2021-10-20T23:48:14.507 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-20T23:48:14.509 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076 --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --name yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/orig.config.yaml 2021-10-20T23:48:14.554 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-20T23:48:14.620 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076 branch: wip-yuri5-testing-2021-10-20-0922-octopus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6453076' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri5-testing-2021-10-20-0922-octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd op complaint time: 180 osd sloppy crc: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3fb760aae831e6138791851b7921f8f0e05db414 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: 3fb760aae831e6138791851b7921f8f0e05db414 workunit: branch: wip-yuri5-testing-2021-10-20-0922-octopus sha1: 3fb760aae831e6138791851b7921f8f0e05db414 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: 3fb760aae831e6138791851b7921f8f0e05db414 sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri5-testing-2021-10-20-0922-octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3fb760aae831e6138791851b7921f8f0e05db414 targets: smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXBwrECUb4DctCX6GYkfL5lSjr8Xfi/oX7E6c7DZ5HxpOn/iLiHa5gXqBgQtu2L+CiRW4cj2kA0///OSKxHJUJ4SaEc8J7MrUfBi6KL6PJgwps8jX78Taw7Qg+VuEfxgLeu7ZFHuG+5z2xPv7/+Bv5lxGkDn2mjsiNpaHaNqnysJsIYlIr3gFxcbOfv1o+KewG65E/srKjC8NqWSsYeuoXEsgRHfYseIEDlVETWoW9A18di4tkQHs376Cy56F2C1z03DxCNfRKwkzO4HApUQOsSYk8R94RAYDcdH5IqA9D6GI7wO/Xg6SrIESAFy2loWImFTmcIE6K2jyiUT+yZNDjT6hpdACEKdX7YMFFIcOWiXWb5IKeLVl79vSy5+7YGmrzBM9O/xPbgdqJVLGJ2gDQVsCUJEEn/Ep+sSKR7VpyvIXjetq6c977Vw55NRyw+wQ8k5wc4XcuEY1D2VaOwLEL19jWTDPlZnJmPnzD/u3UQue/9yK3j7rDHH5jui2dbE= smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgMQL2m/dzc+9R8ONxMqlBE14QZanCqbP5gO93r9/GvnQyL87ui9/wmKYu9uiFyd/JCW1xUfpxgzDJRZ1DA35KWwBkav/UgM5Ene40HKqIBkA2EHM+3Nno37qY2oD3UL30+bJBaycpT3wf5qdF6I4hPvkk6vFCs8nd9PhBQNRFC0lHOOioEQEIyDmknoA49/hGMf+XlB4NfKY9WKuqP0Pm6PmclkoMU8QzveqmqaMW4FpbwbFLlDOyCwVtBp0dAUPoydeQyhDQXK4dtp8pRlGp+lLMlAks5sll53R7q3IC6NND3nxDt/h+WYasVwuWsXdUT4/QVZUgc8saxXJ8O2o3CpjK1GBGhc/2TCbAH2OPoJd2827/tBpZpVLgiBwVF8j1WXkITZOtNZu0E2Aq6TW6pwT+tz47eaKdP65KJ0MFnhQDGzWSSRM9cLbtNIN514SkI144/yPJjjweUZ4vp4zB5UqA/PQ8IquIee2F3gaQYRQhOim27w65UXsPJPgFHi0= smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1+K2Jcu7Dlk/HCzcfsvkfeVCxsebE9fGclQEMdI1/ACX+M5a8fyIu9ws62e8bTtRmVrNdB1HZucQVn4TXCRfvRjOmVcH2qhfzdrIvOS9uxuyQ/tdpVKLg1yCCvzBVtswpEaf4AIT3A1/req8mQGmHVN80N1BglZrKZYoO+1CQWghyC9RP2/vfzVdSoo5tCwQNpHqYTqr3Js7lQglpJSgZBi8NNOZDblfHVzqHvSJmBUYk1XQ46Vpj4YpjT6MKPe5CkJOGobq/B0wrCyOzKU9ZCeFY365HH5O2FPzZe8uwlqWlA4LmjG07wq/II66qq65i7ro6Jcx2ZqkVkY6SmHS39DX9BsADl8/rx549uZXvlqkl3NOSwfceJusziqM/4Y3+sF3pEmzNpEgwvcO0mrZsb32nHR/AlmVdnBiajrvEh0Dz5Z3pQHosRif2XbvIQC/YfRgHBrjX2aH2Nq/KCZHURyc6pcnDCh4Yc9x24z9iglC7m9yRNC5tsRYZCfbv0jc= smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnHhOZvMoITBBm3EyIiisQGGgrQOLMAycNJhBW8cWsx5YlVZd8JgiArE1eEObEAZIbBB0oBbH+WEL6Mt2VFo0JmdxEUsRuzO2OR2kH+Ujh6ri1rvLQyQo8JgkgQcFB3qHzGf/kVTZ9dL7ZpKZHJ4u4prkPSVMX3x0SiG1aexytljbMcCpH8VzloyQRdB1l956c3OMgSgY2tt5DmnomM4V0kpdweYhGsJRsKRHIuqk6TSxvhFP8uoJ87qEEmpK1lRHSk4j9OUBrWj36rq8sveSThzus3lT5V+xpdmP6adCnPPV4phCgovbjkqgIx7bLqwQUo+o0ZIyDQT28QmnDTdDUuwgDu4gKOk1ajYSvOoh/PLwStAZcb0xk3F1BYnuAXiphQH4BHkMLkTwLAqtZiXXPE977QTWt2fTYApJnNFFnEt0YtaXREJnBq3AQpXzOLuUBR7w7zE+Qb99y6ajs74QN5AlHSkyEtst34QGvQlISgFOdIoL1GBGGACL4SDIjTss= smithi102.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC44RhRPsDn1TW0TRIjAwnvrOKS2GSyOL/YpKgq6a9vSFH9FIE7w77yXtLXv+myR5rBzVQe6cQFvNlAoNJ8T35MwZQHVcs5WyoRBVhh0ZxNqNpyHJ3NvMPuKCoHRqMSqilxtAK3xpj00poHicAw9NLz8ofZ/eoqbCv+KWkQ4a26mHI1S5FXd8u6toL2qsKwOj6ZLM1ZIEjzOOoWBZGLSVt+lEblxTHBxGWI1uTYxALTiSeRQEbmkzIW9BCwrQcZkGzRyp5c1XEBJQN6TdjtkH8A8+nynmi2sw4RE1ZvDtpYeUJMZTsYC2RMWSHiV3WGszZT1sH9Zbr30S4V2ikb3jy6OPW5iYBSelw3+/jHiB3rl3dUBE58lQNetF8ZJQ8TvZvOi3jG7ojRI4joddg7e04WIEtqSg59EGc7+3YQZtSmQkX65xYHGgaQb+znZInTcVDB50O+ySL27BYHOHBmhHHQPgxgKzCHSMLNCV7sw9sT2Iney3BhaJqOeo5yDRUnwjs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: b35344e81ac507b6cad7c1cae575ce08b9c766f2 timestamp: 2021-10-20_18:49:58 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.6888 2021-10-20T23:48:14.621 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa; will attempt to use it 2021-10-20T23:48:14.621 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks 2021-10-20T23:48:14.622 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-20T23:48:14.624 INFO:teuthology.task.internal:Checking packages... 2021-10-20T23:48:14.645 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3fb760aae831e6138791851b7921f8f0e05db414' 2021-10-20T23:48:14.645 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-20T23:48:14.646 INFO:teuthology.packaging:ref: None 2021-10-20T23:48:14.646 INFO:teuthology.packaging:tag: None 2021-10-20T23:48:14.647 INFO:teuthology.packaging:branch: wip-yuri5-testing-2021-10-20-0922-octopus 2021-10-20T23:48:14.647 INFO:teuthology.packaging:sha1: 3fb760aae831e6138791851b7921f8f0e05db414 2021-10-20T23:48:14.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri5-testing-2021-10-20-0922-octopus 2021-10-20T23:48:14.812 INFO:teuthology.task.internal:Found packages for ceph version 15.2.14-138-g3fb760aa-1focal 2021-10-20T23:48:14.812 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-20T23:48:14.821 INFO:teuthology.task.internal:no buildpackages task found 2021-10-20T23:48:14.822 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-20T23:48:14.867 INFO:teuthology.task.internal:Saving configuration 2021-10-20T23:48:14.892 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-20T23:48:14.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-20T23:48:14.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi041.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 23:42:03.179208', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHMWQJB8KhOPfKH+FpcNWA0DQtHxOFnGn02ccvrs+dZp'} 2021-10-20T23:48:14.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 23:42:03.179226', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE7PPzEOJNv0qbkS8Kh4khY5gGF8n9TNWFZGEzbkGsfD'} 2021-10-20T23:48:14.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 23:42:03.179172', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO7P12l1LecH2U4f15Ys56IzHqKTF/XFwrmoMgaZBXuk'} 2021-10-20T23:48:14.998 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 23:42:03.179149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJuuZJdGoF+IaXLv4KLoyCjoFPWjyJGmzRRG5gVWd+m2'} 2021-10-20T23:48:15.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-20 23:42:03.179190', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEjGUFTg5Vzy1dFs5LWjrENTtD3jLKq5nyyXduStO5Ps'} 2021-10-20T23:48:15.031 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-20T23:48:15.089 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-10-20T23:48:15.090 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-10-20T23:48:15.090 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['client.0'] 2021-10-20T23:48:15.090 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['client.1'] 2021-10-20T23:48:15.090 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['client.2'] 2021-10-20T23:48:15.091 INFO:teuthology.run_tasks:Running task console_log... 2021-10-20T23:48:15.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd2dd9ecd90>, signals=[15]) 2021-10-20T23:48:15.392 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-20T23:48:15.406 INFO:teuthology.task.internal:Opening connections... 2021-10-20T23:48:15.407 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi041.front.sepia.ceph.com 2021-10-20T23:48:15.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:48:15.511 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2021-10-20T23:48:15.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:48:15.584 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2021-10-20T23:48:15.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:48:15.638 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2021-10-20T23:48:15.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:48:15.707 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2021-10-20T23:48:15.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:48:15.767 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-20T23:48:15.776 DEBUG:teuthology.orchestra.run.smithi041:> uname -m 2021-10-20T23:48:15.783 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2021-10-20T23:48:15.784 DEBUG:teuthology.orchestra.run.smithi041:> cat /etc/os-release 2021-10-20T23:48:15.831 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="Ubuntu" 2021-10-20T23:48:15.831 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:48:15.831 INFO:teuthology.orchestra.run.smithi041.stdout:ID=ubuntu 2021-10-20T23:48:15.832 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE=debian 2021-10-20T23:48:15.832 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:48:15.832 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="20.04" 2021-10-20T23:48:15.832 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:48:15.833 INFO:teuthology.orchestra.run.smithi041.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:48:15.833 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:48:15.833 INFO:teuthology.orchestra.run.smithi041.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:48:15.834 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_CODENAME=focal 2021-10-20T23:48:15.834 INFO:teuthology.orchestra.run.smithi041.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:48:15.835 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2021-10-20T23:48:15.854 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2021-10-20T23:48:15.861 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2021-10-20T23:48:15.861 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2021-10-20T23:48:15.909 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2021-10-20T23:48:15.910 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:48:15.910 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2021-10-20T23:48:15.910 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2021-10-20T23:48:15.910 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:48:15.911 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="20.04" 2021-10-20T23:48:15.911 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:48:15.911 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:48:15.912 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:48:15.912 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:48:15.912 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=focal 2021-10-20T23:48:15.913 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:48:15.913 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-10-20T23:48:15.932 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2021-10-20T23:48:15.941 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2021-10-20T23:48:15.941 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2021-10-20T23:48:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2021-10-20T23:48:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:48:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2021-10-20T23:48:15.990 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2021-10-20T23:48:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:48:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="20.04" 2021-10-20T23:48:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:48:15.991 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:48:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:48:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:48:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=focal 2021-10-20T23:48:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:48:15.993 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-10-20T23:48:16.013 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2021-10-20T23:48:16.021 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2021-10-20T23:48:16.022 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2021-10-20T23:48:16.071 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2021-10-20T23:48:16.072 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:48:16.072 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2021-10-20T23:48:16.072 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2021-10-20T23:48:16.072 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:48:16.073 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2021-10-20T23:48:16.073 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:48:16.073 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:48:16.074 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:48:16.074 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:48:16.074 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2021-10-20T23:48:16.074 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:48:16.075 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2021-10-20T23:48:16.098 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2021-10-20T23:48:16.106 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2021-10-20T23:48:16.106 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2021-10-20T23:48:16.156 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2021-10-20T23:48:16.156 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-20T23:48:16.158 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2021-10-20T23:48:16.158 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2021-10-20T23:48:16.158 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-20T23:48:16.158 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2021-10-20T23:48:16.159 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-20T23:48:16.159 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-20T23:48:16.159 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-20T23:48:16.160 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-20T23:48:16.160 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2021-10-20T23:48:16.160 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2021-10-20T23:48:16.161 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2021-10-20T23:48:16.180 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-20T23:48:16.192 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-20T23:48:16.218 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-20T23:48:16.219 DEBUG:teuthology.orchestra.run.smithi041:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:48:16.222 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:48:16.224 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:48:16.227 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:48:16.231 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2021-10-20T23:48:16.239 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-20T23:48:16.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-20T23:48:16.257 DEBUG:teuthology.orchestra.run.smithi041:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:48:16.260 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:48:16.264 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:48:16.278 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:48:16.280 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2021-10-20T23:48:16.299 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-20T23:48:16.419 INFO:teuthology.run_tasks:Running task kernel... 2021-10-20T23:48:16.436 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-20T23:48:16.437 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-20T23:48:16.437 DEBUG:teuthology.orchestra.run.smithi041:> uname -r 2021-10-20T23:48:16.444 INFO:teuthology.orchestra.run.smithi041.stdout:5.4.0-88-generic 2021-10-20T23:48:16.446 INFO:teuthology.task.kernel:Running kernel on smithi041: 5.4.0-88-generic 2021-10-20T23:48:16.446 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-get clean 2021-10-20T23:48:16.536 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-get update 2021-10-20T23:48:16.709 INFO:teuthology.orchestra.run.smithi041.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:48:16.818 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:48:16.901 INFO:teuthology.orchestra.run.smithi041.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:48:17.024 INFO:teuthology.orchestra.run.smithi041.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:48:17.098 INFO:teuthology.orchestra.run.smithi041.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:48:17.138 INFO:teuthology.orchestra.run.smithi041.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:48:17.141 INFO:teuthology.orchestra.run.smithi041.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:48:17.142 INFO:teuthology.orchestra.run.smithi041.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:48:17.154 INFO:teuthology.orchestra.run.smithi041.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:48:17.155 INFO:teuthology.orchestra.run.smithi041.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:48:17.160 INFO:teuthology.orchestra.run.smithi041.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:48:17.165 INFO:teuthology.orchestra.run.smithi041.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:48:17.166 INFO:teuthology.orchestra.run.smithi041.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:48:17.246 INFO:teuthology.orchestra.run.smithi041.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:48:17.379 INFO:teuthology.orchestra.run.smithi041.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:48:17.613 INFO:teuthology.orchestra.run.smithi041.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:48:17.753 INFO:teuthology.orchestra.run.smithi041.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:48:17.774 INFO:teuthology.orchestra.run.smithi041.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:48:17.775 INFO:teuthology.orchestra.run.smithi041.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:48:17.776 INFO:teuthology.orchestra.run.smithi041.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:48:17.797 INFO:teuthology.orchestra.run.smithi041.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:48:17.801 INFO:teuthology.orchestra.run.smithi041.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:48:17.801 INFO:teuthology.orchestra.run.smithi041.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:48:17.840 INFO:teuthology.orchestra.run.smithi041.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:48:17.863 INFO:teuthology.orchestra.run.smithi041.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:48:17.868 INFO:teuthology.orchestra.run.smithi041.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:48:17.919 INFO:teuthology.orchestra.run.smithi041.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:48:17.919 INFO:teuthology.orchestra.run.smithi041.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:48:17.920 INFO:teuthology.orchestra.run.smithi041.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:48:17.920 INFO:teuthology.orchestra.run.smithi041.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:48:21.370 INFO:teuthology.orchestra.run.smithi041.stdout:Fetched 8,065 kB in 2s (5,053 kB/s) 2021-10-20T23:48:22.535 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-20T23:48:22.559 DEBUG:teuthology.orchestra.run.smithi041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:48:22.627 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-20T23:48:22.796 INFO:teuthology.orchestra.run.smithi041.stdout:Building dependency tree... 2021-10-20T23:48:22.797 INFO:teuthology.orchestra.run.smithi041.stdout:Reading state information... 2021-10-20T23:48:22.946 INFO:teuthology.orchestra.run.smithi041.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:48:22.947 INFO:teuthology.orchestra.run.smithi041.stdout: libllvm11 2021-10-20T23:48:22.947 INFO:teuthology.orchestra.run.smithi041.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:48:22.947 INFO:teuthology.orchestra.run.smithi041.stdout:The following additional packages will be installed: 2021-10-20T23:48:22.948 INFO:teuthology.orchestra.run.smithi041.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:48:22.948 INFO:teuthology.orchestra.run.smithi041.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:48:22.948 INFO:teuthology.orchestra.run.smithi041.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:48:22.948 INFO:teuthology.orchestra.run.smithi041.stdout:Suggested packages: 2021-10-20T23:48:22.949 INFO:teuthology.orchestra.run.smithi041.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:48:22.949 INFO:teuthology.orchestra.run.smithi041.stdout:Recommended packages: 2021-10-20T23:48:22.949 INFO:teuthology.orchestra.run.smithi041.stdout: thermald 2021-10-20T23:48:23.018 INFO:teuthology.orchestra.run.smithi041.stdout:The following NEW packages will be installed: 2021-10-20T23:48:23.018 INFO:teuthology.orchestra.run.smithi041.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:48:23.019 INFO:teuthology.orchestra.run.smithi041.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:48:23.020 INFO:teuthology.orchestra.run.smithi041.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:48:23.021 INFO:teuthology.orchestra.run.smithi041.stdout:The following packages will be upgraded: 2021-10-20T23:48:23.021 INFO:teuthology.orchestra.run.smithi041.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:48:23.198 INFO:teuthology.orchestra.run.smithi041.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:48:23.199 INFO:teuthology.orchestra.run.smithi041.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:48:23.199 INFO:teuthology.orchestra.run.smithi041.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:48:23.199 INFO:teuthology.orchestra.run.smithi041.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:48:24.299 INFO:teuthology.orchestra.run.smithi041.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:48:24.560 INFO:teuthology.orchestra.run.smithi041.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:48:25.845 INFO:teuthology.orchestra.run.smithi041.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:48:25.846 INFO:teuthology.orchestra.run.smithi041.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:48:25.846 INFO:teuthology.orchestra.run.smithi041.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:48:26.150 INFO:teuthology.orchestra.run.smithi041.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:48:26.166 INFO:teuthology.orchestra.run.smithi041.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:48:26.634 INFO:teuthology.orchestra.run.smithi041.stdout:Fetched 75.6 MB in 3s (24.0 MB/s) 2021-10-20T23:48:26.809 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:48:28.610 INFO:teuthology.orchestra.run.smithi041.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:48:28.616 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:48:28.718 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:30.723 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:48:30.743 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:48:30.855 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:31.872 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:48:31.889 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:48:31.927 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:37.021 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:48:37.159 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:48:37.466 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:48:37.619 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:48:37.932 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:48:37.950 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:48:37.984 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:48:45.027 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:48:45.052 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:48:45.093 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:47.877 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:48:48.404 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:48:48.748 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:50.000 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:51.140 INFO:teuthology.orchestra.run.smithi041.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:48:51.140 INFO:teuthology.orchestra.run.smithi041.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:48:51.141 INFO:teuthology.orchestra.run.smithi041.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:48:51.141 INFO:teuthology.orchestra.run.smithi041.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:48:51.278 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:48:51.404 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:51.538 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:52.706 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:48:52.823 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:48:52.949 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:48:53.076 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:48:53.359 INFO:teuthology.orchestra.run.smithi041.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:48:53.359 INFO:teuthology.orchestra.run.smithi041.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:49:16.494 INFO:teuthology.orchestra.run.smithi041.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:49:16.495 INFO:teuthology.orchestra.run.smithi041.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:49:16.508 INFO:teuthology.orchestra.run.smithi041.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:49:16.547 INFO:teuthology.orchestra.run.smithi041.stdout:Generating grub configuration file ... 2021-10-20T23:49:16.897 INFO:teuthology.orchestra.run.smithi041.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:49:16.924 INFO:teuthology.orchestra.run.smithi041.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:49:17.323 INFO:teuthology.orchestra.run.smithi041.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:49:17.334 INFO:teuthology.orchestra.run.smithi041.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:49:17.455 INFO:teuthology.orchestra.run.smithi041.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:49:17.467 INFO:teuthology.orchestra.run.smithi041.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:49:20.137 INFO:teuthology.orchestra.run.smithi041.stdout:done 2021-10-20T23:49:20.504 DEBUG:teuthology.orchestra.run.smithi041:> dpkg -s linux-image-generic 2021-10-20T23:49:20.536 INFO:teuthology.orchestra.run.smithi041.stdout:Package: linux-image-generic 2021-10-20T23:49:20.537 INFO:teuthology.orchestra.run.smithi041.stdout:Status: install ok installed 2021-10-20T23:49:20.537 INFO:teuthology.orchestra.run.smithi041.stdout:Priority: optional 2021-10-20T23:49:20.537 INFO:teuthology.orchestra.run.smithi041.stdout:Section: kernel 2021-10-20T23:49:20.537 INFO:teuthology.orchestra.run.smithi041.stdout:Installed-Size: 18 2021-10-20T23:49:20.538 INFO:teuthology.orchestra.run.smithi041.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:49:20.538 INFO:teuthology.orchestra.run.smithi041.stdout:Architecture: amd64 2021-10-20T23:49:20.538 INFO:teuthology.orchestra.run.smithi041.stdout:Source: linux-meta 2021-10-20T23:49:20.538 INFO:teuthology.orchestra.run.smithi041.stdout:Version: 5.4.0.89.93 2021-10-20T23:49:20.538 INFO:teuthology.orchestra.run.smithi041.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:49:20.539 INFO:teuthology.orchestra.run.smithi041.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:49:20.539 INFO:teuthology.orchestra.run.smithi041.stdout:Recommends: thermald 2021-10-20T23:49:20.539 INFO:teuthology.orchestra.run.smithi041.stdout:Description: Generic Linux kernel image 2021-10-20T23:49:20.540 INFO:teuthology.orchestra.run.smithi041.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:49:20.540 INFO:teuthology.orchestra.run.smithi041.stdout: available. 2021-10-20T23:49:20.540 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:49:20.541 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2021-10-20T23:49:20.548 INFO:teuthology.orchestra.run.smithi062.stdout:5.4.0-88-generic 2021-10-20T23:49:20.548 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.4.0-88-generic 2021-10-20T23:49:20.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2021-10-20T23:49:20.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-10-20T23:49:20.803 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:49:20.897 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:49:20.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:49:21.078 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:49:21.149 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:49:21.187 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:49:21.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:49:21.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:49:21.204 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:49:21.204 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:49:21.209 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:49:21.214 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:49:21.215 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:49:21.313 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:49:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:49:21.787 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:49:21.810 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:49:21.822 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:49:21.823 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:49:21.843 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:49:21.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:49:21.869 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:49:21.869 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:49:21.895 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:49:21.928 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:49:21.932 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:49:21.978 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:49:21.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:49:21.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:49:21.980 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:49:25.560 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 8,065 kB in 2s (5,308 kB/s) 2021-10-20T23:49:26.740 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-20T23:49:26.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:49:26.837 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-20T23:49:27.006 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-10-20T23:49:27.007 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-10-20T23:49:27.159 INFO:teuthology.orchestra.run.smithi062.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:49:27.160 INFO:teuthology.orchestra.run.smithi062.stdout: libllvm11 2021-10-20T23:49:27.161 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:49:27.161 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2021-10-20T23:49:27.161 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:49:27.161 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:49:27.162 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:49:27.162 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-10-20T23:49:27.163 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:49:27.163 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2021-10-20T23:49:27.163 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2021-10-20T23:49:27.216 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-10-20T23:49:27.216 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:49:27.216 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:49:27.217 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:49:27.217 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2021-10-20T23:49:27.218 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:49:27.400 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:49:27.401 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:49:27.401 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:49:27.401 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:49:28.473 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:49:28.674 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:49:30.054 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:49:30.055 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:49:30.055 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:49:30.752 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:49:30.859 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:49:31.300 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 75.6 MB in 4s (20.8 MB/s) 2021-10-20T23:49:31.500 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:49:33.302 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:49:33.309 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:49:33.561 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:49:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:49:35.994 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:36.726 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:49:36.743 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:49:36.789 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:42.296 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:49:42.417 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:49:42.765 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:49:42.888 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:49:43.248 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:49:43.264 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:49:43.306 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:49:49.727 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:49:49.752 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:49:49.793 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:53.077 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:49:53.201 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:49:53.571 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:54.857 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:56.032 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:49:56.032 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:49:56.033 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:49:56.033 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:49:56.193 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:49:56.310 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:56.436 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:57.930 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:49:58.056 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:49:58.207 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:49:58.333 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:49:58.524 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:49:58.525 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:50:20.984 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:50:20.985 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:50:21.008 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:50:21.039 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2021-10-20T23:50:21.402 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:50:21.435 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:50:21.883 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:50:21.896 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:50:22.008 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:50:22.020 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:50:24.804 INFO:teuthology.orchestra.run.smithi062.stdout:done 2021-10-20T23:50:25.216 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2021-10-20T23:50:25.249 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2021-10-20T23:50:25.249 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2021-10-20T23:50:25.250 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2021-10-20T23:50:25.250 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2021-10-20T23:50:25.250 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 18 2021-10-20T23:50:25.250 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:50:25.251 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2021-10-20T23:50:25.251 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2021-10-20T23:50:25.251 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.4.0.89.93 2021-10-20T23:50:25.251 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:50:25.252 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:50:25.252 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2021-10-20T23:50:25.252 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2021-10-20T23:50:25.253 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:50:25.253 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2021-10-20T23:50:25.253 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:50:25.254 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2021-10-20T23:50:25.261 INFO:teuthology.orchestra.run.smithi071.stdout:5.4.0-88-generic 2021-10-20T23:50:25.262 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.4.0-88-generic 2021-10-20T23:50:25.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2021-10-20T23:50:25.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2021-10-20T23:50:25.559 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:50:25.668 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:50:25.751 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:50:25.845 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:50:25.914 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:50:25.954 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:50:25.964 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:50:25.965 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:50:25.965 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:50:25.965 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:50:25.974 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:50:25.981 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:50:25.982 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:50:26.095 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:50:26.226 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:50:26.469 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:50:26.606 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:50:26.625 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:50:26.627 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:50:26.628 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:50:26.650 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:50:26.653 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:50:26.654 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:50:26.683 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:50:26.715 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:50:26.720 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:50:26.773 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:50:26.774 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:50:26.774 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:50:26.774 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:50:29.945 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 8,065 kB in 2s (5,095 kB/s) 2021-10-20T23:50:31.160 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-20T23:50:31.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:50:31.254 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-20T23:50:31.419 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2021-10-20T23:50:31.420 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2021-10-20T23:50:31.564 INFO:teuthology.orchestra.run.smithi071.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:50:31.565 INFO:teuthology.orchestra.run.smithi071.stdout: libllvm11 2021-10-20T23:50:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:50:31.566 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2021-10-20T23:50:31.566 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:50:31.567 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:50:31.567 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:50:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2021-10-20T23:50:31.568 INFO:teuthology.orchestra.run.smithi071.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:50:31.568 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2021-10-20T23:50:31.568 INFO:teuthology.orchestra.run.smithi071.stdout: thermald 2021-10-20T23:50:31.625 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2021-10-20T23:50:31.626 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:50:31.626 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:50:31.626 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:50:31.627 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages will be upgraded: 2021-10-20T23:50:31.627 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:50:31.808 INFO:teuthology.orchestra.run.smithi071.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:50:31.808 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:50:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:50:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:50:32.909 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:50:33.117 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:50:34.461 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:50:34.463 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:50:34.464 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:50:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:50:34.763 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:50:35.220 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 75.6 MB in 3s (24.1 MB/s) 2021-10-20T23:50:35.408 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:50:37.229 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:50:37.236 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:50:37.377 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:39.428 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:50:39.445 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:50:39.535 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:40.555 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:50:40.575 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:50:40.613 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:45.698 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:50:45.821 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:50:46.193 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:50:46.324 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:50:46.667 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:50:46.685 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:50:46.728 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:50:52.738 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:50:52.763 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:50:52.804 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:55.378 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:50:55.504 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:50:55.856 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:57.052 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:58.154 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:50:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:50:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:50:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:50:58.296 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:50:58.422 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:58.548 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:50:59.725 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:51:00.392 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:51:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:51:01.978 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:51:02.181 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:51:02.182 INFO:teuthology.orchestra.run.smithi071.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:51:24.174 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:51:24.174 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:51:24.189 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:51:24.225 INFO:teuthology.orchestra.run.smithi071.stdout:Generating grub configuration file ... 2021-10-20T23:51:24.522 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:51:24.552 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:51:24.932 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:51:24.944 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:51:25.054 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:51:25.066 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:51:27.733 INFO:teuthology.orchestra.run.smithi071.stdout:done 2021-10-20T23:51:28.144 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2021-10-20T23:51:28.176 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2021-10-20T23:51:28.176 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2021-10-20T23:51:28.176 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2021-10-20T23:51:28.176 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2021-10-20T23:51:28.177 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 18 2021-10-20T23:51:28.177 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:51:28.177 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2021-10-20T23:51:28.177 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2021-10-20T23:51:28.178 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.4.0.89.93 2021-10-20T23:51:28.178 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:51:28.178 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:51:28.178 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2021-10-20T23:51:28.179 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2021-10-20T23:51:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:51:28.179 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2021-10-20T23:51:28.179 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:51:28.180 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2021-10-20T23:51:28.187 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-88-generic 2021-10-20T23:51:28.187 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.4.0-88-generic 2021-10-20T23:51:28.188 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2021-10-20T23:51:28.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-10-20T23:51:28.487 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:51:28.575 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:51:28.658 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:51:28.791 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:51:28.868 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:51:28.931 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:51:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:51:28.936 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:51:28.945 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:51:28.947 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:51:28.961 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:51:28.970 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:51:28.976 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:51:29.006 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:51:29.136 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:51:29.507 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:51:29.531 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:51:29.542 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:51:29.542 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:51:29.566 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:51:29.567 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:51:29.621 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:51:29.622 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:51:29.745 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:51:29.762 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:51:29.763 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:51:29.764 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:51:29.765 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:51:29.765 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:51:29.765 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:51:32.879 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 8,065 kB in 2s (5,179 kB/s) 2021-10-20T23:51:34.048 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-20T23:51:34.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:51:34.138 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-20T23:51:34.304 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-10-20T23:51:34.305 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-10-20T23:51:34.438 INFO:teuthology.orchestra.run.smithi099.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:51:34.439 INFO:teuthology.orchestra.run.smithi099.stdout: libllvm11 2021-10-20T23:51:34.439 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:51:34.440 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2021-10-20T23:51:34.440 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:51:34.440 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:51:34.440 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:51:34.441 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2021-10-20T23:51:34.441 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:51:34.441 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2021-10-20T23:51:34.442 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2021-10-20T23:51:34.477 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2021-10-20T23:51:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:51:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:51:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:51:34.478 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2021-10-20T23:51:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:51:34.659 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:51:34.659 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:51:34.659 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:51:34.660 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:51:35.739 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:51:35.956 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:51:37.302 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:51:37.302 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:51:37.303 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:51:37.595 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:51:37.630 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:51:38.064 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 75.6 MB in 3s (24.0 MB/s) 2021-10-20T23:51:38.268 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:51:40.113 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:51:40.120 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:51:40.297 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:51:42.262 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:51:42.279 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:51:42.413 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:51:43.425 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:51:43.442 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:51:43.484 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:51:48.572 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:51:48.711 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:51:49.043 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:51:49.188 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:51:49.499 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:51:49.519 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:51:49.564 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:51:55.976 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:51:56.001 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:51:56.042 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:51:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:51:58.792 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:51:59.170 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:00.347 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:01.484 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:52:01.594 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:52:01.594 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:52:01.594 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:52:01.623 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:52:01.758 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:01.884 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:03.969 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:52:04.095 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:52:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:52:04.381 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:04.582 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:52:04.582 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:52:26.820 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:52:26.820 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:52:26.835 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:52:26.871 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2021-10-20T23:52:27.217 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:52:27.244 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:52:27.671 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:52:27.682 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:52:27.791 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:52:27.802 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:52:30.525 INFO:teuthology.orchestra.run.smithi099.stdout:done 2021-10-20T23:52:30.931 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2021-10-20T23:52:30.980 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2021-10-20T23:52:30.980 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2021-10-20T23:52:30.980 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2021-10-20T23:52:30.981 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2021-10-20T23:52:30.981 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 18 2021-10-20T23:52:30.981 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:52:30.981 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2021-10-20T23:52:30.982 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2021-10-20T23:52:30.982 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.89.93 2021-10-20T23:52:30.982 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:52:30.982 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:52:30.983 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2021-10-20T23:52:30.983 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2021-10-20T23:52:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:52:30.983 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2021-10-20T23:52:30.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:52:30.984 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2021-10-20T23:52:30.991 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-88-generic 2021-10-20T23:52:30.992 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.4.0-88-generic 2021-10-20T23:52:30.992 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2021-10-20T23:52:31.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-10-20T23:52:31.287 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-10-20T23:52:31.401 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:52:31.486 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-10-20T23:52:31.573 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [296 kB] 2021-10-20T23:52:31.631 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [935 kB] 2021-10-20T23:52:31.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [177 kB] 2021-10-20T23:52:31.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,840 B] 2021-10-20T23:52:31.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [475 kB] 2021-10-20T23:52:31.673 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [68.3 kB] 2021-10-20T23:52:31.674 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [512 kB] 2021-10-20T23:52:31.681 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [646 kB] 2021-10-20T23:52:31.687 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [106 kB] 2021-10-20T23:52:31.688 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.7 kB] 2021-10-20T23:52:31.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-10-20T23:52:31.964 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,294 kB] 2021-10-20T23:52:32.254 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [550 kB] 2021-10-20T23:52:32.301 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [269 kB] 2021-10-20T23:52:32.318 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.4 kB] 2021-10-20T23:52:32.319 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.4 kB] 2021-10-20T23:52:32.319 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [522 kB] 2021-10-20T23:52:32.347 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [74.8 kB] 2021-10-20T23:52:32.352 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-10-20T23:52:32.353 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [642 kB] 2021-10-20T23:52:32.381 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [867 kB] 2021-10-20T23:52:32.412 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [186 kB] 2021-10-20T23:52:32.435 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.3 kB] 2021-10-20T23:52:32.436 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-10-20T23:52:32.436 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-10-20T23:52:32.437 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-10-20T23:52:32.437 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-10-20T23:52:35.807 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 8,065 kB in 2s (5,141 kB/s) 2021-10-20T23:52:36.984 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-20T23:52:37.006 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:52:37.070 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-20T23:52:37.217 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-10-20T23:52:37.218 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-10-20T23:52:37.346 INFO:teuthology.orchestra.run.smithi102.stdout:The following package was automatically installed and is no longer required: 2021-10-20T23:52:37.347 INFO:teuthology.orchestra.run.smithi102.stdout: libllvm11 2021-10-20T23:52:37.347 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove it. 2021-10-20T23:52:37.348 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2021-10-20T23:52:37.348 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:52:37.348 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.4.0-89-generic 2021-10-20T23:52:37.348 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.4.0-89-generic linux-modules-extra-5.4.0-89-generic 2021-10-20T23:52:37.349 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-10-20T23:52:37.349 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-10-20T23:52:37.349 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2021-10-20T23:52:37.350 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2021-10-20T23:52:37.401 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-10-20T23:52:37.402 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.4.0-89 linux-headers-5.4.0-89-generic 2021-10-20T23:52:37.402 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-89-generic linux-modules-5.4.0-89-generic 2021-10-20T23:52:37.402 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-89-generic 2021-10-20T23:52:37.403 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2021-10-20T23:52:37.403 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2021-10-20T23:52:37.585 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:52:37.585 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 75.6 MB of archives. 2021-10-20T23:52:37.586 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 378 MB of additional disk space will be used. 2021-10-20T23:52:37.586 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-89-generic amd64 5.4.0-89.100 [14.8 MB] 2021-10-20T23:52:38.652 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-89-generic amd64 5.4.0-89.100 [8,990 kB] 2021-10-20T23:52:38.883 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-89-generic amd64 5.4.0-89.100 [39.4 MB] 2021-10-20T23:52:40.279 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.89.93 [1,900 B] 2021-10-20T23:52:40.279 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.89.93 [2,576 B] 2021-10-20T23:52:40.279 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89 all 5.4.0-89.100 [11.0 MB] 2021-10-20T23:52:40.611 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-89-generic amd64 5.4.0-89.100 [1,391 kB] 2021-10-20T23:52:40.669 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.89.93 [2,436 B] 2021-10-20T23:52:41.108 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 75.6 MB in 3s (23.2 MB/s) 2021-10-20T23:52:41.302 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.4.0-89-generic. 2021-10-20T23:52:43.153 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-10-20T23:52:43.158 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:52:43.335 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:45.364 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.4.0-89-generic. 2021-10-20T23:52:45.382 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:52:45.497 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:46.525 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-89-generic. 2021-10-20T23:52:46.540 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:52:46.608 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:52:51.833 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:52:51.962 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:52:52.331 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:52:52.454 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:52:52.811 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-89. 2021-10-20T23:52:52.827 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.4.0-89_5.4.0-89.100_all.deb ... 2021-10-20T23:52:52.879 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:52:59.013 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-89-generic. 2021-10-20T23:52:59.037 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.4.0-89-generic_5.4.0-89.100_amd64.deb ... 2021-10-20T23:52:59.071 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:01.679 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.89.93_amd64.deb ... 2021-10-20T23:53:01.812 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.4.0.89.93) over (5.4.0.88.92) ... 2021-10-20T23:53:02.189 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:03.751 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:04.889 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:04.890 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:04.890 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:04.890 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:05.045 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-89 (5.4.0-89.100) ... 2021-10-20T23:53:05.171 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:05.297 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:06.490 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.4.0.89.93) ... 2021-10-20T23:53:06.650 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.4.0.89.93) ... 2021-10-20T23:53:06.776 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.4.0.89.93) ... 2021-10-20T23:53:06.922 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.4.0-89-generic (5.4.0-89.100) ... 2021-10-20T23:53:07.133 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-10-20T23:53:07.134 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:29.484 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-10-20T23:53:29.485 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2021-10-20T23:53:29.501 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:53:29.532 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2021-10-20T23:53:29.911 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:29.941 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:30.372 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:30.383 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:30.497 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:53:30.509 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:53:33.176 INFO:teuthology.orchestra.run.smithi102.stdout:done 2021-10-20T23:53:33.597 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2021-10-20T23:53:33.627 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2021-10-20T23:53:33.628 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2021-10-20T23:53:33.628 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2021-10-20T23:53:33.628 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2021-10-20T23:53:33.628 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 18 2021-10-20T23:53:33.629 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:53:33.629 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2021-10-20T23:53:33.629 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2021-10-20T23:53:33.629 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.89.93 2021-10-20T23:53:33.629 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:53:33.630 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:53:33.630 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2021-10-20T23:53:33.630 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2021-10-20T23:53:33.630 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:53:33.631 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2021-10-20T23:53:33.631 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-89-generic 2021-10-20T23:53:33.631 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-20T23:53:33.632 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:53:33.632 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:53:33.632 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:53:33.632 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:53:33.633 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-20T23:53:33.633 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-20T23:53:33.634 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi041.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:53:33.634 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-get clean 2021-10-20T23:53:33.768 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-get update 2021-10-20T23:53:33.906 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:53:34.081 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:53:34.192 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:53:34.306 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:53:35.456 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-20T23:53:35.479 DEBUG:teuthology.orchestra.run.smithi041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:53:35.549 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-20T23:53:35.702 INFO:teuthology.orchestra.run.smithi041.stdout:Building dependency tree... 2021-10-20T23:53:35.702 INFO:teuthology.orchestra.run.smithi041.stdout:Reading state information... 2021-10-20T23:53:35.833 INFO:teuthology.orchestra.run.smithi041.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:53:35.833 INFO:teuthology.orchestra.run.smithi041.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:53:35.833 INFO:teuthology.orchestra.run.smithi041.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:53:35.834 INFO:teuthology.orchestra.run.smithi041.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:53:35.834 INFO:teuthology.orchestra.run.smithi041.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:53:35.834 INFO:teuthology.orchestra.run.smithi041.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:53:35.871 INFO:teuthology.orchestra.run.smithi041.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:53:35.874 DEBUG:teuthology.orchestra.run.smithi041:> dpkg -s linux-image-generic 2021-10-20T23:53:35.893 INFO:teuthology.orchestra.run.smithi041.stdout:Package: linux-image-generic 2021-10-20T23:53:35.894 INFO:teuthology.orchestra.run.smithi041.stdout:Status: install ok installed 2021-10-20T23:53:35.894 INFO:teuthology.orchestra.run.smithi041.stdout:Priority: optional 2021-10-20T23:53:35.894 INFO:teuthology.orchestra.run.smithi041.stdout:Section: kernel 2021-10-20T23:53:35.894 INFO:teuthology.orchestra.run.smithi041.stdout:Installed-Size: 18 2021-10-20T23:53:35.895 INFO:teuthology.orchestra.run.smithi041.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:53:35.895 INFO:teuthology.orchestra.run.smithi041.stdout:Architecture: amd64 2021-10-20T23:53:35.895 INFO:teuthology.orchestra.run.smithi041.stdout:Source: linux-meta 2021-10-20T23:53:35.895 INFO:teuthology.orchestra.run.smithi041.stdout:Version: 5.4.0.89.93 2021-10-20T23:53:35.895 INFO:teuthology.orchestra.run.smithi041.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:53:35.896 INFO:teuthology.orchestra.run.smithi041.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:53:35.896 INFO:teuthology.orchestra.run.smithi041.stdout:Recommends: thermald 2021-10-20T23:53:35.896 INFO:teuthology.orchestra.run.smithi041.stdout:Description: Generic Linux kernel image 2021-10-20T23:53:35.896 INFO:teuthology.orchestra.run.smithi041.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:53:35.897 INFO:teuthology.orchestra.run.smithi041.stdout: available. 2021-10-20T23:53:35.897 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-20T23:53:35.902 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.b8kOnZpdT8 2021-10-20T23:53:35.902 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /boot/grub/grub.cfg /tmp/tmp.b8kOnZpdT8 2021-10-20T23:53:35.911 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.b8kOnZpdT8 2021-10-20T23:53:36.005 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.b8kOnZpdT8 is 10KB 2021-10-20T23:53:36.028 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.b8kOnZpdT8 2021-10-20T23:53:36.036 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:36.091 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-20T23:53:36.092 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:53:36.093 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:36.147 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:53:36.147 DEBUG:teuthology.orchestra.run.smithi041:> sudo update-grub 2021-10-20T23:53:37.380 INFO:teuthology.orchestra.run.smithi041.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:53:37.382 INFO:teuthology.orchestra.run.smithi041.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:53:37.412 INFO:teuthology.orchestra.run.smithi041.stderr:Generating grub configuration file ... 2021-10-20T23:53:37.654 INFO:teuthology.orchestra.run.smithi041.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:37.665 INFO:teuthology.orchestra.run.smithi041.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:38.375 INFO:teuthology.orchestra.run.smithi041.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:38.385 INFO:teuthology.orchestra.run.smithi041.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:38.466 INFO:teuthology.orchestra.run.smithi041.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:53:38.474 INFO:teuthology.orchestra.run.smithi041.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:53:40.132 INFO:teuthology.orchestra.run.smithi041.stderr:done 2021-10-20T23:53:40.134 DEBUG:teuthology.orchestra.run.smithi041:> sudo shutdown -r now 2021-10-20T23:53:40.136 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-10-20T23:53:40.137 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:53:40.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2021-10-20T23:53:40.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-10-20T23:53:40.434 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:53:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:53:40.635 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:53:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:53:41.995 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-20T23:53:42.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:53:42.087 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-20T23:53:42.257 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-10-20T23:53:42.258 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-10-20T23:53:42.406 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:53:42.406 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:53:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:53:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:53:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:53:42.407 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:53:42.445 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:53:42.447 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2021-10-20T23:53:42.463 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2021-10-20T23:53:42.463 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2021-10-20T23:53:42.464 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2021-10-20T23:53:42.464 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2021-10-20T23:53:42.464 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 18 2021-10-20T23:53:42.464 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:53:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2021-10-20T23:53:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2021-10-20T23:53:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.4.0.89.93 2021-10-20T23:53:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:53:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:53:42.466 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2021-10-20T23:53:42.466 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2021-10-20T23:53:42.466 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:53:42.466 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2021-10-20T23:53:42.467 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-20T23:53:42.512 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.t8diQB0SlS 2021-10-20T23:53:42.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.t8diQB0SlS 2021-10-20T23:53:42.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.t8diQB0SlS 2021-10-20T23:53:42.604 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.t8diQB0SlS is 10KB 2021-10-20T23:53:42.619 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.t8diQB0SlS 2021-10-20T23:53:42.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:42.682 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-20T23:53:42.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:53:42.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:42.732 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:53:42.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2021-10-20T23:53:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:53:43.873 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:53:43.904 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2021-10-20T23:53:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:44.168 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:44.503 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:44.612 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:53:44.623 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:53:46.285 INFO:teuthology.orchestra.run.smithi062.stderr:done 2021-10-20T23:53:46.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2021-10-20T23:53:46.289 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-10-20T23:53:46.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:53:46.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2021-10-20T23:53:46.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2021-10-20T23:53:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:53:46.709 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:53:46.791 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:53:46.880 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:53:48.115 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-20T23:53:48.133 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:53:48.198 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-20T23:53:48.365 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2021-10-20T23:53:48.366 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2021-10-20T23:53:48.506 INFO:teuthology.orchestra.run.smithi071.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:53:48.506 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:53:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:53:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:53:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:53:48.507 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:53:48.545 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:53:48.547 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2021-10-20T23:53:48.566 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2021-10-20T23:53:48.566 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2021-10-20T23:53:48.567 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2021-10-20T23:53:48.567 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2021-10-20T23:53:48.567 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 18 2021-10-20T23:53:48.567 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:53:48.568 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2021-10-20T23:53:48.568 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2021-10-20T23:53:48.568 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.4.0.89.93 2021-10-20T23:53:48.568 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:53:48.569 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:53:48.569 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2021-10-20T23:53:48.569 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2021-10-20T23:53:48.569 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:53:48.569 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2021-10-20T23:53:48.570 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2021-10-20T23:53:48.575 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.reDxErapiI 2021-10-20T23:53:48.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub/grub.cfg /tmp/tmp.reDxErapiI 2021-10-20T23:53:48.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.reDxErapiI 2021-10-20T23:53:48.677 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.reDxErapiI is 10KB 2021-10-20T23:53:48.691 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.reDxErapiI 2021-10-20T23:53:48.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:48.754 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-20T23:53:48.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:53:48.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:48.804 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:53:48.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo update-grub 2021-10-20T23:53:50.015 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:53:50.016 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:53:50.034 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2021-10-20T23:53:50.280 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:50.681 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:50.693 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:50.788 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:53:50.800 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:53:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:done 2021-10-20T23:53:52.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2021-10-20T23:53:52.430 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-10-20T23:53:52.430 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:53:52.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2021-10-20T23:53:52.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-10-20T23:53:52.799 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:53:52.908 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:53:52.990 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:53:53.073 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:53:54.310 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-20T23:53:54.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:53:54.399 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-20T23:53:54.564 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-10-20T23:53:54.565 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-10-20T23:53:54.693 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:53:54.694 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:53:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:53:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:53:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:53:54.695 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:53:54.731 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:53:54.733 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2021-10-20T23:53:54.753 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2021-10-20T23:53:54.753 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2021-10-20T23:53:54.754 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2021-10-20T23:53:54.754 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2021-10-20T23:53:54.754 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 18 2021-10-20T23:53:54.754 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:53:54.755 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2021-10-20T23:53:54.755 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2021-10-20T23:53:54.755 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.89.93 2021-10-20T23:53:54.755 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:53:54.756 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:53:54.756 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2021-10-20T23:53:54.756 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2021-10-20T23:53:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:53:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2021-10-20T23:53:54.757 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2021-10-20T23:53:54.762 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.wt6OIz2EZL 2021-10-20T23:53:54.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wt6OIz2EZL 2021-10-20T23:53:54.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.wt6OIz2EZL 2021-10-20T23:53:54.863 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.wt6OIz2EZL is 10KB 2021-10-20T23:53:54.878 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.wt6OIz2EZL 2021-10-20T23:53:54.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:54.939 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-20T23:53:54.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:53:54.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:53:54.992 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:53:54.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2021-10-20T23:53:56.194 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:53:56.195 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:53:56.218 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2021-10-20T23:53:56.465 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:53:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:53:56.877 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:53:56.888 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:53:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:53:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:53:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:done 2021-10-20T23:53:58.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2021-10-20T23:53:58.653 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-10-20T23:53:58.653 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2021-10-20T23:53:58.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2021-10-20T23:53:58.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-10-20T23:53:58.915 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-20T23:53:59.044 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-20T23:53:59.127 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-20T23:53:59.213 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-20T23:54:00.429 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-20T23:54:00.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-10-20T23:54:00.514 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-20T23:54:00.680 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-10-20T23:54:00.680 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-10-20T23:54:00.814 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.4.0.89.93). 2021-10-20T23:54:00.814 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2021-10-20T23:54:00.815 INFO:teuthology.orchestra.run.smithi102.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-20T23:54:00.815 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-20T23:54:00.815 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-20T23:54:00.816 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-20T23:54:00.850 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 39 not upgraded. 2021-10-20T23:54:00.851 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2021-10-20T23:54:00.874 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2021-10-20T23:54:00.874 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2021-10-20T23:54:00.874 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2021-10-20T23:54:00.875 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2021-10-20T23:54:00.875 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 18 2021-10-20T23:54:00.875 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2021-10-20T23:54:00.875 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2021-10-20T23:54:00.876 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2021-10-20T23:54:00.876 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.89.93 2021-10-20T23:54:00.876 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-10-20T23:54:00.876 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-89-generic, linux-modules-extra-5.4.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2021-10-20T23:54:00.877 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2021-10-20T23:54:00.877 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2021-10-20T23:54:00.877 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2021-10-20T23:54:00.877 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2021-10-20T23:54:00.878 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2021-10-20T23:54:00.885 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.1O90sVu7iq 2021-10-20T23:54:00.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1O90sVu7iq 2021-10-20T23:54:00.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.1O90sVu7iq 2021-10-20T23:54:01.007 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.1O90sVu7iq is 10KB 2021-10-20T23:54:01.023 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.1O90sVu7iq 2021-10-20T23:54:01.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-10-20T23:54:01.090 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-20T23:54:01.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-10-20T23:54:01.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-10-20T23:54:01.144 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-89-generic 2021-10-20T23:54:01.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2021-10-20T23:54:02.635 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2021-10-20T23:54:02.637 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-10-20T23:54:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2021-10-20T23:54:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-89-generic 2021-10-20T23:54:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-89-generic 2021-10-20T23:54:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-10-20T23:54:03.314 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-10-20T23:54:03.409 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-10-20T23:54:03.421 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-10-20T23:54:05.086 INFO:teuthology.orchestra.run.smithi102.stderr:done 2021-10-20T23:54:05.087 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2021-10-20T23:54:35.119 INFO:teuthology.misc:Re-opening connections... 2021-10-20T23:54:35.120 INFO:teuthology.misc:trying to connect to ubuntu@smithi041.front.sepia.ceph.com 2021-10-20T23:54:35.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com' 2021-10-20T23:54:35.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:35.183 DEBUG:teuthology.orchestra.remote:timed out 2021-10-20T23:55:35.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2021-10-20T23:55:35.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-10-20T23:55:35.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:35.532 DEBUG:teuthology.orchestra.run.smithi062:> true 2021-10-20T23:55:36.182 INFO:teuthology.misc:trying to connect to ubuntu@smithi099.front.sepia.ceph.com 2021-10-20T23:55:36.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2021-10-20T23:55:36.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:36.661 DEBUG:teuthology.orchestra.run.smithi099:> true 2021-10-20T23:55:37.901 DEBUG:teuthology.misc:waited 62.781062602996826 2021-10-20T23:55:38.902 INFO:teuthology.misc:trying to connect to ubuntu@smithi041.front.sepia.ceph.com 2021-10-20T23:55:38.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com' 2021-10-20T23:55:38.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:39.208 DEBUG:teuthology.orchestra.run.smithi041:> true 2021-10-20T23:55:39.745 INFO:teuthology.misc:trying to connect to ubuntu@smithi102.front.sepia.ceph.com 2021-10-20T23:55:39.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2021-10-20T23:55:39.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:40.647 DEBUG:teuthology.orchestra.remote:No existing session 2021-10-20T23:55:40.649 DEBUG:teuthology.misc:waited 65.52911615371704 2021-10-20T23:55:41.650 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2021-10-20T23:55:41.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-10-20T23:55:41.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:41.849 DEBUG:teuthology.orchestra.run.smithi071:> true 2021-10-20T23:55:42.501 DEBUG:teuthology.misc:waited 67.38102650642395 2021-10-20T23:55:43.501 INFO:teuthology.misc:trying to connect to ubuntu@smithi102.front.sepia.ceph.com 2021-10-20T23:55:43.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2021-10-20T23:55:43.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:55:43.553 DEBUG:teuthology.orchestra.run.smithi102:> true 2021-10-20T23:55:44.883 DEBUG:teuthology.misc:waited 69.76354646682739 2021-10-20T23:55:45.884 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-10-20T23:55:45.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-89-generic"... 2021-10-20T23:55:45.885 DEBUG:teuthology.orchestra.run.smithi041:> uname -r 2021-10-20T23:55:45.893 INFO:teuthology.orchestra.run.smithi041.stdout:5.4.0-89-generic 2021-10-20T23:55:45.893 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:55:45.893 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:55:45.894 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:55:45.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-10-20T23:55:45.894 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-89-generic"... 2021-10-20T23:55:45.895 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2021-10-20T23:55:45.902 INFO:teuthology.orchestra.run.smithi062.stdout:5.4.0-89-generic 2021-10-20T23:55:45.902 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:55:45.902 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:55:45.903 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:55:45.903 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-10-20T23:55:45.903 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-89-generic"... 2021-10-20T23:55:45.903 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2021-10-20T23:55:45.911 INFO:teuthology.orchestra.run.smithi071.stdout:5.4.0-89-generic 2021-10-20T23:55:45.911 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:55:45.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:55:45.912 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:55:45.912 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-10-20T23:55:45.912 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-89-generic"... 2021-10-20T23:55:45.913 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2021-10-20T23:55:45.920 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-89-generic 2021-10-20T23:55:45.920 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:55:45.921 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:55:45.921 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:55:45.921 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-10-20T23:55:45.922 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-89-generic"... 2021-10-20T23:55:45.922 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2021-10-20T23:55:45.934 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-89-generic 2021-10-20T23:55:45.934 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-89-generic vs 5.4.0-89-generic 2021-10-20T23:55:45.935 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-10-20T23:55:45.935 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-10-20T23:55:46.937 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-10-20T23:55:46.937 DEBUG:teuthology.orchestra.run.smithi041:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:55:47.019 INFO:teuthology.orchestra.run.smithi041.stdout:ttyS1 2021-10-20T23:55:47.044 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-10-20T23:55:47.045 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:55:47.130 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2021-10-20T23:55:47.168 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-10-20T23:55:47.169 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:55:47.315 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2021-10-20T23:55:47.332 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-10-20T23:55:47.332 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:55:47.404 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2021-10-20T23:55:47.425 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-10-20T23:55:47.425 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-10-20T23:55:47.489 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2021-10-20T23:55:47.506 INFO:teuthology.run_tasks:Running task internal.base... 2021-10-20T23:55:47.517 INFO:teuthology.task.internal:Creating test directory... 2021-10-20T23:55:47.517 DEBUG:teuthology.orchestra.run.smithi041:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:55:47.520 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:55:47.523 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:55:47.525 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:55:47.528 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-10-20T23:55:47.536 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-10-20T23:55:47.558 INFO:teuthology.run_tasks:Running task internal.archive... 2021-10-20T23:55:47.581 INFO:teuthology.task.internal:Creating archive directory... 2021-10-20T23:55:47.582 DEBUG:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:55:47.585 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:55:47.587 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:55:47.589 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:55:47.592 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-10-20T23:55:47.649 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-10-20T23:55:47.665 INFO:teuthology.task.internal:Enabling coredump saving... 2021-10-20T23:55:47.666 DEBUG:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:55:47.668 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:55:47.671 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:55:47.673 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:55:47.676 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-10-20T23:55:47.691 INFO:teuthology.orchestra.run.smithi041.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.696 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.700 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.701 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.702 INFO:teuthology.orchestra.run.smithi041.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.702 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.706 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.709 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.712 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.712 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-10-20T23:55:47.715 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-10-20T23:55:47.725 INFO:teuthology.task.internal:Configuring sudo... 2021-10-20T23:55:47.726 DEBUG:teuthology.orchestra.run.smithi041:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:55:47.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:55:47.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:55:47.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:55:47.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-10-20T23:55:47.779 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-10-20T23:55:47.792 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-10-20T23:55:47.793 DEBUG:teuthology.orchestra.run.smithi041:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:55:47.796 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:55:47.799 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:55:47.802 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:55:47.821 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-10-20T23:55:47.829 DEBUG:teuthology.orchestra.run.smithi041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:55:47.836 DEBUG:teuthology.orchestra.run.smithi041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:55:47.884 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-20T23:55:47.885 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:55:47.913 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:55:47.920 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:55:47.928 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-20T23:55:47.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:55:47.947 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:55:47.954 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:55:47.962 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-20T23:55:47.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:55:47.984 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:55:47.991 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:55:48.041 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-20T23:55:48.042 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:55:48.068 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-10-20T23:55:48.075 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-10-20T23:55:48.125 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-20T23:55:48.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-10-20T23:55:48.153 DEBUG:teuthology.orchestra.run.smithi041:> sudo service rsyslog restart 2021-10-20T23:55:48.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2021-10-20T23:55:48.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2021-10-20T23:55:48.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2021-10-20T23:55:48.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2021-10-20T23:55:48.222 INFO:teuthology.run_tasks:Running task internal.timer... 2021-10-20T23:55:48.236 INFO:teuthology.task.internal:Starting timer... 2021-10-20T23:55:48.237 INFO:teuthology.run_tasks:Running task pcp... 2021-10-20T23:55:48.277 INFO:teuthology.run_tasks:Running task selinux... 2021-10-20T23:55:48.298 DEBUG:teuthology.task.selinux:Excluding smithi041: OS 'ubuntu' does not support SELinux 2021-10-20T23:55:48.299 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2021-10-20T23:55:48.299 DEBUG:teuthology.task.selinux:Excluding smithi071: OS 'ubuntu' does not support SELinux 2021-10-20T23:55:48.300 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2021-10-20T23:55:48.300 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2021-10-20T23:55:48.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-10-20T23:55:48.301 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-10-20T23:55:48.302 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-10-20T23:55:48.302 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-10-20T23:55:48.328 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-10-20T23:55:48.336 INFO:teuthology.repo_utils:Fetching master from origin 2021-10-20T23:55:48.374 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-10-20T23:55:48.404 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-10-20T23:55:48.408 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi041.front.sepia.ceph.com,smithi062.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-10-20T23:55:48.827 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-10-20T23:55:49.685 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-10-20T23:55:52.649 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-10-20T23:55:52.778 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:52 +0000 (0:00:00.144) 0:00:00.144 ***** 2021-10-20T23:55:52.790 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:52 +0000 (0:00:00.014) 0:00:00.159 ***** 2021-10-20T23:55:52.805 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:52 +0000 (0:00:00.015) 0:00:00.174 ***** 2021-10-20T23:55:52.819 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:52 +0000 (0:00:00.014) 0:00:00.188 ***** 2021-10-20T23:55:52.836 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:52 +0000 (0:00:00.016) 0:00:00.205 ***** 2021-10-20T23:55:54.893 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-20T23:55:54.895 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi041.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi041.front.sepia.ceph.com] 2021-10-20T23:55:54.950 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:54 +0000 (0:00:02.114) 0:00:02.319 ***** 2021-10-20T23:55:54.964 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi062.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi062.front.sepia.ceph.com] 2021-10-20T23:55:54.999 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi102.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi102.front.sepia.ceph.com] 2021-10-20T23:55:55.030 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.078) 0:00:02.398 ***** 2021-10-20T23:55:55.054 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi099.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi099.front.sepia.ceph.com] 2021-10-20T23:55:55.097 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.067) 0:00:02.466 ***** 2021-10-20T23:55:55.108 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi071.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:55:55.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.059) 0:00:02.525 ***** 2021-10-20T23:55:55.186 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.029) 0:00:02.555 ***** 2021-10-20T23:55:55.193 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-10-20T23:55:55.194 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:55:55.219 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.032) 0:00:02.587 ***** 2021-10-20T23:55:55.245 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.026) 0:00:02.614 ***** 2021-10-20T23:55:55.253 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:55:55.279 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.033) 0:00:02.648 ***** 2021-10-20T23:55:55.300 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:55:55.324 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.044) 0:00:02.693 ***** 2021-10-20T23:55:55.331 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:55:55.357 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.033) 0:00:02.726 ***** 2021-10-20T23:55:55.736 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-10-20T23:55:55.738 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:55:55.761 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.404) 0:00:03.130 ***** 2021-10-20T23:55:55.768 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:55:55.770 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:55:55.771 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:55:55.772 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-10-20T23:55:55.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.036) 0:00:03.166 ***** 2021-10-20T23:55:55.822 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.023) 0:00:03.191 ***** 2021-10-20T23:55:55.849 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.022) 0:00:03.213 ***** 2021-10-20T23:55:55.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.022) 0:00:03.236 ***** 2021-10-20T23:55:55.874 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:55:55.876 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:55:55.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.033) 0:00:03.270 ***** 2021-10-20T23:55:55.926 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.022) 0:00:03.292 ***** 2021-10-20T23:55:55.930 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:55:55.932 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:55:55.962 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.038) 0:00:03.331 ***** 2021-10-20T23:55:55.983 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:55 +0000 (0:00:00.021) 0:00:03.352 ***** 2021-10-20T23:55:55.990 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:55:56.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.032) 0:00:03.385 ***** 2021-10-20T23:55:56.109 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-10-20T23:55:56.111 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:55:56.137 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.121) 0:00:03.506 ***** 2021-10-20T23:55:56.150 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:55:56.152 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:55:56.153 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:55:56.154 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:55:56.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.047) 0:00:03.554 ***** 2021-10-20T23:55:56.214 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.028) 0:00:03.583 ***** 2021-10-20T23:55:56.236 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.022) 0:00:03.605 ***** 2021-10-20T23:55:56.261 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.024) 0:00:03.629 ***** 2021-10-20T23:55:56.897 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-10-20T23:55:56.899 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-10-20T23:55:56.901 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-10-20T23:55:56.924 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.663) 0:00:04.293 ***** 2021-10-20T23:55:56.948 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.024) 0:00:04.317 ***** 2021-10-20T23:55:56.970 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.022) 0:00:04.339 ***** 2021-10-20T23:55:56.993 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:56 +0000 (0:00:00.022) 0:00:04.362 ***** 2021-10-20T23:55:57.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:57 +0000 (0:00:00.021) 0:00:04.384 ***** 2021-10-20T23:55:57.409 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2021-10-20T23:55:57.411 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2021-10-20T23:55:57.413 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2021-10-20T23:55:57.415 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3Nz 2021-10-20T23:55:57.419 INFO:teuthology.task.ansible.out:aC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-20T23:55:57.457 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-10-20T23:55:57.459 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-10-20T23:55:57.461 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-10-20T23:55:57.463 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-10-20T23:55:57.589 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-10-20T23:55:57.590 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-20T23:55:57.607 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-10-20T23:55:57.608 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:57 +0000 (0:00:00.592) 0:00:04.976 ***** 2021-10-20T23:55:58.336 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] 2021-10-20T23:55:58.357 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:55:58.389 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-10-20T23:55:59.345 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2021-10-20T23:55:59.367 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-10-20T23:55:59.388 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Wednesday 20 October 2021 23:55:59 +0000 (0:00:01.781) 0:00:06.758 ***** 2021-10-20T23:55:59.422 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:55:59.446 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:55:59.474 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:55:59.506 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:55:59.508 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-10-20T23:55:59.515 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-10-20T23:55:59.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:59 +0000 (0:00:00.310) 0:00:07.068 ***** 2021-10-20T23:55:59.724 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:59 +0000 (0:00:00.024) 0:00:07.093 ***** 2021-10-20T23:55:59.748 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:59 +0000 (0:00:00.024) 0:00:07.117 ***** 2021-10-20T23:55:59.771 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:59 +0000 (0:00:00.022) 0:00:07.140 ***** 2021-10-20T23:55:59.798 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:55:59 +0000 (0:00:00.024) 0:00:07.164 ***** 2021-10-20T23:56:00.623 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi062.front.sepia.ceph.com] 2021-10-20T23:56:00.776 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] 2021-10-20T23:56:00.788 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:56:00.801 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-10-20T23:56:00.812 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-10-20T23:56:00.910 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-10-20T23:56:00.912 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:00 +0000 (0:00:01.115) 0:00:08.280 ***** 2021-10-20T23:56:00.936 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:00 +0000 (0:00:00.024) 0:00:08.304 ***** 2021-10-20T23:56:00.961 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:00 +0000 (0:00:00.025) 0:00:08.330 ***** 2021-10-20T23:56:00.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:00 +0000 (0:00:00.026) 0:00:08.356 ***** 2021-10-20T23:56:01.013 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.025) 0:00:08.382 ***** 2021-10-20T23:56:01.502 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-10-20T23:56:01.504 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.237126", "end": "2021-10-20 23:56:01.472561", "rc": 0, "start": "2021-10-20 23:56:01.235435", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.243297", "end": "2021-10-20 23:56:01.476269", "rc": 0, "start": "2021-10-20 23:56:01.232972", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:56:01.528 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.514) 0:00:08.897 ***** 2021-10-20T23:56:01.557 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.029) 0:00:08.926 ***** 2021-10-20T23:56:01.565 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.324743", "end": "2021-10-20 23:56:01.537840", "rc": 0, "start": "2021-10-20 23:56:01.213097", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:56:01.591 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.034) 0:00:08.960 ***** 2021-10-20T23:56:01.620 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.310835", "end": "2021-10-20 23:56:01.594640", "rc": 0, "start": "2021-10-20 23:56:01.283805", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:56:01.647 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.055) 0:00:09.016 ***** 2021-10-20T23:56:01.653 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.373226", "end": "2021-10-20 23:56:01.620688", "rc": 0, "start": "2021-10-20 23:56:01.247462", "stderr": "", "stderr_lines": [], "stdout": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "stdout_lines": ["67bbe4acd25fa11296ed99ae51cddedfa9791439"]} 2021-10-20T23:56:01.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.033) 0:00:09.050 ***** 2021-10-20T23:56:01.689 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-20T23:56:01.691 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.021794", "end": "2021-10-20 23:56:01.488120", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:56:01.466326", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:56:01.720 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.039) 0:00:09.089 ***** 2021-10-20T23:56:01.729 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015209", "end": "2021-10-20 23:56:01.998954", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:56:01.983745", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:56:01.755 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.035) 0:00:09.125 ***** 2021-10-20T23:56:01.763 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012412", "end": "2021-10-20 23:56:02.257014", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:56:02.244602", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:56:01.796 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.039) 0:00:09.165 ***** 2021-10-20T23:56:01.805 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009632", "end": "2021-10-20 23:56:01.440857", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:56:01.431225", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:56:01.806 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-20T23:56:01.807 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:01.833 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.037) 0:00:09.202 ***** 2021-10-20T23:56:01.855 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.022) 0:00:09.224 ***** 2021-10-20T23:56:01.863 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:01.864 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-10-20T23:56:01.865 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011432", "end": "2021-10-20 23:56:01.508691", "failed_when_result": false, "rc": 0, "start": "2021-10-20 23:56:01.497259", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-10-20T23:56:01.891 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.035) 0:00:09.260 ***** 2021-10-20T23:56:01.914 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.023) 0:00:09.283 ***** 2021-10-20T23:56:01.922 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:01.924 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:01.949 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.034) 0:00:09.318 ***** 2021-10-20T23:56:01.982 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:01 +0000 (0:00:00.033) 0:00:09.351 ***** 2021-10-20T23:56:01.989 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-10-20T23:56:01.991 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.017 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.034) 0:00:09.386 ***** 2021-10-20T23:56:02.041 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.024) 0:00:09.410 ***** 2021-10-20T23:56:02.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.022) 0:00:09.433 ***** 2021-10-20T23:56:02.072 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-10-20T23:56:02.074 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.099 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.034) 0:00:09.468 ***** 2021-10-20T23:56:02.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.022) 0:00:09.490 ***** 2021-10-20T23:56:02.129 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.131 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.034) 0:00:09.525 ***** 2021-10-20T23:56:02.179 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.022) 0:00:09.547 ***** 2021-10-20T23:56:02.186 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.033) 0:00:09.581 ***** 2021-10-20T23:56:02.233 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.263 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.049) 0:00:09.631 ***** 2021-10-20T23:56:02.295 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.032) 0:00:09.664 ***** 2021-10-20T23:56:02.303 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.306 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.330 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.034) 0:00:09.699 ***** 2021-10-20T23:56:02.361 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.030) 0:00:09.730 ***** 2021-10-20T23:56:02.369 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-10-20T23:56:02.370 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.371 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.397 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.036) 0:00:09.766 ***** 2021-10-20T23:56:02.437 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.039) 0:00:09.806 ***** 2021-10-20T23:56:02.466 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.029) 0:00:09.835 ***** 2021-10-20T23:56:02.477 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.479 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.505 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.038) 0:00:09.874 ***** 2021-10-20T23:56:02.528 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.022) 0:00:09.897 ***** 2021-10-20T23:56:02.552 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.024) 0:00:09.921 ***** 2021-10-20T23:56:02.560 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.592 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.038) 0:00:09.960 ***** 2021-10-20T23:56:02.632 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-20T23:56:02.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.659 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.068) 0:00:10.028 ***** 2021-10-20T23:56:02.684 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.024) 0:00:10.053 ***** 2021-10-20T23:56:02.692 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:02.693 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-10-20T23:56:02.693 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:56:02.724 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.039) 0:00:10.093 ***** 2021-10-20T23:56:02.748 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.024) 0:00:10.117 ***** 2021-10-20T23:56:02.759 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:56:02.794 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.046) 0:00:10.163 ***** 2021-10-20T23:56:02.873 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:56:02.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.106) 0:00:10.270 ***** 2021-10-20T23:56:02.923 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-20T23:56:02.924 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:56:02.937 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:56:02.964 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:02 +0000 (0:00:00.062) 0:00:10.332 ***** 2021-10-20T23:56:03.008 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-20T23:56:03.010 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:56:03.059 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:56:03.083 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:56:03.168 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:56:03.169 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:56:03.192 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:56:03.237 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:56:03.249 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-10-20T23:56:03.316 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:56:03.350 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:56:03.394 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:56:03.397 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-10-20T23:56:03.463 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:56:03.476 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:56:03.499 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:56:03.537 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:56:03.549 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-10-20T23:56:03.615 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:56:03.616 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:56:03.658 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:56:03.694 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:56:03.697 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-10-20T23:56:03.761 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:56:03.773 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:56:03.817 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:56:03.843 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-10-20T23:56:03.910 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:56:03.923 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:56:03.961 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:56:03.998 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:56:04.002 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-10-20T23:56:04.056 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:56:04.078 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:56:04.080 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:04.115 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:56:04.137 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:56:04.149 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-10-20T23:56:04.205 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:56:04.217 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:56:04.261 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:56:04.294 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:56:04.306 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-10-20T23:56:04.352 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:56:04.375 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:56:04.398 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:56:04.442 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-10-20T23:56:04.454 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:56:04.499 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:56:04.522 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:56:04.544 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:56:04.587 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-10-20T23:56:04.599 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:56:04.642 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:56:04.696 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:56:04.697 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:56:04.730 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-10-20T23:56:04.753 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:56:04.787 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:56:04.830 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:56:04.844 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:56:04.877 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-10-20T23:56:04.899 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:56:04.933 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:56:04.977 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:56:04.978 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:56:05.021 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-10-20T23:56:05.044 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:56:05.087 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:56:05.123 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:56:05.125 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:56:05.177 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-10-20T23:56:05.179 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:56:05.236 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:56:05.269 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:56:05.281 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:56:05.313 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-10-20T23:56:05.346 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:56:05.380 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:56:05.413 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:56:05.414 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:56:05.457 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-10-20T23:56:05.490 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:56:05.533 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:56:05.555 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:56:05.567 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:56:05.601 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-10-20T23:56:05.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:56:05.677 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:56:05.710 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:56:05.712 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:56:05.734 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-10-20T23:56:05.789 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:56:05.822 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:56:05.856 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:56:05.857 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:56:05.882 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-10-20T23:56:05.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:56:05.968 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:56:05.990 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:56:06.002 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:56:06.025 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-10-20T23:56:06.090 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:56:06.113 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:56:06.135 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:56:06.147 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:56:06.170 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-10-20T23:56:06.235 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:56:06.256 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:56:06.279 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:56:06.290 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:56:06.312 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-10-20T23:56:06.376 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:56:06.398 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:56:06.420 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:56:06.432 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:56:06.433 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:06.455 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-10-20T23:56:06.519 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:56:06.541 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:56:06.563 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:56:06.575 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:56:06.597 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-10-20T23:56:06.671 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:56:06.683 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:56:06.705 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:56:06.717 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-10-20T23:56:06.749 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-10-20T23:56:06.815 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-10-20T23:56:07.553 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/br 2021-10-20T23:56:07.555 INFO:teuthology.task.ansible.out:anto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ 2021-10-20T23:56:07.556 INFO:teuthology.task.ansible.out:7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 113 2021-10-20T23:56:07.558 INFO:teuthology.task.ansible.out:1} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@r 2021-10-20T23:56:07.560 INFO:teuthology.task.ansible.out:edhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:56:07.562 INFO:teuthology.task.ansible.out: => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511 2021-10-20T23:56:07.563 INFO:teuthology.task.ansible.out:c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, 2021-10-20T23:56:07.565 INFO:teuthology.task.ansible.out:"comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:56:07.607 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:56:07.630 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-10-20T23:56:07.642 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:56:07.643 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:56:07.665 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:56:07.785 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:56:07.787 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-10-20T23:56:07.809 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:56:07.810 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:56:07.832 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:56:07.928 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:56:07.960 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-10-20T23:56:07.963 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:56:07.974 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:56:07.985 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:56:08.091 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:56:08.116 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:08.138 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-10-20T23:56:08.151 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:08.258 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:56:08.270 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:56:08.282 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:56:08.293 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:56:08.336 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-10-20T23:56:08.411 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:08.423 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:56:08.436 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:56:08.459 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:56:08.544 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:08.556 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:56:08.578 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:56:08.589 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:56:08.612 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:56:08.689 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-10-20T23:56:08.700 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:56:08.723 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:56:08.745 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:56:08.756 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:56:08.844 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-10-20T23:56:08.846 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:56:08.868 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:56:08.890 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:56:08.901 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:56:08.986 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:56:08.987 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-10-20T23:56:09.009 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:56:09.031 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:56:09.053 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:56:09.127 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:56:09.128 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-10-20T23:56:09.161 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:56:09.183 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:56:09.194 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:56:09.280 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:56:09.281 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-10-20T23:56:09.314 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:09.325 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:09.337 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:09.422 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-10-20T23:56:09.424 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:56:09.466 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:56:09.467 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:56:09.479 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:56:09.564 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-10-20T23:56:09.576 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:09.609 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:56:09.621 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:56:09.623 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:56:09.719 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:56:09.721 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:09.764 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:56:09.766 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:56:09.864 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-10-20T23:56:09.869 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:56:09.907 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:56:09.919 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:56:09.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:56:10.004 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-10-20T23:56:10.006 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:56:10.049 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:56:10.061 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:56:10.062 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:56:10.147 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-10-20T23:56:10.148 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:56:10.192 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:56:10.215 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:56:10.216 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:56:10.292 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-10-20T23:56:10.293 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:56:10.336 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:56:10.359 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:56:10.361 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:56:10.438 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:56:10.439 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-10-20T23:56:10.494 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:56:10.507 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:56:10.508 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:56:10.583 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:56:10.584 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-10-20T23:56:10.639 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:56:10.640 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:56:10.652 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:56:10.726 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:56:10.728 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-10-20T23:56:10.781 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:56:10.792 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:56:10.795 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:56:10.868 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-10-20T23:56:10.869 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:56:10.923 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:56:10.934 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:56:10.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:56:11.011 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-10-20T23:56:11.011 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:11.014 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:56:11.067 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:56:11.078 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:56:11.079 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:56:11.154 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-10-20T23:56:11.166 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:56:11.209 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:56:11.221 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:56:11.233 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:56:11.293 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-10-20T23:56:11.316 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:56:11.348 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:56:11.371 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:56:11.372 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:56:11.446 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-10-20T23:56:11.458 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:56:11.501 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:56:11.512 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:56:11.524 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:56:11.588 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-10-20T23:56:11.600 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:56:11.643 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:56:11.665 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:56:11.666 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:56:11.731 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-10-20T23:56:11.754 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:56:11.787 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:11.809 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:11.810 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:11.885 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-10-20T23:56:11.897 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:56:11.929 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:56:11.952 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:56:11.964 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:56:12.028 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-10-20T23:56:12.050 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:12.072 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:56:12.095 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:56:12.107 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:56:12.172 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-10-20T23:56:12.184 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:56:12.231 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:56:12.242 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:56:12.255 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:56:12.319 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-10-20T23:56:12.331 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:56:12.374 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:56:12.396 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:56:12.407 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:56:12.461 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-10-20T23:56:12.473 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:56:12.528 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:56:12.539 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:56:12.551 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:56:12.605 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-10-20T23:56:12.627 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:56:12.661 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:56:12.683 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:56:12.694 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:56:12.747 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-10-20T23:56:12.769 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:56:12.802 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:56:12.825 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:56:12.847 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:56:12.890 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-10-20T23:56:12.924 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:56:12.946 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:56:12.969 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:56:12.991 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:56:13.045 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-10-20T23:56:13.067 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:56:13.089 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:56:13.111 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:56:13.124 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:56:13.188 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-10-20T23:56:13.210 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:56:13.232 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:56:13.255 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:56:13.288 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:56:13.331 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-10-20T23:56:13.353 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:56:13.386 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:56:13.420 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:56:13.432 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:56:13.487 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-10-20T23:56:13.498 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:56:13.532 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:56:13.558 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:56:13.584 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:56:13.627 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-10-20T23:56:13.639 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:56:13.672 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:56:13.704 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:56:13.728 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:56:13.781 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-10-20T23:56:13.782 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-10-20T23:56:13.815 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:56:13.848 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:56:13.881 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:56:13.925 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:56:13.959 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:56:14.003 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:56:14.025 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:56:14.068 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-10-20T23:56:14.080 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:56:14.102 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:56:14.146 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:56:14.168 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:56:14.211 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-10-20T23:56:14.223 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:56:14.248 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:56:14.292 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:56:14.314 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:56:14.357 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-10-20T23:56:14.369 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:56:14.391 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:56:14.434 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:56:14.467 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:56:14.510 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:56:14.513 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-10-20T23:56:14.538 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:56:14.570 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:56:14.614 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:56:14.647 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:56:14.659 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-10-20T23:56:14.681 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:56:14.724 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:56:14.757 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:56:14.800 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:56:14.802 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-10-20T23:56:14.824 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:56:14.867 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:56:14.921 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:56:14.943 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:56:14.945 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-10-20T23:56:14.978 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:56:15.011 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:56:15.065 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:56:15.086 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-10-20T23:56:15.098 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:56:15.120 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:56:15.164 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:56:15.208 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:56:15.230 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:56:15.242 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-10-20T23:56:15.264 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:56:15.318 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:56:15.351 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:56:15.384 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:56:15.386 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-10-20T23:56:15.417 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:56:15.470 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:56:15.502 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:56:15.524 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:56:15.525 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-10-20T23:56:15.569 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:56:15.612 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:56:15.656 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:56:15.668 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:56:15.669 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-10-20T23:56:15.670 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:15.713 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:56:15.756 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:56:15.799 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:56:15.810 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-10-20T23:56:15.822 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:56:15.855 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:56:15.898 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:56:15.941 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:56:15.963 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-10-20T23:56:15.965 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:56:15.998 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:56:16.040 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:56:16.094 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:56:16.106 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-10-20T23:56:16.108 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:56:16.151 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:56:16.184 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:56:16.239 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:56:16.241 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:56:16.252 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-10-20T23:56:16.295 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:56:16.339 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:56:16.383 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:56:16.385 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:56:16.395 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-10-20T23:56:16.438 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:56:16.481 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:56:16.524 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:56:16.538 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:56:16.549 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-10-20T23:56:16.582 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:56:16.625 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:56:16.668 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:56:16.680 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:56:16.691 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-10-20T23:56:16.734 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:56:16.767 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:56:16.811 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:56:16.823 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:56:16.835 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-10-20T23:56:16.878 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:56:16.911 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:56:16.955 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:56:16.967 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:56:16.979 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-10-20T23:56:17.024 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:17.068 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:17.100 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:56:17.123 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:17.124 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-10-20T23:56:17.168 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:56:17.213 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:56:17.249 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:17.272 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-10-20T23:56:17.273 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:56:17.306 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:56:17.370 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:56:17.392 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:56:17.414 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-10-20T23:56:17.416 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:56:17.459 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:56:17.522 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:56:17.534 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:56:17.557 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-10-20T23:56:17.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:56:17.592 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:56:17.665 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:56:17.677 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:56:17.711 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-10-20T23:56:17.712 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:56:17.745 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:56:17.810 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:56:17.822 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:56:17.844 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-10-20T23:56:17.855 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:56:17.888 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:56:17.952 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:56:17.975 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:56:17.997 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-10-20T23:56:17.998 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:56:18.033 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:56:18.097 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:56:18.120 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:56:18.132 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-10-20T23:56:18.143 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:56:18.176 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:56:18.251 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:56:18.263 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:56:18.274 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-10-20T23:56:18.287 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:56:18.320 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:56:18.395 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:56:18.406 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:56:18.428 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-10-20T23:56:18.440 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:56:18.473 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:56:18.548 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:56:18.550 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:56:18.573 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-10-20T23:56:18.584 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:56:18.606 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:56:18.692 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:56:18.694 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:56:18.717 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-10-20T23:56:18.728 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:56:18.751 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:56:18.836 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:56:18.837 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:56:18.859 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-10-20T23:56:18.881 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:56:18.903 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:56:18.988 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:56:18.989 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:56:19.001 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-10-20T23:56:19.023 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:56:19.046 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:56:19.133 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:56:19.145 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:56:19.146 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-10-20T23:56:19.179 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:56:19.190 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:56:19.277 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:56:19.288 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:56:19.300 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-10-20T23:56:19.333 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:56:19.334 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:56:19.418 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:56:19.441 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:56:19.442 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-10-20T23:56:19.474 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:56:19.486 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:56:19.560 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:56:19.582 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-10-20T23:56:19.583 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:56:19.629 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:56:19.631 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:56:19.706 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:56:19.728 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-10-20T23:56:19.729 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:56:19.773 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:56:19.773 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:56:19.848 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:56:19.871 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-10-20T23:56:19.872 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:56:19.916 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:56:19.928 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:56:19.991 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:56:20.013 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-10-20T23:56:20.025 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:56:20.068 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:56:20.069 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:56:20.136 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:56:20.170 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-10-20T23:56:20.173 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:56:20.214 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:56:20.215 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:56:20.281 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:56:20.314 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-10-20T23:56:20.315 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:56:20.358 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:56:20.370 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:56:20.423 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:56:20.456 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-10-20T23:56:20.457 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:56:20.500 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:56:20.501 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:56:20.565 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:56:20.599 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-10-20T23:56:20.601 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:56:20.646 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:56:20.658 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:56:20.712 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:56:20.744 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:56:20.745 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-10-20T23:56:20.800 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:56:20.801 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:56:20.865 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:56:20.887 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-10-20T23:56:20.899 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:56:20.941 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:56:20.953 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:56:21.007 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:56:21.040 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-10-20T23:56:21.051 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:56:21.084 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:56:21.096 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:56:21.150 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:56:21.183 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-10-20T23:56:21.185 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:56:21.230 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:56:21.241 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:56:21.294 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:56:21.340 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-10-20T23:56:21.342 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:56:21.384 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:56:21.385 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:56:21.440 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:56:21.484 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-10-20T23:56:21.486 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:56:21.520 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:56:21.532 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:56:21.587 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:56:21.632 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-10-20T23:56:21.633 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:56:21.664 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:56:21.676 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:56:21.740 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:56:21.773 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-10-20T23:56:21.774 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:56:21.820 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:56:21.830 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:56:21.885 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:56:21.917 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-10-20T23:56:21.929 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:56:21.961 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:56:21.973 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:56:22.028 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:56:22.061 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-10-20T23:56:22.074 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:56:22.097 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:56:22.109 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:56:22.172 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:56:22.205 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-10-20T23:56:22.217 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:56:22.251 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:56:22.263 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:56:22.317 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:56:22.349 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-10-20T23:56:22.361 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:56:22.394 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:56:22.406 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:56:22.472 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:56:22.484 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-10-20T23:56:22.506 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:56:22.539 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:56:22.572 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:56:22.604 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:56:22.637 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-10-20T23:56:22.649 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:56:22.692 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:56:22.725 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:56:22.748 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:56:22.781 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-10-20T23:56:22.803 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:56:22.836 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:56:22.869 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:56:22.891 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:56:22.924 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-10-20T23:56:22.946 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:56:22.989 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:56:23.012 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:56:23.034 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:56:23.067 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-10-20T23:56:23.100 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:56:23.122 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:56:23.155 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:56:23.188 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:56:23.210 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-10-20T23:56:23.243 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:56:23.276 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:56:23.298 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:56:23.346 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:56:23.358 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-10-20T23:56:23.380 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:56:23.413 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:56:23.456 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:56:23.500 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:56:23.502 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-10-20T23:56:23.534 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:56:23.567 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:56:23.602 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:56:23.643 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:56:23.644 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-10-20T23:56:23.677 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:56:23.720 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:56:23.731 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:56:23.785 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:56:23.786 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-10-20T23:56:23.830 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:56:23.862 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:56:23.874 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:56:23.928 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:56:23.940 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-10-20T23:56:23.973 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:56:24.016 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:56:24.017 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:56:24.072 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:56:24.084 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-10-20T23:56:24.128 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:56:24.161 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:56:24.173 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:56:24.226 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:56:24.238 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-10-20T23:56:24.282 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:56:24.305 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:56:24.308 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:56:24.372 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:56:24.383 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-10-20T23:56:24.427 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:56:24.449 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:56:24.450 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:56:24.515 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:56:24.528 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-10-20T23:56:24.572 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:56:24.595 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:56:24.607 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:56:24.663 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:56:24.675 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-10-20T23:56:24.708 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:56:24.742 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:56:24.754 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:56:24.807 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:56:24.829 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-10-20T23:56:24.851 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:56:24.895 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:56:24.908 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:56:24.954 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:56:24.977 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-10-20T23:56:25.001 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:56:25.034 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:56:25.056 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:56:25.100 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:56:25.122 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-10-20T23:56:25.145 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:56:25.167 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:56:25.169 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:25.211 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:56:25.246 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:56:25.281 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-10-20T23:56:25.282 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:56:25.316 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:56:25.318 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:25.462 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:56:25.463 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:56:25.464 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-10-20T23:56:25.465 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:56:25.489 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:25 +0000 (0:00:22.525) 0:00:32.858 ***** 2021-10-20T23:56:25.771 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:56:25.772 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:56:25.774 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-20T23:56:25.808 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-10-20T23:56:25.959 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-10-20T23:56:25.960 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-10-20T23:56:26.072 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.582) 0:00:33.440 ***** 2021-10-20T23:56:26.111 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.039) 0:00:33.480 ***** 2021-10-20T23:56:26.151 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.039) 0:00:33.520 ***** 2021-10-20T23:56:26.175 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.023) 0:00:33.544 ***** 2021-10-20T23:56:26.198 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.023) 0:00:33.567 ***** 2021-10-20T23:56:26.206 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-20T23:56:26.244 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.046) 0:00:33.613 ***** 2021-10-20T23:56:26.267 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.022) 0:00:33.636 ***** 2021-10-20T23:56:26.276 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-20T23:56:26.279 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:56:26.280 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:56:26.282 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:56:26.284 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:56:26.285 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:56:26.287 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:56:26.289 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a9 2021-10-20T23:56:26.289 INFO:teuthology.task.ansible.out:5579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:56:26.291 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:56:26.293 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:56:26.295 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:56:26.296 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:56:26.298 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:56:26.300 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f9 2021-10-20T23:56:26.300 INFO:teuthology.task.ansible.out:1e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:56:26.302 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:56:26.304 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-10-20T23:56:26.340 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.073) 0:00:33.709 ***** 2021-10-20T23:56:26.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.023) 0:00:33.733 ***** 2021-10-20T23:56:26.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.022) 0:00:33.756 ***** 2021-10-20T23:56:26.396 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-10-20T23:56:26.399 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:56:26.401 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:56:26.402 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:56:26.404 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:56:26.406 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2021-10-20T23:56:26.406 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:56:26.408 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:56:26.409 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:56:26.411 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:56:26.412 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:56:26.414 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:56:26.416 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432 2021-10-20T23:56:26.416 INFO:teuthology.task.ansible.out:aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:56:26.418 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:56:26.420 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:56:26.422 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:56:26.424 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:56:26.426 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:56:26.427 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:56:26.430 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:56:26.432 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:56:26.433 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:56:26.435 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a9 2021-10-20T23:56:26.435 INFO:teuthology.task.ansible.out:5579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:56:26.437 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:56:26.439 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:56:26.440 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:56:26.442 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:56:26.443 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:56:26.445 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f9 2021-10-20T23:56:26.445 INFO:teuthology.task.ansible.out:1e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:56:26.447 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:56:26.476 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.089) 0:00:33.845 ***** 2021-10-20T23:56:26.511 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.034) 0:00:33.880 ***** 2021-10-20T23:56:26.526 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:56:26.528 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:56:26.530 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:56:26.532 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:56:26.533 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:56:26.535 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:56:26.538 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a9 2021-10-20T23:56:26.539 INFO:teuthology.task.ansible.out:5579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:56:26.540 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:56:26.542 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:56:26.544 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:56:26.545 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2021-10-20T23:56:26.546 INFO:teuthology.task.ansible.out: {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:56:26.547 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:56:26.549 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:56:26.550 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:56:26.559 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-10-20T23:56:26.561 INFO:teuthology.task.ansible.out: EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2021-10-20T23:56:26.564 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2021-10-20T23:56:26.566 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2021-10-20T23:56:26.567 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2021-10-20T23:56:26.569 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2021-10-20T23:56:26.571 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-10-20T23:56:26.572 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2021-10-20T23:56:26.575 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2021-10-20T23:56:26.576 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2021-10-20T23:56:26.579 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2021-10-20T23:56:26.581 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ec 2021-10-20T23:56:26.584 INFO:teuthology.task.ansible.out:f7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd523 2021-10-20T23:56:26.584 INFO:teuthology.task.ansible.out:0a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn" 2021-10-20T23:56:26.586 INFO:teuthology.task.ansible.out:: "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-10-20T23:56:26.628 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.117) 0:00:33.997 ***** 2021-10-20T23:56:26.657 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:26 +0000 (0:00:00.029) 0:00:34.026 ***** 2021-10-20T23:56:27.272 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-10-20T23:56:27.274 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} ok: [smithi071.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:56:27.299 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:27 +0000 (0:00:00.641) 0:00:34.668 ***** 2021-10-20T23:56:27.327 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:27 +0000 (0:00:00.028) 0:00:34.696 ***** 2021-10-20T23:56:27.336 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:56:27.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:27 +0000 (0:00:00.038) 0:00:34.734 ***** 2021-10-20T23:56:27.381 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:56:27.382 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"after": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "attempts": 1, "before": "67bbe4acd25fa11296ed99ae51cddedfa9791439", "changed": false, "remote_url_changed": false} 2021-10-20T23:56:27.408 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:27 +0000 (0:00:00.042) 0:00:34.777 ***** 2021-10-20T23:56:27.430 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:27 +0000 (0:00:00.021) 0:00:34.799 ***** 2021-10-20T23:56:27.554 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-10-20T23:56:27.556 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:56:27.576 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:56:27.609 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:56:27.651 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:56:27.685 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-10-20T23:56:27.698 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:56:27.730 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:56:27.752 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:56:27.798 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:56:27.832 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-10-20T23:56:27.844 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:56:27.876 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:56:27.890 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:56:27.945 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:56:27.969 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-10-20T23:56:27.992 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:56:27.993 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:56:28.024 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:56:28.026 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:56:28.035 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:56:28.037 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:56:28.089 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:56:28.091 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:56:28.112 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-10-20T23:56:28.114 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-10-20T23:56:28.123 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:56:28.167 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:56:28.169 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:56:28.232 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:56:28.243 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-10-20T23:56:28.265 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:56:28.267 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:56:28.298 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:56:28.300 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7 2021-10-20T23:56:28.301 INFO:teuthology.task.ansible.out:LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:56:28.364 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:56:28.366 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:56:28.376 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-10-20T23:56:28.378 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-10-20T23:56:28.398 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:56:28.434 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:56:28.445 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:56:28.500 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:56:28.523 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-10-20T23:56:28.535 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:56:28.570 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:56:28.582 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:56:28.626 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:56:28.650 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-10-20T23:56:28.652 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:28.673 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:56:28.685 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.707 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:56:28.709 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1s 2021-10-20T23:56:28.710 INFO:teuthology.task.ansible.out:cr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.719 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.720 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:28.765 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:56:28.776 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.778 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-10-20T23:56:28.789 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.811 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:56:28.814 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:56:28.854 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:56:28.856 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:56:28.877 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:56:28.879 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:56:28.910 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:56:28.912 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:56:28.932 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-10-20T23:56:28.934 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-10-20T23:56:28.955 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:56:28.957 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.968 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:28.990 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:56:28.992 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.002 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.024 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:56:29.025 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.036 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.048 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:56:29.049 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-10-20T23:56:29.059 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.070 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-10-20T23:56:29.072 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ57 2021-10-20T23:56:29.074 INFO:teuthology.task.ansible.out:9gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.094 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:29.106 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:56:29.129 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:56:29.183 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:56:29.194 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:56:29.227 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-10-20T23:56:29.261 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:56:29.262 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:56:29.273 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:56:29.276 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:56:29.329 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:56:29.331 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:56:29.343 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:56:29.345 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:56:29.363 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-10-20T23:56:29.365 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-10-20T23:56:29.407 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:56:29.419 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:56:29.464 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:56:29.465 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:56:29.500 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-10-20T23:56:29.544 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:56:29.556 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:56:29.601 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:56:29.644 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-10-20T23:56:29.676 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:56:29.688 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:56:29.730 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:56:29.742 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:56:29.774 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-10-20T23:56:29.818 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:56:29.820 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"} 2021-10-20T23:56:29.822 INFO:teuthology.task.ansible.out:, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:56:29.872 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:56:29.874 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"} 2021-10-20T23:56:29.876 INFO:teuthology.task.ansible.out:, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:56:29.915 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-10-20T23:56:29.917 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-10-20T23:56:29.959 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:56:29.960 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJo 2021-10-20T23:56:29.962 INFO:teuthology.task.ansible.out:SrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:56:29.991 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:56:29.993 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:56:30.013 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:56:30.015 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:56:30.068 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-10-20T23:56:30.070 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-10-20T23:56:30.091 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:56:30.093 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:56:30.127 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:56:30.149 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:56:30.202 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-10-20T23:56:30.224 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:56:30.226 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:56:30.258 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:56:30.292 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:56:30.335 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-10-20T23:56:30.368 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:56:30.370 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible 2021-10-20T23:56:30.372 INFO:teuthology.task.ansible.out:_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5 2021-10-20T23:56:30.373 INFO:teuthology.task.ansible.out:tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:56:30.413 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:56:30.415 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:56:30.445 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:56:30.447 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:56:30.489 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-10-20T23:56:30.491 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-10-20T23:56:30.501 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:56:30.502 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:56:30.545 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:56:30.579 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:56:30.622 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-10-20T23:56:30.634 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:56:30.635 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:56:30.678 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:56:30.712 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:56:30.756 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-10-20T23:56:30.768 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:56:30.770 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:56:30.823 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:56:30.856 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:56:30.891 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-10-20T23:56:30.902 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:56:30.925 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:56:30.947 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:56:30.990 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:56:31.023 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-10-20T23:56:31.046 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:56:31.048 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:56:31.081 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:56:31.135 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:56:31.157 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-10-20T23:56:31.189 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:56:31.191 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@c 2021-10-20T23:56:31.193 INFO:teuthology.task.ansible.out:lusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:56:31.224 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:56:31.227 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:56:31.267 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:56:31.269 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:56:31.299 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-10-20T23:56:31.301 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-10-20T23:56:31.322 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:56:31.324 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:56:31.358 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:56:31.401 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:56:31.423 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-10-20T23:56:31.456 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:56:31.458 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:56:31.478 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:56:31.542 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:56:31.553 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-10-20T23:56:31.585 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:56:31.597 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:56:31.619 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:56:31.672 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:56:31.684 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-10-20T23:56:31.726 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:56:31.728 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:56:31.749 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:56:31.802 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:56:31.836 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-10-20T23:56:31.860 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:31.862 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:31.883 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:31.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:31.968 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:31.990 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:56:31.992 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:56:32.013 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:56:32.067 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:56:32.101 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-10-20T23:56:32.122 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:56:32.124 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:56:32.145 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:56:32.209 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:56:32.241 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-10-20T23:56:32.257 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:56:32.259 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6 2021-10-20T23:56:32.260 INFO:teuthology.task.ansible.out:UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:56:32.280 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:56:32.281 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:56:32.344 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:56:32.346 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-10-20T23:56:32.387 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-10-20T23:56:32.389 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgn 2021-10-20T23:56:32.391 INFO:teuthology.task.ansible.out:oB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:56:32.399 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:56:32.401 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:56:32.411 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:56:32.413 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:56:32.487 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:56:32.489 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-10-20T23:56:32.520 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-10-20T23:56:32.522 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZr 2021-10-20T23:56:32.523 INFO:teuthology.task.ansible.out:YOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:56:32.544 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:56:32.619 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:56:32.663 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:56:32.665 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:56:32.667 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-10-20T23:56:32.689 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:56:32.763 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:56:32.796 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:56:32.807 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:56:32.818 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-10-20T23:56:32.820 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:56:32.894 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:56:32.937 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-10-20T23:56:32.948 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:56:32.951 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQD 2021-10-20T23:56:32.952 INFO:teuthology.task.ansible.out:mOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:32.971 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:56:32.973 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:33.036 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:56:33.038 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:33.079 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:56:33.081 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:56:33.083 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMS 2021-10-20T23:56:33.085 INFO:teuthology.task.ansible.out:woj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf 2021-10-20T23:56:33.086 INFO:teuthology.task.ansible.out:53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:56:33.091 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-10-20T23:56:33.093 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:33.115 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:56:33.117 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:56:33.119 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:56:33.179 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:56:33.181 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:56:33.183 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:56:33.213 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:56:33.224 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:56:33.226 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-10-20T23:56:33.227 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-10-20T23:56:33.229 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-10-20T23:56:33.257 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:56:33.312 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-10-20T23:56:33.356 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:56:33.357 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFz 2021-10-20T23:56:33.359 INFO:teuthology.task.ansible.out:YWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:56:33.390 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:56:33.437 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:56:33.490 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-10-20T23:56:33.492 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", 2021-10-20T23:56:33.494 INFO:teuthology.task.ansible.out:"user": "rdias", "validate_certs": true} 2021-10-20T23:56:33.526 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:56:33.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:56:33.626 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-10-20T23:56:33.629 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFU 2021-10-20T23:56:33.631 INFO:teuthology.task.ansible.out:Ru+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:56:33.659 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:56:33.702 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:56:33.756 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:56:33.757 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-10-20T23:56:33.768 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:56:33.790 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:56:33.832 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:56:33.886 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-10-20T23:56:33.897 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:56:33.899 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0b 2021-10-20T23:56:33.900 INFO:teuthology.task.ansible.out:sfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:56:33.941 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:56:33.943 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:56:33.974 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:56:33.976 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:56:34.029 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-10-20T23:56:34.030 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-10-20T23:56:34.040 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:56:34.051 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:56:34.085 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:56:34.117 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:56:34.171 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-10-20T23:56:34.183 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:56:34.194 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:56:34.217 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:56:34.260 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-10-20T23:56:34.303 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXW 2021-10-20T23:56:34.305 INFO:teuthology.task.ansible.out:guQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-10-20T23:56:34.325 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:56:34.328 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:56:34.358 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:56:34.359 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:56:34.390 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:56:34.392 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:56:34.435 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:56:34.436 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-10-20T23:56:34.438 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-10-20T23:56:34.459 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:56:34.492 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:56:34.536 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:56:34.568 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:56:34.569 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-10-20T23:56:34.604 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:56:34.624 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:56:34.666 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:56:34.699 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-10-20T23:56:34.699 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:56:34.701 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:56:34.733 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:56:34.736 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:56:34.766 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:56:34.767 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:56:34.798 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:56:34.800 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:56:34.842 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:56:34.844 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-10-20T23:56:34.845 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-10-20T23:56:34.887 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:56:34.899 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:56:34.974 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:56:34.975 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:56:34.976 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-10-20T23:56:35.008 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:56:35.030 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:56:35.104 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:56:35.115 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:56:35.117 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-10-20T23:56:35.148 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:56:35.160 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:56:35.234 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:56:35.245 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-10-20T23:56:35.246 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:35.280 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:35.291 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:35.365 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:35.378 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-10-20T23:56:35.390 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:56:35.423 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:56:35.434 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:56:35.519 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:56:35.531 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-10-20T23:56:35.533 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:56:35.564 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:56:35.576 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:56:35.651 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:56:35.662 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-10-20T23:56:35.664 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:56:35.696 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:56:35.707 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:56:35.792 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:56:35.803 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-10-20T23:56:35.804 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:56:35.826 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:56:35.838 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:56:35.924 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:56:35.935 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-10-20T23:56:35.936 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:56:35.960 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:56:35.971 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:56:36.046 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:56:36.068 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:56:36.070 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-10-20T23:56:36.091 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:56:36.102 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:56:36.176 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:56:36.198 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:56:36.199 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-10-20T23:56:36.221 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:56:36.222 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:56:36.308 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:56:36.331 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:56:36.333 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-10-20T23:56:36.364 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:56:36.366 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:56:36.439 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:56:36.461 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:56:36.463 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-10-20T23:56:36.495 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:56:36.498 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:56:36.583 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:56:36.594 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:56:36.606 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-10-20T23:56:36.638 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:56:36.650 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:56:36.713 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:56:36.735 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:56:36.747 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-10-20T23:56:36.779 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:56:36.791 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:56:36.855 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:56:36.876 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:56:36.878 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-10-20T23:56:36.921 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:56:36.932 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:56:36.987 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:56:37.019 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:56:37.020 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-10-20T23:56:37.063 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:56:37.064 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:56:37.127 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:56:37.149 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:56:37.151 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-10-20T23:56:37.182 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:56:37.193 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:56:37.279 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:56:37.280 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-10-20T23:56:37.282 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:56:37.313 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:56:37.325 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:56:37.409 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:56:37.421 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:56:37.423 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-10-20T23:56:37.459 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:56:37.460 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:56:37.558 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae 2021-10-20T23:56:37.560 INFO:teuthology.task.ansible.out:\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn 2021-10-20T23:56:37.562 INFO:teuthology.task.ansible.out:': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-10-20T23:56:37.591 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:56:37.593 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:56:37.603 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:56:37.605 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:56:37.689 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:56:37.690 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-10-20T23:56:37.692 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmr 2021-10-20T23:56:37.694 INFO:teuthology.task.ansible.out:luaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-10-20T23:56:37.723 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:56:37.745 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:56:37.819 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:56:37.831 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:56:37.832 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-10-20T23:56:37.853 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:56:37.876 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:56:37.952 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:56:37.964 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-10-20T23:56:38.040 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "com 2021-10-20T23:56:38.044 INFO:teuthology.task.ansible.out:ment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:56:38.098 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjK 2021-10-20T23:56:38.101 INFO:teuthology.task.ansible.out:o5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:56:38.112 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-10-20T23:56:38.150 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:56:38.153 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:56:38.172 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:56:38.174 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:56:38.246 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:56:38.251 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:56:38.268 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:56:38.290 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:56:38.315 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-10-20T23:56:38.318 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-10-20T23:56:38.338 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:56:38.395 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:56:38.433 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:56:38.467 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:56:38.490 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-10-20T23:56:38.492 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:56:38.523 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:56:38.567 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:56:38.632 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:56:38.634 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:56:38.657 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-10-20T23:56:38.661 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:56:38.718 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:56:38.773 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:56:38.785 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:56:38.817 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:56:38.819 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-10-20T23:56:38.866 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:56:38.924 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:56:38.938 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:56:38.952 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-10-20T23:56:38.965 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:56:38.999 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:56:39.057 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:56:39.069 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:56:39.091 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-10-20T23:56:39.092 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:56:39.137 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:56:39.191 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:56:39.203 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:56:39.225 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:56:39.237 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-10-20T23:56:39.281 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:56:39.283 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:56:39.335 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:56:39.337 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLg 2021-10-20T23:56:39.339 INFO:teuthology.task.ansible.out:SjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:56:39.358 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-10-20T23:56:39.371 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:56:39.373 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:56:39.403 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:56:39.473 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2021-10-20T23:56:39.475 INFO:teuthology.task.ansible.out:": "ofriedma", "validate_certs": true} 2021-10-20T23:56:39.490 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-10-20T23:56:39.491 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-10-20T23:56:39.502 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:56:39.544 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:56:39.608 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:56:39.610 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:56:39.631 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-10-20T23:56:39.633 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:56:39.675 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:56:39.739 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:56:39.740 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:56:39.762 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-10-20T23:56:39.763 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:56:39.805 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:56:39.870 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:56:39.872 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:56:39.893 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:56:39.895 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-10-20T23:56:39.948 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:56:40.001 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:56:40.003 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:56:40.024 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:56:40.025 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-10-20T23:56:40.078 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:56:40.131 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:56:40.133 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:56:40.153 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:56:40.156 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-10-20T23:56:40.207 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:56:40.209 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:40.273 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:56:40.275 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWe 2021-10-20T23:56:40.277 INFO:teuthology.task.ansible.out:uU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:40.286 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-10-20T23:56:40.288 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:56:40.289 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-10-20T23:56:40.341 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:56:40.405 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:56:40.406 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:56:40.418 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-10-20T23:56:40.420 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:56:40.471 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:56:40.536 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:56:40.537 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:56:40.548 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-10-20T23:56:40.549 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:56:40.613 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:56:40.667 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:56:40.669 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:56:40.679 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-10-20T23:56:40.680 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:56:40.744 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:56:40.802 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:56:40.810 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:56:40.811 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-10-20T23:56:40.822 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:56:40.877 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:56:40.930 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:56:40.941 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:56:40.954 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-10-20T23:56:40.965 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:56:41.012 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:56:41.075 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:56:41.090 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-10-20T23:56:41.092 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkO 2021-10-20T23:56:41.094 INFO:teuthology.task.ansible.out:k7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:56:41.135 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:56:41.199 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:56:41.212 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/ 2021-10-20T23:56:41.214 INFO:teuthology.task.ansible.out:wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-10-20T23:56:41.222 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:56:41.275 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:56:41.339 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:56:41.351 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-10-20T23:56:41.353 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:56:41.364 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:56:41.407 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:56:41.481 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-10-20T23:56:41.483 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:56:41.489 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:56:41.511 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:56:41.566 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:56:41.612 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-10-20T23:56:41.622 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:56:41.624 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:56:41.634 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:56:41.688 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:56:41.752 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-10-20T23:56:41.764 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:56:41.764 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:56:41.766 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:56:41.829 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:56:41.883 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-10-20T23:56:41.894 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:56:41.906 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:56:41.907 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:56:41.961 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:56:42.014 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-10-20T23:56:42.026 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:56:42.027 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:56:42.038 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:56:42.102 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:56:42.145 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-10-20T23:56:42.166 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:56:42.168 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "u 2021-10-20T23:56:42.170 INFO:teuthology.task.ansible.out:ser": "gkyratsas", "validate_certs": true} 2021-10-20T23:56:42.242 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:56:42.285 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-10-20T23:56:42.296 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:56:42.297 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:56:42.299 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:56:42.373 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:56:42.417 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-10-20T23:56:42.428 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:56:42.429 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:56:42.430 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-10-20T23:56:42.505 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:56:42.559 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6O 2021-10-20T23:56:42.561 INFO:teuthology.task.ansible.out:Qw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsX 2021-10-20T23:56:42.563 INFO:teuthology.task.ansible.out:DOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:56:42.636 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:56:42.694 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgn 2021-10-20T23:56:42.696 INFO:teuthology.task.ansible.out:vaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-10-20T23:56:42.704 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:56:42.768 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:56:42.770 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-20T23:56:42.822 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:56:42.824 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFT 2021-10-20T23:56:42.826 INFO:teuthology.task.ansible.out:Vsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-20T23:56:42.834 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-10-20T23:56:42.846 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:56:42.848 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-10-20T23:56:42.909 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:56:42.953 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:56:42.964 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:56:42.976 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-10-20T23:56:42.977 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:56:43.041 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:56:43.095 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:56:43.107 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:56:43.108 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:56:43.119 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-10-20T23:56:43.185 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:56:43.229 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:56:43.240 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:56:43.241 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:56:43.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-10-20T23:56:43.327 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:56:43.370 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:56:43.392 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:56:43.393 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-10-20T23:56:43.404 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:56:43.458 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:56:43.506 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:56:43.518 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:56:43.541 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-10-20T23:56:43.543 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:56:43.617 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:56:43.660 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:56:43.672 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-10-20T23:56:43.673 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:56:43.686 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:56:43.750 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:56:43.792 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:56:43.804 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:56:43.815 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:56:43.828 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-10-20T23:56:43.881 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:56:43.924 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:56:43.935 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:56:43.937 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:43.958 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-10-20T23:56:43.959 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:56:44.012 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:56:44.055 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:56:44.066 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:56:44.089 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:56:44.091 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-10-20T23:56:44.154 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:56:44.197 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:56:44.208 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:56:44.220 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:56:44.231 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-10-20T23:56:44.285 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:56:44.328 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:56:44.339 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:56:44.351 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:56:44.365 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-10-20T23:56:44.419 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:56:44.463 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:56:44.473 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:56:44.485 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:56:44.488 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-10-20T23:56:44.564 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:56:44.608 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:56:44.620 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-10-20T23:56:44.631 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:56:44.633 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:56:44.696 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:56:44.739 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:56:44.750 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:56:44.762 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:56:44.764 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-10-20T23:56:44.869 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:56:44.890 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:56:44.902 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-10-20T23:56:44.904 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "co 2021-10-20T23:56:44.906 INFO:teuthology.task.ansible.out:mment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:56:45.011 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:56:45.013 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:56:45.033 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:56:45.035 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:56:45.046 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:56:45.048 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:56:45.058 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:56:45.060 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:56:45.070 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-10-20T23:56:45.145 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:56:45.179 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vX 2021-10-20T23:56:45.183 INFO:teuthology.task.ansible.out:Os76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:56:45.200 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:56:45.212 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-10-20T23:56:45.213 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-10-20T23:56:45.318 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:56:45.330 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:56:45.343 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:56:45.354 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:56:45.356 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-10-20T23:56:45.451 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:56:45.462 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:56:45.474 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:56:45.497 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:56:45.499 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-10-20T23:56:45.589 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:56:45.601 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R 2021-10-20T23:56:45.603 INFO:teuthology.task.ansible.out:1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:56:45.623 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:56:45.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-10-20T23:56:45.730 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:56:45.731 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": tr 2021-10-20T23:56:45.733 INFO:teuthology.task.ansible.out:ue, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:56:45.765 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:56:45.766 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-10-20T23:56:45.872 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:56:45.872 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:56:45.874 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:56:45.906 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-10-20T23:56:45.917 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:56:46.002 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:56:46.014 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:56:46.025 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:56:46.037 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-10-20T23:56:46.048 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:56:46.133 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:56:46.144 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:56:46.166 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-10-20T23:56:46.177 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:56:46.179 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:56:46.263 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:56:46.285 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:56:46.307 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-10-20T23:56:46.308 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:56:46.319 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:56:46.393 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:56:46.416 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:56:46.438 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-10-20T23:56:46.449 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:56:46.461 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:56:46.535 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:56:46.547 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:56:46.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-10-20T23:56:46.581 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:56:46.582 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:56:46.666 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:56:46.678 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:56:46.711 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-10-20T23:56:46.713 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:56:46.723 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:56:46.798 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:56:46.809 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:56:46.841 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-10-20T23:56:46.853 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:56:46.855 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:56:46.928 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:56:46.940 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:56:46.983 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:56:46.985 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-10-20T23:56:46.996 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:56:47.066 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:56:47.083 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:56:47.105 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:56:47.117 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-10-20T23:56:47.131 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:56:47.208 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:56:47.219 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:56:47.241 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:56:47.253 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-10-20T23:56:47.264 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:56:47.340 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:56:47.351 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:56:47.384 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:56:47.396 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-10-20T23:56:47.398 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-10-20T23:56:47.472 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:56:47.483 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:56:47.515 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:56:47.528 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs 2021-10-20T23:56:47.530 INFO:teuthology.task.ansible.out:90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:56:47.623 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:56:47.646 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:56:47.679 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:56:47.681 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-10-20T23:56:47.691 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:56:47.777 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:56:47.788 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:56:47.821 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:56:47.843 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:56:47.844 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-10-20T23:56:47.921 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:56:47.943 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:56:47.955 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:56:47.987 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-10-20T23:56:47.989 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:56:48.063 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:56:48.156 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:56:48.158 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:56:48.265 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:56:48.270 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-10-20T23:56:48.330 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-10-20T23:56:48.523 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:48 +0000 (0:00:21.092) 0:00:55.892 ***** 2021-10-20T23:56:48.546 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:48 +0000 (0:00:00.023) 0:00:55.915 ***** 2021-10-20T23:56:48.572 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:48 +0000 (0:00:00.026) 0:00:55.941 ***** 2021-10-20T23:56:48.605 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:48 +0000 (0:00:00.030) 0:00:55.972 ***** 2021-10-20T23:56:48.633 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:48 +0000 (0:00:00.030) 0:00:56.002 ***** 2021-10-20T23:56:48.645 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-10-20T23:56:48.647 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.648 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.649 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.682 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.684 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com y 2021-10-20T23:56:48.686 INFO:teuthology.task.ansible.out:UBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@hom 2021-10-20T23:56:48.689 INFO:teuthology.task.ansible.out:e o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.696 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.698 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBu 2021-10-20T23:56:48.700 INFO:teuthology.task.ansible.out:obkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.700 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@m 2021-10-20T23:56:48.702 INFO:teuthology.task.ansible.out:aetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.711 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.713 INFO:teuthology.task.ansible.out: skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.724 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.727 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.737 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.748 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.751 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.751 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2021-10-20T23:56:48.753 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.755 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.765 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.767 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.777 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.788 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.790 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.800 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.801 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop EuLHgn133AdN5AhgoByD2Q f769cce8052fd9d208db045d0d14e9370ed1db8bcc1e249b6968344b86f5339b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.811 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.834 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:56:48.846 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.848 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.870 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:56:48.881 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.883 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:56:48.884 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.895 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.906 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.918 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:56:48.920 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.929 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.962 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-10-20T23:56:48.974 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.976 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:48.986 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:56:49.019 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:56:49.043 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:56:49.066 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:56:49.109 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-10-20T23:56:49.111 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-20T23:56:49.121 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.132 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.134 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.144 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.154 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.156 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.166 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-20T23:56:49.168 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.168 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key' 2021-10-20T23:56:49.170 INFO:teuthology.task.ansible.out:: 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-20T23:56:49.179 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.181 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.191 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.193 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@Wo 2021-10-20T23:56:49.195 INFO:teuthology.task.ansible.out:rkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.205 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-10-20T23:56:49.207 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.208 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ce 2021-10-20T23:56:49.209 INFO:teuthology.task.ansible.out:ph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.209 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.210 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.221 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.225 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.239 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.241 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63d 2021-10-20T23:56:49.243 INFO:teuthology.task.ansible.out:d76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.254 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.255 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.256 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.256 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.257 INFO:teuthology.task.ansible.out:skipping: [smithi071.fr 2021-10-20T23:56:49.258 INFO:teuthology.task.ansible.out:ont.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.266 INFO:teuthology.task.ansible.out: skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.268 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef 2021-10-20T23:56:49.270 INFO:teuthology.task.ansible.out:168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5 2021-10-20T23:56:49.274 INFO:teuthology.task.ansible.out:ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kef 2021-10-20T23:56:49.276 INFO:teuthology.task.ansible.out:u@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7 2021-10-20T23:56:49.277 INFO:teuthology.task.ansible.out:nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a25532 2021-10-20T23:56:49.279 INFO:teuthology.task.ansible.out:7d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72 2021-10-20T23:56:49.280 INFO:teuthology.task.ansible.out:f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@ 2021-10-20T23:56:49.282 INFO:teuthology.task.ansible.out:magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a0 2021-10-20T23:56:49.284 INFO:teuthology.task.ansible.out:4c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bc 2021-10-20T23:56:49.285 INFO:teuthology.task.ansible.out:bac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.296 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e 2021-10-20T23:56:49.298 INFO:teuthology.task.ansible.out:2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.302 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:49.304 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.305 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.307 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.307 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.308 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.309 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.310 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.310 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.se 2021-10-20T23:56:49.312 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.312 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.312 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item 2021-10-20T23:56:49.314 INFO:teuthology.task.ansible.out:={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.314 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:49.315 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.332 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.338 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, " 2021-10-20T23:56:49.339 INFO:teuthology.task.ansible.out:item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.343 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.345 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.345 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.345 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-10-20T23:56:49.347 INFO:teuthology.task.ansible.out: {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.357 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.358 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.359 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] 2021-10-20T23:56:49.361 INFO:teuthology.task.ansible.out: => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.363 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.365 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.365 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.365 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg 2021-10-20T23:56:49.370 INFO:teuthology.task.ansible.out:2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.373 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc77458 2021-10-20T23:56:49.374 INFO:teuthology.task.ansible.out:7e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.375 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7W 2021-10-20T23:56:49.376 INFO:teuthology.task.ansible.out:w 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.387 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.389 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.403 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52L 2021-10-20T23:56:49.405 INFO:teuthology.task.ansible.out:g 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a 2021-10-20T23:56:49.407 INFO:teuthology.task.ansible.out:1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) = 2021-10-20T23:56:49.411 INFO:teuthology.task.ansible.out:> {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={' 2021-10-20T23:56:49.413 INFO:teuthology.task.ansible.out:name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK 2021-10-20T23:56:49.415 INFO:teuthology.task.ansible.out:3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.422 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.424 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.424 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.425 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.427 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.428 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.429 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.440 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.441 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.442 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.442 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ov 2021-10-20T23:56:49.444 INFO:teuthology.task.ansible.out:pn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f 2021-10-20T23:56:49.446 INFO:teuthology.task.ansible.out:5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.452 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (i 2021-10-20T23:56:49.455 INFO:teuthology.task.ansible.out:tem={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.465 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.467 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-10-20T23:56:49.469 INFO:teuthology.task.ansible.out: "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD 2021-10-20T23:56:49.472 INFO:teuthology.task.ansible.out:39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.480 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.481 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.484 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugS 2021-10-20T23:56:49.491 INFO:teuthology.task.ansible.out:tZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442b 2021-10-20T23:56:49.493 INFO:teuthology.task.ansible.out:a7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.496 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.497 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.498 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.499 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.499 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dC 2021-10-20T23:56:49.502 INFO:teuthology.task.ansible.out:iRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e416 2021-10-20T23:56:49.504 INFO:teuthology.task.ansible.out:7aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.513 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.515 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.516 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8V 2021-10-20T23:56:49.517 INFO:teuthology.task.ansible.out:a/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.518 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.518 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.519 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, " 2021-10-20T23:56:49.521 INFO:teuthology.task.ansible.out:skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.538 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.540 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.543 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2021-10-20T23:56:49.545 INFO:teuthology.task.ansible.out:me": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLz 2021-10-20T23:56:49.546 INFO:teuthology.task.ansible.out:P5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.560 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.562 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item 2021-10-20T23:56:49.564 INFO:teuthology.task.ansible.out:": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.574 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.cep 2021-10-20T23:56:49.577 INFO:teuthology.task.ansible.out:h.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e0 2021-10-20T23:56:49.579 INFO:teuthology.task.ansible.out:74f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.589 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.591 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn 2021-10-20T23:56:49.592 INFO:teuthology.task.ansible.out:': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.593 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "ski 2021-10-20T23:56:49.594 INFO:teuthology.task.ansible.out:p_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.604 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.606 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.607 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1c 2021-10-20T23:56:49.608 INFO:teuthology.task.ansible.out:arbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.609 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.620 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.623 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix 2021-10-20T23:56:49.625 INFO:teuthology.task.ansible.out:", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.634 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.635 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.637 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.637 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.638 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.639 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.640 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.651 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.653 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.654 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.654 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanja 2021-10-20T23:56:49.656 INFO:teuthology.task.ansible.out:ra", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.657 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.668 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.668 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.669 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.670 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.671 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", 2021-10-20T23:56:49.673 INFO:teuthology.task.ansible.out:"changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.673 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.673 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.674 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": " 2021-10-20T23:56:49.675 INFO:teuthology.task.ansible.out:rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.686 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.688 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.688 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.689 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.689 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd 2021-10-20T23:56:49.702 INFO:teuthology.task.ansible.out:50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "sk 2021-10-20T23:56:49.707 INFO:teuthology.task.ansible.out:ip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043 2021-10-20T23:56:49.709 INFO:teuthology.task.ansible.out:c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2p 2021-10-20T23:56:49.710 INFO:teuthology.task.ansible.out:Mz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.720 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.722 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.722 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.723 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.723 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCk 2021-10-20T23:56:49.725 INFO:teuthology.task.ansible.out:WSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"} 2021-10-20T23:56:49.727 INFO:teuthology.task.ansible.out:, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.737 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.740 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.743 INFO:teuthology.task.ansible.out: skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f1 2021-10-20T23:56:49.744 INFO:teuthology.task.ansible.out:20cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.747 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.749 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:49.751 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.752 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.754 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'o 2021-10-20T23:56:49.756 INFO:teuthology.task.ansible.out:vpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf 2021-10-20T23:56:49.758 INFO:teuthology.task.ansible.out:313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": 2021-10-20T23:56:49.759 INFO:teuthology.task.ansible.out:"Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.771 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.773 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.775 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2 2021-10-20T23:56:49.777 INFO:teuthology.task.ansible.out:352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d 2021-10-20T23:56:49.779 INFO:teuthology.task.ansible.out:0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.790 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.791 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.802 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.804 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.805 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.805 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.805 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.807 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.807 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.810 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) 2021-10-20T23:56:49.812 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd 2021-10-20T23:56:49.813 INFO:teuthology.task.ansible.out:856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.816 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.826 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.828 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.828 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.828 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.840 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.851 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.853 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.854 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.854 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.865 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.867 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.867 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.869 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_ 2021-10-20T23:56:49.870 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovp 2021-10-20T23:56:49.872 INFO:teuthology.task.ansible.out:n': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.883 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.885 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.886 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pr 2021-10-20T23:56:49.888 INFO:teuthology.task.ansible.out:o-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba 2021-10-20T23:56:49.890 INFO:teuthology.task.ansible.out:55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.901 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.901 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.902 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.903 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.903 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.903 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item 2021-10-20T23:56:49.905 INFO:teuthology.task.ansible.out:", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.906 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item 2021-10-20T23:56:49.907 INFO:teuthology.task.ansible.out:={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.917 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.919 INFO:teuthology.task.ansible.out: skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.920 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khire 2021-10-20T23:56:49.922 INFO:teuthology.task.ansible.out:mat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.933 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.935 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.935 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.937 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.938 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.938 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => 2021-10-20T23:56:49.940 INFO:teuthology.task.ansible.out:(item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0a 2021-10-20T23:56:49.941 INFO:teuthology.task.ansible.out:e6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.942 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.952 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.954 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.955 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.955 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-10-20T23:56:49.958 INFO:teuthology.task.ansible.out:"khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.966 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.968 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.969 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "chan 2021-10-20T23:56:49.970 INFO:teuthology.task.ansible.out:ged": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.986 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.987 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.988 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.988 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.988 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.989 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": 2021-10-20T23:56:49.990 INFO:teuthology.task.ansible.out: "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.991 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.991 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.992 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858 2021-10-20T23:56:49.993 INFO:teuthology.task.ansible.out:bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:49.997 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name 2021-10-20T23:56:49.999 INFO:teuthology.task.ansible.out:': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaa 2021-10-20T23:56:50.001 INFO:teuthology.task.ansible.out:e2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJ 2021-10-20T23:56:50.003 INFO:teuthology.task.ansible.out:Nljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.012 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.014 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.015 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result 2021-10-20T23:56:50.016 INFO:teuthology.task.ansible.out: was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.017 INFO:teuthology.task.ansible.out:skipping: [smithi041.f 2021-10-20T23:56:50.021 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.028 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.030 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.030 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.031 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item= 2021-10-20T23:56:50.033 INFO:teuthology.task.ansible.out:{'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-10-20T23:56:50.035 INFO:teuthology.task.ansible.out:: {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.045 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.047 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.048 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.059 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.071 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.073 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.075 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.076 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.077 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.077 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.078 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_va 2021-10-20T23:56:50.079 INFO:teuthology.task.ansible.out:r": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.081 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.081 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.081 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.082 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => 2021-10-20T23:56:50.083 INFO:teuthology.task.ansible.out:(item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.084 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-10-20T23:56:50.087 INFO:teuthology.task.ansible.out:{"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result wa 2021-10-20T23:56:50.088 INFO:teuthology.task.ansible.out:s False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.089 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", " 2021-10-20T23:56:50.090 INFO:teuthology.task.ansible.out:changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.091 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.s 2021-10-20T23:56:50.092 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.093 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ni 2021-10-20T23:56:50.094 INFO:teuthology.task.ansible.out:zamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.104 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.106 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.132 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.134 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.134 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.134 INFO:teuthology.task.ansible.out:skipping: [smithi0 2021-10-20T23:56:50.136 INFO:teuthology.task.ansible.out:99.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev 9yS+bIbr1MbawLssYvllzQ 3129af06c559ee3876a5c43fbd400494ed87feb472eeaa0bf9b33466183c2da7"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b 2021-10-20T23:56:50.138 INFO:teuthology.task.ansible.out:59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ 2021-10-20T23:56:50.140 INFO:teuthology.task.ansible.out:375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.164 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:01.531) 0:00:57.533 ***** 2021-10-20T23:56:50.174 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.176 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.177 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.177 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.179 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.180 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.181 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.181 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.181 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", " 2021-10-20T23:56:50.183 INFO:teuthology.task.ansible.out:ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.184 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.184 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJ 2021-10-20T23:56:50.186 INFO:teuthology.task.ansible.out:uwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.186 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.187 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpa 2021-10-20T23:56:50.188 INFO:teuthology.task.ansible.out:d_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3 2021-10-20T23:56:50.190 INFO:teuthology.task.ansible.out:uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.190 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.202 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.205 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'na 2021-10-20T23:56:50.207 INFO:teuthology.task.ansible.out:me': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "meli 2021-10-20T23:56:50.208 INFO:teuthology.task.ansible.out:ssali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.209 INFO:teuthology.task.ansible.out:skipping: [smithi10 2021-10-20T23:56:50.210 INFO:teuthology.task.ansible.out:2.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.211 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": " 2021-10-20T23:56:50.212 INFO:teuthology.task.ansible.out:item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": fals 2021-10-20T23:56:50.214 INFO:teuthology.task.ansible.out:e, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.224 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.226 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.228 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.228 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.229 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn 2021-10-20T23:56:50.230 INFO:teuthology.task.ansible.out:": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.271 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.274 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.292 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.294 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.296 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.338 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.173) 0:00:57.706 ***** 2021-10-20T23:56:50.364 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.026) 0:00:57.733 ***** 2021-10-20T23:56:50.389 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.024) 0:00:57.758 ***** 2021-10-20T23:56:50.416 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.027) 0:00:57.785 ***** 2021-10-20T23:56:50.448 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.031) 0:00:57.817 ***** 2021-10-20T23:56:50.454 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-10-20T23:56:50.455 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.456 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.488 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.039) 0:00:57.856 ***** 2021-10-20T23:56:50.512 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.024) 0:00:57.881 ***** 2021-10-20T23:56:50.520 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.522 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:50.548 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.036) 0:00:57.917 ***** 2021-10-20T23:56:50.574 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:50 +0000 (0:00:00.025) 0:00:57.943 ***** 2021-10-20T23:56:50.582 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-10-20T23:56:50.584 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:56:50.691 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:56:50.702 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:56:50.725 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:56:50.769 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:56:50.803 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-10-20T23:56:50.826 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:56:50.836 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:56:50.869 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:56:50.906 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:56:50.939 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-10-20T23:56:50.961 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:56:50.985 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:56:51.008 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:56:51.051 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:56:51.063 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-10-20T23:56:51.107 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:56:51.131 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:56:51.143 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:56:51.187 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:56:51.209 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-10-20T23:56:51.242 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:56:51.275 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:56:51.276 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:56:51.320 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:56:51.341 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-10-20T23:56:51.374 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:56:51.407 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:56:51.409 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:56:51.452 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:56:51.474 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-10-20T23:56:51.518 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:56:51.540 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:56:51.552 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:56:51.584 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:56:51.627 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-10-20T23:56:51.660 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:56:51.671 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:56:51.683 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:56:51.727 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:56:51.749 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-10-20T23:56:51.792 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:56:51.803 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:56:51.825 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:56:51.861 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:56:51.893 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-10-20T23:56:51.927 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:56:51.938 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:56:51.960 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:56:51.962 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:51.993 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:56:52.025 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-10-20T23:56:52.069 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:56:52.081 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:56:52.092 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:56:52.135 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:56:52.159 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-10-20T23:56:52.202 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:56:52.214 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:56:52.237 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:56:52.273 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:56:52.296 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-10-20T23:56:52.341 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:56:52.344 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:56:52.376 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:56:52.421 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:56:52.433 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-10-20T23:56:52.479 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:56:52.491 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:56:52.514 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:56:52.557 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:56:52.569 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-10-20T23:56:52.613 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:56:52.624 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:56:52.658 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:56:52.690 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:56:52.715 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-10-20T23:56:52.756 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:56:52.767 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:56:52.800 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:56:52.832 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:56:52.843 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-10-20T23:56:52.900 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:56:52.911 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:56:52.933 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:56:52.966 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:56:52.990 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-10-20T23:56:53.032 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:56:53.044 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:56:53.078 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:56:53.100 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:56:53.122 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-10-20T23:56:53.175 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:56:53.187 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:56:53.209 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:56:53.231 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:56:53.253 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-10-20T23:56:53.317 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:56:53.319 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:56:53.351 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:56:53.364 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:56:53.397 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-10-20T23:56:53.453 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} ok: [smithi041.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:56:53.486 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:56:53.497 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:56:53.541 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-10-20T23:56:53.591 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:56:53.603 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:56:53.625 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:56:53.636 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:56:53.680 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-10-20T23:56:53.734 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:56:53.745 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:56:53.756 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:56:53.779 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:56:53.821 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-10-20T23:56:53.877 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:56:53.879 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:56:53.904 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:56:53.907 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:56:53.961 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-10-20T23:56:54.016 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:56:54.017 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:56:54.040 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:56:54.042 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:56:54.095 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-10-20T23:56:54.149 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:56:54.160 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:56:54.171 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:56:54.183 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:56:54.236 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-10-20T23:56:54.289 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:56:54.301 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:56:54.312 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:56:54.314 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:56:54.369 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-10-20T23:56:54.423 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:56:54.447 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:56:54.450 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} ok: [smithi062.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:56:54.503 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-10-20T23:56:54.556 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:56:54.581 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} ok: [smithi062.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:56:54.592 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:56:54.645 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-10-20T23:56:54.699 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:56:54.721 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:56:54.725 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} ok: [smithi041.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:56:54.777 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-10-20T23:56:54.831 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:56:54.853 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:56:54.854 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:56:54.866 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:56:54.909 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-10-20T23:56:54.973 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:56:54.984 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:56:54.995 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:56:54.997 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:56:55.039 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-10-20T23:56:55.114 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:56:55.127 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:56:55.128 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:56:55.130 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:56:55.184 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-10-20T23:56:55.249 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:56:55.261 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:56:55.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:56:55.273 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:56:55.317 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-10-20T23:56:55.381 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:56:55.404 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:56:55.405 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:56:55.416 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:56:55.418 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:55.450 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-10-20T23:56:55.514 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:56:55.549 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} ok: [smithi041.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} ok: [smithi099.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:56:55.581 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-10-20T23:56:55.653 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:56:55.685 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:56:55.685 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:56:55.687 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:56:55.720 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-10-20T23:56:55.794 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:56:55.817 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:56:55.829 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:56:55.831 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:56:55.863 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-10-20T23:56:55.927 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:56:55.960 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:56:55.971 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:56:55.983 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:56:55.995 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-10-20T23:56:56.059 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:56:56.102 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:56:56.103 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:56:56.114 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:56:56.136 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-10-20T23:56:56.202 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:56:56.244 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:56:56.245 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:56:56.257 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:56:56.268 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-10-20T23:56:56.332 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:56:56.374 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:56:56.375 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:56:56.386 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:56:56.400 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-10-20T23:56:56.463 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:56:56.516 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:56:56.517 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:56:56.528 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:56:56.540 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-10-20T23:56:56.604 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:56:56.648 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:56:56.648 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:56:56.661 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:56:56.663 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:56.673 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-10-20T23:56:56.737 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:56:56.791 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:56:56.793 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} ok: [smithi099.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:56:56.815 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-10-20T23:56:56.868 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:56:56.922 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:56:56.934 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:56:56.935 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:56:56.947 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-10-20T23:56:57.011 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:56:57.066 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:56:57.067 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:56:57.069 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:56:57.080 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-10-20T23:56:57.134 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:56:57.198 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:56:57.199 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:56:57.200 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:56:57.211 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-10-20T23:56:57.275 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:56:57.335 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:56:57.336 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:56:57.348 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:56:57.359 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-10-20T23:56:57.403 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:56:57.479 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:56:57.480 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} ok: [smithi041.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:56:57.502 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-10-20T23:56:57.536 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:56:57.611 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:56:57.624 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:56:57.636 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:56:57.637 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-10-20T23:56:57.681 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:56:57.756 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:56:57.759 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:56:57.769 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:56:57.771 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-10-20T23:56:57.813 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:56:57.890 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:56:57.901 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-10-20T23:56:57.913 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} ok: [smithi041.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:56:57.957 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:56:58.021 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:56:58.033 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:56:58.045 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-10-20T23:56:58.057 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:56:58.108 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:07.534) 0:01:05.477 ***** 2021-10-20T23:56:58.116 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:56:58.168 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.059) 0:01:05.537 ***** 2021-10-20T23:56:58.177 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:56:58.214 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:56:58.216 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-10-20T23:56:58.282 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.113) 0:01:05.651 ***** 2021-10-20T23:56:58.304 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.022) 0:01:05.673 ***** 2021-10-20T23:56:58.326 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.021) 0:01:05.695 ***** 2021-10-20T23:56:58.659 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-10-20T23:56:58.661 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634774218.2519045-5215-150700854842210/source", "state": "file", "uid": 0} 2021-10-20T23:56:58.685 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.359) 0:01:06.054 ***** 2021-10-20T23:56:58.694 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634774218.1893668-5212-67929353793110/source", "state": "file", "uid": 0} 2021-10-20T23:56:58.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.035) 0:01:06.090 ***** 2021-10-20T23:56:58.760 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-20T23:56:58.762 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => { "msg": "Host smithi071.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634774218.3647506-5230-203746881329257/source", "state": "file", "uid": 0} 2021-10-20T23:56:58.794 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.073) 0:01:06.163 ***** 2021-10-20T23:56:58.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.029) 0:01:06.192 ***** 2021-10-20T23:56:58.832 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634774218.391901-5232-178178550275820/source", "state": "file", "uid": 0} 2021-10-20T23:56:58.835 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "checksum": "3c24666d5ec7240db227d39660f0222d26fcd89b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "bf918fdf05a6a97e741e5654f2d06e66", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1634774218.4133463-5234-128789524699678/source", "state": "file", "uid": 0} TASK [common : Log the OS name, version and release] *************************** ok: [smithi041.front.sepia.ceph.com] => { "msg": "Host smithi041.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:56:58.862 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.038) 0:01:06.231 ***** 2021-10-20T23:56:58.885 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.023) 0:01:06.254 ***** 2021-10-20T23:56:58.909 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.023) 0:01:06.278 ***** 2021-10-20T23:56:58.916 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => { "msg": "Host smithi062.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:56:58.918 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:56:58.945 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.035) 0:01:06.314 ***** 2021-10-20T23:56:58.968 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:58 +0000 (0:00:00.023) 0:01:06.337 ***** 2021-10-20T23:56:58.975 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:56:58.977 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-10-20T23:56:58.977 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => { "msg": "Host smithi099.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:56:58.979 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => { "msg": "Host smithi102.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-10-20T23:56:59.004 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.036) 0:01:06.373 ***** 2021-10-20T23:56:59.027 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.396 ***** 2021-10-20T23:56:59.049 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.418 ***** 2021-10-20T23:56:59.056 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-20T23:56:59.057 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.083 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.034) 0:01:06.452 ***** 2021-10-20T23:56:59.105 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.474 ***** 2021-10-20T23:56:59.112 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.113 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-10-20T23:56:59.113 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:56:59.145 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.039) 0:01:06.514 ***** 2021-10-20T23:56:59.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.024) 0:01:06.539 ***** 2021-10-20T23:56:59.178 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-10-20T23:56:59.179 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-10-20T23:56:59.180 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.207 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.036) 0:01:06.576 ***** 2021-10-20T23:56:59.231 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.024) 0:01:06.600 ***** 2021-10-20T23:56:59.240 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-10-20T23:56:59.241 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.267 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.035) 0:01:06.636 ***** 2021-10-20T23:56:59.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.659 ***** 2021-10-20T23:56:59.312 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.681 ***** 2021-10-20T23:56:59.319 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-10-20T23:56:59.321 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.035) 0:01:06.716 ***** 2021-10-20T23:56:59.375 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.027) 0:01:06.744 ***** 2021-10-20T23:56:59.384 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-20T23:56:59.385 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.417 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.041) 0:01:06.785 ***** 2021-10-20T23:56:59.444 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.028) 0:01:06.813 ***** 2021-10-20T23:56:59.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:06.836 ***** 2021-10-20T23:56:59.473 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-20T23:56:59.475 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.504 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.037) 0:01:06.873 ***** 2021-10-20T23:56:59.529 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.023) 0:01:06.897 ***** 2021-10-20T23:56:59.535 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-10-20T23:56:59.537 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.563 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.034) 0:01:06.932 ***** 2021-10-20T23:56:59.587 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.024) 0:01:06.956 ***** 2021-10-20T23:56:59.595 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-20T23:56:59.598 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.623 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.035) 0:01:06.992 ***** 2021-10-20T23:56:59.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.030) 0:01:07.023 ***** 2021-10-20T23:56:59.662 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-10-20T23:56:59.664 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.690 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.036) 0:01:07.059 ***** 2021-10-20T23:56:59.712 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.022) 0:01:07.081 ***** 2021-10-20T23:56:59.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.023) 0:01:07.105 ***** 2021-10-20T23:56:59.744 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.746 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.774 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.038) 0:01:07.143 ***** 2021-10-20T23:56:59.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.026) 0:01:07.170 ***** 2021-10-20T23:56:59.810 INFO:teuthology.task.ansible.out: 2021-10-20T23:56:59.813 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.839 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.037) 0:01:07.208 ***** 2021-10-20T23:56:59.871 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.031) 0:01:07.240 ***** 2021-10-20T23:56:59.895 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.024) 0:01:07.264 ***** 2021-10-20T23:56:59.904 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-10-20T23:56:59.906 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.932 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.036) 0:01:07.301 ***** 2021-10-20T23:56:59.958 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.026) 0:01:07.327 ***** 2021-10-20T23:56:59.967 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-10-20T23:56:59.969 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:56:59.997 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:56:59 +0000 (0:00:00.039) 0:01:07.366 ***** 2021-10-20T23:57:00.022 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.024) 0:01:07.391 ***** 2021-10-20T23:57:00.048 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.025) 0:01:07.417 ***** 2021-10-20T23:57:00.061 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.091 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.042) 0:01:07.460 ***** 2021-10-20T23:57:00.114 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:07.483 ***** 2021-10-20T23:57:00.124 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-20T23:57:00.127 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.154 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.039) 0:01:07.523 ***** 2021-10-20T23:57:00.180 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.026) 0:01:07.549 ***** 2021-10-20T23:57:00.207 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.026) 0:01:07.576 ***** 2021-10-20T23:57:00.215 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-10-20T23:57:00.217 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.250 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.043) 0:01:07.620 ***** 2021-10-20T23:57:00.274 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:07.643 ***** 2021-10-20T23:57:00.282 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:57:00.283 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.285 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi071.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.285 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.312 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.037) 0:01:07.680 ***** 2021-10-20T23:57:00.337 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.025) 0:01:07.706 ***** 2021-10-20T23:57:00.361 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:07.730 ***** 2021-10-20T23:57:00.368 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi062.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.370 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.397 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.035) 0:01:07.766 ***** 2021-10-20T23:57:00.420 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.022) 0:01:07.788 ***** 2021-10-20T23:57:00.427 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-20T23:57:00.429 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.456 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.036) 0:01:07.825 ***** 2021-10-20T23:57:00.480 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:07.848 ***** 2021-10-20T23:57:00.504 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.024) 0:01:07.872 ***** 2021-10-20T23:57:00.511 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-10-20T23:57:00.513 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi099.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.540 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.037) 0:01:07.909 ***** 2021-10-20T23:57:00.567 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.026) 0:01:07.936 ***** 2021-10-20T23:57:00.575 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-20T23:57:00.576 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.607 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.040) 0:01:07.976 ***** 2021-10-20T23:57:00.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.026) 0:01:08.003 ***** 2021-10-20T23:57:00.641 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-10-20T23:57:00.643 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.644 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.644 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.670 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.036) 0:01:08.039 ***** 2021-10-20T23:57:00.696 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.025) 0:01:08.065 ***** 2021-10-20T23:57:00.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:08.089 ***** 2021-10-20T23:57:00.729 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.754 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.034) 0:01:08.123 ***** 2021-10-20T23:57:00.778 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:08.147 ***** 2021-10-20T23:57:00.788 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** 2021-10-20T23:57:00.790 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.815 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.036) 0:01:08.184 ***** 2021-10-20T23:57:00.838 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.022) 0:01:08.206 ***** 2021-10-20T23:57:00.861 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.023) 0:01:08.230 ***** 2021-10-20T23:57:00.867 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-20T23:57:00.869 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.898 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.037) 0:01:08.268 ***** 2021-10-20T23:57:00.923 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.024) 0:01:08.292 ***** 2021-10-20T23:57:00.931 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:00.932 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-10-20T23:57:00.933 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.962 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.039) 0:01:08.331 ***** 2021-10-20T23:57:00.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:00 +0000 (0:00:00.024) 0:01:08.356 ***** 2021-10-20T23:57:00.996 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:00.999 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.023 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.035) 0:01:08.391 ***** 2021-10-20T23:57:01.048 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.025) 0:01:08.417 ***** 2021-10-20T23:57:01.074 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.025) 0:01:08.443 ***** 2021-10-20T23:57:01.082 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.083 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:01.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.035) 0:01:08.479 ***** 2021-10-20T23:57:01.135 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.024) 0:01:08.503 ***** 2021-10-20T23:57:01.144 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-20T23:57:01.146 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:01.146 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.176 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.040) 0:01:08.544 ***** 2021-10-20T23:57:01.203 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.027) 0:01:08.572 ***** 2021-10-20T23:57:01.235 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.032) 0:01:08.604 ***** 2021-10-20T23:57:01.246 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-20T23:57:01.247 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:01.249 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.278 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.041) 0:01:08.646 ***** 2021-10-20T23:57:01.300 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.023) 0:01:08.669 ***** 2021-10-20T23:57:01.308 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.343 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.043) 0:01:08.712 ***** 2021-10-20T23:57:01.369 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.024) 0:01:08.737 ***** 2021-10-20T23:57:01.377 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-10-20T23:57:01.381 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.405 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.036) 0:01:08.774 ***** 2021-10-20T23:57:01.431 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.025) 0:01:08.799 ***** 2021-10-20T23:57:01.442 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-10-20T23:57:01.445 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.470 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.039) 0:01:08.839 ***** 2021-10-20T23:57:01.494 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.023) 0:01:08.863 ***** 2021-10-20T23:57:01.502 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.503 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.036) 0:01:08.899 ***** 2021-10-20T23:57:01.556 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.025) 0:01:08.925 ***** 2021-10-20T23:57:01.563 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-10-20T23:57:01.565 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.591 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.035) 0:01:08.960 ***** 2021-10-20T23:57:01.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.023) 0:01:08.983 ***** 2021-10-20T23:57:01.622 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-10-20T23:57:01.624 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.046) 0:01:09.030 ***** 2021-10-20T23:57:01.694 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.033) 0:01:09.063 ***** 2021-10-20T23:57:01.702 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.704 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:01.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.046) 0:01:09.109 ***** 2021-10-20T23:57:01.765 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.025) 0:01:09.134 ***** 2021-10-20T23:57:01.804 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.038) 0:01:09.173 ***** 2021-10-20T23:57:01.813 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-20T23:57:01.815 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:01.844 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.039) 0:01:09.213 ***** 2021-10-20T23:57:01.869 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.024) 0:01:09.237 ***** 2021-10-20T23:57:01.896 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.027) 0:01:09.265 ***** 2021-10-20T23:57:01.906 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-10-20T23:57:01.908 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.909 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:01.939 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.042) 0:01:09.308 ***** 2021-10-20T23:57:01.962 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.023) 0:01:09.331 ***** 2021-10-20T23:57:01.985 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:01 +0000 (0:00:00.022) 0:01:09.353 ***** 2021-10-20T23:57:01.991 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-10-20T23:57:01.993 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.021 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.036) 0:01:09.390 ***** 2021-10-20T23:57:02.045 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.023) 0:01:09.414 ***** 2021-10-20T23:57:02.052 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-20T23:57:02.054 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:02.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.033) 0:01:09.448 ***** 2021-10-20T23:57:02.125 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.045) 0:01:09.493 ***** 2021-10-20T23:57:02.135 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.137 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.168 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.043) 0:01:09.537 ***** 2021-10-20T23:57:02.197 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.029) 0:01:09.566 ***** 2021-10-20T23:57:02.224 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.027) 0:01:09.593 ***** 2021-10-20T23:57:02.236 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-10-20T23:57:02.238 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.041) 0:01:09.634 ***** 2021-10-20T23:57:02.299 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.025) 0:01:09.660 ***** 2021-10-20T23:57:02.320 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.029) 0:01:09.689 ***** 2021-10-20T23:57:02.329 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:02.331 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.357 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.036) 0:01:09.726 ***** 2021-10-20T23:57:02.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.023) 0:01:09.749 ***** 2021-10-20T23:57:02.388 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-10-20T23:57:02.390 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.418 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.037) 0:01:09.787 ***** 2021-10-20T23:57:02.447 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.028) 0:01:09.815 ***** 2021-10-20T23:57:02.455 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-20T23:57:02.457 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.486 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.039) 0:01:09.854 ***** 2021-10-20T23:57:02.518 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.033) 0:01:09.887 ***** 2021-10-20T23:57:02.544 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.025) 0:01:09.913 ***** 2021-10-20T23:57:02.553 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-20T23:57:02.555 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.555 INFO:teuthology.task.ansible.out:TASK [common : Store list of enabled repos] ************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.584 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.040) 0:01:09.953 ***** 2021-10-20T23:57:02.609 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.024) 0:01:09.978 ***** 2021-10-20T23:57:02.636 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.026) 0:01:10.005 ***** 2021-10-20T23:57:02.644 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-10-20T23:57:02.648 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:02.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.039) 0:01:10.044 ***** 2021-10-20T23:57:02.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.025) 0:01:10.069 ***** 2021-10-20T23:57:02.707 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-20T23:57:02.709 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.738 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.037) 0:01:10.107 ***** 2021-10-20T23:57:02.765 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.027) 0:01:10.134 ***** 2021-10-20T23:57:02.790 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.025) 0:01:10.159 ***** 2021-10-20T23:57:02.802 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.827 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.036) 0:01:10.196 ***** 2021-10-20T23:57:02.854 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.023) 0:01:10.220 ***** 2021-10-20T23:57:02.858 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-20T23:57:02.860 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.893 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.042) 0:01:10.262 ***** 2021-10-20T23:57:02.919 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.025) 0:01:10.288 ***** 2021-10-20T23:57:02.929 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-10-20T23:57:02.931 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:02.957 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.037) 0:01:10.326 ***** 2021-10-20T23:57:02.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:02 +0000 (0:00:00.030) 0:01:10.356 ***** 2021-10-20T23:57:03.025 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.037) 0:01:10.393 ***** 2021-10-20T23:57:03.035 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-20T23:57:03.037 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:03.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.042) 0:01:10.436 ***** 2021-10-20T23:57:03.094 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.023) 0:01:10.460 ***** 2021-10-20T23:57:03.098 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-10-20T23:57:03.100 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.126 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.035) 0:01:10.495 ***** 2021-10-20T23:57:03.149 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.023) 0:01:10.518 ***** 2021-10-20T23:57:03.174 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.024) 0:01:10.543 ***** 2021-10-20T23:57:03.182 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-20T23:57:03.185 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.212 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.038) 0:01:10.581 ***** 2021-10-20T23:57:03.244 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.031) 0:01:10.613 ***** 2021-10-20T23:57:03.265 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-10-20T23:57:03.268 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.300 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.056) 0:01:10.669 ***** 2021-10-20T23:57:03.309 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.336 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.035) 0:01:10.705 ***** 2021-10-20T23:57:03.343 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-20T23:57:03.345 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.370 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.034) 0:01:10.739 ***** 2021-10-20T23:57:03.380 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.382 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:03.409 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.038) 0:01:10.778 ***** 2021-10-20T23:57:03.435 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.025) 0:01:10.804 ***** 2021-10-20T23:57:03.442 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.444 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.446 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.473 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.038) 0:01:10.842 ***** 2021-10-20T23:57:03.496 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.022) 0:01:10.865 ***** 2021-10-20T23:57:03.520 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.024) 0:01:10.889 ***** 2021-10-20T23:57:03.529 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.531 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.558 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.037) 0:01:10.927 ***** 2021-10-20T23:57:03.581 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.022) 0:01:10.949 ***** 2021-10-20T23:57:03.589 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-20T23:57:03.591 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.619 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.038) 0:01:10.988 ***** 2021-10-20T23:57:03.758 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-20T23:57:03.760 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.761 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:03.788 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.169) 0:01:11.157 ***** 2021-10-20T23:57:03.797 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-20T23:57:03.799 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:03.832 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:03 +0000 (0:00:00.043) 0:01:11.201 ***** 2021-10-20T23:57:03.840 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-20T23:57:03.842 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.004 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.172) 0:01:11.373 ***** 2021-10-20T23:57:04.011 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-10-20T23:57:04.013 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.039 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.035) 0:01:11.408 ***** 2021-10-20T23:57:04.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.024) 0:01:11.433 ***** 2021-10-20T23:57:04.074 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi062.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.076 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.105 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.040) 0:01:11.474 ***** 2021-10-20T23:57:04.130 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.025) 0:01:11.499 ***** 2021-10-20T23:57:04.156 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.025) 0:01:11.524 ***** 2021-10-20T23:57:04.163 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-10-20T23:57:04.165 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.034) 0:01:11.559 ***** 2021-10-20T23:57:04.197 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:57:04.199 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.225 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.034) 0:01:11.594 ***** 2021-10-20T23:57:04.233 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:04.235 INFO:teuthology.task.ansible.out:TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.237 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.237 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.017968", "end": "2021-10-20 23:57:04.748105", "rc": 0, "start": "2021-10-20 23:57:04.730137", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:57:04.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.039) 0:01:11.634 ***** 2021-10-20T23:57:04.288 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.023) 0:01:11.657 ***** 2021-10-20T23:57:04.311 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.023) 0:01:11.680 ***** 2021-10-20T23:57:04.319 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-10-20T23:57:04.321 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.035) 0:01:11.716 ***** 2021-10-20T23:57:04.354 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-20T23:57:04.355 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.389 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.041) 0:01:11.758 ***** 2021-10-20T23:57:04.398 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-20T23:57:04.400 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.430 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.041) 0:01:11.799 ***** 2021-10-20T23:57:04.454 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.023) 0:01:11.822 ***** 2021-10-20T23:57:04.463 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.464 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:04.465 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012769", "end": "2021-10-20 23:57:04.229335", "rc": 0, "start": "2021-10-20 23:57:04.216566", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:57:04.465 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-10-20T23:57:04.466 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.492 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.038) 0:01:11.861 ***** 2021-10-20T23:57:04.516 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.022) 0:01:11.884 ***** 2021-10-20T23:57:04.541 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.025) 0:01:11.910 ***** 2021-10-20T23:57:04.548 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:57:04.550 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.551 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.580 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.038) 0:01:11.949 ***** 2021-10-20T23:57:04.605 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.025) 0:01:11.974 ***** 2021-10-20T23:57:04.613 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-20T23:57:04.616 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.643 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.036) 0:01:12.011 ***** 2021-10-20T23:57:04.651 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-10-20T23:57:04.655 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.682 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.039) 0:01:12.051 ***** 2021-10-20T23:57:04.701 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:04.703 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi099.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.729 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.046) 0:01:12.098 ***** 2021-10-20T23:57:04.730 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:04.738 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-10-20T23:57:04.740 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.768 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.038) 0:01:12.137 ***** 2021-10-20T23:57:04.776 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-10-20T23:57:04.777 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.811 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.043) 0:01:12.180 ***** 2021-10-20T23:57:04.818 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:57:04.820 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.034) 0:01:12.214 ***** 2021-10-20T23:57:04.854 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.023391", "end": "2021-10-20 23:57:05.119380", "rc": 0, "start": "2021-10-20 23:57:05.095989", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:57:04.883 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.037) 0:01:12.252 ***** 2021-10-20T23:57:04.901 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-10-20T23:57:04.903 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.933 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.049) 0:01:12.302 ***** 2021-10-20T23:57:04.963 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-20T23:57:04.965 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:04.991 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:04 +0000 (0:00:00.057) 0:01:12.359 ***** 2021-10-20T23:57:05.041 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:05.044 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.017415", "end": "2021-10-20 23:57:04.719939", "rc": 0, "start": "2021-10-20 23:57:04.702524", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:57:05.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.076) 0:01:12.436 ***** 2021-10-20T23:57:05.075 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.075 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-10-20T23:57:05.077 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.077 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-10-20T23:57:05.104 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.036) 0:01:12.473 ***** 2021-10-20T23:57:05.136 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:05.138 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016164", "end": "2021-10-20 23:57:04.780461", "rc": 0, "start": "2021-10-20 23:57:04.764297", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-10-20T23:57:05.165 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.061) 0:01:12.534 ***** 2021-10-20T23:57:05.172 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-10-20T23:57:05.173 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.200 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.035) 0:01:12.569 ***** 2021-10-20T23:57:05.240 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.242 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.242 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.070) 0:01:12.640 ***** 2021-10-20T23:57:05.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.282 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.308 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.036) 0:01:12.676 ***** 2021-10-20T23:57:05.349 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.377 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.069) 0:01:12.746 ***** 2021-10-20T23:57:05.385 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.385 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-10-20T23:57:05.434 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.459 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.556 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.568 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-10-20T23:57:05.616 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.646 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.268) 0:01:13.015 ***** 2021-10-20T23:57:05.657 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-10-20T23:57:05.659 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.053) 0:01:13.068 ***** 2021-10-20T23:57:05.729 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:05.731 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.757 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.058) 0:01:13.126 ***** 2021-10-20T23:57:05.766 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.767 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.779 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.779 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:05.780 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.805 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.048) 0:01:13.174 ***** 2021-10-20T23:57:05.824 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.826 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} TASK [common : Set the timezone] *********************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.852 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.045) 0:01:13.220 ***** 2021-10-20T23:57:05.880 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:05.915 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.064) 0:01:13.284 ***** 2021-10-20T23:57:05.923 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:05.924 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.957 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.041) 0:01:13.326 ***** 2021-10-20T23:57:05.965 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:57:05.968 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [smithi099.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:05.997 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:05 +0000 (0:00:00.040) 0:01:13.366 ***** 2021-10-20T23:57:06.007 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:57:06.008 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.009 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:06.010 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:06.039 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.041) 0:01:13.408 ***** 2021-10-20T23:57:06.050 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:06.052 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.083 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.044) 0:01:13.452 ***** 2021-10-20T23:57:06.094 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-20T23:57:06.096 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.124 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.040) 0:01:13.493 ***** 2021-10-20T23:57:06.133 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-10-20T23:57:06.135 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:06.138 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.168 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.043) 0:01:13.537 ***** 2021-10-20T23:57:06.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.024) 0:01:13.562 ***** 2021-10-20T23:57:06.200 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-20T23:57:06.202 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [smithi102.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-10-20T23:57:06.206 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.040) 0:01:13.603 ***** 2021-10-20T23:57:06.235 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:06.261 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.027) 0:01:13.630 ***** 2021-10-20T23:57:06.285 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.023) 0:01:13.654 ***** 2021-10-20T23:57:06.293 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.294 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.321 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.035) 0:01:13.690 ***** 2021-10-20T23:57:06.344 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.023) 0:01:13.713 ***** 2021-10-20T23:57:06.351 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:57:06.353 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.378 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.033) 0:01:13.746 ***** 2021-10-20T23:57:06.385 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-10-20T23:57:06.387 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.421 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.043) 0:01:13.790 ***** 2021-10-20T23:57:06.428 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-10-20T23:57:06.430 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.458 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.036) 0:01:13.827 ***** 2021-10-20T23:57:06.470 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.498 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.039) 0:01:13.867 ***** 2021-10-20T23:57:06.507 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.535 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.037) 0:01:13.904 ***** 2021-10-20T23:57:06.544 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:57:06.545 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.575 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.039) 0:01:13.944 ***** 2021-10-20T23:57:06.583 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-20T23:57:06.585 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.612 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.037) 0:01:13.981 ***** 2021-10-20T23:57:06.620 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-10-20T23:57:06.622 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.649 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.036) 0:01:14.018 ***** 2021-10-20T23:57:06.656 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-20T23:57:06.659 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.685 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.034) 0:01:14.053 ***** 2021-10-20T23:57:06.703 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:57:06.705 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.231539", "end": "2021-10-20 23:57:06.500436", "rc": 0, "start": "2021-10-20 23:57:06.268897", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:06.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.050) 0:01:14.103 ***** 2021-10-20T23:57:06.744 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-10-20T23:57:06.746 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.040) 0:01:14.144 ***** 2021-10-20T23:57:06.785 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.823 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.048) 0:01:14.192 ***** 2021-10-20T23:57:06.835 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-20T23:57:06.837 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.863 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.039) 0:01:14.232 ***** 2021-10-20T23:57:06.871 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-10-20T23:57:06.873 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:06.908 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:06 +0000 (0:00:00.044) 0:01:14.276 ***** 2021-10-20T23:57:06.989 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:57:06.991 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.604122", "end": "2021-10-20 23:57:07.500434", "rc": 0, "start": "2021-10-20 23:57:06.896312", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.107) 0:01:14.384 ***** 2021-10-20T23:57:07.087 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:07.111 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.096) 0:01:14.481 ***** 2021-10-20T23:57:07.183 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-20T23:57:07.185 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.125953", "end": "2021-10-20 23:57:06.983300", "rc": 0, "start": "2021-10-20 23:57:06.857347", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.210 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.098) 0:01:14.579 ***** 2021-10-20T23:57:07.217 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:57:07.218 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.456899", "end": "2021-10-20 23:57:07.500462", "rc": 0, "start": "2021-10-20 23:57:07.043563", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.244 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.034) 0:01:14.613 ***** 2021-10-20T23:57:07.316 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:07.341 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.096) 0:01:14.710 ***** 2021-10-20T23:57:07.423 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-20T23:57:07.425 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.126999", "end": "2021-10-20 23:57:07.928655", "rc": 0, "start": "2021-10-20 23:57:07.801656", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.451 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.109) 0:01:14.820 ***** 2021-10-20T23:57:07.652 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.131680", "end": "2021-10-20 23:57:07.944934", "rc": 0, "start": "2021-10-20 23:57:07.813254", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.678 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.227) 0:01:15.047 ***** 2021-10-20T23:57:07.824 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-10-20T23:57:07.826 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.862843", "end": "2021-10-20 23:57:07.500480", "rc": 0, "start": "2021-10-20 23:57:06.637637", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.172) 0:01:15.219 ***** 2021-10-20T23:57:07.869 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.815679", "end": "2021-10-20 23:57:07.509298", "rc": 0, "start": "2021-10-20 23:57:06.693619", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:07.895 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.045) 0:01:15.264 ***** 2021-10-20T23:57:07.934 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-10-20T23:57:07.936 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:07.961 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:07 +0000 (0:00:00.064) 0:01:15.329 ***** 2021-10-20T23:57:07.979 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:08.012 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:08 +0000 (0:00:00.050) 0:01:15.379 ***** 2021-10-20T23:57:08.250 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-10-20T23:57:08.252 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.108961", "end": "2021-10-20 23:57:07.923405", "rc": 0, "start": "2021-10-20 23:57:07.814444", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:08.283 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:08 +0000 (0:00:00.272) 0:01:15.652 ***** 2021-10-20T23:57:08.322 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.121335", "end": "2021-10-20 23:57:07.964395", "rc": 0, "start": "2021-10-20 23:57:07.843060", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:08.348 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:08 +0000 (0:00:00.065) 0:01:15.717 ***** 2021-10-20T23:57:11.146 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-20T23:57:11.149 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:11.183 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:11 +0000 (0:00:02.834) 0:01:18.552 ***** 2021-10-20T23:57:11.198 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:11.228 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:11 +0000 (0:00:00.045) 0:01:18.597 ***** 2021-10-20T23:57:11.518 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:11.561 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:11 +0000 (0:00:00.331) 0:01:18.929 ***** 2021-10-20T23:57:11.961 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:57:11.963 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:11.987 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:11 +0000 (0:00:00.427) 0:01:19.356 ***** 2021-10-20T23:57:12.006 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:12.033 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.044) 0:01:19.401 ***** 2021-10-20T23:57:12.042 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:12.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.034) 0:01:19.436 ***** 2021-10-20T23:57:12.076 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-20T23:57:12.078 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:12.102 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.034) 0:01:19.471 ***** 2021-10-20T23:57:12.108 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-10-20T23:57:12.110 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1634773952, "cache_updated": false, "changed": false} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:12.135 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.032) 0:01:19.504 ***** 2021-10-20T23:57:12.159 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.023) 0:01:19.527 ***** 2021-10-20T23:57:12.323 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:57:12.326 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:12.358 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.199) 0:01:19.727 ***** 2021-10-20T23:57:12.433 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:12.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.113) 0:01:19.841 ***** 2021-10-20T23:57:12.514 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-20T23:57:12.517 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:57:12.550 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.077) 0:01:19.919 ***** 2021-10-20T23:57:12.558 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:57:12.586 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.035) 0:01:19.955 ***** 2021-10-20T23:57:12.830 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:57:12.832 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:12.859 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.272) 0:01:20.228 ***** 2021-10-20T23:57:12.878 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-20T23:57:12.880 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:57:12.905 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.046) 0:01:20.274 ***** 2021-10-20T23:57:12.913 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-10-20T23:57:12.914 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:57:12.941 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.035) 0:01:20.310 ***** 2021-10-20T23:57:12.949 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-10-20T23:57:12.951 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:12.978 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:12 +0000 (0:00:00.037) 0:01:20.347 ***** 2021-10-20T23:57:13.008 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:13.036 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.056) 0:01:20.404 ***** 2021-10-20T23:57:13.286 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-20T23:57:13.288 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:13.317 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.282) 0:01:20.686 ***** 2021-10-20T23:57:13.336 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:13.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.047) 0:01:20.733 ***** 2021-10-20T23:57:13.420 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-10-20T23:57:13.421 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:57:13.456 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.091) 0:01:20.825 ***** 2021-10-20T23:57:13.471 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-10-20T23:57:13.507 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.050) 0:01:20.876 ***** 2021-10-20T23:57:13.634 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-10-20T23:57:13.636 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:13.675 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:13 +0000 (0:00:00.168) 0:01:21.044 ***** 2021-10-20T23:57:13.769 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:13.771 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:57:13.828 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:57:14.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:57:14.116 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:57:14.171 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:57:14.193 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:14.218 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.543) 0:01:21.587 ***** 2021-10-20T23:57:14.246 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:57:14.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.053) 0:01:21.641 ***** 2021-10-20T23:57:14.417 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:14.419 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:57:14.450 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.175) 0:01:21.817 ***** 2021-10-20T23:57:14.457 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:57:14.480 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:57:14.523 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.074) 0:01:21.891 ***** 2021-10-20T23:57:14.597 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:57:14.599 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:57:14.626 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.103) 0:01:21.995 ***** 2021-10-20T23:57:14.647 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:14.649 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:57:14.669 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:57:14.671 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:57:14.695 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.069) 0:01:22.064 ***** 2021-10-20T23:57:14.712 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:14.714 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-10-20T23:57:14.757 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:57:14.786 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.091) 0:01:22.155 ***** 2021-10-20T23:57:14.788 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:14.939 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:57:14.963 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:14 +0000 (0:00:00.176) 0:01:22.332 ***** 2021-10-20T23:57:14.981 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:14.982 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:57:15.036 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi062.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:57:15.058 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi102.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-10-20T23:57:15.096 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:15.097 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:57:15.292 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-10-20T23:57:15.294 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:57:15.319 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.355) 0:01:22.688 ***** 2021-10-20T23:57:15.354 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi062.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:57:15.374 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:57:15.384 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi102.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-10-20T23:57:15.413 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.093) 0:01:22.781 ***** 2021-10-20T23:57:15.425 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:15.428 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:57:15.473 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-10-20T23:57:15.475 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:57:15.499 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.087) 0:01:22.869 ***** 2021-10-20T23:57:15.571 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:57:15.606 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.102) 0:01:22.971 ***** 2021-10-20T23:57:15.688 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:15.689 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:57:15.693 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:57:15.720 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.117) 0:01:23.089 ***** 2021-10-20T23:57:15.750 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:57:15.784 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.063) 0:01:23.153 ***** 2021-10-20T23:57:15.825 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-20T23:57:15.826 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:15.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.066) 0:01:23.219 ***** 2021-10-20T23:57:15.867 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:15.898 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.046) 0:01:23.265 ***** 2021-10-20T23:57:15.905 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:15.907 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-10-20T23:57:15.929 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:15.958 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.061) 0:01:23.327 ***** 2021-10-20T23:57:15.975 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.002 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:15 +0000 (0:00:00.044) 0:01:23.371 ***** 2021-10-20T23:57:16.012 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.014 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} ok: [smithi071.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:57:16.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.044) 0:01:23.416 ***** 2021-10-20T23:57:16.055 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-10-20T23:57:16.057 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:16.093 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.043) 0:01:23.460 ***** 2021-10-20T23:57:16.101 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:16.129 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.038) 0:01:23.498 ***** 2021-10-20T23:57:16.147 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-10-20T23:57:16.149 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:16.174 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.045) 0:01:23.543 ***** 2021-10-20T23:57:16.203 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.207 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.209 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:57:16.219 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-20T23:57:16.221 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.232 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.235 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.260 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.085) 0:01:23.628 ***** 2021-10-20T23:57:16.267 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.269 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.269 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.270 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi041.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.298 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.038) 0:01:23.667 ***** 2021-10-20T23:57:16.321 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.022) 0:01:23.689 ***** 2021-10-20T23:57:16.327 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.329 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-10-20T23:57:16.340 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-20T23:57:16.341 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.045) 0:01:23.735 ***** 2021-10-20T23:57:16.373 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.035) 0:01:23.770 ***** 2021-10-20T23:57:16.409 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:16.437 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.036) 0:01:23.806 ***** 2021-10-20T23:57:16.531 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.533 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.534 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.561 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.122) 0:01:23.928 ***** 2021-10-20T23:57:16.567 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-10-20T23:57:16.569 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.570 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.597 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.037) 0:01:23.966 ***** 2021-10-20T23:57:16.615 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-10-20T23:57:16.618 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-10-20T23:57:16.644 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.047) 0:01:24.013 ***** 2021-10-20T23:57:16.651 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:16.690 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.045) 0:01:24.059 ***** 2021-10-20T23:57:16.699 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-20T23:57:16.701 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.727 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.036) 0:01:24.096 ***** 2021-10-20T23:57:16.736 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:16.765 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.036) 0:01:24.132 ***** 2021-10-20T23:57:16.774 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.803 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.038) 0:01:24.171 ***** 2021-10-20T23:57:16.847 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:16.876 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.073) 0:01:24.244 ***** 2021-10-20T23:57:16.886 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:16.912 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.036) 0:01:24.281 ***** 2021-10-20T23:57:16.943 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:16.970 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:16 +0000 (0:00:00.057) 0:01:24.339 ***** 2021-10-20T23:57:17.008 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.022 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.030 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.042 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.071 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.101) 0:01:24.440 ***** 2021-10-20T23:57:17.088 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.090 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.101 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.112 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.113 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:17.139 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.067) 0:01:24.508 ***** 2021-10-20T23:57:17.162 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.023) 0:01:24.531 ***** 2021-10-20T23:57:17.170 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-20T23:57:17.171 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.172 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:17.198 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.036) 0:01:24.567 ***** 2021-10-20T23:57:17.221 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.023) 0:01:24.590 ***** 2021-10-20T23:57:17.241 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-10-20T23:57:17.243 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:17.280 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.057) 0:01:24.648 ***** 2021-10-20T23:57:17.468 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-20T23:57:17.470 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:17.500 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.220) 0:01:24.869 ***** 2021-10-20T23:57:17.533 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-20T23:57:17.535 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:57:17.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.062) 0:01:24.933 ***** 2021-10-20T23:57:17.597 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:57:17.625 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.061) 0:01:24.994 ***** 2021-10-20T23:57:17.912 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:57:17.938 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:17 +0000 (0:00:00.313) 0:01:25.307 ***** 2021-10-20T23:57:17.980 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-20T23:57:17.983 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:18.010 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.071) 0:01:25.379 ***** 2021-10-20T23:57:18.022 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:57:18.053 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.039) 0:01:25.419 ***** 2021-10-20T23:57:18.059 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-10-20T23:57:18.062 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:57:18.090 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.039) 0:01:25.459 ***** 2021-10-20T23:57:18.118 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.027) 0:01:25.486 ***** 2021-10-20T23:57:18.288 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:18.290 INFO:teuthology.task.ansible.out:TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi062.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:57:18.303 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:57:18.357 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-10-20T23:57:18.358 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:57:18.385 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.267) 0:01:25.754 ***** 2021-10-20T23:57:18.403 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:57:18.405 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:57:18.441 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.056) 0:01:25.810 ***** 2021-10-20T23:57:18.450 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-20T23:57:18.452 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:57:18.452 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:57:18.493 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.042) 0:01:25.852 ***** 2021-10-20T23:57:18.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.030) 0:01:25.883 ***** 2021-10-20T23:57:18.542 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:18.563 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.048) 0:01:25.932 ***** 2021-10-20T23:57:18.571 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-10-20T23:57:18.573 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-10-20T23:57:18.574 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:57:18.575 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:18.610 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.046) 0:01:25.978 ***** 2021-10-20T23:57:18.636 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.026) 0:01:26.005 ***** 2021-10-20T23:57:18.644 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:18.646 INFO:teuthology.task.ansible.out:TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi071.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:57:18.657 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-20T23:57:18.659 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:18.689 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.052) 0:01:26.058 ***** 2021-10-20T23:57:18.707 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:18.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.046) 0:01:26.105 ***** 2021-10-20T23:57:18.743 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi071.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:57:18.772 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.036) 0:01:26.141 ***** 2021-10-20T23:57:18.780 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:18.806 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.034) 0:01:26.175 ***** 2021-10-20T23:57:18.823 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:18.849 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.043) 0:01:26.218 ***** 2021-10-20T23:57:18.856 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:57:18.858 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:18.882 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:18 +0000 (0:00:00.032) 0:01:26.251 ***** 2021-10-20T23:57:18.975 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-10-20T23:57:18.977 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:57:19.006 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.123) 0:01:26.375 ***** 2021-10-20T23:57:19.030 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.024) 0:01:26.399 ***** 2021-10-20T23:57:19.060 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-10-20T23:57:19.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.055) 0:01:26.455 ***** 2021-10-20T23:57:19.094 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-20T23:57:19.095 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.121 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.035) 0:01:26.490 ***** 2021-10-20T23:57:19.207 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:57:19.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.112) 0:01:26.602 ***** 2021-10-20T23:57:19.251 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi099.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:57:19.276 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.042) 0:01:26.645 ***** 2021-10-20T23:57:19.297 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-10-20T23:57:19.299 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-10-20T23:57:19.388 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:57:19.419 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.140) 0:01:26.786 ***** 2021-10-20T23:57:19.437 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-10-20T23:57:19.467 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.049) 0:01:26.835 ***** 2021-10-20T23:57:19.496 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:57:19.498 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.531 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.064) 0:01:26.900 ***** 2021-10-20T23:57:19.540 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-20T23:57:19.542 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:57:19.543 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:57:19.544 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:20 UTC", "ActiveEnterTimestampMonotonic": "15182953", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target system.slice systemd-tmpfiles-setup.service var-run.mount -.mount local-fs.target time-sync.target nss-lookup.target remote-fs.target systemd-journald.socket network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:20 UTC", "AssertTimestampMonotonic": "15181279", "Before": "getty@tty1.service shutdown.target multi-user.target xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:20 UTC", "Co 2021-10-20T23:57:19.547 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15181279", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "854", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:20 UTC", "ExecMainStartTimestampMonotonic": "15182820", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:55:20 UTC] ; stop_time=[n/a] ; pid=854 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:55:20 UTC] ; stop_time=[n/a] ; pid=854 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:57:19.548 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:20 UTC", "InactiveExitTimestampMonotonic": "15182953", "InvocationID": "80f0420602f945cc8f170d5e26328521", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "854", "MemoryAccounting": "yes", "MemoryCurrent": "1261568", "MemoryD 2021-10-20T23:57:19.550 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:20 UTC", "StateChangeTimestampMonotonic": "15182953", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:57:19.552 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38332", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:57:19.573 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.041) 0:01:26.942 ***** 2021-10-20T23:57:19.605 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.032) 0:01:26.974 ***** 2021-10-20T23:57:19.615 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-10-20T23:57:19.617 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.618 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:57:19.620 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:10 UTC", "ActiveEnterTimestampMonotonic": "17838957", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target basic.target nss-lookup.target network.target var-run.mount systemd-journald.socket time-sync.target system.slice remote-fs.target -.mount systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:10 UTC", "AssertTimestampMonotonic": "17837775", "Before": "getty@tty1.service shutdown.target plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:10 UTC", "Co 2021-10-20T23:57:19.622 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "17837775", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "860", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:10 UTC", "ExecMainStartTimestampMonotonic": "17838826", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:55:10 UTC] ; stop_time=[n/a] ; pid=860 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:55:10 UTC] ; stop_time=[n/a] ; pid=860 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:57:19.624 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:10 UTC", "InactiveExitTimestampMonotonic": "17838957", "InvocationID": "83b8929bc06d4a8caa98ed58ba487ab6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "860", "MemoryAccounting": "yes", "MemoryCurrent": "1404928", "MemoryD 2021-10-20T23:57:19.626 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:10 UTC", "StateChangeTimestampMonotonic": "17838957", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:57:19.628 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38339", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : Check firewalld status] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:19.651 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.043) 0:01:27.018 ***** 2021-10-20T23:57:19.676 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.025) 0:01:27.044 ***** 2021-10-20T23:57:19.713 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.036) 0:01:27.081 ***** 2021-10-20T23:57:19.722 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.754 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.042) 0:01:27.123 ***** 2021-10-20T23:57:19.769 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.046) 0:01:27.170 ***** 2021-10-20T23:57:19.817 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-20T23:57:19.818 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.819 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-10-20T23:57:19.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.049) 0:01:27.219 ***** 2021-10-20T23:57:19.877 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.026) 0:01:27.246 ***** 2021-10-20T23:57:19.884 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.886 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:57:19.888 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:29 UTC", "ActiveEnterTimestampMonotonic": "15235597", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target local-fs.target remote-fs.target -.mount nss-lookup.target time-sync.target systemd-tmpfiles-setup.service var-run.mount sysinit.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:29 UTC", "AssertTimestampMonotonic": "15233712", "Before": "xdm.service shutdown.target multi-user.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:29 UTC", "Co 2021-10-20T23:57:19.890 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15233711", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "860", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:29 UTC", "ExecMainStartTimestampMonotonic": "15235462", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:55:29 UTC] ; stop_time=[n/a] ; pid=860 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:55:29 UTC] ; stop_time=[n/a] ; pid=860 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:57:19.892 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:29 UTC", "InactiveExitTimestampMonotonic": "15235597", "InvocationID": "84b6f3ac0e174f0d9c074935bef4a997", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "860", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-10-20T23:57:19.894 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:29 UTC", "StateChangeTimestampMonotonic": "15235597", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:57:19.895 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:19.916 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.039) 0:01:27.285 ***** 2021-10-20T23:57:19.940 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.024) 0:01:27.309 ***** 2021-10-20T23:57:19.964 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:19 +0000 (0:00:00.023) 0:01:27.333 ***** 2021-10-20T23:57:19.973 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-10-20T23:57:19.975 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.007 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.042) 0:01:27.376 ***** 2021-10-20T23:57:20.015 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-10-20T23:57:20.016 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.043 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.035) 0:01:27.412 ***** 2021-10-20T23:57:20.052 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.054 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.080 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.037) 0:01:27.449 ***** 2021-10-20T23:57:20.082 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:20.107 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.026) 0:01:27.476 ***** 2021-10-20T23:57:20.115 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-20T23:57:20.117 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.143 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.034) 0:01:27.510 ***** 2021-10-20T23:57:20.161 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.190 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.048) 0:01:27.559 ***** 2021-10-20T23:57:20.200 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-10-20T23:57:20.202 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.235 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.041) 0:01:27.600 ***** 2021-10-20T23:57:20.241 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-10-20T23:57:20.242 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.270 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.037) 0:01:27.638 ***** 2021-10-20T23:57:20.290 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-20T23:57:20.292 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.322 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.052) 0:01:27.691 ***** 2021-10-20T23:57:20.346 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.024) 0:01:27.715 ***** 2021-10-20T23:57:20.353 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-10-20T23:57:20.355 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.035) 0:01:27.750 ***** 2021-10-20T23:57:20.409 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.027) 0:01:27.778 ***** 2021-10-20T23:57:20.418 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* 2021-10-20T23:57:20.420 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-10-20T23:57:20.451 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.041) 0:01:27.820 ***** 2021-10-20T23:57:20.476 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.025) 0:01:27.845 ***** 2021-10-20T23:57:20.484 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.513 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.036) 0:01:27.882 ***** 2021-10-20T23:57:20.522 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-10-20T23:57:20.524 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.560 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.046) 0:01:27.929 ***** 2021-10-20T23:57:20.570 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-20T23:57:20.572 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.598 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.037) 0:01:27.966 ***** 2021-10-20T23:57:20.605 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-20T23:57:20.607 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.632 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.034) 0:01:28.001 ***** 2021-10-20T23:57:20.641 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:57:20.642 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:35 UTC", "ActiveEnterTimestampMonotonic": "15308272", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket local-fs.target remote-fs.target system.slice time-sync.target network.target var-run.mount nss-lookup.target basic.target -.mount sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:35 UTC", "AssertTimestampMonotonic": "15277771", "Before": "multi-user.target xdm.service plymouth-quit.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:35 UTC", "Co 2021-10-20T23:57:20.644 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15277771", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "862", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:35 UTC", "ExecMainStartTimestampMonotonic": "15308110", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:55:35 UTC] ; stop_time=[n/a] ; pid=862 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:55:35 UTC] ; stop_time=[n/a] ; pid=862 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:57:20.645 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:35 UTC", "InactiveExitTimestampMonotonic": "15308272", "InvocationID": "8059dc6c76aa42bcab5a51b20c9a141e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "862", "MemoryAccounting": "yes", "MemoryCurrent": "1314816", "MemoryD 2021-10-20T23:57:20.647 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:35 UTC", "StateChangeTimestampMonotonic": "15308272", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:57:20.649 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.672 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.039) 0:01:28.041 ***** 2021-10-20T23:57:20.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.022) 0:01:28.063 ***** 2021-10-20T23:57:20.704 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-20T23:57:20.706 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.041) 0:01:28.105 ***** 2021-10-20T23:57:20.747 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-10-20T23:57:20.752 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:40 UTC", "ActiveEnterTimestampMonotonic": "15707174", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target local-fs.target systemd-journald.socket var-run.mount sysinit.target time-sync.target network.target system.slice remote-fs.target -.mount systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:40 UTC", "AssertTimestampMonotonic": "15705607", "Before": "xdm.service getty@tty1.service multi-user.target shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:40 UTC", "Co 2021-10-20T23:57:20.752 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15705607", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "893", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:40 UTC", "ExecMainStartTimestampMonotonic": "15707034", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-10-20 23:55:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-10-20 23:55:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-10-20T23:57:20.758 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:40 UTC", "InactiveExitTimestampMonotonic": "15707174", "InvocationID": "810e80f62edd45e0acbfe8e9130aded0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "893", "MemoryAccounting": "yes", "MemoryCurrent": "1314816", "MemoryD 2021-10-20T23:57:20.773 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:40 UTC", "StateChangeTimestampMonotonic": "15707174", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-10-20T23:57:20.776 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2021-10-20T23:57:20.781 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38331", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:57:20.821 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.077) 0:01:28.183 ***** 2021-10-20T23:57:20.878 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:20.924 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:20 +0000 (0:00:00.110) 0:01:28.293 ***** 2021-10-20T23:57:20.935 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-20T23:57:20.936 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.112 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.188) 0:01:28.481 ***** 2021-10-20T23:57:21.122 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.124 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.152 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.040) 0:01:28.521 ***** 2021-10-20T23:57:21.182 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.028) 0:01:28.550 ***** 2021-10-20T23:57:21.208 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.027) 0:01:28.577 ***** 2021-10-20T23:57:21.217 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:57:21.219 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.250 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.042) 0:01:28.619 ***** 2021-10-20T23:57:21.276 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.025) 0:01:28.645 ***** 2021-10-20T23:57:21.283 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:57:21.285 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.311 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.035) 0:01:28.680 ***** 2021-10-20T23:57:21.338 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.026) 0:01:28.706 ***** 2021-10-20T23:57:21.346 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.348 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:21.374 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.036) 0:01:28.743 ***** 2021-10-20T23:57:21.399 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.025) 0:01:28.768 ***** 2021-10-20T23:57:21.406 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-20T23:57:21.408 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.409 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.436 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.037) 0:01:28.805 ***** 2021-10-20T23:57:21.460 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.023) 0:01:28.829 ***** 2021-10-20T23:57:21.500 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.039) 0:01:28.869 ***** 2021-10-20T23:57:21.508 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-20T23:57:21.508 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:57:21.511 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-10-20T23:57:21.513 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.537 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.037) 0:01:28.906 ***** 2021-10-20T23:57:21.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.023) 0:01:28.930 ***** 2021-10-20T23:57:21.568 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-20T23:57:21.570 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:57:21.572 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.598 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.037) 0:01:28.967 ***** 2021-10-20T23:57:21.622 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.024) 0:01:28.991 ***** 2021-10-20T23:57:21.645 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.022) 0:01:29.014 ***** 2021-10-20T23:57:21.652 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-20T23:57:21.654 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:57:21.654 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.681 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.035) 0:01:29.050 ***** 2021-10-20T23:57:21.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.028) 0:01:29.078 ***** 2021-10-20T23:57:21.719 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:57:21.721 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-10-20T23:57:21.723 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.751 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.041) 0:01:29.120 ***** 2021-10-20T23:57:21.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.023) 0:01:29.144 ***** 2021-10-20T23:57:21.783 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.784 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:57:21.814 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.038) 0:01:29.183 ***** 2021-10-20T23:57:21.836 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.022) 0:01:29.205 ***** 2021-10-20T23:57:21.843 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-10-20T23:57:21.846 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:21.881 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.044) 0:01:29.250 ***** 2021-10-20T23:57:21.888 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-20T23:57:21.891 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:21.922 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.040) 0:01:29.291 ***** 2021-10-20T23:57:21.957 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.035) 0:01:29.326 ***** 2021-10-20T23:57:21.966 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-10-20T23:57:21.968 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:57:21.996 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:21 +0000 (0:00:00.038) 0:01:29.365 ***** 2021-10-20T23:57:22.023 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.027) 0:01:29.392 ***** 2021-10-20T23:57:22.056 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.032) 0:01:29.425 ***** 2021-10-20T23:57:22.067 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-20T23:57:22.071 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:57:22.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.053) 0:01:29.479 ***** 2021-10-20T23:57:22.138 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.028) 0:01:29.507 ***** 2021-10-20T23:57:22.146 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-10-20T23:57:22.148 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.178 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.039) 0:01:29.547 ***** 2021-10-20T23:57:22.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.025) 0:01:29.573 ***** 2021-10-20T23:57:22.216 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:57:22.240 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.036) 0:01:29.609 ***** 2021-10-20T23:57:22.248 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-20T23:57:22.251 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:57:22.277 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.036) 0:01:29.646 ***** 2021-10-20T23:57:22.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-10-20T23:57:22.286 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.329 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.051) 0:01:29.698 ***** 2021-10-20T23:57:22.353 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.023) 0:01:29.722 ***** 2021-10-20T23:57:22.362 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-20T23:57:22.363 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.389 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.036) 0:01:29.758 ***** 2021-10-20T23:57:22.415 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.024) 0:01:29.783 ***** 2021-10-20T23:57:22.423 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-10-20T23:57:22.425 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.426 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.458 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.044) 0:01:29.827 ***** 2021-10-20T23:57:22.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.028) 0:01:29.856 ***** 2021-10-20T23:57:22.524 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.036) 0:01:29.893 ***** 2021-10-20T23:57:22.535 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-20T23:57:22.537 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.576 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.051) 0:01:29.945 ***** 2021-10-20T23:57:22.600 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.023) 0:01:29.969 ***** 2021-10-20T23:57:22.608 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.609 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:57:22.635 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.035) 0:01:30.004 ***** 2021-10-20T23:57:22.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.027) 0:01:30.031 ***** 2021-10-20T23:57:22.688 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.025) 0:01:30.057 ***** 2021-10-20T23:57:22.695 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-20T23:57:22.697 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:22.732 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.044) 0:01:30.101 ***** 2021-10-20T23:57:22.764 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-10-20T23:57:22.766 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:22.797 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.064) 0:01:30.166 ***** 2021-10-20T23:57:22.816 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-10-20T23:57:22.841 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.043) 0:01:30.209 ***** 2021-10-20T23:57:22.852 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi041.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:57:22.880 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.039) 0:01:30.249 ***** 2021-10-20T23:57:22.906 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.025) 0:01:30.274 ***** 2021-10-20T23:57:22.914 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-10-20T23:57:22.916 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:57:22.919 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-10-20T23:57:22.949 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.043) 0:01:30.318 ***** 2021-10-20T23:57:22.974 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:22 +0000 (0:00:00.025) 0:01:30.343 ***** 2021-10-20T23:57:22.981 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:57:22.983 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-10-20T23:57:23.011 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.036) 0:01:30.379 ***** 2021-10-20T23:57:23.018 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-20T23:57:23.021 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.036) 0:01:30.416 ***** 2021-10-20T23:57:23.055 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-10-20T23:57:23.057 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:57:23.084 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.036) 0:01:30.453 ***** 2021-10-20T23:57:23.093 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-10-20T23:57:23.124 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.039) 0:01:30.492 ***** 2021-10-20T23:57:23.141 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-10-20T23:57:23.143 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.046) 0:01:30.539 ***** 2021-10-20T23:57:23.178 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:57:23.220 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.048) 0:01:30.587 ***** 2021-10-20T23:57:23.226 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-10-20T23:57:23.255 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.037) 0:01:30.624 ***** 2021-10-20T23:57:23.257 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:23.354 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-10-20T23:57:23.356 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:57:23.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.125) 0:01:30.750 ***** 2021-10-20T23:57:23.391 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-20T23:57:23.393 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:57:23.421 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.039) 0:01:30.790 ***** 2021-10-20T23:57:23.429 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:57:23.432 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-10-20T23:57:23.459 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.037) 0:01:30.828 ***** 2021-10-20T23:57:23.483 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.024) 0:01:30.852 ***** 2021-10-20T23:57:23.492 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:57:23.519 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.035) 0:01:30.888 ***** 2021-10-20T23:57:23.527 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-20T23:57:23.529 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi041"}, "changed": false} 2021-10-20T23:57:23.567 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.047) 0:01:30.935 ***** 2021-10-20T23:57:23.581 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-20T23:57:23.583 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:57:23.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.046) 0:01:30.982 ***** 2021-10-20T23:57:23.622 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-20T23:57:23.624 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi062"}, "changed": false} 2021-10-20T23:57:23.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.040) 0:01:31.023 ***** 2021-10-20T23:57:23.672 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-10-20T23:57:23.674 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-10-20T23:57:23.701 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.047) 0:01:31.070 ***** 2021-10-20T23:57:23.711 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-10-20T23:57:23.713 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.742 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.040) 0:01:31.111 ***** 2021-10-20T23:57:23.783 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.814 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.071) 0:01:31.183 ***** 2021-10-20T23:57:23.833 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.858 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.044) 0:01:31.227 ***** 2021-10-20T23:57:23.888 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:23.916 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:23 +0000 (0:00:00.057) 0:01:31.285 ***** 2021-10-20T23:57:23.976 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-20T23:57:23.979 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:57:24.003 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.086) 0:01:31.372 ***** 2021-10-20T23:57:24.076 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:57:24.078 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Set hostname var] ********************************************* ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi071"}, "changed": false} 2021-10-20T23:57:24.105 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.100) 0:01:31.472 ***** 2021-10-20T23:57:24.132 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.028) 0:01:31.501 ***** 2021-10-20T23:57:24.141 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-10-20T23:57:24.143 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-10-20T23:57:24.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.037) 0:01:31.539 ***** 2021-10-20T23:57:24.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-10-20T23:57:24.307 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi041.front.sepia.ceph.com", "ansible_hostname": "smithi041", "ansible_nodename": "smithi041"}, "changed": true, "name": "smithi041"} changed: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_nodename": "smithi062"}, "changed": true, "name": "smithi062"} 2021-10-20T23:57:24.332 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.161) 0:01:31.701 ***** 2021-10-20T23:57:24.357 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.025) 0:01:31.726 ***** 2021-10-20T23:57:24.537 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi071.front.sepia.ceph.com", "ansible_hostname": "smithi071", "ansible_nodename": "smithi071"}, "changed": true, "name": "smithi071"} 2021-10-20T23:57:24.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.205) 0:01:31.931 ***** 2021-10-20T23:57:24.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-10-20T23:57:24.593 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:57:24.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.055) 0:01:31.987 ***** 2021-10-20T23:57:24.636 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-10-20T23:57:24.662 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.043) 0:01:32.031 ***** 2021-10-20T23:57:24.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-10-20T23:57:24.714 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi099"}, "changed": false} 2021-10-20T23:57:24.745 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.082) 0:01:32.114 ***** 2021-10-20T23:57:24.753 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-10-20T23:57:24.755 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} TASK [testnode : Set hostname var] ********************************************* ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi102"}, "changed": false} 2021-10-20T23:57:24.755 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-10-20T23:57:24.756 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:57:24.784 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.039) 0:01:32.153 ***** 2021-10-20T23:57:24.809 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.025) 0:01:32.178 ***** 2021-10-20T23:57:24.837 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:24 +0000 (0:00:00.027) 0:01:32.205 ***** 2021-10-20T23:57:24.995 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:57:25.023 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.186) 0:01:32.392 ***** 2021-10-20T23:57:25.182 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi099.front.sepia.ceph.com", "ansible_hostname": "smithi099", "ansible_nodename": "smithi099"}, "changed": true, "name": "smithi099"} 2021-10-20T23:57:25.208 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.185) 0:01:32.577 ***** 2021-10-20T23:57:25.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-20T23:57:25.217 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:57:25.243 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.034) 0:01:32.612 ***** 2021-10-20T23:57:25.251 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:57:25.278 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.035) 0:01:32.647 ***** 2021-10-20T23:57:25.287 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-10-20T23:57:25.289 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi102.front.sepia.ceph.com", "ansible_hostname": "smithi102", "ansible_nodename": "smithi102"}, "changed": true, "name": "smithi102"} 2021-10-20T23:57:25.316 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.038) 0:01:32.685 ***** 2021-10-20T23:57:25.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-20T23:57:25.431 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:57:25.455 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.138) 0:01:32.824 ***** 2021-10-20T23:57:25.591 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:57:25.617 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.160) 0:01:32.985 ***** 2021-10-20T23:57:25.709 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-10-20T23:57:25.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.117) 0:01:33.103 ***** 2021-10-20T23:57:25.753 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-10-20T23:57:25.754 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:57:25.791 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.056) 0:01:33.160 ***** 2021-10-20T23:57:25.801 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:57:25.832 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.040) 0:01:33.201 ***** 2021-10-20T23:57:25.856 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:25.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.053) 0:01:33.254 ***** 2021-10-20T23:57:25.914 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:25.945 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.057) 0:01:33.312 ***** 2021-10-20T23:57:25.963 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:57:25.965 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi071.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:57:25.990 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:25 +0000 (0:00:00.046) 0:01:33.359 ***** 2021-10-20T23:57:26.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.025) 0:01:33.385 ***** 2021-10-20T23:57:26.022 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:57:26.024 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.049 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.033) 0:01:33.418 ***** 2021-10-20T23:57:26.059 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:57:26.084 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.034) 0:01:33.453 ***** 2021-10-20T23:57:26.085 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:26.093 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:57:26.094 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.037) 0:01:33.491 ***** 2021-10-20T23:57:26.147 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.024) 0:01:33.516 ***** 2021-10-20T23:57:26.154 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.155 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-10-20T23:57:26.156 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-10-20T23:57:26.184 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.034) 0:01:33.550 ***** 2021-10-20T23:57:26.205 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.023) 0:01:33.574 ***** 2021-10-20T23:57:26.212 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:57:26.213 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.215 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:57:26.216 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.250 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.045) 0:01:33.619 ***** 2021-10-20T23:57:26.275 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.025) 0:01:33.644 ***** 2021-10-20T23:57:26.284 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:57:26.286 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.315 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.039) 0:01:33.683 ***** 2021-10-20T23:57:26.335 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.361 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.046) 0:01:33.730 ***** 2021-10-20T23:57:26.370 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.396 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.035) 0:01:33.766 ***** 2021-10-20T23:57:26.405 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:57:26.407 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.435 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.038) 0:01:33.804 ***** 2021-10-20T23:57:26.442 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-20T23:57:26.444 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.037) 0:01:33.841 ***** 2021-10-20T23:57:26.480 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:57:26.482 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.509 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.036) 0:01:33.878 ***** 2021-10-20T23:57:26.516 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-20T23:57:26.518 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.544 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.034) 0:01:33.913 ***** 2021-10-20T23:57:26.553 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:57:26.554 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.581 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.036) 0:01:33.949 ***** 2021-10-20T23:57:26.588 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:57:26.589 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.036) 0:01:33.986 ***** 2021-10-20T23:57:26.635 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:57:26.636 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:57:26.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.044) 0:01:34.031 ***** 2021-10-20T23:57:26.696 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.034) 0:01:34.065 ***** 2021-10-20T23:57:26.707 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-20T23:57:26.709 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.737 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.040) 0:01:34.106 ***** 2021-10-20T23:57:26.761 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.023) 0:01:34.130 ***** 2021-10-20T23:57:26.768 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-20T23:57:26.770 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.796 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.035) 0:01:34.165 ***** 2021-10-20T23:57:26.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-10-20T23:57:26.804 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-10-20T23:57:26.805 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-10-20T23:57:26.805 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.806 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:57:26.807 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.832 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.036) 0:01:34.201 ***** 2021-10-20T23:57:26.856 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.023) 0:01:34.225 ***** 2021-10-20T23:57:26.879 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.022) 0:01:34.248 ***** 2021-10-20T23:57:26.887 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:57:26.889 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.917 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.038) 0:01:34.286 ***** 2021-10-20T23:57:26.940 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.022) 0:01:34.309 ***** 2021-10-20T23:57:26.947 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-20T23:57:26.949 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:26.977 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:26 +0000 (0:00:00.037) 0:01:34.346 ***** 2021-10-20T23:57:27.004 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:34.372 ***** 2021-10-20T23:57:27.013 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-10-20T23:57:27.015 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.042 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.038) 0:01:34.411 ***** 2021-10-20T23:57:27.076 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.033) 0:01:34.445 ***** 2021-10-20T23:57:27.084 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-20T23:57:27.086 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.115 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.037) 0:01:34.483 ***** 2021-10-20T23:57:27.140 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:34.509 ***** 2021-10-20T23:57:27.148 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:57:27.150 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.177 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.037) 0:01:34.546 ***** 2021-10-20T23:57:27.203 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:34.572 ***** 2021-10-20T23:57:27.227 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.023) 0:01:34.596 ***** 2021-10-20T23:57:27.236 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:57:27.238 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:57:27.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.038) 0:01:34.634 ***** 2021-10-20T23:57:27.289 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.023) 0:01:34.658 ***** 2021-10-20T23:57:27.313 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.024) 0:01:34.682 ***** 2021-10-20T23:57:27.324 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:57:27.326 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.354 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.041) 0:01:34.723 ***** 2021-10-20T23:57:27.379 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.024) 0:01:34.748 ***** 2021-10-20T23:57:27.387 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:57:27.414 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.035) 0:01:34.783 ***** 2021-10-20T23:57:27.447 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.032) 0:01:34.816 ***** 2021-10-20T23:57:27.455 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-20T23:57:27.457 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.485 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.038) 0:01:34.854 ***** 2021-10-20T23:57:27.511 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:34.880 ***** 2021-10-20T23:57:27.538 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.027) 0:01:34.907 ***** 2021-10-20T23:57:27.546 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:57:27.573 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.034) 0:01:34.942 ***** 2021-10-20T23:57:27.597 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.023) 0:01:34.966 ***** 2021-10-20T23:57:27.604 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-10-20T23:57:27.606 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.633 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.035) 0:01:35.002 ***** 2021-10-20T23:57:27.657 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.024) 0:01:35.026 ***** 2021-10-20T23:57:27.689 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.031) 0:01:35.058 ***** 2021-10-20T23:57:27.696 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-10-20T23:57:27.698 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.699 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:57:27.729 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.039) 0:01:35.098 ***** 2021-10-20T23:57:27.754 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:35.123 ***** 2021-10-20T23:57:27.778 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.024) 0:01:35.147 ***** 2021-10-20T23:57:27.786 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:57:27.788 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.819 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.041) 0:01:35.188 ***** 2021-10-20T23:57:27.845 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.025) 0:01:35.214 ***** 2021-10-20T23:57:27.857 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.859 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.860 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.860 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.862 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:57:27.889 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.044) 0:01:35.258 ***** 2021-10-20T23:57:27.916 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.027) 0:01:35.285 ***** 2021-10-20T23:57:27.941 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.024) 0:01:35.309 ***** 2021-10-20T23:57:27.948 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-10-20T23:57:27.951 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:27.979 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:27 +0000 (0:00:00.037) 0:01:35.347 ***** 2021-10-20T23:57:28.006 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.027) 0:01:35.375 ***** 2021-10-20T23:57:28.014 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.015 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:57:28.044 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.037) 0:01:35.413 ***** 2021-10-20T23:57:28.069 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.024) 0:01:35.437 ***** 2021-10-20T23:57:28.097 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.026) 0:01:35.464 ***** 2021-10-20T23:57:28.105 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.108 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.135 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.039) 0:01:35.504 ***** 2021-10-20T23:57:28.161 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.026) 0:01:35.530 ***** 2021-10-20T23:57:28.168 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:57:28.170 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.042) 0:01:35.573 ***** 2021-10-20T23:57:28.229 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.024) 0:01:35.598 ***** 2021-10-20T23:57:28.238 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-10-20T23:57:28.240 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.241 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.243 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.269 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.040) 0:01:35.638 ***** 2021-10-20T23:57:28.294 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.024) 0:01:35.663 ***** 2021-10-20T23:57:28.325 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.029) 0:01:35.693 ***** 2021-10-20T23:57:28.332 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-10-20T23:57:28.333 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.362 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.037) 0:01:35.731 ***** 2021-10-20T23:57:28.386 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.023) 0:01:35.755 ***** 2021-10-20T23:57:28.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.396 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.396 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.424 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.037) 0:01:35.793 ***** 2021-10-20T23:57:28.457 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.033) 0:01:35.826 ***** 2021-10-20T23:57:28.464 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-10-20T23:57:28.466 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.467 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.493 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.035) 0:01:35.862 ***** 2021-10-20T23:57:28.516 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.023) 0:01:35.885 ***** 2021-10-20T23:57:28.539 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.023) 0:01:35.908 ***** 2021-10-20T23:57:28.546 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-20T23:57:28.547 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.547 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:57:28.579 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.039) 0:01:35.948 ***** 2021-10-20T23:57:28.604 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.024) 0:01:35.973 ***** 2021-10-20T23:57:28.614 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.616 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.641 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.037) 0:01:36.010 ***** 2021-10-20T23:57:28.665 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.023) 0:01:36.034 ***** 2021-10-20T23:57:28.690 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.023) 0:01:36.058 ***** 2021-10-20T23:57:28.697 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.699 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:57:28.725 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.036) 0:01:36.094 ***** 2021-10-20T23:57:28.750 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.024) 0:01:36.119 ***** 2021-10-20T23:57:28.758 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-20T23:57:28.760 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-10-20T23:57:28.789 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.038) 0:01:36.158 ***** 2021-10-20T23:57:28.815 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.025) 0:01:36.184 ***** 2021-10-20T23:57:28.841 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.025) 0:01:36.209 ***** 2021-10-20T23:57:28.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.850 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:57:28.878 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.037) 0:01:36.247 ***** 2021-10-20T23:57:28.904 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.026) 0:01:36.273 ***** 2021-10-20T23:57:28.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:57:28.913 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:28.915 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-10-20T23:57:28.951 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.047) 0:01:36.320 ***** 2021-10-20T23:57:28.977 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:28 +0000 (0:00:00.025) 0:01:36.346 ***** 2021-10-20T23:57:29.005 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.027) 0:01:36.374 ***** 2021-10-20T23:57:29.015 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-10-20T23:57:29.018 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.046 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.040) 0:01:36.415 ***** 2021-10-20T23:57:29.073 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.025) 0:01:36.440 ***** 2021-10-20T23:57:29.082 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.084 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-10-20T23:57:29.111 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.039) 0:01:36.480 ***** 2021-10-20T23:57:29.137 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.024) 0:01:36.505 ***** 2021-10-20T23:57:29.165 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.027) 0:01:36.534 ***** 2021-10-20T23:57:29.172 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-10-20T23:57:29.174 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.174 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.175 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.206 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.041) 0:01:36.575 ***** 2021-10-20T23:57:29.230 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.023) 0:01:36.598 ***** 2021-10-20T23:57:29.237 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:57:29.239 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.035) 0:01:36.634 ***** 2021-10-20T23:57:29.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.023) 0:01:36.658 ***** 2021-10-20T23:57:29.322 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.033) 0:01:36.691 ***** 2021-10-20T23:57:29.331 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-10-20T23:57:29.334 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.362 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.039) 0:01:36.731 ***** 2021-10-20T23:57:29.388 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.023) 0:01:36.754 ***** 2021-10-20T23:57:29.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-10-20T23:57:29.395 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.423 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.037) 0:01:36.792 ***** 2021-10-20T23:57:29.447 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.024) 0:01:36.816 ***** 2021-10-20T23:57:29.454 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-10-20T23:57:29.456 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.458 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:57:29.458 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.484 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.036) 0:01:36.853 ***** 2021-10-20T23:57:29.515 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.030) 0:01:36.884 ***** 2021-10-20T23:57:29.544 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.028) 0:01:36.913 ***** 2021-10-20T23:57:29.554 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-20T23:57:29.556 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.585 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.041) 0:01:36.954 ***** 2021-10-20T23:57:29.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.027) 0:01:36.982 ***** 2021-10-20T23:57:29.633 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-10-20T23:57:29.635 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.662 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.049) 0:01:37.031 ***** 2021-10-20T23:57:29.669 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:57:29.671 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.696 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.033) 0:01:37.065 ***** 2021-10-20T23:57:29.705 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.040) 0:01:37.105 ***** 2021-10-20T23:57:29.745 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:57:29.747 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.038) 0:01:37.144 ***** 2021-10-20T23:57:29.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.026) 0:01:37.170 ***** 2021-10-20T23:57:29.809 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-20T23:57:29.811 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.840 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.038) 0:01:37.209 ***** 2021-10-20T23:57:29.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.026) 0:01:37.236 ***** 2021-10-20T23:57:29.895 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.027) 0:01:37.264 ***** 2021-10-20T23:57:29.902 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:57:29.904 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.930 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.035) 0:01:37.299 ***** 2021-10-20T23:57:29.955 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.024) 0:01:37.324 ***** 2021-10-20T23:57:29.964 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-20T23:57:29.965 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:29.994 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:29 +0000 (0:00:00.038) 0:01:37.363 ***** 2021-10-20T23:57:30.018 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.024) 0:01:37.387 ***** 2021-10-20T23:57:30.112 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.125) 0:01:37.513 ***** 2021-10-20T23:57:30.206 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.233 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.089) 0:01:37.602 ***** 2021-10-20T23:57:30.272 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:57:30.274 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.303 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.069) 0:01:37.672 ***** 2021-10-20T23:57:30.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.169) 0:01:37.841 ***** 2021-10-20T23:57:30.480 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:57:30.482 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.509 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.036) 0:01:37.878 ***** 2021-10-20T23:57:30.534 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.023) 0:01:37.901 ***** 2021-10-20T23:57:30.542 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.574 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.040) 0:01:37.942 ***** 2021-10-20T23:57:30.586 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-20T23:57:30.588 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.615 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.042) 0:01:37.984 ***** 2021-10-20T23:57:30.639 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.024) 0:01:38.008 ***** 2021-10-20T23:57:30.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.021) 0:01:38.030 ***** 2021-10-20T23:57:30.669 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.671 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.705 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.043) 0:01:38.074 ***** 2021-10-20T23:57:30.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.033) 0:01:38.108 ***** 2021-10-20T23:57:30.747 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-10-20T23:57:30.750 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.783 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.044) 0:01:38.152 ***** 2021-10-20T23:57:30.808 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.024) 0:01:38.177 ***** 2021-10-20T23:57:30.837 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.027) 0:01:38.205 ***** 2021-10-20T23:57:30.844 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:57:30.846 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.880 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.044) 0:01:38.249 ***** 2021-10-20T23:57:30.905 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.024) 0:01:38.274 ***** 2021-10-20T23:57:30.914 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-20T23:57:30.916 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:30.945 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.039) 0:01:38.314 ***** 2021-10-20T23:57:30.971 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.025) 0:01:38.340 ***** 2021-10-20T23:57:30.997 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:30 +0000 (0:00:00.026) 0:01:38.366 ***** 2021-10-20T23:57:31.005 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:57:31.007 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.034 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.037) 0:01:38.403 ***** 2021-10-20T23:57:31.059 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.024) 0:01:38.427 ***** 2021-10-20T23:57:31.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-10-20T23:57:31.068 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.068 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.068 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-20T23:57:31.069 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.095 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.036) 0:01:38.464 ***** 2021-10-20T23:57:31.121 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:38.490 ***** 2021-10-20T23:57:31.145 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.023) 0:01:38.514 ***** 2021-10-20T23:57:31.153 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.157 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.182 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.036) 0:01:38.551 ***** 2021-10-20T23:57:31.222 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.039) 0:01:38.591 ***** 2021-10-20T23:57:31.233 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-20T23:57:31.236 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.268 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.045) 0:01:38.636 ***** 2021-10-20T23:57:31.292 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.024) 0:01:38.661 ***** 2021-10-20T23:57:31.317 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:38.686 ***** 2021-10-20T23:57:31.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.328 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.358 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.040) 0:01:38.727 ***** 2021-10-20T23:57:31.385 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.026) 0:01:38.754 ***** 2021-10-20T23:57:31.402 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-20T23:57:31.404 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.430 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.045) 0:01:38.799 ***** 2021-10-20T23:57:31.438 INFO:teuthology.task.ansible.out: 2021-10-20T23:57:31.440 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.468 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.036) 0:01:38.836 ***** 2021-10-20T23:57:31.475 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.477 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:57:31.479 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005304", "end": "2021-10-20 23:57:31.969764", "rc": 0, "start": "2021-10-20 23:57:31.964460", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:31.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.036) 0:01:38.872 ***** 2021-10-20T23:57:31.528 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:38.897 ***** 2021-10-20T23:57:31.536 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005363", "end": "2021-10-20 23:57:31.285902", "rc": 0, "start": "2021-10-20 23:57:31.280539", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:31.538 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.568 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.039) 0:01:38.937 ***** 2021-10-20T23:57:31.594 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:38.963 ***** 2021-10-20T23:57:31.602 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.603 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:57:31.629 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.035) 0:01:38.998 ***** 2021-10-20T23:57:31.662 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.032) 0:01:39.031 ***** 2021-10-20T23:57:31.670 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.672 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.700 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.038) 0:01:39.069 ***** 2021-10-20T23:57:31.726 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:39.095 ***** 2021-10-20T23:57:31.752 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.025) 0:01:39.120 ***** 2021-10-20T23:57:31.760 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-20T23:57:31.761 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.790 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.038) 0:01:39.159 ***** 2021-10-20T23:57:31.808 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-10-20T23:57:31.810 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.044) 0:01:39.203 ***** 2021-10-20T23:57:31.842 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-10-20T23:57:31.844 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.871 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.036) 0:01:39.240 ***** 2021-10-20T23:57:31.878 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-10-20T23:57:31.879 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.909 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.038) 0:01:39.278 ***** 2021-10-20T23:57:31.917 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-10-20T23:57:31.919 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.947 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.038) 0:01:39.316 ***** 2021-10-20T23:57:31.955 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:31.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:31 +0000 (0:00:00.033) 0:01:39.350 ***** 2021-10-20T23:57:31.988 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:57:31.989 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.033) 0:01:39.384 ***** 2021-10-20T23:57:32.033 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:57:32.035 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:57:32.060 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.045) 0:01:39.429 ***** 2021-10-20T23:57:32.067 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-10-20T23:57:32.068 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.104 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.043) 0:01:39.473 ***** 2021-10-20T23:57:32.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-10-20T23:57:32.113 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:57:32.114 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:57:32.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.039) 0:01:39.513 ***** 2021-10-20T23:57:32.170 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.026) 0:01:39.539 ***** 2021-10-20T23:57:32.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:57:32.182 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005409", "end": "2021-10-20 23:57:32.427848", "rc": 0, "start": "2021-10-20 23:57:32.422439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Add sources list] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.209 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.038) 0:01:39.577 ***** 2021-10-20T23:57:32.234 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.025) 0:01:39.603 ***** 2021-10-20T23:57:32.258 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.023) 0:01:39.626 ***** 2021-10-20T23:57:32.265 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:57:32.267 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.294 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.036) 0:01:39.663 ***** 2021-10-20T23:57:32.318 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.024) 0:01:39.687 ***** 2021-10-20T23:57:32.331 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:57:32.360 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.040) 0:01:39.728 ***** 2021-10-20T23:57:32.368 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.396 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.036) 0:01:39.765 ***** 2021-10-20T23:57:32.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-10-20T23:57:32.405 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.435 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.038) 0:01:39.803 ***** 2021-10-20T23:57:32.476 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.502 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.066) 0:01:39.870 ***** 2021-10-20T23:57:32.519 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.550 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.049) 0:01:39.919 ***** 2021-10-20T23:57:32.581 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.608 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.056) 0:01:39.976 ***** 2021-10-20T23:57:32.625 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.046) 0:01:40.023 ***** 2021-10-20T23:57:32.683 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.054) 0:01:40.078 ***** 2021-10-20T23:57:32.753 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:57:32.755 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:57:32.783 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.073) 0:01:40.152 ***** 2021-10-20T23:57:32.837 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:57:32.839 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005400", "end": "2021-10-20 23:57:32.518745", "rc": 0, "start": "2021-10-20 23:57:32.513345", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:32.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.084) 0:01:40.236 ***** 2021-10-20T23:57:32.890 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:57:32.891 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:32.920 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.052) 0:01:40.289 ***** 2021-10-20T23:57:32.928 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-10-20T23:57:32.930 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005362", "end": "2021-10-20 23:57:32.549269", "rc": 0, "start": "2021-10-20 23:57:32.543907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:32.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.035) 0:01:40.325 ***** 2021-10-20T23:57:32.965 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-10-20T23:57:32.990 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:32 +0000 (0:00:00.033) 0:01:40.359 ***** 2021-10-20T23:57:33.056 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:33 +0000 (0:00:00.065) 0:01:40.424 ***** 2021-10-20T23:57:33.383 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-10-20T23:57:33.384 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:57:33.409 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:33 +0000 (0:00:00.353) 0:01:40.778 ***** 2021-10-20T23:57:33.460 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-10-20T23:57:33.490 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:33 +0000 (0:00:00.081) 0:01:40.859 ***** 2021-10-20T23:57:33.497 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-10-20T23:57:33.499 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:33.531 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:33 +0000 (0:00:00.040) 0:01:40.900 ***** 2021-10-20T23:57:33.561 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:57:33.589 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:33 +0000 (0:00:00.058) 0:01:40.958 ***** 2021-10-20T23:57:33.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-10-20T23:57:33.694 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:57:33.714 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:57:34.170 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:57:34.750 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:57:34.815 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-10-20T23:57:34.826 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:57:34.853 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:34 +0000 (0:00:01.264) 0:01:42.222 ***** 2021-10-20T23:57:34.862 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:57:34.890 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:34 +0000 (0:00:00.036) 0:01:42.259 ***** 2021-10-20T23:57:35.297 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:57:35.329 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.438) 0:01:42.698 ***** 2021-10-20T23:57:35.607 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-10-20T23:57:35.610 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:35.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.304) 0:01:43.003 ***** 2021-10-20T23:57:35.652 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:35.681 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.046) 0:01:43.050 ***** 2021-10-20T23:57:35.711 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:57:35.737 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.055) 0:01:43.106 ***** 2021-10-20T23:57:35.782 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.044) 0:01:43.151 ***** 2021-10-20T23:57:35.887 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-10-20T23:57:35.889 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:57:35.915 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.133) 0:01:43.284 ***** 2021-10-20T23:57:35.956 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-20T23:57:35.958 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030978", "end": "2021-10-20 23:57:36.467952", "rc": 0, "start": "2021-10-20 23:57:36.436974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:35.958 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi102.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-10-20T23:57:35.984 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:35 +0000 (0:00:00.068) 0:01:43.353 ***** 2021-10-20T23:57:36.011 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.027) 0:01:43.380 ***** 2021-10-20T23:57:36.019 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-20T23:57:36.020 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032296", "end": "2021-10-20 23:57:35.807985", "rc": 0, "start": "2021-10-20 23:57:35.775689", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:36.050 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.038) 0:01:43.419 ***** 2021-10-20T23:57:36.081 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:36.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.059) 0:01:43.479 ***** 2021-10-20T23:57:36.188 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:57:36.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.102) 0:01:43.582 ***** 2021-10-20T23:57:36.436 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-10-20T23:57:36.438 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034353", "end": "2021-10-20 23:57:36.733252", "rc": 0, "start": "2021-10-20 23:57:36.698899", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:36.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.247) 0:01:43.830 ***** 2021-10-20T23:57:36.671 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:36.697 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.235) 0:01:44.065 ***** 2021-10-20T23:57:36.758 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:57:36.787 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.091) 0:01:44.156 ***** 2021-10-20T23:57:36.795 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-10-20T23:57:36.825 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.037) 0:01:44.194 ***** 2021-10-20T23:57:36.883 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:36 +0000 (0:00:00.057) 0:01:44.252 ***** 2021-10-20T23:57:37.054 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033228", "end": "2021-10-20 23:57:36.729054", "rc": 0, "start": "2021-10-20 23:57:36.695826", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:37.082 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:37 +0000 (0:00:00.199) 0:01:44.451 ***** 2021-10-20T23:57:37.113 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033496", "end": "2021-10-20 23:57:36.757301", "rc": 0, "start": "2021-10-20 23:57:36.723805", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:57:37.141 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:37 +0000 (0:00:00.058) 0:01:44.510 ***** 2021-10-20T23:57:38.336 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-10-20T23:57:38.338 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:57:38.363 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:38 +0000 (0:00:01.221) 0:01:45.732 ***** 2021-10-20T23:57:38.416 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:57:38.442 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:38 +0000 (0:00:00.079) 0:01:45.811 ***** 2021-10-20T23:57:38.710 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:57:38.736 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:38 +0000 (0:00:00.293) 0:01:46.105 ***** 2021-10-20T23:57:39.282 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:57:39.306 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:39 +0000 (0:00:00.569) 0:01:46.674 ***** 2021-10-20T23:57:39.399 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:57:39.428 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:39 +0000 (0:00:00.123) 0:01:46.798 ***** 2021-10-20T23:57:46.459 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-10-20T23:57:46.461 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:57:46.462 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:57:46.464 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:57:46.485 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:46 +0000 (0:00:07.056) 0:01:53.854 ***** 2021-10-20T23:57:46.736 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:57:46.737 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:57:46.739 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:57:46.762 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:46 +0000 (0:00:00.276) 0:01:54.131 ***** 2021-10-20T23:57:47.404 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:57:47.406 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:57:47.407 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:57:47.429 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:47 +0000 (0:00:00.667) 0:01:54.798 ***** 2021-10-20T23:57:47.574 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:57:47.576 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:57:47.577 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:57:47.601 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:47 +0000 (0:00:00.171) 0:01:54.970 ***** 2021-10-20T23:57:47.769 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2021-10-20T23:57:47.771 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 33 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2021-10-20T23:57:47.773 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-10-20T23:57:47.796 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:57:47 +0000 (0:00:00.195) 0:01:55.165 ***** 2021-10-20T23:58:02.268 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:58:02.270 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:58:02.272 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1840 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:58:02.273 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1840 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:58:02.275 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:58:02.297 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:02 +0000 (0:00:14.500) 0:02:09.665 ***** 2021-10-20T23:58:02.376 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-20T23:58:02.379 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:02.408 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:02 +0000 (0:00:00.108) 0:02:09.774 ***** 2021-10-20T23:58:02.419 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:58:02.423 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:58:02.425 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1817 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:58:02.427 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1817 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:58:02.429 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:58:02.452 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:02 +0000 (0:00:00.046) 0:02:09.821 ***** 2021-10-20T23:58:02.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-20T23:58:02.549 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:02.576 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:02 +0000 (0:00:00.124) 0:02:09.945 ***** 2021-10-20T23:58:03.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.u 2021-10-20T23:58:03.168 INFO:teuthology.task.ansible.out:buntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1842 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading 2021-10-20T23:58:03.170 INFO:teuthology.task.ansible.out:state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1842 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10 2021-10-20T23:58:03.172 INFO:teuthology.task.ansible.out:%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:58:03.192 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.615) 0:02:10.561 ***** 2021-10-20T23:58:03.211 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:58:03.213 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1821 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:58:03.215 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1821 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:58:03.218 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:58:03.238 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.045) 0:02:10.607 ***** 2021-10-20T23:58:03.269 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-20T23:58:03.271 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:03.302 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.063) 0:02:10.671 ***** 2021-10-20T23:58:03.321 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:03.347 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.045) 0:02:10.717 ***** 2021-10-20T23:58:03.741 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:58:03.743 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 2021-10-20T23:58:03.745 INFO:teuthology.task.ansible.out:kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]\nFetched 1519 kB in 1s (1838 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.7) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.7) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are 2021-10-20T23:58:03.747 INFO:teuthology.task.ansible.out:no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 29 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.7 [95.6 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.7 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.7 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.7 [84.4 kB]", "Fetched 1519 kB in 1s (1838 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 2021-10-20T23:58:03.749 INFO:teuthology.task.ansible.out: 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.7_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.7_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.7) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.7) ...", "Setting up apache2-data (2.4.41-4ubuntu3.7) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.7) ...", "Setting up apache2 (2.4.41-4ubuntu3.7) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-10-20T23:58:03.767 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.419) 0:02:11.136 ***** 2021-10-20T23:58:03.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-10-20T23:58:03.842 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:03.873 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:03 +0000 (0:00:00.098) 0:02:11.235 ***** 2021-10-20T23:58:14.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:58:14.438 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:58:14.440 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.5 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:58:14.441 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:58:14.443 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.5 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:58:14.445 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proc 2021-10-20T23:58:14.446 INFO:teuthology.task.ansible.out:essing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:58:14.471 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:14 +0000 (0:00:10.605) 0:02:21.840 ***** 2021-10-20T23:58:15.054 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:58:15.055 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:58:15.057 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:58:15.058 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:58:15.060 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:58:15.080 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:15 +0000 (0:00:00.608) 0:02:22.449 ***** 2021-10-20T23:58:15.218 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:58:15.220 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:15.245 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:15 +0000 (0:00:00.162) 0:02:22.612 ***** 2021-10-20T23:58:15.294 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-10-20T23:58:15.295 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:58:15.297 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.3 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:58:15.298 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:58:15.300 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.3 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:58:15.302 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:58:15.324 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:15 +0000 (0:00:00.081) 0:02:22.694 ***** 2021-10-20T23:58:15.453 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2021-10-20T23:58:15.455 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2021-10-20T23:58:15.457 INFO:teuthology.task.ansible.out:buntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2021-10-20T23:58:15.459 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ... 2021-10-20T23:58:15.460 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-10-20T23:58:15.480 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:15 +0000 (0:00:00.155) 0:02:22.849 ***** 2021-10-20T23:58:15.819 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:58:15.821 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:58:15.847 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:15 +0000 (0:00:00.367) 0:02:23.216 ***** 2021-10-20T23:58:15.974 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-20T23:58:15.976 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.003 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.155) 0:02:23.372 ***** 2021-10-20T23:58:16.046 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:58:16.048 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.073 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.069) 0:02:23.442 ***** 2021-10-20T23:58:16.188 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-10-20T23:58:16.189 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:58:16.215 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.142) 0:02:23.584 ***** 2021-10-20T23:58:16.223 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:58:16.224 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.257 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.041) 0:02:23.626 ***** 2021-10-20T23:58:16.286 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:16.288 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ub 2021-10-20T23:58:16.290 INFO:teuthology.task.ansible.out:untu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.4 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-syste 2021-10-20T23:58:16.291 INFO:teuthology.task.ansible.out:m-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The fo 2021-10-20T23:58:16.293 INFO:teuthology.task.ansible.out:llowing packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.4 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14- 2021-10-20T23:58:16.296 INFO:teuthology.task.ansible.out:0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proc 2021-10-20T23:58:16.297 INFO:teuthology.task.ansible.out:essing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mi 2021-10-20T23:58:16.298 INFO:teuthology.task.ansible.out:me-support (3.64ubuntu1) ..."]} 2021-10-20T23:58:16.322 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.065) 0:02:23.691 ***** 2021-10-20T23:58:16.345 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.023) 0:02:23.714 ***** 2021-10-20T23:58:16.512 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-20T23:58:16.514 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:58:16.537 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.191) 0:02:23.906 ***** 2021-10-20T23:58:16.600 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.612 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.074) 0:02:23.981 ***** 2021-10-20T23:58:16.791 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-10-20T23:58:16.793 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:58:16.816 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.203) 0:02:24.185 ***** 2021-10-20T23:58:16.824 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-10-20T23:58:16.826 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.856 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.039) 0:02:24.225 ***** 2021-10-20T23:58:16.888 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:16.912 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.056) 0:02:24.281 ***** 2021-10-20T23:58:16.951 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:58:16.982 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:16 +0000 (0:00:00.069) 0:02:24.351 ***** 2021-10-20T23:58:16.989 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:58:16.991 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:58:17.017 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.035) 0:02:24.387 ***** 2021-10-20T23:58:17.037 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-10-20T23:58:17.039 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:58:17.064 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.046) 0:02:24.433 ***** 2021-10-20T23:58:17.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-10-20T23:58:17.074 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:17.101 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.036) 0:02:24.470 ***** 2021-10-20T23:58:17.109 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-20T23:58:17.111 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:58:17.135 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.033) 0:02:24.504 ***** 2021-10-20T23:58:17.142 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-20T23:58:17.144 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:17.172 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.036) 0:02:24.541 ***** 2021-10-20T23:58:17.178 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-10-20T23:58:17.179 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:58:17.206 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.034) 0:02:24.575 ***** 2021-10-20T23:58:17.234 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:58:17.236 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:58:17.262 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.055) 0:02:24.631 ***** 2021-10-20T23:58:17.280 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-10-20T23:58:17.282 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:17.307 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.045) 0:02:24.676 ***** 2021-10-20T23:58:17.357 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-20T23:58:17.360 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:58:17.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.079) 0:02:24.756 ***** 2021-10-20T23:58:17.457 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:58:17.459 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:17.482 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.095) 0:02:24.851 ***** 2021-10-20T23:58:17.500 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-10-20T23:58:17.501 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:58:17.534 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.051) 0:02:24.903 ***** 2021-10-20T23:58:17.543 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:58:17.544 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:58:17.576 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.041) 0:02:24.945 ***** 2021-10-20T23:58:17.801 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:58:17.803 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:58:17.826 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.250) 0:02:25.195 ***** 2021-10-20T23:58:17.833 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:58:17.835 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:17.874 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.047) 0:02:25.242 ***** 2021-10-20T23:58:17.908 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.032) 0:02:25.275 ***** 2021-10-20T23:58:17.914 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:58:17.917 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveEnterTimestampMonotonic": "188538053", "ActiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveExitTimestampMonotonic": "188450376", "ActiveState": "active", "After": "systemd-journald.socket remote-fs.target systemd-tmpfiles-setup.service network.target -.mount sysinit.target basic.target system.slice nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:58:00 UTC", "AssertTimestampMonotonic": "188501766", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ConditionTimestampMonotonic": "188501765", "ConfigurationDirec 2021-10-20T23:58:17.919 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6359", "ExecMainStartTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ExecMainStartTimestampMonotonic": "188538019", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:58:17.920 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveEnterTimestampMonotonic": "188500233", "InactiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveExitTimestampMonotonic": "188504122", "InvocationID": "fef365aa841741ff921dcd0f00156210", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6359", "MemoryAccounting": "yes", "MemoryCurrent": "6762496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:58:17.922 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:58:00 UTC", "StateChangeTimestampMonotonic": "188538053", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:58:17.924 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:17.947 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.040) 0:02:25.315 ***** 2021-10-20T23:58:17.954 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:58:17.956 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:58:17.982 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:17 +0000 (0:00:00.035) 0:02:25.351 ***** 2021-10-20T23:58:18.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:58:18.013 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.039 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.057) 0:02:25.408 ***** 2021-10-20T23:58:18.068 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.028) 0:02:25.437 ***** 2021-10-20T23:58:18.078 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-10-20T23:58:18.081 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-10-20T23:58:18.106 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.037) 0:02:25.475 ***** 2021-10-20T23:58:18.127 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:18.129 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.131 INFO:teuthology.task.ansible.out:TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi102.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-10-20T23:58:18.155 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.049) 0:02:25.524 ***** 2021-10-20T23:58:18.186 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.030) 0:02:25.555 ***** 2021-10-20T23:58:18.196 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.226 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.040) 0:02:25.595 ***** 2021-10-20T23:58:18.234 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:58:18.236 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.267 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.040) 0:02:25.636 ***** 2021-10-20T23:58:18.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.023) 0:02:25.660 ***** 2021-10-20T23:58:18.341 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:58:18.343 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.370 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.079) 0:02:25.739 ***** 2021-10-20T23:58:18.380 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:58:18.381 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:18.411 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.040) 0:02:25.780 ***** 2021-10-20T23:58:18.420 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:58:18.422 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:57:59 UTC", "ActiveEnterTimestampMonotonic": "174466544", "ActiveExitTimestamp": "Wed 2021-10-20 23:57:59 UTC", "ActiveExitTimestampMonotonic": "174378999", "ActiveState": "active", "After": "sysinit.target system.slice nss-lookup.target systemd-journald.socket systemd-tmpfiles-setup.service network.target remote-fs.target -.mount basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:57:59 UTC", "AssertTimestampMonotonic": "174432023", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:57:59 UTC", "ConditionTimestampMonotonic": "174432022", "ConfigurationDirec 2021-10-20T23:58:18.423 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6460", "ExecMainStartTimestamp": "Wed 2021-10-20 23:57:59 UTC", "ExecMainStartTimestampMonotonic": "174466519", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:58:18.425 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:57:59 UTC", "InactiveEnterTimestampMonotonic": "174430726", "InactiveExitTimestamp": "Wed 2021-10-20 23:57:59 UTC", "InactiveExitTimestampMonotonic": "174434994", "InvocationID": "13cf0f8e847c4b869edc5eaf56bf704d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6460", "MemoryAccounting": "yes", "MemoryCurrent": "6684672", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:58:18.427 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:57:59 UTC", "StateChangeTimestampMonotonic": "174466544", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:58:18.429 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38332", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-10-20T23:58:18.452 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.041) 0:02:25.821 ***** 2021-10-20T23:58:18.475 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.023) 0:02:25.844 ***** 2021-10-20T23:58:18.484 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.510 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.034) 0:02:25.879 ***** 2021-10-20T23:58:18.518 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-10-20T23:58:18.521 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:18.545 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.034) 0:02:25.914 ***** 2021-10-20T23:58:18.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-10-20T23:58:18.554 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.586 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.041) 0:02:25.955 ***** 2021-10-20T23:58:18.597 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:58:18.599 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.634 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.046) 0:02:26.002 ***** 2021-10-20T23:58:18.682 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.709 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.076) 0:02:26.078 ***** 2021-10-20T23:58:18.729 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:18.732 INFO:teuthology.task.ansible.out:TASK [testnode : Stop apache2] ************************************************* changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveEnterTimestampMonotonic": "155516829", "ActiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveExitTimestampMonotonic": "155428414", "ActiveState": "active", "After": "nss-lookup.target basic.target network.target systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket system.slice remote-fs.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:58:00 UTC", "AssertTimestampMonotonic": "155480348", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10 2021-10-20T23:58:18.733 INFO:teuthology.task.ansible.out:-20 23:58:00 UTC", "ConditionTimestampMonotonic": "155480347", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6450", "ExecMainStartTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ExecMainStartTimestampMonotonic": "155516806", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IORea 2021-10-20T23:58:18.735 INFO:teuthology.task.ansible.out:dOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveEnterTimestampMonotonic": "155478741", "InactiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveExitTimestampMonotonic": "155483680", "InvocationID": "e0502545c34a4b4b970de518b194f3bb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6450", "MemoryAccounting": "yes", "MemoryCurrent": "6832128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": 2021-10-20T23:58:18.737 INFO:teuthology.task.ansible.out: "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:58:00 UTC", "StateChangeTimestampMonotonic": "155516829", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix" 2021-10-20T23:58:18.738 INFO:teuthology.task.ansible.out:: "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.760 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.050) 0:02:26.129 ***** 2021-10-20T23:58:18.784 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.024) 0:02:26.153 ***** 2021-10-20T23:58:18.807 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:58:18.808 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.837 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.052) 0:02:26.206 ***** 2021-10-20T23:58:18.846 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:58:18.848 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:18.876 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.039) 0:02:26.245 ***** 2021-10-20T23:58:18.890 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveEnterTimestampMonotonic": "160616077", "ActiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ActiveExitTimestampMonotonic": "160529206", "ActiveState": "active", "After": "network.target sysinit.target basic.target -.mount remote-fs.target systemd-journald.socket nss-lookup.target system.slice systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:58:00 UTC", "AssertTimestampMonotonic": "160582403", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_ma 2021-10-20T23:58:18.892 INFO:teuthology.task.ansible.out:c_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ConditionTimestampMonotonic": "160582402", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6447", "ExecMainStartTimestamp": "Wed 2021-10-20 23:58:00 UTC", "ExecMainStartTimestampMonotonic": "160616050", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreM 2021-10-20T23:58:18.894 INFO:teuthology.task.ansible.out:ax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveEnterTimestampMonotonic": "160581030", "InactiveExitTimestamp": "Wed 2021-10-20 23:58:00 UTC", "InactiveExitTimestampMonotonic": "160584970", "InvocationID": "02e8b49fc0b34b648794dab4edc1b13c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateL 2021-10-20T23:58:18.895 INFO:teuthology.task.ansible.out:imitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6447", "MemoryAccounting": "yes", "MemoryCurrent": "6856704", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:58:00 UTC", "StateChangeTimestampMonotonic": 2021-10-20T23:58:18.897 INFO:teuthology.task.ansible.out:"160616077", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:18.923 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.046) 0:02:26.292 ***** 2021-10-20T23:58:18.950 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.027) 0:02:26.319 ***** 2021-10-20T23:58:18.960 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-10-20T23:58:18.961 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-10-20T23:58:18.962 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-10-20T23:58:18.996 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:18 +0000 (0:00:00.045) 0:02:26.365 ***** 2021-10-20T23:58:19.021 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.024) 0:02:26.389 ***** 2021-10-20T23:58:19.029 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:19.031 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.062 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.041) 0:02:26.431 ***** 2021-10-20T23:58:19.090 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.027) 0:02:26.459 ***** 2021-10-20T23:58:19.099 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:58:19.101 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.128 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.038) 0:02:26.497 ***** 2021-10-20T23:58:19.153 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.025) 0:02:26.522 ***** 2021-10-20T23:58:19.164 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-10-20T23:58:19.165 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.192 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.038) 0:02:26.561 ***** 2021-10-20T23:58:19.216 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.024) 0:02:26.585 ***** 2021-10-20T23:58:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:58:19.226 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.253 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.037) 0:02:26.622 ***** 2021-10-20T23:58:19.280 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.026) 0:02:26.649 ***** 2021-10-20T23:58:19.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-10-20T23:58:19.290 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Install packages] ********************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.317 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.036) 0:02:26.686 ***** 2021-10-20T23:58:19.341 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.024) 0:02:26.710 ***** 2021-10-20T23:58:19.349 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:58:19.351 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.376 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.035) 0:02:26.745 ***** 2021-10-20T23:58:19.400 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.023) 0:02:26.769 ***** 2021-10-20T23:58:19.408 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.444 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.044) 0:02:26.813 ***** 2021-10-20T23:58:19.451 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-10-20T23:58:19.453 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.479 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.034) 0:02:26.848 ***** 2021-10-20T23:58:19.487 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-10-20T23:58:19.490 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.515 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.035) 0:02:26.884 ***** 2021-10-20T23:58:19.540 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.023) 0:02:26.908 ***** 2021-10-20T23:58:19.547 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.548 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:19.577 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.036) 0:02:26.945 ***** 2021-10-20T23:58:19.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.023) 0:02:26.968 ***** 2021-10-20T23:58:19.606 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:19.608 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.609 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.639 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.040) 0:02:27.008 ***** 2021-10-20T23:58:19.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.026) 0:02:27.035 ***** 2021-10-20T23:58:19.691 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.024) 0:02:27.060 ***** 2021-10-20T23:58:19.702 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:58:19.704 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.733 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.042) 0:02:27.102 ***** 2021-10-20T23:58:19.894 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-10-20T23:58:19.897 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:58:01 UTC", "ActiveEnterTimestampMonotonic": "167530545", "ActiveExitTimestamp": "Wed 2021-10-20 23:58:01 UTC", "ActiveExitTimestampMonotonic": "167445174", "ActiveState": "active", "After": "basic.target sysinit.target network.target nss-lookup.target systemd-tmpfiles-setup.service remote-fs.target system.slice systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:58:01 UTC", "AssertTimestampMonotonic": "167496627", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:58:01 UTC", "ConditionTimestampMonotonic": "167496627", "ConfigurationDirec 2021-10-20T23:58:19.899 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6461", "ExecMainStartTimestamp": "Wed 2021-10-20 23:58:01 UTC", "ExecMainStartTimestampMonotonic": "167530523", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-10-20T23:58:19.901 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:58:01 UTC", "InactiveEnterTimestampMonotonic": "167495206", "InactiveExitTimestamp": "Wed 2021-10-20 23:58:01 UTC", "InactiveExitTimestampMonotonic": "167499912", "InvocationID": "1a9b94b7bbfd45f38c1ea6c14abbc9f9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6461", "MemoryAccounting": "yes", "MemoryCurrent": "6868992", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-10-20T23:58:19.903 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:58:01 UTC", "StateChangeTimestampMonotonic": "167530545", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-10-20T23:58:19.904 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:19.924 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.190) 0:02:27.293 ***** 2021-10-20T23:58:19.927 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:19.946 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:19.982 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:19 +0000 (0:00:00.057) 0:02:27.351 ***** 2021-10-20T23:58:20.166 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.184) 0:02:27.535 ***** 2021-10-20T23:58:20.176 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.178 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.037) 0:02:27.573 ***** 2021-10-20T23:58:20.229 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:27.598 ***** 2021-10-20T23:58:20.253 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:27.622 ***** 2021-10-20T23:58:20.263 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:20.264 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.037) 0:02:27.660 ***** 2021-10-20T23:58:20.315 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:27.684 ***** 2021-10-20T23:58:20.322 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-10-20T23:58:20.324 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.326 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.352 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.037) 0:02:27.722 ***** 2021-10-20T23:58:20.377 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:27.746 ***** 2021-10-20T23:58:20.399 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.022) 0:02:27.768 ***** 2021-10-20T23:58:20.406 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:58:20.408 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.434 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.034) 0:02:27.802 ***** 2021-10-20T23:58:20.458 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:27.827 ***** 2021-10-20T23:58:20.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-10-20T23:58:20.467 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.492 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.034) 0:02:27.861 ***** 2021-10-20T23:58:20.523 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.030) 0:02:27.892 ***** 2021-10-20T23:58:20.531 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:20.533 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.559 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.035) 0:02:27.927 ***** 2021-10-20T23:58:20.583 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.025) 0:02:27.952 ***** 2021-10-20T23:58:20.591 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:20.593 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.628 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.044) 0:02:27.997 ***** 2021-10-20T23:58:20.658 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.029) 0:02:28.027 ***** 2021-10-20T23:58:20.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.040) 0:02:28.067 ***** 2021-10-20T23:58:20.710 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.041) 0:02:28.109 ***** 2021-10-20T23:58:20.765 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.024) 0:02:28.134 ***** 2021-10-20T23:58:20.791 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.025) 0:02:28.159 ***** 2021-10-20T23:58:20.798 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-10-20T23:58:20.800 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.828 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.038) 0:02:28.197 ***** 2021-10-20T23:58:20.859 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.030) 0:02:28.228 ***** 2021-10-20T23:58:20.868 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:20.869 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.895 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.036) 0:02:28.264 ***** 2021-10-20T23:58:20.925 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.030) 0:02:28.294 ***** 2021-10-20T23:58:20.949 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.023) 0:02:28.318 ***** 2021-10-20T23:58:20.956 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-10-20T23:58:20.958 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:20.986 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:20 +0000 (0:00:00.036) 0:02:28.355 ***** 2021-10-20T23:58:21.008 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.022) 0:02:28.377 ***** 2021-10-20T23:58:21.016 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:21.018 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.044 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.036) 0:02:28.413 ***** 2021-10-20T23:58:21.045 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:21.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.022) 0:02:28.436 ***** 2021-10-20T23:58:21.093 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.024) 0:02:28.460 ***** 2021-10-20T23:58:21.098 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-10-20T23:58:21.100 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.127 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.035) 0:02:28.496 ***** 2021-10-20T23:58:21.167 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.040) 0:02:28.536 ***** 2021-10-20T23:58:21.178 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:21.180 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.208 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.040) 0:02:28.577 ***** 2021-10-20T23:58:21.230 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.022) 0:02:28.599 ***** 2021-10-20T23:58:21.238 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.035) 0:02:28.634 ***** 2021-10-20T23:58:21.296 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.030) 0:02:28.665 ***** 2021-10-20T23:58:21.303 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:21.306 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.331 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.035) 0:02:28.700 ***** 2021-10-20T23:58:21.356 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.025) 0:02:28.725 ***** 2021-10-20T23:58:21.365 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:21.366 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.368 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.396 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.039) 0:02:28.765 ***** 2021-10-20T23:58:21.422 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.025) 0:02:28.791 ***** 2021-10-20T23:58:21.448 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.025) 0:02:28.817 ***** 2021-10-20T23:58:21.457 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:21.458 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.495 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.047) 0:02:28.864 ***** 2021-10-20T23:58:21.525 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.029) 0:02:28.893 ***** 2021-10-20T23:58:21.533 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:21.535 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.564 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.039) 0:02:28.933 ***** 2021-10-20T23:58:21.590 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.025) 0:02:28.958 ***** 2021-10-20T23:58:21.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.023) 0:02:28.982 ***** 2021-10-20T23:58:21.619 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:21.621 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.647 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.034) 0:02:29.016 ***** 2021-10-20T23:58:21.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.032) 0:02:29.048 ***** 2021-10-20T23:58:21.689 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:21.690 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.716 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.037) 0:02:29.085 ***** 2021-10-20T23:58:21.742 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.025) 0:02:29.111 ***** 2021-10-20T23:58:21.752 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:58:21.754 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.783 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.040) 0:02:29.151 ***** 2021-10-20T23:58:21.809 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.026) 0:02:29.178 ***** 2021-10-20T23:58:21.844 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.035) 0:02:29.213 ***** 2021-10-20T23:58:21.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:21.853 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.855 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.855 INFO:teuthology.task.ansible.out:TASK [testnode : Set grub config.] ********************************************* 2021-10-20T23:58:21.856 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.886 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.042) 0:02:29.255 ***** 2021-10-20T23:58:21.912 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.024) 0:02:29.280 ***** 2021-10-20T23:58:21.939 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.027) 0:02:29.308 ***** 2021-10-20T23:58:21.947 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:58:21.949 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:21.975 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.035) 0:02:29.344 ***** 2021-10-20T23:58:21.998 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:21 +0000 (0:00:00.023) 0:02:29.367 ***** 2021-10-20T23:58:22.007 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.037 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.037) 0:02:29.405 ***** 2021-10-20T23:58:22.047 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:22.049 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.083 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.046) 0:02:29.452 ***** 2021-10-20T23:58:22.107 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.024) 0:02:29.476 ***** 2021-10-20T23:58:22.117 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:58:22.118 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.145 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.038) 0:02:29.515 ***** 2021-10-20T23:58:22.171 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.024) 0:02:29.539 ***** 2021-10-20T23:58:22.198 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.025) 0:02:29.565 ***** 2021-10-20T23:58:22.205 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.235 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.038) 0:02:29.604 ***** 2021-10-20T23:58:22.260 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.025) 0:02:29.629 ***** 2021-10-20T23:58:22.267 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:22.269 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.296 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.035) 0:02:29.665 ***** 2021-10-20T23:58:22.303 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:22.306 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.332 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.036) 0:02:29.701 ***** 2021-10-20T23:58:22.340 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:22.342 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.377 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.044) 0:02:29.746 ***** 2021-10-20T23:58:22.388 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.390 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.417 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.039) 0:02:29.786 ***** 2021-10-20T23:58:22.441 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.023) 0:02:29.810 ***** 2021-10-20T23:58:22.451 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.452 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.046) 0:02:29.856 ***** 2021-10-20T23:58:22.512 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.025) 0:02:29.881 ***** 2021-10-20T23:58:22.521 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-10-20T23:58:22.526 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.552 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.039) 0:02:29.921 ***** 2021-10-20T23:58:22.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:22.562 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:58:22.593 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.040) 0:02:29.962 ***** 2021-10-20T23:58:22.619 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.025) 0:02:29.988 ***** 2021-10-20T23:58:22.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:22.629 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.044) 0:02:30.032 ***** 2021-10-20T23:58:22.686 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.022) 0:02:30.055 ***** 2021-10-20T23:58:22.693 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:22.695 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.724 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.038) 0:02:30.093 ***** 2021-10-20T23:58:22.750 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.025) 0:02:30.118 ***** 2021-10-20T23:58:22.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:22.759 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:58:22.787 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.037) 0:02:30.156 ***** 2021-10-20T23:58:22.813 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.024) 0:02:30.181 ***** 2021-10-20T23:58:22.821 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:58:22.823 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.848 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.036) 0:02:30.217 ***** 2021-10-20T23:58:22.883 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.034) 0:02:30.252 ***** 2021-10-20T23:58:22.891 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-10-20T23:58:22.892 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.920 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.037) 0:02:30.289 ***** 2021-10-20T23:58:22.929 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:22.958 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:22 +0000 (0:00:00.037) 0:02:30.327 ***** 2021-10-20T23:58:22.966 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:22.968 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.006 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.047) 0:02:30.375 ***** 2021-10-20T23:58:23.014 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:23.017 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.043 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.036) 0:02:30.412 ***** 2021-10-20T23:58:23.051 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:58:23.053 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.082 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.037) 0:02:30.450 ***** 2021-10-20T23:58:23.090 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:23.091 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.120 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.039) 0:02:30.489 ***** 2021-10-20T23:58:23.137 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:58:23.139 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.168 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.047) 0:02:30.537 ***** 2021-10-20T23:58:23.191 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.023) 0:02:30.560 ***** 2021-10-20T23:58:23.200 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:58:23.202 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.228 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.036) 0:02:30.597 ***** 2021-10-20T23:58:23.252 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.023) 0:02:30.621 ***** 2021-10-20T23:58:23.275 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.021) 0:02:30.643 ***** 2021-10-20T23:58:23.283 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-10-20T23:58:23.285 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.318 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.043) 0:02:30.687 ***** 2021-10-20T23:58:23.327 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:23.329 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.355 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.037) 0:02:30.724 ***** 2021-10-20T23:58:23.367 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.393 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.037) 0:02:30.762 ***** 2021-10-20T23:58:23.400 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-10-20T23:58:23.402 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.427 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.034) 0:02:30.796 ***** 2021-10-20T23:58:23.444 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:58:23.446 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:58:23.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.044) 0:02:30.841 ***** 2021-10-20T23:58:23.492 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-10-20T23:58:23.495 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.518 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.046) 0:02:30.887 ***** 2021-10-20T23:58:23.568 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-20T23:58:23.570 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:58:23.595 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.076) 0:02:30.964 ***** 2021-10-20T23:58:23.601 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-10-20T23:58:23.603 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.630 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.035) 0:02:30.999 ***** 2021-10-20T23:58:23.655 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.024) 0:02:31.024 ***** 2021-10-20T23:58:23.707 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:23.742 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.086) 0:02:31.111 ***** 2021-10-20T23:58:23.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:58:23.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.124) 0:02:31.236 ***** 2021-10-20T23:58:23.874 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:58:23.876 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:58:23.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.034) 0:02:31.270 ***** 2021-10-20T23:58:23.957 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-10-20T23:58:23.984 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:23 +0000 (0:00:00.081) 0:02:31.352 ***** 2021-10-20T23:58:23.991 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:23.993 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:58:24.023 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.039) 0:02:31.392 ***** 2021-10-20T23:58:24.053 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.030) 0:02:31.422 ***** 2021-10-20T23:58:24.074 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-10-20T23:58:24.079 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:58:24.107 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.052) 0:02:31.475 ***** 2021-10-20T23:58:24.183 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:24.185 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.209 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.103) 0:02:31.578 ***** 2021-10-20T23:58:24.217 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:58:24.220 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:24.248 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.038) 0:02:31.617 ***** 2021-10-20T23:58:24.269 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:58:24.303 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.050) 0:02:31.667 ***** 2021-10-20T23:58:24.341 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:24.348 INFO:teuthology.task.ansible.out:TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.349 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:24.381 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.083) 0:02:31.750 ***** 2021-10-20T23:58:24.402 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-10-20T23:58:24.436 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.050) 0:02:31.801 ***** 2021-10-20T23:58:24.464 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.493 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.060) 0:02:31.862 ***** 2021-10-20T23:58:24.501 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:58:24.503 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:58:24.530 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.036) 0:02:31.898 ***** 2021-10-20T23:58:24.538 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-10-20T23:58:24.540 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.570 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.040) 0:02:31.939 ***** 2021-10-20T23:58:24.578 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.619 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.045) 0:02:31.984 ***** 2021-10-20T23:58:24.638 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-10-20T23:58:24.639 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-10-20T23:58:24.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.051) 0:02:32.035 ***** 2021-10-20T23:58:24.696 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-20T23:58:24.697 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.726 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.059) 0:02:32.095 ***** 2021-10-20T23:58:24.758 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:58:24.797 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.068) 0:02:32.163 ***** 2021-10-20T23:58:24.828 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:24.853 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.059) 0:02:32.223 ***** 2021-10-20T23:58:24.947 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:58:24.949 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:58:24.973 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.119) 0:02:32.342 ***** 2021-10-20T23:58:24.999 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:24 +0000 (0:00:00.026) 0:02:32.368 ***** 2021-10-20T23:58:25.008 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:58:25.010 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:25.037 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.037) 0:02:32.406 ***** 2021-10-20T23:58:25.062 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.023) 0:02:32.429 ***** 2021-10-20T23:58:25.074 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi041.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.085 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.099 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.102 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi041.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-20T23:58:25.138 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.076) 0:02:32.506 ***** 2021-10-20T23:58:25.143 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.146 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi041.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.149 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.174 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.037) 0:02:32.543 ***** 2021-10-20T23:58:25.186 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.188 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.219 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.044) 0:02:32.588 ***** 2021-10-20T23:58:25.261 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-20T23:58:25.263 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.300 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.081) 0:02:32.669 ***** 2021-10-20T23:58:25.395 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:58:25.397 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.431 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.130) 0:02:32.800 ***** 2021-10-20T23:58:25.443 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-20T23:58:25.444 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:58:25.476 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.042) 0:02:32.842 ***** 2021-10-20T23:58:25.504 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-20T23:58:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.536 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.062) 0:02:32.905 ***** 2021-10-20T23:58:25.556 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-20T23:58:25.558 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.008401", "end": "2021-10-20 23:58:25.514585", "rc": 0, "start": "2021-10-20 23:58:25.506184", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:58:25.588 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.051) 0:02:32.957 ***** 2021-10-20T23:58:25.601 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-10-20T23:58:25.603 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-10-20T23:58:25.603 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-10-20T23:58:25.605 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:58:25.638 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.049) 0:02:33.007 ***** 2021-10-20T23:58:25.661 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.023) 0:02:33.030 ***** 2021-10-20T23:58:25.668 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-20T23:58:25.670 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:25.697 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.035) 0:02:33.066 ***** 2021-10-20T23:58:25.722 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.024) 0:02:33.091 ***** 2021-10-20T23:58:25.738 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.759 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.037) 0:02:33.128 ***** 2021-10-20T23:58:25.813 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.841 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.079) 0:02:33.207 ***** 2021-10-20T23:58:25.863 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.024) 0:02:33.232 ***** 2021-10-20T23:58:25.881 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.884 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:25.922 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.059) 0:02:33.291 ***** 2021-10-20T23:58:25.954 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.031) 0:02:33.323 ***** 2021-10-20T23:58:25.964 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:58:25.966 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.967 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:25.968 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.002 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:25 +0000 (0:00:00.048) 0:02:33.371 ***** 2021-10-20T23:58:26.019 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi062.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi062.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.026 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:26.032 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.036 INFO:teuthology.task.ansible.out: skipping: [smithi062.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.039 INFO:teuthology.task.ansible.out: skipping: [smithi062.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.065) 0:02:33.436 ***** 2021-10-20T23:58:26.122 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.053) 0:02:33.490 ***** 2021-10-20T23:58:26.150 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.028) 0:02:33.519 ***** 2021-10-20T23:58:26.160 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-10-20T23:58:26.162 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.162 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-10-20T23:58:26.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.043) 0:02:33.562 ***** 2021-10-20T23:58:26.220 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.025) 0:02:33.588 ***** 2021-10-20T23:58:26.241 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-10-20T23:58:26.243 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.052) 0:02:33.641 ***** 2021-10-20T23:58:26.303 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-20T23:58:26.305 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.354 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.069) 0:02:33.710 ***** 2021-10-20T23:58:26.389 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.429 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.087) 0:02:33.798 ***** 2021-10-20T23:58:26.439 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-10-20T23:58:26.442 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.011307", "end": "2021-10-20 23:58:26.409866", "rc": 0, "start": "2021-10-20 23:58:26.398559", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:58:26.481 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.046) 0:02:33.845 ***** 2021-10-20T23:58:26.513 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.034) 0:02:33.879 ***** 2021-10-20T23:58:26.550 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.033) 0:02:33.913 ***** 2021-10-20T23:58:26.560 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.054) 0:02:33.968 ***** 2021-10-20T23:58:26.609 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:26.628 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.667 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.066) 0:02:34.034 ***** 2021-10-20T23:58:26.715 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.048) 0:02:34.083 ***** 2021-10-20T23:58:26.726 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:58:26.732 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.772 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.056) 0:02:34.139 ***** 2021-10-20T23:58:26.801 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.029) 0:02:34.169 ***** 2021-10-20T23:58:26.811 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:58:26.828 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.830 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:26.859 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.059) 0:02:34.228 ***** 2021-10-20T23:58:26.882 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.022) 0:02:34.251 ***** 2021-10-20T23:58:26.909 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.027) 0:02:34.278 ***** 2021-10-20T23:58:26.918 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:26.920 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.920 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.949 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.039) 0:02:34.318 ***** 2021-10-20T23:58:26.956 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.958 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.958 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.958 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.959 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-20T23:58:26.959 INFO:teuthology.task.ansible.out: skipping: [smithi099.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.961 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.962 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.962 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.963 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:26.995 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:26 +0000 (0:00:00.045) 0:02:34.364 ***** 2021-10-20T23:58:27.029 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.033) 0:02:34.397 ***** 2021-10-20T23:58:27.038 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.039 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.048) 0:02:34.445 ***** 2021-10-20T23:58:27.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.033) 0:02:34.479 ***** 2021-10-20T23:58:27.121 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.122 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.122 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.124 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi041.front.sepia.ceph.com] => (item={'block_used': 14045283, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049825, 'size_available': 925900083200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049825, "block_size": 4096, "block_total": 240095108, "block_used": 14045283, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900083200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:58:27.124 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi102.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.125 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:27.126 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi102.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.127 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.127 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-10-20T23:58:27.128 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.129 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.130 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.132 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.134 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.163 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.052) 0:02:34.532 ***** 2021-10-20T23:58:27.192 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.028) 0:02:34.561 ***** 2021-10-20T23:58:27.200 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-10-20T23:58:27.201 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.231 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.038) 0:02:34.599 ***** 2021-10-20T23:58:27.312 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-10-20T23:58:27.314 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.337 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.106) 0:02:34.706 ***** 2021-10-20T23:58:27.368 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-10-20T23:58:27.369 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009548", "end": "2021-10-20 23:58:27.355162", "rc": 0, "start": "2021-10-20 23:58:27.345614", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:27.397 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.059) 0:02:34.766 ***** 2021-10-20T23:58:27.418 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004914", "end": "2021-10-20 23:58:27.366956", "rc": 0, "start": "2021-10-20 23:58:27.362042", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:58:27.452 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.054) 0:02:34.821 ***** 2021-10-20T23:58:27.464 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-10-20T23:58:27.491 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.038) 0:02:34.859 ***** 2021-10-20T23:58:27.512 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-10-20T23:58:27.514 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.007652", "end": "2021-10-20 23:58:27.460284", "rc": 0, "start": "2021-10-20 23:58:27.452632", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi041.front.sepia.ceph.com] => (item={'block_used': 14045283, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049825, 'size_available': 925900083200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049825, "block_size": 4096, "block_total": 240095108, "block_used": 14045283, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900083200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.547 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.057) 0:02:34.916 ***** 2021-10-20T23:58:27.553 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:27.586 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.038) 0:02:34.955 ***** 2021-10-20T23:58:27.599 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.638 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.051) 0:02:35.006 ***** 2021-10-20T23:58:27.646 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-10-20T23:58:27.647 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.648 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:58:27.648 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi071.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.650 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.690 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.051) 0:02:35.058 ***** 2021-10-20T23:58:27.699 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.701 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi071.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi071.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.703 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.703 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi071.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.707 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.738 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.048) 0:02:35.106 ***** 2021-10-20T23:58:27.740 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:27.752 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.756 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:58:27.758 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.816 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.074) 0:02:35.181 ***** 2021-10-20T23:58:27.841 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.028) 0:02:35.209 ***** 2021-10-20T23:58:27.855 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.859 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:27.891 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.051) 0:02:35.260 ***** 2021-10-20T23:58:27.917 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:27 +0000 (0:00:00.025) 0:02:35.286 ***** 2021-10-20T23:58:27.981 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:58:27.983 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.094) 0:02:35.381 ***** 2021-10-20T23:58:28.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.027) 0:02:35.408 ***** 2021-10-20T23:58:28.074 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:58:28.078 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.119 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.076) 0:02:35.485 ***** 2021-10-20T23:58:28.144 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14045280, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049828, 'size_available': 925900095488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049828, "block_size": 4096, "block_total": 240095108, "block_used": 14045280, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900095488, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:58:28.199 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.071) 0:02:35.557 ***** TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.013487", "end": "2021-10-20 23:58:28.107470", "rc": 0, "start": "2021-10-20 23:58:28.093983", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology-lock"]} 2021-10-20T23:58:28.244 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.056) 0:02:35.613 ***** 2021-10-20T23:58:28.399 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.422 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.178) 0:02:35.791 ***** 2021-10-20T23:58:28.455 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009558", "end": "2021-10-20 23:58:28.262961", "rc": 0, "start": "2021-10-20 23:58:28.253403", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:28.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.059) 0:02:35.851 ***** 2021-10-20T23:58:28.504 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-10-20T23:58:28.506 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.533 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.051) 0:02:35.902 ***** 2021-10-20T23:58:28.572 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-20T23:58:28.574 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14045280, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049828, 'size_available': 925900095488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049828, "block_size": 4096, "block_total": 240095108, "block_used": 14045280, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900095488, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.602 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.068) 0:02:35.971 ***** 2021-10-20T23:58:28.621 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-10-20T23:58:28.624 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.657 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.050) 0:02:36.021 ***** 2021-10-20T23:58:28.683 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:58:28.715 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.057) 0:02:36.079 ***** 2021-10-20T23:58:28.799 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.822 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:58:28.851 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.140) 0:02:36.219 ***** 2021-10-20T23:58:28.892 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:58:28.921 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.070) 0:02:36.290 ***** 2021-10-20T23:58:28.944 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-10-20T23:58:28.946 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:28.981 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:28 +0000 (0:00:00.052) 0:02:36.343 ***** 2021-10-20T23:58:29.020 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.021 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:29.050 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.074) 0:02:36.417 ***** 2021-10-20T23:58:29.073 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:29.074 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'block_used': 14045272, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049836, 'size_available': 925900128256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049836, "block_size": 4096, "block_total": 240095108, "block_used": 14045272, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900128256, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:58:29.102 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.054) 0:02:36.471 ***** 2021-10-20T23:58:29.143 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'block_used': 14045287, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049821, 'size_available': 925900066816, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049821, "block_size": 4096, "block_total": 240095108, "block_used": 14045287, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900066816, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:58:29.172 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.069) 0:02:36.540 ***** 2021-10-20T23:58:29.321 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009543", "end": "2021-10-20 23:58:28.994409", "rc": 0, "start": "2021-10-20 23:58:28.984866", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:29.351 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.179) 0:02:36.720 ***** 2021-10-20T23:58:29.370 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009435", "end": "2021-10-20 23:58:29.023979", "rc": 0, "start": "2021-10-20 23:58:29.014544", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:29.398 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.046) 0:02:36.767 ***** 2021-10-20T23:58:29.409 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-10-20T23:58:29.411 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:29.439 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.041) 0:02:36.808 ***** 2021-10-20T23:58:29.463 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi099.front.sepia.ceph.com] => (item={'block_used': 14045272, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049836, 'size_available': 925900128256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049836, "block_size": 4096, "block_total": 240095108, "block_used": 14045272, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900128256, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.465 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:29.494 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.055) 0:02:36.863 ***** 2021-10-20T23:58:29.517 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'block_used': 14045287, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049821, 'size_available': 925900066816, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049821, "block_size": 4096, "block_total": 240095108, "block_used": 14045287, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900066816, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.057) 0:02:36.920 ***** TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD5eGOM3VI2YBlXsKnlXOE7bZeOTEMPDDB'], 'uuids': ['7130fdf5-24aa-4b36-8574-ea2bbc7bc0b0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.582009", "end": "2021-10-20 23:58:29.489062", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD5eGOM3VI2YBlXsKnlXOE7bZeOTEMPDDB"], "labels": [], "masters": [], "uuids": ["7130fdf5-24aa-4b36-8574-ea2bbc7bc0b0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:27.907053", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after y 2021-10-20T23:58:29.565 INFO:teuthology.task.ansible.out:ou", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.566 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.595 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.042) 0:02:36.963 ***** 2021-10-20T23:58:29.603 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:58:29.633 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.038) 0:02:37.002 ***** 2021-10-20T23:58:29.669 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.036) 0:02:37.038 ***** 2021-10-20T23:58:29.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:29.691 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-10-20T23:58:29.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.051) 0:02:37.090 ***** 2021-10-20T23:58:29.781 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:29.932 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009597", "end": "2021-10-20 23:58:30.225435", "rc": 0, "start": "2021-10-20 23:58:30.215838", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:29.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:29 +0000 (0:00:00.234) 0:02:37.324 ***** 2021-10-20T23:58:30.068 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-10-20T23:58:30.073 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:30.099 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:30 +0000 (0:00:00.143) 0:02:37.468 ***** 2021-10-20T23:58:30.176 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-10-20T23:58:30.222 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:30 +0000 (0:00:00.114) 0:02:37.582 ***** 2021-10-20T23:58:30.343 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:30.344 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:30.708 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCugB4s9bI4ke6vTTopfK5iCdMFOv3T9a9'], 'uuids': ['5aac026d-18be-4066-a180-d4b90b4a6497']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.769994", "end": "2021-10-20 23:58:30.508471", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCugB4s9bI4ke6vTTopfK5iCdMFOv3T9a9"], "labels": [], "masters": [], "uuids": ["5aac026d-18be-4066-a180-d4b90b4a6497"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:28.738477", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:30.725 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:30.733 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:30.869 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD9OYwrwIQObAi7pjPpE7N9S8diO6Gnk5N'], 'uuids': ['4264c7c0-70c4-4dd1-ac14-03384607d0a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.189025", "end": "2021-10-20 23:58:30.851252", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD9OYwrwIQObAi7pjPpE7N9S8diO6Gnk5N"], "labels": [], "masters": [], "uuids": ["4264c7c0-70c4-4dd1-ac14-03384607d0a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:29.662227", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:30.881 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S', 'wwn-0x5000c500871a27d9'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1', 'wwn-0x5000c500871a27d9-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a27d9', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HM0S', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S", "wwn-0x5000c500871a27d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1", "wwn-0x5000c500871a27d9-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HM0S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a27d9"}}, 2021-10-20T23:58:30.883 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:31.561 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpvGKS3fbK1o32ojHQCzwLXJF3pvJmAFI1'], 'uuids': ['120db64d-3223-44ee-8576-ebd85f5f9817']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.641309", "end": "2021-10-20 23:58:31.197055", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpvGKS3fbK1o32ojHQCzwLXJF3pvJmAFI1"], "labels": [], "masters": [], "uuids": ["120db64d-3223-44ee-8576-ebd85f5f9817"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:29.555746", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:31.574 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:31.576 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:31.678 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn20eRgR3T2hHYlg07lzk2OPKFgfVun2cPg'], 'uuids': ['79476aa1-dd3e-4e63-8eb5-14a4aa9a3289']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.767101", "end": "2021-10-20 23:58:31.339203", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn20eRgR3T2hHYlg07lzk2OPKFgfVun2cPg"], "labels": [], "masters": [], "uuids": ["79476aa1-dd3e-4e63-8eb5-14a4aa9a3289"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:29.572102", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:31.696 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.042 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCsFTyGsLbCayVHMlBqpI1hWIoYfhyb2Q0'], 'uuids': ['b4c2907e-d56e-4b1e-ad2f-6fe00539dce4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.156454", "end": "2021-10-20 23:58:31.817853", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCsFTyGsLbCayVHMlBqpI1hWIoYfhyb2Q0"], "labels": [], "masters": [], "uuids": ["b4c2907e-d56e-4b1e-ad2f-6fe00539dce4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:30.661399", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:32.072 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV', 'wwn-0x5000c50087b99812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', 'wwn-0x5000c50087b99812-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b99812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W5SV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, 2021-10-20T23:58:32.084 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.138 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRkEfNAONUEcu0R5ebaRWsjudUUvIcEjfH'], 'uuids': ['8a5d7d2f-9c31-4e1a-8b92-064151ee770c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.628881", "end": "2021-10-20 23:58:32.401399", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRkEfNAONUEcu0R5ebaRWsjudUUvIcEjfH"], "labels": [], "masters": [], "uuids": ["8a5d7d2f-9c31-4e1a-8b92-064151ee770c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:30.772518", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi071.front 2021-10-20T23:58:32.143 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.160 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.246 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-q7iuwz-TD65-i3KH-5E6r-2pfP-Gq3H-zoCcZD', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN', 'nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.193380", "end": "2021-10-20 23:58:32.188539", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q7iuwz-TD65-i3KH-5E6r-2pfP-Gq3H-zoCcZD", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN", "nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:30.995159", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:58:32.248 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.252 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.868 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpBDGsyRVOz45F2jutp9zswNkLuk8B3SuB'], 'uuids': ['475762d8-ec97-4ac6-aedd-eefd361015a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.136061", "end": "2021-10-20 23:58:32.499636", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpBDGsyRVOz45F2jutp9zswNkLuk8B3SuB"], "labels": [], "masters": [], "uuids": ["475762d8-ec97-4ac6-aedd-eefd361015a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:31.363575", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:32.881 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM', 'wwn-0x5000c50091e0bcf8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1', 'wwn-0x5000c50091e0bcf8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bcf8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPPM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM", "wwn-0x5000c50091e0bcf8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1", "wwn-0x5000c50091e0bcf8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPPM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bcf8"}}, 2021-10-20T23:58:32.883 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:32.995 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2yFeQWB9ZjsbMn4tsAxFWemGiLR2yO3et'], 'uuids': ['41268ead-823f-4ea6-9003-fd8125385024']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.141340", "end": "2021-10-20 23:58:32.652316", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2yFeQWB9ZjsbMn4tsAxFWemGiLR2yO3et"], "labels": [], "masters": [], "uuids": ["41268ead-823f-4ea6-9003-fd8125385024"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:31.510976", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN', 'wwn-0x5000c500918da8bc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1', 'wwn-0x5000c500918da8bc-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918da8bc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LHPN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN", "wwn-0x5000c500918da8bc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1", "wwn-0x5000c500918da8bc-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHPN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da8bc"}}, 2021-10-20T23:58:33.004 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:33.443 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRUTlA2xzr1LwJPErv9YEyffQdMvwmGADh'], 'uuids': ['55a2fea4-300b-47c1-a157-9744489f9f56']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.151502", "end": "2021-10-20 23:58:33.731781", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRUTlA2xzr1LwJPErv9YEyffQdMvwmGADh"], "labels": [], "masters": [], "uuids": ["55a2fea4-300b-47c1-a157-9744489f9f56"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:32.580279", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:33.456 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJJR', 'wwn-0x5000c50091e19c4b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1', 'wwn-0x5000c50091e19c4b-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e19c4b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QJJR', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR", "wwn-0x5000c50091e19c4b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1", "wwn-0x5000c50091e19c4b-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJJR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e19c4b"}}, 2021-10-20T23:58:33.458 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:33.468 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kMVBHE-MKor-jkJr-aiVw-nkym-Ks0A-zvDzVX', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', 'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.193254", "end": "2021-10-20 23:58:33.254775", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kMVBHE-MKor-jkJr-aiVw-nkym-Ks0A-zvDzVX", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:32.061521", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:58:33.470 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:33.480 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:33.492 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:33.634 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDlLO99pb4Q5YAwMmxddAVQdrsp4m4GrW2'], 'uuids': ['56f2a937-ff66-4401-ae97-6dcb5e7737ec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.184114", "end": "2021-10-20 23:58:33.606224", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDlLO99pb4Q5YAwMmxddAVQdrsp4m4GrW2"], "labels": [], "masters": [], "uuids": ["56f2a937-ff66-4401-ae97-6dcb5e7737ec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:32.422110", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:33.648 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:33.659 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.215 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-qCdOum-tpv5-fmNk-bu1h-LMsH-sXyP-1BQcVc', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN', 'nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.189509", "end": "2021-10-20 23:58:33.853171", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-qCdOum-tpv5-fmNk-bu1h-LMsH-sXyP-1BQcVc", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN", "nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:32.663662", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:58:34.217 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.228 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.359 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QcMRsS-cAU8-h4eD-KxUW-9X1c-EEMf-dNn3QG', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN', 'nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.206240", "end": "2021-10-20 23:58:34.021803", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-QcMRsS-cAU8-h4eD-KxUW-9X1c-EEMf-dNn3QG", "nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN", "nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:32.815563", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:58:34.369 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:34.374 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.376 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.773 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCGVxxWYPbhAqOCAr7kGWfmjEKKLPKrGlA'], 'uuids': ['1219d137-a470-4a5f-9e5d-395aa042e799']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.149207", "end": "2021-10-20 23:58:34.570007", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCGVxxWYPbhAqOCAr7kGWfmjEKKLPKrGlA"], "labels": [], "masters": [], "uuids": ["1219d137-a470-4a5f-9e5d-395aa042e799"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:33.420800", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:34.785 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.797 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.957 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDiqcIeqCT8zV3Rc0Rjhk2YKgOoABT4Tk8'], 'uuids': ['b3c9d047-1c72-4faa-873f-b1319a3671b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.142725", "end": "2021-10-20 23:58:34.936401", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDiqcIeqCT8zV3Rc0Rjhk2YKgOoABT4Tk8"], "labels": [], "masters": [], "uuids": ["b3c9d047-1c72-4faa-873f-b1319a3671b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:33.793676", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:34.959 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-E4U9kj-KmeP-3tuU-7neJ-0j9X-f7GT-rzmQeM', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN', 'nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.188084", "end": "2021-10-20 23:58:35.242349", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-E4U9kj-KmeP-3tuU-7neJ-0j9X-f7GT-rzmQeM", "nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN", "nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:34.054265", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-10-20T23:58:34.960 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:34.971 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.972 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:34.983 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:35.584 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpHJMLERc2oZgX2DHfSG23tn7c7MKEOmFB'], 'uuids': ['011d1d6c-9003-4edf-bdef-0b4d6a084a10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.221476", "end": "2021-10-20 23:58:35.221214", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpHJMLERc2oZgX2DHfSG23tn7c7MKEOmFB"], "labels": [], "masters": [], "uuids": ["011d1d6c-9003-4edf-bdef-0b4d6a084a10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:33.999738", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:35.586 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:35.598 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:35.766 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2gJj2VeLjAunoJPpYaxCRJMY33H2FyInh'], 'uuids': ['81f6b490-3e8a-4982-a6a1-82f4ffeb4734']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.249076", "end": "2021-10-20 23:58:35.428999", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2gJj2VeLjAunoJPpYaxCRJMY33H2FyInh"], "labels": [], "masters": [], "uuids": ["81f6b490-3e8a-4982-a6a1-82f4ffeb4734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:34.179923", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:35.778 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.085 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCkJgiTjhU0vHZHOvu5NcttohTJDAtAL3s'], 'uuids': ['c641872e-a48f-41a9-9d78-e5cc8b11a3e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.156284", "end": "2021-10-20 23:58:35.882207", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCkJgiTjhU0vHZHOvu5NcttohTJDAtAL3s"], "labels": [], "masters": [], "uuids": ["c641872e-a48f-41a9-9d78-e5cc8b11a3e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:34.725923", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:36.096 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.240 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD8uK9LriFW2Gw49XRoTS0byECgRJzsi7W'], 'uuids': ['44aebcc5-f431-493c-ad14-d4cddf69a6c7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.144475", "end": "2021-10-20 23:58:36.224884", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD8uK9LriFW2Gw49XRoTS0byECgRJzsi7W"], "labels": [], "masters": [], "uuids": ["44aebcc5-f431-493c-ad14-d4cddf69a6c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:35.080409", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:36.294 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:36 +0000 (0:00:06.075) 0:02:43.658 ***** 2021-10-20T23:58:36.306 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRQOgVfuvwvLTNTygrPl6et9GfXZecGB4D'], 'uuids': ['5c6b4e83-b6ea-4d82-aad6-fa044ebe4e4b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.150413", "end": "2021-10-20 23:58:36.555403", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRQOgVfuvwvLTNTygrPl6et9GfXZecGB4D"], "labels": [], "masters": [], "uuids": ["5c6b4e83-b6ea-4d82-aad6-fa044ebe4e4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:35.404990", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:36.308 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.310 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.554 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:36.556 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.862 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD5eGOM3VI2YBlXsKnlXOE7bZeOTEMPDDB'], 'uuids': ['7130fdf5-24aa-4b36-8574-ea2bbc7bc0b0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.161590", "end": "2021-10-20 23:58:36.834973", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD5eGOM3VI2YBlXsKnlXOE7bZeOTEMPDDB"], "labels": [], "masters": [], "uuids": ["7130fdf5-24aa-4b36-8574-ea2bbc7bc0b0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:36.673383", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156651 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156651 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:36.886 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.902 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:36.912 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:36.915 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpQmgWV1h0qKasb9IYMZF6yJbMSDkU5ePB'], 'uuids': ['c96a417b-1170-4dc2-bb7a-7f59573ca7e9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.162140", "end": "2021-10-20 23:58:36.540330", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpQmgWV1h0qKasb9IYMZF6yJbMSDkU5ePB"], "labels": [], "masters": [], "uuids": ["c96a417b-1170-4dc2-bb7a-7f59573ca7e9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:35.378190", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi102.front 2021-10-20T23:58:36.917 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.085 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2Q5GzVYhp4VcokPFB0lbwJDPONpMjiIVv'], 'uuids': ['2cc6c29f-5808-4e61-b7ad-a76290c0e160']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.174778", "end": "2021-10-20 23:58:36.752650", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2Q5GzVYhp4VcokPFB0lbwJDPONpMjiIVv"], "labels": [], "masters": [], "uuids": ["2cc6c29f-5808-4e61-b7ad-a76290c0e160"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:35.577872", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:37.097 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.196 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:37.199 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD9OYwrwIQObAi7pjPpE7N9S8diO6Gnk5N'], 'uuids': ['4264c7c0-70c4-4dd1-ac14-03384607d0a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.160320", "end": "2021-10-20 23:58:37.169506", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD9OYwrwIQObAi7pjPpE7N9S8diO6Gnk5N"], "labels": [], "masters": [], "uuids": ["4264c7c0-70c4-4dd1-ac14-03384607d0a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.009186", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15546 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15546 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:37.212 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S', 'wwn-0x5000c500871a27d9'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1', 'wwn-0x5000c500871a27d9-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a27d9', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HM0S', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S", "wwn-0x5000c500871a27d9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HM0S-part1", "wwn-0x5000c500871a27d9-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HM0S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a27d9"}}, 2021-10-20T23:58:37.215 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.362 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:37.364 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCFdE2XRSTfSKwHRujCPJUyzCfGBQeM21x'], 'uuids': ['f13b6d53-532d-4b2b-b09b-2e9f975f8eb5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.127299", "end": "2021-10-20 23:58:37.152389", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCFdE2XRSTfSKwHRujCPJUyzCfGBQeM21x"], "labels": [], "masters": [], "uuids": ["f13b6d53-532d-4b2b-b09b-2e9f975f8eb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:36.025090", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:37.404 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:37 +0000 (0:00:01.115) 0:02:44.773 ***** 2021-10-20T23:58:37.419 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:37.420 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-q7iuwz-TD65-i3KH-5E6r-2pfP-Gq3H-zoCcZD', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN', 'nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056745", "end": "2021-10-20 23:58:37.373600", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-q7iuwz-TD65-i3KH-5E6r-2pfP-Gq3H-zoCcZD", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003M400BGN", "nvme-nvme.8086-43564654353333313030334d34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.316855", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0516906 s, 2.2 GB/s", "std 2021-10-20T23:58:37.422 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0516906 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:37.423 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.424 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.503 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.561 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:37.563 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRBOLh6l2nT3wBxnzsxDLeeT9vd2mlB1od'], 'uuids': ['75d6f8e5-38e1-48ce-a7ed-2f4ce5c2a762']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.116362", "end": "2021-10-20 23:58:37.837011", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRBOLh6l2nT3wBxnzsxDLeeT9vd2mlB1od"], "labels": [], "masters": [], "uuids": ["75d6f8e5-38e1-48ce-a7ed-2f4ce5c2a762"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:36.720649", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:37.586 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.717 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:37.718 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDlLO99pb4Q5YAwMmxddAVQdrsp4m4GrW2'], 'uuids': ['56f2a937-ff66-4401-ae97-6dcb5e7737ec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.158523", "end": "2021-10-20 23:58:37.694280", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDlLO99pb4Q5YAwMmxddAVQdrsp4m4GrW2"], "labels": [], "masters": [], "uuids": ["56f2a937-ff66-4401-ae97-6dcb5e7737ec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.535757", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154778 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154778 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:37.720 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.733 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.970 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCugB4s9bI4ke6vTTopfK5iCdMFOv3T9a9'], 'uuids': ['5aac026d-18be-4066-a180-d4b90b4a6497']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.344949", "end": "2021-10-20 23:58:37.945535", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCugB4s9bI4ke6vTTopfK5iCdMFOv3T9a9"], "labels": [], "masters": [], "uuids": ["5aac026d-18be-4066-a180-d4b90b4a6497"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.600586", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165106 s, 699 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165106 s, 699 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:37.980 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:37.981 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.048 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDiqcIeqCT8zV3Rc0Rjhk2YKgOoABT4Tk8'], 'uuids': ['b3c9d047-1c72-4faa-873f-b1319a3671b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162906", "end": "2021-10-20 23:58:38.031684", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaDiqcIeqCT8zV3Rc0Rjhk2YKgOoABT4Tk8"], "labels": [], "masters": [], "uuids": ["b3c9d047-1c72-4faa-873f-b1319a3671b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.868778", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159104 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159104 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:38.070 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.178 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:38.179 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpeoXNDpNyqX3SC5KbJgjnquZjqALjOCP3'], 'uuids': ['392c3882-d445-4818-bc8d-707bb6f36d93']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.134206", "end": "2021-10-20 23:58:37.816506", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpeoXNDpNyqX3SC5KbJgjnquZjqALjOCP3"], "labels": [], "masters": [], "uuids": ["392c3882-d445-4818-bc8d-707bb6f36d93"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:36.682300", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:38.287 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCsFTyGsLbCayVHMlBqpI1hWIoYfhyb2Q0'], 'uuids': ['b4c2907e-d56e-4b1e-ad2f-6fe00539dce4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.173782", "end": "2021-10-20 23:58:38.257086", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCsFTyGsLbCayVHMlBqpI1hWIoYfhyb2Q0"], "labels": [], "masters": [], "uuids": ["b4c2907e-d56e-4b1e-ad2f-6fe00539dce4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.083304", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.168872 s, 683 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.168872 s, 683 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:38.298 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV', 'wwn-0x5000c50087b99812'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', 'wwn-0x5000c50087b99812-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b99812', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W5SV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, 2021-10-20T23:58:38.300 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.346 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:38.349 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:38.361 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:38.363 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD8uK9LriFW2Gw49XRoTS0byECgRJzsi7W'], 'uuids': ['44aebcc5-f431-493c-ad14-d4cddf69a6c7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.155792", "end": "2021-10-20 23:58:38.328734", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ufQW7g1e4PARCeLNGVPf7NJKpD1dNQaD8uK9LriFW2Gw49XRoTS0byECgRJzsi7W"], "labels": [], "masters": [], "uuids": ["44aebcc5-f431-493c-ad14-d4cddf69a6c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.172942", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150925 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150925 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:38.517 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2uIZSxxnJay9UIcxkmUNIhUyXSGWto1TZ'], 'uuids': ['44f25425-4506-4eae-b91f-bd7641d4ebce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.136728", "end": "2021-10-20 23:58:38.031869", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2uIZSxxnJay9UIcxkmUNIhUyXSGWto1TZ"], "labels": [], "masters": [], "uuids": ["44f25425-4506-4eae-b91f-bd7641d4ebce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:36.895141", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now 2021-10-20T23:58:38.519 INFO:teuthology.task.ansible.out:partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:38.532 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-kMVBHE-MKor-jkJr-aiVw-nkym-Ks0A-zvDzVX', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', 'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054803", "end": "2021-10-20 23:58:38.455493", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kMVBHE-MKor-jkJr-aiVw-nkym-Ks0A-zvDzVX", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.400690", "stderr": "110+0 records in\n110+0 2021-10-20T23:58:38.534 INFO:teuthology.task.ansible.out: records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0498893 s, 2.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0498893 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_ 2021-10-20T23:58:38.536 INFO:teuthology.task.ansible.out:discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.553 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:38 +0000 (0:00:01.148) 0:02:45.922 ***** 2021-10-20T23:58:38.577 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:38 +0000 (0:00:00.023) 0:02:45.946 ***** 2021-10-20T23:58:38.601 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:38 +0000 (0:00:00.024) 0:02:45.970 ***** 2021-10-20T23:58:38.688 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.709 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.797 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCGVxxWYPbhAqOCAr7kGWfmjEKKLPKrGlA'], 'uuids': ['1219d137-a470-4a5f-9e5d-395aa042e799']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.158678", "end": "2021-10-20 23:58:38.770494", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCGVxxWYPbhAqOCAr7kGWfmjEKKLPKrGlA"], "labels": [], "masters": [], "uuids": ["1219d137-a470-4a5f-9e5d-395aa042e799"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.611816", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15366 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15366 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:38.810 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.820 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:38.869 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi041.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.113767", "end": "2021-10-20 23:58:38.796336", "rc": 0, "start": "2021-10-20 23:58:38.682569", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** 2021-10-20T23:58:38.871 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRIwD3ue0EsXTX4EiFQl2ehBW5PjQNy0HP'], 'uuids': ['11f909ce-2c51-4c2c-8ede-af304364c85b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.152142", "end": "2021-10-20 23:58:39.149284", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRIwD3ue0EsXTX4EiFQl2ehBW5PjQNy0HP"], "labels": [], "masters": [], "uuids": ["11f909ce-2c51-4c2c-8ede-af304364c85b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:37.997142", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-10-20T23:58:38.898 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:38 +0000 (0:00:00.293) 0:02:46.264 ***** 2021-10-20T23:58:38.945 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:38 +0000 (0:00:00.048) 0:02:46.312 ***** 2021-10-20T23:58:39.002 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn20eRgR3T2hHYlg07lzk2OPKFgfVun2cPg'], 'uuids': ['79476aa1-dd3e-4e63-8eb5-14a4aa9a3289']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164834", "end": "2021-10-20 23:58:38.644072", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn20eRgR3T2hHYlg07lzk2OPKFgfVun2cPg"], "labels": [], "masters": [], "uuids": ["79476aa1-dd3e-4e63-8eb5-14a4aa9a3289"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.479238", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159981 s, 721 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159981 s, 721 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'remov 2021-10-20T23:58:39.004 INFO:teuthology.task.ansible.out:able': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.024 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpvGKS3fbK1o32ojHQCzwLXJF3pvJmAFI1'], 'uuids': ['120db64d-3223-44ee-8576-ebd85f5f9817']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164977", "end": "2021-10-20 23:58:38.647591", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpvGKS3fbK1o32ojHQCzwLXJF3pvJmAFI1"], "labels": [], "masters": [], "uuids": ["120db64d-3223-44ee-8576-ebd85f5f9817"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.482614", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160119 s, 720 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160119 s, 720 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.026 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.038 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.039 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.052 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.131 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCkJgiTjhU0vHZHOvu5NcttohTJDAtAL3s'], 'uuids': ['c641872e-a48f-41a9-9d78-e5cc8b11a3e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.163001", "end": "2021-10-20 23:58:39.090926", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCkJgiTjhU0vHZHOvu5NcttohTJDAtAL3s"], "labels": [], "masters": [], "uuids": ["c641872e-a48f-41a9-9d78-e5cc8b11a3e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.927925", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158201 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158201 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.143 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:58:39.145 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.090284", "end": "2021-10-20 23:58:39.113470", "rc": 0, "start": "2021-10-20 23:58:39.023186", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.169 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.225) 0:02:46.538 ***** 2021-10-20T23:58:39.242 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:58:39.323 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.153) 0:02:46.692 ***** 2021-10-20T23:58:39.344 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2yFeQWB9ZjsbMn4tsAxFWemGiLR2yO3et'], 'uuids': ['41268ead-823f-4ea6-9003-fd8125385024']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.171664", "end": "2021-10-20 23:58:38.987359", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2yFeQWB9ZjsbMn4tsAxFWemGiLR2yO3et"], "labels": [], "masters": [], "uuids": ["41268ead-823f-4ea6-9003-fd8125385024"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.815695", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16663 s, 692 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16663 s, 692 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN', 'wwn-0x5000c500918da8bc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize 2021-10-20T23:58:39.346 INFO:teuthology.task.ansible.out:': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1', 'wwn-0x5000c500918da8bc-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918da8bc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LHPN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN", "wwn-0x5000c500918da8bc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1", "wwn-0x5000c500918da8bc-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHPN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da8bc"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.348 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpBDGsyRVOz45F2jutp9zswNkLuk8B3SuB'], 'uuids': ['475762d8-ec97-4ac6-aedd-eefd361015a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167769", "end": "2021-10-20 23:58:38.982833", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpBDGsyRVOz45F2jutp9zswNkLuk8B3SuB"], "labels": [], "masters": [], "uuids": ["475762d8-ec97-4ac6-aedd-eefd361015a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:38.815064", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162713 s, 709 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162713 s, 709 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.350 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:39.352 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRkEfNAONUEcu0R5ebaRWsjudUUvIcEjfH'], 'uuids': ['8a5d7d2f-9c31-4e1a-8b92-064151ee770c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.162771", "end": "2021-10-20 23:58:39.622991", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRkEfNAONUEcu0R5ebaRWsjudUUvIcEjfH"], "labels": [], "masters": [], "uuids": ["8a5d7d2f-9c31-4e1a-8b92-064151ee770c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.460220", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157847 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157847 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.354 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.366 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM', 'wwn-0x5000c50091e0bcf8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1', 'wwn-0x5000c50091e0bcf8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bcf8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPPM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM", "wwn-0x5000c50091e0bcf8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1", "wwn-0x5000c50091e0bcf8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPPM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bcf8"}}, 2021-10-20T23:58:39.368 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.370 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.395 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.072) 0:02:46.764 ***** 2021-10-20T23:58:39.437 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCFdE2XRSTfSKwHRujCPJUyzCfGBQeM21x'], 'uuids': ['f13b6d53-532d-4b2b-b09b-2e9f975f8eb5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.164375", "end": "2021-10-20 23:58:39.408813", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ztfU352GbOBo8R4FslKBuo2ecSo63QvCFdE2XRSTfSKwHRujCPJUyzCfGBQeM21x"], "labels": [], "masters": [], "uuids": ["f13b6d53-532d-4b2b-b09b-2e9f975f8eb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.244438", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159496 s, 723 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159496 s, 723 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.472 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.076) 0:02:46.841 ***** 2021-10-20T23:58:39.496 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.024) 0:02:46.865 ***** 2021-10-20T23:58:39.503 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:39.505 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.535 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.038) 0:02:46.904 ***** 2021-10-20T23:58:39.550 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QcMRsS-cAU8-h4eD-KxUW-9X1c-EEMf-dNn3QG', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN', 'nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.060463", "end": "2021-10-20 23:58:39.189049", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-QcMRsS-cAU8-h4eD-KxUW-9X1c-EEMf-dNn3QG", "nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN", "nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.128586", "stderr": "110+0 records in\n110+0 2021-10-20T23:58:39.554 INFO:teuthology.task.ansible.out: records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0556421 s, 2.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0556421 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.558 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_ 2021-10-20T23:58:39.561 INFO:teuthology.task.ansible.out:discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.566 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-qCdOum-tpv5-fmNk-bu1h-LMsH-sXyP-1BQcVc', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN', 'nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.061751", "end": "2021-10-20 23:58:39.188332", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-qCdOum-tpv5-fmNk-bu1h-LMsH-sXyP-1BQcVc", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN", "nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.126581", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0568819 s, 2.0 GB/s", "std 2021-10-20T23:58:39.568 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0568819 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.569 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result wa 2021-10-20T23:58:39.570 INFO:teuthology.task.ansible.out:s False"} TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.599 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.064) 0:02:46.968 ***** 2021-10-20T23:58:39.681 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:39.683 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRUTlA2xzr1LwJPErv9YEyffQdMvwmGADh'], 'uuids': ['55a2fea4-300b-47c1-a157-9744489f9f56']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.170135", "end": "2021-10-20 23:58:39.946999", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRUTlA2xzr1LwJPErv9YEyffQdMvwmGADh"], "labels": [], "masters": [], "uuids": ["55a2fea4-300b-47c1-a157-9744489f9f56"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.776864", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165245 s, 698 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165245 s, 698 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.683 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJJR', 'wwn-0x5000c50091e19c4b'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], ' 2021-10-20T23:58:39.685 INFO:teuthology.task.ansible.out:labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1', 'wwn-0x5000c50091e19c4b-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e19c4b', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QJJR', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR", "wwn-0x5000c50091e19c4b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJJR-part1", "wwn-0x5000c50091e19c4b-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJJR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e19c4b"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.738 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:39.767 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.167) 0:02:47.136 ***** 2021-10-20T23:58:39.769 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:39.801 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-20T23:58:39.802 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.145334", "end": "2021-10-20 23:58:39.757313", "rc": 0, "start": "2021-10-20 23:58:39.611979", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.828 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.060) 0:02:47.197 ***** 2021-10-20T23:58:39.838 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:39.840 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'block_used': 14045283, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049825, 'size_available': 925900083200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049825, "block_size": 4096, "block_total": 240095108, "block_used": 14045283, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900083200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.840 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:39.841 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2gJj2VeLjAunoJPpYaxCRJMY33H2FyInh'], 'uuids': ['81f6b490-3e8a-4982-a6a1-82f4ffeb4734']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.170284", "end": "2021-10-20 23:58:39.510846", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2gJj2VeLjAunoJPpYaxCRJMY33H2FyInh"], "labels": [], "masters": [], "uuids": ["81f6b490-3e8a-4982-a6a1-8 2021-10-20T23:58:39.842 INFO:teuthology.task.ansible.out:2f4ffeb4734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.340562", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166488 s, 693 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166488 s, 693 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.873 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.043) 0:02:47.241 ***** 2021-10-20T23:58:39.881 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.882 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.884 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpHJMLERc2oZgX2DHfSG23tn7c7MKEOmFB'], 'uuids': ['011d1d6c-9003-4edf-bdef-0b4d6a084a10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.163656", "end": "2021-10-20 23:58:39.501265", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpHJMLERc2oZgX2DHfSG23tn7c7MKEOmFB"], "labels": [], "masters": [], "uuids": ["011d1d6c-9003-4edf-bdef-0b4d6a084a10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.337609", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159821 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159821 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:39.890 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-E4U9kj-KmeP-3tuU-7neJ-0j9X-f7GT-rzmQeM', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN', 'nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059523", "end": "2021-10-20 23:58:40.156914", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-E4U9kj-KmeP-3tuU-7neJ-0j9X-f7GT-rzmQeM", "nvme-INTEL_SSDPEDMD400G4_PHFT62040172400BGN", "nvme-nvme.8086-50484654363230343031373234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.097391", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0544595 s, 2.1 GB/s", "std 2021-10-20T23:58:39.892 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0544595 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.902 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.903 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.906 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.919 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:39.944 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:39 +0000 (0:00:00.072) 0:02:47.313 ***** 2021-10-20T23:58:39.983 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:39.985 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.007 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.062) 0:02:47.376 ***** 2021-10-20T23:58:40.035 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:40.040 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.060 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.052) 0:02:47.428 ***** 2021-10-20T23:58:40.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.114 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.054) 0:02:47.483 ***** 2021-10-20T23:58:40.122 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:58:40.123 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.086450", "end": "2021-10-20 23:58:40.082369", "rc": 0, "start": "2021-10-20 23:58:39.995919", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.149 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.034) 0:02:47.518 ***** 2021-10-20T23:58:40.156 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-20T23:58:40.158 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.184 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.035) 0:02:47.553 ***** 2021-10-20T23:58:40.193 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:58:40.194 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:40.196 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2Q5GzVYhp4VcokPFB0lbwJDPONpMjiIVv'], 'uuids': ['2cc6c29f-5808-4e61-b7ad-a76290c0e160']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.172939", "end": "2021-10-20 23:58:39.857218", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2Q5GzVYhp4VcokPFB0lbwJDPONpMjiIVv"], "labels": [], "masters": [], "uuids": ["2cc6c29f-5808-4e61-b7ad-a76290c0e160"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.684279", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167841 s, 687 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167841 s, 687 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.232 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.045) 0:02:47.598 ***** 2021-10-20T23:58:40.253 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.255 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRQOgVfuvwvLTNTygrPl6et9GfXZecGB4D'], 'uuids': ['5c6b4e83-b6ea-4d82-aad6-fa044ebe4e4b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.176369", "end": "2021-10-20 23:58:40.504443", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRQOgVfuvwvLTNTygrPl6et9GfXZecGB4D"], "labels": [], "masters": [], "uuids": ["5c6b4e83-b6ea-4d82-aad6-fa044ebe4e4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.328074", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.171567 s, 672 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.171567 s, 672 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.256 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpQmgWV1h0qKasb9IYMZF6yJbMSDkU5ePB'], 'uuids': ['c96a417b-1170-4dc2-bb7a-7f59573ca7e9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.181693", "end": "2021-10-20 23:58:39.855186", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpQmgWV1h0qKasb9IYMZF6yJbMSDkU5ePB"], "labels": [], "masters": [], "uuids": ["c96a417b-1170-4dc2-bb7a-7f59573ca7e9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:39.673493", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.176788 s, 652 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.176788 s, 652 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.259 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 2021-10-20T23:58:40.261 INFO:teuthology.task.ansible.out:'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": 2021-10-20T23:58:40.265 INFO:teuthology.task.ansible.out:{"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.285 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.055) 0:02:47.654 ***** 2021-10-20T23:58:40.294 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.325 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.040) 0:02:47.694 ***** 2021-10-20T23:58:40.357 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.382 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.057) 0:02:47.751 ***** 2021-10-20T23:58:40.426 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:40.431 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.455 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.072) 0:02:47.824 ***** 2021-10-20T23:58:40.495 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-20T23:58:40.498 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.520 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.064) 0:02:47.889 ***** 2021-10-20T23:58:40.527 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:40.528 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2uIZSxxnJay9UIcxkmUNIhUyXSGWto1TZ'], 'uuids': ['44f25425-4506-4eae-b91f-bd7641d4ebce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.166239", "end": "2021-10-20 23:58:40.169012", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QQgjDBsshfFmfMxHH4dIQZw9843oFdn2uIZSxxnJay9UIcxkmUNIhUyXSGWto1TZ"], "labels": [], "masters": [], "uuids": ["44f25425-4506-4eae-b91f-bd7641d4ebce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.002773", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161346 s, 715 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161346 s, 715 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.549 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpeoXNDpNyqX3SC5KbJgjnquZjqALjOCP3'], 'uuids': ['392c3882-d445-4818-bc8d-707bb6f36d93']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.172559", "end": "2021-10-20 23:58:40.181833", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-VQ10gyI0gVwjhUyXCLzuO7O6decnfScpeoXNDpNyqX3SC5KbJgjnquZjqALjOCP3"], "labels": [], "masters": [], "uuids": ["392c3882-d445-4818-bc8d-707bb6f36d93"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.009274", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167728 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167728 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.563 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRBOLh6l2nT3wBxnzsxDLeeT9vd2mlB1od'], 'uuids': ['75d6f8e5-38e1-48ce-a7ed-2f4ce5c2a762']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.164287", "end": "2021-10-20 23:58:40.828135", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRBOLh6l2nT3wBxnzsxDLeeT9vd2mlB1od"], "labels": [], "masters": [], "uuids": ["75d6f8e5-38e1-48ce-a7ed-2f4ce5c2a762"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.663848", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159271 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159271 s, 724 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 2021-10-20T23:58:40.565 INFO:teuthology.task.ansible.out:'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.588 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.068) 0:02:47.957 ***** 2021-10-20T23:58:40.618 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.029) 0:02:47.987 ***** 2021-10-20T23:58:40.657 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:40.693 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.075) 0:02:48.062 ***** 2021-10-20T23:58:40.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi062.front.sepia.ceph.com] => (item={'block_used': 14045280, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049828, 'size_available': 925900095488, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049828, "block_size": 4096, "block_total": 240095108, "block_used": 14045280, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900095488, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.778 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.084) 0:02:48.147 ***** 2021-10-20T23:58:40.820 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.850 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.071) 0:02:48.219 ***** 2021-10-20T23:58:40.862 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-10-20T23:58:40.864 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRIwD3ue0EsXTX4EiFQl2ehBW5PjQNy0HP'], 'uuids': ['11f909ce-2c51-4c2c-8ede-af304364c85b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.160835", "end": "2021-10-20 23:58:41.129653", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-U0QlMx1XVyZJ0B3hB9h6UnvyXkrItTyRIwD3ue0EsXTX4EiFQl2ehBW5PjQNy0HP"], "labels": [], "masters": [], "uuids": ["11f909ce-2c51-4c2c-8ede-af304364c85b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-10-20 23:58:40.968818", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15598 s, 739 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15598 s, 739 MB/s"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.904 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.054) 0:02:48.273 ***** 2021-10-20T23:58:40.912 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:40.914 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:40.915 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141295", "end": "2021-10-20 23:58:40.557454", "rc": 0, "start": "2021-10-20 23:58:40.416159", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:40.948 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.040) 0:02:48.314 ***** 2021-10-20T23:58:40.973 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:40 +0000 (0:00:00.027) 0:02:48.342 ***** 2021-10-20T23:58:40.981 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-20T23:58:40.983 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:58:40.984 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141719", "end": "2021-10-20 23:58:40.580918", "rc": 0, "start": "2021-10-20 23:58:40.439199", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:41.024 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.050) 0:02:48.392 ***** 2021-10-20T23:58:41.051 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.028) 0:02:48.420 ***** 2021-10-20T23:58:41.063 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.094 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.042) 0:02:48.463 ***** 2021-10-20T23:58:41.138 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-10-20T23:58:41.140 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.176 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.074) 0:02:48.538 ***** 2021-10-20T23:58:41.187 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-10-20T23:58:41.189 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.129677", "end": "2021-10-20 23:58:41.470100", "rc": 0, "start": "2021-10-20 23:58:41.340423", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:41.213 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.044) 0:02:48.583 ***** 2021-10-20T23:58:41.222 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.251 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.037) 0:02:48.620 ***** 2021-10-20T23:58:41.263 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.096158", "end": "2021-10-20 23:58:40.886531", "rc": 0, "start": "2021-10-20 23:58:40.790373", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:41.293 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.041) 0:02:48.662 ***** 2021-10-20T23:58:41.296 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-10-20T23:58:41.307 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.333 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.039) 0:02:48.702 ***** 2021-10-20T23:58:41.342 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.090944", "end": "2021-10-20 23:58:40.950009", "rc": 0, "start": "2021-10-20 23:58:40.859065", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:41.345 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:58:41.378 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.044) 0:02:48.747 ***** 2021-10-20T23:58:41.402 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.023) 0:02:48.770 ***** 2021-10-20T23:58:41.410 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-10-20T23:58:41.412 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.445 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.043) 0:02:48.814 ***** 2021-10-20T23:58:41.454 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-10-20T23:58:41.489 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.040) 0:02:48.854 ***** 2021-10-20T23:58:41.497 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-10-20T23:58:41.499 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.086939", "end": "2021-10-20 23:58:41.739125", "rc": 0, "start": "2021-10-20 23:58:41.652186", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-10-20T23:58:41.500 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.541 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.043) 0:02:48.897 ***** 2021-10-20T23:58:41.559 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.023) 0:02:48.921 ***** 2021-10-20T23:58:41.561 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.566 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:41.592 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.040) 0:02:48.961 ***** 2021-10-20T23:58:41.628 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.035) 0:02:48.997 ***** 2021-10-20T23:58:41.635 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:41.637 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.038) 0:02:49.035 ***** 2021-10-20T23:58:41.697 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.028) 0:02:49.064 ***** 2021-10-20T23:58:41.704 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.712 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.038) 0:02:49.103 ***** 2021-10-20T23:58:41.759 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.025) 0:02:49.128 ***** 2021-10-20T23:58:41.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-20T23:58:41.768 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.039) 0:02:49.168 ***** 2021-10-20T23:58:41.825 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.024) 0:02:49.192 ***** 2021-10-20T23:58:41.833 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.835 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:41.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.044) 0:02:49.236 ***** 2021-10-20T23:58:41.904 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.035) 0:02:49.272 ***** 2021-10-20T23:58:41.911 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-20T23:58:41.916 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:58:41.950 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:41 +0000 (0:00:00.046) 0:02:49.319 ***** 2021-10-20T23:58:41.971 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-10-20T23:58:41.973 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:42.007 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.055) 0:02:49.375 ***** 2021-10-20T23:58:42.039 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.033) 0:02:49.408 ***** 2021-10-20T23:58:42.047 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:42.048 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-10-20T23:58:42.049 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:42.098 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.055) 0:02:49.464 ***** 2021-10-20T23:58:42.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:42.106 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'block_used': 14045272, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049836, 'size_available': 925900128256, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049836, "block_size": 4096, "block_total": 240095108, "block_used": 14045272, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900128256, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.144 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.048) 0:02:49.513 ***** 2021-10-20T23:58:42.183 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-10-20T23:58:42.185 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.209 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.065) 0:02:49.578 ***** 2021-10-20T23:58:42.217 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:42.219 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'block_used': 14045278, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049830, 'size_available': 925900103680, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049830, "block_size": 4096, "block_total": 240095108, "block_used": 14045278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900103680, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.221 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-10-20T23:58:42.250 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.039) 0:02:49.618 ***** 2021-10-20T23:58:42.279 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.024) 0:02:49.643 ***** 2021-10-20T23:58:42.289 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.320 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.040) 0:02:49.683 ***** 2021-10-20T23:58:42.324 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.354 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.039) 0:02:49.723 ***** 2021-10-20T23:58:42.363 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-10-20T23:58:42.367 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'block_used': 14045287, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226049821, 'size_available': 925900066816, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226049821, "block_size": 4096, "block_total": 240095108, "block_used": 14045287, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925900066816, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.406 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.052) 0:02:49.775 ***** 2021-10-20T23:58:42.469 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.062) 0:02:49.838 ***** 2021-10-20T23:58:42.479 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:42.480 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:42.481 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:42.482 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:42.484 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.515 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.042) 0:02:49.880 ***** 2021-10-20T23:58:42.543 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.029) 0:02:49.910 ***** 2021-10-20T23:58:42.552 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.580 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.039) 0:02:49.949 ***** 2021-10-20T23:58:42.622 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.040) 0:02:49.989 ***** 2021-10-20T23:58:42.629 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-20T23:58:42.631 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.664 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.043) 0:02:50.033 ***** 2021-10-20T23:58:42.672 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:42.674 INFO:teuthology.task.ansible.out:TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.707 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.042) 0:02:50.076 ***** 2021-10-20T23:58:42.735 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.027) 0:02:50.103 ***** 2021-10-20T23:58:42.744 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-10-20T23:58:42.746 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.774 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.039) 0:02:50.143 ***** 2021-10-20T23:58:42.786 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.814 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.039) 0:02:50.183 ***** 2021-10-20T23:58:42.852 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.037) 0:02:50.221 ***** 2021-10-20T23:58:42.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:42.861 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.900 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.046) 0:02:50.267 ***** 2021-10-20T23:58:42.907 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:42.908 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:42.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:42.940 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:42 +0000 (0:00:00.041) 0:02:50.309 ***** 2021-10-20T23:58:42.983 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-10-20T23:58:42.985 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:43.010 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.070) 0:02:50.379 ***** 2021-10-20T23:58:43.050 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:43.075 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.065) 0:02:50.444 ***** 2021-10-20T23:58:43.077 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:43.234 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:43.235 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:43.237 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:43.271 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.196) 0:02:50.640 ***** 2021-10-20T23:58:43.337 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-20T23:58:43.339 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:58:43.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.093) 0:02:50.734 ***** 2021-10-20T23:58:43.418 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:43.420 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:43.420 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:58:43.451 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.086) 0:02:50.820 ***** 2021-10-20T23:58:43.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-20T23:58:43.475 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:58:43.500 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.048) 0:02:50.869 ***** 2021-10-20T23:58:43.615 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:43.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:43.628 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:43.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-10-20T23:58:43.654 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-10-20T23:58:43.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:43 +0000 (0:00:00.179) 0:02:51.048 ***** 2021-10-20T23:58:43.742 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:43.744 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:43.872 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:43.886 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:43.928 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:43.983 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:43.985 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:43.995 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:44.027 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.347) 0:02:51.396 ***** 2021-10-20T23:58:44.046 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:44.047 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.076 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.047) 0:02:51.444 ***** 2021-10-20T23:58:44.086 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:44.114 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.039) 0:02:51.483 ***** 2021-10-20T23:58:44.150 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-10-20T23:58:44.152 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:44.178 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.064) 0:02:51.548 ***** 2021-10-20T23:58:44.189 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:44.191 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.237 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:44.238 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:58:44.263 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.084) 0:02:51.632 ***** 2021-10-20T23:58:44.282 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:44.284 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.328 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-20T23:58:44.329 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:44.365 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.094) 0:02:51.727 ***** 2021-10-20T23:58:44.367 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:58:44.442 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.079) 0:02:51.806 ***** 2021-10-20T23:58:44.469 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:44.471 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:44.581 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:44.583 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.594 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:44.599 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:44.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:44.673 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:44.739 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:44.741 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:44.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:44.892 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:44.924 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.486) 0:02:52.293 ***** 2021-10-20T23:58:44.953 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-10-20T23:58:44.956 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:44.978 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:44 +0000 (0:00:00.054) 0:02:52.347 ***** 2021-10-20T23:58:44.988 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi041.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.016 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.038) 0:02:52.385 ***** 2021-10-20T23:58:45.026 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:45.053 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.036) 0:02:52.422 ***** 2021-10-20T23:58:45.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:45.108 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.206 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:45.241 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.187) 0:02:52.610 ***** 2021-10-20T23:58:45.265 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:45.267 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.279 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-20T23:58:45.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:58:45.306 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.061) 0:02:52.672 ***** 2021-10-20T23:58:45.385 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:45.387 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.484 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.511 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.207) 0:02:52.880 ***** 2021-10-20T23:58:45.520 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:58:45.546 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.034) 0:02:52.915 ***** 2021-10-20T23:58:45.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi062.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:58:45.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.062) 0:02:52.977 ***** 2021-10-20T23:58:45.642 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.033) 0:02:53.010 ***** 2021-10-20T23:58:45.650 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:45.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:58:45.688 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.046) 0:02:53.057 ***** 2021-10-20T23:58:45.721 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.027) 0:02:53.084 ***** 2021-10-20T23:58:45.738 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.022) 0:02:53.107 ***** 2021-10-20T23:58:45.746 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-20T23:58:45.748 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:45.775 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.036) 0:02:53.143 ***** 2021-10-20T23:58:45.803 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-10-20T23:58:45.805 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-10-20T23:58:45.807 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:45.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.059) 0:02:53.203 ***** 2021-10-20T23:58:45.861 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.025) 0:02:53.229 ***** 2021-10-20T23:58:45.879 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:45.881 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:45.883 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-10-20T23:58:45.883 INFO:teuthology.task.ansible.out:TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-10-20T23:58:45.884 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:58:45.913 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.053) 0:02:53.282 ***** 2021-10-20T23:58:45.937 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.023) 0:02:53.306 ***** 2021-10-20T23:58:45.945 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:45.947 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-20T23:58:45.949 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:45.978 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:45 +0000 (0:00:00.037) 0:02:53.344 ***** 2021-10-20T23:58:46.014 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:46.035 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.060) 0:02:53.404 ***** 2021-10-20T23:58:46.074 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.038) 0:02:53.443 ***** 2021-10-20T23:58:46.089 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-10-20T23:58:46.091 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:46.092 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.118 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.044) 0:02:53.487 ***** 2021-10-20T23:58:46.126 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.127 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.154 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.035) 0:02:53.523 ***** 2021-10-20T23:58:46.172 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-10-20T23:58:46.174 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.195 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.222 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.068) 0:02:53.591 ***** 2021-10-20T23:58:46.231 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-20T23:58:46.232 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:46.263 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.039) 0:02:53.631 ***** 2021-10-20T23:58:46.274 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.296 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.297 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.311 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.340 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.078) 0:02:53.709 ***** 2021-10-20T23:58:46.361 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.362 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:46.373 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-10-20T23:58:46.375 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.405 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.063) 0:02:53.773 ***** 2021-10-20T23:58:46.423 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-20T23:58:46.425 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.453 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.049) 0:02:53.822 ***** 2021-10-20T23:58:46.455 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:46.463 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-10-20T23:58:46.465 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.500 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.045) 0:02:53.868 ***** 2021-10-20T23:58:46.509 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.520 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.554 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.053) 0:02:53.922 ***** 2021-10-20T23:58:46.566 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-10-20T23:58:46.593 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.622 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.069) 0:02:53.991 ***** 2021-10-20T23:58:46.641 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:46.664 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.042) 0:02:54.033 ***** 2021-10-20T23:58:46.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-10-20T23:58:46.674 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:58:46.675 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-10-20T23:58:46.688 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.690 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.718 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.053) 0:02:54.087 ***** 2021-10-20T23:58:46.742 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.024) 0:02:54.111 ***** 2021-10-20T23:58:46.769 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.026) 0:02:54.138 ***** 2021-10-20T23:58:46.775 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:46.819 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.045) 0:02:54.184 ***** 2021-10-20T23:58:46.823 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-20T23:58:46.824 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:58:46.854 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.039) 0:02:54.223 ***** 2021-10-20T23:58:46.874 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.901 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.046) 0:02:54.270 ***** 2021-10-20T23:58:46.941 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:46.943 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:46.975 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:46 +0000 (0:00:00.074) 0:02:54.344 ***** 2021-10-20T23:58:47.012 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.036) 0:02:54.381 ***** 2021-10-20T23:58:47.031 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-10-20T23:58:47.033 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:58:47.058 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.046) 0:02:54.427 ***** 2021-10-20T23:58:47.076 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-10-20T23:58:47.083 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:58:47.154 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.090) 0:02:54.517 ***** 2021-10-20T23:58:47.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:58:47.204 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.052) 0:02:54.570 ***** 2021-10-20T23:58:47.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi099.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:58:47.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.084) 0:02:54.654 ***** 2021-10-20T23:58:47.326 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.036) 0:02:54.691 ***** 2021-10-20T23:58:47.368 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:58:47.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-10-20T23:58:47.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.079) 0:02:54.770 ***** 2021-10-20T23:58:47.426 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.024) 0:02:54.794 ***** 2021-10-20T23:58:47.546 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-10-20T23:58:47.548 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:58:47.573 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.147) 0:02:54.942 ***** 2021-10-20T23:58:47.583 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-20T23:58:47.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:58:47.613 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.038) 0:02:54.981 ***** 2021-10-20T23:58:47.621 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-20T23:58:47.623 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:47.654 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.042) 0:02:55.023 ***** 2021-10-20T23:58:47.661 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-10-20T23:58:47.663 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:58:47.699 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.042) 0:02:55.066 ***** 2021-10-20T23:58:47.715 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi102.front.sepia.ceph.com] => {"changed": true} 2021-10-20T23:58:47.739 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.041) 0:02:55.108 ***** 2021-10-20T23:58:47.763 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.024) 0:02:55.132 ***** 2021-10-20T23:58:47.818 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.044) 0:02:55.176 ***** 2021-10-20T23:58:47.867 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.059) 0:02:55.236 ***** 2021-10-20T23:58:47.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-20T23:58:47.878 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:47.920 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.053) 0:02:55.289 ***** 2021-10-20T23:58:47.930 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:47.931 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-10-20T23:58:47.932 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:47.960 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.039) 0:02:55.329 ***** 2021-10-20T23:58:47.993 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:47 +0000 (0:00:00.026) 0:02:55.355 ***** 2021-10-20T23:58:47.995 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-10-20T23:58:47.996 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.037 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.051) 0:02:55.406 ***** 2021-10-20T23:58:48.048 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-10-20T23:58:48.074 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.035) 0:02:55.442 ***** 2021-10-20T23:58:48.095 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.119 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.046) 0:02:55.488 ***** 2021-10-20T23:58:48.126 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-10-20T23:58:48.128 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.155 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.035) 0:02:55.524 ***** 2021-10-20T23:58:48.158 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:48.175 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:48.203 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.046) 0:02:55.570 ***** 2021-10-20T23:58:48.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-10-20T23:58:48.210 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.241 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.038) 0:02:55.609 ***** 2021-10-20T23:58:48.272 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-10-20T23:58:48.273 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.137484", "end": "2021-10-20 23:58:48.252500", "rc": 0, "start": "2021-10-20 23:58:48.115016", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.300 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.060) 0:02:55.669 ***** 2021-10-20T23:58:48.335 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.034) 0:02:55.704 ***** 2021-10-20T23:58:48.343 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-20T23:58:48.345 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:58:48.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-20T23:58:48.346 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.372 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.037) 0:02:55.741 ***** 2021-10-20T23:58:48.400 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.028) 0:02:55.769 ***** 2021-10-20T23:58:48.423 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.022) 0:02:55.792 ***** 2021-10-20T23:58:48.432 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.434 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.461 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.038) 0:02:55.830 ***** 2021-10-20T23:58:48.489 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.027) 0:02:55.858 ***** 2021-10-20T23:58:48.523 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.033) 0:02:55.892 ***** 2021-10-20T23:58:48.585 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-10-20T23:58:48.590 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:48.617 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.094) 0:02:55.986 ***** 2021-10-20T23:58:48.659 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-10-20T23:58:48.661 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.100151", "end": "2021-10-20 23:58:48.624296", "rc": 0, "start": "2021-10-20 23:58:48.524145", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:58:48.688 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.070) 0:02:56.057 ***** 2021-10-20T23:58:48.696 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-10-20T23:58:48.698 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:48.727 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.038) 0:02:56.096 ***** 2021-10-20T23:58:48.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-20T23:58:48.736 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.771 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.044) 0:02:56.140 ***** 2021-10-20T23:58:48.818 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-10-20T23:58:48.820 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:48.845 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.073) 0:02:56.214 ***** 2021-10-20T23:58:48.903 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:58:48.928 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.082) 0:02:56.297 ***** 2021-10-20T23:58:48.937 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-10-20T23:58:48.939 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:58:48.969 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:48 +0000 (0:00:00.040) 0:02:56.338 ***** 2021-10-20T23:58:49.038 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:58:49.072 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.103) 0:02:56.441 ***** 2021-10-20T23:58:49.165 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-20T23:58:49.166 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:49.195 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.122) 0:02:56.564 ***** 2021-10-20T23:58:49.227 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-10-20T23:58:49.229 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:49.251 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.056) 0:02:56.620 ***** 2021-10-20T23:58:49.313 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-10-20T23:58:49.315 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-10-20T23:58:49.342 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.089) 0:02:56.710 ***** 2021-10-20T23:58:49.358 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-20T23:58:49.363 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:58:49.387 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.046) 0:02:56.756 ***** 2021-10-20T23:58:49.450 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:58:49.476 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.089) 0:02:56.845 ***** 2021-10-20T23:58:49.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-20T23:58:49.558 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:58:49.584 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.107) 0:02:56.953 ***** 2021-10-20T23:58:49.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:58:49.615 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:49.641 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.056) 0:02:57.010 ***** 2021-10-20T23:58:49.666 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.024) 0:02:57.034 ***** 2021-10-20T23:58:49.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-20T23:58:49.674 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:49.704 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.038) 0:02:57.073 ***** 2021-10-20T23:58:49.716 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-10-20T23:58:49.719 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-10-20T23:58:49.745 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.040) 0:02:57.114 ***** 2021-10-20T23:58:49.925 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:58:49.927 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:10 UTC", "ActiveEnterTimestampMonotonic": "17902025", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount basic.target system.slice sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:09 UTC", "AssertTimestampMonotonic": "17621652", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:09 UTC", "ConditionTimestampMonotonic": "17621651", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-10-20T23:58:49.928 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "837", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:10 UTC", "ExecMainStartTimestampMonotonic": "17902012", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:09 UTC", "InactiveExitTimestampMonotonic": "17622719", "InvocationID": "3aba62d7eba14ea4b091341ded35efc3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:58:49.930 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127797", "LimitNPROCSoft": "127797", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "837", "MemoryAccounting": "yes", "MemoryCurrent": "3579904", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-10-20T23:58:49.932 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:10 UTC", "StateChangeTimestampMonotonic": "17902025", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38339", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:49.969 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:49 +0000 (0:00:00.221) 0:02:57.335 ***** 2021-10-20T23:58:49.997 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:49.999 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:58:50.024 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.056) 0:02:57.392 ***** 2021-10-20T23:58:50.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:58:50.044 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:58:50.073 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.049) 0:02:57.442 ***** 2021-10-20T23:58:50.083 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:50.086 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:58:50.110 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.037) 0:02:57.479 ***** 2021-10-20T23:58:50.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-10-20T23:58:50.122 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:50.145 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.034) 0:02:57.514 ***** 2021-10-20T23:58:50.171 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.025) 0:02:57.540 ***** 2021-10-20T23:58:50.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-20T23:58:50.180 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:50.210 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.039) 0:02:57.579 ***** 2021-10-20T23:58:50.237 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.025) 0:02:57.604 ***** 2021-10-20T23:58:50.365 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:58:50.368 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:19 UTC", "ActiveEnterTimestampMonotonic": "14505474", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sysinit.target -.mount network.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:19 UTC", "AssertTimestampMonotonic": "14333249", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:19 UTC", "ConditionTimestampMonotonic": "14333248", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-10-20T23:58:50.372 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "832", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:19 UTC", "ExecMainStartTimestampMonotonic": "14505461", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:19 UTC", "InactiveExitTimestampMonotonic": "14334169", "InvocationID": "222e2d6815e5458281da140c0fad4a68", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:58:50.373 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "832", "MemoryAccounting": "yes", "MemoryCurrent": "3526656", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-10-20T23:58:50.375 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:19 UTC", "StateChangeTimestampMonotonic": "14505474", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38332", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:50.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.165) 0:02:57.770 ***** 2021-10-20T23:58:50.436 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-10-20T23:58:50.438 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.114651", "end": "2021-10-20 23:58:50.109469", "rc": 0, "start": "2021-10-20 23:58:49.994818", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:58:50.464 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.063) 0:02:57.833 ***** 2021-10-20T23:58:50.491 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.023) 0:02:57.857 ***** 2021-10-20T23:58:50.496 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:50.497 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:58:50.543 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.051) 0:02:57.909 ***** 2021-10-20T23:58:50.552 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.135342", "end": "2021-10-20 23:58:50.508050", "rc": 0, "start": "2021-10-20 23:58:50.372708", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:58:50.754 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.212) 0:02:58.122 ***** 2021-10-20T23:58:50.778 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.025) 0:02:58.147 ***** 2021-10-20T23:58:50.805 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:58:50.833 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.055) 0:02:58.202 ***** 2021-10-20T23:58:50.845 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:50.847 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.139347", "end": "2021-10-20 23:58:50.436325", "rc": 0, "start": "2021-10-20 23:58:50.296978", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-10-20T23:58:50.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:50.876 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.043) 0:02:58.245 ***** 2021-10-20T23:58:50.906 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.029) 0:02:58.275 ***** 2021-10-20T23:58:50.935 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.028) 0:02:58.304 ***** 2021-10-20T23:58:50.941 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-20T23:58:50.943 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:50.983 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:50 +0000 (0:00:00.047) 0:02:58.351 ***** 2021-10-20T23:58:51.013 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.030) 0:02:58.382 ***** 2021-10-20T23:58:51.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-10-20T23:58:51.035 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.067 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.054) 0:02:58.436 ***** 2021-10-20T23:58:51.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.146 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.078) 0:02:58.515 ***** 2021-10-20T23:58:51.264 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-20T23:58:51.265 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:58:51.290 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.144) 0:02:58.659 ***** 2021-10-20T23:58:51.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:58:51.338 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.362 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.071) 0:02:58.731 ***** 2021-10-20T23:58:51.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-20T23:58:51.569 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:51.609 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.247) 0:02:58.978 ***** 2021-10-20T23:58:51.617 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:58:51.656 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.047) 0:02:59.025 ***** 2021-10-20T23:58:51.658 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:51.688 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-10-20T23:58:51.690 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.726 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.069) 0:02:59.095 ***** 2021-10-20T23:58:51.738 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-10-20T23:58:51.741 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:51.786 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.059) 0:02:59.155 ***** 2021-10-20T23:58:51.819 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.847 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.060) 0:02:59.215 ***** 2021-10-20T23:58:51.880 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:58:51.913 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.066) 0:02:59.282 ***** 2021-10-20T23:58:51.923 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:51.964 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:51.997 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:51 +0000 (0:00:00.080) 0:02:59.363 ***** 2021-10-20T23:58:52.097 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:58:52.131 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.131) 0:02:59.494 ***** 2021-10-20T23:58:52.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-10-20T23:58:52.135 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:58:52.162 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.036) 0:02:59.531 ***** 2021-10-20T23:58:52.185 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.023) 0:02:59.554 ***** 2021-10-20T23:58:52.204 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:58:52.206 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.238 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.050) 0:02:59.605 ***** 2021-10-20T23:58:52.250 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.287 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.051) 0:02:59.656 ***** 2021-10-20T23:58:52.312 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:58:52.339 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.051) 0:02:59.708 ***** 2021-10-20T23:58:52.373 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-10-20T23:58:52.408 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.068) 0:02:59.777 ***** 2021-10-20T23:58:52.420 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-10-20T23:58:52.422 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.451 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.040) 0:02:59.818 ***** 2021-10-20T23:58:52.457 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.485 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.036) 0:02:59.854 ***** 2021-10-20T23:58:52.492 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-20T23:58:52.493 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:52.533 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.047) 0:02:59.902 ***** 2021-10-20T23:58:52.542 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:58:52.544 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:34 UTC", "ActiveEnterTimestampMonotonic": "14154398", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service basic.target system.slice network.target sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:34 UTC", "AssertTimestampMonotonic": "14017510", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:34 UTC", "ConditionTimestampMonotonic": "14017509", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-10-20T23:58:52.547 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "829", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:34 UTC", "ExecMainStartTimestampMonotonic": "14154382", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:34 UTC", "InactiveExitTimestampMonotonic": "14018512", "InvocationID": "76d35875ad414271a2ef3490ba06b836", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:58:52.548 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127772", "LimitNPROCSoft": "127772", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "829", "MemoryAccounting": "yes", "MemoryCurrent": "3559424", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-10-20T23:58:52.553 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:34 UTC", "StateChangeTimestampMonotonic": "14154398", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:58:52.583 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.039) 0:02:59.941 ***** 2021-10-20T23:58:52.613 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:52.615 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:58:52.643 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.070) 0:03:00.012 ***** 2021-10-20T23:58:52.682 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:58:52.684 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:28 UTC", "ActiveEnterTimestampMonotonic": "14478209", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-journald.socket sysinit.target network.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:28 UTC", "AssertTimestampMonotonic": "14265590", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:28 UTC", "ConditionTimestampMonotonic": "14265589", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-10-20T23:58:52.685 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "827", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:28 UTC", "ExecMainStartTimestampMonotonic": "14478194", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:28 UTC", "InactiveExitTimestampMonotonic": "14266533", "InvocationID": "3b31e557b72d476691ea6863464860a4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:58:52.687 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "827", "MemoryAccounting": "yes", "MemoryCurrent": "3780608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-10-20T23:58:52.689 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:28 UTC", "StateChangeTimestampMonotonic": "14478209", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : set_fact] ***************************************************** ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:58:52.711 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.068) 0:03:00.080 ***** 2021-10-20T23:58:52.740 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.029) 0:03:00.109 ***** 2021-10-20T23:58:52.760 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-10-20T23:58:52.761 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:55:39 UTC", "ActiveEnterTimestampMonotonic": "14141776", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount system.slice systemd-tmpfiles-setup.service basic.target sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:55:39 UTC", "AssertTimestampMonotonic": "14009470", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:55:39 UTC", "ConditionTimestampMonotonic": "14009469", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-10-20T23:58:52.763 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "833", "ExecMainStartTimestamp": "Wed 2021-10-20 23:55:39 UTC", "ExecMainStartTimestampMonotonic": "14141763", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-10-20 23:55:39 UTC", "InactiveExitTimestampMonotonic": "14010358", "InvocationID": "2230ca00098640ddb90bf9694c045fb4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-10-20T23:58:52.766 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127773", "LimitNPROCSoft": "127773", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "833", "MemoryAccounting": "yes", "MemoryCurrent": "3596288", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-10-20T23:58:52.767 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:55:39 UTC", "StateChangeTimestampMonotonic": "14141776", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38331", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : set_fact] ***************************************************** ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:58:52.793 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.052) 0:03:00.162 ***** 2021-10-20T23:58:52.819 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.025) 0:03:00.187 ***** 2021-10-20T23:58:52.829 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-20T23:58:52.831 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.856 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.037) 0:03:00.225 ***** 2021-10-20T23:58:52.864 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:52.866 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : set_fact] ***************************************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-10-20T23:58:52.894 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.037) 0:03:00.263 ***** 2021-10-20T23:58:52.921 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.026) 0:03:00.290 ***** 2021-10-20T23:58:52.928 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-10-20T23:58:52.930 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:52.960 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.039) 0:03:00.329 ***** 2021-10-20T23:58:52.969 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:52.971 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-10-20T23:58:52.998 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:52 +0000 (0:00:00.037) 0:03:00.367 ***** 2021-10-20T23:58:53.011 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:58:53.040 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:53 +0000 (0:00:00.041) 0:03:00.408 ***** 2021-10-20T23:58:53.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:53.078 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:53 +0000 (0:00:00.038) 0:03:00.447 ***** 2021-10-20T23:58:54.000 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-20T23:58:54.002 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:58:54.031 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.953) 0:03:01.400 ***** 2021-10-20T23:58:54.062 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:54.086 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.054) 0:03:01.455 ***** 2021-10-20T23:58:54.095 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:58:54.124 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.038) 0:03:01.493 ***** 2021-10-20T23:58:54.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:58:54.157 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:54.180 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.056) 0:03:01.549 ***** 2021-10-20T23:58:54.232 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-10-20T23:58:54.234 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:58:54.259 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.078) 0:03:01.628 ***** 2021-10-20T23:58:54.276 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-20T23:58:54.278 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:54.304 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.045) 0:03:01.673 ***** 2021-10-20T23:58:54.313 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-10-20T23:58:54.314 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:54.343 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.038) 0:03:01.712 ***** 2021-10-20T23:58:54.363 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-10-20T23:58:54.365 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:54.395 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.051) 0:03:01.764 ***** 2021-10-20T23:58:54.397 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:54.547 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-10-20T23:58:54.566 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.170) 0:03:01.935 ***** 2021-10-20T23:58:54.573 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-10-20T23:58:54.575 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:58:54.603 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.037) 0:03:01.972 ***** 2021-10-20T23:58:54.791 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-10-20T23:58:54.793 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:58:54.817 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.213) 0:03:02.186 ***** 2021-10-20T23:58:54.858 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:58:54.884 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:54 +0000 (0:00:00.067) 0:03:02.254 ***** 2021-10-20T23:58:55.013 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-10-20T23:58:55.046 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.161) 0:03:02.415 ***** 2021-10-20T23:58:55.130 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-20T23:58:55.132 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:58:55.165 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.119) 0:03:02.534 ***** 2021-10-20T23:58:55.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-20T23:58:55.200 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-10-20T23:58:55.224 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.058) 0:03:02.593 ***** 2021-10-20T23:58:55.415 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:58:55.416 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773603.2122076, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634773603.2082076, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634773603.2082076, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : Install packages via pip] ************************************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:58:55.441 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.217) 0:03:02.810 ***** 2021-10-20T23:58:55.466 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.024) 0:03:02.835 ***** 2021-10-20T23:58:55.696 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-20T23:58:55.698 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:58:55.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.267) 0:03:03.103 ***** 2021-10-20T23:58:55.767 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:58:55.792 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.058) 0:03:03.161 ***** 2021-10-20T23:58:55.821 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-20T23:58:55.822 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:55.847 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:55 +0000 (0:00:00.055) 0:03:03.216 ***** 2021-10-20T23:58:56.015 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-20T23:58:56.023 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:58:56.041 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.194) 0:03:03.410 ***** 2021-10-20T23:58:56.050 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-10-20T23:58:56.052 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:58:56.076 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.034) 0:03:03.445 ***** 2021-10-20T23:58:56.084 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-20T23:58:56.086 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-20T23:58:56.111 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.034) 0:03:03.480 ***** 2021-10-20T23:58:56.255 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:58:56.257 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:58:56.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.180) 0:03:03.660 ***** 2021-10-20T23:58:56.310 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:58:56.312 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773637.9274216, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634773637.9234216, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634773637.9234216, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:58:56.337 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.045) 0:03:03.706 ***** 2021-10-20T23:58:56.348 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-20T23:58:56.350 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.377 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.040) 0:03:03.746 ***** 2021-10-20T23:58:56.418 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-20T23:58:56.420 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.430 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.431 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.442 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.443 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.468 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.090) 0:03:03.837 ***** 2021-10-20T23:58:56.508 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.510 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:58:56.537 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.069) 0:03:03.906 ***** 2021-10-20T23:58:56.547 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:58:56.549 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.549 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.550 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.578 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.041) 0:03:03.947 ***** 2021-10-20T23:58:56.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:58:56.614 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.035) 0:03:03.983 ***** 2021-10-20T23:58:56.624 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:56.625 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.655 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.040) 0:03:04.024 ***** 2021-10-20T23:58:56.666 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.691 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.035) 0:03:04.060 ***** 2021-10-20T23:58:56.700 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-20T23:58:56.702 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.729 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.038) 0:03:04.098 ***** 2021-10-20T23:58:56.772 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-20T23:58:56.774 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.069) 0:03:04.168 ***** 2021-10-20T23:58:56.830 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-10-20T23:58:56.832 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.855 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.055) 0:03:04.224 ***** 2021-10-20T23:58:56.874 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:58:56.902 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.047) 0:03:04.271 ***** 2021-10-20T23:58:56.910 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-20T23:58:56.911 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.939 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.036) 0:03:04.308 ***** 2021-10-20T23:58:56.969 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:58:56.971 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:56.997 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:56 +0000 (0:00:00.057) 0:03:04.366 ***** 2021-10-20T23:58:57.026 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.054 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.057) 0:03:04.423 ***** 2021-10-20T23:58:57.072 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:58:57.076 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:58:57.097 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.042) 0:03:04.466 ***** 2021-10-20T23:58:57.104 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:58:57.106 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.130 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.033) 0:03:04.499 ***** 2021-10-20T23:58:57.137 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-20T23:58:57.140 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.167 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.034) 0:03:04.534 ***** 2021-10-20T23:58:57.184 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:58:57.219 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.054) 0:03:04.588 ***** 2021-10-20T23:58:57.221 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:57.233 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:58:57.234 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi062.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.236 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.045) 0:03:04.634 ***** 2021-10-20T23:58:57.274 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.275 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.276 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.306 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.040) 0:03:04.674 ***** 2021-10-20T23:58:57.325 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-10-20T23:58:57.359 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.050) 0:03:04.725 ***** 2021-10-20T23:58:57.367 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:57.369 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010605", "end": "2021-10-20 23:58:57.315860", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:58:57.305255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.369 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.369 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.371 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.384 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.420 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.063) 0:03:04.789 ***** 2021-10-20T23:58:57.454 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.487 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.066) 0:03:04.856 ***** 2021-10-20T23:58:57.505 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:57.506 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006028", "end": "2021-10-20 23:58:57.488954", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:58:57.482926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:57.517 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.544 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.056) 0:03:04.913 ***** 2021-10-20T23:58:57.574 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.602 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.058) 0:03:04.971 ***** 2021-10-20T23:58:57.631 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.659 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.053) 0:03:05.025 ***** 2021-10-20T23:58:57.687 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:57.690 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005558", "end": "2021-10-20 23:58:57.650681", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:58:57.645123", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:57.690 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-20T23:58:57.691 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.716 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.060) 0:03:05.085 ***** 2021-10-20T23:58:57.735 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-10-20T23:58:57.736 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:58:57.760 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.044) 0:03:05.129 ***** 2021-10-20T23:58:57.768 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:58:57.770 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.799 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.038) 0:03:05.168 ***** 2021-10-20T23:58:57.809 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false} TASK [testnode : Set interface] ************************************************ ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-10-20T23:58:57.839 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.040) 0:03:05.208 ***** 2021-10-20T23:58:57.863 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.023) 0:03:05.232 ***** 2021-10-20T23:58:57.880 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:57.927 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.063) 0:03:05.296 ***** 2021-10-20T23:58:57.938 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:57.939 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027576", "end": "2021-10-20 23:58:57.863804", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:58:57.836228", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:57.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-10-20T23:58:57.942 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false} 2021-10-20T23:58:57.967 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.040) 0:03:05.336 ***** 2021-10-20T23:58:57.992 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:57 +0000 (0:00:00.024) 0:03:05.361 ***** 2021-10-20T23:58:58.042 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.049) 0:03:05.411 ***** 2021-10-20T23:58:58.053 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:58:58.055 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:58:58.059 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773640.4089105, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634773640.4049106, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634773640.4049106, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:58:58.090 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.045) 0:03:05.456 ***** 2021-10-20T23:58:58.115 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.028) 0:03:05.484 ***** 2021-10-20T23:58:58.138 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.022) 0:03:05.507 ***** 2021-10-20T23:58:58.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:58.194 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.051) 0:03:05.559 ***** 2021-10-20T23:58:58.198 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:58:58.199 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773639.7433968, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634773639.7393968, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634773639.7393968, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:58:58.248 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.057) 0:03:05.617 ***** 2021-10-20T23:58:58.310 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:58:58.337 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.088) 0:03:05.706 ***** 2021-10-20T23:58:58.345 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:58.347 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010454", "end": "2021-10-20 23:58:58.284561", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:58:58.274107", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:58.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-20T23:58:58.370 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:58:58.392 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.055) 0:03:05.761 ***** 2021-10-20T23:58:58.400 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-10-20T23:58:58.401 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773634.7634075, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1634773634.7594075, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1634773634.7594075, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:58:58.432 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.039) 0:03:05.801 ***** 2021-10-20T23:58:58.441 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-20T23:58:58.445 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:58:58.471 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.039) 0:03:05.841 ***** 2021-10-20T23:58:58.510 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.038) 0:03:05.879 ***** 2021-10-20T23:58:58.539 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi062.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006055", "end": "2021-10-20 23:58:58.454211", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:58:58.448156", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:58.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-20T23:58:58.548 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:58:58.579 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.067) 0:03:05.947 ***** 2021-10-20T23:58:58.620 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-10-20T23:58:58.621 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-10-20T23:58:58.644 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.065) 0:03:06.013 ***** 2021-10-20T23:58:58.680 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.034) 0:03:06.047 ***** 2021-10-20T23:58:58.690 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:58.690 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005475", "end": "2021-10-20 23:58:58.619422", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:58:58.613947", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:58.692 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:58:58.723 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.044) 0:03:06.092 ***** 2021-10-20T23:58:58.734 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-10-20T23:58:58.736 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-10-20T23:58:58.773 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.049) 0:03:06.142 ***** 2021-10-20T23:58:58.818 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-10-20T23:58:58.820 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:58.851 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.077) 0:03:06.219 ***** 2021-10-20T23:58:58.859 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:58:58.861 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.032716", "end": "2021-10-20 23:58:58.799457", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:58:58.766741", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:58:58.866 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:58:58.899 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.049) 0:03:06.268 ***** 2021-10-20T23:58:58.937 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.037) 0:03:06.306 ***** 2021-10-20T23:58:58.939 INFO:teuthology.task.ansible.out: 2021-10-20T23:58:58.946 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:58:58.947 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:58:58.948 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:58:58.977 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:58 +0000 (0:00:00.038) 0:03:06.344 ***** 2021-10-20T23:58:59.003 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.027) 0:03:06.372 ***** 2021-10-20T23:58:59.023 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:58:59.025 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.053 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.055 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-10-20T23:58:59.094 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.090) 0:03:06.463 ***** 2021-10-20T23:58:59.129 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.034) 0:03:06.497 ***** 2021-10-20T23:58:59.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-10-20T23:58:59.140 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi071.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.166 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.037) 0:03:06.535 ***** 2021-10-20T23:58:59.175 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.177 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.206 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.040) 0:03:06.575 ***** 2021-10-20T23:58:59.217 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.244 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.037) 0:03:06.613 ***** 2021-10-20T23:58:59.270 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.272 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.283 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.286 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-10-20T23:58:59.287 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.317 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.072) 0:03:06.686 ***** 2021-10-20T23:58:59.324 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.326 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-10-20T23:58:59.327 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi099.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.328 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.353 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.036) 0:03:06.722 ***** 2021-10-20T23:58:59.361 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:59.363 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.389 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.035) 0:03:06.758 ***** 2021-10-20T23:58:59.412 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.022) 0:03:06.780 ***** 2021-10-20T23:58:59.418 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-10-20T23:58:59.420 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.445 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.033) 0:03:06.814 ***** 2021-10-20T23:58:59.452 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.480 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.034) 0:03:06.848 ***** 2021-10-20T23:58:59.486 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:58:59.489 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.490 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Cond 2021-10-20T23:58:59.493 INFO:teuthology.task.ansible.out:itional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi102.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.525 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.045) 0:03:06.894 ***** 2021-10-20T23:58:59.533 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.534 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.535 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi102.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.565 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.039) 0:03:06.934 ***** 2021-10-20T23:58:59.594 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.028) 0:03:06.963 ***** 2021-10-20T23:58:59.601 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-10-20T23:58:59.602 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.609 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.633 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.036) 0:03:06.999 ***** 2021-10-20T23:58:59.679 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.049) 0:03:07.048 ***** 2021-10-20T23:58:59.691 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-10-20T23:58:59.693 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.693 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.693 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.694 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Cond 2021-10-20T23:58:59.696 INFO:teuthology.task.ansible.out:itional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.697 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.728 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.048) 0:03:07.097 ***** 2021-10-20T23:58:59.750 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.022) 0:03:07.119 ***** 2021-10-20T23:58:59.756 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-20T23:58:59.758 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.787 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.036) 0:03:07.156 ***** 2021-10-20T23:58:59.810 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.022) 0:03:07.178 ***** 2021-10-20T23:58:59.820 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.846 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.035) 0:03:07.214 ***** 2021-10-20T23:58:59.852 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.882 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.036) 0:03:07.251 ***** 2021-10-20T23:58:59.906 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.024) 0:03:07.275 ***** 2021-10-20T23:58:59.913 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-10-20T23:58:59.918 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:58:59.944 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.037) 0:03:07.313 ***** 2021-10-20T23:58:59.967 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.022) 0:03:07.336 ***** 2021-10-20T23:58:59.975 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-10-20T23:58:59.977 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.002 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:58:59 +0000 (0:00:00.035) 0:03:07.371 ***** 2021-10-20T23:59:00.010 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-10-20T23:59:00.012 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.040 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.037) 0:03:07.409 ***** 2021-10-20T23:59:00.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.079 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.038) 0:03:07.448 ***** 2021-10-20T23:59:00.087 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.113 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.033) 0:03:07.482 ***** 2021-10-20T23:59:00.119 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:59:00.121 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.152 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.039) 0:03:07.521 ***** 2021-10-20T23:59:00.159 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-10-20T23:59:00.161 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi071.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009298", "end": "2021-10-20 23:59:00.116301", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:59:00.107003", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.191 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.039) 0:03:07.560 ***** 2021-10-20T23:59:00.198 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-10-20T23:59:00.200 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.229 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.038) 0:03:07.598 ***** 2021-10-20T23:59:00.237 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:59:00.238 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.265 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.036) 0:03:07.635 ***** 2021-10-20T23:59:00.273 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-10-20T23:59:00.275 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.301 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.035) 0:03:07.670 ***** 2021-10-20T23:59:00.309 INFO:teuthology.task.ansible.out: 2021-10-20T23:59:00.311 INFO:teuthology.task.ansible.out:TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.340 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.038) 0:03:07.709 ***** 2021-10-20T23:59:00.348 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:59:00.350 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006256", "end": "2021-10-20 23:59:00.292351", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:59:00.286095", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.373 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.407 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.066) 0:03:07.776 ***** 2021-10-20T23:59:00.481 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:59:00.483 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005570", "end": "2021-10-20 23:59:00.455540", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:59:00.449970", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.494 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010377", "end": "2021-10-20 23:59:00.463303", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:59:00.452926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.618 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010339", "end": "2021-10-20 23:59:00.579170", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-10-20 23:59:00.568831", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.662 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006028", "end": "2021-10-20 23:59:00.631896", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:59:00.625868", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.674 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.034836", "end": "2021-10-20 23:59:00.641817", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:59:00.606981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.704 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.297) 0:03:08.073 ***** 2021-10-20T23:59:00.736 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:59:00.763 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:00 +0000 (0:00:00.059) 0:03:08.132 ***** 2021-10-20T23:59:00.799 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:59:00.801 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005264", "end": "2021-10-20 23:59:00.748394", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-10-20 23:59:00.743130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.811 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-10-20T23:59:00.813 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:00.873 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi099.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005496", "end": "2021-10-20 23:59:00.794355", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:59:00.788859", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:00.941 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005366", "end": "2021-10-20 23:59:00.903858", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-10-20 23:59:00.898492", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:01.044 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025485", "end": "2021-10-20 23:59:01.004675", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:59:00.979190", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:01.068 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.305) 0:03:08.437 ***** 2021-10-20T23:59:01.109 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:59:01.143 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.075) 0:03:08.512 ***** 2021-10-20T23:59:01.176 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi102.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.034216", "end": "2021-10-20 23:59:01.129766", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-10-20 23:59:01.095550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:01.177 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-10-20T23:59:01.224 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.080) 0:03:08.593 ***** 2021-10-20T23:59:01.264 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-10-20T23:59:01.292 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.063) 0:03:08.657 ***** 2021-10-20T23:59:01.330 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:01.413 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-10-20T23:59:01.437 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.148) 0:03:08.805 ***** 2021-10-20T23:59:01.479 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.039) 0:03:08.844 ***** 2021-10-20T23:59:01.506 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.027) 0:03:08.872 ***** 2021-10-20T23:59:01.534 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.029) 0:03:08.901 ***** 2021-10-20T23:59:01.562 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:01 +0000 (0:00:00.025) 0:03:08.927 ***** 2021-10-20T23:59:02.511 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi041.front.sepia.ceph.com] 2021-10-20T23:59:02.523 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2021-10-20T23:59:02.578 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-10-20T23:59:02.620 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:01.053) 0:03:09.981 ***** 2021-10-20T23:59:02.659 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:00.046) 0:03:10.028 ***** 2021-10-20T23:59:02.692 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:59:02.704 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-10-20T23:59:02.711 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:02.713 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:59:02.734 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:00.075) 0:03:10.103 ***** 2021-10-20T23:59:02.757 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:00.022) 0:03:10.126 ***** 2021-10-20T23:59:02.793 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:00.035) 0:03:10.162 ***** 2021-10-20T23:59:02.815 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:02.818 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:02.842 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:02 +0000 (0:00:00.049) 0:03:10.211 ***** 2021-10-20T23:59:03.024 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.181) 0:03:10.393 ***** 2021-10-20T23:59:03.047 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.022) 0:03:10.416 ***** 2021-10-20T23:59:03.073 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.025) 0:03:10.442 ***** 2021-10-20T23:59:03.082 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:03.084 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} TASK [container-host : Including distro specific variables] ******************** ok: [smithi041.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:59:03.085 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:59:03.086 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:59:03.112 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.039) 0:03:10.481 ***** 2021-10-20T23:59:03.150 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.038) 0:03:10.519 ***** 2021-10-20T23:59:03.193 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.042) 0:03:10.561 ***** 2021-10-20T23:59:03.237 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.040) 0:03:10.602 ***** 2021-10-20T23:59:03.247 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-10-20T23:59:03.249 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:03.249 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:03.291 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.057) 0:03:10.660 ***** 2021-10-20T23:59:03.318 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.027) 0:03:10.687 ***** 2021-10-20T23:59:03.327 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:03.355 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.037) 0:03:10.725 ***** 2021-10-20T23:59:03.364 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:03.367 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi071.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:59:03.401 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.045) 0:03:10.770 ***** 2021-10-20T23:59:03.444 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.041) 0:03:10.811 ***** 2021-10-20T23:59:03.454 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:59:03.499 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.056) 0:03:10.868 ***** 2021-10-20T23:59:03.522 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-10-20T23:59:03.551 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:03 +0000 (0:00:00.052) 0:03:10.920 ***** 2021-10-20T23:59:19.810 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-20T23:59:19.812 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.9 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Bu 2021-10-20T23:59:19.814 INFO:teuthology.task.ansible.out:ilding dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.9 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:59:19.837 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:19 +0000 (0:00:16.285) 0:03:27.206 ***** 2021-10-20T23:59:19.868 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:19.869 INFO:teuthology.task.ansible.out:skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:19.893 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:19 +0000 (0:00:00.055) 0:03:27.262 ***** 2021-10-20T23:59:19.932 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:19.934 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:59:19.956 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:19 +0000 (0:00:00.063) 0:03:27.325 ***** 2021-10-20T23:59:20.120 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-20T23:59:20.123 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.4 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Bu 2021-10-20T23:59:20.125 INFO:teuthology.task.ansible.out:ilding dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.4 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:59:20.149 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.192) 0:03:27.518 ***** 2021-10-20T23:59:20.173 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi041.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:20.183 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:20.207 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.058) 0:03:27.576 ***** 2021-10-20T23:59:20.246 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-10-20T23:59:20.248 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:59:20.272 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.064) 0:03:27.641 ***** 2021-10-20T23:59:20.354 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:20.356 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:20.386 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.114) 0:03:27.756 ***** 2021-10-20T23:59:20.439 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing trig 2021-10-20T23:59:20.442 INFO:teuthology.task.ansible.out:gers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:59:20.470 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.082) 0:03:27.838 ***** 2021-10-20T23:59:20.490 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi071.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:20.502 INFO:teuthology.task.ansible.out: 2021-10-20T23:59:20.505 INFO:teuthology.task.ansible.out:TASK [container-host : set_fact] *********************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:20.538 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.068) 0:03:27.907 ***** 2021-10-20T23:59:20.578 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:59:20.602 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.064) 0:03:27.971 ***** 2021-10-20T23:59:20.633 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-20T23:59:20.634 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Bu 2021-10-20T23:59:20.636 INFO:teuthology.task.ansible.out:ilding dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:59:20.664 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.059) 0:03:28.031 ***** 2021-10-20T23:59:20.673 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:20.674 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:20.704 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.041) 0:03:28.073 ***** 2021-10-20T23:59:20.713 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:20.741 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.035) 0:03:28.108 ***** 2021-10-20T23:59:20.791 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:59:20.834 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.094) 0:03:28.203 ***** 2021-10-20T23:59:20.846 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:20.848 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:20.883 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi041.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:20.972 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-10-20T23:59:20.973 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.8 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu1~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Bu 2021-10-20T23:59:20.975 INFO:teuthology.task.ansible.out:ilding dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 26 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.8 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu1~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu1~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-10-20T23:59:20.999 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:20 +0000 (0:00:00.165) 0:03:28.369 ***** 2021-10-20T23:59:21.030 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:21.031 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:21.033 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:21.065 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.062) 0:03:28.431 ***** 2021-10-20T23:59:21.088 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.026) 0:03:28.457 ***** 2021-10-20T23:59:21.104 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi099.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:21.137 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-10-20T23:59:21.171 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.080) 0:03:28.538 ***** 2021-10-20T23:59:21.218 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:59:21.220 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:21.251 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:21.252 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:21.280 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.110) 0:03:28.649 ***** 2021-10-20T23:59:21.315 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:59:21.317 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:21.351 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.070) 0:03:28.719 ***** 2021-10-20T23:59:21.404 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-10-20T23:59:21.409 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:21.561 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi062.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:21.586 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi102.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-10-20T23:59:21.619 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.269) 0:03:28.988 ***** 2021-10-20T23:59:21.628 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:59:21.631 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:21.663 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.043) 0:03:29.032 ***** 2021-10-20T23:59:21.798 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:21.974 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:22.000 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:21 +0000 (0:00:00.336) 0:03:29.369 ***** 2021-10-20T23:59:22.109 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:22.158 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi041.front.sepia.ceph.com] => {"cache_update_time": 1634773698, "cache_updated": false, "changed": false} 2021-10-20T23:59:22.191 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:22 +0000 (0:00:00.188) 0:03:29.557 ***** 2021-10-20T23:59:22.206 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-10-20T23:59:22.208 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:22.242 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:22 +0000 (0:00:00.054) 0:03:29.611 ***** 2021-10-20T23:59:22.467 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-10-20T23:59:22.469 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] => {"cache_update_time": 1634773827, "cache_updated": false, "changed": false} 2021-10-20T23:59:22.494 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:22 +0000 (0:00:00.251) 0:03:29.863 ***** 2021-10-20T23:59:22.520 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** ok: [smithi102.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-10-20T23:59:22.547 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:22 +0000 (0:00:00.053) 0:03:29.916 ***** 2021-10-20T23:59:22.549 INFO:teuthology.task.ansible.out: 2021-10-20T23:59:22.802 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi062.front.sepia.ceph.com] => {"cache_update_time": 1634773762, "cache_updated": false, "changed": false} 2021-10-20T23:59:22.831 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:22 +0000 (0:00:00.281) 0:03:30.197 ***** 2021-10-20T23:59:23.038 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1634773889, "cache_updated": false, "changed": false} 2021-10-20T23:59:23.065 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:23 +0000 (0:00:00.235) 0:03:30.433 ***** 2021-10-20T23:59:23.330 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1634773952, "cache_updated": false, "changed": false} 2021-10-20T23:59:23.368 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:23 +0000 (0:00:00.304) 0:03:30.737 ***** 2021-10-20T23:59:26.469 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-20T23:59:26.471 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-aypplxhy\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-aypplxhy"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-aypplxhy\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=9a99df73bbe2da1cde8f6372113bc5ab3a70a7a4968b1e648890753fb5abdda1\n Stored in directory: /tmp/pip-ephem-wheel-cache-il7__7ez/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:59:26.472 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-aypplxhy", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=9a99df73bbe2da1cde8f6372113bc5ab3a70a7a4968b1e648890753fb5abdda1", " Stored in directory: /tmp/pip-ephem-wheel-cache-il7__7ez/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:59:26.505 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:26 +0000 (0:00:03.130) 0:03:33.868 ***** 2021-10-20T23:59:26.725 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-20T23:59:26.737 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773592.9204905, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:59:26.776 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:26 +0000 (0:00:00.255) 0:03:34.123 ***** 2021-10-20T23:59:26.811 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6so6nlgv\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6so6nlgv"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6so6nlgv\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=9a99df73bbe2da1cde8f6372113bc5ab3a70a7a4968b1e648890753fb5abdda1\n Stored in directory: /tmp/pip-ephem-wheel-cache-4w6wldc5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebasti 2021-10-20T23:59:26.815 INFO:teuthology.task.ansible.out:an-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6so6nlgv", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=9a99df73bbe2da1cde8f6372113bc5ab3a70a7a4968b1e648890753fb5abdda1", " Stored in directory: /tmp/pip-ephem-wheel-cache-4w6wldc5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:59:26.839 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:26 +0000 (0:00:00.082) 0:03:34.205 ***** 2021-10-20T23:59:26.872 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ skipping: [smithi041.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:26.908 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:26 +0000 (0:00:00.065) 0:03:34.271 ***** 2021-10-20T23:59:27.092 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi071.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773622.1014147, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:59:27.125 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.222) 0:03:34.494 ***** 2021-10-20T23:59:27.164 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:59:27.165 INFO:teuthology.task.ansible.out:skipping: [smithi071.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:27.189 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.063) 0:03:34.558 ***** 2021-10-20T23:59:27.242 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.089150", "end": "2021-10-20 23:59:27.219751", "rc": 0, "start": "2021-10-20 23:59:27.130601", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:27.267 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.078) 0:03:34.636 ***** 2021-10-20T23:59:27.311 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-10-20T23:59:27.316 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-f6nfwgc9\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-f6nfwgc9"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-f6nfwgc9\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=ca6411e01100517a57cd07ed5d9882df8423ee758df1187c442cb3a8565e8b19\n Stored in directory: /tmp/pip-ephem-wheel-cache-moz56yk5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-10-20T23:59:27.318 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-f6nfwgc9", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=ca6411e01100517a57cd07ed5d9882df8423ee758df1187c442cb3a8565e8b19", " Stored in directory: /tmp/pip-ephem-wheel-cache-moz56yk5/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:59:27.337 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.069) 0:03:34.706 ***** 2021-10-20T23:59:27.471 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.079039", "end": "2021-10-20 23:59:27.434228", "rc": 0, "start": "2021-10-20 23:59:27.355189", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:27.503 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.161) 0:03:34.868 ***** 2021-10-20T23:59:27.556 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-10-20T23:59:27.558 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773620.039914, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:59:27.600 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.098) 0:03:34.967 ***** 2021-10-20T23:59:27.663 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:27.697 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.093) 0:03:35.060 ***** 2021-10-20T23:59:27.699 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-at8np3or\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-at8np3or"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-at8np3or\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=ca6411e01100517a57cd07ed5d9882df8423ee758df1187c442cb3a8565e8b19\n Stored in directory: /tmp/pip-ephem-wheel-cache-6ccid0il/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebasti 2021-10-20T23:59:27.701 INFO:teuthology.task.ansible.out:an-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-at8np3or", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=ca6411e01100517a57cd07ed5d9882df8423ee758df1187c442cb3a8565e8b19", " Stored in directory: /tmp/pip-ephem-wheel-cache-6ccid0il/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:59:27.728 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.035) 0:03:35.095 ***** 2021-10-20T23:59:27.954 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773617.9838696, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:59:27.978 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:27 +0000 (0:00:00.252) 0:03:35.347 ***** 2021-10-20T23:59:27.988 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-20T23:59:27.990 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.082940", "end": "2021-10-20 23:59:27.942345", "rc": 0, "start": "2021-10-20 23:59:27.859405", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:28.015 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.036) 0:03:35.384 ***** 2021-10-20T23:59:28.025 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:59:28.027 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:28.057 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.040) 0:03:35.424 ***** 2021-10-20T23:59:28.317 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-864r8fv8\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-864r8fv8"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-864r8fv8\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c51d4d7d6a96a5a01cd601e5385ee58d4a644d82590a0332a93999cbb13efb3d\n Stored in directory: /tmp/pip-ephem-wheel-cache-mf19mw_l/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebasti 2021-10-20T23:59:28.319 INFO:teuthology.task.ansible.out:an-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-864r8fv8", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c51d4d7d6a96a5a01cd601e5385ee58d4a644d82590a0332a93999cbb13efb3d", " Stored in directory: /tmp/pip-ephem-wheel-cache-mf19mw_l/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-10-20T23:59:28.344 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.288) 0:03:35.713 ***** 2021-10-20T23:59:28.354 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-10-20T23:59:28.356 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.087552", "end": "2021-10-20 23:59:28.308339", "rc": 0, "start": "2021-10-20 23:59:28.220787", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:28.383 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.037) 0:03:35.751 ***** 2021-10-20T23:59:28.555 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1634773622.635868, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-10-20T23:59:28.579 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.196) 0:03:35.948 ***** 2021-10-20T23:59:28.618 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-10-20T23:59:28.620 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-10-20T23:59:28.657 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.064) 0:03:36.013 ***** 2021-10-20T23:59:28.940 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.089042", "end": "2021-10-20 23:59:28.908618", "rc": 0, "start": "2021-10-20 23:59:28.819576", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-10-20T23:59:28.973 INFO:teuthology.task.ansible.out:Wednesday 20 October 2021 23:59:28 +0000 (0:00:00.328) 0:03:36.341 ***** 2021-10-20T23:59:29.113 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-10-20T23:59:29.115 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ActiveEnterTimestampMonotonic": "264099040", "ActiveExitTimestamp": "Wed 2021-10-20 23:59:14 UTC", "ActiveExitTimestampMonotonic": "263010585", "ActiveState": "active", "After": "network-online.target system.slice basic.target docker.socket firewalld.service systemd-journald.socket containerd.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:59:14 UTC", "AssertTimestampMonotonic": "263023361", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:59:14 UTC", "ConditionTimestampMonotonic": "263023360", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:59:29.117 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8143", "ExecMainStartTimestamp": "Wed 2021-10-20 23:59:14 UTC", "ExecMainStartTimestampMonotonic": "263024209", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:59:29.118 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:59:14 UTC", "InactiveEnterTimestampMonotonic": "263015960", "InactiveExitTimestamp": "Wed 2021-10-20 23:59:14 UTC", "InactiveExitTimestampMonotonic": "263025040", "InvocationID": "6afb1e1ee0054123aa35f90a66b4ff65", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127797", "LimitSIGPENDINGSoft": "127797", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8143", "MemoryAccounting": "yes", "MemoryCurrent": "46424064", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:59:29.120 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:59:15 UTC", "StateChangeTimestampMonotonic": "264099040", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "18", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:59:29.122 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:59:29.318 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:59:16 UTC", "ActiveEnterTimestampMonotonic": "242151781", "ActiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ActiveExitTimestampMonotonic": "241154038", "ActiveState": "active", "After": "system.slice systemd-journald.socket basic.target firewalld.service containerd.service sysinit.target network-online.target docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:59:15 UTC", "AssertTimestampMonotonic": "241168340", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ConditionTimestampMonotonic": "241168340", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:59:29.319 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8242", "ExecMainStartTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ExecMainStartTimestampMonotonic": "241169430", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:59:29.321 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveEnterTimestampMonotonic": "241161791", "InactiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveExitTimestampMonotonic": "241170415", "InvocationID": "5463e2576300450face01fbb13854f87", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8242", "MemoryAccounting": "yes", "MemoryCurrent": "45473792", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:59:29.323 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:59:16 UTC", "StateChangeTimestampMonotonic": "242151781", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:59:29.325 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "ini 2021-10-20T23:59:29.325 INFO:teuthology.task.ansible.out:t", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:59:29.952 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:59:16 UTC", "ActiveEnterTimestampMonotonic": "250870545", "ActiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ActiveExitTimestampMonotonic": "249719301", "ActiveState": "active", "After": "sysinit.target containerd.service system.slice basic.target systemd-journald.socket network-online.target docker.socket firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:59:15 UTC", "AssertTimestampMonotonic": "249731760", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ConditionTimestampMonotonic": "249731759", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:59:29.954 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8265", "ExecMainStartTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ExecMainStartTimestampMonotonic": "249732463", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:59:29.954 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveEnterTimestampMonotonic": "249727264", "InactiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveExitTimestampMonotonic": "249733378", "InvocationID": "e56edcc4fe5440afaa9309cff12a8d15", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8265", "MemoryAccounting": "yes", "MemoryCurrent": "45391872", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:59:29.957 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:59:16 UTC", "StateChangeTimestampMonotonic": "250870545", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "17", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:59:29.959 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:59:30.272 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:59:16 UTC", "ActiveEnterTimestampMonotonic": "231503381", "ActiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ActiveExitTimestampMonotonic": "230350279", "ActiveState": "active", "After": "containerd.service system.slice sysinit.target systemd-journald.socket docker.socket firewalld.service network-online.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:59:15 UTC", "AssertTimestampMonotonic": "230361961", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ConditionTimestampMonotonic": "230361961", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:59:30.275 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8228", "ExecMainStartTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ExecMainStartTimestampMonotonic": "230362872", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:59:30.276 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveEnterTimestampMonotonic": "230356676", "InactiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveExitTimestampMonotonic": "230363817", "InvocationID": "cb14ccc948fc4974adb589633bbb28e0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127773", "LimitSIGPENDINGSoft": "127773", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8228", "MemoryAccounting": "yes", "MemoryCurrent": "44945408", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:59:30.278 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:59:16 UTC", "StateChangeTimestampMonotonic": "231503381", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:59:30.280 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:59:30.922 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-10-20 23:59:16 UTC", "ActiveEnterTimestampMonotonic": "236213298", "ActiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ActiveExitTimestampMonotonic": "234993832", "ActiveState": "active", "After": "systemd-journald.socket containerd.service firewalld.service basic.target sysinit.target system.slice network-online.target docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-10-20 23:59:15 UTC", "AssertTimestampMonotonic": "235004697", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ConditionTimestampMonotonic": "235004697", "ConfigurationDirectoryMode": "0755" 2021-10-20T23:59:30.924 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8224", "ExecMainStartTimestamp": "Wed 2021-10-20 23:59:15 UTC", "ExecMainStartTimestampMonotonic": "235005533", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2021-10-20T23:59:30.927 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveEnterTimestampMonotonic": "234998467", "InactiveExitTimestamp": "Wed 2021-10-20 23:59:15 UTC", "InactiveExitTimestampMonotonic": "235006404", "InvocationID": "c0c1139b1fdf4be685899bcf796ae1b3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127772", "LimitSIGPENDINGSoft": "127772", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8224", "MemoryAccounting": "yes", "MemoryCurrent": "46247936", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2021-10-20T23:59:30.929 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-10-20 23:59:16 UTC", "StateChangeTimestampMonotonic": "236213298", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2021-10-20T23:59:30.930 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-10-20T23:59:31.006 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-10-20T23:59:31.014 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY [testnodes] *************************************************************** 2021-10-20T23:59:31.025 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 20 October 2021 23:59:31 +0000 (0:00:02.052) 0:03:38.394 ***** 2021-10-20T23:59:32.068 INFO:teuthology.task.ansible.out:ok: [smithi041.front.sepia.ceph.com] 2021-10-20T23:59:32.069 INFO:teuthology.task.ansible.out: 2021-10-20T23:59:32.093 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2021-10-20T23:59:32.095 INFO:teuthology.task.ansible.out: 2021-10-20T23:59:32.134 INFO:teuthology.task.ansible.out:ok: [smithi071.front.sepia.ceph.com] 2021-10-20T23:59:32.164 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-10-20T23:59:32.215 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-10-20T23:59:32.254 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Wednesday 20 October 2021 23:59:32 +0000 (0:00:01.229) 0:03:39.623 ***** 2021-10-20T23:59:32.476 INFO:teuthology.task.ansible.out:changed: [smithi041.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:59:32.519 INFO:teuthology.task.ansible.out:changed: [smithi071.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:59:32.520 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:59:32.568 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:59:32.579 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-10-20T23:59:32.582 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-10-20T23:59:32.583 INFO:teuthology.task.ansible.out:smithi041.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi062.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi071.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi099.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi102.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 Wednesday 20 October 2021 23:59:32 +0000 (0:00:00.327) 0:03:39.951 ***** =============================================================================== Create all admin users with sudo access. ------------------------------- 22.53s users : Update authorized_keys using the keys repo --------------------- 21.09s container-host : Install container packages ---------------------------- 16.29s testnode : Upgrade packages -------------------------------------------- 14.50s testnode : Install packages -------------------------------------------- 10.61s Remove revoked users ---------------------------------------------------- 7.53s testnode : Ensure packages are not present. ----------------------------- 7.06s testnode : Zap all non-root disks --------------------------------------- 6.08s container-host : Install registries-conf-ctl ---------------------------- 3.13s common : Update apt cache ----------------------------------------------- 2.83s Gathering Facts --------------------------------------------------------- 2.11s container-host : Restart docker service --------------------------------- 2.05s Gathering Facts --------------------------------------------------------- 1.78s users : Update authorized_keys for each user with literal keys ---------- 1.53s testnode : Install apt keys --------------------------------------------- 1.26s Gath 2021-10-20T23:59:32.590 INFO:teuthology.task.ansible.out:ering Facts --------------------------------------------------------- 1.23s testnode : Update apt cache. -------------------------------------------- 1.22s Gathering Facts --------------------------------------------------------- 1.11s Gathering Facts --------------------------------------------------------- 1.05s testnode : Install python-pip on apt based systems. --------------------- 0.95s 2021-10-20T23:59:33.041 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi041.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2021-10-20T23:59:33.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com' 2021-10-20T23:59:33.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:59:33.120 DEBUG:teuthology.orchestra.run.smithi041:> true 2021-10-20T23:59:33.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-10-20T23:59:33.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:59:33.290 DEBUG:teuthology.orchestra.run.smithi062:> true 2021-10-20T23:59:33.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-10-20T23:59:33.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:59:33.471 DEBUG:teuthology.orchestra.run.smithi071:> true 2021-10-20T23:59:33.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2021-10-20T23:59:33.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:59:33.655 DEBUG:teuthology.orchestra.run.smithi099:> true 2021-10-20T23:59:33.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2021-10-20T23:59:33.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-20T23:59:33.846 DEBUG:teuthology.orchestra.run.smithi102:> true 2021-10-20T23:59:33.980 INFO:teuthology.run_tasks:Running task clock... 2021-10-20T23:59:34.005 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-10-20T23:59:34.007 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:59:34.009 DEBUG:teuthology.orchestra.run.smithi041:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:59:34.063 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:59:34.064 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Command line: ntpd -gq 2021-10-20T23:59:34.064 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: proto: precision = 0.117 usec (-23) 2021-10-20T23:59:34.064 INFO:teuthology.orchestra.run.smithi041.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:34.065 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:34.065 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:34.066 INFO:teuthology.orchestra.run.smithi041.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:34.067 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:59:34.067 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:59:34.067 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:59:34.068 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen normally on 3 ens1f0 172.21.15.41:123 2021-10-20T23:59:34.068 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen normally on 4 lo [::1]:123 2021-10-20T23:59:34.068 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1252%4]:123 2021-10-20T23:59:34.068 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:34 ntpd[9558]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:59:35.057 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:35.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:35.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:35.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:35 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:37.071 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.112 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.112 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.112 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.113 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.113 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.114 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.114 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.114 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:37.114 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:37.115 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.115 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.116 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:37.116 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:37.116 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:37.116 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:37.118 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:37.118 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:37 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:39.057 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.058 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.059 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:39.062 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:39.076 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:39.079 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:39.079 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:39 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:41.067 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:41.067 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:41.078 INFO:teuthology.orchestra.run.smithi041.stdout:20 Oct 23:59:41 ntpd[9558]: ntpd: time slew -0.010939 s 2021-10-20T23:59:41.079 INFO:teuthology.orchestra.run.smithi041.stdout:ntpd: time slew -0.010939s 2021-10-20T23:59:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:59:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:20 Oct 23:59:41 ntpd[9558]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:59:41.121 INFO:teuthology.orchestra.run.smithi041.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:59:41.122 INFO:teuthology.orchestra.run.smithi041.stdout:============================================================================== 2021-10-20T23:59:41.122 INFO:teuthology.orchestra.run.smithi041.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:41.122 INFO:teuthology.orchestra.run.smithi041.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:41.123 INFO:teuthology.orchestra.run.smithi041.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:41.123 INFO:teuthology.orchestra.run.smithi041.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:41.123 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:59:41.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:59:41.175 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:59:41.175 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Command line: ntpd -gq 2021-10-20T23:59:41.176 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: proto: precision = 0.155 usec (-23) 2021-10-20T23:59:41.176 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:41.177 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:41.177 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:41.177 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:41.180 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:59:41.180 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:59:41.180 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:59:41.181 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2021-10-20T23:59:41.182 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen normally on 4 lo [::1]:123 2021-10-20T23:59:41.182 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2021-10-20T23:59:41.183 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:41 ntpd[9674]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:59:42.177 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:42.178 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:42.178 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:42.178 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:42.179 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:42.179 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:42 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:44.171 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:44.171 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:44.172 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:44.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:44.174 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:44 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.184 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.186 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.187 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.188 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:46 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:48.170 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.171 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.171 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.173 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.174 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.174 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.174 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.175 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.175 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.175 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.175 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:48.176 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:48.176 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:48.176 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:48.176 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:48.177 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:48.177 INFO:teuthology.orchestra.run.smithi062.stdout:20 Oct 23:59:48 ntpd[9674]: ntpd: time slew +0.001282 s 2021-10-20T23:59:48.178 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew +0.001282s 2021-10-20T23:59:48.178 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:59:48.179 INFO:teuthology.orchestra.run.smithi062.stderr:20 Oct 23:59:48 ntpd[9674]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:59:48.250 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:59:48.251 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2021-10-20T23:59:48.251 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:48.253 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:48.253 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:48.254 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:48.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:59:48.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:59:48.289 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:59:48.290 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Command line: ntpd -gq 2021-10-20T23:59:48.291 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: proto: precision = 0.046 usec (-24) 2021-10-20T23:59:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:48.293 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:48.294 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:48.294 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:59:48.295 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:59:48.295 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:59:48.295 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen normally on 3 enp3s0f1 172.21.15.71:123 2021-10-20T23:59:48.295 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen normally on 4 lo [::1]:123 2021-10-20T23:59:48.296 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d765%5]:123 2021-10-20T23:59:48.296 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:48 ntpd[9653]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:59:49.290 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:49 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:50.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:50.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:50.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:50.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:50.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:50.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:50.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:50.297 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:50.297 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:50 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:51.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:51 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:52.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:52.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:52.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:52.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:52 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:53.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:53.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:53.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:53.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:53.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:53.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:53.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:53.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:53.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:53.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:53.294 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:53 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:54.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:54.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:54.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:54.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:54.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:54.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:54.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:54.292 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:54.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:54.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:54.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:54.293 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:54 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:55.291 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:55.302 INFO:teuthology.orchestra.run.smithi071.stdout:20 Oct 23:59:55 ntpd[9653]: ntpd: time slew +0.001019 s 2021-10-20T23:59:55.302 INFO:teuthology.orchestra.run.smithi071.stdout:ntpd: time slew +0.001019s 2021-10-20T23:59:55.302 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-20T23:59:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:20 Oct 23:59:55 ntpd[9653]: can't open /var/log/ntpstats/loopstats.20211020: Permission denied 2021-10-20T23:59:55.367 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2021-10-20T23:59:55.367 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2021-10-20T23:59:55.367 INFO:teuthology.orchestra.run.smithi071.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:55.368 INFO:teuthology.orchestra.run.smithi071.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:55.368 INFO:teuthology.orchestra.run.smithi071.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:55.368 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-20T23:59:55.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-20T23:59:55.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-20T23:59:55.406 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-20T23:59:55.406 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Command line: ntpd -gq 2021-10-20T23:59:55.407 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: proto: precision = 0.085 usec (-23) 2021-10-20T23:59:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:55.408 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-20T23:59:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:55.410 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: restrict ::: KOD does nothing without LIMITED. 2021-10-20T23:59:55.423 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen and drop on 0 v6wildcard [::]:123 2021-10-20T23:59:55.423 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-20T23:59:55.424 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen normally on 2 lo 127.0.0.1:123 2021-10-20T23:59:55.424 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2021-10-20T23:59:55.424 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen normally on 4 lo [::1]:123 2021-10-20T23:59:55.424 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2021-10-20T23:59:55.425 INFO:teuthology.orchestra.run.smithi099.stdout:20 Oct 23:59:55 ntpd[9623]: Listening on routing socket on fd #22 for interface updates 2021-10-20T23:59:57.407 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:57.408 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:57.408 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:57.408 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:57.408 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:57.409 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:57 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:59.408 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:59.410 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:59.410 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:59.412 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:59.418 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:59.418 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:59.419 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-20T23:59:59.420 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-20T23:59:59.421 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211020: Permission denied 2021-10-20T23:59:59.422 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-20T23:59:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:20 Oct 23:59:59 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211020: Permission denied 2021-10-21T00:00:00.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:00 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:01.408 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:01.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:01.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:01.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:01.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:01.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:01.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:01.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:01.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:01.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:01.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:01 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:02.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:02.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:02.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:02.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:02.412 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:02.415 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:02.416 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:02.416 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:02.416 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:02.416 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:02 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:03.412 INFO:teuthology.orchestra.run.smithi099.stdout:21 Oct 00:00:03 ntpd[9623]: ntpd: time slew +0.000351 s 2021-10-21T00:00:03.412 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew +0.000351s 2021-10-21T00:00:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-21T00:00:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:21 Oct 00:00:03 ntpd[9623]: can't open /var/log/ntpstats/loopstats.20211021: Permission denied 2021-10-21T00:00:03.486 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:00:03.486 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2021-10-21T00:00:03.486 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:03.486 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:03.487 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:03.487 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:03.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-10-21T00:00:03.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:00:03.527 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-10-21T00:00:03.528 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Command line: ntpd -gq 2021-10-21T00:00:03.528 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: proto: precision = 0.053 usec (-24) 2021-10-21T00:00:03.529 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-21T00:00:03.529 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-10-21T00:00:03.530 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: restrict ::: KOD does nothing without LIMITED. 2021-10-21T00:00:03.530 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2021-10-21T00:00:03.532 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen and drop on 0 v6wildcard [::]:123 2021-10-21T00:00:03.532 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-10-21T00:00:03.533 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen normally on 2 lo 127.0.0.1:123 2021-10-21T00:00:03.533 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2021-10-21T00:00:03.533 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen normally on 4 lo [::1]:123 2021-10-21T00:00:03.533 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2021-10-21T00:00:03.534 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:03 ntpd[9647]: Listening on routing socket on fd #22 for interface updates 2021-10-21T00:00:04.533 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:04.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:04.536 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:04.537 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:04.537 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:04.537 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:04.538 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:04.538 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:04.539 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:04.539 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:04.539 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:04.539 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:04 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:06.529 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.529 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.530 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.533 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:06.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:06.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:06.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:06.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:06.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:06.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:06.536 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:06 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:07.530 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:07.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:07 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:08.530 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.531 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.532 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.532 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.532 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.532 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:08.532 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:08.533 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:08.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:08 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:09.551 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:09.554 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:09.555 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:09.555 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:09.555 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:09.556 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:09 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:10.534 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:10.546 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:10.547 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:10.547 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:10.547 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-10-21T00:00:10.552 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/rawstats.20211021: Permission denied 2021-10-21T00:00:10.552 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-10-21T00:00:10.553 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/peerstats.20211021: Permission denied 2021-10-21T00:00:10.567 INFO:teuthology.orchestra.run.smithi102.stdout:21 Oct 00:00:10 ntpd[9647]: ntpd: time slew +0.000078 s 2021-10-21T00:00:10.567 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew +0.000078s 2021-10-21T00:00:10.568 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-10-21T00:00:10.568 INFO:teuthology.orchestra.run.smithi102.stderr:21 Oct 00:00:10 ntpd[9647]: can't open /var/log/ntpstats/loopstats.20211021: Permission denied 2021-10-21T00:00:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:00:10.607 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2021-10-21T00:00:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-10-21T00:00:10.608 INFO:teuthology.run_tasks:Running task install... 2021-10-21T00:00:10.651 DEBUG:teuthology.task.install:project ceph 2021-10-21T00:00:10.653 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}} 2021-10-21T00:00:10.653 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'} 2021-10-21T00:00:10.662 INFO:teuthology.task.install:Using flavor: default 2021-10-21T00:00:10.670 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-10-21T00:00:10.670 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-10-21T00:00:10.671 DEBUG:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2021-10-21T00:00:10.725 INFO:teuthology.orchestra.run.smithi041.stdout:Ubuntu 2021-10-21T00:00:10.736 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:10.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-10-21T00:00:10.738 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-key list | grep Ceph 2021-10-21T00:00:10.805 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-10-21T00:00:10.812 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:10.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2021-10-21T00:00:10.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2021-10-21T00:00:10.855 INFO:teuthology.orchestra.run.smithi041.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-21T00:00:10.863 INFO:teuthology.orchestra.run.smithi071.stdout:Ubuntu 2021-10-21T00:00:10.884 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:10.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-10-21T00:00:10.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-key list | grep Ceph 2021-10-21T00:00:10.899 INFO:teuthology.orchestra.run.smithi041.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-21T00:00:10.900 INFO:teuthology.orchestra.run.smithi041.stdout:uid [ unknown] Ceph.com (release key) 2021-10-21T00:00:10.900 DEBUG:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2021-10-21T00:00:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-21T00:00:10.938 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-10-21T00:00:10.949 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:10.950 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-10-21T00:00:10.950 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2021-10-21T00:00:10.954 INFO:teuthology.orchestra.run.smithi041.stdout:Ubuntu 2021-10-21T00:00:10.959 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:10.959 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-21T00:00:10.964 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-21T00:00:10.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:00:11.034 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-21T00:00:11.035 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-21T00:00:11.036 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2021-10-21T00:00:11.036 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-10-21T00:00:11.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-10-21T00:00:11.037 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:11.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2021-10-21T00:00:11.044 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-21T00:00:11.046 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-21T00:00:11.047 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph.com (release key) 2021-10-21T00:00:11.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2021-10-21T00:00:11.087 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-10-21T00:00:11.115 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-21T00:00:11.115 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2021-10-21T00:00:11.115 INFO:teuthology.orchestra.run.smithi071.stdout:Ubuntu 2021-10-21T00:00:11.116 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:11.116 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-21T00:00:11.117 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-21T00:00:11.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:00:11.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-10-21T00:00:11.121 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:11.121 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-21T00:00:11.121 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-21T00:00:11.122 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:00:11.181 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-10-21T00:00:11.184 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-21T00:00:11.187 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:11.233 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-10-21T00:00:11.235 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-10-21T00:00:11.235 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2021-10-21T00:00:11.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-10-21T00:00:11.240 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:11.240 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-21T00:00:11.246 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-21T00:00:11.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:00:11.319 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-10-21T00:00:11.319 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:00:11.320 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-10-21T00:00:11.321 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-10-21T00:00:11.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:00:11.386 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:00:11.387 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-21T00:00:11.403 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-21T00:00:11.404 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:11.431 DEBUG:teuthology.orchestra.run.smithi041:> sudo apt-get update 2021-10-21T00:00:11.432 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-21T00:00:11.432 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:11.487 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-21T00:00:11.488 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:11.515 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default/ 2021-10-21T00:00:11.516 INFO:teuthology.task.install.deb:Package version is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:11.561 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:00:11.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-21T00:00:11.564 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:00:11.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-21T00:00:11.600 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-21T00:00:11.611 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:00:11.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-21T00:00:11.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2021-10-21T00:00:11.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2021-10-21T00:00:11.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-10-21T00:00:11.637 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:00:11.637 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-10-21T00:00:11.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-10-21T00:00:11.666 INFO:teuthology.orchestra.run.smithi041.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-21T00:00:11.690 INFO:teuthology.orchestra.run.smithi041.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-21T00:00:11.709 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-21T00:00:11.729 INFO:teuthology.orchestra.run.smithi041.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-21T00:00:11.744 INFO:teuthology.orchestra.run.smithi041.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-21T00:00:11.771 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-21T00:00:11.777 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-21T00:00:11.779 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-21T00:00:11.810 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-21T00:00:11.827 INFO:teuthology.orchestra.run.smithi041.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-21T00:00:11.827 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-21T00:00:11.828 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-21T00:00:11.835 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-21T00:00:11.847 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-10-21T00:00:11.849 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-21T00:00:11.850 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-21T00:00:11.859 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-21T00:00:11.872 INFO:teuthology.orchestra.run.smithi041.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-21T00:00:11.874 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-21T00:00:11.884 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-21T00:00:11.885 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-21T00:00:11.886 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-21T00:00:11.886 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-21T00:00:11.898 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-21T00:00:11.900 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-21T00:00:11.901 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-21T00:00:11.905 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal InRelease 2021-10-21T00:00:11.906 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-21T00:00:11.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-10-21T00:00:11.943 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-21T00:00:11.944 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-21T00:00:11.965 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-21T00:00:11.966 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal Release.gpg 2021-10-21T00:00:11.966 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-10-21T00:00:11.968 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-21T00:00:11.969 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-21T00:00:11.975 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-21T00:00:11.979 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main i386 Packages [3,068 B] 2021-10-21T00:00:12.026 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-10-21T00:00:12.040 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-10-21T00:00:12.050 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-21T00:00:12.052 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-21T00:00:12.076 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-21T00:00:12.123 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-10-21T00:00:12.263 INFO:teuthology.orchestra.run.smithi041.stdout:Fetched 26.5 kB in 1s (41.8 kB/s) 2021-10-21T00:00:12.412 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 26.5 kB in 1s (42.6 kB/s) 2021-10-21T00:00:12.424 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 26.5 kB in 1s (41.7 kB/s) 2021-10-21T00:00:12.449 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 26.5 kB in 1s (40.6 kB/s) 2021-10-21T00:00:12.503 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 26.5 kB in 1s (41.7 kB/s) 2021-10-21T00:00:13.079 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-21T00:00:13.103 DEBUG:teuthology.orchestra.run.smithi041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:13.173 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-21T00:00:13.199 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-21T00:00:13.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:13.238 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-21T00:00:13.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:13.258 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-21T00:00:13.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:13.292 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-21T00:00:13.314 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-21T00:00:13.332 INFO:teuthology.orchestra.run.smithi041.stdout:Building dependency tree... 2021-10-21T00:00:13.333 INFO:teuthology.orchestra.run.smithi041.stdout:Reading state information... 2021-10-21T00:00:13.333 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-21T00:00:13.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-138-g3fb760aa-1focal cephadm=15.2.14-138-g3fb760aa-1focal ceph-mds=15.2.14-138-g3fb760aa-1focal ceph-mgr=15.2.14-138-g3fb760aa-1focal ceph-common=15.2.14-138-g3fb760aa-1focal ceph-fuse=15.2.14-138-g3fb760aa-1focal ceph-test=15.2.14-138-g3fb760aa-1focal radosgw=15.2.14-138-g3fb760aa-1focal python3-rados=15.2.14-138-g3fb760aa-1focal python3-rgw=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal python3-rbd=15.2.14-138-g3fb760aa-1focal libcephfs2=15.2.14-138-g3fb760aa-1focal libcephfs-dev=15.2.14-138-g3fb760aa-1focal librados2=15.2.14-138-g3fb760aa-1focal librbd1=15.2.14-138-g3fb760aa-1focal rbd-fuse=15.2.14-138-g3fb760aa-1focal python3-cephfs=15.2.14-138-g3fb760aa-1focal cephfs-shell=15.2.14-138-g3fb760aa-1focal 2021-10-21T00:00:13.356 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-21T00:00:13.402 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-21T00:00:13.451 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2021-10-21T00:00:13.451 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2021-10-21T00:00:13.462 INFO:teuthology.orchestra.run.smithi041.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:00:13.462 INFO:teuthology.orchestra.run.smithi041.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:00:13.462 INFO:teuthology.orchestra.run.smithi041.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:00:13.463 INFO:teuthology.orchestra.run.smithi041.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:00:13.463 INFO:teuthology.orchestra.run.smithi041.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:00:13.463 INFO:teuthology.orchestra.run.smithi041.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:00:13.463 INFO:teuthology.orchestra.run.smithi041.stdout:The following additional packages will be installed: 2021-10-21T00:00:13.464 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.470 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.471 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-21T00:00:13.471 INFO:teuthology.orchestra.run.smithi041.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-21T00:00:13.472 INFO:teuthology.orchestra.run.smithi041.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-21T00:00:13.472 INFO:teuthology.orchestra.run.smithi041.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-21T00:00:13.472 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-21T00:00:13.472 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-21T00:00:13.474 INFO:teuthology.orchestra.run.smithi041.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-21T00:00:13.475 INFO:teuthology.orchestra.run.smithi041.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-21T00:00:13.475 INFO:teuthology.orchestra.run.smithi041.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-21T00:00:13.475 INFO:teuthology.orchestra.run.smithi041.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-21T00:00:13.476 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-21T00:00:13.476 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-21T00:00:13.476 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-21T00:00:13.476 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-21T00:00:13.477 INFO:teuthology.orchestra.run.smithi041.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-21T00:00:13.477 INFO:teuthology.orchestra.run.smithi041.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-21T00:00:13.477 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-21T00:00:13.477 INFO:teuthology.orchestra.run.smithi041.stdout: xmlstarlet 2021-10-21T00:00:13.477 INFO:teuthology.orchestra.run.smithi041.stdout:Suggested packages: 2021-10-21T00:00:13.478 INFO:teuthology.orchestra.run.smithi041.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-21T00:00:13.478 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-21T00:00:13.478 INFO:teuthology.orchestra.run.smithi041.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-21T00:00:13.479 INFO:teuthology.orchestra.run.smithi041.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-21T00:00:13.479 INFO:teuthology.orchestra.run.smithi041.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-21T00:00:13.479 INFO:teuthology.orchestra.run.smithi041.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-21T00:00:13.480 INFO:teuthology.orchestra.run.smithi041.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-21T00:00:13.480 INFO:teuthology.orchestra.run.smithi041.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-21T00:00:13.480 INFO:teuthology.orchestra.run.smithi041.stdout:Recommended packages: 2021-10-21T00:00:13.481 INFO:teuthology.orchestra.run.smithi041.stdout: btrfs-tools 2021-10-21T00:00:13.492 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-10-21T00:00:13.493 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-10-21T00:00:13.516 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-10-21T00:00:13.517 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-10-21T00:00:13.551 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-10-21T00:00:13.552 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-10-21T00:00:13.570 INFO:teuthology.orchestra.run.smithi041.stdout:The following NEW packages will be installed: 2021-10-21T00:00:13.571 INFO:teuthology.orchestra.run.smithi041.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-21T00:00:13.575 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.575 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.575 INFO:teuthology.orchestra.run.smithi041.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-21T00:00:13.575 INFO:teuthology.orchestra.run.smithi041.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-21T00:00:13.576 INFO:teuthology.orchestra.run.smithi041.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-21T00:00:13.576 INFO:teuthology.orchestra.run.smithi041.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-21T00:00:13.576 INFO:teuthology.orchestra.run.smithi041.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-21T00:00:13.576 INFO:teuthology.orchestra.run.smithi041.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-21T00:00:13.576 INFO:teuthology.orchestra.run.smithi041.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-21T00:00:13.577 INFO:teuthology.orchestra.run.smithi041.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-21T00:00:13.577 INFO:teuthology.orchestra.run.smithi041.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-21T00:00:13.577 INFO:teuthology.orchestra.run.smithi041.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-21T00:00:13.577 INFO:teuthology.orchestra.run.smithi041.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-21T00:00:13.578 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-21T00:00:13.578 INFO:teuthology.orchestra.run.smithi041.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-21T00:00:13.578 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-21T00:00:13.578 INFO:teuthology.orchestra.run.smithi041.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-21T00:00:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-21T00:00:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-21T00:00:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-21T00:00:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-21T00:00:13.579 INFO:teuthology.orchestra.run.smithi041.stdout:The following packages will be upgraded: 2021-10-21T00:00:13.580 INFO:teuthology.orchestra.run.smithi041.stdout: librados2 librbd1 2021-10-21T00:00:13.586 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:00:13.587 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:00:13.587 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:00:13.588 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:00:13.588 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:00:13.588 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:00:13.590 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2021-10-21T00:00:13.590 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.591 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.592 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-21T00:00:13.602 INFO:teuthology.orchestra.run.smithi071.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-21T00:00:13.604 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-21T00:00:13.604 INFO:teuthology.orchestra.run.smithi071.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-21T00:00:13.604 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-21T00:00:13.605 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-21T00:00:13.605 INFO:teuthology.orchestra.run.smithi071.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-21T00:00:13.605 INFO:teuthology.orchestra.run.smithi071.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-21T00:00:13.605 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-21T00:00:13.606 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-21T00:00:13.606 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-21T00:00:13.606 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-21T00:00:13.606 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-21T00:00:13.607 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-21T00:00:13.607 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-21T00:00:13.607 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-21T00:00:13.607 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-21T00:00:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet 2021-10-21T00:00:13.608 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2021-10-21T00:00:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-21T00:00:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-21T00:00:13.609 INFO:teuthology.orchestra.run.smithi071.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-21T00:00:13.609 INFO:teuthology.orchestra.run.smithi071.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-21T00:00:13.609 INFO:teuthology.orchestra.run.smithi071.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-21T00:00:13.609 INFO:teuthology.orchestra.run.smithi071.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-21T00:00:13.609 INFO:teuthology.orchestra.run.smithi071.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-21T00:00:13.610 INFO:teuthology.orchestra.run.smithi071.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-21T00:00:13.622 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2021-10-21T00:00:13.622 INFO:teuthology.orchestra.run.smithi071.stdout: btrfs-tools 2021-10-21T00:00:13.638 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:00:13.638 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:00:13.639 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:00:13.639 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:00:13.639 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:00:13.639 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:00:13.639 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2021-10-21T00:00:13.641 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.641 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.641 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-21T00:00:13.641 INFO:teuthology.orchestra.run.smithi099.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-21T00:00:13.642 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-21T00:00:13.642 INFO:teuthology.orchestra.run.smithi099.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-21T00:00:13.642 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-21T00:00:13.642 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-21T00:00:13.643 INFO:teuthology.orchestra.run.smithi099.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-21T00:00:13.643 INFO:teuthology.orchestra.run.smithi099.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-21T00:00:13.643 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-21T00:00:13.643 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-21T00:00:13.643 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-21T00:00:13.644 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-21T00:00:13.644 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-21T00:00:13.651 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-21T00:00:13.652 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-21T00:00:13.652 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-21T00:00:13.653 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-21T00:00:13.653 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet 2021-10-21T00:00:13.654 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2021-10-21T00:00:13.655 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-21T00:00:13.655 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-21T00:00:13.656 INFO:teuthology.orchestra.run.smithi099.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-21T00:00:13.656 INFO:teuthology.orchestra.run.smithi099.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-21T00:00:13.657 INFO:teuthology.orchestra.run.smithi099.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-21T00:00:13.657 INFO:teuthology.orchestra.run.smithi099.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-21T00:00:13.657 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-21T00:00:13.658 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-21T00:00:13.658 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2021-10-21T00:00:13.659 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2021-10-21T00:00:13.699 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:00:13.699 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:00:13.699 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:00:13.699 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:00:13.700 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:00:13.700 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:00:13.700 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2021-10-21T00:00:13.700 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.701 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.701 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-21T00:00:13.701 INFO:teuthology.orchestra.run.smithi062.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-21T00:00:13.701 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-21T00:00:13.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-21T00:00:13.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-21T00:00:13.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-21T00:00:13.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-21T00:00:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-21T00:00:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-21T00:00:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-21T00:00:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-21T00:00:13.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-21T00:00:13.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-21T00:00:13.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-21T00:00:13.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-21T00:00:13.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-21T00:00:13.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-21T00:00:13.705 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet 2021-10-21T00:00:13.705 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-10-21T00:00:13.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-21T00:00:13.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-21T00:00:13.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-21T00:00:13.707 INFO:teuthology.orchestra.run.smithi062.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-21T00:00:13.707 INFO:teuthology.orchestra.run.smithi062.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-21T00:00:13.708 INFO:teuthology.orchestra.run.smithi062.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-21T00:00:13.708 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-21T00:00:13.708 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-21T00:00:13.708 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2021-10-21T00:00:13.709 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2021-10-21T00:00:13.712 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:00:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:00:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:00:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:00:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:00:13.714 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:00:13.714 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2021-10-21T00:00:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-10-21T00:00:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-10-21T00:00:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-10-21T00:00:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-10-21T00:00:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-10-21T00:00:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-10-21T00:00:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-10-21T00:00:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-10-21T00:00:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-10-21T00:00:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-10-21T00:00:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-10-21T00:00:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-10-21T00:00:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-10-21T00:00:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-10-21T00:00:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-10-21T00:00:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-10-21T00:00:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-10-21T00:00:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet 2021-10-21T00:00:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-10-21T00:00:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-10-21T00:00:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-10-21T00:00:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-10-21T00:00:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-10-21T00:00:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-10-21T00:00:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-10-21T00:00:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-10-21T00:00:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-10-21T00:00:13.722 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2021-10-21T00:00:13.722 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2021-10-21T00:00:13.723 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2021-10-21T00:00:13.723 INFO:teuthology.orchestra.run.smithi071.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-21T00:00:13.723 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.724 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.724 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-21T00:00:13.724 INFO:teuthology.orchestra.run.smithi071.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-21T00:00:13.724 INFO:teuthology.orchestra.run.smithi071.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-21T00:00:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-21T00:00:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-21T00:00:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-21T00:00:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-21T00:00:13.725 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-21T00:00:13.726 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-21T00:00:13.726 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-21T00:00:13.726 INFO:teuthology.orchestra.run.smithi071.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-21T00:00:13.726 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-21T00:00:13.727 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-21T00:00:13.727 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-21T00:00:13.728 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-21T00:00:13.728 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-21T00:00:13.728 INFO:teuthology.orchestra.run.smithi071.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-21T00:00:13.728 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-21T00:00:13.729 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-21T00:00:13.729 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages will be upgraded: 2021-10-21T00:00:13.729 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 librbd1 2021-10-21T00:00:13.730 INFO:teuthology.orchestra.run.smithi041.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:00:13.730 INFO:teuthology.orchestra.run.smithi041.stdout:Need to get 153 MB of archives. 2021-10-21T00:00:13.730 INFO:teuthology.orchestra.run.smithi041.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-21T00:00:13.731 INFO:teuthology.orchestra.run.smithi041.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-21T00:00:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2021-10-21T00:00:13.741 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-21T00:00:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.743 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-21T00:00:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-21T00:00:13.745 INFO:teuthology.orchestra.run.smithi099.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-21T00:00:13.746 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-21T00:00:13.747 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-21T00:00:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-21T00:00:13.748 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-21T00:00:13.749 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-21T00:00:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-21T00:00:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-21T00:00:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-21T00:00:13.750 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-21T00:00:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-21T00:00:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-21T00:00:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-21T00:00:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-21T00:00:13.752 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-21T00:00:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-21T00:00:13.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-21T00:00:13.760 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2021-10-21T00:00:13.761 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 librbd1 2021-10-21T00:00:13.761 INFO:teuthology.orchestra.run.smithi041.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-21T00:00:13.772 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-10-21T00:00:13.772 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-21T00:00:13.773 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.774 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.780 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-21T00:00:13.780 INFO:teuthology.orchestra.run.smithi062.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-21T00:00:13.781 INFO:teuthology.orchestra.run.smithi062.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-21T00:00:13.781 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-21T00:00:13.781 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-21T00:00:13.782 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-21T00:00:13.782 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-21T00:00:13.782 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-21T00:00:13.782 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-21T00:00:13.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-21T00:00:13.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-21T00:00:13.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-21T00:00:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-21T00:00:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-21T00:00:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-21T00:00:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-21T00:00:13.786 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-21T00:00:13.786 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-21T00:00:13.786 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-21T00:00:13.786 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2021-10-21T00:00:13.787 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 librbd1 2021-10-21T00:00:13.788 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-10-21T00:00:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-10-21T00:00:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-10-21T00:00:13.789 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-10-21T00:00:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-10-21T00:00:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-10-21T00:00:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-10-21T00:00:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-10-21T00:00:13.791 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-10-21T00:00:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-10-21T00:00:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-10-21T00:00:13.792 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-10-21T00:00:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-10-21T00:00:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-10-21T00:00:13.793 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-10-21T00:00:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-10-21T00:00:13.794 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-10-21T00:00:13.795 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-10-21T00:00:13.796 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-10-21T00:00:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-10-21T00:00:13.797 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-10-21T00:00:13.798 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-10-21T00:00:13.799 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-10-21T00:00:13.800 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2021-10-21T00:00:13.800 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 librbd1 2021-10-21T00:00:13.842 INFO:teuthology.orchestra.run.smithi071.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:00:13.843 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 153 MB of archives. 2021-10-21T00:00:13.843 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-21T00:00:13.843 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-21T00:00:13.844 INFO:teuthology.orchestra.run.smithi041.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-21T00:00:13.887 INFO:teuthology.orchestra.run.smithi041.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-21T00:00:13.888 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-21T00:00:13.922 INFO:teuthology.orchestra.run.smithi041.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-21T00:00:13.922 INFO:teuthology.orchestra.run.smithi099.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:00:13.923 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 153 MB of archives. 2021-10-21T00:00:13.923 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-21T00:00:13.923 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-21T00:00:13.960 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-21T00:00:13.960 INFO:teuthology.orchestra.run.smithi062.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:00:13.961 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 153 MB of archives. 2021-10-21T00:00:13.961 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-21T00:00:13.961 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-21T00:00:13.961 INFO:teuthology.orchestra.run.smithi102.stdout:2 upgraded, 101 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:00:13.962 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 153 MB of archives. 2021-10-21T00:00:13.962 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 698 MB of additional disk space will be used. 2021-10-21T00:00:13.962 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-138-g3fb760aa-1focal [1,695 kB] 2021-10-21T00:00:13.962 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-21T00:00:13.963 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-21T00:00:13.967 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-21T00:00:13.969 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-10-21T00:00:13.985 INFO:teuthology.orchestra.run.smithi041.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-21T00:00:14.019 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-21T00:00:14.026 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-21T00:00:14.051 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-21T00:00:14.053 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-10-21T00:00:14.076 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-21T00:00:14.081 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-21T00:00:14.082 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-10-21T00:00:14.089 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-21T00:00:14.109 INFO:teuthology.orchestra.run.smithi041.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-21T00:00:14.121 INFO:teuthology.orchestra.run.smithi041.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-21T00:00:14.121 INFO:teuthology.orchestra.run.smithi041.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-21T00:00:14.132 INFO:teuthology.orchestra.run.smithi041.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-21T00:00:14.138 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-21T00:00:14.148 INFO:teuthology.orchestra.run.smithi041.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-21T00:00:14.162 INFO:teuthology.orchestra.run.smithi041.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-21T00:00:14.163 INFO:teuthology.orchestra.run.smithi041.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-21T00:00:14.166 INFO:teuthology.orchestra.run.smithi041.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-21T00:00:14.167 INFO:teuthology.orchestra.run.smithi041.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-21T00:00:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-21T00:00:14.192 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-10-21T00:00:14.205 INFO:teuthology.orchestra.run.smithi041.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-21T00:00:14.229 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-21T00:00:14.233 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-21T00:00:14.242 INFO:teuthology.orchestra.run.smithi041.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-21T00:00:14.253 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-21T00:00:14.267 INFO:teuthology.orchestra.run.smithi041.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-21T00:00:14.273 INFO:teuthology.orchestra.run.smithi041.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-21T00:00:14.295 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-21T00:00:14.297 INFO:teuthology.orchestra.run.smithi041.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-21T00:00:14.302 INFO:teuthology.orchestra.run.smithi041.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-21T00:00:14.303 INFO:teuthology.orchestra.run.smithi041.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-21T00:00:14.307 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-21T00:00:14.323 INFO:teuthology.orchestra.run.smithi041.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-21T00:00:14.324 INFO:teuthology.orchestra.run.smithi041.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-21T00:00:14.324 INFO:teuthology.orchestra.run.smithi041.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-21T00:00:14.335 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-21T00:00:14.336 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-21T00:00:14.336 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-10-21T00:00:14.336 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-21T00:00:14.337 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-10-21T00:00:14.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-21T00:00:14.353 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-21T00:00:14.354 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-10-21T00:00:14.365 INFO:teuthology.orchestra.run.smithi041.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-21T00:00:14.368 INFO:teuthology.orchestra.run.smithi041.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-21T00:00:14.370 INFO:teuthology.orchestra.run.smithi041.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-21T00:00:14.376 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-21T00:00:14.382 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-21T00:00:14.383 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-21T00:00:14.408 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-21T00:00:14.412 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-21T00:00:14.414 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-21T00:00:14.425 INFO:teuthology.orchestra.run.smithi041.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-21T00:00:14.428 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-21T00:00:14.429 INFO:teuthology.orchestra.run.smithi041.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-21T00:00:14.431 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-21T00:00:14.431 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-21T00:00:14.433 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-21T00:00:14.433 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-21T00:00:14.451 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-21T00:00:14.460 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-21T00:00:14.471 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-21T00:00:14.472 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-10-21T00:00:14.474 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-21T00:00:14.474 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-21T00:00:14.475 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-21T00:00:14.475 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-21T00:00:14.475 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-21T00:00:14.477 INFO:teuthology.orchestra.run.smithi041.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-21T00:00:14.478 INFO:teuthology.orchestra.run.smithi041.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-21T00:00:14.478 INFO:teuthology.orchestra.run.smithi041.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-21T00:00:14.478 INFO:teuthology.orchestra.run.smithi041.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-21T00:00:14.478 INFO:teuthology.orchestra.run.smithi041.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-21T00:00:14.479 INFO:teuthology.orchestra.run.smithi041.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-21T00:00:14.479 INFO:teuthology.orchestra.run.smithi041.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-21T00:00:14.480 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-21T00:00:14.480 INFO:teuthology.orchestra.run.smithi041.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-21T00:00:14.481 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-21T00:00:14.481 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-21T00:00:14.481 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-21T00:00:14.486 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-21T00:00:14.486 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-21T00:00:14.491 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-21T00:00:14.493 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-21T00:00:14.507 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-21T00:00:14.510 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-10-21T00:00:14.512 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-21T00:00:14.513 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-21T00:00:14.515 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-21T00:00:14.516 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-10-21T00:00:14.516 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-21T00:00:14.517 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-21T00:00:14.518 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-21T00:00:14.538 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-10-21T00:00:14.538 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-10-21T00:00:14.538 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-21T00:00:14.539 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-21T00:00:14.539 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-21T00:00:14.539 INFO:teuthology.orchestra.run.smithi041.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-21T00:00:14.539 INFO:teuthology.orchestra.run.smithi041.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-21T00:00:14.540 INFO:teuthology.orchestra.run.smithi041.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-21T00:00:14.540 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-10-21T00:00:14.546 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-21T00:00:14.563 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-10-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-10-21T00:00:14.564 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-10-21T00:00:14.570 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-21T00:00:14.570 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-21T00:00:14.571 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-21T00:00:14.571 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-21T00:00:14.571 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-21T00:00:14.571 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-21T00:00:14.580 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-21T00:00:14.582 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-21T00:00:14.583 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-21T00:00:14.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-10-21T00:00:14.596 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-21T00:00:14.612 INFO:teuthology.orchestra.run.smithi041.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-21T00:00:14.616 INFO:teuthology.orchestra.run.smithi041.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-21T00:00:14.620 INFO:teuthology.orchestra.run.smithi041.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-21T00:00:14.621 INFO:teuthology.orchestra.run.smithi041.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-21T00:00:14.623 INFO:teuthology.orchestra.run.smithi041.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-21T00:00:14.625 INFO:teuthology.orchestra.run.smithi041.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-21T00:00:14.626 INFO:teuthology.orchestra.run.smithi041.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-21T00:00:14.627 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-21T00:00:14.630 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-21T00:00:14.631 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-21T00:00:14.634 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-21T00:00:14.637 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-10-21T00:00:14.637 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-10-21T00:00:14.638 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-21T00:00:14.639 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-21T00:00:14.640 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-21T00:00:14.640 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-21T00:00:14.644 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-21T00:00:14.646 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-21T00:00:14.646 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-21T00:00:14.647 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-21T00:00:14.647 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-21T00:00:14.650 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-21T00:00:14.651 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-21T00:00:14.663 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-21T00:00:14.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-10-21T00:00:14.665 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-10-21T00:00:14.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-10-21T00:00:14.675 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-21T00:00:14.677 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-10-21T00:00:14.677 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-10-21T00:00:14.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-10-21T00:00:14.692 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-10-21T00:00:14.694 INFO:teuthology.orchestra.run.smithi041.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-21T00:00:14.694 INFO:teuthology.orchestra.run.smithi041.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-21T00:00:14.713 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-21T00:00:14.714 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-21T00:00:14.716 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-21T00:00:14.743 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-21T00:00:14.744 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-21T00:00:14.744 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-21T00:00:14.744 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-21T00:00:14.745 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-21T00:00:14.806 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-21T00:00:14.806 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-21T00:00:14.807 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-21T00:00:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-21T00:00:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-21T00:00:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-21T00:00:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-21T00:00:14.809 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-10-21T00:00:14.810 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-10-21T00:00:14.810 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-10-21T00:00:14.810 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-21T00:00:14.836 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-21T00:00:14.837 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-21T00:00:14.837 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-21T00:00:14.837 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-21T00:00:14.840 INFO:teuthology.orchestra.run.smithi071.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-21T00:00:14.842 INFO:teuthology.orchestra.run.smithi071.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-21T00:00:14.843 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-21T00:00:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-21T00:00:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-21T00:00:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-21T00:00:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-21T00:00:14.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-21T00:00:14.845 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-21T00:00:14.882 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-10-21T00:00:14.900 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-21T00:00:14.900 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-21T00:00:14.901 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-10-21T00:00:14.901 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-10-21T00:00:14.901 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-10-21T00:00:14.928 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-10-21T00:00:14.929 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-10-21T00:00:14.930 INFO:teuthology.orchestra.run.smithi071.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-21T00:00:14.931 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-10-21T00:00:14.931 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-21T00:00:14.931 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-21T00:00:14.932 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-21T00:00:14.932 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-21T00:00:14.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-10-21T00:00:15.000 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-10-21T00:00:15.176 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-21T00:00:15.362 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-138-g3fb760aa-1focal [3,246 kB] 2021-10-21T00:00:15.501 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-21T00:00:15.533 INFO:teuthology.orchestra.run.smithi071.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-21T00:00:15.609 INFO:teuthology.orchestra.run.smithi041.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-21T00:00:15.755 INFO:teuthology.orchestra.run.smithi041.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-21T00:00:15.758 INFO:teuthology.orchestra.run.smithi041.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-21T00:00:15.788 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-21T00:00:15.807 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-21T00:00:15.822 INFO:teuthology.orchestra.run.smithi041.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-21T00:00:15.822 INFO:teuthology.orchestra.run.smithi041.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-21T00:00:15.823 INFO:teuthology.orchestra.run.smithi041.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-21T00:00:15.823 INFO:teuthology.orchestra.run.smithi041.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-21T00:00:15.824 INFO:teuthology.orchestra.run.smithi041.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-21T00:00:15.824 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-21T00:00:15.825 INFO:teuthology.orchestra.run.smithi041.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-21T00:00:15.825 INFO:teuthology.orchestra.run.smithi041.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-21T00:00:15.832 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-21T00:00:15.833 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-21T00:00:15.837 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-21T00:00:15.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-21T00:00:15.852 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-10-21T00:00:15.871 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-21T00:00:15.873 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-21T00:00:15.889 INFO:teuthology.orchestra.run.smithi071.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-21T00:00:15.896 INFO:teuthology.orchestra.run.smithi071.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-21T00:00:15.897 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-21T00:00:15.900 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-21T00:00:15.915 INFO:teuthology.orchestra.run.smithi071.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-21T00:00:15.932 INFO:teuthology.orchestra.run.smithi071.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-21T00:00:15.932 INFO:teuthology.orchestra.run.smithi071.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-21T00:00:15.932 INFO:teuthology.orchestra.run.smithi071.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-21T00:00:15.933 INFO:teuthology.orchestra.run.smithi071.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-21T00:00:15.933 INFO:teuthology.orchestra.run.smithi071.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-21T00:00:15.934 INFO:teuthology.orchestra.run.smithi071.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-21T00:00:15.935 INFO:teuthology.orchestra.run.smithi041.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-21T00:00:15.936 INFO:teuthology.orchestra.run.smithi041.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-21T00:00:15.936 INFO:teuthology.orchestra.run.smithi041.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-21T00:00:15.936 INFO:teuthology.orchestra.run.smithi041.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-21T00:00:15.936 INFO:teuthology.orchestra.run.smithi041.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-21T00:00:15.937 INFO:teuthology.orchestra.run.smithi041.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-21T00:00:15.937 INFO:teuthology.orchestra.run.smithi041.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-21T00:00:15.942 INFO:teuthology.orchestra.run.smithi041.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-21T00:00:15.943 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-21T00:00:15.944 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-21T00:00:15.945 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-21T00:00:15.945 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-21T00:00:15.946 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-21T00:00:15.947 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-21T00:00:15.947 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-21T00:00:15.949 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-21T00:00:15.950 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-21T00:00:15.951 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-21T00:00:15.951 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-21T00:00:15.952 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-21T00:00:15.952 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-21T00:00:15.953 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-21T00:00:15.953 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-21T00:00:15.972 INFO:teuthology.orchestra.run.smithi041.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-21T00:00:15.972 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-10-21T00:00:15.972 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-10-21T00:00:15.973 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-21T00:00:15.973 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-21T00:00:15.975 INFO:teuthology.orchestra.run.smithi041.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-21T00:00:16.000 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-21T00:00:16.000 INFO:teuthology.orchestra.run.smithi071.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-21T00:00:16.000 INFO:teuthology.orchestra.run.smithi071.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-21T00:00:16.001 INFO:teuthology.orchestra.run.smithi071.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-21T00:00:16.016 INFO:teuthology.orchestra.run.smithi071.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-21T00:00:16.017 INFO:teuthology.orchestra.run.smithi071.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-21T00:00:16.017 INFO:teuthology.orchestra.run.smithi071.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-21T00:00:16.017 INFO:teuthology.orchestra.run.smithi071.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-21T00:00:16.018 INFO:teuthology.orchestra.run.smithi071.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-21T00:00:16.032 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-21T00:00:16.037 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-21T00:00:16.039 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-21T00:00:16.041 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-21T00:00:16.046 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-21T00:00:16.047 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-21T00:00:16.061 INFO:teuthology.orchestra.run.smithi041.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-21T00:00:16.062 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-21T00:00:16.063 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-21T00:00:16.063 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-21T00:00:16.068 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-21T00:00:16.068 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-21T00:00:16.069 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-21T00:00:16.073 INFO:teuthology.orchestra.run.smithi041.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-21T00:00:16.074 INFO:teuthology.orchestra.run.smithi041.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-21T00:00:16.074 INFO:teuthology.orchestra.run.smithi041.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-21T00:00:16.074 INFO:teuthology.orchestra.run.smithi041.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-21T00:00:16.074 INFO:teuthology.orchestra.run.smithi041.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-21T00:00:16.075 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-21T00:00:16.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-10-21T00:00:16.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-10-21T00:00:16.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-10-21T00:00:16.078 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-21T00:00:16.078 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-10-21T00:00:16.080 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-10-21T00:00:16.081 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-21T00:00:16.081 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-21T00:00:16.083 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-10-21T00:00:16.084 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-10-21T00:00:16.088 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-21T00:00:16.101 INFO:teuthology.orchestra.run.smithi041.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-21T00:00:16.106 INFO:teuthology.orchestra.run.smithi041.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-21T00:00:16.107 INFO:teuthology.orchestra.run.smithi071.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-21T00:00:16.124 INFO:teuthology.orchestra.run.smithi071.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-21T00:00:16.137 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-21T00:00:16.142 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-21T00:00:16.143 INFO:teuthology.orchestra.run.smithi041.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-21T00:00:16.144 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-21T00:00:16.145 INFO:teuthology.orchestra.run.smithi041.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-21T00:00:16.148 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-10-21T00:00:16.149 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-10-21T00:00:16.149 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-21T00:00:16.150 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-21T00:00:16.151 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-21T00:00:16.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-21T00:00:16.153 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-21T00:00:16.174 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-21T00:00:16.175 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-21T00:00:16.176 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-21T00:00:16.182 INFO:teuthology.orchestra.run.smithi071.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-21T00:00:16.190 INFO:teuthology.orchestra.run.smithi071.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-21T00:00:16.190 INFO:teuthology.orchestra.run.smithi071.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-21T00:00:16.191 INFO:teuthology.orchestra.run.smithi071.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-21T00:00:16.191 INFO:teuthology.orchestra.run.smithi071.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-21T00:00:16.192 INFO:teuthology.orchestra.run.smithi071.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-21T00:00:16.212 INFO:teuthology.orchestra.run.smithi071.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-21T00:00:16.213 INFO:teuthology.orchestra.run.smithi071.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-21T00:00:16.219 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-21T00:00:16.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-21T00:00:16.223 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-21T00:00:16.224 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-21T00:00:16.243 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-10-21T00:00:16.243 INFO:teuthology.orchestra.run.smithi041.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-21T00:00:16.244 INFO:teuthology.orchestra.run.smithi041.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-21T00:00:16.244 INFO:teuthology.orchestra.run.smithi041.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-21T00:00:16.244 INFO:teuthology.orchestra.run.smithi041.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-21T00:00:16.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-21T00:00:16.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-21T00:00:16.251 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-10-21T00:00:16.252 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-21T00:00:16.253 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-21T00:00:16.257 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-10-21T00:00:16.259 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-21T00:00:16.259 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-10-21T00:00:16.261 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-10-21T00:00:16.261 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-21T00:00:16.263 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-21T00:00:16.264 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-21T00:00:16.268 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-21T00:00:16.269 INFO:teuthology.orchestra.run.smithi071.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-21T00:00:16.270 INFO:teuthology.orchestra.run.smithi071.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-21T00:00:16.275 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-10-21T00:00:16.280 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-10-21T00:00:16.289 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-10-21T00:00:16.301 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-21T00:00:16.304 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-21T00:00:16.316 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-10-21T00:00:16.329 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-10-21T00:00:16.353 INFO:teuthology.orchestra.run.smithi071.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-21T00:00:16.353 INFO:teuthology.orchestra.run.smithi071.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-21T00:00:16.354 INFO:teuthology.orchestra.run.smithi071.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-21T00:00:16.357 INFO:teuthology.orchestra.run.smithi071.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-21T00:00:16.387 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-21T00:00:16.388 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-21T00:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-10-21T00:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-10-21T00:00:16.414 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-10-21T00:00:16.415 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-10-21T00:00:16.467 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-10-21T00:00:16.468 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-10-21T00:00:16.471 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-10-21T00:00:16.473 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-10-21T00:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-10-21T00:00:16.488 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-10-21T00:00:16.525 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-21T00:00:16.544 INFO:teuthology.orchestra.run.smithi041.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-21T00:00:16.562 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-10-21T00:00:16.571 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-10-21T00:00:16.621 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-21T00:00:16.640 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-21T00:00:16.643 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-21T00:00:16.719 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-21T00:00:16.722 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-21T00:00:16.734 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-21T00:00:16.762 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-21T00:00:16.775 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-21T00:00:16.859 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-21T00:00:17.053 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-138-g3fb760aa-1focal [463 kB] 2021-10-21T00:00:17.089 INFO:teuthology.orchestra.run.smithi041.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-21T00:00:17.110 INFO:teuthology.orchestra.run.smithi041.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-21T00:00:17.287 INFO:teuthology.orchestra.run.smithi071.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-21T00:00:17.292 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-138-g3fb760aa-1focal [365 kB] 2021-10-21T00:00:17.357 INFO:teuthology.orchestra.run.smithi041.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-21T00:00:17.542 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-138-g3fb760aa-1focal [20.8 kB] 2021-10-21T00:00:17.543 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-138-g3fb760aa-1focal [156 kB] 2021-10-21T00:00:17.632 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-138-g3fb760aa-1focal [29.4 kB] 2021-10-21T00:00:17.654 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-138-g3fb760aa-1focal [363 kB] 2021-10-21T00:00:17.769 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-138-g3fb760aa-1focal [3,139 kB] 2021-10-21T00:00:17.853 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-21T00:00:17.880 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-21T00:00:17.982 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-21T00:00:18.115 INFO:teuthology.orchestra.run.smithi071.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-21T00:00:18.141 INFO:teuthology.orchestra.run.smithi071.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-21T00:00:18.364 INFO:teuthology.orchestra.run.smithi041.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-21T00:00:18.365 INFO:teuthology.orchestra.run.smithi071.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-21T00:00:18.691 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-138-g3fb760aa-1focal [116 kB] 2021-10-21T00:00:18.711 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-138-g3fb760aa-1focal [361 kB] 2021-10-21T00:00:18.807 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-138-g3fb760aa-1focal [20.0 MB] 2021-10-21T00:00:19.113 INFO:teuthology.orchestra.run.smithi071.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-21T00:00:20.974 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-21T00:00:21.524 INFO:teuthology.orchestra.run.smithi041.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-21T00:00:21.524 INFO:teuthology.orchestra.run.smithi041.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-21T00:00:21.543 INFO:teuthology.orchestra.run.smithi041.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-21T00:00:21.813 INFO:teuthology.orchestra.run.smithi041.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-21T00:00:21.828 INFO:teuthology.orchestra.run.smithi041.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-21T00:00:21.829 INFO:teuthology.orchestra.run.smithi041.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-21T00:00:21.885 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-21T00:00:21.916 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-21T00:00:22.150 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-21T00:00:22.216 INFO:teuthology.orchestra.run.smithi071.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-21T00:00:22.216 INFO:teuthology.orchestra.run.smithi071.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-21T00:00:22.241 INFO:teuthology.orchestra.run.smithi071.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-21T00:00:22.268 INFO:teuthology.orchestra.run.smithi041.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-21T00:00:22.269 INFO:teuthology.orchestra.run.smithi041.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-21T00:00:22.319 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-21T00:00:22.484 INFO:teuthology.orchestra.run.smithi071.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-21T00:00:22.504 INFO:teuthology.orchestra.run.smithi071.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-21T00:00:22.515 INFO:teuthology.orchestra.run.smithi071.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-21T00:00:22.921 INFO:teuthology.orchestra.run.smithi071.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-21T00:00:22.942 INFO:teuthology.orchestra.run.smithi071.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-21T00:00:23.099 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-138-g3fb760aa-1focal [5,334 kB] 2021-10-21T00:00:23.246 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-21T00:00:23.300 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-21T00:00:23.308 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-21T00:00:23.336 INFO:teuthology.orchestra.run.smithi041.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-21T00:00:23.336 INFO:teuthology.orchestra.run.smithi041.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-21T00:00:23.598 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-21T00:00:23.992 INFO:teuthology.orchestra.run.smithi071.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-21T00:00:23.993 INFO:teuthology.orchestra.run.smithi071.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-21T00:00:24.107 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-138-g3fb760aa-1focal [162 kB] 2021-10-21T00:00:24.146 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-138-g3fb760aa-1focal [1,402 kB] 2021-10-21T00:00:24.414 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-138-g3fb760aa-1focal [6,169 kB] 2021-10-21T00:00:24.777 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-21T00:00:25.610 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-138-g3fb760aa-1focal [23.9 MB] 2021-10-21T00:00:27.729 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-21T00:00:27.729 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-21T00:00:27.763 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-21T00:00:28.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-21T00:00:28.203 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-21T00:00:28.204 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-21T00:00:28.792 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-21T00:00:28.792 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-21T00:00:28.796 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-21T00:00:28.887 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-21T00:00:28.909 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-21T00:00:28.949 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-21T00:00:28.950 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-21T00:00:28.952 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-21T00:00:29.291 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-21T00:00:29.302 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-21T00:00:29.672 INFO:teuthology.orchestra.run.smithi041.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-21T00:00:29.673 INFO:teuthology.orchestra.run.smithi041.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-21T00:00:29.674 INFO:teuthology.orchestra.run.smithi041.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-21T00:00:29.827 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-138-g3fb760aa-1focal [4,008 B] 2021-10-21T00:00:29.829 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-138-g3fb760aa-1focal [538 kB] 2021-10-21T00:00:29.974 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-138-g3fb760aa-1focal [2,006 kB] 2021-10-21T00:00:30.071 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-21T00:00:30.072 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-21T00:00:30.146 INFO:teuthology.orchestra.run.smithi071.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-21T00:00:30.147 INFO:teuthology.orchestra.run.smithi071.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-21T00:00:30.147 INFO:teuthology.orchestra.run.smithi071.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-21T00:00:30.290 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-138-g3fb760aa-1focal [53.2 kB] 2021-10-21T00:00:30.317 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-138-g3fb760aa-1focal [58.2 kB] 2021-10-21T00:00:30.319 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-138-g3fb760aa-1focal [3,208 kB] 2021-10-21T00:00:30.728 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-21T00:00:30.728 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-21T00:00:31.173 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-138-g3fb760aa-1focal [34.4 kB] 2021-10-21T00:00:31.173 INFO:teuthology.orchestra.run.smithi041.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-21T00:00:31.174 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-138-g3fb760aa-1focal [7,876 kB] 2021-10-21T00:00:31.311 INFO:teuthology.orchestra.run.smithi071.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-21T00:00:31.773 INFO:teuthology.orchestra.run.smithi041.stdout:Fetched 153 MB in 18s (8,686 kB/s) 2021-10-21T00:00:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 153 MB in 18s (8,674 kB/s) 2021-10-21T00:00:31.949 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-21T00:00:32.022 INFO:teuthology.orchestra.run.smithi041.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-21T00:00:32.026 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-21T00:00:32.050 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-21T00:00:32.074 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-21T00:00:32.120 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-21T00:00:32.125 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-21T00:00:32.168 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-21T00:00:32.365 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-21T00:00:32.394 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-21T00:00:32.424 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:00:32.455 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-21T00:00:32.476 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-21T00:00:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-138-g3fb760aa-1focal [4,120 B] 2021-10-21T00:00:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-138-g3fb760aa-1focal [39.8 MB] 2021-10-21T00:00:32.514 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:00:32.767 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-cmd2. 2021-10-21T00:00:32.787 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-21T00:00:32.825 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:00:32.848 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cmd2. 2021-10-21T00:00:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-21T00:00:32.900 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:00:33.005 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-21T00:00:33.006 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-21T00:00:33.006 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-21T00:00:33.179 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-21T00:00:33.198 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-21T00:00:33.269 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:00:33.276 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-21T00:00:33.297 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-21T00:00:33.379 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-21T00:00:33.386 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:00:33.619 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:33.754 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:33.754 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:33.926 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:33.978 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 153 MB in 20s (7,796 kB/s) 2021-10-21T00:00:34.142 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-21T00:00:34.212 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-21T00:00:34.217 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-21T00:00:34.252 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-21T00:00:34.312 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:34.447 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:34.523 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:34.561 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-21T00:00:34.581 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-21T00:00:34.643 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:34.650 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:00:34.950 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2021-10-21T00:00:34.968 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-21T00:00:35.007 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:00:35.102 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libcephfs2. 2021-10-21T00:00:35.119 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:35.144 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:35.330 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs2. 2021-10-21T00:00:35.347 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:35.412 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:35.514 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-21T00:00:35.542 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-rados. 2021-10-21T00:00:35.565 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:35.592 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-21T00:00:35.593 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-21T00:00:35.644 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:35.710 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-21T00:00:35.728 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-21T00:00:35.771 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rados. 2021-10-21T00:00:35.795 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:35.805 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:00:35.834 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.022 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-21T00:00:36.041 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:36.081 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.147 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:36.163 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-21T00:00:36.171 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-138-g3fb760aa-1focal [15.9 kB] 2021-10-21T00:00:36.179 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-138-g3fb760aa-1focal [18.1 kB] 2021-10-21T00:00:36.180 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:36.181 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-138-g3fb760aa-1focal [9,719 kB] 2021-10-21T00:00:36.188 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-21T00:00:36.215 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.266 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:36.512 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-cephfs. 2021-10-21T00:00:36.516 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cephfs. 2021-10-21T00:00:36.528 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:36.530 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:36.583 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.601 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri5-testing-2021-10-20-0922-octopus/3fb760aae831e6138791851b7921f8f0e05db414/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-138-g3fb760aa-1focal [60.9 kB] 2021-10-21T00:00:36.760 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 153 MB in 22s (6,812 kB/s) 2021-10-21T00:00:36.863 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:36.869 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-21T00:00:36.889 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:36.919 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:36.922 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-21T00:00:36.945 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-21T00:00:36.964 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:36.987 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:36.988 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-21T00:00:36.993 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-21T00:00:37.004 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:37.030 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-21T00:00:37.164 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-prettytable. 2021-10-21T00:00:37.186 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-21T00:00:37.226 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-21T00:00:37.324 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 153 MB in 23s (6,662 kB/s) 2021-10-21T00:00:37.341 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-prettytable. 2021-10-21T00:00:37.355 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-21T00:00:37.358 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-21T00:00:37.376 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-21T00:00:37.398 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-21T00:00:37.403 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:00:37.484 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2021-10-21T00:00:37.505 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-rbd. 2021-10-21T00:00:37.531 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:37.555 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-10-21T00:00:37.558 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:37.561 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-10-21T00:00:37.600 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-10-21T00:00:37.634 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rbd. 2021-10-21T00:00:37.653 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:37.684 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:37.698 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2021-10-21T00:00:37.722 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:37.737 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cmd2. 2021-10-21T00:00:37.756 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-21T00:00:37.769 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:37.796 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:00:37.924 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-21T00:00:37.934 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2021-10-21T00:00:37.941 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-21T00:00:37.954 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-10-21T00:00:37.991 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:00:37.993 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:00:38.045 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-21T00:00:38.064 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-21T00:00:38.089 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2021-10-21T00:00:38.103 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:00:38.112 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:38.147 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:38.155 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-21T00:00:38.174 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-21T00:00:38.240 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:00:38.297 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-21T00:00:38.319 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-21T00:00:38.344 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2021-10-21T00:00:38.346 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:00:38.363 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-10-21T00:00:38.404 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:00:38.471 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-21T00:00:38.484 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-21T00:00:38.485 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-21T00:00:38.511 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:38.539 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:00:38.542 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:38.593 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:38.667 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package librgw2. 2021-10-21T00:00:38.687 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:38.694 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:38.726 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:38.736 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-10-21T00:00:38.758 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-10-21T00:00:38.861 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:00:38.862 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2021-10-21T00:00:38.951 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librgw2. 2021-10-21T00:00:38.952 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:38.952 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:38.953 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:38.978 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:39.218 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-librbd1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.268 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-rgw. 2021-10-21T00:00:39.281 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-21T00:00:39.281 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.298 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.300 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:39.332 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:39.339 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:39.383 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:39.401 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:39.503 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rgw. 2021-10-21T00:00:39.524 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.552 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:39.608 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2021-10-21T00:00:39.644 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-21T00:00:39.661 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-21T00:00:39.680 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-21T00:00:39.703 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-21T00:00:39.738 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:00:39.888 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-21T00:00:39.908 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-21T00:00:39.916 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2021-10-21T00:00:39.928 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-librados2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.930 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:39.946 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:00:39.975 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.032 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package liboath0. 2021-10-21T00:00:40.036 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (15.2.14-138-g3fb760aa-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-10-21T00:00:40.052 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-21T00:00:40.063 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2021-10-21T00:00:40.082 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-21T00:00:40.083 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:40.123 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.366 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liboath0. 2021-10-21T00:00:40.380 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-21T00:00:40.385 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-21T00:00:40.399 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-21T00:00:40.401 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libradosstriper1. 2021-10-21T00:00:40.421 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:40.428 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-21T00:00:40.439 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:00:40.460 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2021-10-21T00:00:40.480 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:40.484 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.515 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2021-10-21T00:00:40.738 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:40.765 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libradosstriper1. 2021-10-21T00:00:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.781 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:40.808 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-21T00:00:40.818 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.828 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-21T00:00:40.866 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:00:40.878 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-21T00:00:40.901 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:40.943 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:40.955 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-common. 2021-10-21T00:00:40.975 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.013 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.100 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2021-10-21T00:00:41.119 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-python3-rados_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.153 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2021-10-21T00:00:41.158 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.172 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.203 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.237 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2021-10-21T00:00:41.260 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.300 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.314 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-common. 2021-10-21T00:00:41.333 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.375 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.619 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-10-21T00:00:41.645 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-21T00:00:41.645 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:41.659 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:41.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.701 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:41.807 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2021-10-21T00:00:41.826 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:41.872 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:42.005 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2021-10-21T00:00:42.027 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:42.034 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2021-10-21T00:00:42.057 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-21T00:00:42.068 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:42.124 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-21T00:00:42.180 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-21T00:00:42.197 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-21T00:00:42.258 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:00:42.373 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2021-10-21T00:00:42.392 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:42.419 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2021-10-21T00:00:42.436 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:42.437 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:42.475 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:42.592 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0. 2021-10-21T00:00:42.607 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-21T00:00:42.635 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-21T00:00:42.787 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2021-10-21T00:00:42.798 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-21T00:00:42.805 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-10-21T00:00:42.820 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-21T00:00:42.844 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-10-21T00:00:42.856 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:00:42.989 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2021-10-21T00:00:43.007 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.047 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.080 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2021-10-21T00:00:43.102 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.138 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.235 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-21T00:00:43.254 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-21T00:00:43.292 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:00:43.293 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-base. 2021-10-21T00:00:43.314 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.374 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.475 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2021-10-21T00:00:43.497 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.502 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-base. 2021-10-21T00:00:43.527 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-10-21T00:00:43.528 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.542 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.548 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-10-21T00:00:43.575 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.584 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:00:43.670 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2021-10-21T00:00:43.696 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:43.737 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:43.961 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-10-21T00:00:43.980 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-10-21T00:00:44.019 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:00:44.281 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-cryptography. 2021-10-21T00:00:44.300 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-21T00:00:44.324 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2021-10-21T00:00:44.330 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2021-10-21T00:00:44.352 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:44.370 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:00:44.371 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-librgw2_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:44.383 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:44.390 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:44.540 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cryptography. 2021-10-21T00:00:44.570 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-21T00:00:44.632 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:00:44.718 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-openssl. 2021-10-21T00:00:44.728 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-21T00:00:44.743 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-21T00:00:44.744 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-21T00:00:44.787 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-21T00:00:44.788 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:00:44.907 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2021-10-21T00:00:44.930 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:44.983 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:45.005 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-21T00:00:45.024 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:45.063 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:45.094 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-openssl. 2021-10-21T00:00:45.096 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0. 2021-10-21T00:00:45.120 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-21T00:00:45.121 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-21T00:00:45.152 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-21T00:00:45.154 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-21T00:00:45.302 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-10-21T00:00:45.321 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-10-21T00:00:45.373 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:00:45.402 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-21T00:00:45.422 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:45.452 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-21T00:00:45.458 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:45.485 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-21T00:00:45.506 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2021-10-21T00:00:45.521 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:45.522 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:00:45.559 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:45.729 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2021-10-21T00:00:45.741 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0. 2021-10-21T00:00:45.747 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:45.764 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-10-21T00:00:45.769 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-21T00:00:45.794 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:45.795 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-10-21T00:00:45.795 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-21T00:00:45.827 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:00:45.851 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-21T00:00:45.879 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-21T00:00:46.027 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2021-10-21T00:00:46.047 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:46.097 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:46.168 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2021-10-21T00:00:46.169 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:46.176 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:00:46.203 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:46.711 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cryptography. 2021-10-21T00:00:46.735 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-21T00:00:46.783 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:00:46.822 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-jwt. 2021-10-21T00:00:46.843 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-21T00:00:46.912 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-21T00:00:46.914 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:00:46.933 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-21T00:00:46.971 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:00:47.245 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-logutils. 2021-10-21T00:00:47.257 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-21T00:00:47.300 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-21T00:00:47.341 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jwt. 2021-10-21T00:00:47.360 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-21T00:00:47.399 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:00:47.420 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2021-10-21T00:00:47.443 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-ceph-common_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:47.561 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:47.587 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-21T00:00:47.609 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-21T00:00:47.653 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:00:47.743 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-logutils. 2021-10-21T00:00:47.762 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-21T00:00:47.827 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-21T00:00:47.886 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2021-10-21T00:00:47.903 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-21T00:00:47.948 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-21T00:00:47.980 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-mako. 2021-10-21T00:00:47.999 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-21T00:00:48.038 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:00:48.179 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-21T00:00:48.198 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-21T00:00:48.237 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:00:48.243 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-21T00:00:48.263 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:48.309 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:48.359 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-21T00:00:48.381 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-21T00:00:48.424 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:00:48.556 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-mako. 2021-10-21T00:00:48.580 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-21T00:00:48.623 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:00:48.689 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-21T00:00:48.708 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-21T00:00:48.710 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-21T00:00:48.734 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-21T00:00:48.735 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2021-10-21T00:00:48.749 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:00:48.751 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:48.777 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:00:48.801 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:48.970 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-21T00:00:48.988 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-21T00:00:49.034 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:00:49.082 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-webob. 2021-10-21T00:00:49.088 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-21T00:00:49.099 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-21T00:00:49.103 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-21T00:00:49.155 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:00:49.156 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-21T00:00:49.376 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-21T00:00:49.391 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-21T00:00:49.430 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:00:49.481 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jwt. 2021-10-21T00:00:49.498 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-21T00:00:49.518 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-21T00:00:49.537 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:00:49.537 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-21T00:00:49.574 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:00:49.693 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2021-10-21T00:00:49.712 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-ceph-base_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:49.764 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webob. 2021-10-21T00:00:49.777 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cryptography. 2021-10-21T00:00:49.778 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:49.783 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-21T00:00:49.792 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-21T00:00:49.826 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-21T00:00:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:00:49.877 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-bs4. 2021-10-21T00:00:49.895 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2021-10-21T00:00:49.898 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-21T00:00:49.913 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-21T00:00:49.938 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-21T00:00:49.990 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-21T00:00:50.183 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-21T00:00:50.211 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-21T00:00:50.249 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2021-10-21T00:00:50.267 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-21T00:00:50.273 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:00:50.292 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-21T00:00:50.307 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-21T00:00:50.313 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-21T00:00:50.331 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-waitress. 2021-10-21T00:00:50.352 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:00:50.353 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-21T00:00:50.391 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-21T00:00:50.585 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-21T00:00:50.610 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:50.636 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-bs4. 2021-10-21T00:00:50.643 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:50.657 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-21T00:00:50.687 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2021-10-21T00:00:50.694 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-21T00:00:50.713 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-21T00:00:50.722 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cryptography. 2021-10-21T00:00:50.722 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-tempita. 2021-10-21T00:00:50.735 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-21T00:00:50.736 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-10-21T00:00:50.745 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:00:50.774 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-21T00:00:50.780 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:00:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-21T00:00:51.059 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-21T00:00:51.066 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-21T00:00:51.080 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-waitress. 2021-10-21T00:00:51.085 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-21T00:00:51.097 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:00:51.103 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-21T00:00:51.118 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-paste. 2021-10-21T00:00:51.140 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-21T00:00:51.148 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:00:51.170 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2021-10-21T00:00:51.173 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-21T00:00:51.176 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:00:51.187 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-10-21T00:00:51.251 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-10-21T00:00:51.438 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-21T00:00:51.441 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-21T00:00:51.447 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-21T00:00:51.461 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-21T00:00:51.484 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:00:51.485 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-21T00:00:51.502 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:00:51.502 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-21T00:00:51.517 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-10-21T00:00:51.543 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:00:51.544 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempita. 2021-10-21T00:00:51.547 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:00:51.567 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-21T00:00:51.570 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:51.599 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-21T00:00:51.797 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2021-10-21T00:00:51.817 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-21T00:00:51.863 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-21T00:00:51.891 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-21T00:00:51.894 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jwt. 2021-10-21T00:00:51.918 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-21T00:00:51.918 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-21T00:00:51.952 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-paste. 2021-10-21T00:00:51.953 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:00:51.957 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:00:51.968 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2021-10-21T00:00:51.974 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-21T00:00:52.001 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-10-21T00:00:52.028 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:00:52.028 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:00:52.224 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-21T00:00:52.243 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-21T00:00:52.413 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:00:52.413 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2021-10-21T00:00:52.413 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-10-21T00:00:52.414 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-21T00:00:52.414 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-21T00:00:52.414 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:00:52.415 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2021-10-21T00:00:52.415 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-21T00:00:52.415 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-21T00:00:52.415 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-webtest. 2021-10-21T00:00:52.416 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-21T00:00:52.416 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-21T00:00:52.419 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:00:52.527 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bs4. 2021-10-21T00:00:52.544 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-21T00:00:52.578 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-21T00:00:52.689 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pecan. 2021-10-21T00:00:52.691 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-21T00:00:52.708 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-21T00:00:52.714 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-21T00:00:52.757 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:00:52.758 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:00:52.791 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-21T00:00:52.797 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jwt. 2021-10-21T00:00:52.821 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-10-21T00:00:52.822 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-21T00:00:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:00:52.858 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:00:52.920 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2021-10-21T00:00:52.940 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-21T00:00:52.982 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-21T00:00:53.086 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2021-10-21T00:00:53.108 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-21T00:00:53.125 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2021-10-21T00:00:53.141 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-21T00:00:53.147 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-10-21T00:00:53.152 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:00:53.154 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-21T00:00:53.183 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-10-21T00:00:53.219 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webtest. 2021-10-21T00:00:53.225 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:00:53.238 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-21T00:00:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-21T00:00:53.340 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2021-10-21T00:00:53.363 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-21T00:00:53.408 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-21T00:00:53.437 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2021-10-21T00:00:53.455 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-10-21T00:00:53.486 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:00:53.497 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-21T00:00:53.515 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-21T00:00:53.580 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:00:53.603 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr. 2021-10-21T00:00:53.604 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pecan. 2021-10-21T00:00:53.627 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:53.628 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-21T00:00:53.670 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:53.696 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:00:53.735 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2021-10-21T00:00:53.755 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-21T00:00:53.793 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:00:53.815 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2021-10-21T00:00:53.837 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-10-21T00:00:53.880 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:00:53.899 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-21T00:00:53.926 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-21T00:00:53.991 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:00:54.085 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-21T00:00:54.097 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-21T00:00:54.107 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-21T00:00:54.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-21T00:00:54.150 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:00:54.154 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:00:54.173 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mon. 2021-10-21T00:00:54.192 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:54.230 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:54.242 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2021-10-21T00:00:54.261 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-10-21T00:00:54.296 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2021-10-21T00:00:54.318 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-21T00:00:54.335 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:00:54.376 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-21T00:00:54.490 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-21T00:00:54.514 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-21T00:00:54.547 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr. 2021-10-21T00:00:54.548 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:00:54.567 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:54.629 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:54.636 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2021-10-21T00:00:54.663 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-10-21T00:00:54.702 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:00:54.734 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-21T00:00:54.749 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-21T00:00:54.795 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:00:54.876 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2021-10-21T00:00:54.903 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-21T00:00:54.943 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-21T00:00:55.035 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2021-10-21T00:00:55.052 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-10-21T00:00:55.096 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-10-21T00:00:55.117 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mon. 2021-10-21T00:00:55.129 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bs4. 2021-10-21T00:00:55.150 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-21T00:00:55.151 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:55.173 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:55.182 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-21T00:00:55.292 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2021-10-21T00:00:55.323 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-21T00:00:55.354 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:00:55.369 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-osd. 2021-10-21T00:00:55.401 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:55.427 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:55.438 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-soupsieve. 2021-10-21T00:00:55.453 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-10-21T00:00:55.511 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:00:55.562 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2021-10-21T00:00:55.582 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-21T00:00:55.630 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-21T00:00:55.752 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-21T00:00:55.753 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bs4. 2021-10-21T00:00:55.789 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-10-21T00:00:55.790 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-21T00:00:55.826 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:00:55.849 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-10-21T00:00:55.967 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2021-10-21T00:00:55.991 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-21T00:00:56.032 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-21T00:00:56.104 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2021-10-21T00:00:56.111 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-10-21T00:00:56.165 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-10-21T00:00:56.221 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-osd. 2021-10-21T00:00:56.221 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2021-10-21T00:00:56.231 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:56.231 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:56.279 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:56.286 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:56.359 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2021-10-21T00:00:56.382 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-21T00:00:56.419 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:00:56.442 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2021-10-21T00:00:56.480 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-10-21T00:00:56.501 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-10-21T00:00:56.760 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-21T00:00:56.778 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-21T00:00:56.784 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2021-10-21T00:00:56.792 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-10-21T00:00:56.808 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2021-10-21T00:00:56.817 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:00:56.822 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:56.851 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:00:56.857 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:57.175 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-10-21T00:00:57.175 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-21T00:00:57.190 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-21T00:00:57.194 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-10-21T00:00:57.235 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:00:57.248 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:00:57.572 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2021-10-21T00:00:57.573 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2021-10-21T00:00:57.607 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-10-21T00:00:57.607 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-21T00:00:57.649 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-21T00:00:57.655 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:00:57.862 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph. 2021-10-21T00:00:57.879 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:57.983 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:57.984 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2021-10-21T00:00:57.985 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-10-21T00:00:57.985 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2021-10-21T00:00:57.985 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-21T00:00:57.986 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2021-10-21T00:00:58.015 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:58.015 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:58.017 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-10-21T00:00:58.017 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:00:58.267 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-fuse. 2021-10-21T00:00:58.289 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:58.318 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:58.338 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-21T00:00:58.363 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-21T00:00:58.396 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:00:58.448 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2021-10-21T00:00:58.448 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-10-21T00:00:58.491 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:00:58.668 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mds. 2021-10-21T00:00:58.669 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:58.707 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:58.708 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph. 2021-10-21T00:00:58.747 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:58.794 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:58.829 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2021-10-21T00:00:58.852 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:58.897 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:58.898 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2021-10-21T00:00:58.935 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-10-21T00:00:58.945 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:00:59.150 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-fuse. 2021-10-21T00:00:59.171 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.194 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package cephadm. 2021-10-21T00:00:59.208 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.219 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.248 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.331 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2021-10-21T00:00:59.346 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.406 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2021-10-21T00:00:59.407 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.420 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.453 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.598 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-jinja2. 2021-10-21T00:00:59.611 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mds. 2021-10-21T00:00:59.612 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-21T00:00:59.631 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.659 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-21T00:00:59.694 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.872 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2021-10-21T00:00:59.882 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:00:59.958 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-21T00:00:59.958 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:00:59.986 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:00.028 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:00.223 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephadm. 2021-10-21T00:01:00.241 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:00.282 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:00.414 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2021-10-21T00:01:00.415 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-21T00:01:00.438 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:00.455 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-21T00:01:00.485 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:00.499 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:00.499 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2021-10-21T00:01:00.501 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:00.529 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jinja2. 2021-10-21T00:01:00.674 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-21T00:01:00.708 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:00.732 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libjs-underscore. 2021-10-21T00:01:00.754 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-21T00:01:00.785 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2021-10-21T00:01:00.792 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:00.811 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:00.838 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:01.007 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2021-10-21T00:01:01.026 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:01.055 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-21T00:01:01.068 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:01.072 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-21T00:01:01.079 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:01.085 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-21T00:01:01.112 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:01.175 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:01.284 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2021-10-21T00:01:01.285 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:01.347 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:01.467 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-routes. 2021-10-21T00:01:01.486 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-21T00:01:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-21T00:01:01.513 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-21T00:01:01.524 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-21T00:01:01.539 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:01.825 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjs-underscore. 2021-10-21T00:01:01.836 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2021-10-21T00:01:01.845 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-21T00:01:01.852 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:01.891 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:01.908 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:01.918 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-21T00:01:01.944 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:01.987 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:02.186 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2021-10-21T00:01:02.207 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-21T00:01:02.227 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-21T00:01:02.230 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-21T00:01:02.235 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:02.275 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:02.580 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-21T00:01:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:02.643 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-routes. 2021-10-21T00:01:02.644 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:02.660 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-21T00:01:02.697 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-21T00:01:02.903 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2021-10-21T00:01:02.922 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:02.973 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-21T00:01:03.004 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.005 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:03.005 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-21T00:01:03.039 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.040 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-21T00:01:03.075 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:03.094 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-21T00:01:03.112 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:03.167 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.311 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-underscore. 2021-10-21T00:01:03.356 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2021-10-21T00:01:03.356 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-21T00:01:03.379 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:03.380 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-decorator. 2021-10-21T00:01:03.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:03.392 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-21T00:01:03.397 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.435 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2021-10-21T00:01:03.439 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-ceph_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:03.451 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:03.521 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.599 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-21T00:01:03.616 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-21T00:01:03.671 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:03.760 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-21T00:01:03.769 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-21T00:01:03.815 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:03.844 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2021-10-21T00:01:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:03.928 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:03.991 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2021-10-21T00:01:04.013 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-21T00:01:04.115 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-21T00:01:04.189 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-21T00:01:04.189 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-scipy. 2021-10-21T00:01:04.192 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-21T00:01:04.215 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:04.251 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:04.252 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:04.307 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2021-10-21T00:01:04.310 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:04.310 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2021-10-21T00:01:04.330 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:04.367 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:04.381 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-21T00:01:04.403 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:04.435 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:04.584 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-decorator. 2021-10-21T00:01:04.616 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-21T00:01:04.679 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:04.855 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2021-10-21T00:01:04.861 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2021-10-21T00:01:04.878 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:04.883 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-cephadm_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:04.927 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:04.927 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:05.004 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-21T00:01:05.025 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-21T00:01:05.074 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:05.247 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2021-10-21T00:01:05.268 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-21T00:01:05.268 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2021-10-21T00:01:05.288 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-10-21T00:01:05.325 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:05.325 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:05.423 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-21T00:01:05.424 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-scipy. 2021-10-21T00:01:05.425 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-21T00:01:05.438 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:05.484 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:05.484 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:05.559 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-21T00:01:05.574 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-21T00:01:05.608 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-21T00:01:05.625 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:05.627 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:05.682 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:05.694 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-10-21T00:01:05.720 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:05.780 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:05.814 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-decorator. 2021-10-21T00:01:05.839 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-21T00:01:05.871 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:06.007 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-21T00:01:06.023 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-21T00:01:06.066 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:06.151 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2021-10-21T00:01:06.179 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-10-21T00:01:06.214 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-joblib. 2021-10-21T00:01:06.214 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:06.215 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-21T00:01:06.228 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-21T00:01:06.232 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-21T00:01:06.280 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-21T00:01:06.280 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-underscore. 2021-10-21T00:01:06.366 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-21T00:01:06.405 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:06.459 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-underscore. 2021-10-21T00:01:06.481 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-10-21T00:01:06.516 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:06.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-scipy. 2021-10-21T00:01:06.635 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-21T00:01:06.669 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:06.691 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-sklearn. 2021-10-21T00:01:06.710 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-21T00:01:06.715 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-21T00:01:06.723 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-21T00:01:06.762 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:06.763 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:06.792 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-21T00:01:06.838 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-21T00:01:06.839 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-10-21T00:01:06.839 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-10-21T00:01:06.864 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:06.876 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:07.086 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2021-10-21T00:01:07.118 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-21T00:01:07.155 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-21T00:01:07.224 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2021-10-21T00:01:07.248 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-10-21T00:01:07.284 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-10-21T00:01:07.546 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-21T00:01:07.571 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:07.612 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:07.654 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-10-21T00:01:07.669 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:07.708 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:07.858 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-21T00:01:07.869 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-joblib. 2021-10-21T00:01:07.877 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:07.879 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-21T00:01:07.915 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:07.927 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-21T00:01:08.368 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn. 2021-10-21T00:01:08.384 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-21T00:01:08.466 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:08.547 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-21T00:01:08.583 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-21T00:01:08.607 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-21T00:01:08.635 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:08.636 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:08.664 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-10-21T00:01:08.664 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:08.677 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:08.724 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:09.029 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-decorator. 2021-10-21T00:01:09.029 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-decorator. 2021-10-21T00:01:09.047 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-21T00:01:09.049 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-10-21T00:01:09.071 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-cachetools. 2021-10-21T00:01:09.072 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:09.088 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-21T00:01:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:09.131 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:09.204 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-21T00:01:09.223 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:09.237 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2021-10-21T00:01:09.254 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-21T00:01:09.262 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:09.297 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-21T00:01:09.427 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-21T00:01:09.428 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-10-21T00:01:09.430 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-21T00:01:09.456 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-21T00:01:09.457 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-21T00:01:09.457 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-10-21T00:01:09.494 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:09.505 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:09.506 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:09.669 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2021-10-21T00:01:09.697 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-21T00:01:09.763 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:09.843 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-21T00:01:09.843 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-scipy. 2021-10-21T00:01:09.869 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-scipy. 2021-10-21T00:01:09.870 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-21T00:01:09.870 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-21T00:01:09.916 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:09.917 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:09.918 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-10-21T00:01:09.918 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:10.210 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-rsa. 2021-10-21T00:01:10.230 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-21T00:01:10.271 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-21T00:01:10.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-21T00:01:10.451 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cachetools. 2021-10-21T00:01:10.456 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:10.470 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-21T00:01:10.495 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:10.507 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:10.640 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-google-auth. 2021-10-21T00:01:10.659 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-21T00:01:10.697 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:10.837 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-21T00:01:10.856 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-21T00:01:10.926 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:11.034 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-blinker. 2021-10-21T00:01:11.056 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-21T00:01:11.092 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:11.217 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-21T00:01:11.248 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-21T00:01:11.272 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:11.308 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-21T00:01:11.323 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-21T00:01:11.362 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-10-21T00:01:11.368 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-10-21T00:01:11.371 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:11.403 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:11.427 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-21T00:01:11.457 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-21T00:01:11.498 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:11.641 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2021-10-21T00:01:11.658 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-21T00:01:11.702 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:11.716 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rsa. 2021-10-21T00:01:11.736 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-21T00:01:11.778 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-21T00:01:11.824 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-21T00:01:11.828 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2021-10-21T00:01:11.846 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-21T00:01:11.856 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-21T00:01:11.888 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:11.903 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-21T00:01:12.000 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2021-10-21T00:01:12.012 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-10-21T00:01:12.016 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-21T00:01:12.037 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-21T00:01:12.047 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-10-21T00:01:12.075 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:12.112 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-google-auth. 2021-10-21T00:01:12.132 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-21T00:01:12.194 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:12.230 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-websocket. 2021-10-21T00:01:12.244 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-21T00:01:12.274 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2021-10-21T00:01:12.283 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:12.310 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-21T00:01:12.331 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:12.463 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2021-10-21T00:01:12.464 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-10-21T00:01:12.465 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-21T00:01:12.480 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-21T00:01:12.521 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:12.523 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:12.541 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-blinker. 2021-10-21T00:01:12.560 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-21T00:01:12.597 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:12.626 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-21T00:01:12.634 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-21T00:01:12.681 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:12.889 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2021-10-21T00:01:12.903 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-21T00:01:12.946 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-21T00:01:12.950 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-21T00:01:12.978 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-21T00:01:13.013 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:13.079 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-21T00:01:13.093 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:13.141 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:13.241 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-21T00:01:13.262 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:13.275 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2021-10-21T00:01:13.293 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-10-21T00:01:13.299 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-21T00:01:13.320 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:13.389 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:13.390 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:13.403 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-21T00:01:13.428 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-21T00:01:13.462 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:13.623 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-21T00:01:13.650 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-21T00:01:13.687 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:13.692 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-blinker. 2021-10-21T00:01:13.707 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-21T00:01:13.743 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:13.814 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-websocket. 2021-10-21T00:01:13.834 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-21T00:01:13.880 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-21T00:01:14.077 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-21T00:01:14.121 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:14.122 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-21T00:01:14.141 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:14.180 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:14.242 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2021-10-21T00:01:14.266 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-21T00:01:14.275 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-21T00:01:14.306 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-21T00:01:14.318 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:14.341 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:14.456 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package jq. 2021-10-21T00:01:14.484 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-21T00:01:14.485 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:14.495 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2021-10-21T00:01:14.507 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-21T00:01:14.519 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-10-21T00:01:14.520 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:14.549 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:14.553 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:14.647 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-21T00:01:14.656 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-21T00:01:14.703 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:14.808 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package socat. 2021-10-21T00:01:14.829 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-21T00:01:14.872 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-21T00:01:14.881 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2021-10-21T00:01:14.910 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-10-21T00:01:14.914 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2021-10-21T00:01:14.934 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-21T00:01:14.946 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-21T00:01:14.947 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:14.968 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:14.986 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:15.015 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:15.074 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-21T00:01:15.095 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-21T00:01:15.132 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:15.301 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-10-21T00:01:15.314 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-21T00:01:15.320 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-10-21T00:01:15.330 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-21T00:01:15.343 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-21T00:01:15.351 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-21T00:01:15.368 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:15.374 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-21T00:01:15.389 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:15.399 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-21T00:01:15.414 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:15.437 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2021-10-21T00:01:15.457 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:15.458 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-21T00:01:15.513 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-21T00:01:15.684 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package xmlstarlet. 2021-10-21T00:01:15.706 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-21T00:01:15.706 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2021-10-21T00:01:15.726 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-10-21T00:01:15.741 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:15.799 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.0-3) ... 2021-10-21T00:01:15.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2021-10-21T00:01:15.835 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-21T00:01:15.840 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-21T00:01:15.861 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:15.879 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:15.893 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:15.944 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-21T00:01:15.964 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:15.994 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:16.079 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package ceph-test. 2021-10-21T00:01:16.100 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:16.107 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2021-10-21T00:01:16.127 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-10-21T00:01:16.137 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:16.194 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:16.195 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package jq. 2021-10-21T00:01:16.218 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:16.233 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-blinker. 2021-10-21T00:01:16.252 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-21T00:01:16.253 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:16.271 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-21T00:01:16.291 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:16.293 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-21T00:01:16.330 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:16.501 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-blinker. 2021-10-21T00:01:16.523 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package socat. 2021-10-21T00:01:16.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-10-21T00:01:16.542 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-21T00:01:16.581 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-21T00:01:16.619 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-21T00:01:16.639 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-21T00:01:16.664 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:16.683 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:16.719 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-21T00:01:16.736 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:16.775 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:16.987 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-oauthlib. 2021-10-21T00:01:17.009 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-10-21T00:01:17.031 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-21T00:01:17.051 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-21T00:01:17.064 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:17.069 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2021-10-21T00:01:17.088 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:17.090 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:17.120 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-21T00:01:17.136 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:17.140 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-21T00:01:17.178 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:17.405 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2021-10-21T00:01:17.422 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2021-10-21T00:01:17.422 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-10-21T00:01:17.426 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-21T00:01:17.440 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-21T00:01:17.440 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-10-21T00:01:17.474 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:17.479 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-21T00:01:17.481 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package xmlstarlet. 2021-10-21T00:01:17.482 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:17.505 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-21T00:01:17.542 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:17.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-21T00:01:17.826 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2021-10-21T00:01:17.840 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-21T00:01:17.849 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-10-21T00:01:17.877 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:17.903 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:17.943 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-test. 2021-10-21T00:01:17.965 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:17.985 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-21T00:01:18.010 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:18.010 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-21T00:01:18.052 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:18.255 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2021-10-21T00:01:18.274 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-10-21T00:01:18.312 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:18.313 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2021-10-21T00:01:18.333 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-21T00:01:18.371 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:18.753 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2021-10-21T00:01:18.775 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:18.823 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:18.852 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-21T00:01:18.870 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:18.893 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-10-21T00:01:18.915 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:18.942 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:18.992 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:19.269 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-21T00:01:19.276 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2021-10-21T00:01:19.288 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-21T00:01:19.298 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-10-21T00:01:19.343 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:19.344 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:19.667 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-colorama. 2021-10-21T00:01:19.687 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-21T00:01:19.705 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-21T00:01:19.731 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:19.731 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:19.755 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2021-10-21T00:01:19.771 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:19.778 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:19.813 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:20.003 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package cephfs-shell. 2021-10-21T00:01:20.023 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:20.032 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2021-10-21T00:01:20.052 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:20.060 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:20.090 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:20.119 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2021-10-21T00:01:20.138 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-10-21T00:01:20.179 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:20.346 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-21T00:01:20.370 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:20.376 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2021-10-21T00:01:20.394 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2021-10-21T00:01:20.397 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-21T00:01:20.404 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:20.425 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-10-21T00:01:20.434 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-21T00:01:20.471 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.3.3-2) ... 2021-10-21T00:01:20.807 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package nvme-cli. 2021-10-21T00:01:20.828 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-21T00:01:20.892 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:20.948 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-21T00:01:20.965 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-10-21T00:01:20.971 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-21T00:01:20.986 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-10-21T00:01:21.022 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:21.023 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:21.246 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-21T00:01:21.275 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-21T00:01:21.318 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:21.319 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2021-10-21T00:01:21.326 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2021-10-21T00:01:21.338 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-21T00:01:21.348 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-10-21T00:01:21.382 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:21.394 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:21.447 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-colorama. 2021-10-21T00:01:21.466 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-21T00:01:21.505 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:21.632 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-attr. 2021-10-21T00:01:21.655 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-21T00:01:21.709 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-21T00:01:21.739 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2021-10-21T00:01:21.747 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2021-10-21T00:01:21.749 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephfs-shell. 2021-10-21T00:01:21.759 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:21.768 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-ceph-test_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:21.771 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:21.797 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:21.799 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:21.805 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:22.027 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-webencodings. 2021-10-21T00:01:22.035 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-21T00:01:22.045 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-21T00:01:22.065 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:22.085 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:22.097 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:22.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2021-10-21T00:01:22.292 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-21T00:01:22.332 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:22.404 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-html5lib. 2021-10-21T00:01:22.424 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-21T00:01:22.478 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:22.535 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package nvme-cli. 2021-10-21T00:01:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-21T00:01:22.593 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2021-10-21T00:01:22.619 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:22.622 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:22.667 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:22.874 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-21T00:01:22.893 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-21T00:01:22.931 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:22.937 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-21T00:01:22.958 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:22.995 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:23.035 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-21T00:01:23.056 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-21T00:01:23.093 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:23.390 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2021-10-21T00:01:23.426 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-attr. 2021-10-21T00:01:23.427 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-21T00:01:23.439 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-21T00:01:23.446 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-packaging. 2021-10-21T00:01:23.465 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-21T00:01:23.469 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:23.507 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-21T00:01:23.515 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-21T00:01:23.827 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webencodings. 2021-10-21T00:01:23.829 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pastescript. 2021-10-21T00:01:23.846 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-21T00:01:23.851 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-21T00:01:23.875 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:23.876 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-21T00:01:23.891 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-21T00:01:23.908 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:23.941 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:24.201 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-html5lib. 2021-10-21T00:01:24.215 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-21T00:01:24.249 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pluggy. 2021-10-21T00:01:24.262 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:24.276 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-attr. 2021-10-21T00:01:24.281 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-21T00:01:24.312 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:24.313 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-21T00:01:24.336 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-21T00:01:24.619 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-psutil. 2021-10-21T00:01:24.629 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-21T00:01:24.642 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-21T00:01:24.648 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-21T00:01:24.686 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:24.704 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webencodings. 2021-10-21T00:01:24.720 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-21T00:01:24.721 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:24.759 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:25.032 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-py. 2021-10-21T00:01:25.053 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-21T00:01:25.064 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-html5lib. 2021-10-21T00:01:25.085 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-21T00:01:25.097 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-21T00:01:25.122 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:25.208 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-packaging. 2021-10-21T00:01:25.235 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-21T00:01:25.267 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-colorama. 2021-10-21T00:01:25.287 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-21T00:01:25.290 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-21T00:01:25.334 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:25.334 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2021-10-21T00:01:25.355 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-10-21T00:01:25.392 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:25.438 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-21T00:01:25.455 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-21T00:01:25.492 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:25.498 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-21T00:01:25.523 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-21T00:01:25.572 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:25.611 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastescript. 2021-10-21T00:01:25.630 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-shell. 2021-10-21T00:01:25.639 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2021-10-21T00:01:25.639 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-21T00:01:25.650 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:25.658 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-138-g3fb760aa-1focal_all.deb ... 2021-10-21T00:01:25.667 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:25.686 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:25.702 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:25.879 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-pytest. 2021-10-21T00:01:25.907 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-21T00:01:25.938 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-21T00:01:25.966 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-21T00:01:25.972 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2021-10-21T00:01:25.983 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:25.995 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:26.009 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pluggy. 2021-10-21T00:01:26.022 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:26.027 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-21T00:01:26.041 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:26.071 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:26.085 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-packaging. 2021-10-21T00:01:26.108 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-21T00:01:26.151 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-21T00:01:26.290 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package python3-simplejson. 2021-10-21T00:01:26.315 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-21T00:01:26.347 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:26.416 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-psutil. 2021-10-21T00:01:26.436 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-21T00:01:26.442 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2021-10-21T00:01:26.450 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2021-10-21T00:01:26.463 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2021-10-21T00:01:26.465 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-21T00:01:26.473 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-10-21T00:01:26.486 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-21T00:01:26.497 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:26.531 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:26.532 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:26.534 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:26.776 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package radosgw. 2021-10-21T00:01:26.799 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:26.841 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:26.860 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-py. 2021-10-21T00:01:26.881 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-21T00:01:26.891 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2021-10-21T00:01:26.919 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-21T00:01:26.919 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-21T00:01:26.920 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-21T00:01:26.932 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-21T00:01:26.939 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-atomicwrites. 2021-10-21T00:01:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:26.960 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-10-21T00:01:26.992 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:27.264 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-21T00:01:27.286 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-21T00:01:27.324 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-attr. 2021-10-21T00:01:27.325 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-attr. 2021-10-21T00:01:27.325 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-21T00:01:27.325 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2021-10-21T00:01:27.326 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-21T00:01:27.326 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-10-21T00:01:27.345 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:27.358 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-21T00:01:27.388 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-10-21T00:01:27.389 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:27.687 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pytest. 2021-10-21T00:01:27.689 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-21T00:01:27.690 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2021-10-21T00:01:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-21T00:01:27.735 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webencodings. 2021-10-21T00:01:27.735 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webencodings. 2021-10-21T00:01:27.782 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-21T00:01:27.790 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-10-21T00:01:27.813 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-21T00:01:27.814 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-21T00:01:27.820 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:27.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:27.963 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package rbd-fuse. 2021-10-21T00:01:27.983 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:28.033 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:28.093 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-21T00:01:28.113 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-21T00:01:28.127 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-html5lib. 2021-10-21T00:01:28.127 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplejson. 2021-10-21T00:01:28.145 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-21T00:01:28.147 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-21T00:01:28.203 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-html5lib. 2021-10-21T00:01:28.204 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:28.210 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:28.211 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:28.211 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-10-21T00:01:28.224 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:28.318 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-21T00:01:28.472 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2021-10-21T00:01:28.497 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-21T00:01:28.546 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-21T00:01:28.566 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-21T00:01:28.587 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-21T00:01:28.618 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-10-21T00:01:28.637 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-10-21T00:01:28.657 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:28.676 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:28.680 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package radosgw. 2021-10-21T00:01:28.701 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:28.741 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:28.795 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:01:28.925 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2021-10-21T00:01:28.926 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:01:28.948 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-21T00:01:29.008 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:29.069 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:29.167 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-packaging. 2021-10-21T00:01:29.172 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-packaging. 2021-10-21T00:01:29.186 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-21T00:01:29.193 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-10-21T00:01:29.259 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:29.260 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-21T00:01:29.260 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-packaging (20.3-1) ... 2021-10-21T00:01:29.439 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2021-10-21T00:01:29.464 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:29.503 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:29.563 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2021-10-21T00:01:29.583 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-21T00:01:29.590 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2021-10-21T00:01:29.610 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-10-21T00:01:29.621 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:29.657 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:29.859 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package rbd-fuse. 2021-10-21T00:01:29.862 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:29.925 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:29.949 INFO:teuthology.orchestra.run.smithi041.stdout:Adding system user cephadm....done 2021-10-21T00:01:30.001 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2021-10-21T00:01:30.035 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-21T00:01:30.085 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:30.086 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2021-10-21T00:01:30.099 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-10-21T00:01:30.124 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-21T00:01:30.163 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:30.258 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-21T00:01:30.425 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2021-10-21T00:01:30.483 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-21T00:01:30.493 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:30.493 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2021-10-21T00:01:30.494 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:30.512 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-10-21T00:01:30.580 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:30.588 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:01:30.695 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:01:30.695 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2021-10-21T00:01:30.696 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:30.719 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:30.796 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-21T00:01:30.839 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:30.840 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2021-10-21T00:01:30.869 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-21T00:01:30.920 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-21T00:01:30.922 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-21T00:01:30.935 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2021-10-21T00:01:30.954 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-10-21T00:01:31.015 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.8.1-1) ... 2021-10-21T00:01:31.039 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:31.041 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-21T00:01:31.253 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-21T00:01:31.265 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-21T00:01:31.281 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-21T00:01:31.311 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2021-10-21T00:01:31.337 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:31.337 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-10-21T00:01:31.377 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:01:31.378 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:31.507 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:01:31.648 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2021-10-21T00:01:31.649 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:31.670 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-21T00:01:31.680 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:01:31.719 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user cephadm....done 2021-10-21T00:01:31.720 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-21T00:01:31.722 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2021-10-21T00:01:31.744 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-10-21T00:01:31.788 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-10-21T00:01:31.865 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-21T00:01:31.892 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:31.977 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:32.087 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2021-10-21T00:01:32.106 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-21T00:01:32.143 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2021-10-21T00:01:32.181 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:32.182 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-10-21T00:01:32.199 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:32.209 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:32.277 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:32.525 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-21T00:01:32.586 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:01:32.623 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2021-10-21T00:01:32.656 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2021-10-21T00:01:32.674 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:32.688 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2021-10-21T00:01:32.689 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-21T00:01:32.708 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-radosgw_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:32.712 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:32.745 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:32.763 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-21T00:01:32.932 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:33.020 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-21T00:01:33.091 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:33.215 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:33.404 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-21T00:01:33.429 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:01:33.525 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-21T00:01:33.531 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:33.657 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-21T00:01:33.699 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:33.799 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2021-10-21T00:01:33.816 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2021-10-21T00:01:33.821 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:33.838 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-138-g3fb760aa-1focal_amd64.deb ... 2021-10-21T00:01:33.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-21T00:01:33.866 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:33.882 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:33.954 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:01:33.965 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:34.191 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-21T00:01:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-attr (19.3.0-2) ... 2021-10-21T00:01:34.267 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:01:34.268 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:34.278 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:01:34.546 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:01:34.551 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:34.561 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:34.566 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:34.572 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-10-21T00:01:34.672 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:01:34.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-10-21T00:01:34.823 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:34.824 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-10-21T00:01:34.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:34.851 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:34.936 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:35.060 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:35.144 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:35.166 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:01:35.213 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:35.263 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-21T00:01:35.432 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:35.460 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:35.530 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:01:35.564 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:35.745 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2021-10-21T00:01:35.769 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:35.814 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:35.857 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:35.898 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-21T00:01:36.073 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:36.100 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:36.146 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2021-10-21T00:01:36.200 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-21T00:01:36.203 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-21T00:01:36.259 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-10-21T00:01:36.475 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:36.489 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:01:36.521 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-21T00:01:36.578 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-21T00:01:36.657 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-10-21T00:01:36.701 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-21T00:01:36.773 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:36.793 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:36.811 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:01:36.942 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-10-21T00:01:36.945 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:01:37.042 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-21T00:01:37.065 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:37.076 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.8.1-1) ... 2021-10-21T00:01:37.194 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:37.238 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:01:37.425 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:37.453 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-10-21T00:01:37.471 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:01:37.479 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:37.649 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:01:37.734 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:37.756 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:37.861 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-10-21T00:01:38.049 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:38.071 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-21T00:01:38.086 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:38.197 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-10-21T00:01:38.343 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:01:38.368 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:01:38.369 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:38.414 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-21T00:01:38.491 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-10-21T00:01:38.652 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:38.705 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-21T00:01:38.717 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:01:38.740 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:01:38.784 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-10-21T00:01:38.866 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:01:38.919 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:39.069 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-10-21T00:01:39.116 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-21T00:01:39.169 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:01:39.214 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:39.254 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:39.272 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-21T00:01:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-21T00:01:39.411 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:39.572 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:01:39.885 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:39.887 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:01:39.887 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:01:39.888 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:01:39.888 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:39.888 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-10-21T00:01:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:01:39.923 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:01:39.941 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:40.018 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:01:40.059 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:40.139 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-10-21T00:01:40.245 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:01:40.360 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:40.436 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:01:40.437 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-10-21T00:01:40.487 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:40.659 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-21T00:01:40.725 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-10-21T00:01:40.729 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:01:40.816 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:40.821 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:01:40.894 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:41.105 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-21T00:01:41.110 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-10-21T00:01:41.118 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:41.122 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:01:41.263 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:41.386 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-10-21T00:01:41.445 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:01:41.469 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:01:41.490 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-21T00:01:41.539 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:41.566 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:01:41.599 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:41.610 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:41.771 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-10-21T00:01:41.873 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-21T00:01:41.890 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-21T00:01:41.923 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:41.935 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:42.088 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:42.088 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-10-21T00:01:42.160 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:01:42.193 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-21T00:01:42.281 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:01:42.409 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:01:42.428 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-10-21T00:01:42.447 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:42.485 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:42.493 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:01:42.618 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:01:42.701 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-21T00:01:42.724 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-packaging (20.3-1) ... 2021-10-21T00:01:42.758 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:42.876 INFO:teuthology.orchestra.run.smithi041.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-21T00:01:42.910 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:01:42.978 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:01:43.026 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-10-21T00:01:43.107 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:01:43.132 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:43.151 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-10-21T00:01:43.236 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:01:43.262 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:01:43.375 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:01:43.429 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-10-21T00:01:43.463 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-21T00:01:43.518 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-21T00:01:43.584 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:01:43.680 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:01:43.781 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:01:43.796 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:01:43.840 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-10-21T00:01:43.948 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:01:43.955 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:44.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:01:44.090 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:44.118 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:44.177 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-10-21T00:01:44.216 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-21T00:01:44.235 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-21T00:01:44.448 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-21T00:01:44.493 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-21T00:01:44.525 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:01:44.551 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:44.557 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-10-21T00:01:44.573 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:44.758 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:44.836 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:44.874 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:01:44.876 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:44.910 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:44.935 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.3.3-2) ... 2021-10-21T00:01:45.002 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:45.102 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:45.225 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:01:45.260 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-21T00:01:45.285 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:01:45.379 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-10-21T00:01:45.412 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:45.531 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:45.635 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:45.671 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:01:45.707 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:45.767 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:45.768 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-10-21T00:01:45.869 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:45.869 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-10-21T00:01:45.911 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-21T00:01:45.990 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:01:46.199 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-10-21T00:01:46.239 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:01:46.253 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:46.311 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-10-21T00:01:46.361 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:46.510 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:46.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:46.546 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-21T00:01:46.556 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:46.636 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:46.637 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-10-21T00:01:46.656 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-21T00:01:46.688 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:46.767 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-21T00:01:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:01:46.922 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-10-21T00:01:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:01:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:47.143 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-21T00:01:47.248 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-10-21T00:01:47.276 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:47.278 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-21T00:01:47.379 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-10-21T00:01:47.401 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:47.448 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:01:47.619 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-10-21T00:01:47.758 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-21T00:01:47.906 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:48.003 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-10-21T00:01:48.109 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:48.166 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:48.236 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:48.286 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-21T00:01:48.289 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:48.324 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-10-21T00:01:48.427 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-21T00:01:48.562 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:48.688 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:48.689 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:01:48.774 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-10-21T00:01:48.777 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-21T00:01:48.885 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:49.018 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:01:49.018 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:49.036 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:49.085 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:01:49.087 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-10-21T00:01:49.196 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-21T00:01:49.268 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-10-21T00:01:49.363 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-21T00:01:49.565 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-21T00:01:49.587 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-10-21T00:01:49.722 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:49.758 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:49.871 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:49.874 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:01:49.889 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:49.932 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-10-21T00:01:50.050 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-21T00:01:50.058 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-10-21T00:01:50.107 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.163 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.166 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-21T00:01:50.187 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-10-21T00:01:50.230 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:50.260 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:50.356 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:50.373 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:50.483 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:50.519 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-10-21T00:01:50.529 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.599 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:50.662 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.663 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:50.763 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:50.819 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.833 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:50.937 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-10-21T00:01:50.966 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:50.967 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-21T00:01:51.129 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:51.278 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-21T00:01:51.464 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:51.596 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:51.677 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:51.739 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:51.802 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:51.970 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:51.981 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:51.982 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:52.096 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:52.249 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:52.359 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:52.396 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:52.406 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:52.459 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:52.468 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-21T00:01:52.522 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:52.557 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-21T00:01:52.568 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:52.583 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:52.682 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-10-21T00:01:52.698 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:52.840 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:52.851 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-21T00:01:52.853 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-21T00:01:52.892 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:52.966 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:53.051 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-10-21T00:01:53.152 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.164 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:01:53.228 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:01:53.281 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.285 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:53.379 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-10-21T00:01:53.412 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-21T00:01:53.474 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-21T00:01:53.505 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:53.506 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:53.590 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.661 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-10-21T00:01:53.712 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-21T00:01:53.717 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.825 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.845 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:53.926 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:53.985 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.011 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-21T00:01:54.022 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.029 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.115 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:54.182 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.190 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-10-21T00:01:54.237 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.365 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:54.398 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:54.407 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:54.409 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:54.409 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.664 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-10-21T00:01:54.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:54.717 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.718 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:01:54.866 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.884 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:54.994 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-10-21T00:01:55.009 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:55.065 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:55.167 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:55.215 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:55.294 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:55.319 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:55.341 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:55.468 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-21T00:01:55.649 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:01:55.872 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:55.886 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:55.997 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:56.017 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.050 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.142 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:56.176 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-10-21T00:01:56.177 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.213 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.240 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.278 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:56.303 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.311 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-10-21T00:01:56.364 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.430 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-21T00:01:56.465 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-10-21T00:01:56.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:56.703 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:56.743 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-21T00:01:56.817 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-21T00:01:56.818 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-10-21T00:01:56.844 INFO:teuthology.orchestra.run.smithi041.stdout:Adding group ceph....done 2021-10-21T00:01:56.852 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:56.950 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.0-3) ... 2021-10-21T00:01:57.044 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-21T00:01:57.117 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.219 INFO:teuthology.orchestra.run.smithi041.stdout:Adding system user ceph....done 2021-10-21T00:01:57.249 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-10-21T00:01:57.268 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.332 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.413 INFO:teuthology.orchestra.run.smithi041.stdout:Setting system user ceph properties....done 2021-10-21T00:01:57.436 INFO:teuthology.orchestra.run.smithi041.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-21T00:01:57.459 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.574 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.578 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.585 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-21T00:01:57.689 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:57.689 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:57.711 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.722 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:01:57.769 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:57.901 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-21T00:01:57.936 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:57.937 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-10-21T00:01:58.164 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:58.303 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:58.357 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:58.397 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:58.405 INFO:teuthology.orchestra.run.smithi071.stdout:Adding group ceph....done 2021-10-21T00:01:58.483 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:58.531 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-10-21T00:01:58.604 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:58.626 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:58.761 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:01:58.761 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:01:58.819 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user ceph....done 2021-10-21T00:01:58.836 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-10-21T00:01:58.956 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:01:59.033 INFO:teuthology.orchestra.run.smithi071.stdout:Setting system user ceph properties....done 2021-10-21T00:01:59.054 INFO:teuthology.orchestra.run.smithi071.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-21T00:01:59.150 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-10-21T00:01:59.199 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-21T00:01:59.235 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2021-10-21T00:01:59.339 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.461 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.468 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.497 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-21T00:01:59.532 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.657 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.664 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2021-10-21T00:01:59.753 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-21T00:01:59.783 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:01:59.821 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-21T00:01:59.885 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2021-10-21T00:01:59.900 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-21T00:01:59.942 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.4.1-2) ... 2021-10-21T00:01:59.946 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.060 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-21T00:02:00.094 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-21T00:02:00.303 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.528 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.529 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-21T00:02:00.535 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-10-21T00:02:00.540 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:00.541 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.644 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.693 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:00.694 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:00.789 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.852 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.863 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:00.995 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:02:01.004 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.019 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.082 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-shell (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.208 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-10-21T00:02:01.239 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:01.240 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:01.311 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:01.312 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.682 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-21T00:02:01.872 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:01.931 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.115 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.128 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.146 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.345 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:02.346 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:02.428 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:02.428 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:02.464 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-21T00:02:02.501 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2021-10-21T00:02:02.749 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2021-10-21T00:02:02.813 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.885 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:02.912 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2021-10-21T00:02:02.926 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.011 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.070 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:03.071 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:03.072 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2021-10-21T00:02:03.098 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-21T00:02:03.144 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.167 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:03.167 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:03.168 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2021-10-21T00:02:03.243 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-21T00:02:03.369 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2021-10-21T00:02:03.379 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:03.380 INFO:teuthology.orchestra.run.smithi041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:03.403 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-10-21T00:02:03.551 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-10-21T00:02:03.559 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.570 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-21T00:02:03.627 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.699 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:03.868 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-10-21T00:02:03.880 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:03.880 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:04.031 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.036 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.186 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.234 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.251 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:04.251 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:04.296 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.368 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.449 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:04.450 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:04.503 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.513 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-21T00:02:04.574 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.676 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.768 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:04.768 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-10-21T00:02:04.815 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:04.824 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:04.947 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.113 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.156 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:05.156 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:05.277 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:05.277 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:05.404 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.485 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-21T00:02:05.585 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.727 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.745 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-10-21T00:02:05.754 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.826 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.880 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:05.940 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.002 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.057 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-21T00:02:06.169 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:06.177 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:06.229 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:06.229 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:06.521 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.626 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.757 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:06.758 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-10-21T00:02:06.819 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:06.867 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:06.868 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:06.977 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:07.131 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-21T00:02:07.256 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:07.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:07.457 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:07.476 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:07.486 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-10-21T00:02:07.532 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:07.915 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:07.977 INFO:teuthology.orchestra.run.smithi041.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:07.982 DEBUG:teuthology.orchestra.run.smithi041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-21T00:02:08.029 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:08.030 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:08.051 INFO:teuthology.orchestra.run.smithi041.stdout:Reading package lists... 2021-10-21T00:02:08.092 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:08.225 INFO:teuthology.orchestra.run.smithi041.stdout:Building dependency tree... 2021-10-21T00:02:08.225 INFO:teuthology.orchestra.run.smithi041.stdout:Reading state information... 2021-10-21T00:02:08.377 INFO:teuthology.orchestra.run.smithi041.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-21T00:02:08.377 INFO:teuthology.orchestra.run.smithi041.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-21T00:02:08.377 INFO:teuthology.orchestra.run.smithi041.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-21T00:02:08.378 INFO:teuthology.orchestra.run.smithi041.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:02:08.378 INFO:teuthology.orchestra.run.smithi041.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:02:08.378 INFO:teuthology.orchestra.run.smithi041.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:02:08.378 INFO:teuthology.orchestra.run.smithi041.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:02:08.379 INFO:teuthology.orchestra.run.smithi041.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:02:08.379 INFO:teuthology.orchestra.run.smithi041.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:02:08.379 INFO:teuthology.orchestra.run.smithi041.stdout:Suggested packages: 2021-10-21T00:02:08.380 INFO:teuthology.orchestra.run.smithi041.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-21T00:02:08.411 INFO:teuthology.orchestra.run.smithi041.stdout:The following NEW packages will be installed: 2021-10-21T00:02:08.411 INFO:teuthology.orchestra.run.smithi041.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-21T00:02:08.412 INFO:teuthology.orchestra.run.smithi041.stdout: libssl-dev 2021-10-21T00:02:08.480 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:08.596 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:08.597 INFO:teuthology.orchestra.run.smithi041.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:02:08.597 INFO:teuthology.orchestra.run.smithi041.stdout:Need to get 2,913 kB of archives. 2021-10-21T00:02:08.597 INFO:teuthology.orchestra.run.smithi041.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-21T00:02:08.598 INFO:teuthology.orchestra.run.smithi041.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-21T00:02:08.658 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:08.658 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-10-21T00:02:08.722 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:08.950 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:08.951 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:09.073 INFO:teuthology.orchestra.run.smithi041.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-21T00:02:09.111 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.143 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:09.199 INFO:teuthology.orchestra.run.smithi041.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-21T00:02:09.221 INFO:teuthology.orchestra.run.smithi041.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-21T00:02:09.236 INFO:teuthology.orchestra.run.smithi041.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-21T00:02:09.261 INFO:teuthology.orchestra.run.smithi041.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-21T00:02:09.270 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.339 INFO:teuthology.orchestra.run.smithi041.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-21T00:02:09.339 INFO:teuthology.orchestra.run.smithi041.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-21T00:02:09.339 INFO:teuthology.orchestra.run.smithi041.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-21T00:02:09.340 INFO:teuthology.orchestra.run.smithi041.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-21T00:02:09.399 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.412 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.560 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:09.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-21T00:02:09.567 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.636 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2021-10-21T00:02:09.641 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:09.641 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-10-21T00:02:09.677 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:09.693 INFO:teuthology.orchestra.run.smithi041.stdout:Fetched 2,913 kB in 1s (3,163 kB/s) 2021-10-21T00:02:09.803 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2021-10-21T00:02:09.804 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2021-10-21T00:02:09.820 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-21T00:02:09.839 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package flex. 2021-10-21T00:02:09.910 INFO:teuthology.orchestra.run.smithi041.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-21T00:02:09.916 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:09.946 INFO:teuthology.orchestra.run.smithi071.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-21T00:02:09.946 INFO:teuthology.orchestra.run.smithi071.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-21T00:02:09.947 INFO:teuthology.orchestra.run.smithi071.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-21T00:02:09.947 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:02:09.947 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:02:09.947 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:02:09.947 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:02:09.948 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:02:09.948 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:02:09.949 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2021-10-21T00:02:09.949 INFO:teuthology.orchestra.run.smithi071.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-21T00:02:09.956 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-21T00:02:09.980 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2021-10-21T00:02:09.980 INFO:teuthology.orchestra.run.smithi071.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-21T00:02:09.981 INFO:teuthology.orchestra.run.smithi071.stdout: libssl-dev 2021-10-21T00:02:10.115 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:10.166 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:02:10.166 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 2,913 kB of archives. 2021-10-21T00:02:10.167 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-21T00:02:10.167 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-21T00:02:10.259 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:10.305 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:10.400 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (15.2.14-138-g3fb760aa-1focal) ... 2021-10-21T00:02:10.466 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package bison. 2021-10-21T00:02:10.490 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-21T00:02:10.533 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:10.538 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:10.547 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-10-21T00:02:10.628 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-21T00:02:10.763 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-21T00:02:10.768 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-21T00:02:10.791 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-21T00:02:10.794 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-21T00:02:10.795 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-21T00:02:10.799 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-21T00:02:10.800 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-21T00:02:10.801 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-21T00:02:10.823 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:10.938 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-21T00:02:10.957 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-21T00:02:10.975 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:10.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-21T00:02:11.038 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:11.043 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-10-21T00:02:11.210 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-10-21T00:02:11.213 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-10-21T00:02:11.251 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 2,913 kB in 1s (3,184 kB/s) 2021-10-21T00:02:11.355 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-21T00:02:11.355 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-21T00:02:11.355 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-21T00:02:11.355 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:02:11.356 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:02:11.356 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:02:11.356 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:02:11.356 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:02:11.357 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:02:11.357 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-10-21T00:02:11.357 INFO:teuthology.orchestra.run.smithi102.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-21T00:02:11.365 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package flex. 2021-10-21T00:02:11.383 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package dump. 2021-10-21T00:02:11.384 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-10-21T00:02:11.386 INFO:teuthology.orchestra.run.smithi102.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-21T00:02:11.386 INFO:teuthology.orchestra.run.smithi102.stdout: libssl-dev 2021-10-21T00:02:11.405 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-21T00:02:11.432 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking dump (0.4b46-6) ... 2021-10-21T00:02:11.437 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-21T00:02:11.443 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:11.488 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-21T00:02:11.569 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:02:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 2,913 kB of archives. 2021-10-21T00:02:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-21T00:02:11.571 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-21T00:02:11.719 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package indent. 2021-10-21T00:02:11.740 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-21T00:02:11.777 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking indent (2.2.12-1) ... 2021-10-21T00:02:12.001 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package bison. 2021-10-21T00:02:12.022 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-21T00:02:12.034 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-21T00:02:12.072 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-21T00:02:12.081 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:12.093 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-21T00:02:12.130 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:12.169 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-21T00:02:12.175 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-21T00:02:12.190 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-21T00:02:12.200 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-21T00:02:12.202 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-21T00:02:12.206 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-21T00:02:12.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-21T00:02:12.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-21T00:02:12.392 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-21T00:02:12.413 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-21T00:02:12.450 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:12.514 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-21T00:02:12.534 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-21T00:02:12.614 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:12.656 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 2,913 kB in 1s (3,183 kB/s) 2021-10-21T00:02:12.795 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-21T00:02:12.806 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package flex. 2021-10-21T00:02:12.816 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:12.854 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:12.879 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-21T00:02:12.884 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:12.921 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-21T00:02:13.042 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package dump. 2021-10-21T00:02:13.063 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-21T00:02:13.089 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-21T00:02:13.109 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking dump (0.4b46-6) ... 2021-10-21T00:02:13.110 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:13.126 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:13.147 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:13.400 INFO:teuthology.orchestra.run.smithi041.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-21T00:02:13.421 INFO:teuthology.orchestra.run.smithi041.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-21T00:02:13.458 INFO:teuthology.orchestra.run.smithi041.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:13.462 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package indent. 2021-10-21T00:02:13.476 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package bison. 2021-10-21T00:02:13.482 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-21T00:02:13.496 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-21T00:02:13.499 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:13.521 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking indent (2.2.12-1) ... 2021-10-21T00:02:13.537 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:13.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-21T00:02:13.574 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:13.613 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2021-10-21T00:02:13.788 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2021-10-21T00:02:13.789 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2021-10-21T00:02:13.908 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:13.910 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-10-21T00:02:13.939 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-21T00:02:13.940 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-21T00:02:13.940 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-21T00:02:13.940 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:02:13.940 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:02:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:02:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:02:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:02:13.941 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:02:13.941 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2021-10-21T00:02:13.942 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-21T00:02:13.971 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2021-10-21T00:02:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-21T00:02:13.972 INFO:teuthology.orchestra.run.smithi062.stdout: libssl-dev 2021-10-21T00:02:13.977 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-10-21T00:02:13.990 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-21T00:02:14.009 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-21T00:02:14.015 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-21T00:02:14.028 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-21T00:02:14.033 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-21T00:02:14.066 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:14.116 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:14.144 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-10-21T00:02:14.145 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-10-21T00:02:14.154 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:02:14.154 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 2,913 kB of archives. 2021-10-21T00:02:14.154 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-21T00:02:14.155 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-21T00:02:14.155 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:14.258 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:14.288 INFO:teuthology.orchestra.run.smithi099.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-10-21T00:02:14.288 INFO:teuthology.orchestra.run.smithi099.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-10-21T00:02:14.289 INFO:teuthology.orchestra.run.smithi099.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-10-21T00:02:14.289 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2021-10-21T00:02:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-10-21T00:02:14.289 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-10-21T00:02:14.291 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-10-21T00:02:14.292 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-66-generic 2021-10-21T00:02:14.292 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2021-10-21T00:02:14.293 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2021-10-21T00:02:14.293 INFO:teuthology.orchestra.run.smithi099.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-10-21T00:02:14.320 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2021-10-21T00:02:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-10-21T00:02:14.321 INFO:teuthology.orchestra.run.smithi099.stdout: libssl-dev 2021-10-21T00:02:14.378 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-21T00:02:14.398 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-21T00:02:14.410 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:14.465 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:14.500 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2021-10-21T00:02:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 10 newly installed, 0 to remove and 26 not upgraded. 2021-10-21T00:02:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 2,913 kB of archives. 2021-10-21T00:02:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-10-21T00:02:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-10-21T00:02:14.525 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-21T00:02:14.559 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b46-6) ... 2021-10-21T00:02:14.626 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-21T00:02:14.639 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:14.765 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:14.775 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-21T00:02:14.782 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-21T00:02:14.797 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-21T00:02:14.806 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-21T00:02:14.807 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-21T00:02:14.811 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-21T00:02:14.812 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-21T00:02:14.813 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-21T00:02:14.856 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-21T00:02:14.877 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:14.878 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2021-10-21T00:02:14.901 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-21T00:02:14.921 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up dump (0.4b46-6) ... 2021-10-21T00:02:14.922 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:14.937 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1) ... 2021-10-21T00:02:14.975 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-10-21T00:02:15.011 INFO:teuthology.orchestra.run.smithi041.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-21T00:02:15.109 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:15.113 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-10-21T00:02:15.122 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-10-21T00:02:15.144 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-10-21T00:02:15.145 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-10-21T00:02:15.146 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-10-21T00:02:15.151 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-10-21T00:02:15.152 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-10-21T00:02:15.152 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-10-21T00:02:15.203 INFO:teuthology.orchestra.run.smithi041.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-21T00:02:15.218 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-21T00:02:15.238 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:15.264 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 2,913 kB in 1s (3,109 kB/s) 2021-10-21T00:02:15.269 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up indent (2.2.12-1) ... 2021-10-21T00:02:15.281 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:15.374 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-21T00:02:15.395 INFO:teuthology.orchestra.run.smithi041.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:15.396 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-21T00:02:15.443 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:15.510 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2021-10-21T00:02:15.522 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:15.563 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-21T00:02:15.583 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-21T00:02:15.585 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-21T00:02:15.589 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:15.593 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 2,913 kB in 1s (3,146 kB/s) 2021-10-21T00:02:15.631 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:15.638 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-21T00:02:15.674 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:15.727 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-21T00:02:15.747 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-21T00:02:15.758 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package flex. 2021-10-21T00:02:15.790 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:15.827 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-10-21T00:02:15.832 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:15.880 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking flex (2.6.4-6.2) ... 2021-10-21T00:02:16.159 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2021-10-21T00:02:16.167 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-21T00:02:16.173 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-21T00:02:16.179 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-21T00:02:16.192 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:16.230 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:16.295 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:16.309 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package bison. 2021-10-21T00:02:16.331 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-10-21T00:02:16.372 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:16.454 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:16.500 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-21T00:02:16.523 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:16.558 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:16.581 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:16.656 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-21T00:02:16.676 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-21T00:02:16.740 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:16.756 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:16.830 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-21T00:02:16.848 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-21T00:02:16.874 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:16.887 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:16.990 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-10-21T00:02:17.008 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up dump (0.4b46-6) ... 2021-10-21T00:02:17.011 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-10-21T00:02:17.084 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2021-10-21T00:02:17.090 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:17.098 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-21T00:02:17.105 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-21T00:02:17.152 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:17.175 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b46-6) ... 2021-10-21T00:02:17.241 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-21T00:02:17.340 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up indent (2.2.12-1) ... 2021-10-21T00:02:17.819 INFO:teuthology.orchestra.run.smithi041.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-21T00:02:17.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2021-10-21T00:02:17.821 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-21T00:02:17.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1) ... 2021-10-21T00:02:17.821 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package dump. 2021-10-21T00:02:17.822 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-10-21T00:02:17.822 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking dump (0.4b46-6) ... 2021-10-21T00:02:17.822 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:17.822 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:17.823 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:17.823 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-21T00:02:17.823 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:17.823 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:17.824 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:17.824 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package indent. 2021-10-21T00:02:17.832 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-21T00:02:17.852 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-10-21T00:02:17.855 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-21T00:02:17.873 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking indent (2.2.12-1) ... 2021-10-21T00:02:17.891 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:17.940 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:18.066 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:18.177 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-10-21T00:02:18.196 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-10-21T00:02:18.205 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-21T00:02:18.235 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:18.236 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-21T00:02:18.236 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b46-6) ... 2021-10-21T00:02:18.272 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:18.308 INFO:teuthology.orchestra.run.smithi041.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:18.309 DEBUG:teuthology.parallel:result is None 2021-10-21T00:02:18.323 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-21T00:02:18.386 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:18.475 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-21T00:02:18.495 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-10-21T00:02:18.517 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-10-21T00:02:18.546 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1) ... 2021-10-21T00:02:18.563 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:18.643 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-21T00:02:18.662 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:18.697 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:18.717 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:18.840 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:18.899 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl2:amd64. 2021-10-21T00:02:18.921 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:18.957 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:18.990 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-21T00:02:19.000 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:19.009 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:19.047 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:19.212 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-10-21T00:02:19.238 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-10-21T00:02:19.275 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:19.333 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-21T00:02:19.353 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-21T00:02:19.393 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:19.545 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-10-21T00:02:19.569 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-10-21T00:02:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:19.620 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-21T00:02:19.882 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-21T00:02:20.004 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:20.095 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up flex (2.6.4-6.2) ... 2021-10-21T00:02:20.130 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:20.219 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-10-21T00:02:20.281 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:20.378 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-10-21T00:02:20.395 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:20.397 DEBUG:teuthology.parallel:result is None 2021-10-21T00:02:20.416 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:20.505 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-10-21T00:02:20.517 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:20.631 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-10-21T00:02:20.783 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:20.837 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-21T00:02:20.908 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up dump (0.4b46-6) ... 2021-10-21T00:02:21.004 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-21T00:02:21.102 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:21.146 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b46-6) ... 2021-10-21T00:02:21.208 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-21T00:02:21.279 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up indent (2.2.12-1) ... 2021-10-21T00:02:21.383 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-10-21T00:02:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:21.445 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-10-21T00:02:21.535 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-10-21T00:02:21.566 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:21.581 DEBUG:teuthology.parallel:result is None 2021-10-21T00:02:21.608 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1) ... 2021-10-21T00:02:21.724 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:21.731 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-10-21T00:02:21.890 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-10-21T00:02:22.001 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-10-21T00:02:23.578 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-21T00:02:23.892 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-10-21T00:02:24.286 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:24.289 DEBUG:teuthology.parallel:result is None 2021-10-21T00:02:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-10-21T00:02:24.611 DEBUG:teuthology.parallel:result is None 2021-10-21T00:02:24.612 DEBUG:teuthology.orchestra.run.smithi041:> sudo lsb_release -is 2021-10-21T00:02:24.667 INFO:teuthology.orchestra.run.smithi041.stdout:Ubuntu 2021-10-21T00:02:24.673 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:02:24.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:02:24.851 DEBUG:teuthology.orchestra.run.smithi041:> dpkg-query -W -f '${Version}' ceph 2021-10-21T00:02:24.876 INFO:teuthology.orchestra.run.smithi041.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:24.877 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:24.878 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-21T00:02:24.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2021-10-21T00:02:24.940 INFO:teuthology.orchestra.run.smithi062.stdout:Ubuntu 2021-10-21T00:02:24.945 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:02:24.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:02:25.100 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2021-10-21T00:02:25.123 INFO:teuthology.orchestra.run.smithi062.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.123 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.124 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-21T00:02:25.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo lsb_release -is 2021-10-21T00:02:25.178 INFO:teuthology.orchestra.run.smithi071.stdout:Ubuntu 2021-10-21T00:02:25.187 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:02:25.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:02:25.338 DEBUG:teuthology.orchestra.run.smithi071:> dpkg-query -W -f '${Version}' ceph 2021-10-21T00:02:25.360 INFO:teuthology.orchestra.run.smithi071.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.361 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.361 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-21T00:02:25.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-10-21T00:02:25.416 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-10-21T00:02:25.421 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:02:25.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:02:25.580 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2021-10-21T00:02:25.603 INFO:teuthology.orchestra.run.smithi099.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.604 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.604 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-21T00:02:25.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-10-21T00:02:25.657 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-10-21T00:02:25.663 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-10-21T00:02:25.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3fb760aae831e6138791851b7921f8f0e05db414 2021-10-21T00:02:25.822 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2021-10-21T00:02:25.847 INFO:teuthology.orchestra.run.smithi102.stdout:15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.848 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-138-g3fb760aa-1focal 2021-10-21T00:02:25.848 INFO:teuthology.task.install:The correct ceph version 15.2.14-138-g3fb760aa-1focal is installed. 2021-10-21T00:02:25.849 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-10-21T00:02:25.849 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:25.849 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-21T00:02:25.868 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:25.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-21T00:02:25.886 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:25.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-21T00:02:25.904 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:25.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-21T00:02:25.922 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:25.923 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-10-21T00:02:25.941 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-10-21T00:02:25.942 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:25.942 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/usr/bin/daemon-helper 2021-10-21T00:02:25.959 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-21T00:02:26.022 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:26.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2021-10-21T00:02:26.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-21T00:02:26.098 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:26.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2021-10-21T00:02:26.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-21T00:02:26.170 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:26.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2021-10-21T00:02:26.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-21T00:02:26.243 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:26.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2021-10-21T00:02:26.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-10-21T00:02:26.278 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-10-21T00:02:26.279 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:26.279 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-21T00:02:26.297 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-21T00:02:26.357 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:26.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-21T00:02:26.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-21T00:02:26.385 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:26.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-21T00:02:26.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-21T00:02:26.459 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:26.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-21T00:02:26.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-21T00:02:26.491 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:26.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2021-10-21T00:02:26.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-10-21T00:02:26.523 INFO:teuthology.run_tasks:Running task ceph... 2021-10-21T00:02:26.596 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-10-21T00:02:26.597 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 777 /var/log/ceph 2021-10-21T00:02:26.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2021-10-21T00:02:26.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2021-10-21T00:02:26.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2021-10-21T00:02:26.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2021-10-21T00:02:26.625 INFO:tasks.ceph:Disabling ceph logrotate... 2021-10-21T00:02:26.625 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-21T00:02:26.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-21T00:02:26.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-21T00:02:26.664 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-21T00:02:26.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2021-10-21T00:02:26.685 INFO:tasks.ceph:Creating extra log directories... 2021-10-21T00:02:26.686 DEBUG:teuthology.orchestra.run.smithi041:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-21T00:02:26.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-21T00:02:26.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-21T00:02:26.723 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-21T00:02:26.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-10-21T00:02:26.745 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-10-21T00:02:26.746 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-10-21T00:02:26.746 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-10-21T00:02:26.746 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:26.747 DEBUG:teuthology.orchestra.run.smithi041:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-21T00:02:26.754 DEBUG:teuthology.orchestra.run.smithi041:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:26.837 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:26.837 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-21T00:02:26.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:26.887 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:26.887 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-21T00:02:26.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:26.979 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:26.980 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-21T00:02:26.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:27.067 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:27.067 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-10-21T00:02:27.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:27.117 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-10-21T00:02:27.118 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-10-21T00:02:27.118 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076', 'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6453076', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, 'workunit': {'branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-yuri5-testing-2021-10-20-0922-octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3fb760aae831e6138791851b7921f8f0e05db414', 'targets': {'smithi041.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLXBwrECUb4DctCX6GYkfL5lSjr8Xfi/oX7E6c7DZ5HxpOn/iLiHa5gXqBgQtu2L+CiRW4cj2kA0///OSKxHJUJ4SaEc8J7MrUfBi6KL6PJgwps8jX78Taw7Qg+VuEfxgLeu7ZFHuG+5z2xPv7/+Bv5lxGkDn2mjsiNpaHaNqnysJsIYlIr3gFxcbOfv1o+KewG65E/srKjC8NqWSsYeuoXEsgRHfYseIEDlVETWoW9A18di4tkQHs376Cy56F2C1z03DxCNfRKwkzO4HApUQOsSYk8R94RAYDcdH5IqA9D6GI7wO/Xg6SrIESAFy2loWImFTmcIE6K2jyiUT+yZNDjT6hpdACEKdX7YMFFIcOWiXWb5IKeLVl79vSy5+7YGmrzBM9O/xPbgdqJVLGJ2gDQVsCUJEEn/Ep+sSKR7VpyvIXjetq6c977Vw55NRyw+wQ8k5wc4XcuEY1D2VaOwLEL19jWTDPlZnJmPnzD/u3UQue/9yK3j7rDHH5jui2dbE=', 'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgMQL2m/dzc+9R8ONxMqlBE14QZanCqbP5gO93r9/GvnQyL87ui9/wmKYu9uiFyd/JCW1xUfpxgzDJRZ1DA35KWwBkav/UgM5Ene40HKqIBkA2EHM+3Nno37qY2oD3UL30+bJBaycpT3wf5qdF6I4hPvkk6vFCs8nd9PhBQNRFC0lHOOioEQEIyDmknoA49/hGMf+XlB4NfKY9WKuqP0Pm6PmclkoMU8QzveqmqaMW4FpbwbFLlDOyCwVtBp0dAUPoydeQyhDQXK4dtp8pRlGp+lLMlAks5sll53R7q3IC6NND3nxDt/h+WYasVwuWsXdUT4/QVZUgc8saxXJ8O2o3CpjK1GBGhc/2TCbAH2OPoJd2827/tBpZpVLgiBwVF8j1WXkITZOtNZu0E2Aq6TW6pwT+tz47eaKdP65KJ0MFnhQDGzWSSRM9cLbtNIN514SkI144/yPJjjweUZ4vp4zB5UqA/PQ8IquIee2F3gaQYRQhOim27w65UXsPJPgFHi0=', 'smithi071.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1+K2Jcu7Dlk/HCzcfsvkfeVCxsebE9fGclQEMdI1/ACX+M5a8fyIu9ws62e8bTtRmVrNdB1HZucQVn4TXCRfvRjOmVcH2qhfzdrIvOS9uxuyQ/tdpVKLg1yCCvzBVtswpEaf4AIT3A1/req8mQGmHVN80N1BglZrKZYoO+1CQWghyC9RP2/vfzVdSoo5tCwQNpHqYTqr3Js7lQglpJSgZBi8NNOZDblfHVzqHvSJmBUYk1XQ46Vpj4YpjT6MKPe5CkJOGobq/B0wrCyOzKU9ZCeFY365HH5O2FPzZe8uwlqWlA4LmjG07wq/II66qq65i7ro6Jcx2ZqkVkY6SmHS39DX9BsADl8/rx549uZXvlqkl3NOSwfceJusziqM/4Y3+sF3pEmzNpEgwvcO0mrZsb32nHR/AlmVdnBiajrvEh0Dz5Z3pQHosRif2XbvIQC/YfRgHBrjX2aH2Nq/KCZHURyc6pcnDCh4Yc9x24z9iglC7m9yRNC5tsRYZCfbv0jc=', 'smithi099.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnHhOZvMoITBBm3EyIiisQGGgrQOLMAycNJhBW8cWsx5YlVZd8JgiArE1eEObEAZIbBB0oBbH+WEL6Mt2VFo0JmdxEUsRuzO2OR2kH+Ujh6ri1rvLQyQo8JgkgQcFB3qHzGf/kVTZ9dL7ZpKZHJ4u4prkPSVMX3x0SiG1aexytljbMcCpH8VzloyQRdB1l956c3OMgSgY2tt5DmnomM4V0kpdweYhGsJRsKRHIuqk6TSxvhFP8uoJ87qEEmpK1lRHSk4j9OUBrWj36rq8sveSThzus3lT5V+xpdmP6adCnPPV4phCgovbjkqgIx7bLqwQUo+o0ZIyDQT28QmnDTdDUuwgDu4gKOk1ajYSvOoh/PLwStAZcb0xk3F1BYnuAXiphQH4BHkMLkTwLAqtZiXXPE977QTWt2fTYApJnNFFnEt0YtaXREJnBq3AQpXzOLuUBR7w7zE+Qb99y6ajs74QN5AlHSkyEtst34QGvQlISgFOdIoL1GBGGACL4SDIjTss=', 'smithi102.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC44RhRPsDn1TW0TRIjAwnvrOKS2GSyOL/YpKgq6a9vSFH9FIE7w77yXtLXv+myR5rBzVQe6cQFvNlAoNJ8T35MwZQHVcs5WyoRBVhh0ZxNqNpyHJ3NvMPuKCoHRqMSqilxtAK3xpj00poHicAw9NLz8ofZ/eoqbCv+KWkQ4a26mHI1S5FXd8u6toL2qsKwOj6ZLM1ZIEjzOOoWBZGLSVt+lEblxTHBxGWI1uTYxALTiSeRQEbmkzIW9BCwrQcZkGzRyp5c1XEBJQN6TdjtkH8A8+nynmi2sw4RE1ZvDtpYeUJMZTsYC2RMWSHiV3WGszZT1sH9Zbr30S4V2ikb3jy6OPW5iYBSelw3+/jHiB3rl3dUBE58lQNetF8ZJQ8TvZvOi3jG7ojRI4joddg7e04WIEtqSg59EGc7+3YQZtSmQkX65xYHGgaQb+znZInTcVDB50O+ySL27BYHOHBmhHHQPgxgKzCHSMLNCV7sw9sT2Iney3BhaJqOeo5yDRUnwjs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '3fb760aae831e6138791851b7921f8f0e05db414'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b35344e81ac507b6cad7c1cae575ce08b9c766f2', 'timestamp': '2021-10-20_18:49:58', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.6888'} 2021-10-21T00:02:27.119 DEBUG:teuthology.orchestra.run.smithi041:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-21T00:02:27.122 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-21T00:02:27.125 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-21T00:02:27.128 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-21T00:02:27.130 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-10-21T00:02:27.164 DEBUG:teuthology.orchestra.run.smithi041:> sudo install -d -m0777 -- /var/run/ceph 2021-10-21T00:02:27.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2021-10-21T00:02:27.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2021-10-21T00:02:27.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2021-10-21T00:02:27.180 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2021-10-21T00:02:27.198 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:27.199 DEBUG:teuthology.orchestra.run.smithi041:> dd if=/scratch_devs of=/dev/stdout 2021-10-21T00:02:27.235 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-21T00:02:27.236 DEBUG:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-21T00:02:27.244 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-21T00:02:27.245 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.245 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-10-21T00:02:27.246 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.246 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2021-10-20 23:58:41.524970520 +0000 2021-10-21T00:02:27.246 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2021-10-20 23:58:41.520970630 +0000 2021-10-21T00:02:27.246 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2021-10-20 23:58:41.520970630 +0000 2021-10-21T00:02:27.247 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2021-10-21T00:02:27.256 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2021-10-21T00:02:27.256 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2021-10-21T00:02:27.257 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000437246 s, 1.2 MB/s 2021-10-21T00:02:27.261 DEBUG:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-21T00:02:27.309 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-21T00:02:27.310 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.310 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-10-21T00:02:27.311 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.311 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2021-10-20 23:58:41.980957966 +0000 2021-10-21T00:02:27.312 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2021-10-20 23:58:41.976958076 +0000 2021-10-21T00:02:27.312 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2021-10-20 23:58:41.976958076 +0000 2021-10-21T00:02:27.312 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2021-10-21T00:02:27.320 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2021-10-21T00:02:27.320 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2021-10-21T00:02:27.321 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000419439 s, 1.2 MB/s 2021-10-21T00:02:27.324 DEBUG:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-21T00:02:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-21T00:02:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.331 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-10-21T00:02:27.332 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.332 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2021-10-20 23:58:42.392946624 +0000 2021-10-21T00:02:27.332 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2021-10-20 23:58:42.388946734 +0000 2021-10-21T00:02:27.332 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2021-10-20 23:58:42.388946734 +0000 2021-10-21T00:02:27.332 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2021-10-21T00:02:27.341 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2021-10-21T00:02:27.341 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2021-10-21T00:02:27.342 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000327129 s, 1.6 MB/s 2021-10-21T00:02:27.345 DEBUG:teuthology.orchestra.run.smithi041:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-21T00:02:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-21T00:02:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.353 INFO:teuthology.orchestra.run.smithi041.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-10-21T00:02:27.354 INFO:teuthology.orchestra.run.smithi041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.354 INFO:teuthology.orchestra.run.smithi041.stdout:Access: 2021-10-20 23:58:42.980930436 +0000 2021-10-21T00:02:27.354 INFO:teuthology.orchestra.run.smithi041.stdout:Modify: 2021-10-20 23:58:42.800935392 +0000 2021-10-21T00:02:27.354 INFO:teuthology.orchestra.run.smithi041.stdout:Change: 2021-10-20 23:58:42.800935392 +0000 2021-10-21T00:02:27.355 INFO:teuthology.orchestra.run.smithi041.stdout: Birth: - 2021-10-21T00:02:27.360 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records in 2021-10-21T00:02:27.361 INFO:teuthology.orchestra.run.smithi041.stderr:1+0 records out 2021-10-21T00:02:27.361 INFO:teuthology.orchestra.run.smithi041.stderr:512 bytes copied, 0.000325798 s, 1.6 MB/s 2021-10-21T00:02:27.365 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:27.366 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:27.366 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2021-10-21T00:02:27.375 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-10-21T00:02:27.375 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-10-21T00:02:27.384 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-10-21T00:02:27.385 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.386 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-10-21T00:02:27.386 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.386 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-10-20 23:58:42.562898372 +0000 2021-10-21T00:02:27.386 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-10-20 23:58:42.358903989 +0000 2021-10-21T00:02:27.387 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-10-20 23:58:42.358903989 +0000 2021-10-21T00:02:27.387 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-10-21T00:02:27.395 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-10-21T00:02:27.395 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-10-21T00:02:27.395 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000416878 s, 1.2 MB/s 2021-10-21T00:02:27.399 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-10-21T00:02:27.448 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-10-21T00:02:27.449 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.449 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-10-21T00:02:27.449 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.449 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-10-20 23:58:42.970887140 +0000 2021-10-21T00:02:27.450 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-10-20 23:58:42.794891985 +0000 2021-10-21T00:02:27.450 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-10-20 23:58:42.794891985 +0000 2021-10-21T00:02:27.450 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-10-21T00:02:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-10-21T00:02:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-10-21T00:02:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000410226 s, 1.2 MB/s 2021-10-21T00:02:27.464 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-10-21T00:02:27.471 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-10-21T00:02:27.471 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-10-21T00:02:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-10-20 23:58:43.354876569 +0000 2021-10-21T00:02:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-10-20 23:58:43.202880753 +0000 2021-10-21T00:02:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-10-20 23:58:43.202880753 +0000 2021-10-21T00:02:27.473 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-10-21T00:02:27.481 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-10-21T00:02:27.482 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-10-21T00:02:27.482 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000396303 s, 1.3 MB/s 2021-10-21T00:02:27.486 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-10-21T00:02:27.493 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-10-21T00:02:27.494 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-10-21T00:02:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 364 Links: 1 2021-10-21T00:02:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-10-21T00:02:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2021-10-20 23:58:43.746865777 +0000 2021-10-21T00:02:27.495 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2021-10-20 23:58:43.578870402 +0000 2021-10-21T00:02:27.495 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2021-10-20 23:58:43.578870402 +0000 2021-10-21T00:02:27.495 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2021-10-21T00:02:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2021-10-21T00:02:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2021-10-21T00:02:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000399735 s, 1.3 MB/s 2021-10-21T00:02:27.504 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:27.505 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi041.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-10-21T00:02:27.505 INFO:tasks.ceph:Generating config... 2021-10-21T00:02:27.506 INFO:tasks.ceph:[client] client mount timeout = 600 2021-10-21T00:02:27.507 INFO:tasks.ceph:[client] debug client = 20 2021-10-21T00:02:27.507 INFO:tasks.ceph:[client] debug ms = 1 2021-10-21T00:02:27.508 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-10-21T00:02:27.508 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-10-21T00:02:27.509 INFO:tasks.ceph:[mds] debug mds = 20 2021-10-21T00:02:27.509 INFO:tasks.ceph:[mds] debug ms = 1 2021-10-21T00:02:27.509 INFO:tasks.ceph:[mds] mds bal frag = True 2021-10-21T00:02:27.510 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-10-21T00:02:27.510 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-10-21T00:02:27.511 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-10-21T00:02:27.512 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-10-21T00:02:27.513 INFO:tasks.ceph:[mds] mds debug frag = True 2021-10-21T00:02:27.513 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-10-21T00:02:27.514 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-10-21T00:02:27.514 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-10-21T00:02:27.515 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-10-21T00:02:27.515 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-10-21T00:02:27.515 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-10-21T00:02:27.516 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-10-21T00:02:27.516 INFO:tasks.ceph:[mgr] debug ms = 1 2021-10-21T00:02:27.516 INFO:tasks.ceph:[mon] debug mon = 20 2021-10-21T00:02:27.516 INFO:tasks.ceph:[mon] debug ms = 1 2021-10-21T00:02:27.517 INFO:tasks.ceph:[mon] debug paxos = 20 2021-10-21T00:02:27.517 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-10-21T00:02:27.517 INFO:tasks.ceph:[osd] debug ms = 1 2021-10-21T00:02:27.518 INFO:tasks.ceph:[osd] debug osd = 20 2021-10-21T00:02:27.518 INFO:tasks.ceph:[osd] osd objectstore = filestore 2021-10-21T00:02:27.518 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-10-21T00:02:27.519 INFO:tasks.ceph:[osd] osd sloppy crc = True 2021-10-21T00:02:27.519 INFO:tasks.ceph:Setting up mon.a... 2021-10-21T00:02:27.519 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-10-21T00:02:27.580 INFO:teuthology.orchestra.run.smithi041.stdout:creating /etc/ceph/ceph.keyring 2021-10-21T00:02:27.584 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-10-21T00:02:27.618 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:27.632 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.41'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2021-10-21T00:02:27.633 DEBUG:teuthology.orchestra.run.smithi041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.41 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:27.710 INFO:teuthology.orchestra.run.smithi041.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:27.710 INFO:teuthology.orchestra.run.smithi041.stdout:monmaptool: generated fsid 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.711 INFO:teuthology.orchestra.run.smithi041.stdout:epoch 0 2021-10-21T00:02:27.711 INFO:teuthology.orchestra.run.smithi041.stdout:fsid 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.711 INFO:teuthology.orchestra.run.smithi041.stdout:last_changed 2021-10-21T00:02:27.707258+0000 2021-10-21T00:02:27.711 INFO:teuthology.orchestra.run.smithi041.stdout:created 2021-10-21T00:02:27.707258+0000 2021-10-21T00:02:27.711 INFO:teuthology.orchestra.run.smithi041.stdout:min_mon_release 0 (unknown) 2021-10-21T00:02:27.712 INFO:teuthology.orchestra.run.smithi041.stdout:0: [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] mon.a 2021-10-21T00:02:27.712 INFO:teuthology.orchestra.run.smithi041.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2021-10-21T00:02:27.712 INFO:teuthology.orchestra.run.smithi041.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2021-10-21T00:02:27.712 INFO:teuthology.orchestra.run.smithi041.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-10-21T00:02:27.714 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60... 2021-10-21T00:02:27.716 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:02:27.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:02:27.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:02:27.724 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:02:27.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:02:27.753 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2021-10-21T00:02:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2021-10-21T00:02:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:02:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2021-10-21T00:02:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2021-10-21T00:02:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2021-10-21T00:02:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2021-10-21T00:02:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2021-10-21T00:02:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2021-10-21T00:02:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2021-10-21T00:02:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:02:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2021-10-21T00:02:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:02:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:02:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2021-10-21T00:02:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2021-10-21T00:02:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2021-10-21T00:02:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:02:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:02:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2021-10-21T00:02:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:02:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2021-10-21T00:02:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:02:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:02:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:02:27.766 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.766 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2021-10-21T00:02:27.766 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.766 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2021-10-21T00:02:27.767 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.767 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2021-10-21T00:02:27.767 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2021-10-21T00:02:27.767 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2021-10-21T00:02:27.768 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:02:27.769 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.769 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2021-10-21T00:02:27.770 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2021-10-21T00:02:27.770 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.770 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2021-10-21T00:02:27.771 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2021-10-21T00:02:27.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.771 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2021-10-21T00:02:27.771 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2021-10-21T00:02:27.772 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.772 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2021-10-21T00:02:27.772 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2021-10-21T00:02:27.772 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2021-10-21T00:02:27.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.773 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2021-10-21T00:02:27.773 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2021-10-21T00:02:27.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.774 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:02:27.774 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.774 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2021-10-21T00:02:27.774 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.775 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2021-10-21T00:02:27.775 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.775 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:02:27.775 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2021-10-21T00:02:27.776 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.776 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2021-10-21T00:02:27.776 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2021-10-21T00:02:27.776 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:02:27.777 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2021-10-21T00:02:27.777 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = filestore 2021-10-21T00:02:27.777 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:02:27.777 INFO:teuthology.orchestra.run.smithi071.stdout: osd sloppy crc = True 2021-10-21T00:02:27.778 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.778 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2021-10-21T00:02:27.779 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:02:27.779 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2021-10-21T00:02:27.779 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:02:27.780 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:02:27.780 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.780 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.780 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2021-10-21T00:02:27.781 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.781 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2021-10-21T00:02:27.781 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:02:27.782 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:02:27.782 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2021-10-21T00:02:27.782 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:02:27.782 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2021-10-21T00:02:27.783 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2021-10-21T00:02:27.783 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.783 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2021-10-21T00:02:27.784 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2021-10-21T00:02:27.784 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.784 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.785 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:02:27.785 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:02:27.785 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:02:27.785 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.786 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:02:27.786 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:02:27.786 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:02:27.786 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2021-10-21T00:02:27.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:02:27.787 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2021-10-21T00:02:27.787 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2021-10-21T00:02:27.787 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2021-10-21T00:02:27.788 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2021-10-21T00:02:27.788 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:02:27.788 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:02:27.789 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2021-10-21T00:02:27.790 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2021-10-21T00:02:27.791 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:02:27.791 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.791 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.791 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2021-10-21T00:02:27.792 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2021-10-21T00:02:27.792 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2021-10-21T00:02:27.792 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2021-10-21T00:02:27.792 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2021-10-21T00:02:27.793 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2021-10-21T00:02:27.793 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2021-10-21T00:02:27.793 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:02:27.793 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal frag = True 2021-10-21T00:02:27.794 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal fragment size max = 10000 2021-10-21T00:02:27.794 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal merge size = 5 2021-10-21T00:02:27.794 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split bits = 3 2021-10-21T00:02:27.794 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split size = 100 2021-10-21T00:02:27.795 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2021-10-21T00:02:27.795 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2021-10-21T00:02:27.795 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2021-10-21T00:02:27.795 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2021-10-21T00:02:27.796 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:02:27.796 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.796 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.801 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-10-21T00:02:27.802 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-10-21T00:02:27.802 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:02:27.802 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-10-21T00:02:27.802 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.803 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-10-21T00:02:27.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.803 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-10-21T00:02:27.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.804 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-10-21T00:02:27.804 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-10-21T00:02:27.804 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.804 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-10-21T00:02:27.805 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-10-21T00:02:27.805 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.805 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:02:27.805 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-10-21T00:02:27.806 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.806 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:02:27.806 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:02:27.806 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.807 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-10-21T00:02:27.807 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.807 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-10-21T00:02:27.807 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-10-21T00:02:27.808 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:02:27.808 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:02:27.808 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-10-21T00:02:27.809 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:02:27.809 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-10-21T00:02:27.809 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:02:27.809 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:02:27.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.810 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:02:27.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.810 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-10-21T00:02:27.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.811 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-10-21T00:02:27.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.812 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-10-21T00:02:27.812 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-10-21T00:02:27.812 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-10-21T00:02:27.813 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:02:27.813 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.813 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-10-21T00:02:27.814 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-10-21T00:02:27.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.814 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-10-21T00:02:27.814 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-10-21T00:02:27.815 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.815 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-10-21T00:02:27.815 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-10-21T00:02:27.815 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.816 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-10-21T00:02:27.816 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-10-21T00:02:27.816 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-10-21T00:02:27.816 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.817 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-10-21T00:02:27.817 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-10-21T00:02:27.817 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.817 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:02:27.817 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.818 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-10-21T00:02:27.818 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.818 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-10-21T00:02:27.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.819 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:02:27.819 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-10-21T00:02:27.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.820 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-10-21T00:02:27.820 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-10-21T00:02:27.820 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:02:27.820 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-10-21T00:02:27.821 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = filestore 2021-10-21T00:02:27.821 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:02:27.821 INFO:teuthology.orchestra.run.smithi102.stdout: osd sloppy crc = True 2021-10-21T00:02:27.821 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.822 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-10-21T00:02:27.822 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:02:27.822 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-10-21T00:02:27.822 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:02:27.823 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:02:27.823 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.823 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.824 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-10-21T00:02:27.824 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.825 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-10-21T00:02:27.825 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:02:27.826 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:02:27.826 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-10-21T00:02:27.826 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:02:27.827 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-10-21T00:02:27.827 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-10-21T00:02:27.827 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.828 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-10-21T00:02:27.828 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-10-21T00:02:27.828 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.828 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.829 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:02:27.829 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:02:27.829 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:02:27.830 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.830 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:02:27.830 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:02:27.830 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:02:27.831 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-10-21T00:02:27.831 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:02:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-10-21T00:02:27.832 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-10-21T00:02:27.832 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-10-21T00:02:27.832 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-10-21T00:02:27.833 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:02:27.833 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:02:27.833 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-10-21T00:02:27.833 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-10-21T00:02:27.834 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:02:27.835 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.835 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-10-21T00:02:27.836 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-10-21T00:02:27.836 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-10-21T00:02:27.836 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-10-21T00:02:27.836 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-10-21T00:02:27.837 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-10-21T00:02:27.837 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-10-21T00:02:27.837 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:02:27.837 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-10-21T00:02:27.838 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-10-21T00:02:27.838 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-10-21T00:02:27.839 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-10-21T00:02:27.839 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-10-21T00:02:27.839 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-10-21T00:02:27.840 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-10-21T00:02:27.840 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-10-21T00:02:27.840 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-10-21T00:02:27.841 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:02:27.842 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.843 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.843 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2021-10-21T00:02:27.843 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2021-10-21T00:02:27.844 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:02:27.844 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2021-10-21T00:02:27.844 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.844 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2021-10-21T00:02:27.845 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.845 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2021-10-21T00:02:27.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.846 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2021-10-21T00:02:27.846 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2021-10-21T00:02:27.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.847 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2021-10-21T00:02:27.847 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2021-10-21T00:02:27.847 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.847 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:02:27.848 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2021-10-21T00:02:27.848 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.848 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:02:27.848 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:02:27.848 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.849 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2021-10-21T00:02:27.849 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.849 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2021-10-21T00:02:27.849 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2021-10-21T00:02:27.850 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:02:27.850 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:02:27.850 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2021-10-21T00:02:27.850 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:02:27.851 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2021-10-21T00:02:27.851 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:02:27.851 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:02:27.852 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.853 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:02:27.853 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.853 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2021-10-21T00:02:27.854 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.854 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2021-10-21T00:02:27.854 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.855 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2021-10-21T00:02:27.855 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2021-10-21T00:02:27.856 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2021-10-21T00:02:27.856 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:02:27.856 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.857 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2021-10-21T00:02:27.857 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2021-10-21T00:02:27.857 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.858 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2021-10-21T00:02:27.858 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2021-10-21T00:02:27.858 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.858 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2021-10-21T00:02:27.859 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2021-10-21T00:02:27.859 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.859 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2021-10-21T00:02:27.859 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2021-10-21T00:02:27.860 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2021-10-21T00:02:27.860 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.860 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2021-10-21T00:02:27.860 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2021-10-21T00:02:27.861 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.861 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:02:27.861 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.861 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2021-10-21T00:02:27.862 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.862 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2021-10-21T00:02:27.863 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.863 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:02:27.864 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2021-10-21T00:02:27.864 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.864 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2021-10-21T00:02:27.864 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2021-10-21T00:02:27.864 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:02:27.865 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2021-10-21T00:02:27.865 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = filestore 2021-10-21T00:02:27.865 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:02:27.865 INFO:teuthology.orchestra.run.smithi099.stdout: osd sloppy crc = True 2021-10-21T00:02:27.866 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.866 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2021-10-21T00:02:27.867 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:02:27.867 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2021-10-21T00:02:27.867 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:02:27.867 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:02:27.868 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.868 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.868 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2021-10-21T00:02:27.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.869 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2021-10-21T00:02:27.869 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:02:27.869 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:02:27.869 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2021-10-21T00:02:27.870 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:02:27.870 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2021-10-21T00:02:27.870 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2021-10-21T00:02:27.870 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.871 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2021-10-21T00:02:27.871 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2021-10-21T00:02:27.871 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.871 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.872 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:02:27.872 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:02:27.872 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:02:27.872 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.873 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:02:27.874 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:02:27.874 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:02:27.874 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2021-10-21T00:02:27.874 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:02:27.875 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2021-10-21T00:02:27.875 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2021-10-21T00:02:27.875 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2021-10-21T00:02:27.875 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2021-10-21T00:02:27.876 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:02:27.876 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:02:27.877 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2021-10-21T00:02:27.877 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2021-10-21T00:02:27.877 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:02:27.877 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.878 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.878 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2021-10-21T00:02:27.878 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2021-10-21T00:02:27.878 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2021-10-21T00:02:27.879 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2021-10-21T00:02:27.879 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2021-10-21T00:02:27.879 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2021-10-21T00:02:27.879 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2021-10-21T00:02:27.880 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:02:27.880 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal frag = True 2021-10-21T00:02:27.880 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal fragment size max = 10000 2021-10-21T00:02:27.880 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal merge size = 5 2021-10-21T00:02:27.881 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split bits = 3 2021-10-21T00:02:27.881 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split size = 100 2021-10-21T00:02:27.881 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2021-10-21T00:02:27.881 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2021-10-21T00:02:27.882 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2021-10-21T00:02:27.882 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2021-10-21T00:02:27.882 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:02:27.882 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.883 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.883 INFO:teuthology.orchestra.run.smithi041.stdout:[global] 2021-10-21T00:02:27.885 INFO:teuthology.orchestra.run.smithi041.stdout: chdir = "" 2021-10-21T00:02:27.885 INFO:teuthology.orchestra.run.smithi041.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:02:27.886 INFO:teuthology.orchestra.run.smithi041.stdout: auth supported = cephx 2021-10-21T00:02:27.886 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.886 INFO:teuthology.orchestra.run.smithi041.stdout: filestore xattr use omap = true 2021-10-21T00:02:27.886 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.887 INFO:teuthology.orchestra.run.smithi041.stdout: mon clock drift allowed = 1.000 2021-10-21T00:02:27.888 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.888 INFO:teuthology.orchestra.run.smithi041.stdout: osd crush chooseleaf type = 0 2021-10-21T00:02:27.888 INFO:teuthology.orchestra.run.smithi041.stdout: auth debug = true 2021-10-21T00:02:27.888 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.888 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on old message = true 2021-10-21T00:02:27.889 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on bug = true 2021-10-21T00:02:27.889 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.889 INFO:teuthology.orchestra.run.smithi041.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:02:27.890 INFO:teuthology.orchestra.run.smithi041.stdout: mon pg warn max object skew = 0 2021-10-21T00:02:27.890 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.890 INFO:teuthology.orchestra.run.smithi041.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:02:27.890 INFO:teuthology.orchestra.run.smithi041.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:02:27.891 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.891 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default size = 2 2021-10-21T00:02:27.891 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.891 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow primary affinity = true 2021-10-21T00:02:27.892 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow pg remap = true 2021-10-21T00:02:27.892 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:02:27.892 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:02:27.892 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on no sortbitwise = false 2021-10-21T00:02:27.893 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:02:27.893 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on too few osds = false 2021-10-21T00:02:27.893 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:02:27.894 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:02:27.894 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.894 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:02:27.895 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.896 INFO:teuthology.orchestra.run.smithi041.stdout: osd default data pool replay window = 5 2021-10-21T00:02:27.896 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.896 INFO:teuthology.orchestra.run.smithi041.stdout: mon allow pool delete = true 2021-10-21T00:02:27.896 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.897 INFO:teuthology.orchestra.run.smithi041.stdout: mon cluster log file level = debug 2021-10-21T00:02:27.897 INFO:teuthology.orchestra.run.smithi041.stdout: debug asserts on shutdown = true 2021-10-21T00:02:27.897 INFO:teuthology.orchestra.run.smithi041.stdout: mon health detail to clog = false 2021-10-21T00:02:27.897 INFO:teuthology.orchestra.run.smithi041.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:02:27.898 INFO:teuthology.orchestra.run.smithi041.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.898 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.898 INFO:teuthology.orchestra.run.smithi041.stdout:[osd] 2021-10-21T00:02:27.898 INFO:teuthology.orchestra.run.smithi041.stdout: osd journal size = 100 2021-10-21T00:02:27.898 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.899 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub load threshold = 5.0 2021-10-21T00:02:27.899 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub max interval = 600 2021-10-21T00:02:27.899 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.899 INFO:teuthology.orchestra.run.smithi041.stdout: osd recover clone overlap = true 2021-10-21T00:02:27.900 INFO:teuthology.orchestra.run.smithi041.stdout: osd recovery max chunk = 1048576 2021-10-21T00:02:27.900 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.900 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug shutdown = true 2021-10-21T00:02:27.900 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug op order = true 2021-10-21T00:02:27.900 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug verify stray on activate = true 2021-10-21T00:02:27.901 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.901 INFO:teuthology.orchestra.run.smithi041.stdout: osd open classes on start = true 2021-10-21T00:02:27.901 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug pg log writeout = true 2021-10-21T00:02:27.901 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.902 INFO:teuthology.orchestra.run.smithi041.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:02:27.902 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.902 INFO:teuthology.orchestra.run.smithi041.stdout: osd map max advance = 10 2021-10-21T00:02:27.902 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.903 INFO:teuthology.orchestra.run.smithi041.stdout: journal zero on create = true 2021-10-21T00:02:27.903 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.903 INFO:teuthology.orchestra.run.smithi041.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:02:27.903 INFO:teuthology.orchestra.run.smithi041.stdout: filestore apply finisher threads = 3 2021-10-21T00:02:27.903 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.904 INFO:teuthology.orchestra.run.smithi041.stdout: bdev debug aio = true 2021-10-21T00:02:27.904 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug misdirected ops = true 2021-10-21T00:02:27.904 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:02:27.904 INFO:teuthology.orchestra.run.smithi041.stdout: debug osd = 20 2021-10-21T00:02:27.904 INFO:teuthology.orchestra.run.smithi041.stdout: osd objectstore = filestore 2021-10-21T00:02:27.905 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:02:27.905 INFO:teuthology.orchestra.run.smithi041.stdout: osd sloppy crc = True 2021-10-21T00:02:27.905 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.905 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr] 2021-10-21T00:02:27.906 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:02:27.906 INFO:teuthology.orchestra.run.smithi041.stdout: debug mgr = 20 2021-10-21T00:02:27.906 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:02:27.906 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:02:27.906 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.907 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.907 INFO:teuthology.orchestra.run.smithi041.stdout: mgr/telemetry/nag = false 2021-10-21T00:02:27.907 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.907 INFO:teuthology.orchestra.run.smithi041.stdout:[mon] 2021-10-21T00:02:27.908 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:02:27.908 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:02:27.908 INFO:teuthology.orchestra.run.smithi041.stdout: debug paxos = 20 2021-10-21T00:02:27.910 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:02:27.910 INFO:teuthology.orchestra.run.smithi041.stdout: mon data avail warn = 5 2021-10-21T00:02:27.910 INFO:teuthology.orchestra.run.smithi041.stdout: mon mgr mkfs grace = 240 2021-10-21T00:02:27.911 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.911 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd reporter subtree level = osd 2021-10-21T00:02:27.911 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd prime pg temp = true 2021-10-21T00:02:27.911 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.911 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.912 INFO:teuthology.orchestra.run.smithi041.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:02:27.912 INFO:teuthology.orchestra.run.smithi041.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:02:27.912 INFO:teuthology.orchestra.run.smithi041.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:02:27.913 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.914 INFO:teuthology.orchestra.run.smithi041.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:02:27.914 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:02:27.914 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:02:27.914 INFO:teuthology.orchestra.run.smithi041.stdout: mon op complaint time = 120 2021-10-21T00:02:27.915 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:27.915 INFO:teuthology.orchestra.run.smithi041.stdout:[client] 2021-10-21T00:02:27.915 INFO:teuthology.orchestra.run.smithi041.stdout: rgw cache enabled = true 2021-10-21T00:02:27.915 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable ops log = true 2021-10-21T00:02:27.916 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable usage log = true 2021-10-21T00:02:27.916 INFO:teuthology.orchestra.run.smithi041.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:02:27.916 INFO:teuthology.orchestra.run.smithi041.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:02:27.916 INFO:teuthology.orchestra.run.smithi041.stdout: client mount timeout = 600 2021-10-21T00:02:27.916 INFO:teuthology.orchestra.run.smithi041.stdout: debug client = 20 2021-10-21T00:02:27.917 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:02:27.917 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.917 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.917 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.a] 2021-10-21T00:02:27.918 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.b] 2021-10-21T00:02:27.918 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.c] 2021-10-21T00:02:27.918 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2021-10-21T00:02:27.918 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2021-10-21T00:02:27.918 INFO:teuthology.orchestra.run.smithi041.stdout:[mds] 2021-10-21T00:02:27.919 INFO:teuthology.orchestra.run.smithi041.stdout: debug mds = 20 2021-10-21T00:02:27.919 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:02:27.919 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal frag = True 2021-10-21T00:02:27.919 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal fragment size max = 10000 2021-10-21T00:02:27.920 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal merge size = 5 2021-10-21T00:02:27.920 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split bits = 3 2021-10-21T00:02:27.920 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split size = 100 2021-10-21T00:02:27.920 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug frag = True 2021-10-21T00:02:27.920 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug scatterstat = True 2021-10-21T00:02:27.921 INFO:teuthology.orchestra.run.smithi041.stdout: mds op complaint time = 180 2021-10-21T00:02:27.921 INFO:teuthology.orchestra.run.smithi041.stdout: mds verify scatter = True 2021-10-21T00:02:27.921 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:02:27.921 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.921 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.922 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-10-21T00:02:27.922 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-10-21T00:02:27.922 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:02:27.924 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-10-21T00:02:27.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.924 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-10-21T00:02:27.925 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.926 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-10-21T00:02:27.926 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.928 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-10-21T00:02:27.928 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-10-21T00:02:27.930 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.932 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-10-21T00:02:27.934 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-10-21T00:02:27.934 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.934 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:02:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-10-21T00:02:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:02:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:02:27.936 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.936 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-10-21T00:02:27.936 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.936 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-10-21T00:02:27.937 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-10-21T00:02:27.937 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:02:27.937 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:02:27.937 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-10-21T00:02:27.938 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:02:27.939 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-10-21T00:02:27.939 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:02:27.939 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:02:27.939 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.940 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:02:27.940 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.940 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-10-21T00:02:27.940 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.941 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-10-21T00:02:27.941 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.941 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-10-21T00:02:27.941 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-10-21T00:02:27.942 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-10-21T00:02:27.942 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:02:27.943 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:02:27.943 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.943 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-10-21T00:02:27.943 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-10-21T00:02:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-10-21T00:02:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-10-21T00:02:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.945 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-10-21T00:02:27.945 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-10-21T00:02:27.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.946 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-10-21T00:02:27.946 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-10-21T00:02:27.946 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-10-21T00:02:27.947 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.947 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-10-21T00:02:27.947 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-10-21T00:02:27.947 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.948 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:02:27.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.948 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-10-21T00:02:27.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.949 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-10-21T00:02:27.949 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.949 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:02:27.949 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-10-21T00:02:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-10-21T00:02:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-10-21T00:02:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:02:27.951 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-10-21T00:02:27.951 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = filestore 2021-10-21T00:02:27.951 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:02:27.952 INFO:teuthology.orchestra.run.smithi062.stdout: osd sloppy crc = True 2021-10-21T00:02:27.952 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.952 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-10-21T00:02:27.952 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:02:27.953 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-10-21T00:02:27.953 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:02:27.953 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:02:27.953 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.954 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.954 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-10-21T00:02:27.954 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.954 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-10-21T00:02:27.955 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:02:27.955 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:02:27.955 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-10-21T00:02:27.955 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:02:27.956 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-10-21T00:02:27.956 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-10-21T00:02:27.956 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:02:27.956 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-10-21T00:02:27.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-10-21T00:02:27.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:02:27.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.957 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:02:27.957 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:02:27.958 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:02:27.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.958 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:02:27.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:02:27.959 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:02:27.959 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-10-21T00:02:27.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:02:27.959 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-10-21T00:02:27.960 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-10-21T00:02:27.960 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-10-21T00:02:27.960 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-10-21T00:02:27.960 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:02:27.961 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:02:27.961 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-10-21T00:02:27.961 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-10-21T00:02:27.961 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:02:27.962 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.962 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.962 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-10-21T00:02:27.962 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-10-21T00:02:27.963 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-10-21T00:02:27.963 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-10-21T00:02:27.963 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-10-21T00:02:27.964 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-10-21T00:02:27.964 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-10-21T00:02:27.964 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:02:27.964 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-10-21T00:02:27.965 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-10-21T00:02:27.965 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-10-21T00:02:27.965 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-10-21T00:02:27.965 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-10-21T00:02:27.966 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-10-21T00:02:27.966 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-10-21T00:02:27.966 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-10-21T00:02:27.966 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-10-21T00:02:27.967 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:02:27.967 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:02:27.967 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:02:27.968 INFO:tasks.ceph:Creating admin key on mon.a... 2021-10-21T00:02:27.968 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-10-21T00:02:28.019 INFO:tasks.ceph:Copying monmap to all nodes... 2021-10-21T00:02:28.033 DEBUG:teuthology.orchestra.remote:smithi041:/etc/ceph/ceph.keyring is 206B 2021-10-21T00:02:28.097 DEBUG:teuthology.orchestra.remote:smithi041:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-10-21T00:02:28.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:02:28.153 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:28.153 DEBUG:teuthology.orchestra.run.smithi041:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-21T00:02:28.153 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:28.182 DEBUG:teuthology.orchestra.run.smithi041:> set -ex 2021-10-21T00:02:28.183 DEBUG:teuthology.orchestra.run.smithi041:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:28.232 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:02:28.233 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:28.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-21T00:02:28.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:28.263 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2021-10-21T00:02:28.263 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:28.268 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2021-10-21T00:02:28.269 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:28.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-21T00:02:28.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:28.296 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2021-10-21T00:02:28.297 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:28.304 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2021-10-21T00:02:28.305 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:28.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-21T00:02:28.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:28.333 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-10-21T00:02:28.334 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:28.383 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2021-10-21T00:02:28.384 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:28.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2021-10-21T00:02:28.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-10-21T00:02:28.411 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-10-21T00:02:28.412 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:28.417 INFO:tasks.ceph:Setting up mon nodes... 2021-10-21T00:02:28.417 INFO:tasks.ceph:Setting up mgr nodes... 2021-10-21T00:02:28.418 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-10-21T00:02:28.464 INFO:teuthology.orchestra.run.smithi041.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-10-21T00:02:28.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-10-21T00:02:28.534 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-10-21T00:02:28.536 INFO:tasks.ceph:Setting up mds nodes... 2021-10-21T00:02:28.537 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-10-21T00:02:28.581 INFO:teuthology.orchestra.run.smithi041.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-10-21T00:02:28.584 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-10-21T00:02:28.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-10-21T00:02:28.690 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-10-21T00:02:28.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-10-21T00:02:28.707 INFO:tasks.ceph_client:Setting up client nodes... 2021-10-21T00:02:28.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-10-21T00:02:28.766 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-10-21T00:02:28.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-10-21T00:02:28.858 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-10-21T00:02:28.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-10-21T00:02:28.929 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-10-21T00:02:28.943 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-10-21T00:02:28.943 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi041.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-10-21T00:02:28.944 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-10-21T00:02:28.962 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:28.963 INFO:tasks.ceph:role: osd.0 2021-10-21T00:02:28.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:02:28.964 DEBUG:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-10-21T00:02:29.483 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:29.484 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:29.484 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:29.484 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2021-10-21T00:02:29.484 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:29.485 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:29.485 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:29.485 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:29.485 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:29.485 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:29.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2021-10-21T00:02:29.487 DEBUG:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-10-21T00:02:29.588 DEBUG:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-10-21T00:02:29.600 INFO:teuthology.orchestra.run.smithi041.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:29.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:29.602 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-10-21T00:02:29.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:29.613 INFO:tasks.ceph:role: osd.1 2021-10-21T00:02:29.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:02:29.614 DEBUG:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-10-21T00:02:30.132 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:30.133 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:30.134 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:30.134 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2021-10-21T00:02:30.135 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:30.136 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:30.136 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:30.137 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:30.137 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:30.137 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:30.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2021-10-21T00:02:30.139 DEBUG:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-10-21T00:02:30.183 DEBUG:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-10-21T00:02:30.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:30.196 INFO:teuthology.orchestra.run.smithi041.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:30.197 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-10-21T00:02:30.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:30.255 INFO:tasks.ceph:role: osd.2 2021-10-21T00:02:30.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:02:30.256 DEBUG:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-10-21T00:02:30.728 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:30.729 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:30.729 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:30.729 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2021-10-21T00:02:30.730 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:30.730 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:30.730 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:30.730 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:30.731 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:30.731 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:30.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2021-10-21T00:02:30.733 DEBUG:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-10-21T00:02:30.790 DEBUG:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-10-21T00:02:30.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:30.804 INFO:teuthology.orchestra.run.smithi041.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:30.804 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-10-21T00:02:30.863 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:30.863 INFO:tasks.ceph:role: osd.3 2021-10-21T00:02:30.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:02:30.864 DEBUG:teuthology.orchestra.run.smithi041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-10-21T00:02:31.361 INFO:teuthology.orchestra.run.smithi041.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:31.361 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:31.361 INFO:teuthology.orchestra.run.smithi041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:31.362 INFO:teuthology.orchestra.run.smithi041.stdout: = reflink=1 2021-10-21T00:02:31.362 INFO:teuthology.orchestra.run.smithi041.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:31.362 INFO:teuthology.orchestra.run.smithi041.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:31.362 INFO:teuthology.orchestra.run.smithi041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:31.363 INFO:teuthology.orchestra.run.smithi041.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:31.363 INFO:teuthology.orchestra.run.smithi041.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:31.363 INFO:teuthology.orchestra.run.smithi041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:31.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi041.front.sepia.ceph.com -o noatime 2021-10-21T00:02:31.365 DEBUG:teuthology.orchestra.run.smithi041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-10-21T00:02:31.415 DEBUG:teuthology.orchestra.run.smithi041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-10-21T00:02:31.426 INFO:teuthology.orchestra.run.smithi041.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:31.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:31.427 DEBUG:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:31.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.499+0000 7fed57cdbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-10-21T00:02:31.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.499+0000 7fed57cdbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-10-21T00:02:31.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.535+0000 7fed57cdbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:31.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.535+0000 7fed57cdbd80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:31.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.807+0000 7fed57cdbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.811+0000 7fed57cdbd80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.811+0000 7fed57cdbd80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:31.854 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-10-21T00:02:31.879 DEBUG:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:31.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.951+0000 7faacba97d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-10-21T00:02:31.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.955+0000 7faacba97d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-10-21T00:02:31.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.987+0000 7faacba97d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:31.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:31.987+0000 7faacba97d80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:32.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.255+0000 7faacba97d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:32.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.255+0000 7faacba97d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.255+0000 7faacba97d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.300 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-10-21T00:02:32.316 DEBUG:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:32.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.343+0000 7f450a077d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-10-21T00:02:32.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.343+0000 7f450a077d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-10-21T00:02:32.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.363+0000 7f450a077d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:32.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.363+0000 7f450a077d80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.511+0000 7f450a077d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.511+0000 7f450a077d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.511+0000 7f450a077d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.535 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-10-21T00:02:32.552 DEBUG:teuthology.orchestra.run.smithi041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:32.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.579+0000 7fb032110d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-10-21T00:02:32.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.579+0000 7fb032110d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-10-21T00:02:32.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.591+0000 7fb032110d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:32.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.591+0000 7fb032110d80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:32.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.719+0000 7fb032110d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:32.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.723+0000 7fb032110d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:32.723+0000 7fb032110d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:32.751 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-10-21T00:02:32.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-10-21T00:02:32.786 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:32.786 INFO:tasks.ceph:role: osd.4 2021-10-21T00:02:32.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:02:32.787 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-10-21T00:02:33.368 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:33.369 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:33.369 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:33.369 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-10-21T00:02:33.369 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:33.370 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:33.373 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:33.374 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:33.374 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:33.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-10-21T00:02:33.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-10-21T00:02:33.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-10-21T00:02:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:33.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:33.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-10-21T00:02:33.546 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:33.546 INFO:tasks.ceph:role: osd.5 2021-10-21T00:02:33.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:02:33.547 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-10-21T00:02:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:34.045 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:34.046 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:34.046 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-10-21T00:02:34.046 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:34.046 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:34.047 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:34.047 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:34.047 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:34.047 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:34.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-10-21T00:02:34.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-10-21T00:02:34.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-10-21T00:02:34.101 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:34.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:34.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-10-21T00:02:34.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:34.163 INFO:tasks.ceph:role: osd.6 2021-10-21T00:02:34.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:02:34.180 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-10-21T00:02:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:34.659 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:34.659 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:34.659 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-10-21T00:02:34.660 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:34.660 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:34.660 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:34.660 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:34.661 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:34.661 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:34.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-10-21T00:02:34.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-10-21T00:02:34.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-10-21T00:02:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:34.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:34.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-10-21T00:02:34.746 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-10-21T00:02:34.746 INFO:tasks.ceph:role: osd.7 2021-10-21T00:02:34.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:02:34.748 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-10-21T00:02:35.293 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-10-21T00:02:35.293 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2021-10-21T00:02:35.293 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-10-21T00:02:35.293 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2021-10-21T00:02:35.294 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-10-21T00:02:35.294 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2021-10-21T00:02:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-10-21T00:02:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-10-21T00:02:35.295 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-10-21T00:02:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-10-21T00:02:35.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2021-10-21T00:02:35.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-10-21T00:02:35.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-10-21T00:02:35.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:02:35.365 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2021-10-21T00:02:35.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.465+0000 7f862edced80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-10-21T00:02:35.476 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.469+0000 7f862edced80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-10-21T00:02:35.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.497+0000 7f862edced80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.501+0000 7f862edced80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.737+0000 7f862edced80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.737+0000 7f862edced80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.737+0000 7f862edced80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:35.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-10-21T00:02:35.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:35.824 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.817+0000 7fbd265fbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-10-21T00:02:35.825 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.817+0000 7fbd265fbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-10-21T00:02:35.861 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.853+0000 7fbd265fbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:35.862 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:35.857+0000 7fbd265fbd80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:36.140 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.133+0000 7fbd265fbd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:36.141 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.133+0000 7fbd265fbd80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.133+0000 7fbd265fbd80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:36.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-10-21T00:02:36.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:36.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.273+0000 7f46c6c25d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-10-21T00:02:36.280 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.273+0000 7f46c6c25d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-10-21T00:02:36.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.281+0000 7f46c6c25d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:36.290 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.281+0000 7f46c6c25d80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:36.457 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.449+0000 7f46c6c25d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.449+0000 7f46c6c25d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:36.813 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.449+0000 7f46c6c25d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:36.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-10-21T00:02:36.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:36.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.865+0000 7f2ddadb4d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-10-21T00:02:36.874 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.865+0000 7f2ddadb4d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-10-21T00:02:36.887 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.881+0000 7f2ddadb4d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:36.888 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:36.881+0000 7f2ddadb4d80 -1 journal FileJournal::_open_file : zeroing journal 2021-10-21T00:02:37.029 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:37.021+0000 7f2ddadb4d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:37.021+0000 7f2ddadb4d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:37.021+0000 7f2ddadb4d80 -1 journal do_read_entry(4096): bad header magic 2021-10-21T00:02:37.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-10-21T00:02:37.065 INFO:tasks.ceph:Reading keys from all nodes... 2021-10-21T00:02:37.065 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:37.073 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.FEPRugBFmT 2021-10-21T00:02:37.073 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.FEPRugBFmT 2021-10-21T00:02:37.130 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.FEPRugBFmT 2021-10-21T00:02:37.326 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.FEPRugBFmT is 56B 2021-10-21T00:02:37.341 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.FEPRugBFmT 2021-10-21T00:02:37.348 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:37.396 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.dE5WKi58P3 2021-10-21T00:02:37.396 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.dE5WKi58P3 2021-10-21T00:02:37.413 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.dE5WKi58P3 2021-10-21T00:02:37.485 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.dE5WKi58P3 is 56B 2021-10-21T00:02:37.537 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.dE5WKi58P3 2021-10-21T00:02:37.544 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:37.596 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.P1I09sKKly 2021-10-21T00:02:37.597 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.P1I09sKKly 2021-10-21T00:02:37.621 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.P1I09sKKly 2021-10-21T00:02:37.696 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.P1I09sKKly is 56B 2021-10-21T00:02:37.717 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.P1I09sKKly 2021-10-21T00:02:37.725 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:37.772 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.B8UfOqLgSr 2021-10-21T00:02:37.772 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.B8UfOqLgSr 2021-10-21T00:02:37.787 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.B8UfOqLgSr 2021-10-21T00:02:37.813 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.B8UfOqLgSr is 56B 2021-10-21T00:02:37.830 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.B8UfOqLgSr 2021-10-21T00:02:37.838 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:37.885 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.bWbM4E7ZoR 2021-10-21T00:02:37.885 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.bWbM4E7ZoR 2021-10-21T00:02:37.902 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.bWbM4E7ZoR 2021-10-21T00:02:37.972 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.bWbM4E7ZoR is 56B 2021-10-21T00:02:37.997 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.bWbM4E7ZoR 2021-10-21T00:02:38.006 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:38.052 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.TCvqSaichb 2021-10-21T00:02:38.052 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.TCvqSaichb 2021-10-21T00:02:38.070 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.TCvqSaichb 2021-10-21T00:02:38.141 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.TCvqSaichb is 56B 2021-10-21T00:02:38.197 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.TCvqSaichb 2021-10-21T00:02:38.205 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.213 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.gpIvQCdUuf 2021-10-21T00:02:38.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.gpIvQCdUuf 2021-10-21T00:02:38.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.gpIvQCdUuf 2021-10-21T00:02:38.300 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.gpIvQCdUuf is 56B 2021-10-21T00:02:38.316 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.gpIvQCdUuf 2021-10-21T00:02:38.323 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.cTXM2SSjgP 2021-10-21T00:02:38.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.cTXM2SSjgP 2021-10-21T00:02:38.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.cTXM2SSjgP 2021-10-21T00:02:38.414 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.cTXM2SSjgP is 56B 2021-10-21T00:02:38.429 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.cTXM2SSjgP 2021-10-21T00:02:38.436 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.484 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.Fo8ZYfWyIx 2021-10-21T00:02:38.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Fo8ZYfWyIx 2021-10-21T00:02:38.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.Fo8ZYfWyIx 2021-10-21T00:02:38.573 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.Fo8ZYfWyIx is 56B 2021-10-21T00:02:38.588 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.Fo8ZYfWyIx 2021-10-21T00:02:38.597 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.644 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.b5YyT07y1o 2021-10-21T00:02:38.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.b5YyT07y1o 2021-10-21T00:02:38.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.b5YyT07y1o 2021-10-21T00:02:38.745 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.b5YyT07y1o is 56B 2021-10-21T00:02:38.761 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.b5YyT07y1o 2021-10-21T00:02:38.768 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.824 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.UTUVGhZPka 2021-10-21T00:02:38.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.UTUVGhZPka 2021-10-21T00:02:38.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.UTUVGhZPka 2021-10-21T00:02:38.907 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.UTUVGhZPka is 56B 2021-10-21T00:02:38.924 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.UTUVGhZPka 2021-10-21T00:02:38.930 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:38.981 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.3vEXCtyKYA 2021-10-21T00:02:38.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.3vEXCtyKYA 2021-10-21T00:02:39.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.3vEXCtyKYA 2021-10-21T00:02:39.077 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.3vEXCtyKYA is 56B 2021-10-21T00:02:39.097 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.3vEXCtyKYA 2021-10-21T00:02:39.119 DEBUG:teuthology.orchestra.remote:smithi071:/etc/ceph/ceph.client.0.keyring is 59B 2021-10-21T00:02:39.152 DEBUG:teuthology.orchestra.remote:smithi099:/etc/ceph/ceph.client.1.keyring is 59B 2021-10-21T00:02:39.182 DEBUG:teuthology.orchestra.remote:smithi102:/etc/ceph/ceph.client.2.keyring is 59B 2021-10-21T00:02:39.208 INFO:tasks.ceph:Adding keys to all mons... 2021-10-21T00:02:39.209 DEBUG:teuthology.orchestra.run.smithi041:> sudo tee -a /etc/ceph/ceph.keyring 2021-10-21T00:02:39.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2021-10-21T00:02:39.224 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr.y] 2021-10-21T00:02:39.225 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg== 2021-10-21T00:02:39.225 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2021-10-21T00:02:39.225 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg== 2021-10-21T00:02:39.225 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.0] 2021-10-21T00:02:39.226 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ== 2021-10-21T00:02:39.226 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.1] 2021-10-21T00:02:39.226 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ== 2021-10-21T00:02:39.226 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.2] 2021-10-21T00:02:39.226 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA== 2021-10-21T00:02:39.227 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.3] 2021-10-21T00:02:39.227 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g== 2021-10-21T00:02:39.227 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr.x] 2021-10-21T00:02:39.227 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw== 2021-10-21T00:02:39.228 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2021-10-21T00:02:39.228 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg== 2021-10-21T00:02:39.228 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.4] 2021-10-21T00:02:39.228 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g== 2021-10-21T00:02:39.228 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.5] 2021-10-21T00:02:39.229 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw== 2021-10-21T00:02:39.229 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.6] 2021-10-21T00:02:39.229 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ== 2021-10-21T00:02:39.229 INFO:teuthology.orchestra.run.smithi041.stdout:[osd.7] 2021-10-21T00:02:39.230 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA== 2021-10-21T00:02:39.230 INFO:teuthology.orchestra.run.smithi041.stdout:[client.0] 2021-10-21T00:02:39.230 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg== 2021-10-21T00:02:39.230 INFO:teuthology.orchestra.run.smithi041.stdout:[client.1] 2021-10-21T00:02:39.230 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA== 2021-10-21T00:02:39.231 INFO:teuthology.orchestra.run.smithi041.stdout:[client.2] 2021-10-21T00:02:39.231 INFO:teuthology.orchestra.run.smithi041.stdout: key = AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A== 2021-10-21T00:02:39.235 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2021-10-21T00:02:39.236 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg== 2021-10-21T00:02:39.236 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-10-21T00:02:39.238 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg== 2021-10-21T00:02:39.238 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2021-10-21T00:02:39.239 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ== 2021-10-21T00:02:39.239 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2021-10-21T00:02:39.240 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ== 2021-10-21T00:02:39.241 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2021-10-21T00:02:39.241 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA== 2021-10-21T00:02:39.243 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2021-10-21T00:02:39.244 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g== 2021-10-21T00:02:39.244 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2021-10-21T00:02:39.245 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw== 2021-10-21T00:02:39.245 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-10-21T00:02:39.245 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg== 2021-10-21T00:02:39.245 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2021-10-21T00:02:39.246 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g== 2021-10-21T00:02:39.246 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2021-10-21T00:02:39.246 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw== 2021-10-21T00:02:39.247 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2021-10-21T00:02:39.247 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ== 2021-10-21T00:02:39.248 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2021-10-21T00:02:39.248 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA== 2021-10-21T00:02:39.249 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2021-10-21T00:02:39.249 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg== 2021-10-21T00:02:39.250 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2021-10-21T00:02:39.250 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA== 2021-10-21T00:02:39.250 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2021-10-21T00:02:39.251 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A== 2021-10-21T00:02:39.255 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-21T00:02:39.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-21T00:02:39.312 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-21T00:02:39.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-21T00:02:39.409 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.464 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.522 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.610 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.669 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-21T00:02:39.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-10-21T00:02:39.751 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-21T00:02:39.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-10-21T00:02:39.817 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.865 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.948 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:39.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:40.005 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:40.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-10-21T00:02:40.052 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.172 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.250 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-10-21T00:02:40.343 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-10-21T00:02:40.344 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-10-21T00:02:40.372 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-21T00:02:40.490 DEBUG:teuthology.orchestra.run.smithi041:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-10-21T00:02:40.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-10-21T00:02:40.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-21T00:02:40.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-10-21T00:02:40.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-10-21T00:02:40.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-10-21T00:02:40.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-10-21T00:02:41.001 DEBUG:teuthology.orchestra.run.smithi041:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:41.025 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-10-21T00:02:41.053 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-10-21T00:02:41.054 INFO:tasks.ceph.mon.a:Restarting daemon 2021-10-21T00:02:41.054 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-10-21T00:02:41.065 INFO:tasks.ceph.mon.a:Started 2021-10-21T00:02:41.067 INFO:tasks.ceph.mon.b:Restarting daemon 2021-10-21T00:02:41.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-10-21T00:02:41.079 INFO:tasks.ceph.mon.b:Started 2021-10-21T00:02:41.079 INFO:tasks.ceph.mon.c:Restarting daemon 2021-10-21T00:02:41.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-10-21T00:02:41.087 INFO:tasks.ceph.mon.c:Started 2021-10-21T00:02:41.087 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-10-21T00:02:41.088 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-10-21T00:02:41.088 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-10-21T00:02:41.126 INFO:tasks.ceph.mgr.y:Started 2021-10-21T00:02:41.128 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-10-21T00:02:41.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-10-21T00:02:41.147 INFO:tasks.ceph.mgr.x:Started 2021-10-21T00:02:41.148 INFO:tasks.ceph:Setting crush tunables to default 2021-10-21T00:02:41.150 DEBUG:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd crush tunables default 2021-10-21T00:02:41.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 Processor -- start 2021-10-21T00:02:41.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 -- start start 2021-10-21T00:02:41.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 0x7f4b88152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880628a0 con 0x7f4b880b3a20 2021-10-21T00:02:41.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b881479c0 con 0x7f4b880b2cf0 2021-10-21T00:02:41.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b8759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b880b0d90 con 0x7f4b8805c5e0 2021-10-21T00:02:41.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b85d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4b880b3a20 0x7f4b8805bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:54840/0 (socket says 172.21.15.41:54840) 2021-10-21T00:02:41.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b85d9b700 1 -- 172.21.15.41:0/396132251 learned_addr learned my addr 172.21.15.41:0/396132251 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:41.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 0x7f4b88152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b86d9d700 1 -- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 msgr2=0x7f4b88152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-10-21T00:02:41.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b86d9d700 1 -- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 msgr2=0x7f4b88152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-10-21T00:02:41.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 0x7f4b88152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-10-21T00:02:41.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.255+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 0x7f4b88152740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-10-21T00:02:41.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229527910 0 0) 0x7f4b880628a0 con 0x7f4b880b3a20 2021-10-21T00:02:41.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c003260 con 0x7f4b880b3a20 2021-10-21T00:02:41.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195367463 0 0) 0x7f4b881479c0 con 0x7f4b880b2cf0 2021-10-21T00:02:41.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b880628a0 con 0x7f4b880b2cf0 2021-10-21T00:02:41.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972488737 0 0) 0x7f4b880628a0 con 0x7f4b880b2cf0 2021-10-21T00:02:41.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 msgr2=0x7f4b88152740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-10-21T00:02:41.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 --2- 172.21.15.41:0/396132251 >> v2:172.21.15.41:3300/0 conn(0x7f4b8805c5e0 0x7f4b88152740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 >> v1:172.21.15.41:6789/0 conn(0x7f4b880b3a20 legacy=0x7f4b8805bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88147c60 con 0x7f4b880b2cf0 2021-10-21T00:02:41.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f4b7c001660 con 0x7f4b880b2cf0 2021-10-21T00:02:41.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 >> v1:172.21.15.62:6789/0 conn(0x7f4b880b2cf0 legacy=0x7f4b88062190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b6c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c004500 0x7f4b6c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c004f90 0x7f4b6c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880b0d90 con 0x7f4b6c003930 2021-10-21T00:02:41.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00bdd0 con 0x7f4b6c004f90 2021-10-21T00:02:41.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00bf90 con 0x7f4b6c004500 2021-10-21T00:02:41.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b8659c700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b6c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b85d9b700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c004500 0x7f4b6c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.427+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c004f90 0x7f4b6c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 -- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c004500 msgr2=0x7f4b6c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:41.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c004500 0x7f4b6c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 -- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c004f90 msgr2=0x7f4b6c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c004f90 0x7f4b6c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b86d9d700 1 -- 172.21.15.41:0/396132251 reap_dead start 2021-10-21T00:02:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 -- 172.21.15.41:0/396132251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880628a0 con 0x7f4b6c003930 2021-10-21T00:02:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8659c700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b6c003d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4b7c001430 tx=0x7f4b88147b50).ready entity=mon.0 client_cookie=2931f3ff784cf3e9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7c00c700 con 0x7f4b6c003930 2021-10-21T00:02:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c00c860 con 0x7f4b6c003930 2021-10-21T00:02:41.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8559a700 1 -- 172.21.15.41:0/396132251 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7c00cbc0 con 0x7f4b6c003930 2021-10-21T00:02:41.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 -- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 msgr2=0x7f4b6c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b6c003d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4b7c001430 tx=0x7f4b88147b50).stop 2021-10-21T00:02:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 -- 172.21.15.41:0/396132251 shutdown_connections 2021-10-21T00:02:41.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 --2- 172.21.15.41:0/396132251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b6c003d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 -- 172.21.15.41:0/396132251 >> 172.21.15.41:0/396132251 conn(0x7f4b880b9080 msgr2=0x7f4b880b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:41.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 -- 172.21.15.41:0/396132251 shutdown_connections 2021-10-21T00:02:41.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.431+0000 7f4b8759e700 1 -- 172.21.15.41:0/396132251 wait complete. 2021-10-21T00:02:41.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 Processor -- start 2021-10-21T00:02:41.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 -- start start 2021-10-21T00:02:41.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b88063680 0x7f4b881429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 0x7f4b881468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88065610 con 0x7f4b6c003930 2021-10-21T00:02:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88066240 con 0x7f4b88063680 2021-10-21T00:02:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.435+0000 7f4b8759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88063b00 con 0x7f4b88142eb0 2021-10-21T00:02:41.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57100/0 (socket says 172.21.15.41:57100) 2021-10-21T00:02:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 -- 172.21.15.41:0/1368995343 learned_addr learned my addr 172.21.15.41:0/1368995343 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b85d9b700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b88063680 0x7f4b881429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 0x7f4b881468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 -- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 msgr2=0x7f4b881468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 0x7f4b881468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 -- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b88063680 msgr2=0x7f4b881429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b88063680 0x7f4b881429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 -- 172.21.15.41:0/1368995343 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88143360 con 0x7f4b6c003930 2021-10-21T00:02:41.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b86d9d700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 0x7f4b881468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:41.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8659c700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4b88141a60 tx=0x7f4b7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:41.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7c00c700 con 0x7f4b6c003930 2021-10-21T00:02:41.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c01c810 con 0x7f4b6c003930 2021-10-21T00:02:41.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7c01cb70 con 0x7f4b6c003930 2021-10-21T00:02:41.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88142540 con 0x7f4b6c003930 2021-10-21T00:02:41.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88066430 con 0x7f4b6c003930 2021-10-21T00:02:41.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4b7c02b070 con 0x7f4b6c003930 2021-10-21T00:02:41.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4b7c0128d0 con 0x7f4b6c003930 2021-10-21T00:02:41.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.439+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88142700 con 0x7f4b6c003930 2021-10-21T00:02:41.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.443+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4b88142700 con 0x7f4b6c003930 2021-10-21T00:02:41.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.507+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4b88065430 con 0x7f4b6c003930 2021-10-21T00:02:41.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b777fe700 1 -- 172.21.15.41:0/1368995343 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4b7c029060 con 0x7f4b6c003930 2021-10-21T00:02:41.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 msgr2=0x7f4b8814a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:41.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4b88141a60 tx=0x7f4b7c015000).stop 2021-10-21T00:02:41.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 shutdown_connections 2021-10-21T00:02:41.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b88142eb0 0x7f4b881468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b88063680 0x7f4b881429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 --2- 172.21.15.41:0/1368995343 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c003930 0x7f4b8814a6e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:41.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 >> 172.21.15.41:0/1368995343 conn(0x7f4b880b9080 msgr2=0x7f4b880b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:41.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 shutdown_connections 2021-10-21T00:02:41.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:41.511+0000 7f4b8759e700 1 -- 172.21.15.41:0/1368995343 wait complete. 2021-10-21T00:02:41.524 INFO:teuthology.orchestra.run.smithi041.stderr:adjusted tunables profile to default 2021-10-21T00:02:41.535 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-10-21T00:02:41.536 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:41.542 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.9KVmi75KNj 2021-10-21T00:02:41.542 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.9KVmi75KNj 2021-10-21T00:02:41.565 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.9KVmi75KNj 2021-10-21T00:02:41.704 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.9KVmi75KNj is 37B 2021-10-21T00:02:41.750 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.9KVmi75KNj 2021-10-21T00:02:41.762 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:41.816 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.zQVmSoZd8l 2021-10-21T00:02:41.817 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.zQVmSoZd8l 2021-10-21T00:02:41.850 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.zQVmSoZd8l 2021-10-21T00:02:41.984 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.zQVmSoZd8l is 37B 2021-10-21T00:02:42.012 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.zQVmSoZd8l 2021-10-21T00:02:42.025 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:42.075 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.jyfRhvWqQR 2021-10-21T00:02:42.076 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.jyfRhvWqQR 2021-10-21T00:02:42.100 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.jyfRhvWqQR 2021-10-21T00:02:42.181 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.jyfRhvWqQR is 37B 2021-10-21T00:02:42.216 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.jyfRhvWqQR 2021-10-21T00:02:42.226 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:02:42.280 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.JQ3Am9blqT 2021-10-21T00:02:42.280 DEBUG:teuthology.orchestra.run.smithi041:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.JQ3Am9blqT 2021-10-21T00:02:42.296 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.JQ3Am9blqT 2021-10-21T00:02:42.370 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.JQ3Am9blqT is 37B 2021-10-21T00:02:42.385 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.JQ3Am9blqT 2021-10-21T00:02:42.396 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:42.404 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.UB5XMrSMFt 2021-10-21T00:02:42.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.UB5XMrSMFt 2021-10-21T00:02:42.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.UB5XMrSMFt 2021-10-21T00:02:42.532 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.UB5XMrSMFt is 37B 2021-10-21T00:02:42.548 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.UB5XMrSMFt 2021-10-21T00:02:42.554 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:42.601 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.ZQJQD8RkLU 2021-10-21T00:02:42.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.ZQJQD8RkLU 2021-10-21T00:02:42.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.ZQJQD8RkLU 2021-10-21T00:02:42.694 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.ZQJQD8RkLU is 37B 2021-10-21T00:02:42.711 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.ZQJQD8RkLU 2021-10-21T00:02:42.718 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:42.771 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.vH6tzJsMYf 2021-10-21T00:02:42.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.vH6tzJsMYf 2021-10-21T00:02:42.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.vH6tzJsMYf 2021-10-21T00:02:42.867 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.vH6tzJsMYf is 37B 2021-10-21T00:02:42.945 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.vH6tzJsMYf 2021-10-21T00:02:42.960 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:02:43.009 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.gvm2Qk3bit 2021-10-21T00:02:43.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.gvm2Qk3bit 2021-10-21T00:02:43.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.gvm2Qk3bit 2021-10-21T00:02:43.051 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.gvm2Qk3bit is 37B 2021-10-21T00:02:43.063 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.gvm2Qk3bit 2021-10-21T00:02:43.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 9d4121f8-718a-453c-8e46-22ccaa7c65d6 0 2021-10-21T00:02:43.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 Processor -- start 2021-10-21T00:02:43.216 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 -- start start 2021-10-21T00:02:43.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5100b0120 0x7fb5100b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.220 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5100b1d10 con 0x7fb5100adef0 2021-10-21T00:02:43.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51005d3f0 con 0x7fb5100b0120 2021-10-21T00:02:43.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5166ee700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100b65b0 con 0x7fb5100b61d0 2021-10-21T00:02:43.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.221 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56518/0 (socket says 172.21.15.62:56518) 2021-10-21T00:02:43.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 -- 172.21.15.62:0/1434083491 learned_addr learned my addr 172.21.15.62:0/1434083491 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb515eed700 1 --1- 172.21.15.62:0/1434083491 >> v1:172.21.15.62:6789/0 conn(0x7fb5100adef0 0x7fb5100ae3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44966/0 (socket says 172.21.15.62:44966) 2021-10-21T00:02:43.222 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb514eeb700 1 --2- 172.21.15.62:0/1434083491 >> v2:172.21.15.41:3300/0 conn(0x7fb5100b0120 0x7fb5100b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb50ffff700 1 -- 172.21.15.62:0/1434083491 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485489631 0 0) 0x7fb5100b1d10 con 0x7fb5100adef0 2021-10-21T00:02:43.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb50ffff700 1 -- 172.21.15.62:0/1434083491 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc003260 con 0x7fb5100adef0 2021-10-21T00:02:43.223 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 -- 172.21.15.62:0/1434083491 >> v2:172.21.15.41:3300/0 conn(0x7fb5100b0120 msgr2=0x7fb5100b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:43.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 --2- 172.21.15.62:0/1434083491 >> v2:172.21.15.41:3300/0 conn(0x7fb5100b0120 0x7fb5100b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 -- 172.21.15.62:0/1434083491 >> v1:172.21.15.62:6789/0 conn(0x7fb5100adef0 legacy=0x7fb5100ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 -- 172.21.15.62:0/1434083491 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100b1850 con 0x7fb5100b61d0 2021-10-21T00:02:43.224 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.209+0000 7fb5156ec700 1 --2- 172.21.15.62:0/1434083491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb5000032f0 tx=0x7fb500009290).ready entity=mon.2 client_cookie=2632fe1aa2c5ada4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb50ffff700 1 -- 172.21.15.62:0/1434083491 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50000b6c0 con 0x7fb5100b61d0 2021-10-21T00:02:43.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb50ffff700 1 -- 172.21.15.62:0/1434083491 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50000b820 con 0x7fb5100b61d0 2021-10-21T00:02:43.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb50ffff700 1 -- 172.21.15.62:0/1434083491 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50000b990 con 0x7fb5100b61d0 2021-10-21T00:02:43.225 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- 172.21.15.62:0/1434083491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 msgr2=0x7fb5100af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 --2- 172.21.15.62:0/1434083491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb5000032f0 tx=0x7fb500009290).stop 2021-10-21T00:02:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- 172.21.15.62:0/1434083491 shutdown_connections 2021-10-21T00:02:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 --2- 172.21.15.62:0/1434083491 >> v2:172.21.15.41:3300/0 conn(0x7fb5100b0120 0x7fb5100b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.226 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 --2- 172.21.15.62:0/1434083491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5100af8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- 172.21.15.62:0/1434083491 >> 172.21.15.62:0/1434083491 conn(0x7fb510063b80 msgr2=0x7fb5100b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- 172.21.15.62:0/1434083491 shutdown_connections 2021-10-21T00:02:43.227 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- 172.21.15.62:0/1434083491 wait complete. 2021-10-21T00:02:43.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 Processor -- start 2021-10-21T00:02:43.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.213+0000 7fb5166ee700 1 -- start start 2021-10-21T00:02:43.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5100adef0 0x7fb510148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.231 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 0x7fb510141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5101521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510113810 con 0x7fb5100adef0 2021-10-21T00:02:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510116260 con 0x7fb5100b0120 2021-10-21T00:02:43.232 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb510113a40 con 0x7fb5100b61d0 2021-10-21T00:02:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb515eed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5101521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 0x7fb510141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb515eed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5101521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56528/0 (socket says 172.21.15.62:56528) 2021-10-21T00:02:43.233 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb515eed700 1 -- 172.21.15.62:0/3780478302 learned_addr learned my addr 172.21.15.62:0/3780478302 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5156ec700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5100adef0 0x7fb510148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 -- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 msgr2=0x7fb5101521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5101521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.234 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 -- 172.21.15.62:0/3780478302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5100adef0 msgr2=0x7fb510148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5100adef0 0x7fb510148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 -- 172.21.15.62:0/3780478302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500009530 con 0x7fb5100b0120 2021-10-21T00:02:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb514eeb700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 0x7fb510141aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb50400c000 tx=0x7fb504006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.235 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb504011750 con 0x7fb5100b0120 2021-10-21T00:02:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5040118b0 con 0x7fb5100b0120 2021-10-21T00:02:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb510115f90 con 0x7fb5100b0120 2021-10-21T00:02:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb504011c10 con 0x7fb5100b0120 2021-10-21T00:02:43.236 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5100b36f0 con 0x7fb5100b0120 2021-10-21T00:02:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fb50401b410 con 0x7fb5100b0120 2021-10-21T00:02:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb5040123f0 con 0x7fb5100b0120 2021-10-21T00:02:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.217+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec003410 con 0x7fb5100b0120 2021-10-21T00:02:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.221+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fb504012600 con 0x7fb5100b0120 2021-10-21T00:02:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.289+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", "id": 0} v 0) v1 -- 0x7fb4ec003990 con 0x7fb5100b0120 2021-10-21T00:02:43.311 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb50e7fc700 1 -- 172.21.15.62:0/3780478302 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5040127a0 con 0x7fb5100b0120 2021-10-21T00:02:43.311 INFO:teuthology.orchestra.run.smithi062.stdout:0 2021-10-21T00:02:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 msgr2=0x7fb510141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 0x7fb510141aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb50400c000 tx=0x7fb504006df0).stop 2021-10-21T00:02:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 shutdown_connections 2021-10-21T00:02:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5100b61d0 0x7fb5101521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5100b0120 0x7fb510141aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 --2- 172.21.15.62:0/3780478302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5100adef0 0x7fb510148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 >> 172.21.15.62:0/3780478302 conn(0x7fb510063b80 msgr2=0x7fb5100b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 shutdown_connections 2021-10-21T00:02:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.301+0000 7fb5166ee700 1 -- 172.21.15.62:0/3780478302 wait complete. 2021-10-21T00:02:43.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 74d69c01-63b5-4279-9378-9271a8ca55a6 1 2021-10-21T00:02:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 Processor -- start 2021-10-21T00:02:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 -- start start 2021-10-21T00:02:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87e8064ca0 0x7f87e813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.432 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 0x7f87e80ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80b6570 con 0x7f87e80b6190 2021-10-21T00:02:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8142d30 con 0x7f87e8143710 2021-10-21T00:02:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ef0e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8142fd0 con 0x7f87e8064ca0 2021-10-21T00:02:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87e8064ca0 0x7f87e813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87e8064ca0 0x7f87e813fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41908/0 (socket says 172.21.15.62:41908) 2021-10-21T00:02:43.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 -- 172.21.15.62:0/3585833696 learned_addr learned my addr 172.21.15.62:0/3585833696 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ee8e3700 1 --2- 172.21.15.62:0/3585833696 >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 0x7f87e80ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.434 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 -- 172.21.15.62:0/3585833696 >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 msgr2=0x7f87e80ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 --2- 172.21.15.62:0/3585833696 >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 0x7f87e80ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 -- 172.21.15.62:0/3585833696 >> v1:172.21.15.41:6789/0 conn(0x7f87e80b6190 legacy=0x7f87e813f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 -- 172.21.15.62:0/3585833696 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8143270 con 0x7f87e8064ca0 2021-10-21T00:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ee8e3700 1 --2- 172.21.15.62:0/3585833696 >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 0x7f87e80ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:43.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed8e1700 1 --2- 172.21.15.62:0/3585833696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e813fcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f87d8002f70 tx=0x7f87d8006f40).ready entity=mon.1 client_cookie=654b6ad85f7b1a95 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed0e0700 1 -- 172.21.15.62:0/3585833696 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d800dc70 con 0x7f87e8064ca0 2021-10-21T00:02:43.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed0e0700 1 -- 172.21.15.62:0/3585833696 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8000e90 con 0x7f87e8064ca0 2021-10-21T00:02:43.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.417+0000 7f87ed0e0700 1 -- 172.21.15.62:0/3585833696 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d800be90 con 0x7f87e8064ca0 2021-10-21T00:02:43.436 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/3585833696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 msgr2=0x7f87e813fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/3585833696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e813fcf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f87d8002f70 tx=0x7f87d8006f40).stop 2021-10-21T00:02:43.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/3585833696 shutdown_connections 2021-10-21T00:02:43.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/3585833696 >> v2:172.21.15.41:3300/0 conn(0x7f87e8143710 0x7f87e80ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.437 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/3585833696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e813fcf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/3585833696 >> 172.21.15.62:0/3585833696 conn(0x7f87e8069df0 msgr2=0x7f87e8063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/3585833696 shutdown_connections 2021-10-21T00:02:43.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/3585833696 wait complete. 2021-10-21T00:02:43.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 Processor -- start 2021-10-21T00:02:43.438 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- start start 2021-10-21T00:02:43.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e80b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87e8143710 0x7f87e812e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.439 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e812f420 con 0x7f87e8143710 2021-10-21T00:02:43.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e812eac0 con 0x7f87e8064ca0 2021-10-21T00:02:43.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8152b40 con 0x7f87e80b6190 2021-10-21T00:02:43.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56538/0 (socket says 172.21.15.62:56538) 2021-10-21T00:02:43.440 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 -- 172.21.15.62:0/389694284 learned_addr learned my addr 172.21.15.62:0/389694284 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ee0e2700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e80b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ee8e3700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87e8143710 0x7f87e812e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 -- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 msgr2=0x7f87e80b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.441 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e80b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 -- 172.21.15.62:0/389694284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87e8143710 msgr2=0x7f87e812e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87e8143710 0x7f87e812e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.442 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 -- 172.21.15.62:0/389694284 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d800b460 con 0x7f87e80b6190 2021-10-21T00:02:43.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ed8e1700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f87d8002f70 tx=0x7f87e8065110).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d801d070 con 0x7f87e80b6190 2021-10-21T00:02:43.446 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8022410 con 0x7f87e80b6190 2021-10-21T00:02:43.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87d8022770 con 0x7f87e80b6190 2021-10-21T00:02:43.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e8152de0 con 0x7f87e80b6190 2021-10-21T00:02:43.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.421+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e812e560 con 0x7f87e80b6190 2021-10-21T00:02:43.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.425+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f87d8029070 con 0x7f87e80b6190 2021-10-21T00:02:43.447 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.425+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f87d80187e0 con 0x7f87e80b6190 2021-10-21T00:02:43.448 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.425+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8152fa0 con 0x7f87e80b6190 2021-10-21T00:02:43.449 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.429+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f87d8027060 con 0x7f87e80b6190 2021-10-21T00:02:43.505 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.497+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", "id": 1} v 0) v1 -- 0x7f87e8057350 con 0x7f87e80b6190 2021-10-21T00:02:43.520 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.505+0000 7f87d77fe700 1 -- 172.21.15.62:0/389694284 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87d80310b0 con 0x7f87e80b6190 2021-10-21T00:02:43.521 INFO:teuthology.orchestra.run.smithi062.stdout:1 2021-10-21T00:02:43.525 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 msgr2=0x7f87e80b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f87d8002f70 tx=0x7f87e8065110).stop 2021-10-21T00:02:43.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 shutdown_connections 2021-10-21T00:02:43.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87e8143710 0x7f87e812e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.528 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87e80b6190 0x7f87e80b2670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 --2- 172.21.15.62:0/389694284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87e8064ca0 0x7f87e80b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 >> 172.21.15.62:0/389694284 conn(0x7f87e8069df0 msgr2=0x7f87e81276f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 shutdown_connections 2021-10-21T00:02:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.509+0000 7f87ef0e4700 1 -- 172.21.15.62:0/389694284 wait complete. 2021-10-21T00:02:43.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 603c1558-e391-4cf5-92fb-2b53696e1c56 2 2021-10-21T00:02:43.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.621+0000 7f51f0fc1700 1 Processor -- start 2021-10-21T00:02:43.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- start start 2021-10-21T00:02:43.633 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 0x7f51ec143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ec05ca20 0x7f51ec0af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.634 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec05beb0 con 0x7f51ec066d90 2021-10-21T00:02:43.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec05ce90 con 0x7f51ec060c60 2021-10-21T00:02:43.635 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0ac910 con 0x7f51ec05ca20 2021-10-21T00:02:43.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ec05ca20 0x7f51ec0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51ec05ca20 0x7f51ec0af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41922/0 (socket says 172.21.15.62:41922) 2021-10-21T00:02:43.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 -- 172.21.15.62:0/411091967 learned_addr learned my addr 172.21.15.62:0/411091967 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.636 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51e9d9b700 1 --1- 172.21.15.62:0/411091967 >> v1:172.21.15.62:6789/0 conn(0x7f51ec066d90 0x7f51ec0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44988/0 (socket says 172.21.15.62:44988) 2021-10-21T00:02:43.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ea59c700 1 --2- 172.21.15.62:0/411091967 >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 0x7f51ec143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 -- 172.21.15.62:0/411091967 >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 msgr2=0x7f51ec143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:43.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 --2- 172.21.15.62:0/411091967 >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 0x7f51ec143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 -- 172.21.15.62:0/411091967 >> v1:172.21.15.62:6789/0 conn(0x7f51ec066d90 legacy=0x7f51ec0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.637 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 -- 172.21.15.62:0/411091967 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec061040 con 0x7f51ec05ca20 2021-10-21T00:02:43.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ea59c700 1 --2- 172.21.15.62:0/411091967 >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 0x7f51ec143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:43.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51ead9d700 1 --2- 172.21.15.62:0/411091967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec05ca20 0x7f51ec0af170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f51e40032f0 tx=0x7f51e4009290).ready entity=mon.1 client_cookie=53ef0ca696943852 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51e959a700 1 -- 172.21.15.62:0/411091967 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e400b870 con 0x7f51ec05ca20 2021-10-21T00:02:43.638 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51e959a700 1 -- 172.21.15.62:0/411091967 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b9d0 con 0x7f51ec05ca20 2021-10-21T00:02:43.639 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51e959a700 1 -- 172.21.15.62:0/411091967 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e400bb40 con 0x7f51ec05ca20 2021-10-21T00:02:43.642 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- 172.21.15.62:0/411091967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec05ca20 msgr2=0x7f51ec0af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/411091967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec05ca20 0x7f51ec0af170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f51e40032f0 tx=0x7f51e4009290).stop 2021-10-21T00:02:43.646 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- 172.21.15.62:0/411091967 shutdown_connections 2021-10-21T00:02:43.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/411091967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec05ca20 0x7f51ec0af170 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/411091967 >> v2:172.21.15.41:3300/0 conn(0x7f51ec060c60 0x7f51ec143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.647 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- 172.21.15.62:0/411091967 >> 172.21.15.62:0/411091967 conn(0x7f51ec063b70 msgr2=0x7f51ec060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.648 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- 172.21.15.62:0/411091967 shutdown_connections 2021-10-21T00:02:43.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.625+0000 7f51f0fc1700 1 -- 172.21.15.62:0/411091967 wait complete. 2021-10-21T00:02:43.649 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 Processor -- start 2021-10-21T00:02:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- start start 2021-10-21T00:02:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f51ec05ca20 0x7f51ec09f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec060c60 0x7f51ec0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec09ea10 con 0x7f51ec05ca20 2021-10-21T00:02:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec09ee40 con 0x7f51ec060c60 2021-10-21T00:02:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0a1890 con 0x7f51ec066d90 2021-10-21T00:02:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51e9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec060c60 0x7f51ec0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56550/0 (socket says 172.21.15.62:56550) 2021-10-21T00:02:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 -- 172.21.15.62:0/904562305 learned_addr learned my addr 172.21.15.62:0/904562305 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ea59c700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f51ec05ca20 0x7f51ec09f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 -- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec060c60 msgr2=0x7f51ec0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec060c60 0x7f51ec0ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 -- 172.21.15.62:0/904562305 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f51ec05ca20 msgr2=0x7f51ec09f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f51ec05ca20 0x7f51ec09f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 -- 172.21.15.62:0/904562305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4009530 con 0x7f51ec066d90 2021-10-21T00:02:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51ead9d700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f51e40032f0 tx=0x7f51e4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e400b870 con 0x7f51ec066d90 2021-10-21T00:02:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400bdb0 con 0x7f51ec066d90 2021-10-21T00:02:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0a1b30 con 0x7f51ec066d90 2021-10-21T00:02:43.655 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e4020610 con 0x7f51ec066d90 2021-10-21T00:02:43.656 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0abb30 con 0x7f51ec066d90 2021-10-21T00:02:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f51e400f070 con 0x7f51ec066d90 2021-10-21T00:02:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.629+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f51e4020940 con 0x7f51ec066d90 2021-10-21T00:02:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.633+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec09eb80 con 0x7f51ec066d90 2021-10-21T00:02:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.633+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f51ec09eb80 con 0x7f51ec066d90 2021-10-21T00:02:43.706 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.697+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", "id": 2} v 0) v1 -- 0x7f51ec09e170 con 0x7f51ec066d90 2021-10-21T00:02:43.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.705+0000 7f51db7fe700 1 -- 172.21.15.62:0/904562305 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51e402e0b0 con 0x7f51ec066d90 2021-10-21T00:02:43.716 INFO:teuthology.orchestra.run.smithi062.stdout:2 2021-10-21T00:02:43.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 msgr2=0x7f51ec0ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f51e40032f0 tx=0x7f51e4016000).stop 2021-10-21T00:02:43.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 shutdown_connections 2021-10-21T00:02:43.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51ec066d90 0x7f51ec0ab640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51ec060c60 0x7f51ec0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 --2- 172.21.15.62:0/904562305 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f51ec05ca20 0x7f51ec09f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 >> 172.21.15.62:0/904562305 conn(0x7f51ec063b70 msgr2=0x7f51ec0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 shutdown_connections 2021-10-21T00:02:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.709+0000 7f51f0fc1700 1 -- 172.21.15.62:0/904562305 wait complete. 2021-10-21T00:02:43.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 42c9fc1d-cfc4-40ab-829c-269c80c181a2 3 2021-10-21T00:02:43.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.821+0000 7fc6c3fff700 1 Processor -- start 2021-10-21T00:02:43.830 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.821+0000 7fc6c3fff700 1 -- start start 2021-10-21T00:02:43.833 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c4066490 con 0x7fc6c405bca0 2021-10-21T00:02:43.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c4145f60 con 0x7fc6c40b2e00 2021-10-21T00:02:43.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4146db0 con 0x7fc6c405c080 2021-10-21T00:02:43.834 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c27fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6c40b2e00 0x7fc6c4142880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44998/0 (socket says 172.21.15.62:44998) 2021-10-21T00:02:43.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56558/0 (socket says 172.21.15.62:56558) 2021-10-21T00:02:43.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c27fc700 1 -- 172.21.15.62:0/3948218685 learned_addr learned my addr 172.21.15.62:0/3948218685 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-10-21T00:02:43.835 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 -- 172.21.15.62:0/3948218685 >> v1:172.21.15.62:6789/0 conn(0x7fc6c40b2e00 legacy=0x7fc6c4142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 -- 172.21.15.62:0/3948218685 >> v1:172.21.15.41:6789/0 conn(0x7fc6c405bca0 legacy=0x7fc6c41466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 -- 172.21.15.62:0/3948218685 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4146200 con 0x7fc6c405c080 2021-10-21T00:02:43.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c1ffb700 1 -- 172.21.15.62:0/3948218685 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124795139 0 0) 0x7fc6c4145f60 con 0x7fc6c40b2e00 2021-10-21T00:02:43.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c37fe700 1 --2- 172.21.15.62:0/3948218685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc6bc0032f0 tx=0x7fc6bc0091d0).ready entity=mon.2 client_cookie=131d1aa56b0cb999 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.836 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c1ffb700 1 -- 172.21.15.62:0/3948218685 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00b8a0 con 0x7fc6c405c080 2021-10-21T00:02:43.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c1ffb700 1 -- 172.21.15.62:0/3948218685 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00ba00 con 0x7fc6c405c080 2021-10-21T00:02:43.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c1ffb700 1 -- 172.21.15.62:0/3948218685 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00bb70 con 0x7fc6c405c080 2021-10-21T00:02:43.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- 172.21.15.62:0/3948218685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 msgr2=0x7fc6c4065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.837 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/3948218685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc6bc0032f0 tx=0x7fc6bc0091d0).stop 2021-10-21T00:02:43.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- 172.21.15.62:0/3948218685 shutdown_connections 2021-10-21T00:02:43.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/3948218685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c4065570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- 172.21.15.62:0/3948218685 >> 172.21.15.62:0/3948218685 conn(0x7fc6c4069df0 msgr2=0x7fc6c4063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.838 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- 172.21.15.62:0/3948218685 shutdown_connections 2021-10-21T00:02:43.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- 172.21.15.62:0/3948218685 wait complete. 2021-10-21T00:02:43.839 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 Processor -- start 2021-10-21T00:02:43.841 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- start start 2021-10-21T00:02:43.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 0x7fc6c4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.847 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 0x7fc6c40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:43.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c413d3c0 con 0x7fc6c405bca0 2021-10-21T00:02:43.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c413fe80 con 0x7fc6c40b2e00 2021-10-21T00:02:43.848 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.825+0000 7fc6c3fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c413d120 con 0x7fc6c405c080 2021-10-21T00:02:43.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 0x7fc6c40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56562/0 (socket says 172.21.15.62:56562) 2021-10-21T00:02:43.849 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 -- 172.21.15.62:0/519252031 learned_addr learned my addr 172.21.15.62:0/519252031 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:43.850 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c2ffd700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 0x7fc6c4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 -- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 msgr2=0x7fc6c40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 0x7fc6c40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 -- 172.21.15.62:0/519252031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 msgr2=0x7fc6c4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 0x7fc6c4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.851 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 -- 172.21.15.62:0/519252031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009470 con 0x7fc6c405c080 2021-10-21T00:02:43.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c37fe700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 0x7fc6c40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:43.852 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c2ffd700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 0x7fc6c4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:43.854 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c27fc700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc6c413d040 tx=0x7fc6b8007ce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:43.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b80070d0 con 0x7fc6c405c080 2021-10-21T00:02:43.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4152af0 con 0x7fc6c405c080 2021-10-21T00:02:43.856 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40b6310 con 0x7fc6c405c080 2021-10-21T00:02:43.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8007230 con 0x7fc6c405c080 2021-10-21T00:02:43.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b8005610 con 0x7fc6c405c080 2021-10-21T00:02:43.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc6b8010070 con 0x7fc6c405c080 2021-10-21T00:02:43.857 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fc6b8005e40 con 0x7fc6c405c080 2021-10-21T00:02:43.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.829+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4003410 con 0x7fc6c405c080 2021-10-21T00:02:43.858 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.833+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc6b801d3f0 con 0x7fc6c405c080 2021-10-21T00:02:43.908 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.901+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", "id": 3} v 0) v1 -- 0x7fc6a4003990 con 0x7fc6c405c080 2021-10-21T00:02:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.909+0000 7fc6b3fff700 1 -- 172.21.15.62:0/519252031 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6b801d610 con 0x7fc6c405c080 2021-10-21T00:02:43.920 INFO:teuthology.orchestra.run.smithi062.stdout:3 2021-10-21T00:02:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 msgr2=0x7fc6c412a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc6c413d040 tx=0x7fc6b8007ce0).stop 2021-10-21T00:02:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 shutdown_connections 2021-10-21T00:02:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40b2e00 0x7fc6c40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c405c080 0x7fc6c412a4f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 --2- 172.21.15.62:0/519252031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6c405bca0 0x7fc6c4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 >> 172.21.15.62:0/519252031 conn(0x7fc6c4069df0 msgr2=0x7fc6c4143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 shutdown_connections 2021-10-21T00:02:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:43.913+0000 7fc6c3fff700 1 -- 172.21.15.62:0/519252031 wait complete. 2021-10-21T00:02:43.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new f454248d-9887-41fb-8d6b-6ef9afcb0ce7 4 2021-10-21T00:02:44.037 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 Processor -- start 2021-10-21T00:02:44.039 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 -- start start 2021-10-21T00:02:44.062 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 0x7f923c144870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.063 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f923c0b1b70 0x7f923c13a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.066 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c0b4110 con 0x7f923c13a940 2021-10-21T00:02:44.068 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0675a0 con 0x7f923c0b3d30 2021-10-21T00:02:44.069 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9242703700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c067840 con 0x7f923c0b1b70 2021-10-21T00:02:44.070 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9240f00700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f923c0b1b70 0x7f923c13a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.071 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9240f00700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f923c0b1b70 0x7f923c13a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41946/0 (socket says 172.21.15.62:41946) 2021-10-21T00:02:44.072 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9240f00700 1 -- 172.21.15.62:0/3362551781 learned_addr learned my addr 172.21.15.62:0/3362551781 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.073 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.029+0000 7f9241701700 1 --2- 172.21.15.62:0/3362551781 >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 0x7f923c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.074 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 -- 172.21.15.62:0/3362551781 >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 msgr2=0x7f923c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:44.076 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 --2- 172.21.15.62:0/3362551781 >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 0x7f923c144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.077 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 -- 172.21.15.62:0/3362551781 >> v1:172.21.15.41:6789/0 conn(0x7f923c13a940 legacy=0x7f923c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.078 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 -- 172.21.15.62:0/3362551781 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c1409a0 con 0x7f923c0b1b70 2021-10-21T00:02:44.079 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241701700 1 --2- 172.21.15.62:0/3362551781 >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 0x7f923c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:44.080 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 --2- 172.21.15.62:0/3362551781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c0b1b70 0x7f923c13a450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f922c002f70 tx=0x7f922c006eb0).ready entity=mon.1 client_cookie=39662b67dfbf823d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.082 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f922bfff700 1 -- 172.21.15.62:0/3362551781 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922c00d610 con 0x7f923c0b1b70 2021-10-21T00:02:44.083 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f922bfff700 1 -- 172.21.15.62:0/3362551781 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c000e90 con 0x7f923c0b1b70 2021-10-21T00:02:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f922bfff700 1 -- 172.21.15.62:0/3362551781 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922c00d9a0 con 0x7f923c0b1b70 2021-10-21T00:02:44.088 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- 172.21.15.62:0/3362551781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c0b1b70 msgr2=0x7f923c13a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.089 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- 172.21.15.62:0/3362551781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c0b1b70 0x7f923c13a450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f922c002f70 tx=0x7f922c006eb0).stop 2021-10-21T00:02:44.090 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- 172.21.15.62:0/3362551781 shutdown_connections 2021-10-21T00:02:44.091 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- 172.21.15.62:0/3362551781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c0b1b70 0x7f923c13a450 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.105 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- 172.21.15.62:0/3362551781 >> v2:172.21.15.41:3300/0 conn(0x7f923c0b3d30 0x7f923c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- 172.21.15.62:0/3362551781 >> 172.21.15.62:0/3362551781 conn(0x7f923c0649c0 msgr2=0x7f923c064dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- 172.21.15.62:0/3362551781 shutdown_connections 2021-10-21T00:02:44.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- 172.21.15.62:0/3362551781 wait complete. 2021-10-21T00:02:44.106 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 Processor -- start 2021-10-21T00:02:44.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- start start 2021-10-21T00:02:44.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 0x7f923c142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f923c0b3d30 0x7f923c1399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.107 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0634b0 con 0x7f923c0b3d30 2021-10-21T00:02:44.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c062f70 con 0x7f923c13a940 2021-10-21T00:02:44.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9242703700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c063210 con 0x7f923c0b1b70 2021-10-21T00:02:44.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241701700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 0x7f923c142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.108 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41952/0 (socket says 172.21.15.62:41952) 2021-10-21T00:02:44.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 -- 172.21.15.62:0/791942932 learned_addr learned my addr 172.21.15.62:0/791942932 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241701700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 0x7f923c142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56572/0 (socket says 172.21.15.62:56572) 2021-10-21T00:02:44.109 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9240f00700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f923c0b3d30 0x7f923c1399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 -- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 msgr2=0x7f923c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 0x7f923c142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.110 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 -- 172.21.15.62:0/791942932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f923c0b3d30 msgr2=0x7f923c1399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f923c0b3d30 0x7f923c1399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.033+0000 7f9241f02700 1 -- 172.21.15.62:0/791942932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c00b1e0 con 0x7f923c13a940 2021-10-21T00:02:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f9241f02700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f923c0646e0 tx=0x7f92340013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9234006aa0 con 0x7f923c13a940 2021-10-21T00:02:44.115 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234006c00 con 0x7f923c13a940 2021-10-21T00:02:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c13a380 con 0x7f923c13a940 2021-10-21T00:02:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9234007030 con 0x7f923c13a940 2021-10-21T00:02:44.117 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c13d000 con 0x7f923c13a940 2021-10-21T00:02:44.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9234010030 con 0x7f923c13a940 2021-10-21T00:02:44.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f9234007360 con 0x7f923c13a940 2021-10-21T00:02:44.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c0662a0 con 0x7f923c13a940 2021-10-21T00:02:44.118 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.037+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9234013410 con 0x7f923c13a940 2021-10-21T00:02:44.120 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.105+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", "id": 4} v 0) v1 -- 0x7f923c065790 con 0x7f923c13a940 2021-10-21T00:02:44.121 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f922a7fc700 1 -- 172.21.15.62:0/791942932 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92340135b0 con 0x7f923c13a940 2021-10-21T00:02:44.122 INFO:teuthology.orchestra.run.smithi062.stdout:4 2021-10-21T00:02:44.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 msgr2=0x7f923c139e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f923c0646e0 tx=0x7f92340013a0).stop 2021-10-21T00:02:44.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 shutdown_connections 2021-10-21T00:02:44.123 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f923c13a940 0x7f923c139e90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f923c0b3d30 0x7f923c1399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 --2- 172.21.15.62:0/791942932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f923c0b1b70 0x7f923c142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 >> 172.21.15.62:0/791942932 conn(0x7f923c0649c0 msgr2=0x7f923c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 shutdown_connections 2021-10-21T00:02:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.113+0000 7f9242703700 1 -- 172.21.15.62:0/791942932 wait complete. 2021-10-21T00:02:44.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new acfe82dc-231b-49f2-a47f-99afb268f107 5 2021-10-21T00:02:44.256 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.237+0000 7f054942e700 1 Processor -- start 2021-10-21T00:02:44.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.237+0000 7f054942e700 1 -- start start 2021-10-21T00:02:44.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f05440b5e90 0x7f05440b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05440ad280 0x7f0544142c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.257 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05440afb40 con 0x7f05440b1d10 2021-10-21T00:02:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440b0e00 con 0x7f05440b5e90 2021-10-21T00:02:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440b1ab0 con 0x7f05440ad280 2021-10-21T00:02:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f05437fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f05440b1d10 0x7f05440b13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45022/0 (socket says 172.21.15.62:45022) 2021-10-21T00:02:44.258 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05440ad280 0x7f0544142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f05437fe700 1 -- 172.21.15.62:0/195874307 learned_addr learned my addr 172.21.15.62:0/195874307 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-10-21T00:02:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0543fff700 1 --2- 172.21.15.62:0/195874307 >> v2:172.21.15.41:3300/0 conn(0x7f05440b5e90 0x7f05440b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0542ffd700 1 -- 172.21.15.62:0/195874307 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105859637 0 0) 0x7f05440afb40 con 0x7f05440b1d10 2021-10-21T00:02:44.259 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0542ffd700 1 -- 172.21.15.62:0/195874307 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0530003260 con 0x7f05440b1d10 2021-10-21T00:02:44.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 -- 172.21.15.62:0/195874307 >> v2:172.21.15.41:3300/0 conn(0x7f05440b5e90 msgr2=0x7f05440b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:44.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 --2- 172.21.15.62:0/195874307 >> v2:172.21.15.41:3300/0 conn(0x7f05440b5e90 0x7f05440b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 -- 172.21.15.62:0/195874307 >> v1:172.21.15.62:6789/0 conn(0x7f05440b1d10 legacy=0x7f05440b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.260 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 -- 172.21.15.62:0/195874307 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440af7a0 con 0x7f05440ad280 2021-10-21T00:02:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0548c2d700 1 --2- 172.21.15.62:0/195874307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f0544142c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f053c0032f0 tx=0x7f053c0091d0).ready entity=mon.1 client_cookie=b7863de5be7d5fed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0542ffd700 1 -- 172.21.15.62:0/195874307 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f053c00b600 con 0x7f05440ad280 2021-10-21T00:02:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0542ffd700 1 -- 172.21.15.62:0/195874307 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00b760 con 0x7f05440ad280 2021-10-21T00:02:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f0542ffd700 1 -- 172.21.15.62:0/195874307 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f053c00b8d0 con 0x7f05440ad280 2021-10-21T00:02:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- 172.21.15.62:0/195874307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 msgr2=0x7f0544142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 --2- 172.21.15.62:0/195874307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f0544142c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f053c0032f0 tx=0x7f053c0091d0).stop 2021-10-21T00:02:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- 172.21.15.62:0/195874307 shutdown_connections 2021-10-21T00:02:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 --2- 172.21.15.62:0/195874307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f0544142c70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 --2- 172.21.15.62:0/195874307 >> v2:172.21.15.41:3300/0 conn(0x7f05440b5e90 0x7f05440b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- 172.21.15.62:0/195874307 >> 172.21.15.62:0/195874307 conn(0x7f0544063b80 msgr2=0x7f05440b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- 172.21.15.62:0/195874307 shutdown_connections 2021-10-21T00:02:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.241+0000 7f054942e700 1 -- 172.21.15.62:0/195874307 wait complete. 2021-10-21T00:02:44.263 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 Processor -- start 2021-10-21T00:02:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- start start 2021-10-21T00:02:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f05440b5e90 0x7f05441342e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.264 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544154290 con 0x7f05440b5e90 2021-10-21T00:02:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544141f20 con 0x7f05440ad280 2021-10-21T00:02:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0544142150 con 0x7f05440b1d10 2021-10-21T00:02:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.265 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05437fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05437fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56586/0 (socket says 172.21.15.62:56586) 2021-10-21T00:02:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41960/0 (socket says 172.21.15.62:41960) 2021-10-21T00:02:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05437fe700 1 -- 172.21.15.62:0/2206742739 learned_addr learned my addr 172.21.15.62:0/2206742739 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0548c2d700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f05440b5e90 0x7f05441342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.266 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 -- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 msgr2=0x7f0544133df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 -- 172.21.15.62:0/2206742739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f05440b5e90 msgr2=0x7f05441342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f05440b5e90 0x7f05441342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.267 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 -- 172.21.15.62:0/2206742739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c009470 con 0x7f05440ad280 2021-10-21T00:02:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05437fe700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f0543fff700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f053400c000 tx=0x7f0534006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0534010780 con 0x7f05440ad280 2021-10-21T00:02:44.268 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05340108e0 con 0x7f05440ad280 2021-10-21T00:02:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05441423f0 con 0x7f05440ad280 2021-10-21T00:02:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0534010c40 con 0x7f05440ad280 2021-10-21T00:02:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0544153300 con 0x7f05440ad280 2021-10-21T00:02:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f053401b400 con 0x7f05440ad280 2021-10-21T00:02:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f053401b690 con 0x7f05440ad280 2021-10-21T00:02:44.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.245+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05441428f0 con 0x7f05440ad280 2021-10-21T00:02:44.270 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.249+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f053401baf0 con 0x7f05440ad280 2021-10-21T00:02:44.300 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.293+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f053401bc90 con 0x7f05440ad280 2021-10-21T00:02:44.330 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.325+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", "id": 5} v 0) v1 -- 0x7f0544057350 con 0x7f05440ad280 2021-10-21T00:02:44.374 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.361+0000 7f05417fa700 1 -- 172.21.15.62:0/2206742739 <== mon.1 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05340123f0 con 0x7f05440ad280 2021-10-21T00:02:44.375 INFO:teuthology.orchestra.run.smithi062.stdout:5 2021-10-21T00:02:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 msgr2=0x7f05440b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f053400c000 tx=0x7f0534006df0).stop 2021-10-21T00:02:44.376 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 shutdown_connections 2021-10-21T00:02:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f05440b5e90 0x7f05441342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05440b1d10 0x7f0544133df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 --2- 172.21.15.62:0/2206742739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05440ad280 0x7f05440b4620 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.377 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 >> 172.21.15.62:0/2206742739 conn(0x7f0544063b80 msgr2=0x7f05440b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 shutdown_connections 2021-10-21T00:02:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.365+0000 7f054942e700 1 -- 172.21.15.62:0/2206742739 wait complete. 2021-10-21T00:02:44.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 7384bca7-9f97-4d81-a23f-bcbd810a7073 6 2021-10-21T00:02:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 Processor -- start 2021-10-21T00:02:44.501 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 -- start start 2021-10-21T00:02:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b8c0b9b10 0x7f8b8c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c0b4120 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8c0b46e0 con 0x7f8b8c0b9b10 2021-10-21T00:02:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b90afb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c0b4980 con 0x7f8b8c142ce0 2021-10-21T00:02:44.511 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56624/0 (socket says 172.21.15.62:56624) 2021-10-21T00:02:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 -- 172.21.15.62:0/1080510865 learned_addr learned my addr 172.21.15.62:0/1080510865 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8a59c700 1 --2- 172.21.15.62:0/1080510865 >> v2:172.21.15.41:3300/0 conn(0x7f8b8c0b9b10 0x7f8b8c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 -- 172.21.15.62:0/1080510865 >> v2:172.21.15.41:3300/0 conn(0x7f8b8c0b9b10 msgr2=0x7f8b8c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:44.512 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 --2- 172.21.15.62:0/1080510865 >> v2:172.21.15.41:3300/0 conn(0x7f8b8c0b9b10 0x7f8b8c146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 -- 172.21.15.62:0/1080510865 >> v1:172.21.15.41:6789/0 conn(0x7f8b8c0b0ac0 legacy=0x7f8b8c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.493+0000 7f8b8ad9d700 1 -- 172.21.15.62:0/1080510865 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0b5530 con 0x7f8b8c142ce0 2021-10-21T00:02:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b8ad9d700 1 --2- 172.21.15.62:0/1080510865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b7c002f70 tx=0x7f8b7c006eb0).ready entity=mon.2 client_cookie=14302d3c7d135f59 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.513 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b8959a700 1 -- 172.21.15.62:0/1080510865 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c00d570 con 0x7f8b8c142ce0 2021-10-21T00:02:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b8959a700 1 -- 172.21.15.62:0/1080510865 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c000e90 con 0x7f8b8c142ce0 2021-10-21T00:02:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b8959a700 1 -- 172.21.15.62:0/1080510865 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c00d900 con 0x7f8b8c142ce0 2021-10-21T00:02:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 -- 172.21.15.62:0/1080510865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 msgr2=0x7f8b8c143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.514 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1080510865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b7c002f70 tx=0x7f8b7c006eb0).stop 2021-10-21T00:02:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 -- 172.21.15.62:0/1080510865 shutdown_connections 2021-10-21T00:02:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1080510865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c142ce0 0x7f8b8c143110 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1080510865 >> v2:172.21.15.41:3300/0 conn(0x7f8b8c0b9b10 0x7f8b8c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 -- 172.21.15.62:0/1080510865 >> 172.21.15.62:0/1080510865 conn(0x7f8b8c062ec0 msgr2=0x7f8b8c0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.515 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 -- 172.21.15.62:0/1080510865 shutdown_connections 2021-10-21T00:02:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.497+0000 7f8b90afb700 1 -- 172.21.15.62:0/1080510865 wait complete. 2021-10-21T00:02:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 Processor -- start 2021-10-21T00:02:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- start start 2021-10-21T00:02:44.516 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b8c0b9b10 0x7f8b8c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b8c142ce0 0x7f8b8c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1131a0 con 0x7f8b8c0b9b10 2021-10-21T00:02:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c113440 con 0x7f8b8c142ce0 2021-10-21T00:02:44.517 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1136e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.518 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:56626/0 (socket says 172.21.15.62:56626) 2021-10-21T00:02:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 -- 172.21.15.62:0/1133772009 learned_addr learned my addr 172.21.15.62:0/1133772009 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b89d9b700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b8c0b9b10 0x7f8b8c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.521 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8ad9d700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b8c142ce0 0x7f8b8c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 -- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b8c142ce0 msgr2=0x7f8b8c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b8c142ce0 0x7f8b8c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 -- 172.21.15.62:0/1133772009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b8c0b9b10 msgr2=0x7f8b8c0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.522 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b8c0b9b10 0x7f8b8c0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 -- 172.21.15.62:0/1133772009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c00b1e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b8a59c700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8b8400c000 tx=0x7f8b84006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b84010780 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.523 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b840108e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c0aea30 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b84010c40 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.524 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.501+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c113b80 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.505+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f8b8401c460 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.505+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c1138e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.505+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1820+0+0 (secure 0 0 0) 0x7f8b8403a710 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.526 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.509+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8b8c1138e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.587 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.581+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", "id": 6} v 0) v1 -- 0x7f8b8c1138e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b837fe700 1 -- 172.21.15.62:0/1133772009 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b8c1138e0 con 0x7f8b8c0b0ac0 2021-10-21T00:02:44.596 INFO:teuthology.orchestra.run.smithi062.stdout:6 2021-10-21T00:02:44.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 msgr2=0x7f8b8c0ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.598 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f8b8400c000 tx=0x7f8b84006df0).stop 2021-10-21T00:02:44.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 shutdown_connections 2021-10-21T00:02:44.599 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b8c142ce0 0x7f8b8c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b8c0b9b10 0x7f8b8c0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.600 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 --2- 172.21.15.62:0/1133772009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b8c0b0ac0 0x7f8b8c0ade10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 >> 172.21.15.62:0/1133772009 conn(0x7f8b8c062ec0 msgr2=0x7f8b8c0b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 shutdown_connections 2021-10-21T00:02:44.601 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.589+0000 7f8b90afb700 1 -- 172.21.15.62:0/1133772009 wait complete. 2021-10-21T00:02:44.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7 7 2021-10-21T00:02:44.712 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 Processor -- start 2021-10-21T00:02:44.714 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 -- start start 2021-10-21T00:02:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0afb40 con 0x7f99cc0b5e90 2021-10-21T00:02:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0b0e00 con 0x7f99cc0b1d10 2021-10-21T00:02:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.705+0000 7f99d2b4a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0b1ab0 con 0x7f99cc0b6270 2021-10-21T00:02:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d1347700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f99cc0b1d10 0x7f99cc142c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45092/0 (socket says 172.21.15.62:45092) 2021-10-21T00:02:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d1347700 1 -- 172.21.15.62:0/1218627643 learned_addr learned my addr 172.21.15.62:0/1218627643 (peer_addr_for_me v1:172.21.15.62:0/0) 2021-10-21T00:02:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2349700 1 --2- 172.21.15.62:0/1218627643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d0b46700 1 -- 172.21.15.62:0/1218627643 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537141574 0 0) 0x7f99cc0b0e00 con 0x7f99cc0b1d10 2021-10-21T00:02:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2349700 1 -- 172.21.15.62:0/1218627643 >> v1:172.21.15.62:6789/0 conn(0x7f99cc0b1d10 legacy=0x7f99cc142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2349700 1 -- 172.21.15.62:0/1218627643 >> v1:172.21.15.41:6789/0 conn(0x7f99cc0b5e90 legacy=0x7f99cc0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.719 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2349700 1 -- 172.21.15.62:0/1218627643 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0af7a0 con 0x7f99cc0b6270 2021-10-21T00:02:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2349700 1 --2- 172.21.15.62:0/1218627643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc0ad280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f99c40032f0 tx=0x7f99c40091d0).ready entity=mon.2 client_cookie=e2c166720357adaf server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d0b46700 1 -- 172.21.15.62:0/1218627643 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99c400b8a0 con 0x7f99cc0b6270 2021-10-21T00:02:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d0b46700 1 -- 172.21.15.62:0/1218627643 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400ba00 con 0x7f99cc0b6270 2021-10-21T00:02:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d0b46700 1 -- 172.21.15.62:0/1218627643 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99c400bb70 con 0x7f99cc0b6270 2021-10-21T00:02:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 -- 172.21.15.62:0/1218627643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 msgr2=0x7f99cc0ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/1218627643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc0ad280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f99c40032f0 tx=0x7f99c40091d0).stop 2021-10-21T00:02:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 -- 172.21.15.62:0/1218627643 shutdown_connections 2021-10-21T00:02:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/1218627643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc0ad280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 -- 172.21.15.62:0/1218627643 >> 172.21.15.62:0/1218627643 conn(0x7f99cc063b80 msgr2=0x7f99cc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 -- 172.21.15.62:0/1218627643 shutdown_connections 2021-10-21T00:02:44.722 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.709+0000 7f99d2b4a700 1 -- 172.21.15.62:0/1218627643 wait complete. 2021-10-21T00:02:44.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 Processor -- start 2021-10-21T00:02:44.727 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 -- start start 2021-10-21T00:02:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99cc0b1d10 0x7f99cc10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:44.728 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc13fe10 con 0x7f99cc0b1d10 2021-10-21T00:02:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0668b0 con 0x7f99cc0b5e90 2021-10-21T00:02:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2b4a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc066370 con 0x7f99cc0b6270 2021-10-21T00:02:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d2349700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.729 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42030/0 (socket says 172.21.15.62:42030) 2021-10-21T00:02:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 -- 172.21.15.62:0/3432988355 learned_addr learned my addr 172.21.15.62:0/3432988355 (peer_addr_for_me v2:172.21.15.62:0/0) 2021-10-21T00:02:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1b48700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99cc0b1d10 0x7f99cc10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 -- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 msgr2=0x7f99cc110990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.730 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc110990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 -- 172.21.15.62:0/3432988355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99cc0b1d10 msgr2=0x7f99cc10ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99cc0b1d10 0x7f99cc10ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 -- 172.21.15.62:0/3432988355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009470 con 0x7f99cc0b5e90 2021-10-21T00:02:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.713+0000 7f99d1347700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f99cc13f440 tx=0x7f99bc007ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:44.731 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99bc0070d0 con 0x7f99cc0b5e90 2021-10-21T00:02:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc007230 con 0x7f99cc0b5e90 2021-10-21T00:02:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc066610 con 0x7f99cc0b5e90 2021-10-21T00:02:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99bc005610 con 0x7f99cc0b5e90 2021-10-21T00:02:44.732 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc13cd20 con 0x7f99cc0b5e90 2021-10-21T00:02:44.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f99bc010070 con 0x7f99cc0b5e90 2021-10-21T00:02:44.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f99bc039990 con 0x7f99cc0b5e90 2021-10-21T00:02:44.733 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.717+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc13d030 con 0x7f99cc0b5e90 2021-10-21T00:02:44.734 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.721+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f99bc005770 con 0x7f99cc0b5e90 2021-10-21T00:02:44.793 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.785+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", "id": 7} v 0) v1 -- 0x7f99cc110680 con 0x7f99cc0b5e90 2021-10-21T00:02:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.793+0000 7f99baffd700 1 -- 172.21.15.62:0/3432988355 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f99bc0380b0 con 0x7f99cc0b5e90 2021-10-21T00:02:44.806 INFO:teuthology.orchestra.run.smithi062.stdout:7 2021-10-21T00:02:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 msgr2=0x7f99cc1430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:44.808 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f99cc13f440 tx=0x7f99bc007ce0).stop 2021-10-21T00:02:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 shutdown_connections 2021-10-21T00:02:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99cc0b6270 0x7f99cc110990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99cc0b5e90 0x7f99cc1430f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.810 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 --2- 172.21.15.62:0/3432988355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99cc0b1d10 0x7f99cc10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:44.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 >> 172.21.15.62:0/3432988355 conn(0x7f99cc063b80 msgr2=0x7f99cc13e170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:44.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 shutdown_connections 2021-10-21T00:02:44.811 INFO:teuthology.orchestra.run.smithi062.stderr:2021-10-21T00:02:44.797+0000 7f99d2b4a700 1 -- 172.21.15.62:0/3432988355 wait complete. 2021-10-21T00:02:44.823 INFO:tasks.ceph.osd.0:Restarting daemon 2021-10-21T00:02:44.825 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-10-21T00:02:44.829 INFO:tasks.ceph.osd.0:Started 2021-10-21T00:02:44.830 INFO:tasks.ceph.osd.1:Restarting daemon 2021-10-21T00:02:44.830 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-10-21T00:02:44.834 INFO:tasks.ceph.osd.1:Started 2021-10-21T00:02:44.836 INFO:tasks.ceph.osd.2:Restarting daemon 2021-10-21T00:02:44.838 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-10-21T00:02:44.845 INFO:tasks.ceph.osd.2:Started 2021-10-21T00:02:44.847 INFO:tasks.ceph.osd.3:Restarting daemon 2021-10-21T00:02:44.848 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-10-21T00:02:44.855 INFO:tasks.ceph.osd.3:Started 2021-10-21T00:02:44.857 INFO:tasks.ceph.osd.4:Restarting daemon 2021-10-21T00:02:44.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-10-21T00:02:44.864 INFO:tasks.ceph.osd.4:Started 2021-10-21T00:02:44.865 INFO:tasks.ceph.osd.5:Restarting daemon 2021-10-21T00:02:44.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-10-21T00:02:44.874 INFO:tasks.ceph.osd.5:Started 2021-10-21T00:02:44.877 INFO:tasks.ceph.osd.6:Restarting daemon 2021-10-21T00:02:44.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-10-21T00:02:44.882 INFO:tasks.ceph.osd.6:Started 2021-10-21T00:02:44.882 INFO:tasks.ceph.osd.7:Restarting daemon 2021-10-21T00:02:44.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-10-21T00:02:44.893 INFO:tasks.ceph.osd.7:Started 2021-10-21T00:02:44.894 INFO:tasks.ceph:Waiting for OSDs to come up 2021-10-21T00:02:44.904 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:44.899+0000 7f10544ead80 -1 Falling back to public interface 2021-10-21T00:02:44.912 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:44.907+0000 7f758cd29d80 -1 Falling back to public interface 2021-10-21T00:02:44.920 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:44.915+0000 7f4440d8bd80 -1 Falling back to public interface 2021-10-21T00:02:44.924 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:44.919+0000 7f10544ead80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.924 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:44.919+0000 7f10544ead80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.925 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:44.919+0000 7f10544ead80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.926 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:44.919+0000 7ff2e10e1d80 -1 Falling back to public interface 2021-10-21T00:02:44.927 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:44.923+0000 7f758cd29d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.928 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:44.923+0000 7f758cd29d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.928 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:44.923+0000 7f758cd29d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.929 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:44.923+0000 7f10544ead80 -1 osd.0 0 log_to_monitors {default=true} 2021-10-21T00:02:44.933 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:44.927+0000 7f758cd29d80 -1 osd.1 0 log_to_monitors {default=true} 2021-10-21T00:02:44.940 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:44.933+0000 7f01794a4d80 -1 Falling back to public interface 2021-10-21T00:02:44.942 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:44.935+0000 7f4440d8bd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.945 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:44.935+0000 7f4440d8bd80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.945 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:44.935+0000 7f4440d8bd80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.947 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:44.937+0000 7f50bd220d80 -1 Falling back to public interface 2021-10-21T00:02:44.948 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:44.937+0000 7f7be3415d80 -1 Falling back to public interface 2021-10-21T00:02:44.949 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:44.939+0000 7ff2e10e1d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.949 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:44.939+0000 7ff2e10e1d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.949 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:44.939+0000 7ff2e10e1d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.950 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:44.943+0000 7f4440d8bd80 -1 osd.3 0 log_to_monitors {default=true} 2021-10-21T00:02:44.951 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:44.943+0000 7ff2e10e1d80 -1 osd.2 0 log_to_monitors {default=true} 2021-10-21T00:02:44.957 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:44.949+0000 7ff3e9c63d80 -1 Falling back to public interface 2021-10-21T00:02:44.960 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f01794a4d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.960 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f01794a4d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.960 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f01794a4d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.961 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f7be3415d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.962 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f50bd220d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.963 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f50bd220d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.963 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f50bd220d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.964 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f7be3415d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.964 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:44.953+0000 7f7be3415d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.965 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:44.957+0000 7f01794a4d80 -1 osd.5 0 log_to_monitors {default=true} 2021-10-21T00:02:44.966 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:44.957+0000 7f50bd220d80 -1 osd.6 0 log_to_monitors {default=true} 2021-10-21T00:02:44.966 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:44.957+0000 7f7be3415d80 -1 osd.4 0 log_to_monitors {default=true} 2021-10-21T00:02:44.974 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:44.965+0000 7ff3e9c63d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-10-21T00:02:44.975 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:44.969+0000 7ff3e9c63d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.975 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:44.969+0000 7ff3e9c63d80 -1 journal do_read_entry(8192): bad header magic 2021-10-21T00:02:44.981 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:44.973+0000 7ff3e9c63d80 -1 osd.7 0 log_to_monitors {default=true} 2021-10-21T00:02:45.703 DEBUG:teuthology.orchestra.run.smithi041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:45.802 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.795+0000 7fd956857700 1 Processor -- start 2021-10-21T00:02:45.803 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 -- start start 2021-10-21T00:02:45.806 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd9500b10c0 0x7fd95005fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.807 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd95013fab0 0x7fd9501424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.809 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500abeb0 con 0x7fd9500abad0 2021-10-21T00:02:45.810 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500611b0 con 0x7fd9500b10c0 2021-10-21T00:02:45.810 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956857700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd950060bc0 con 0x7fd95013fab0 2021-10-21T00:02:45.811 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd955054700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd9500b10c0 0x7fd95005fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.813 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd955855700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9500abad0 0x7fd95005f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:34752/0 (socket says 172.21.15.41:34752) 2021-10-21T00:02:45.813 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd955855700 1 -- 172.21.15.41:0/1268547500 learned_addr learned my addr 172.21.15.41:0/1268547500 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:45.814 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd956056700 1 --2- 172.21.15.41:0/1268547500 >> v2:172.21.15.62:3300/0 conn(0x7fd95013fab0 0x7fd9501424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.814 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd954853700 1 -- 172.21.15.41:0/1268547500 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339546856 0 0) 0x7fd9500abeb0 con 0x7fd9500abad0 2021-10-21T00:02:45.814 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.799+0000 7fd954853700 1 -- 172.21.15.41:0/1268547500 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd938003260 con 0x7fd9500abad0 2021-10-21T00:02:45.815 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956056700 1 -- 172.21.15.41:0/1268547500 >> v2:172.21.15.41:3300/0 conn(0x7fd9500b10c0 msgr2=0x7fd95005fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:45.815 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956056700 1 --2- 172.21.15.41:0/1268547500 >> v2:172.21.15.41:3300/0 conn(0x7fd9500b10c0 0x7fd95005fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.816 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956056700 1 -- 172.21.15.41:0/1268547500 >> v1:172.21.15.62:6789/0 conn(0x7fd9500abad0 legacy=0x7fd95005f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.817 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956056700 1 -- 172.21.15.41:0/1268547500 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95013f0d0 con 0x7fd95013fab0 2021-10-21T00:02:45.818 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956056700 1 --2- 172.21.15.41:0/1268547500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95013fab0 0x7fd9501424b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd9480032f0 tx=0x7fd94800d670).ready entity=mon.1 client_cookie=a25e5220334cd0fd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:45.825 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd954853700 1 -- 172.21.15.41:0/1268547500 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd948012070 con 0x7fd95013fab0 2021-10-21T00:02:45.826 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd954853700 1 -- 172.21.15.41:0/1268547500 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800faa0 con 0x7fd95013fab0 2021-10-21T00:02:45.826 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd954853700 1 -- 172.21.15.41:0/1268547500 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94800fe00 con 0x7fd95013fab0 2021-10-21T00:02:45.826 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 -- 172.21.15.41:0/1268547500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95013fab0 msgr2=0x7fd9501424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.827 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 --2- 172.21.15.41:0/1268547500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95013fab0 0x7fd9501424b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd9480032f0 tx=0x7fd94800d670).stop 2021-10-21T00:02:45.827 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 -- 172.21.15.41:0/1268547500 shutdown_connections 2021-10-21T00:02:45.827 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 --2- 172.21.15.41:0/1268547500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95013fab0 0x7fd9501424b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.828 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 --2- 172.21.15.41:0/1268547500 >> v2:172.21.15.41:3300/0 conn(0x7fd9500b10c0 0x7fd95005fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.828 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 -- 172.21.15.41:0/1268547500 >> 172.21.15.41:0/1268547500 conn(0x7fd9500b5fd0 msgr2=0x7fd9500b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:45.828 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 -- 172.21.15.41:0/1268547500 shutdown_connections 2021-10-21T00:02:45.829 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.803+0000 7fd956857700 1 -- 172.21.15.41:0/1268547500 wait complete. 2021-10-21T00:02:45.829 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 Processor -- start 2021-10-21T00:02:45.829 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- start start 2021-10-21T00:02:45.829 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9500abad0 0x7fd9500637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.831 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9500b10c0 0x7fd950139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.831 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.831 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950063ce0 con 0x7fd95013fab0 2021-10-21T00:02:45.832 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950063f20 con 0x7fd9500abad0 2021-10-21T00:02:45.832 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95014e200 con 0x7fd9500b10c0 2021-10-21T00:02:45.833 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.835 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57168/0 (socket says 172.21.15.41:57168) 2021-10-21T00:02:45.835 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 -- 172.21.15.41:0/264406962 learned_addr learned my addr 172.21.15.41:0/264406962 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:45.837 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd955855700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9500abad0 0x7fd9500637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.838 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd955054700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9500b10c0 0x7fd950139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.859 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 -- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9500b10c0 msgr2=0x7fd950139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.880 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9500b10c0 0x7fd950139770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.880 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 -- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9500abad0 msgr2=0x7fd9500637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.881 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9500abad0 0x7fd9500637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.881 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 -- 172.21.15.41:0/264406962 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94800d910 con 0x7fd95013fab0 2021-10-21T00:02:45.881 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956056700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd9480032f0 tx=0x7fd94800d670).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:45.881 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94800de80 con 0x7fd95013fab0 2021-10-21T00:02:45.881 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800d2e0 con 0x7fd95013fab0 2021-10-21T00:02:45.882 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95014e4a0 con 0x7fd95013fab0 2021-10-21T00:02:45.882 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94800b450 con 0x7fd95013fab0 2021-10-21T00:02:45.882 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.807+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950066fa0 con 0x7fd95013fab0 2021-10-21T00:02:45.882 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 3) v1 ==== 65580+0+0 (secure 0 0 0) 0x7fd948029020 con 0x7fd95013fab0 2021-10-21T00:02:45.883 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95014e050 con 0x7fd95013fab0 2021-10-21T00:02:45.883 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd93effd700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 0x7fd930055970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:45.883 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2312+0+0 (secure 0 0 0) 0x7fd94806fb10 con 0x7fd95013fab0 2021-10-21T00:02:45.883 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd955855700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 0x7fd930055970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:45.884 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.811+0000 7fd955855700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 0x7fd930055970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd94c00d000 tx=0x7fd94c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:45.884 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.815+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd948047c00 con 0x7fd95013fab0 2021-10-21T00:02:45.956 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.939+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd95013f370 con 0x7fd95013fab0 2021-10-21T00:02:45.957 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd93effd700 1 -- 172.21.15.41:0/264406962 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fd94804b220 con 0x7fd95013fab0 2021-10-21T00:02:45.957 INFO:teuthology.misc.health.smithi041.stdout: 2021-10-21T00:02:45.958 INFO:teuthology.misc.health.smithi041.stdout:{"epoch":11,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:45.794211+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"9","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:02:45.960 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 msgr2=0x7fd930055970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.960 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 0x7fd930055970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd94c00d000 tx=0x7fd94c009040).stop 2021-10-21T00:02:45.960 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 msgr2=0x7fd95013e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:45.961 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd9480032f0 tx=0x7fd94800d670).stop 2021-10-21T00:02:45.961 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 shutdown_connections 2021-10-21T00:02:45.961 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9300534b0 0x7fd930055970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.985 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95013fab0 0x7fd95013e0e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.985 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9500b10c0 0x7fd950139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.986 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 --2- 172.21.15.41:0/264406962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9500abad0 0x7fd9500637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:45.986 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 >> 172.21.15.41:0/264406962 conn(0x7fd9500b5fd0 msgr2=0x7fd950136af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:45.987 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 shutdown_connections 2021-10-21T00:02:45.987 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:45.943+0000 7fd956857700 1 -- 172.21.15.41:0/264406962 wait complete. 2021-10-21T00:02:45.988 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-10-21T00:02:46.819 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:46.813+0000 7f0163568700 -1 osd.5 0 waiting for initial osdmap 2021-10-21T00:02:46.820 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:46.815+0000 7f442ae4f700 -1 osd.3 0 waiting for initial osdmap 2021-10-21T00:02:46.821 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:46.813+0000 7ff3d3d27700 -1 osd.7 0 waiting for initial osdmap 2021-10-21T00:02:46.821 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:46.815+0000 7f103e5ae700 -1 osd.0 0 waiting for initial osdmap 2021-10-21T00:02:46.822 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:46.813+0000 7f50a72e4700 -1 osd.6 0 waiting for initial osdmap 2021-10-21T00:02:46.823 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:46.815+0000 7ff2cb1a5700 -1 osd.2 0 waiting for initial osdmap 2021-10-21T00:02:46.823 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:46.815+0000 7f7576ded700 -1 osd.1 0 waiting for initial osdmap 2021-10-21T00:02:46.824 INFO:tasks.ceph.osd.3.smithi041.stderr:2021-10-21T00:02:46.819+0000 7f443a2d0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.824 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:46.817+0000 7f7bcd4d9700 -1 osd.4 0 waiting for initial osdmap 2021-10-21T00:02:46.825 INFO:tasks.ceph.osd.7.smithi062.stderr:2021-10-21T00:02:46.817+0000 7ff3e31a8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.825 INFO:tasks.ceph.osd.6.smithi062.stderr:2021-10-21T00:02:46.817+0000 7f50b6765700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.825 INFO:tasks.ceph.osd.2.smithi041.stderr:2021-10-21T00:02:46.819+0000 7ff2da626700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.826 INFO:tasks.ceph.osd.4.smithi062.stderr:2021-10-21T00:02:46.817+0000 7f7bdc95a700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.827 INFO:tasks.ceph.osd.0.smithi041.stderr:2021-10-21T00:02:46.819+0000 7f104da2f700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.856 INFO:tasks.ceph.osd.1.smithi041.stderr:2021-10-21T00:02:46.851+0000 7f758626e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:46.859 INFO:tasks.ceph.osd.5.smithi062.stderr:2021-10-21T00:02:46.853+0000 7f01729e9700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-10-21T00:02:52.797 DEBUG:teuthology.orchestra.run.smithi041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:52.899 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 Processor -- start 2021-10-21T00:02:52.900 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- start start 2021-10-21T00:02:52.903 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 0x7faac00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.903 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faac005bfb0 0x7faac014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.903 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac005d080 con 0x7faac00b0160 2021-10-21T00:02:52.904 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac00ac260 con 0x7faac005bfb0 2021-10-21T00:02:52.904 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00b5be0 con 0x7faac00b5800 2021-10-21T00:02:52.904 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faac005bfb0 0x7faac014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.904 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabed9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7faac00b0160 0x7faac014a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55136/0 (socket says 172.21.15.41:55136) 2021-10-21T00:02:52.905 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabed9d700 1 -- 172.21.15.41:0/1344782901 learned_addr learned my addr 172.21.15.41:0/1344782901 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:52.905 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 -- 172.21.15.41:0/1344782901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 msgr2=0x7faac00ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:52.905 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabe59c700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 0x7faac00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.905 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabd59a700 1 -- 172.21.15.41:0/1344782901 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896649328 0 0) 0x7faac005d080 con 0x7faac00b0160 2021-10-21T00:02:52.906 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 0x7faac00ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:52.906 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 -- 172.21.15.41:0/1344782901 >> v1:172.21.15.41:6789/0 conn(0x7faac00b0160 legacy=0x7faac014a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:52.906 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 -- 172.21.15.41:0/1344782901 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac005d2b0 con 0x7faac005bfb0 2021-10-21T00:02:52.906 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabe59c700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 0x7faac00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:02:52.907 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabdd9b700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac005bfb0 0x7faac014a3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faab00032f0 tx=0x7faab00091d0).ready entity=mon.0 client_cookie=71c033fa3c29f2d6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:52.907 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabd59a700 1 -- 172.21.15.41:0/1344782901 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab0009ea0 con 0x7faac005bfb0 2021-10-21T00:02:52.907 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabd59a700 1 -- 172.21.15.41:0/1344782901 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000b8a0 con 0x7faac005bfb0 2021-10-21T00:02:52.907 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faabd59a700 1 -- 172.21.15.41:0/1344782901 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab000ba10 con 0x7faac005bfb0 2021-10-21T00:02:52.907 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- 172.21.15.41:0/1344782901 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac005bfb0 msgr2=0x7faac014a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:52.908 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac005bfb0 0x7faac014a3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faab00032f0 tx=0x7faab00091d0).stop 2021-10-21T00:02:52.908 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- 172.21.15.41:0/1344782901 shutdown_connections 2021-10-21T00:02:52.908 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac005bfb0 0x7faac014a3c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:52.909 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 --2- 172.21.15.41:0/1344782901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac00b5800 0x7faac00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:52.909 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- 172.21.15.41:0/1344782901 >> 172.21.15.41:0/1344782901 conn(0x7faac00633a0 msgr2=0x7faac00b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:52.909 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.895+0000 7faac4b18700 1 -- 172.21.15.41:0/1344782901 shutdown_connections 2021-10-21T00:02:52.909 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 -- 172.21.15.41:0/1344782901 wait complete. 2021-10-21T00:02:52.914 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 Processor -- start 2021-10-21T00:02:52.914 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 -- start start 2021-10-21T00:02:52.915 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 0x7faac0063c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.915 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 0x7faac0064370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.915 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.915 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0066450 con 0x7faac00b5800 2021-10-21T00:02:52.915 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0157490 con 0x7faac00b0160 2021-10-21T00:02:52.916 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faac4b18700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0067030 con 0x7faac005bfb0 2021-10-21T00:02:52.916 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.916 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57374/0 (socket says 172.21.15.41:57374) 2021-10-21T00:02:52.916 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 -- 172.21.15.41:0/4087175095 learned_addr learned my addr 172.21.15.41:0/4087175095 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:52.917 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabe59c700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 0x7faac0063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.917 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabdd9b700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 0x7faac0064370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.917 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 -- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 msgr2=0x7faac0063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:52.917 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 0x7faac0063c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:52.918 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 -- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 msgr2=0x7faac0064370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:52.918 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 0x7faac0064370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:52.918 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 -- 172.21.15.41:0/4087175095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009470 con 0x7faac00b5800 2021-10-21T00:02:52.918 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabe59c700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 0x7faac0063c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:52.918 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabdd9b700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 0x7faac0064370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:52.919 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faabed9d700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faab8000ed0 tx=0x7faab8007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:52.919 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.899+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab800ce00 con 0x7faac00b5800 2021-10-21T00:02:52.919 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8007320 con 0x7faac00b5800 2021-10-21T00:02:52.919 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac00672d0 con 0x7faac00b5800 2021-10-21T00:02:52.920 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faab8005220 con 0x7faac00b5800 2021-10-21T00:02:52.920 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac00a1ba0 con 0x7faac00b5800 2021-10-21T00:02:52.920 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faab8005610 con 0x7faac00b5800 2021-10-21T00:02:52.920 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0067460 con 0x7faac00b5800 2021-10-21T00:02:52.920 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faaaf7fe700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 0x7faa9c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:52.921 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7faab806ae20 con 0x7faac00b5800 2021-10-21T00:02:52.921 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faabe59c700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 0x7faa9c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:52.921 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.903+0000 7faabe59c700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 0x7faa9c055ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faab400b000 tx=0x7faab4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:52.922 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:52.911+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faab80423b0 con 0x7faac00b5800 2021-10-21T00:02:53.053 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.039+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac00ac4c0 con 0x7faac00b5800 2021-10-21T00:02:53.053 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faaaf7fe700 1 -- 172.21.15.41:0/4087175095 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7faab8007490 con 0x7faac00b5800 2021-10-21T00:02:53.054 INFO:teuthology.misc.health.smithi041.stdout: 2021-10-21T00:02:53.055 INFO:teuthology.misc.health.smithi041.stdout:{"epoch":15,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:49.841543+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:02:53.058 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 msgr2=0x7faa9c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.059 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 0x7faa9c055ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faab400b000 tx=0x7faab4008040).stop 2021-10-21T00:02:53.059 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 msgr2=0x7faac0064860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.060 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faab8000ed0 tx=0x7faab8007a00).stop 2021-10-21T00:02:53.060 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 shutdown_connections 2021-10-21T00:02:53.060 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa9c053610 0x7faa9c055ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.061 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faac00b5800 0x7faac0064860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.063 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faac00b0160 0x7faac0064370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.063 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 --2- 172.21.15.41:0/4087175095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faac005bfb0 0x7faac0063c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.063 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 >> 172.21.15.41:0/4087175095 conn(0x7faac00633a0 msgr2=0x7faac014cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:53.064 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 shutdown_connections 2021-10-21T00:02:53.064 INFO:teuthology.misc.health.smithi041.stderr:2021-10-21T00:02:53.043+0000 7faac4b18700 1 -- 172.21.15.41:0/4087175095 wait complete. 2021-10-21T00:02:53.066 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-10-21T00:02:53.066 INFO:tasks.ceph:Creating RBD pool 2021-10-21T00:02:53.067 DEBUG:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd pool create rbd 8 2021-10-21T00:02:53.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 Processor -- start 2021-10-21T00:02:53.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- start start 2021-10-21T00:02:53.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f907805f9f0 0x7f90780b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907805fdd0 con 0x7f90780b0730 2021-10-21T00:02:53.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078140400 con 0x7f907805f9f0 2021-10-21T00:02:53.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780b27c0 con 0x7f90780b3370 2021-10-21T00:02:53.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907ca93700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f907805f9f0 0x7f90780b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:47648/0 (socket says 172.21.15.41:47648) 2021-10-21T00:02:53.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 -- 172.21.15.41:0/692521233 learned_addr learned my addr 172.21.15.41:0/692521233 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:53.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f9077fff700 1 --1- 172.21.15.41:0/692521233 >> v1:172.21.15.62:6789/0 conn(0x7f90780b0730 0x7f90780b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:34972/0 (socket says 172.21.15.41:34972) 2021-10-21T00:02:53.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 -- 172.21.15.41:0/692521233 >> v2:172.21.15.62:3300/0 conn(0x7f907805f9f0 msgr2=0x7f90780b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:53.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 --2- 172.21.15.41:0/692521233 >> v2:172.21.15.62:3300/0 conn(0x7f907805f9f0 0x7f90780b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 -- 172.21.15.41:0/692521233 >> v1:172.21.15.62:6789/0 conn(0x7f90780b0730 legacy=0x7f90780b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 -- 172.21.15.41:0/692521233 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078140080 con 0x7f90780b3370 2021-10-21T00:02:53.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907d294700 1 --2- 172.21.15.41:0/692521233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f907813f630 tx=0x7f9070009290).ready entity=mon.2 client_cookie=b26dca2b4233774a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f90777fe700 1 -- 172.21.15.41:0/692521233 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907000b860 con 0x7f90780b3370 2021-10-21T00:02:53.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f90777fe700 1 -- 172.21.15.41:0/692521233 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000b9c0 con 0x7f90780b3370 2021-10-21T00:02:53.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f90777fe700 1 -- 172.21.15.41:0/692521233 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907000bb30 con 0x7f90780b3370 2021-10-21T00:02:53.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- 172.21.15.41:0/692521233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 msgr2=0x7f9078138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 --2- 172.21.15.41:0/692521233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f907813f630 tx=0x7f9070009290).stop 2021-10-21T00:02:53.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 -- 172.21.15.41:0/692521233 shutdown_connections 2021-10-21T00:02:53.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.171+0000 7f907da95700 1 --2- 172.21.15.41:0/692521233 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078138b60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 --2- 172.21.15.41:0/692521233 >> v2:172.21.15.62:3300/0 conn(0x7f907805f9f0 0x7f90780b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- 172.21.15.41:0/692521233 >> 172.21.15.41:0/692521233 conn(0x7f90780637b0 msgr2=0x7f9078063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:53.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- 172.21.15.41:0/692521233 shutdown_connections 2021-10-21T00:02:53.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- 172.21.15.41:0/692521233 wait complete. 2021-10-21T00:02:53.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 Processor -- start 2021-10-21T00:02:53.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- start start 2021-10-21T00:02:53.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90780b0730 0x7f9078137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078137f50 con 0x7f907805f9f0 2021-10-21T00:02:53.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078139d10 con 0x7f90780b0730 2021-10-21T00:02:53.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907da95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907813eb70 con 0x7f90780b3370 2021-10-21T00:02:53.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57384/0 (socket says 172.21.15.41:57384) 2021-10-21T00:02:53.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 -- 172.21.15.41:0/1786305806 learned_addr learned my addr 172.21.15.41:0/1786305806 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:53.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f9077fff700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90780b0730 0x7f9078137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907d294700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 -- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 msgr2=0x7f9078137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 -- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90780b0730 msgr2=0x7f9078137020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90780b0730 0x7f9078137020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 -- 172.21.15.41:0/1786305806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009530 con 0x7f907805f9f0 2021-10-21T00:02:53.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.175+0000 7f907ca93700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f906000c000 tx=0x7f9060006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90600104c0 con 0x7f907805f9f0 2021-10-21T00:02:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907813ee10 con 0x7f907805f9f0 2021-10-21T00:02:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060010620 con 0x7f907805f9f0 2021-10-21T00:02:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9060010980 con 0x7f907805f9f0 2021-10-21T00:02:53.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907813a410 con 0x7f907805f9f0 2021-10-21T00:02:53.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078057350 con 0x7f907805f9f0 2021-10-21T00:02:53.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f906001a030 con 0x7f907805f9f0 2021-10-21T00:02:53.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 0x7f905c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f906006b9a0 con 0x7f907805f9f0 2021-10-21T00:02:53.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9077fff700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 0x7f905c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.179+0000 7f9077fff700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 0x7f905c055b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f906800d000 tx=0x7f9068007b40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.187+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9060042f90 con 0x7f907805f9f0 2021-10-21T00:02:53.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.315+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f907805f100 con 0x7f907805f9f0 2021-10-21T00:02:53.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.423+0000 7f9075ffb700 1 -- 172.21.15.41:0/1786305806 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f90600465b0 con 0x7f907805f9f0 2021-10-21T00:02:53.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 msgr2=0x7f905c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 0x7f905c055b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f906800d000 tx=0x7f9068007b40).stop 2021-10-21T00:02:53.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 msgr2=0x7f9078142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f906000c000 tx=0x7f9060006d90).stop 2021-10-21T00:02:53.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 shutdown_connections 2021-10-21T00:02:53.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f905c0536a0 0x7f905c055b60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90780b3370 0x7f9078137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90780b0730 0x7f9078137020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 --2- 172.21.15.41:0/1786305806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f907805f9f0 0x7f9078142660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 >> 172.21.15.41:0/1786305806 conn(0x7f90780637b0 msgr2=0x7f90780b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:53.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 shutdown_connections 2021-10-21T00:02:53.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.427+0000 7f907da95700 1 -- 172.21.15.41:0/1786305806 wait complete. 2021-10-21T00:02:53.435 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'rbd' created 2021-10-21T00:02:53.446 DEBUG:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-10-21T00:02:53.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 Processor -- start 2021-10-21T00:02:53.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 -- start start 2021-10-21T00:02:53.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40b8062330 0x7f40b80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40b813c510 0x7f40b813c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b80b3520 con 0x7f40b813c510 2021-10-21T00:02:53.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b8143c40 con 0x7f40b8062330 2021-10-21T00:02:53.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd8c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8142ad0 con 0x7f40b8142f00 2021-10-21T00:02:53.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40b813c510 0x7f40b813c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40b813c510 0x7f40b813c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57394/0 (socket says 172.21.15.41:57394) 2021-10-21T00:02:53.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 -- 172.21.15.41:0/3088530707 learned_addr learned my addr 172.21.15.41:0/3088530707 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:53.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bd0c1700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40bc8c0700 1 --2- 172.21.15.41:0/3088530707 >> v2:172.21.15.62:3300/0 conn(0x7f40b8062330 0x7f40b80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 -- 172.21.15.41:0/3088530707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 msgr2=0x7f40b8143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:53.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 -- 172.21.15.41:0/3088530707 >> v2:172.21.15.62:3300/0 conn(0x7f40b8062330 msgr2=0x7f40b80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:53.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3088530707 >> v2:172.21.15.62:3300/0 conn(0x7f40b8062330 0x7f40b80b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 -- 172.21.15.41:0/3088530707 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b813ce60 con 0x7f40b813c510 2021-10-21T00:02:53.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b813c510 0x7f40b813c970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f40b80b17c0 tx=0x7f40a0006eb0).ready entity=mon.0 client_cookie=df3a2f8bcd29d7ef server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b77fe700 1 -- 172.21.15.41:0/3088530707 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a000e610 con 0x7f40b813c510 2021-10-21T00:02:53.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b77fe700 1 -- 172.21.15.41:0/3088530707 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a0000e90 con 0x7f40b813c510 2021-10-21T00:02:53.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.547+0000 7f40b77fe700 1 -- 172.21.15.41:0/3088530707 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a000e9a0 con 0x7f40b813c510 2021-10-21T00:02:53.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3088530707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b813c510 msgr2=0x7f40b813c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b813c510 0x7f40b813c970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f40b80b17c0 tx=0x7f40a0006eb0).stop 2021-10-21T00:02:53.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3088530707 shutdown_connections 2021-10-21T00:02:53.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b813c510 0x7f40b813c970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3088530707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3088530707 >> v2:172.21.15.62:3300/0 conn(0x7f40b8062330 0x7f40b80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3088530707 >> 172.21.15.41:0/3088530707 conn(0x7f40b80b9080 msgr2=0x7f40b80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:53.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3088530707 shutdown_connections 2021-10-21T00:02:53.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3088530707 wait complete. 2021-10-21T00:02:53.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 Processor -- start 2021-10-21T00:02:53.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.551+0000 7f40bd8c2700 1 -- start start 2021-10-21T00:02:53.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40b813c510 0x7f40b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8148c20 con 0x7f40b8062330 2021-10-21T00:02:53.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8148ec0 con 0x7f40b813c510 2021-10-21T00:02:53.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b813f010 con 0x7f40b8142f00 2021-10-21T00:02:53.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57398/0 (socket says 172.21.15.41:57398) 2021-10-21T00:02:53.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 -- 172.21.15.41:0/3565532009 learned_addr learned my addr 172.21.15.41:0/3565532009 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:53.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40b813c510 0x7f40b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd0c1700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 -- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 msgr2=0x7f40b8145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 -- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40b813c510 msgr2=0x7f40b80b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:53.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40b813c510 0x7f40b80b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:53.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 -- 172.21.15.41:0/3565532009 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a000b1e0 con 0x7f40b8062330 2021-10-21T00:02:53.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd0c1700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:53.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bc8c0700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f40b000c000 tx=0x7f40b00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b000c850 con 0x7f40b8062330 2021-10-21T00:02:53.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b000c9b0 con 0x7f40b8062330 2021-10-21T00:02:53.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b000cd10 con 0x7f40b8062330 2021-10-21T00:02:53.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b813e000 con 0x7f40b8062330 2021-10-21T00:02:53.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b813e450 con 0x7f40b8062330 2021-10-21T00:02:53.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.555+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b8145f90 con 0x7f40b8062330 2021-10-21T00:02:53.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.559+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f40b0022070 con 0x7f40b8062330 2021-10-21T00:02:53.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.559+0000 7f40b5ffb700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 0x7f409c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:53.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.559+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f40b006bd10 con 0x7f40b8062330 2021-10-21T00:02:53.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.559+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 0x7f409c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:53.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.559+0000 7f40b7fff700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 0x7f409c055b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f40a001b000 tx=0x7f40a0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:53.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.563+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40b00431b0 con 0x7f40b8062330 2021-10-21T00:02:53.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:53.695+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40b8057350 con 0x7f40b8062330 2021-10-21T00:02:54.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.435+0000 7f40b5ffb700 1 -- 172.21.15.41:0/3565532009 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f40b00467d0 con 0x7f40b8062330 2021-10-21T00:02:54.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 msgr2=0x7f409c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 0x7f409c055b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f40a001b000 tx=0x7f40a0015000).stop 2021-10-21T00:02:54.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 msgr2=0x7f40b80b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f40b000c000 tx=0x7f40b00091d0).stop 2021-10-21T00:02:54.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 shutdown_connections 2021-10-21T00:02:54.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f409c0536a0 0x7f409c055b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40b8142f00 0x7f40b8145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40b813c510 0x7f40b80b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 --2- 172.21.15.41:0/3565532009 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40b8062330 0x7f40b80b7a50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 >> 172.21.15.41:0/3565532009 conn(0x7f40b80b9080 msgr2=0x7f40b80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:54.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 shutdown_connections 2021-10-21T00:02:54.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.443+0000 7f40bd8c2700 1 -- 172.21.15.41:0/3565532009 wait complete. 2021-10-21T00:02:54.453 INFO:teuthology.orchestra.run.smithi041.stderr:enabled application 'rbd' on pool 'rbd' 2021-10-21T00:02:54.463 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-10-21T00:02:54.464 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:02:54.464 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:02:54.467 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:02:54.467 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:02:54.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:02:54.470 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:02:54.470 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-10-21T00:02:54.471 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:54.540 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:02:54.545 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:02:54.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.567+0000 7fa49bfff700 1 Processor -- start 2021-10-21T00:02:54.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.567+0000 7fa49bfff700 1 -- start start 2021-10-21T00:02:54.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa49c0b3a20 0x7fa49c05bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c05c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c0628a0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c0b0d90 con 0x7fa49c0b3a20 2021-10-21T00:02:54.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1479c0 con 0x7fa49c05c3c0 2021-10-21T00:02:54.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49affd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa49c0b2cf0 0x7fa49c062190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55194/0 (socket says 172.21.15.41:55194) 2021-10-21T00:02:54.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49affd700 1 -- 172.21.15.41:0/3183509415 learned_addr learned my addr 172.21.15.41:0/3183509415 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:54.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/3183509415 >> v2:172.21.15.62:3300/0 conn(0x7fa49c0b3a20 0x7fa49c05bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49b7fe700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c05c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa499ffb700 1 -- 172.21.15.41:0/3183509415 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607044398 0 0) 0x7fa49c0628a0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa499ffb700 1 -- 172.21.15.41:0/3183509415 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa47c003260 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 -- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 msgr2=0x7fa49c05c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:54.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c05c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 -- 172.21.15.41:0/3183509415 >> v1:172.21.15.41:6789/0 conn(0x7fa49c0b2cf0 legacy=0x7fa49c062190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 -- 172.21.15.41:0/3183509415 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c147c60 con 0x7fa49c0b3a20 2021-10-21T00:02:54.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c05bed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa484002f70 tx=0x7fa484006df0).ready entity=mon.1 client_cookie=94a80144f138cf6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa499ffb700 1 -- 172.21.15.41:0/3183509415 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48400d4a0 con 0x7fa49c0b3a20 2021-10-21T00:02:54.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa499ffb700 1 -- 172.21.15.41:0/3183509415 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484000e90 con 0x7fa49c0b3a20 2021-10-21T00:02:54.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa499ffb700 1 -- 172.21.15.41:0/3183509415 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48400d7f0 con 0x7fa49c0b3a20 2021-10-21T00:02:54.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 msgr2=0x7fa49c05bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c05bed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa484002f70 tx=0x7fa484006df0).stop 2021-10-21T00:02:54.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- 172.21.15.41:0/3183509415 shutdown_connections 2021-10-21T00:02:54.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c05c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 --2- 172.21.15.41:0/3183509415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c05bed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- 172.21.15.41:0/3183509415 >> 172.21.15.41:0/3183509415 conn(0x7fa49c0b9080 msgr2=0x7fa49c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:54.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- 172.21.15.41:0/3183509415 shutdown_connections 2021-10-21T00:02:54.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.571+0000 7fa49bfff700 1 -- 172.21.15.41:0/3183509415 wait complete. 2021-10-21T00:02:54.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 Processor -- start 2021-10-21T00:02:54.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- start start 2021-10-21T00:02:54.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c13e080 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c149eb0 con 0x7fa49c0b3a20 2021-10-21T00:02:54.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c141a60 con 0x7fa49c05c3c0 2021-10-21T00:02:54.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57432/0 (socket says 172.21.15.41:57432) 2021-10-21T00:02:54.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 -- 172.21.15.41:0/1928261892 learned_addr learned my addr 172.21.15.41:0/1928261892 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:54.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49affd700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49b7fe700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 -- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 msgr2=0x7fa49c1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c1499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 -- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 msgr2=0x7fa49c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 -- 172.21.15.41:0/1928261892 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48400b180 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49a7fc700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa49c149ff0 tx=0x7fa484014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa484016070 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840137d0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c0af4c0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa484013b30 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c148ed0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.575+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c141ba0 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.579+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa484025030 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.579+0000 7fa493fff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 0x7fa4800559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.579+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa48406c590 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.579+0000 7fa49affd700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 0x7fa4800559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.579+0000 7fa49affd700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 0x7fa4800559b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa48c00d000 tx=0x7fa48c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.587+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa484043950 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa49c0b3f30 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa493fff700 1 -- 172.21.15.41:0/1928261892 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fa484023070 con 0x7fa49c0b2cf0 2021-10-21T00:02:54.724 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:54.725 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":17,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:54.422635+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:02:54.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 msgr2=0x7fa4800559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 0x7fa4800559b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa48c00d000 tx=0x7fa48c009040).stop 2021-10-21T00:02:54.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 msgr2=0x7fa49c0aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa49c149ff0 tx=0x7fa484014000).stop 2021-10-21T00:02:54.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 shutdown_connections 2021-10-21T00:02:54.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa4800534f0 0x7fa4800559b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa49c0b3a20 0x7fa49c141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49c0b2cf0 0x7fa49c0aefd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 --2- 172.21.15.41:0/1928261892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49c05c3c0 0x7fa49c1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 >> 172.21.15.41:0/1928261892 conn(0x7fa49c0b9080 msgr2=0x7fa49c0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:54.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 shutdown_connections 2021-10-21T00:02:54.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.719+0000 7fa49bfff700 1 -- 172.21.15.41:0/1928261892 wait complete. 2021-10-21T00:02:54.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:02:54.738 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:02:54.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 Processor -- start 2021-10-21T00:02:54.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 -- start start 2021-10-21T00:02:54.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f42dc067a80 0x7f42dc0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0b0b50 con 0x7f42dc0b2170 2021-10-21T00:02:54.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0b2550 con 0x7f42dc0af620 2021-10-21T00:02:54.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.839+0000 7f42e153f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0b0d90 con 0x7f42dc067a80 2021-10-21T00:02:54.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42dbfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f42dc0b2170 0x7f42dc0ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55208/0 (socket says 172.21.15.41:55208) 2021-10-21T00:02:54.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42dbfff700 1 -- 172.21.15.41:0/2307745197 learned_addr learned my addr 172.21.15.41:0/2307745197 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:54.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e0d3e700 1 --2- 172.21.15.41:0/2307745197 >> v2:172.21.15.41:3300/0 conn(0x7f42dc067a80 0x7f42dc0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615810775 0 0) 0x7f42d4001490 con 0x7f42dc0b2170 2021-10-21T00:02:54.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c8003260 con 0x7f42dc0b2170 2021-10-21T00:02:54.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662238790 0 0) 0x7f42dc0b2550 con 0x7f42dc0af620 2021-10-21T00:02:54.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e0d3e700 1 -- 172.21.15.41:0/2307745197 >> v1:172.21.15.62:6789/0 conn(0x7f42dc0af620 legacy=0x7f42dc149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e0d3e700 1 -- 172.21.15.41:0/2307745197 >> v1:172.21.15.41:6789/0 conn(0x7f42dc0b2170 legacy=0x7f42dc0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e0d3e700 1 -- 172.21.15.41:0/2307745197 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0b1030 con 0x7f42dc067a80 2021-10-21T00:02:54.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e0d3e700 1 --2- 172.21.15.41:0/2307745197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc067a80 0x7f42dc0ab880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f42d4001cd0 tx=0x7f42cc006df0).ready entity=mon.0 client_cookie=ea22bdecf53eefcf server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d4001b70 con 0x7f42dc067a80 2021-10-21T00:02:54.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc000e90 con 0x7f42dc067a80 2021-10-21T00:02:54.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42daffd700 1 -- 172.21.15.41:0/2307745197 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42cc00d4f0 con 0x7f42dc067a80 2021-10-21T00:02:54.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- 172.21.15.41:0/2307745197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc067a80 msgr2=0x7f42dc0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 --2- 172.21.15.41:0/2307745197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc067a80 0x7f42dc0ab880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f42d4001cd0 tx=0x7f42cc006df0).stop 2021-10-21T00:02:54.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- 172.21.15.41:0/2307745197 shutdown_connections 2021-10-21T00:02:54.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 --2- 172.21.15.41:0/2307745197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc067a80 0x7f42dc0ab880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- 172.21.15.41:0/2307745197 >> 172.21.15.41:0/2307745197 conn(0x7f42dc0b5700 msgr2=0x7f42dc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:54.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- 172.21.15.41:0/2307745197 shutdown_connections 2021-10-21T00:02:54.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- 172.21.15.41:0/2307745197 wait complete. 2021-10-21T00:02:54.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 Processor -- start 2021-10-21T00:02:54.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.843+0000 7f42e153f700 1 -- start start 2021-10-21T00:02:54.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42dc067a80 0x7f42dc0993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42dc0b2170 0x7f42dc066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc148b20 con 0x7f42dc0af620 2021-10-21T00:02:54.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc08fa00 con 0x7f42dc0b2170 2021-10-21T00:02:54.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc08f6d0 con 0x7f42dc067a80 2021-10-21T00:02:54.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57446/0 (socket says 172.21.15.41:57446) 2021-10-21T00:02:54.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 -- 172.21.15.41:0/3317327347 learned_addr learned my addr 172.21.15.41:0/3317327347 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:54.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e0d3e700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42dc0b2170 0x7f42dc066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42dbfff700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42dc067a80 0x7f42dc0993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 -- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42dc067a80 msgr2=0x7f42dc0993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42dc067a80 0x7f42dc0993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 -- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42dc0b2170 msgr2=0x7f42dc066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42dc0b2170 0x7f42dc066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 -- 172.21.15.41:0/3317327347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc00b180 con 0x7f42dc0af620 2021-10-21T00:02:54.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42db7fe700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f42dc065d10 tx=0x7f42d0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d0012400 con 0x7f42dc0af620 2021-10-21T00:02:54.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d0012560 con 0x7f42dc0af620 2021-10-21T00:02:54.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc064610 con 0x7f42dc0af620 2021-10-21T00:02:54.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d00128c0 con 0x7f42dc0af620 2021-10-21T00:02:54.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc0aed50 con 0x7f42dc0af620 2021-10-21T00:02:54.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.847+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc0b12d0 con 0x7f42dc0af620 2021-10-21T00:02:54.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.851+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42d0019030 con 0x7f42dc0af620 2021-10-21T00:02:54.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.851+0000 7f42d97fa700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 0x7f42bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:54.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.851+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f42d006a7d0 con 0x7f42dc0af620 2021-10-21T00:02:54.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.851+0000 7f42dbfff700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 0x7f42bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:54.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.851+0000 7f42dbfff700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 0x7f42bc055ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f42d400d000 tx=0x7f42d4000f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:54.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.859+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42d0041d10 con 0x7f42dc0af620 2021-10-21T00:02:54.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f42dc057350 con 0x7f42dc0af620 2021-10-21T00:02:54.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42d97fa700 1 -- 172.21.15.41:0/3317327347 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f42d0045330 con 0x7f42dc0af620 2021-10-21T00:02:54.988 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:02:54.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 msgr2=0x7f42bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 0x7f42bc055ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f42d400d000 tx=0x7f42d4000f40).stop 2021-10-21T00:02:54.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 msgr2=0x7f42dc063770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:54.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.983+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f42dc065d10 tx=0x7f42d0007a90).stop 2021-10-21T00:02:54.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 shutdown_connections 2021-10-21T00:02:54.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f42bc053610 0x7f42bc055ad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42dc0b2170 0x7f42dc066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42dc0af620 0x7f42dc063770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 --2- 172.21.15.41:0/3317327347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42dc067a80 0x7f42dc0993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:54.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 >> 172.21.15.41:0/3317327347 conn(0x7f42dc0b5700 msgr2=0x7f42dc149050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:54.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 shutdown_connections 2021-10-21T00:02:54.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:54.987+0000 7f42e153f700 1 -- 172.21.15.41:0/3317327347 wait complete. 2021-10-21T00:02:55.006 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:02:55.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 Processor -- start 2021-10-21T00:02:55.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 -- start start 2021-10-21T00:02:55.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f650406a190 0x7f6504140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65040af700 0x7f6504142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040adf10 con 0x7f650406a190 2021-10-21T00:02:55.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650413f710 con 0x7f65040af700 2021-10-21T00:02:55.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6509019700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040b6350 con 0x7f65040b5f70 2021-10-21T00:02:55.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f650406a190 0x7f6504140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f650406a190 0x7f6504140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57454/0 (socket says 172.21.15.41:57454) 2021-10-21T00:02:55.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 -- 172.21.15.41:0/1990534438 learned_addr learned my addr 172.21.15.41:0/1990534438 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:55.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6508818700 1 --2- 172.21.15.41:0/1990534438 >> v2:172.21.15.62:3300/0 conn(0x7f65040af700 0x7f6504142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6503fff700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 -- 172.21.15.41:0/1990534438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 msgr2=0x7f650413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:55.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 -- 172.21.15.41:0/1990534438 >> v2:172.21.15.62:3300/0 conn(0x7f65040af700 msgr2=0x7f6504142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:55.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 --2- 172.21.15.41:0/1990534438 >> v2:172.21.15.62:3300/0 conn(0x7f65040af700 0x7f6504142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 -- 172.21.15.41:0/1990534438 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504140520 con 0x7f650406a190 2021-10-21T00:02:55.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f6503fff700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:55.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.111+0000 7f65037fe700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504140030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f650405cfe0 tx=0x7f64f8006eb0).ready entity=mon.0 client_cookie=12582eabed5fd630 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6502ffd700 1 -- 172.21.15.41:0/1990534438 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f800d570 con 0x7f650406a190 2021-10-21T00:02:55.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6502ffd700 1 -- 172.21.15.41:0/1990534438 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f8000e90 con 0x7f650406a190 2021-10-21T00:02:55.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6502ffd700 1 -- 172.21.15.41:0/1990534438 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f800d900 con 0x7f650406a190 2021-10-21T00:02:55.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- 172.21.15.41:0/1990534438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 msgr2=0x7f6504140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504140030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f650405cfe0 tx=0x7f64f8006eb0).stop 2021-10-21T00:02:55.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- 172.21.15.41:0/1990534438 shutdown_connections 2021-10-21T00:02:55.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504140030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 --2- 172.21.15.41:0/1990534438 >> v2:172.21.15.62:3300/0 conn(0x7f65040af700 0x7f6504142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 --2- 172.21.15.41:0/1990534438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- 172.21.15.41:0/1990534438 >> 172.21.15.41:0/1990534438 conn(0x7f65040639f0 msgr2=0x7f65040b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:55.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- 172.21.15.41:0/1990534438 shutdown_connections 2021-10-21T00:02:55.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- 172.21.15.41:0/1990534438 wait complete. 2021-10-21T00:02:55.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 Processor -- start 2021-10-21T00:02:55.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.115+0000 7f6509019700 1 -- start start 2021-10-21T00:02:55.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65040af700 0x7f650413a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504140f20 con 0x7f650406a190 2021-10-21T00:02:55.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041411c0 con 0x7f65040af700 2021-10-21T00:02:55.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650414eaf0 con 0x7f65040b5f70 2021-10-21T00:02:55.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57458/0 (socket says 172.21.15.41:57458) 2021-10-21T00:02:55.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 -- 172.21.15.41:0/115192847 learned_addr learned my addr 172.21.15.41:0/115192847 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:55.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f65037fe700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65040af700 0x7f650413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6508818700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 -- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 msgr2=0x7f650414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 -- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65040af700 msgr2=0x7f650413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65040af700 0x7f650413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 -- 172.21.15.41:0/115192847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f800b1e0 con 0x7f650406a190 2021-10-21T00:02:55.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6503fff700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f64f4006940 tx=0x7f64f400d3a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f400bbc0 con 0x7f650406a190 2021-10-21T00:02:55.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f400bd20 con 0x7f650406a190 2021-10-21T00:02:55.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504140ba0 con 0x7f650406a190 2021-10-21T00:02:55.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f401a650 con 0x7f650406a190 2021-10-21T00:02:55.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.119+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65041511b0 con 0x7f650406a190 2021-10-21T00:02:55.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504140d90 con 0x7f650406a190 2021-10-21T00:02:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64f4011450 con 0x7f650406a190 2021-10-21T00:02:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f65017fa700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 0x7f64e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f64f406e330 con 0x7f650406a190 2021-10-21T00:02:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f65037fe700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 0x7f64e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.123+0000 7f65037fe700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 0x7f64e4055ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f64f801b000 tx=0x7f64f8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.131+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64f4045760 con 0x7f650406a190 2021-10-21T00:02:55.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.255+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6504057350 con 0x7f650406a190 2021-10-21T00:02:55.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.255+0000 7f65017fa700 1 -- 172.21.15.41:0/115192847 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64f4048d80 con 0x7f650406a190 2021-10-21T00:02:55.261 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:02:55.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 msgr2=0x7f64e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 0x7f64e4055ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f64f801b000 tx=0x7f64f8015000).stop 2021-10-21T00:02:55.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 msgr2=0x7f6504064250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f64f4006940 tx=0x7f64f400d3a0).stop 2021-10-21T00:02:55.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 shutdown_connections 2021-10-21T00:02:55.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64e4053610 0x7f64e4055ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65040b5f70 0x7f650414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65040af700 0x7f650413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 --2- 172.21.15.41:0/115192847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f650406a190 0x7f6504064250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 >> 172.21.15.41:0/115192847 conn(0x7f65040639f0 msgr2=0x7f65040afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:55.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 shutdown_connections 2021-10-21T00:02:55.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.259+0000 7f6509019700 1 -- 172.21.15.41:0/115192847 wait complete. 2021-10-21T00:02:55.279 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:02:55.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.375+0000 7fa5d9704700 1 Processor -- start 2021-10-21T00:02:55.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.375+0000 7fa5d9704700 1 -- start start 2021-10-21T00:02:55.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d40aa750 0x7fa5d414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa5d414b350 0x7fa5d40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d40609d0 con 0x7fa5d405f9f0 2021-10-21T00:02:55.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d40b1620 con 0x7fa5d414b350 2021-10-21T00:02:55.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d405fdd0 con 0x7fa5d40aa750 2021-10-21T00:02:55.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa5d414b350 0x7fa5d40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa5d414b350 0x7fa5d40af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57470/0 (socket says 172.21.15.41:57470) 2021-10-21T00:02:55.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 -- 172.21.15.41:0/1254078239 learned_addr learned my addr 172.21.15.41:0/1254078239 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:55.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d27fc700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d40aa750 0x7fa5d414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 -- 172.21.15.41:0/1254078239 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d40aa750 msgr2=0x7fa5d414ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:55.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d40aa750 0x7fa5d414ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 -- 172.21.15.41:0/1254078239 >> v1:172.21.15.41:6789/0 conn(0x7fa5d405f9f0 legacy=0x7fa5d414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 -- 172.21.15.41:0/1254078239 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40b1380 con 0x7fa5d414b350 2021-10-21T00:02:55.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d37fe700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d414b350 0x7fa5d40af7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa5cc0032f0 tx=0x7fa5cc009290).ready entity=mon.0 client_cookie=7c7649b601eb3885 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d1ffb700 1 -- 172.21.15.41:0/1254078239 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5cc00b8a0 con 0x7fa5d414b350 2021-10-21T00:02:55.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d1ffb700 1 -- 172.21.15.41:0/1254078239 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc00ba00 con 0x7fa5d414b350 2021-10-21T00:02:55.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d1ffb700 1 -- 172.21.15.41:0/1254078239 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5cc00bb70 con 0x7fa5d414b350 2021-10-21T00:02:55.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- 172.21.15.41:0/1254078239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d414b350 msgr2=0x7fa5d40af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d414b350 0x7fa5d40af7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa5cc0032f0 tx=0x7fa5cc009290).stop 2021-10-21T00:02:55.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- 172.21.15.41:0/1254078239 shutdown_connections 2021-10-21T00:02:55.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d414b350 0x7fa5d40af7c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 --2- 172.21.15.41:0/1254078239 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d40aa750 0x7fa5d414ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- 172.21.15.41:0/1254078239 >> 172.21.15.41:0/1254078239 conn(0x7fa5d405bca0 msgr2=0x7fa5d405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:55.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- 172.21.15.41:0/1254078239 shutdown_connections 2021-10-21T00:02:55.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.379+0000 7fa5d9704700 1 -- 172.21.15.41:0/1254078239 wait complete. 2021-10-21T00:02:55.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 Processor -- start 2021-10-21T00:02:55.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- start start 2021-10-21T00:02:55.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 0x7fa5d4148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d414b350 0x7fa5d4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4062690 con 0x7fa5d405f9f0 2021-10-21T00:02:55.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d414e9d0 con 0x7fa5d40aa750 2021-10-21T00:02:55.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4064330 con 0x7fa5d414b350 2021-10-21T00:02:55.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57472/0 (socket says 172.21.15.41:57472) 2021-10-21T00:02:55.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 -- 172.21.15.41:0/652283033 learned_addr learned my addr 172.21.15.41:0/652283033 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:55.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d27fc700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 0x7fa5d4148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d37fe700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d414b350 0x7fa5d4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 -- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d414b350 msgr2=0x7fa5d4148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d414b350 0x7fa5d4148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 -- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 msgr2=0x7fa5d4148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 0x7fa5d4148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 -- 172.21.15.41:0/652283033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009530 con 0x7fa5d405f9f0 2021-10-21T00:02:55.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d27fc700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 0x7fa5d4148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:02:55.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d2ffd700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa5d405ced0 tx=0x7fa5c8007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c800ce00 con 0x7fa5d405f9f0 2021-10-21T00:02:55.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8007240 con 0x7fa5d405f9f0 2021-10-21T00:02:55.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d40628c0 con 0x7fa5d405f9f0 2021-10-21T00:02:55.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5c8006700 con 0x7fa5d405f9f0 2021-10-21T00:02:55.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.383+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d40aeb10 con 0x7fa5d405f9f0 2021-10-21T00:02:55.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d4064160 con 0x7fa5d405f9f0 2021-10-21T00:02:55.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa5c8006860 con 0x7fa5d405f9f0 2021-10-21T00:02:55.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5c3fff700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 0x7fa5b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa5c806b090 con 0x7fa5d405f9f0 2021-10-21T00:02:55.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5d27fc700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 0x7fa5b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.387+0000 7fa5d27fc700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 0x7fa5b0055b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa5c400c000 tx=0x7fa5c4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.391+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa5c80424a0 con 0x7fa5d405f9f0 2021-10-21T00:02:55.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa5d40678f0 con 0x7fa5d405f9f0 2021-10-21T00:02:55.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5c3fff700 1 -- 172.21.15.41:0/652283033 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa5c8045ac0 con 0x7fa5d405f9f0 2021-10-21T00:02:55.524 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:55.525 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:02:55.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:02:55.525 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:02:55.525 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:02:55.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:02:55.526 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:02:55.526 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:02:55.526 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:02:55.527 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:02:55.527 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:02:55.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 msgr2=0x7fa5b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 0x7fa5b0055b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa5c400c000 tx=0x7fa5c4008040).stop 2021-10-21T00:02:55.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 msgr2=0x7fa5d414df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa5d405ced0 tx=0x7fa5c8007be0).stop 2021-10-21T00:02:55.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 shutdown_connections 2021-10-21T00:02:55.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5b00536a0 0x7fa5b0055b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5d414b350 0x7fa5d4148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5d40aa750 0x7fa5d4148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 --2- 172.21.15.41:0/652283033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa5d405f9f0 0x7fa5d414df90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 >> 172.21.15.41:0/652283033 conn(0x7fa5d405bca0 msgr2=0x7fa5d40b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:55.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 shutdown_connections 2021-10-21T00:02:55.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.519+0000 7fa5d9704700 1 -- 172.21.15.41:0/652283033 wait complete. 2021-10-21T00:02:55.537 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:02:55.538 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:02:55.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 Processor -- start 2021-10-21T00:02:55.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 -- start start 2021-10-21T00:02:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e00b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f50e0145e90 0x7f50e0146340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e00aff30 con 0x7f50e00b1350 2021-10-21T00:02:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00aca60 con 0x7f50e0145e90 2021-10-21T00:02:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e5252700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b0f60 con 0x7f50e00b1b40 2021-10-21T00:02:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50df7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f50e00b1350 0x7f50e00b0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55252/0 (socket says 172.21.15.41:55252) 2021-10-21T00:02:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50df7fe700 1 -- 172.21.15.41:0/2507265586 learned_addr learned my addr 172.21.15.41:0/2507265586 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50e4a51700 1 --2- 172.21.15.41:0/2507265586 >> v2:172.21.15.62:3300/0 conn(0x7f50e0145e90 0x7f50e0146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 --2- 172.21.15.41:0/2507265586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e00b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542879856 0 0) 0x7f50e00aff30 con 0x7f50e00b1350 2021-10-21T00:02:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003260 con 0x7f50e00b1350 2021-10-21T00:02:55.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 -- 172.21.15.41:0/2507265586 >> v2:172.21.15.62:3300/0 conn(0x7f50e0145e90 msgr2=0x7f50e0146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:55.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 --2- 172.21.15.41:0/2507265586 >> v2:172.21.15.62:3300/0 conn(0x7f50e0145e90 0x7f50e0146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 -- 172.21.15.41:0/2507265586 >> v1:172.21.15.41:6789/0 conn(0x7f50e00b1350 legacy=0x7f50e00b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982664079 0 0) 0x7f50cc003260 con 0x7f50e00b1350 2021-10-21T00:02:55.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 -- 172.21.15.41:0/2507265586 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00b1f20 con 0x7f50e00b1b40 2021-10-21T00:02:55.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50dffff700 1 --2- 172.21.15.41:0/2507265586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e00b0360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f50d4001b80 tx=0x7f50d0006df0).ready entity=mon.2 client_cookie=f3d9eecc0235373c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d40019e0 con 0x7f50e00b1b40 2021-10-21T00:02:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0000e90 con 0x7f50e00b1b40 2021-10-21T00:02:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.643+0000 7f50deffd700 1 -- 172.21.15.41:0/2507265586 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d0012460 con 0x7f50e00b1b40 2021-10-21T00:02:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- 172.21.15.41:0/2507265586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 msgr2=0x7f50e00b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 --2- 172.21.15.41:0/2507265586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e00b0360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f50d4001b80 tx=0x7f50d0006df0).stop 2021-10-21T00:02:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- 172.21.15.41:0/2507265586 shutdown_connections 2021-10-21T00:02:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 --2- 172.21.15.41:0/2507265586 >> v2:172.21.15.62:3300/0 conn(0x7f50e0145e90 0x7f50e0146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 --2- 172.21.15.41:0/2507265586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e00b0360 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- 172.21.15.41:0/2507265586 >> 172.21.15.41:0/2507265586 conn(0x7f50e00627b0 msgr2=0x7f50e0062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- 172.21.15.41:0/2507265586 shutdown_connections 2021-10-21T00:02:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- 172.21.15.41:0/2507265586 wait complete. 2021-10-21T00:02:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 Processor -- start 2021-10-21T00:02:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.647+0000 7f50e5252700 1 -- start start 2021-10-21T00:02:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e010e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50e0145e90 0x7f50e0110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e010e3d0 con 0x7f50e00b1350 2021-10-21T00:02:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e014cff0 con 0x7f50e0145e90 2021-10-21T00:02:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e010ecf0 con 0x7f50e00b1b40 2021-10-21T00:02:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57486/0 (socket says 172.21.15.41:57486) 2021-10-21T00:02:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 -- 172.21.15.41:0/1441461515 learned_addr learned my addr 172.21.15.41:0/1441461515 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50df7fe700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e010e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e4a51700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50e0145e90 0x7f50e0110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 -- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 msgr2=0x7f50e010e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e010e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 -- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50e0145e90 msgr2=0x7f50e0110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50e0145e90 0x7f50e0110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 -- 172.21.15.41:0/1441461515 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d000b180 con 0x7f50e00b1350 2021-10-21T00:02:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dffff700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f50d4001b80 tx=0x7f50d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d0016070 con 0x7f50e00b1350 2021-10-21T00:02:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0013e20 con 0x7f50e00b1350 2021-10-21T00:02:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e014d290 con 0x7f50e00b1350 2021-10-21T00:02:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d0002f50 con 0x7f50e00b1350 2021-10-21T00:02:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e014c3a0 con 0x7f50e00b1350 2021-10-21T00:02:55.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.651+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e010e540 con 0x7f50e00b1350 2021-10-21T00:02:55.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.655+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f50d0025030 con 0x7f50e00b1350 2021-10-21T00:02:55.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.655+0000 7f50dd7fa700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 0x7f50c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:55.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.655+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f50d006c570 con 0x7f50e00b1350 2021-10-21T00:02:55.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.655+0000 7f50df7fe700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 0x7f50c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:55.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.655+0000 7f50df7fe700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 0x7f50c0055ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f50d400b000 tx=0x7f50d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:55.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.659+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50e010e540 con 0x7f50e00b1350 2021-10-21T00:02:55.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:55.787+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f50e010e510 con 0x7f50e00b1350 2021-10-21T00:02:56.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.455+0000 7f50dd7fa700 1 -- 172.21.15.41:0/1441461515 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f50d0023020 con 0x7f50e00b1350 2021-10-21T00:02:56.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 msgr2=0x7f50c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 0x7f50c0055ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f50d400b000 tx=0x7f50d4009040).stop 2021-10-21T00:02:56.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 msgr2=0x7f50e0149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f50d4001b80 tx=0x7f50d0014000).stop 2021-10-21T00:02:56.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 shutdown_connections 2021-10-21T00:02:56.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f50c0053610 0x7f50c0055ad0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50e0145e90 0x7f50e0110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50e00b1b40 0x7f50e010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 --2- 172.21.15.41:0/1441461515 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50e00b1350 0x7f50e0149710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 >> 172.21.15.41:0/1441461515 conn(0x7f50e00627b0 msgr2=0x7f50e0144700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:56.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 shutdown_connections 2021-10-21T00:02:56.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.459+0000 7f50e5252700 1 -- 172.21.15.41:0/1441461515 wait complete. 2021-10-21T00:02:56.469 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:02:56.480 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:02:56.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.591+0000 7fce3f59e700 1 Processor -- start 2021-10-21T00:02:56.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.591+0000 7fce3f59e700 1 -- start start 2021-10-21T00:02:56.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fce4005c7c0 0x7fce400b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce400b6350 con 0x7fce40142520 2021-10-21T00:02:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4005cee0 con 0x7fce400b5f70 2021-10-21T00:02:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce40067d00 con 0x7fce4005c7c0 2021-10-21T00:02:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3dd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fce40142520 0x7fce40145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55266/0 (socket says 172.21.15.41:55266) 2021-10-21T00:02:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3dd9b700 1 -- 172.21.15.41:0/3151379769 learned_addr learned my addr 172.21.15.41:0/3151379769 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3151379769 >> v2:172.21.15.62:3300/0 conn(0x7fce4005c7c0 0x7fce400b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441985248 0 0) 0x7fce400b6350 con 0x7fce40142520 2021-10-21T00:02:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce20003260 con 0x7fce40142520 2021-10-21T00:02:56.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520104476 0 0) 0x7fce20003260 con 0x7fce40142520 2021-10-21T00:02:56.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 >> v2:172.21.15.62:3300/0 conn(0x7fce4005c7c0 msgr2=0x7fce400b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:56.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 --2- 172.21.15.41:0/3151379769 >> v2:172.21.15.62:3300/0 conn(0x7fce4005c7c0 0x7fce400b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 >> v1:172.21.15.62:6789/0 conn(0x7fce400b5f70 legacy=0x7fce40141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4005d180 con 0x7fce40142520 2021-10-21T00:02:56.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fce28001660 con 0x7fce40142520 2021-10-21T00:02:56.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 >> v1:172.21.15.41:6789/0 conn(0x7fce40142520 legacy=0x7fce40145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 0x7fce20003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20004500 0x7fce20004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce20004e70 0x7fce2000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40067d00 con 0x7fce20003750 2021-10-21T00:02:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2000bd20 con 0x7fce20004e70 2021-10-21T00:02:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2000bee0 con 0x7fce20004500 2021-10-21T00:02:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 0x7fce20003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce20004e70 0x7fce2000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3dd9b700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20004500 0x7fce20004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 -- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20004500 msgr2=0x7fce20004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20004500 0x7fce20004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 -- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce20004e70 msgr2=0x7fce2000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce20004e70 0x7fce2000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 -- 172.21.15.41:0/3151379769 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20003260 con 0x7fce20003750 2021-10-21T00:02:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce20004e70 0x7fce2000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3ed9d700 1 -- 172.21.15.41:0/3151379769 reap_dead start 2021-10-21T00:02:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 0x7fce20003b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce400b30c0 tx=0x7fce30007a00).ready entity=mon.0 client_cookie=5fb91bb6e4b210af server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce30007d10 con 0x7fce20003750 2021-10-21T00:02:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30007030 con 0x7fce20003750 2021-10-21T00:02:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3d59a700 1 -- 172.21.15.41:0/3151379769 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce30007390 con 0x7fce20003750 2021-10-21T00:02:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 -- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 msgr2=0x7fce20003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.595+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 0x7fce20003b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce400b30c0 tx=0x7fce30007a00).stop 2021-10-21T00:02:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- 172.21.15.41:0/3151379769 shutdown_connections 2021-10-21T00:02:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3151379769 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce20003750 0x7fce20003b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- 172.21.15.41:0/3151379769 >> 172.21.15.41:0/3151379769 conn(0x7fce400639f0 msgr2=0x7fce400b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:56.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- 172.21.15.41:0/3151379769 shutdown_connections 2021-10-21T00:02:56.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- 172.21.15.41:0/3151379769 wait complete. 2021-10-21T00:02:56.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 Processor -- start 2021-10-21T00:02:56.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- start start 2021-10-21T00:02:56.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 0x7fce400b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce40145db0 0x7fce40143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 0x7fce401529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40152ee0 con 0x7fce40152570 2021-10-21T00:02:56.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40145130 con 0x7fce40145db0 2021-10-21T00:02:56.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.599+0000 7fce3f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce40146630 con 0x7fce20003750 2021-10-21T00:02:56.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3e59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 0x7fce400b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce40145db0 0x7fce40143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 0x7fce401529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3e59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 0x7fce400b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:47772/0 (socket says 172.21.15.41:47772) 2021-10-21T00:02:56.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3e59c700 1 -- 172.21.15.41:0/3108135586 learned_addr learned my addr 172.21.15.41:0/3108135586 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:56.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 -- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 msgr2=0x7fce400b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 0x7fce400b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 -- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce40145db0 msgr2=0x7fce40143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:56.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce40145db0 0x7fce40143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:56.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 -- 172.21.15.41:0/3108135586 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce401442e0 con 0x7fce40152570 2021-10-21T00:02:56.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3ed9d700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 0x7fce401529f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce3800b000 tx=0x7fce380091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:56.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3800f910 con 0x7fce40152570 2021-10-21T00:02:56.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800fa70 con 0x7fce40152570 2021-10-21T00:02:56.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce40151e30 con 0x7fce40152570 2021-10-21T00:02:56.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3800fdd0 con 0x7fce40152570 2021-10-21T00:02:56.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce400b2d40 con 0x7fce40152570 2021-10-21T00:02:56.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.603+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce40151c70 con 0x7fce40152570 2021-10-21T00:02:56.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.607+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce38014440 con 0x7fce40152570 2021-10-21T00:02:56.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.607+0000 7fce377fe700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 0x7fce24055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:56.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.607+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fce3806bfc0 con 0x7fce40152570 2021-10-21T00:02:56.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.607+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 0x7fce24055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:56.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.607+0000 7fce3e59c700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 0x7fce24055b90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fce3001b000 tx=0x7fce30015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:56.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.611+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce38043290 con 0x7fce40152570 2021-10-21T00:02:56.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:56.735+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fce40146450 con 0x7fce40152570 2021-10-21T00:02:57.120 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:57.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:57.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:57.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:57.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:02:57.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.458+0000 7fce377fe700 1 -- 172.21.15.41:0/3108135586 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7fce38018030 con 0x7fce40152570 2021-10-21T00:02:57.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 msgr2=0x7fce24055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 0x7fce24055b90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fce3001b000 tx=0x7fce30015000).stop 2021-10-21T00:02:57.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 msgr2=0x7fce401529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 0x7fce401529f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce3800b000 tx=0x7fce380091d0).stop 2021-10-21T00:02:57.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 shutdown_connections 2021-10-21T00:02:57.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce240536d0 0x7fce24055b90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce40152570 0x7fce401529f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce40145db0 0x7fce40143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 --2- 172.21.15.41:0/3108135586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce20003750 0x7fce400b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 >> 172.21.15.41:0/3108135586 conn(0x7fce400639f0 msgr2=0x7fce40148910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:57.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 shutdown_connections 2021-10-21T00:02:57.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.470+0000 7fce3f59e700 1 -- 172.21.15.41:0/3108135586 wait complete. 2021-10-21T00:02:57.478 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:02:57.489 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:02:57.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.594+0000 7fd7f1edd700 1 Processor -- start 2021-10-21T00:02:57.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.594+0000 7fd7f1edd700 1 -- start start 2021-10-21T00:02:57.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7ec05f850 0x7fd7ec0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0ac6e0 con 0x7fd7ec0b2bf0 2021-10-21T00:02:57.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0ac980 con 0x7fd7ec05f850 2021-10-21T00:02:57.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec05fc30 con 0x7fd7ec146980 2021-10-21T00:02:57.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:47784/0 (socket says 172.21.15.41:47784) 2021-10-21T00:02:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 -- 172.21.15.41:0/2329419264 learned_addr learned my addr 172.21.15.41:0/2329419264 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7eb7fe700 1 --2- 172.21.15.41:0/2329419264 >> v2:172.21.15.62:3300/0 conn(0x7fd7ec05f850 0x7fd7ec0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 -- 172.21.15.41:0/2329419264 >> v2:172.21.15.62:3300/0 conn(0x7fd7ec05f850 msgr2=0x7fd7ec0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 --2- 172.21.15.41:0/2329419264 >> v2:172.21.15.62:3300/0 conn(0x7fd7ec05f850 0x7fd7ec0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 -- 172.21.15.41:0/2329419264 >> v1:172.21.15.62:6789/0 conn(0x7fd7ec0b2bf0 legacy=0x7fd7ec146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 -- 172.21.15.41:0/2329419264 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec05fda0 con 0x7fd7ec146980 2021-10-21T00:02:57.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ebfff700 1 --2- 172.21.15.41:0/2329419264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd7e40032f0 tx=0x7fd7e4009290).ready entity=mon.2 client_cookie=41f3265efcecfeb5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ea7fc700 1 -- 172.21.15.41:0/2329419264 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e400b8a0 con 0x7fd7ec146980 2021-10-21T00:02:57.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ea7fc700 1 -- 172.21.15.41:0/2329419264 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400ba00 con 0x7fd7ec146980 2021-10-21T00:02:57.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7ea7fc700 1 -- 172.21.15.41:0/2329419264 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e400bb70 con 0x7fd7ec146980 2021-10-21T00:02:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- 172.21.15.41:0/2329419264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 msgr2=0x7fd7ec0ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/2329419264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd7e40032f0 tx=0x7fd7e4009290).stop 2021-10-21T00:02:57.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- 172.21.15.41:0/2329419264 shutdown_connections 2021-10-21T00:02:57.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/2329419264 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec0ad630 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/2329419264 >> v2:172.21.15.62:3300/0 conn(0x7fd7ec05f850 0x7fd7ec0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- 172.21.15.41:0/2329419264 >> 172.21.15.41:0/2329419264 conn(0x7fd7ec0b7030 msgr2=0x7fd7ec0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:57.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.598+0000 7fd7f1edd700 1 -- 172.21.15.41:0/2329419264 shutdown_connections 2021-10-21T00:02:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 -- 172.21.15.41:0/2329419264 wait complete. 2021-10-21T00:02:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 Processor -- start 2021-10-21T00:02:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 -- start start 2021-10-21T00:02:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 0x7fd7ec13c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec13c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec13ccf0 con 0x7fd7ec05f850 2021-10-21T00:02:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b08b0 con 0x7fd7ec0b2bf0 2021-10-21T00:02:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7f1edd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0af890 con 0x7fd7ec146980 2021-10-21T00:02:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57520/0 (socket says 172.21.15.41:57520) 2021-10-21T00:02:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7eaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 0x7fd7ec13c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7eb7fe700 1 -- 172.21.15.41:0/1029967251 learned_addr learned my addr 172.21.15.41:0/1029967251 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.602+0000 7fd7ebfff700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 -- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 msgr2=0x7fd7ec13c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec13c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 -- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 msgr2=0x7fd7ec13c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 0x7fd7ec13c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 -- 172.21.15.41:0/1029967251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009530 con 0x7fd7ec05f850 2021-10-21T00:02:57.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eaffd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 0x7fd7ec13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:57.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7eb7fe700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7ec0b09f0 tx=0x7fd7dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc010780 con 0x7fd7ec05f850 2021-10-21T00:02:57.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0108e0 con 0x7fd7ec05f850 2021-10-21T00:02:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0afc30 con 0x7fd7ec05f850 2021-10-21T00:02:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc010c40 con 0x7fd7ec05f850 2021-10-21T00:02:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec0b0170 con 0x7fd7ec05f850 2021-10-21T00:02:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.606+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec0b33b0 con 0x7fd7ec05f850 2021-10-21T00:02:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.610+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd7dc01c460 con 0x7fd7ec05f850 2021-10-21T00:02:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.610+0000 7fd7e8ff9700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 0x7fd7d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.610+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd7dc06bcc0 con 0x7fd7ec05f850 2021-10-21T00:02:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.610+0000 7fd7eaffd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 0x7fd7d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.610+0000 7fd7eaffd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 0x7fd7d0055a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd7d400d000 tx=0x7fd7d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.614+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7dc042d90 con 0x7fd7ec05f850 2021-10-21T00:02:57.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.786+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd7ec0af9d0 con 0x7fd7ec05f850 2021-10-21T00:02:57.795 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:02:57.786+0000 7f808b04a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:02:57.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7e8ff9700 1 -- 172.21.15.41:0/1029967251 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd7dc0463b0 con 0x7fd7ec05f850 2021-10-21T00:02:57.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 msgr2=0x7fd7d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 0x7fd7d0055a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd7d400d000 tx=0x7fd7d4009040).stop 2021-10-21T00:02:57.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 msgr2=0x7fd7ec0b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7ec0b09f0 tx=0x7fd7dc006df0).stop 2021-10-21T00:02:57.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 shutdown_connections 2021-10-21T00:02:57.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7d0053580 0x7fd7d0055a40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7ec146980 0x7fd7ec13c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7ec0b2bf0 0x7fd7ec13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 --2- 172.21.15.41:0/1029967251 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd7ec05f850 0x7fd7ec0b43e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.798+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 >> 172.21.15.41:0/1029967251 conn(0x7fd7ec0b7030 msgr2=0x7fd7ec0b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:57.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.802+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 shutdown_connections 2021-10-21T00:02:57.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.802+0000 7fd7f1edd700 1 -- 172.21.15.41:0/1029967251 wait complete. 2021-10-21T00:02:57.809 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 3 and data pool 4 2021-10-21T00:02:57.820 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:57.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 Processor -- start 2021-10-21T00:02:57.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 -- start start 2021-10-21T00:02:57.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f48340b5f70 0x7f483405c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4834142520 0x7f4834145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48340b6350 con 0x7f48340b1a50 2021-10-21T00:02:57.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4834067d00 con 0x7f48340b5f70 2021-10-21T00:02:57.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4833fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483405cee0 con 0x7f4834142520 2021-10-21T00:02:57.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4832ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f48340b5f70 0x7f483405c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f482bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f48340b1a50 0x7f4834141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55298/0 (socket says 172.21.15.41:55298) 2021-10-21T00:02:57.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f4832ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f48340b5f70 0x7f483405c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57528/0 (socket says 172.21.15.41:57528) 2021-10-21T00:02:57.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f482bfff700 1 -- 172.21.15.41:0/3177900523 learned_addr learned my addr 172.21.15.41:0/3177900523 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:57.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.914+0000 7f48337fe700 1 --2- 172.21.15.41:0/3177900523 >> v2:172.21.15.62:3300/0 conn(0x7f4834142520 0x7f4834145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f48327fc700 1 -- 172.21.15.41:0/3177900523 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956422565 0 0) 0x7f48340b6350 con 0x7f48340b1a50 2021-10-21T00:02:57.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f48327fc700 1 -- 172.21.15.41:0/3177900523 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4814003260 con 0x7f48340b1a50 2021-10-21T00:02:57.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4832ffd700 1 -- 172.21.15.41:0/3177900523 >> v2:172.21.15.62:3300/0 conn(0x7f4834142520 msgr2=0x7f4834145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:57.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4832ffd700 1 --2- 172.21.15.41:0/3177900523 >> v2:172.21.15.62:3300/0 conn(0x7f4834142520 0x7f4834145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4832ffd700 1 -- 172.21.15.41:0/3177900523 >> v1:172.21.15.41:6789/0 conn(0x7f48340b1a50 legacy=0x7f4834141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4832ffd700 1 -- 172.21.15.41:0/3177900523 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483405d180 con 0x7f48340b5f70 2021-10-21T00:02:57.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4832ffd700 1 --2- 172.21.15.41:0/3177900523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b5f70 0x7f483405c7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824006df0).ready entity=mon.0 client_cookie=34a67fdf6b910e69 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f48327fc700 1 -- 172.21.15.41:0/3177900523 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482400d4f0 con 0x7f48340b5f70 2021-10-21T00:02:57.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f48327fc700 1 -- 172.21.15.41:0/3177900523 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824000e90 con 0x7f48340b5f70 2021-10-21T00:02:57.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f48327fc700 1 -- 172.21.15.41:0/3177900523 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482400d840 con 0x7f48340b5f70 2021-10-21T00:02:57.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 -- 172.21.15.41:0/3177900523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b5f70 msgr2=0x7f483405c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 --2- 172.21.15.41:0/3177900523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b5f70 0x7f483405c7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824006df0).stop 2021-10-21T00:02:57.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 -- 172.21.15.41:0/3177900523 shutdown_connections 2021-10-21T00:02:57.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 --2- 172.21.15.41:0/3177900523 >> v2:172.21.15.62:3300/0 conn(0x7f4834142520 0x7f4834145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 --2- 172.21.15.41:0/3177900523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b5f70 0x7f483405c7c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 -- 172.21.15.41:0/3177900523 >> 172.21.15.41:0/3177900523 conn(0x7f48340639f0 msgr2=0x7f48340b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:57.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 -- 172.21.15.41:0/3177900523 shutdown_connections 2021-10-21T00:02:57.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.918+0000 7f4833fff700 1 -- 172.21.15.41:0/3177900523 wait complete. 2021-10-21T00:02:57.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 Processor -- start 2021-10-21T00:02:57.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- start start 2021-10-21T00:02:57.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b5f70 0x7f48340668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4834142520 0x7f4834151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834065e90 con 0x7f48340b1a50 2021-10-21T00:02:57.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834066130 con 0x7f48340b5f70 2021-10-21T00:02:57.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4834066420 con 0x7f4834142520 2021-10-21T00:02:57.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57534/0 (socket says 172.21.15.41:57534) 2021-10-21T00:02:57.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 -- 172.21.15.41:0/2783015005 learned_addr learned my addr 172.21.15.41:0/2783015005 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:57.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f482bfff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b5f70 0x7f48340668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f48337fe700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4834142520 0x7f4834151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 -- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4834142520 msgr2=0x7f4834151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4834142520 0x7f4834151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 -- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b5f70 msgr2=0x7f48340668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:57.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b5f70 0x7f48340668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:57.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 -- 172.21.15.41:0/2783015005 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482400b180 con 0x7f48340b1a50 2021-10-21T00:02:57.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4832ffd700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4824016070 con 0x7f48340b1a50 2021-10-21T00:02:57.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48240139c0 con 0x7f48340b1a50 2021-10-21T00:02:57.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48340b1370 con 0x7f48340b1a50 2021-10-21T00:02:57.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4824013d20 con 0x7f48340b1a50 2021-10-21T00:02:57.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.922+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4834145310 con 0x7f48340b1a50 2021-10-21T00:02:57.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4834057350 con 0x7f48340b1a50 2021-10-21T00:02:57.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4824025030 con 0x7f48340b1a50 2021-10-21T00:02:57.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f4830ff9700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 0x7f4818055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:57.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f482406c9f0 con 0x7f48340b1a50 2021-10-21T00:02:57.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f482bfff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 0x7f4818055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:57.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.926+0000 7f482bfff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 0x7f4818055b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f481c00b000 tx=0x7f481c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:57.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:57.930+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4824043a40 con 0x7f48340b1a50 2021-10-21T00:02:58.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.058+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4834142300 con 0x7f48340b1a50 2021-10-21T00:02:58.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.062+0000 7f4830ff9700 1 -- 172.21.15.41:0/2783015005 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f4824023070 con 0x7f48340b1a50 2021-10-21T00:02:58.068 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:58.069 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:57.789842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:02:58.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.062+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 msgr2=0x7f4818055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.062+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 0x7f4818055b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f481c00b000 tx=0x7f481c009040).stop 2021-10-21T00:02:58.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.062+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 msgr2=0x7f483413fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.062+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4824002f70 tx=0x7f4824014000).stop 2021-10-21T00:02:58.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 shutdown_connections 2021-10-21T00:02:58.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48180536d0 0x7f4818055b90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4834142520 0x7f4834151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48340b5f70 0x7f48340668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 --2- 172.21.15.41:0/2783015005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48340b1a50 0x7f483413fa60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 >> 172.21.15.41:0/2783015005 conn(0x7f48340639f0 msgr2=0x7f4834140c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:58.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 shutdown_connections 2021-10-21T00:02:58.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.066+0000 7f4833fff700 1 -- 172.21.15.41:0/2783015005 wait complete. 2021-10-21T00:02:58.083 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:58.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 Processor -- start 2021-10-21T00:02:58.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 -- start start 2021-10-21T00:02:58.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd49c062330 0x7fd49c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd49c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c05bd40 con 0x7fd49c062f70 2021-10-21T00:02:58.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c05bf70 con 0x7fd49c062330 2021-10-21T00:02:58.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a33b9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c142cb0 con 0x7fd49c0b3a20 2021-10-21T00:02:58.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a1bb6700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd49c062f70 0x7fd49c05c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55312/0 (socket says 172.21.15.41:55312) 2021-10-21T00:02:58.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a1bb6700 1 -- 172.21.15.41:0/248939487 learned_addr learned my addr 172.21.15.41:0/248939487 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:58.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a23b7700 1 --2- 172.21.15.41:0/248939487 >> v2:172.21.15.62:3300/0 conn(0x7fd49c062330 0x7fd49c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a2bb8700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd49c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154521993 0 0) 0x7fd49c05bd40 con 0x7fd49c062f70 2021-10-21T00:02:58.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd484003260 con 0x7fd49c062f70 2021-10-21T00:02:58.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814167874 0 0) 0x7fd484003260 con 0x7fd49c062f70 2021-10-21T00:02:58.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 msgr2=0x7fd49c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd49c13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 >> v2:172.21.15.62:3300/0 conn(0x7fd49c062330 msgr2=0x7fd49c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 --2- 172.21.15.41:0/248939487 >> v2:172.21.15.62:3300/0 conn(0x7fd49c062330 0x7fd49c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c142950 con 0x7fd49c062f70 2021-10-21T00:02:58.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.182+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd490001660 con 0x7fd49c062f70 2021-10-21T00:02:58.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 >> v1:172.21.15.41:6789/0 conn(0x7fd49c062f70 legacy=0x7fd49c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4840037d0 0x7fd484003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd484004500 0x7fd484004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd484004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c05bf70 con 0x7fd484004500 2021-10-21T00:02:58.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c142cb0 con 0x7fd4840037d0 2021-10-21T00:02:58.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48400b750 con 0x7fd49c0b3a20 2021-10-21T00:02:58.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd484004500 0x7fd484004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a23b7700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4840037d0 0x7fd484003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a2bb8700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd484004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 -- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 msgr2=0x7fd484004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd49c0b3a20 0x7fd484004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 -- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4840037d0 msgr2=0x7fd484003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4840037d0 0x7fd484003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 -- 172.21.15.41:0/248939487 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484003260 con 0x7fd484004500 2021-10-21T00:02:58.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a1bb6700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd484004500 0x7fd484004980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd490001370 tx=0x7fd490001d80).ready entity=mon.0 client_cookie=76bf853b548bb7c0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4900070d0 con 0x7fd484004500 2021-10-21T00:02:58.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490007230 con 0x7fd484004500 2021-10-21T00:02:58.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a13b5700 1 -- 172.21.15.41:0/248939487 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49000c8f0 con 0x7fd484004500 2021-10-21T00:02:58.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- 172.21.15.41:0/248939487 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd484004500 msgr2=0x7fd484004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/248939487 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd484004500 0x7fd484004980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd490001370 tx=0x7fd490001d80).stop 2021-10-21T00:02:58.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a2bb8700 1 -- 172.21.15.41:0/248939487 reap_dead start 2021-10-21T00:02:58.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- 172.21.15.41:0/248939487 shutdown_connections 2021-10-21T00:02:58.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- 172.21.15.41:0/248939487 >> 172.21.15.41:0/248939487 conn(0x7fd49c0b9080 msgr2=0x7fd49c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:58.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- 172.21.15.41:0/248939487 shutdown_connections 2021-10-21T00:02:58.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- 172.21.15.41:0/248939487 wait complete. 2021-10-21T00:02:58.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 Processor -- start 2021-10-21T00:02:58.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.186+0000 7fd4a33b9700 1 -- start start 2021-10-21T00:02:58.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd484004500 0x7fd49c1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49c13f890 0x7fd49c13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0ae480 con 0x7fd49c0ad350 2021-10-21T00:02:58.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c142710 con 0x7fd49c13f890 2021-10-21T00:02:58.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c1424a0 con 0x7fd484004500 2021-10-21T00:02:58.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a1bb6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49c13f890 0x7fd49c13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57556/0 (socket says 172.21.15.41:57556) 2021-10-21T00:02:58.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a23b7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd484004500 0x7fd49c1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 -- 172.21.15.41:0/3705801007 learned_addr learned my addr 172.21.15.41:0/3705801007 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:58.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 -- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd484004500 msgr2=0x7fd49c1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd484004500 0x7fd49c1489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 -- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49c13f890 msgr2=0x7fd49c13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49c13f890 0x7fd49c13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 -- 172.21.15.41:0/3705801007 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c155d00 con 0x7fd49c0ad350 2021-10-21T00:02:58.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a2bb8700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd49400b000 tx=0x7fd494008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4940145f0 con 0x7fd49c0ad350 2021-10-21T00:02:58.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494014750 con 0x7fd49c0ad350 2021-10-21T00:02:58.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c155fa0 con 0x7fd49c0ad350 2021-10-21T00:02:58.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd494014ab0 con 0x7fd49c0ad350 2021-10-21T00:02:58.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c142170 con 0x7fd49c0ad350 2021-10-21T00:02:58.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd494012040 con 0x7fd49c0ad350 2021-10-21T00:02:58.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c1403a0 con 0x7fd49c0ad350 2021-10-21T00:02:58.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 0x7fd47c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.190+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd49406bd80 con 0x7fd49c0ad350 2021-10-21T00:02:58.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.194+0000 7fd4a23b7700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 0x7fd47c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.194+0000 7fd4a23b7700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 0x7fd47c055a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd49800b000 tx=0x7fd498008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.198+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd494042ee0 con 0x7fd49c0ad350 2021-10-21T00:02:58.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.322+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd49c057350 con 0x7fd49c0ad350 2021-10-21T00:02:58.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.322+0000 7fd48f7fe700 1 -- 172.21.15.41:0/3705801007 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fd49406d090 con 0x7fd49c0ad350 2021-10-21T00:02:58.331 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:58.331 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:57.789842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:02:58.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 msgr2=0x7fd47c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 0x7fd47c055a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd49800b000 tx=0x7fd498008040).stop 2021-10-21T00:02:58.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 msgr2=0x7fd49c0ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd49400b000 tx=0x7fd494008040).stop 2021-10-21T00:02:58.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 shutdown_connections 2021-10-21T00:02:58.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd47c053580 0x7fd47c055a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd49c0ad350 0x7fd49c0ad7d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49c13f890 0x7fd49c13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 --2- 172.21.15.41:0/3705801007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd484004500 0x7fd49c1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 >> 172.21.15.41:0/3705801007 conn(0x7fd49c0b9080 msgr2=0x7fd49c062710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:58.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 shutdown_connections 2021-10-21T00:02:58.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.326+0000 7fd4a33b9700 1 -- 172.21.15.41:0/3705801007 wait complete. 2021-10-21T00:02:58.344 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:02:58.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.447+0000 7f0fb4256700 1 Processor -- start 2021-10-21T00:02:58.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.447+0000 7f0fb4256700 1 -- start start 2021-10-21T00:02:58.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.447+0000 7f0fb4256700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0fac0b9ca0 0x7f0fac0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0ba080 con 0x7f0fac0b26d0 2021-10-21T00:02:58.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac05c670 con 0x7f0fac0b31e0 2021-10-21T00:02:58.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac05c8e0 con 0x7f0fac0b9ca0 2021-10-21T00:02:58.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0fac0b26d0 0x7f0fac141bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55336/0 (socket says 172.21.15.41:55336) 2021-10-21T00:02:58.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 -- 172.21.15.41:0/222646626 learned_addr learned my addr 172.21.15.41:0/222646626 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:58.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/222646626 >> v2:172.21.15.62:3300/0 conn(0x7f0fac0b9ca0 0x7f0fac0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382278270 0 0) 0x7f0fac0ba080 con 0x7f0fac0b26d0 2021-10-21T00:02:58.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f94003260 con 0x7f0fac0b26d0 2021-10-21T00:02:58.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028258992 0 0) 0x7f0fac05c670 con 0x7f0fac0b31e0 2021-10-21T00:02:58.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac0ba080 con 0x7f0fac0b31e0 2021-10-21T00:02:58.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111193548 0 0) 0x7f0f94003260 con 0x7f0fac0b26d0 2021-10-21T00:02:58.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 >> v2:172.21.15.62:3300/0 conn(0x7f0fac0b9ca0 msgr2=0x7f0fac0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 --2- 172.21.15.41:0/222646626 >> v2:172.21.15.62:3300/0 conn(0x7f0fac0b9ca0 0x7f0fac0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 >> v1:172.21.15.62:6789/0 conn(0x7f0fac0b31e0 legacy=0x7f0fac0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac05cb80 con 0x7f0fac0b26d0 2021-10-21T00:02:58.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f0fa40019e0 con 0x7f0fac0b26d0 2021-10-21T00:02:58.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 >> v1:172.21.15.41:6789/0 conn(0x7f0fac0b26d0 legacy=0x7f0fac141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f94003930 0x7f0f94003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f94004500 0x7f0f94004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0f9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac05c8e0 con 0x7f0f94004e70 2021-10-21T00:02:58.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400bdd0 con 0x7f0f94004500 2021-10-21T00:02:58.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9400bf90 con 0x7f0f94003930 2021-10-21T00:02:58.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/222646626 >> v2:172.21.15.62:3300/0 conn(0x7f0fac0b9ca0 0x7f0fac0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:58.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0f9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb17f1700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f94004500 0x7f0f94004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f94003930 0x7f0f94003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 -- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f94003930 msgr2=0x7f0f94003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f94003930 0x7f0f94003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 -- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f94004500 msgr2=0x7f0f94004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:58.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f94004500 0x7f0f94004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 -- 172.21.15.41:0/222646626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94003260 con 0x7f0f94004e70 2021-10-21T00:02:58.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb17f1700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f94004500 0x7f0f94004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:02:58.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 -- 172.21.15.41:0/222646626 reap_dead start 2021-10-21T00:02:58.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb27f3700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0f9400b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f0fa40017b0 tx=0x7f0fac0b37d0).ready entity=mon.0 client_cookie=7ac3968b9294acfe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa400cc80 con 0x7f0f94004e70 2021-10-21T00:02:58.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400cde0 con 0x7f0f94004e70 2021-10-21T00:02:58.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb0ff0700 1 -- 172.21.15.41:0/222646626 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa4005b80 con 0x7f0f94004e70 2021-10-21T00:02:58.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 msgr2=0x7f0f9400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0f9400b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f0fa40017b0 tx=0x7f0fac0b37d0).stop 2021-10-21T00:02:58.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- 172.21.15.41:0/222646626 shutdown_connections 2021-10-21T00:02:58.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 --2- 172.21.15.41:0/222646626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0f9400b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- 172.21.15.41:0/222646626 >> 172.21.15.41:0/222646626 conn(0x7f0fac062f00 msgr2=0x7f0fac0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:58.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- 172.21.15.41:0/222646626 shutdown_connections 2021-10-21T00:02:58.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.451+0000 7f0fb4256700 1 -- 172.21.15.41:0/222646626 wait complete. 2021-10-21T00:02:58.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 Processor -- start 2021-10-21T00:02:58.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- start start 2021-10-21T00:02:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fac113740 0x7f0fac13fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0fac155280 0x7f0fac13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1561e0 con 0x7f0f94004e70 2021-10-21T00:02:58.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac146650 con 0x7f0fac113740 2021-10-21T00:02:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac155800 con 0x7f0fac155280 2021-10-21T00:02:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57576/0 (socket says 172.21.15.41:57576) 2021-10-21T00:02:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 -- 172.21.15.41:0/1758277450 learned_addr learned my addr 172.21.15.41:0/1758277450 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:58.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb17f1700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fac113740 0x7f0fac13fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb27f3700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0fac155280 0x7f0fac13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 -- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0fac155280 msgr2=0x7f0fac13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0fac155280 0x7f0fac13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 -- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fac113740 msgr2=0x7f0fac13fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:58.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fac113740 0x7f0fac13fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:58.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 -- 172.21.15.41:0/1758277450 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac155aa0 con 0x7f0f94004e70 2021-10-21T00:02:58.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb1ff2700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0fa800b000 tx=0x7f0fa8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa8011ee0 con 0x7f0f94004e70 2021-10-21T00:02:58.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800f940 con 0x7f0f94004e70 2021-10-21T00:02:58.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac155d40 con 0x7f0f94004e70 2021-10-21T00:02:58.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa800fab0 con 0x7f0f94004e70 2021-10-21T00:02:58.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.455+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac140580 con 0x7f0f94004e70 2021-10-21T00:02:58.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac057350 con 0x7f0f94004e70 2021-10-21T00:02:58.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0fa800fc10 con 0x7f0f94004e70 2021-10-21T00:02:58.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0f9effd700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 0x7f0f8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:58.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0fa806c1d0 con 0x7f0f94004e70 2021-10-21T00:02:58.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0fb17f1700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 0x7f0f8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:58.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.459+0000 7f0fb17f1700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 0x7f0f8c055ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fa0003000 tx=0x7f0fa0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:58.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.467+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0fa8043290 con 0x7f0f94004e70 2021-10-21T00:02:58.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:58.639+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0fac140580 con 0x7f0f94004e70 2021-10-21T00:02:59.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.463+0000 7f0f9effd700 1 -- 172.21.15.41:0/1758277450 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0fac140580 con 0x7f0f94004e70 2021-10-21T00:02:59.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 msgr2=0x7f0f8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 0x7f0f8c055ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0fa0003000 tx=0x7f0fa0009040).stop 2021-10-21T00:02:59.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 msgr2=0x7f0fac1459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0fa800b000 tx=0x7f0fa8006df0).stop 2021-10-21T00:02:59.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 shutdown_connections 2021-10-21T00:02:59.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0f8c053610 0x7f0f8c055ad0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0fac155280 0x7f0fac13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fac113740 0x7f0fac13fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 --2- 172.21.15.41:0/1758277450 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0f94004e70 0x7f0fac1459a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 >> 172.21.15.41:0/1758277450 conn(0x7f0fac062f00 msgr2=0x7f0fac0b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:59.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 shutdown_connections 2021-10-21T00:02:59.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.471+0000 7f0fb4256700 1 -- 172.21.15.41:0/1758277450 wait complete. 2021-10-21T00:02:59.498 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:02:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.587+0000 7f3044d84700 1 Processor -- start 2021-10-21T00:02:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.587+0000 7f3044d84700 1 -- start start 2021-10-21T00:02:59.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30400b5f70 0x7f304013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30400af700 0x7f3040140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304013f710 con 0x7f304006a190 2021-10-21T00:02:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400adf10 con 0x7f30400b5f70 2021-10-21T00:02:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30400ad9b0 con 0x7f30400af700 2021-10-21T00:02:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30400b5f70 0x7f304013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30400b5f70 0x7f304013fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57594/0 (socket says 172.21.15.41:57594) 2021-10-21T00:02:59.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3036ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f304006a190 0x7f3040142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55366/0 (socket says 172.21.15.41:55366) 2021-10-21T00:02:59.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 -- 172.21.15.41:0/792816329 learned_addr learned my addr 172.21.15.41:0/792816329 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:59.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303ffff700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30400af700 0x7f3040140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 -- 172.21.15.41:0/792816329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30400af700 msgr2=0x7f3040140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:59.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30400af700 0x7f3040140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 -- 172.21.15.41:0/792816329 >> v1:172.21.15.41:6789/0 conn(0x7f304006a190 legacy=0x7f3040142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 -- 172.21.15.41:0/792816329 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400b6350 con 0x7f30400b5f70 2021-10-21T00:02:59.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303f7fe700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f304013fb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f30400adaf0 tx=0x7f3030006eb0).ready entity=mon.0 client_cookie=73f34cc1849cf39d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303effd700 1 -- 172.21.15.41:0/792816329 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303000d5c0 con 0x7f30400b5f70 2021-10-21T00:02:59.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303effd700 1 -- 172.21.15.41:0/792816329 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030000e90 con 0x7f30400b5f70 2021-10-21T00:02:59.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f303effd700 1 -- 172.21.15.41:0/792816329 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303000d950 con 0x7f30400b5f70 2021-10-21T00:02:59.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- 172.21.15.41:0/792816329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 msgr2=0x7f304013fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f304013fb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f30400adaf0 tx=0x7f3030006eb0).stop 2021-10-21T00:02:59.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- 172.21.15.41:0/792816329 shutdown_connections 2021-10-21T00:02:59.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30400af700 0x7f3040140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 --2- 172.21.15.41:0/792816329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f304013fb40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- 172.21.15.41:0/792816329 >> 172.21.15.41:0/792816329 conn(0x7f30400639f0 msgr2=0x7f30400b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:59.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- 172.21.15.41:0/792816329 shutdown_connections 2021-10-21T00:02:59.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.591+0000 7f3044d84700 1 -- 172.21.15.41:0/792816329 wait complete. 2021-10-21T00:02:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 Processor -- start 2021-10-21T00:02:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 -- start start 2021-10-21T00:02:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304006a190 0x7f304013d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400af700 0x7f304005bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040150d00 con 0x7f30400b5f70 2021-10-21T00:02:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304013f130 con 0x7f30400af700 2021-10-21T00:02:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3044d84700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304013de70 con 0x7f304006a190 2021-10-21T00:02:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57604/0 (socket says 172.21.15.41:57604) 2021-10-21T00:02:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 -- 172.21.15.41:0/2489954126 learned_addr learned my addr 172.21.15.41:0/2489954126 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f3036ffd700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400af700 0x7f304005bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303f7fe700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304006a190 0x7f304013d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 -- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304006a190 msgr2=0x7f304013d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304006a190 0x7f304013d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 -- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400af700 msgr2=0x7f304005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400af700 0x7f304005bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.595+0000 7f303ffff700 1 -- 172.21.15.41:0/2489954126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303000b1e0 con 0x7f30400b5f70 2021-10-21T00:02:59.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303ffff700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3038006e00 tx=0x7f30380091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800c640 con 0x7f30400b5f70 2021-10-21T00:02:59.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800c7a0 con 0x7f30400b5f70 2021-10-21T00:02:59.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304013c800 con 0x7f30400b5f70 2021-10-21T00:02:59.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800cb00 con 0x7f30400b5f70 2021-10-21T00:02:59.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304013c5e0 con 0x7f30400b5f70 2021-10-21T00:02:59.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040067600 con 0x7f30400b5f70 2021-10-21T00:02:59.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f303800cc60 con 0x7f30400b5f70 2021-10-21T00:02:59.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 0x7f3024055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f303806bd00 con 0x7f30400b5f70 2021-10-21T00:02:59.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.599+0000 7f303f7fe700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 0x7f3024055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.603+0000 7f303f7fe700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 0x7f3024055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f303001b000 tx=0x7f3030015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.607+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3038042c70 con 0x7f30400b5f70 2021-10-21T00:02:59.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3040057350 con 0x7f30400b5f70 2021-10-21T00:02:59.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f303d7fa700 1 -- 172.21.15.41:0/2489954126 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2133 (secure 0 0 0) 0x7f3038046290 con 0x7f30400b5f70 2021-10-21T00:02:59.782 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:02:59.782 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":4,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:02:59.466693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:creating","state_seq":2,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:02:59.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 msgr2=0x7f3024055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 0x7f3024055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f303001b000 tx=0x7f3030015000).stop 2021-10-21T00:02:59.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 msgr2=0x7f3040138180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3038006e00 tx=0x7f30380091d0).stop 2021-10-21T00:02:59.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 shutdown_connections 2021-10-21T00:02:59.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240536a0 0x7f3024055b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b5f70 0x7f3040138180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400af700 0x7f304005bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.775+0000 7f3044d84700 1 --2- 172.21.15.41:0/2489954126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304006a190 0x7f304013d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.779+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 >> 172.21.15.41:0/2489954126 conn(0x7f30400639f0 msgr2=0x7f3040139300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:59.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.779+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 shutdown_connections 2021-10-21T00:02:59.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.779+0000 7f3044d84700 1 -- 172.21.15.41:0/2489954126 wait complete. 2021-10-21T00:02:59.787 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 4 2021-10-21T00:02:59.793 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:02:59.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.891+0000 7fa26a289700 1 Processor -- start 2021-10-21T00:02:59.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.891+0000 7fa26a289700 1 -- start start 2021-10-21T00:02:59.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2640b2170 0x7fa2640ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 0x7fa2640ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2640b0b50 con 0x7fa2640abb50 2021-10-21T00:02:59.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2640b2550 con 0x7fa2640b2170 2021-10-21T00:02:59.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640b0d90 con 0x7fa2640af620 2021-10-21T00:02:59.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa269a88700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa2640abb50 0x7fa26414a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55382/0 (socket says 172.21.15.41:55382) 2021-10-21T00:02:59.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa269a88700 1 -- 172.21.15.41:0/2770589732 learned_addr learned my addr 172.21.15.41:0/2770589732 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:02:59.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 --2- 172.21.15.41:0/2770589732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 0x7fa2640ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa269287700 1 --2- 172.21.15.41:0/2770589732 >> v2:172.21.15.62:3300/0 conn(0x7fa2640b2170 0x7fa2640ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa25bfff700 1 -- 172.21.15.41:0/2770589732 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348501810 0 0) 0x7fa25c001110 con 0x7fa2640abb50 2021-10-21T00:02:59.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa25bfff700 1 -- 172.21.15.41:0/2770589732 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa248003260 con 0x7fa2640abb50 2021-10-21T00:02:59.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 -- 172.21.15.41:0/2770589732 >> v2:172.21.15.62:3300/0 conn(0x7fa2640b2170 msgr2=0x7fa2640ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:02:59.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 --2- 172.21.15.41:0/2770589732 >> v2:172.21.15.62:3300/0 conn(0x7fa2640b2170 0x7fa2640ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 -- 172.21.15.41:0/2770589732 >> v1:172.21.15.41:6789/0 conn(0x7fa2640abb50 legacy=0x7fa26414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 -- 172.21.15.41:0/2770589732 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640b1030 con 0x7fa2640af620 2021-10-21T00:02:59.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa268a86700 1 --2- 172.21.15.41:0/2770589732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 0x7fa2640ab660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa2600032f0 tx=0x7fa2600091d0).ready entity=mon.2 client_cookie=46dd0be598fd3020 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa25bfff700 1 -- 172.21.15.41:0/2770589732 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26000b600 con 0x7fa2640af620 2021-10-21T00:02:59.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa25bfff700 1 -- 172.21.15.41:0/2770589732 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000b760 con 0x7fa2640af620 2021-10-21T00:02:59.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa25bfff700 1 -- 172.21.15.41:0/2770589732 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26000b8d0 con 0x7fa2640af620 2021-10-21T00:02:59.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- 172.21.15.41:0/2770589732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 msgr2=0x7fa2640ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 --2- 172.21.15.41:0/2770589732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 0x7fa2640ab660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa2600032f0 tx=0x7fa2600091d0).stop 2021-10-21T00:02:59.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- 172.21.15.41:0/2770589732 shutdown_connections 2021-10-21T00:02:59.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 --2- 172.21.15.41:0/2770589732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640af620 0x7fa2640ab660 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 --2- 172.21.15.41:0/2770589732 >> v2:172.21.15.62:3300/0 conn(0x7fa2640b2170 0x7fa2640ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- 172.21.15.41:0/2770589732 >> 172.21.15.41:0/2770589732 conn(0x7fa2640b5700 msgr2=0x7fa2640b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:02:59.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- 172.21.15.41:0/2770589732 shutdown_connections 2021-10-21T00:02:59.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.895+0000 7fa26a289700 1 -- 172.21.15.41:0/2770589732 wait complete. 2021-10-21T00:02:59.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 Processor -- start 2021-10-21T00:02:59.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 -- start start 2021-10-21T00:02:59.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2640af620 0x7fa264156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640b2170 0x7fa2641565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264064370 con 0x7fa2640abb50 2021-10-21T00:02:59.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264064610 con 0x7fa2640af620 2021-10-21T00:02:59.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa26a289700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640648b0 con 0x7fa2640b2170 2021-10-21T00:02:59.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa269287700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa269287700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57614/0 (socket says 172.21.15.41:57614) 2021-10-21T00:02:59.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa269287700 1 -- 172.21.15.41:0/1828141652 learned_addr learned my addr 172.21.15.41:0/1828141652 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:02:59.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa268a86700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2640af620 0x7fa264156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.899+0000 7fa269a88700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640b2170 0x7fa2641565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 -- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640b2170 msgr2=0x7fa2641565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640b2170 0x7fa2641565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 -- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2640af620 msgr2=0x7fa264156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:02:59.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2640af620 0x7fa264156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:02:59.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 -- 172.21.15.41:0/1828141652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009470 con 0x7fa2640abb50 2021-10-21T00:02:59.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa269287700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa25400c000 tx=0x7fa254006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa254011750 con 0x7fa2640abb50 2021-10-21T00:02:59.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540118b0 con 0x7fa2640abb50 2021-10-21T00:02:59.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa254011c10 con 0x7fa2640abb50 2021-10-21T00:02:59.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa264064d50 con 0x7fa2640abb50 2021-10-21T00:02:59.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2640ad580 con 0x7fa2640abb50 2021-10-21T00:02:59.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2640ac910 con 0x7fa2640abb50 2021-10-21T00:02:59.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa254011d70 con 0x7fa2640abb50 2021-10-21T00:02:59.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 0x7fa24c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:02:59.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.903+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa25406bd60 con 0x7fa2640abb50 2021-10-21T00:02:59.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.907+0000 7fa268a86700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 0x7fa24c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:02:59.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.907+0000 7fa268a86700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 0x7fa24c055ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa26001b000 tx=0x7fa260016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:02:59.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:02:59.911+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2640ac910 con 0x7fa2640abb50 2021-10-21T00:03:00.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2640ac910 con 0x7fa2640abb50 2021-10-21T00:03:00.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa25a7fc700 1 -- 172.21.15.41:0/1828141652 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fa2640ac910 con 0x7fa2640abb50 2021-10-21T00:03:00.044 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:00.045 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:00.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 msgr2=0x7fa24c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 0x7fa24c055ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa26001b000 tx=0x7fa260016000).stop 2021-10-21T00:03:00.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 msgr2=0x7fa2640ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa25400c000 tx=0x7fa254006df0).stop 2021-10-21T00:03:00.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 shutdown_connections 2021-10-21T00:03:00.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa24c053610 0x7fa24c055ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2640b2170 0x7fa2641565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2640af620 0x7fa264156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 --2- 172.21.15.41:0/1828141652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2640abb50 0x7fa2640ad090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 >> 172.21.15.41:0/1828141652 conn(0x7fa2640b5700 msgr2=0x7fa2641493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 shutdown_connections 2021-10-21T00:03:00.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.039+0000 7fa26a289700 1 -- 172.21.15.41:0/1828141652 wait complete. 2021-10-21T00:03:00.058 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:00.059 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-10-21T00:03:00.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.151+0000 7f145f028700 1 Processor -- start 2021-10-21T00:03:00.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.151+0000 7f145f028700 1 -- start start 2021-10-21T00:03:00.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f14580b2170 0x7f14580ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14580af620 0x7f14580ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580abb50 0x7f145814a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580b0b50 con 0x7f14580b2170 2021-10-21T00:03:00.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580b2550 con 0x7f14580af620 2021-10-21T00:03:00.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580b0d90 con 0x7f14580abb50 2021-10-21T00:03:00.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f14580b2170 0x7f14580ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f14580b2170 0x7f14580ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57622/0 (socket says 172.21.15.41:57622) 2021-10-21T00:03:00.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 -- 172.21.15.41:0/518546827 learned_addr learned my addr 172.21.15.41:0/518546827 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:00.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e827700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580abb50 0x7f145814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145d825700 1 --2- 172.21.15.41:0/518546827 >> v2:172.21.15.62:3300/0 conn(0x7f14580af620 0x7f14580ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 -- 172.21.15.41:0/518546827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580abb50 msgr2=0x7f145814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:00.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580abb50 0x7f145814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 -- 172.21.15.41:0/518546827 >> v2:172.21.15.62:3300/0 conn(0x7f14580af620 msgr2=0x7f14580ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:00.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 --2- 172.21.15.41:0/518546827 >> v2:172.21.15.62:3300/0 conn(0x7f14580af620 0x7f14580ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 -- 172.21.15.41:0/518546827 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580b1030 con 0x7f14580b2170 2021-10-21T00:03:00.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145e026700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ab170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f14500032f0 tx=0x7f1450009290).ready entity=mon.0 client_cookie=fceaae5633107e12 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145d024700 1 -- 172.21.15.41:0/518546827 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145000b870 con 0x7f14580b2170 2021-10-21T00:03:00.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145d024700 1 -- 172.21.15.41:0/518546827 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145000b9d0 con 0x7f14580b2170 2021-10-21T00:03:00.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145d024700 1 -- 172.21.15.41:0/518546827 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145000bb40 con 0x7f14580b2170 2021-10-21T00:03:00.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- 172.21.15.41:0/518546827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 msgr2=0x7f14580ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ab170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f14500032f0 tx=0x7f1450009290).stop 2021-10-21T00:03:00.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- 172.21.15.41:0/518546827 shutdown_connections 2021-10-21T00:03:00.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580abb50 0x7f145814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- 172.21.15.41:0/518546827 >> v2:172.21.15.62:3300/0 conn(0x7f14580af620 0x7f14580ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 --2- 172.21.15.41:0/518546827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ab170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- 172.21.15.41:0/518546827 >> 172.21.15.41:0/518546827 conn(0x7f14580b5700 msgr2=0x7f14580b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- 172.21.15.41:0/518546827 shutdown_connections 2021-10-21T00:03:00.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.155+0000 7f145f028700 1 -- 172.21.15.41:0/518546827 wait complete. 2021-10-21T00:03:00.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 Processor -- start 2021-10-21T00:03:00.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 -- start start 2021-10-21T00:03:00.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14580abb50 0x7f14581445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580af620 0x7f1458144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458145380 con 0x7f14580b2170 2021-10-21T00:03:00.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458156e30 con 0x7f14580abb50 2021-10-21T00:03:00.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145f028700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580aca60 con 0x7f14580af620 2021-10-21T00:03:00.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57632/0 (socket says 172.21.15.41:57632) 2021-10-21T00:03:00.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e026700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14580abb50 0x7f14581445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 -- 172.21.15.41:0/2194151034 learned_addr learned my addr 172.21.15.41:0/2194151034 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:00.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145d825700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580af620 0x7f1458144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 -- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580af620 msgr2=0x7f1458144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580af620 0x7f1458144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 -- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14580abb50 msgr2=0x7f14581445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14580abb50 0x7f14581445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.159+0000 7f145e827700 1 -- 172.21.15.41:0/2194151034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450009530 con 0x7f14580b2170 2021-10-21T00:03:00.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f145e827700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f145400c000 tx=0x7f1454006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1454011750 con 0x7f14580b2170 2021-10-21T00:03:00.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14540118b0 con 0x7f14580b2170 2021-10-21T00:03:00.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458156110 con 0x7f14580b2170 2021-10-21T00:03:00.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1454011c10 con 0x7f14580b2170 2021-10-21T00:03:00.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458156610 con 0x7f14580b2170 2021-10-21T00:03:00.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14580acc80 con 0x7f14580b2170 2021-10-21T00:03:00.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1454011d70 con 0x7f14580b2170 2021-10-21T00:03:00.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 0x7f1438055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f145406bba0 con 0x7f14580b2170 2021-10-21T00:03:00.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.163+0000 7f145e026700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 0x7f1438055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.167+0000 7f145e026700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 0x7f1438055ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f145001b000 tx=0x7f1450016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.171+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1454042d00 con 0x7f14580b2170 2021-10-21T00:03:00.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.291+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14580b12d0 con 0x7f14580b2170 2021-10-21T00:03:00.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f14477fe700 1 -- 172.21.15.41:0/2194151034 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f1454046320 con 0x7f14580b2170 2021-10-21T00:03:00.300 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:00.300 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:00.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 msgr2=0x7f1438055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 0x7f1438055ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f145001b000 tx=0x7f1450016000).stop 2021-10-21T00:03:00.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 msgr2=0x7f14580ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f145400c000 tx=0x7f1454006df0).stop 2021-10-21T00:03:00.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 shutdown_connections 2021-10-21T00:03:00.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1438053610 0x7f1438055ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f14580b2170 0x7f14580ac570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f14580af620 0x7f1458144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 --2- 172.21.15.41:0/2194151034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14580abb50 0x7f14581445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 >> 172.21.15.41:0/2194151034 conn(0x7f14580b5700 msgr2=0x7f145805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.295+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 shutdown_connections 2021-10-21T00:03:00.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.299+0000 7f145f028700 1 -- 172.21.15.41:0/2194151034 wait complete. 2021-10-21T00:03:00.314 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:00.315 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.419+0000 7f4d10f75700 1 Processor -- start 2021-10-21T00:03:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.419+0000 7f4d10f75700 1 -- start start 2021-10-21T00:03:00.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4d0c0aebb0 0x7f4d0c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0b6350 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c05c830 con 0x7f4d0c1448e0 2021-10-21T00:03:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0b13b0 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4d0c0b5f70 0x7f4d0c143ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55406/0 (socket says 172.21.15.41:55406) 2021-10-21T00:03:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0b7fe700 1 -- 172.21.15.41:0/2776670950 learned_addr learned my addr 172.21.15.41:0/2776670950 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d03fff700 1 --2- 172.21.15.41:0/2776670950 >> v2:172.21.15.62:3300/0 conn(0x7f4d0c0aebb0 0x7f4d0c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0affd700 1 -- 172.21.15.41:0/2776670950 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226228609 0 0) 0x7f4d0c0b6350 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0affd700 1 -- 172.21.15.41:0/2776670950 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec003260 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d03fff700 1 -- 172.21.15.41:0/2776670950 >> v1:172.21.15.62:6789/0 conn(0x7f4d0c1448e0 legacy=0x7f4d0c13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d03fff700 1 -- 172.21.15.41:0/2776670950 >> v1:172.21.15.41:6789/0 conn(0x7f4d0c0b5f70 legacy=0x7f4d0c143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d03fff700 1 -- 172.21.15.41:0/2776670950 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c05cad0 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d03fff700 1 --2- 172.21.15.41:0/2776670950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c0aebb0 0x7f4d0c1443f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4cf4002f70 tx=0x7f4cf4006df0).ready entity=mon.1 client_cookie=e5a2aa569e333e30 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0affd700 1 -- 172.21.15.41:0/2776670950 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf400d610 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0affd700 1 -- 172.21.15.41:0/2776670950 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4000e90 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d0affd700 1 -- 172.21.15.41:0/2776670950 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf400d960 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- 172.21.15.41:0/2776670950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c0aebb0 msgr2=0x7f4d0c1443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 --2- 172.21.15.41:0/2776670950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c0aebb0 0x7f4d0c1443f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4cf4002f70 tx=0x7f4cf4006df0).stop 2021-10-21T00:03:00.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- 172.21.15.41:0/2776670950 shutdown_connections 2021-10-21T00:03:00.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 --2- 172.21.15.41:0/2776670950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c0aebb0 0x7f4d0c1443f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- 172.21.15.41:0/2776670950 >> 172.21.15.41:0/2776670950 conn(0x7f4d0c0639f0 msgr2=0x7f4d0c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- 172.21.15.41:0/2776670950 shutdown_connections 2021-10-21T00:03:00.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.423+0000 7f4d10f75700 1 -- 172.21.15.41:0/2776670950 wait complete. 2021-10-21T00:03:00.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 Processor -- start 2021-10-21T00:03:00.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- start start 2021-10-21T00:03:00.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0c0aebb0 0x7f4d0c064100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c1448e0 0x7f4d0c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c110000 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c065e00 con 0x7f4d0c1448e0 2021-10-21T00:03:00.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0660a0 con 0x7f4d0c0aebb0 2021-10-21T00:03:00.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57642/0 (socket says 172.21.15.41:57642) 2021-10-21T00:03:00.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 -- 172.21.15.41:0/1154321919 learned_addr learned my addr 172.21.15.41:0/1154321919 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:00.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d0bfff700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c1448e0 0x7f4d0c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d0b7fe700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0c0aebb0 0x7f4d0c064100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 -- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0c0aebb0 msgr2=0x7f4d0c064100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0c0aebb0 0x7f4d0c064100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 -- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c1448e0 msgr2=0x7f4d0c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c1448e0 0x7f4d0c153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 -- 172.21.15.41:0/1154321919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf400b180 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d03fff700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4cf4002f70 tx=0x7f4cf4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4016070 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf400de90 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4013da0 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c10fc80 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.427+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c0645f0 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.431+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c066260 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.431+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4cf4024030 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.431+0000 7f4d097fa700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 0x7f4cf00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.431+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4cf406c6e0 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.431+0000 7f4d0b7fe700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 0x7f4cf00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.435+0000 7f4d0b7fe700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 0x7f4cf00559b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4cfc00d000 tx=0x7f4cfc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.439+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4cf4043730 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.571+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4d0c067810 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.571+0000 7f4d097fa700 1 -- 172.21.15.41:0/1154321919 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4cf4022020 con 0x7f4d0c0b5f70 2021-10-21T00:03:00.576 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:00.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 msgr2=0x7f4cf00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 0x7f4cf00559b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4cfc00d000 tx=0x7f4cfc009040).stop 2021-10-21T00:03:00.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 msgr2=0x7f4d0c153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f4cf4002f70 tx=0x7f4cf4014000).stop 2021-10-21T00:03:00.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 shutdown_connections 2021-10-21T00:03:00.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4cf00534f0 0x7f4cf00559b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d0c1448e0 0x7f4d0c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4d0c0b5f70 0x7f4d0c153010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 --2- 172.21.15.41:0/1154321919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0c0aebb0 0x7f4d0c064100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 >> 172.21.15.41:0/1154321919 conn(0x7f4d0c0639f0 msgr2=0x7f4d0c139da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 shutdown_connections 2021-10-21T00:03:00.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.575+0000 7f4d10f75700 1 -- 172.21.15.41:0/1154321919 wait complete. 2021-10-21T00:03:00.594 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:00.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 Processor -- start 2021-10-21T00:03:00.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 -- start start 2021-10-21T00:03:00.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5c600b2170 0x7f5c600b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600ab600 0x7f5c6005fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600b2550 con 0x7f5c600602d0 2021-10-21T00:03:00.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600aba40 con 0x7f5c600b2170 2021-10-21T00:03:00.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.695+0000 7f5c5ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60142d60 con 0x7f5c600ab600 2021-10-21T00:03:00.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5c600b2170 0x7f5c600b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5c600b2170 0x7f5c600b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57650/0 (socket says 172.21.15.41:57650) 2021-10-21T00:03:00.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 -- 172.21.15.41:0/444118594 learned_addr learned my addr 172.21.15.41:0/444118594 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:00.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5e7fc700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600ab600 0x7f5c6005fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 -- 172.21.15.41:0/444118594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600ab600 msgr2=0x7f5c6005fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:00.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600ab600 0x7f5c6005fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 -- 172.21.15.41:0/444118594 >> v1:172.21.15.62:6789/0 conn(0x7f5c600602d0 legacy=0x7f5c60145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 -- 172.21.15.41:0/444118594 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600b1350 con 0x7f5c600b2170 2021-10-21T00:03:00.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5effd700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c600b0d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5c54002f70 tx=0x7f5c54006eb0).ready entity=mon.0 client_cookie=313aed13625a37ef server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5dffb700 1 -- 172.21.15.41:0/444118594 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5400d570 con 0x7f5c600b2170 2021-10-21T00:03:00.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5dffb700 1 -- 172.21.15.41:0/444118594 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54000e90 con 0x7f5c600b2170 2021-10-21T00:03:00.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5dffb700 1 -- 172.21.15.41:0/444118594 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c5400d900 con 0x7f5c600b2170 2021-10-21T00:03:00.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- 172.21.15.41:0/444118594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 msgr2=0x7f5c600b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c600b0d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5c54002f70 tx=0x7f5c54006eb0).stop 2021-10-21T00:03:00.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- 172.21.15.41:0/444118594 shutdown_connections 2021-10-21T00:03:00.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600ab600 0x7f5c6005fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/444118594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c600b0d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- 172.21.15.41:0/444118594 >> 172.21.15.41:0/444118594 conn(0x7f5c600b5700 msgr2=0x7f5c600b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- 172.21.15.41:0/444118594 shutdown_connections 2021-10-21T00:03:00.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- 172.21.15.41:0/444118594 wait complete. 2021-10-21T00:03:00.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 Processor -- start 2021-10-21T00:03:00.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.699+0000 7f5c5ffff700 1 -- start start 2021-10-21T00:03:00.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600602d0 0x7f5c600969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c600ab600 0x7f5c60096ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600aeb20 con 0x7f5c600b2170 2021-10-21T00:03:00.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600b3f30 con 0x7f5c600ab600 2021-10-21T00:03:00.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60097d50 con 0x7f5c600602d0 2021-10-21T00:03:00.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57658/0 (socket says 172.21.15.41:57658) 2021-10-21T00:03:00.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 -- 172.21.15.41:0/3771243135 learned_addr learned my addr 172.21.15.41:0/3771243135 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:00.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5effd700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600602d0 0x7f5c600969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5e7fc700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c600ab600 0x7f5c60096ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 -- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600602d0 msgr2=0x7f5c600969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600602d0 0x7f5c600969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 -- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c600ab600 msgr2=0x7f5c60096ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c600ab600 0x7f5c60096ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 -- 172.21.15.41:0/3771243135 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5400b1e0 con 0x7f5c600b2170 2021-10-21T00:03:00.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5f7fe700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5c60060e00 tx=0x7f5c58007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c58012400 con 0x7f5c600b2170 2021-10-21T00:03:00.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58012560 con 0x7f5c600b2170 2021-10-21T00:03:00.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c60097f10 con 0x7f5c600b2170 2021-10-21T00:03:00.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c580128c0 con 0x7f5c600b2170 2021-10-21T00:03:00.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c60098a70 con 0x7f5c600b2170 2021-10-21T00:03:00.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.703+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6008fe80 con 0x7f5c600b2170 2021-10-21T00:03:00.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.707+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c58019030 con 0x7f5c600b2170 2021-10-21T00:03:00.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.707+0000 7f5c4ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 0x7f5c3c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:00.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.707+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c5806ac80 con 0x7f5c600b2170 2021-10-21T00:03:00.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.707+0000 7f5c5effd700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 0x7f5c3c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:00.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.707+0000 7f5c5effd700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 0x7f5c3c055ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5c5401c000 tx=0x7f5c54015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:00.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.711+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c58070020 con 0x7f5c600b2170 2021-10-21T00:03:00.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.839+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c600aece0 con 0x7f5c600b2170 2021-10-21T00:03:00.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.839+0000 7f5c4ffff700 1 -- 172.21.15.41:0/3771243135 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c58041d60 con 0x7f5c600b2170 2021-10-21T00:03:00.845 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:00.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 msgr2=0x7f5c3c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 0x7f5c3c055ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5c5401c000 tx=0x7f5c54015000).stop 2021-10-21T00:03:00.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 msgr2=0x7f5c60151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:00.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f5c60060e00 tx=0x7f5c58007bc0).stop 2021-10-21T00:03:00.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 shutdown_connections 2021-10-21T00:03:00.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c3c053610 0x7f5c3c055ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c600b2170 0x7f5c60151be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c600ab600 0x7f5c60096ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 --2- 172.21.15.41:0/3771243135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c600602d0 0x7f5c600969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:00.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 >> 172.21.15.41:0/3771243135 conn(0x7f5c600b5700 msgr2=0x7f5c60142ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:00.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 shutdown_connections 2021-10-21T00:03:00.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.843+0000 7f5c5ffff700 1 -- 172.21.15.41:0/3771243135 wait complete. 2021-10-21T00:03:00.863 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:00.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.963+0000 7f915359e700 1 Processor -- start 2021-10-21T00:03:01.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.963+0000 7f915359e700 1 -- start start 2021-10-21T00:03:01.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 0x7f91540b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9154067330 con 0x7f91540b3d30 2021-10-21T00:03:01.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9154147000 con 0x7f915414aff0 2021-10-21T00:03:01.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540b4110 con 0x7f9154065d90 2021-10-21T00:03:01.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f91540b3d30 0x7f91540626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55432/0 (socket says 172.21.15.41:55432) 2021-10-21T00:03:01.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915259c700 1 -- 172.21.15.41:0/310148744 learned_addr learned my addr 172.21.15.41:0/310148744 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:01.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9152d9d700 1 --2- 172.21.15.41:0/310148744 >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 0x7f91540b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 --2- 172.21.15.41:0/310148744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915159a700 1 -- 172.21.15.41:0/310148744 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462878803 0 0) 0x7f9154067330 con 0x7f91540b3d30 2021-10-21T00:03:01.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915159a700 1 -- 172.21.15.41:0/310148744 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9134003260 con 0x7f91540b3d30 2021-10-21T00:03:01.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 -- 172.21.15.41:0/310148744 >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 msgr2=0x7f91540b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:01.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 --2- 172.21.15.41:0/310148744 >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 0x7f91540b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 -- 172.21.15.41:0/310148744 >> v1:172.21.15.41:6789/0 conn(0x7f91540b3d30 legacy=0x7f91540626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 -- 172.21.15.41:0/310148744 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154067560 con 0x7f9154065d90 2021-10-21T00:03:01.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9152d9d700 1 --2- 172.21.15.41:0/310148744 >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 0x7f91540b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:01.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f9151d9b700 1 --2- 172.21.15.41:0/310148744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154062dc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f913c002f70 tx=0x7f913c006df0).ready entity=mon.2 client_cookie=92e4eb3e1a8f1c24 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915159a700 1 -- 172.21.15.41:0/310148744 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c00d4a0 con 0x7f9154065d90 2021-10-21T00:03:01.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915159a700 1 -- 172.21.15.41:0/310148744 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c000e90 con 0x7f9154065d90 2021-10-21T00:03:01.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915159a700 1 -- 172.21.15.41:0/310148744 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c00d7f0 con 0x7f9154065d90 2021-10-21T00:03:01.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- 172.21.15.41:0/310148744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 msgr2=0x7f9154062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 --2- 172.21.15.41:0/310148744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154062dc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f913c002f70 tx=0x7f913c006df0).stop 2021-10-21T00:03:01.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- 172.21.15.41:0/310148744 shutdown_connections 2021-10-21T00:03:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 --2- 172.21.15.41:0/310148744 >> v2:172.21.15.62:3300/0 conn(0x7f915414aff0 0x7f91540b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 --2- 172.21.15.41:0/310148744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154062dc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- 172.21.15.41:0/310148744 >> 172.21.15.41:0/310148744 conn(0x7f91540649c0 msgr2=0x7f9154064dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- 172.21.15.41:0/310148744 shutdown_connections 2021-10-21T00:03:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.967+0000 7f915359e700 1 -- 172.21.15.41:0/310148744 wait complete. 2021-10-21T00:03:01.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 Processor -- start 2021-10-21T00:03:01.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- start start 2021-10-21T00:03:01.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f915414aff0 0x7f9154146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540ad530 con 0x7f91540b3d30 2021-10-21T00:03:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540ad7d0 con 0x7f915414aff0 2021-10-21T00:03:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540ada70 con 0x7f9154065d90 2021-10-21T00:03:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57670/0 (socket says 172.21.15.41:57670) 2021-10-21T00:03:01.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 -- 172.21.15.41:0/2945679518 learned_addr learned my addr 172.21.15.41:0/2945679518 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:01.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915259c700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9152d9d700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f915414aff0 0x7f9154146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 -- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 msgr2=0x7f9154148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 -- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f915414aff0 msgr2=0x7f9154146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f915414aff0 0x7f9154146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 -- 172.21.15.41:0/2945679518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009470 con 0x7f91540b3d30 2021-10-21T00:03:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f9151d9b700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f913c002f70 tx=0x7f913c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c0139c0 con 0x7f91540b3d30 2021-10-21T00:03:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c013b20 con 0x7f91540b3d30 2021-10-21T00:03:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c00b180 con 0x7f91540b3d30 2021-10-21T00:03:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913c013e80 con 0x7f91540b3d30 2021-10-21T00:03:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.971+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91541599c0 con 0x7f91540b3d30 2021-10-21T00:03:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9154066730 con 0x7f91540b3d30 2021-10-21T00:03:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f913c025030 con 0x7f91540b3d30 2021-10-21T00:03:01.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f914b7fe700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 0x7f9138055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f913c06c620 con 0x7f91540b3d30 2021-10-21T00:03:01.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f915259c700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 0x7f9138055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.975+0000 7f915259c700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 0x7f9138055ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f914400d000 tx=0x7f9144009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:00.979+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f913c043780 con 0x7f91540b3d30 2021-10-21T00:03:01.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9154067800 con 0x7f91540b3d30 2021-10-21T00:03:01.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f914b7fe700 1 -- 172.21.15.41:0/2945679518 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f913c046da0 con 0x7f91540b3d30 2021-10-21T00:03:01.440 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:01.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 msgr2=0x7f9138055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 0x7f9138055ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f914400d000 tx=0x7f9144009040).stop 2021-10-21T00:03:01.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 msgr2=0x7f9154145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f913c002f70 tx=0x7f913c014000).stop 2021-10-21T00:03:01.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 shutdown_connections 2021-10-21T00:03:01.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9138053610 0x7f9138055ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f915414aff0 0x7f9154146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f91540b3d30 0x7f9154145fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.103+0000 7f915359e700 1 --2- 172.21.15.41:0/2945679518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9154065d90 0x7f9154148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.107+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 >> 172.21.15.41:0/2945679518 conn(0x7f91540649c0 msgr2=0x7f91540626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:01.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.107+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 shutdown_connections 2021-10-21T00:03:01.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.107+0000 7f915359e700 1 -- 172.21.15.41:0/2945679518 wait complete. 2021-10-21T00:03:01.445 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:01.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 Processor -- start 2021-10-21T00:03:01.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 -- start start 2021-10-21T00:03:01.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc3005c6f0 0x7fdc300aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc300b10d0 0x7fdc30145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3005cad0 con 0x7fdc300b0560 2021-10-21T00:03:01.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc300aece0 con 0x7fdc300b10d0 2021-10-21T00:03:01.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc37a92700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300ae300 con 0x7fdc3005c6f0 2021-10-21T00:03:01.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc300b10d0 0x7fdc30145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3502d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdc300b0560 0x7fdc300b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55448/0 (socket says 172.21.15.41:55448) 2021-10-21T00:03:01.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3502d700 1 -- 172.21.15.41:0/1470424899 learned_addr learned my addr 172.21.15.41:0/1470424899 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:01.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3582e700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc3005c6f0 0x7fdc300aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 -- 172.21.15.41:0/1470424899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc3005c6f0 msgr2=0x7fdc300aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc3005c6f0 0x7fdc300aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 -- 172.21.15.41:0/1470424899 >> v1:172.21.15.41:6789/0 conn(0x7fdc300b0560 legacy=0x7fdc300b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3482c700 1 -- 172.21.15.41:0/1470424899 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315693472 0 0) 0x7fdc3005cad0 con 0x7fdc300b0560 2021-10-21T00:03:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 -- 172.21.15.41:0/1470424899 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300ae5a0 con 0x7fdc300b10d0 2021-10-21T00:03:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3602f700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc30145dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fdc280032f0 tx=0x7fdc280091d0).ready entity=mon.0 client_cookie=c850a7432ceb006 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3482c700 1 -- 172.21.15.41:0/1470424899 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2800b6c0 con 0x7fdc300b10d0 2021-10-21T00:03:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3482c700 1 -- 172.21.15.41:0/1470424899 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800b820 con 0x7fdc300b10d0 2021-10-21T00:03:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.559+0000 7fdc3482c700 1 -- 172.21.15.41:0/1470424899 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2800b990 con 0x7fdc300b10d0 2021-10-21T00:03:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- 172.21.15.41:0/1470424899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 msgr2=0x7fdc30145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc30145dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fdc280032f0 tx=0x7fdc280091d0).stop 2021-10-21T00:03:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- 172.21.15.41:0/1470424899 shutdown_connections 2021-10-21T00:03:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc30145dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 --2- 172.21.15.41:0/1470424899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc3005c6f0 0x7fdc300aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- 172.21.15.41:0/1470424899 >> 172.21.15.41:0/1470424899 conn(0x7fdc30063210 msgr2=0x7fdc3005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- 172.21.15.41:0/1470424899 shutdown_connections 2021-10-21T00:03:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- 172.21.15.41:0/1470424899 wait complete. 2021-10-21T00:03:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 Processor -- start 2021-10-21T00:03:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.563+0000 7fdc37a92700 1 -- start start 2021-10-21T00:03:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 0x7fdc30063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc300b0560 0x7fdc30159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3014a660 con 0x7fdc300b10d0 2021-10-21T00:03:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3014a900 con 0x7fdc3005c6f0 2021-10-21T00:03:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc37a92700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3014a230 con 0x7fdc300b0560 2021-10-21T00:03:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57686/0 (socket says 172.21.15.41:57686) 2021-10-21T00:03:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 -- 172.21.15.41:0/2279089065 learned_addr learned my addr 172.21.15.41:0/2279089065 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3502d700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc300b0560 0x7fdc30159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3582e700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 0x7fdc30063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 -- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc300b0560 msgr2=0x7fdc30159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc300b0560 0x7fdc30159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 -- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 msgr2=0x7fdc30063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 0x7fdc30063bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 -- 172.21.15.41:0/2279089065 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009470 con 0x7fdc300b10d0 2021-10-21T00:03:01.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3582e700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 0x7fdc30063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:01.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.567+0000 7fdc3602f700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc280032f0 tx=0x7fdc28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2800b990 con 0x7fdc300b10d0 2021-10-21T00:03:01.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3014b960 con 0x7fdc300b10d0 2021-10-21T00:03:01.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30067260 con 0x7fdc300b10d0 2021-10-21T00:03:01.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc280205e0 con 0x7fdc300b10d0 2021-10-21T00:03:01.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2800b6c0 con 0x7fdc300b10d0 2021-10-21T00:03:01.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3014aac0 con 0x7fdc300b10d0 2021-10-21T00:03:01.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc2801e070 con 0x7fdc300b10d0 2021-10-21T00:03:01.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 0x7fdc10055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc2806c6f0 con 0x7fdc300b10d0 2021-10-21T00:03:01.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.571+0000 7fdc3582e700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 0x7fdc10055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.575+0000 7fdc3582e700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 0x7fdc10055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdc2c00b000 tx=0x7fdc2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.579+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc280437b0 con 0x7fdc300b10d0 2021-10-21T00:03:01.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.711+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc300ae840 con 0x7fdc300b10d0 2021-10-21T00:03:01.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.711+0000 7fdc22ffd700 1 -- 172.21.15.41:0/2279089065 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdc2801b0a0 con 0x7fdc300b10d0 2021-10-21T00:03:01.718 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 msgr2=0x7fdc10055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 0x7fdc10055ad0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fdc2c00b000 tx=0x7fdc2c008040).stop 2021-10-21T00:03:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 msgr2=0x7fdc300b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc280032f0 tx=0x7fdc28016000).stop 2021-10-21T00:03:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 shutdown_connections 2021-10-21T00:03:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc10053610 0x7fdc10055ad0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc300b10d0 0x7fdc300b56f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc300b0560 0x7fdc30159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 --2- 172.21.15.41:0/2279089065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3005c6f0 0x7fdc30063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 >> 172.21.15.41:0/2279089065 conn(0x7fdc30063210 msgr2=0x7fdc3014c460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 shutdown_connections 2021-10-21T00:03:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.715+0000 7fdc37a92700 1 -- 172.21.15.41:0/2279089065 wait complete. 2021-10-21T00:03:01.731 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-10-21T00:03:01.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-10-21T00:03:01.732 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-10-21T00:03:01.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 Processor -- start 2021-10-21T00:03:01.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 -- start start 2021-10-21T00:03:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5440b5f70 0x7fb5440b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440b6350 con 0x7fb544067a00 2021-10-21T00:03:01.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440b0e10 con 0x7fb5441423a0 2021-10-21T00:03:01.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440b10b0 con 0x7fb5440b5f70 2021-10-21T00:03:01.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb54259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5440b5f70 0x7fb5440b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb542d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb544067a00 0x7fb54413ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55464/0 (socket says 172.21.15.41:55464) 2021-10-21T00:03:01.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.831+0000 7fb542d9d700 1 -- 172.21.15.41:0/1609925386 learned_addr learned my addr 172.21.15.41:0/1609925386 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:01.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781040613 0 0) 0x7fb5440b6350 con 0x7fb544067a00 2021-10-21T00:03:01.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb524003260 con 0x7fb544067a00 2021-10-21T00:03:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779697999 0 0) 0x7fb5440b0e10 con 0x7fb5441423a0 2021-10-21T00:03:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54259c700 1 -- 172.21.15.41:0/1609925386 >> v1:172.21.15.62:6789/0 conn(0x7fb5441423a0 legacy=0x7fb5440672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54259c700 1 -- 172.21.15.41:0/1609925386 >> v1:172.21.15.41:6789/0 conn(0x7fb544067a00 legacy=0x7fb54413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54259c700 1 -- 172.21.15.41:0/1609925386 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440b1350 con 0x7fb5440b5f70 2021-10-21T00:03:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54259c700 1 --2- 172.21.15.41:0/1609925386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5440b5f70 0x7fb5440b1a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534006df0).ready entity=mon.0 client_cookie=477e7d83e4cc2417 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53400d610 con 0x7fb5440b5f70 2021-10-21T00:03:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534000e90 con 0x7fb5440b5f70 2021-10-21T00:03:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54159a700 1 -- 172.21.15.41:0/1609925386 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53400d960 con 0x7fb5440b5f70 2021-10-21T00:03:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- 172.21.15.41:0/1609925386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5440b5f70 msgr2=0x7fb5440b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 --2- 172.21.15.41:0/1609925386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5440b5f70 0x7fb5440b1a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534006df0).stop 2021-10-21T00:03:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- 172.21.15.41:0/1609925386 shutdown_connections 2021-10-21T00:03:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 --2- 172.21.15.41:0/1609925386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5440b5f70 0x7fb5440b1a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- 172.21.15.41:0/1609925386 >> 172.21.15.41:0/1609925386 conn(0x7fb5440639f0 msgr2=0x7fb5440b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:01.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- 172.21.15.41:0/1609925386 shutdown_connections 2021-10-21T00:03:01.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- 172.21.15.41:0/1609925386 wait complete. 2021-10-21T00:03:01.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 Processor -- start 2021-10-21T00:03:01.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.835+0000 7fb54359e700 1 -- start start 2021-10-21T00:03:01.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5440b5f70 0x7fb544065b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5441423a0 0x7fb5441337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544065ff0 con 0x7fb544067a00 2021-10-21T00:03:01.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544137710 con 0x7fb5440b5f70 2021-10-21T00:03:01.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb544066210 con 0x7fb5441423a0 2021-10-21T00:03:01.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57696/0 (socket says 172.21.15.41:57696) 2021-10-21T00:03:01.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 -- 172.21.15.41:0/377149779 learned_addr learned my addr 172.21.15.41:0/377149779 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:01.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb541d9b700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5440b5f70 0x7fb544065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb542d9d700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5441423a0 0x7fb5441337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 -- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5441423a0 msgr2=0x7fb5441337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5441423a0 0x7fb5441337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 -- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5440b5f70 msgr2=0x7fb544065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:01.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5440b5f70 0x7fb544065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:01.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 -- 172.21.15.41:0/377149779 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53400b180 con 0x7fb544067a00 2021-10-21T00:03:01.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54259c700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb534013de0 con 0x7fb544067a00 2021-10-21T00:03:01.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400d290 con 0x7fb544067a00 2021-10-21T00:03:01.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5440664b0 con 0x7fb544067a00 2021-10-21T00:03:01.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53401e5f0 con 0x7fb544067a00 2021-10-21T00:03:01.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5440652a0 con 0x7fb544067a00 2021-10-21T00:03:01.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.839+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb544137880 con 0x7fb544067a00 2021-10-21T00:03:01.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.843+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb534025030 con 0x7fb544067a00 2021-10-21T00:03:01.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.843+0000 7fb53b7fe700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 0x7fb528055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:01.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.843+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb53406c620 con 0x7fb544067a00 2021-10-21T00:03:01.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.843+0000 7fb541d9b700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 0x7fb528055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:01.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.843+0000 7fb541d9b700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 0x7fb528055a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb52c00c000 tx=0x7fb52c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:01.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.847+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb544137880 con 0x7fb544067a00 2021-10-21T00:03:02.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:01.999+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb544137880 con 0x7fb544067a00 2021-10-21T00:03:02.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.003+0000 7fb53b7fe700 1 -- 172.21.15.41:0/377149779 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+131253 (secure 0 0 0) 0x7fb544137880 con 0x7fb544067a00 2021-10-21T00:03:02.012 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:02.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 msgr2=0x7fb528055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 0x7fb528055a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb52c00c000 tx=0x7fb52c008040).stop 2021-10-21T00:03:02.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 msgr2=0x7fb544152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534014000).stop 2021-10-21T00:03:02.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 shutdown_connections 2021-10-21T00:03:02.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5280535b0 0x7fb528055a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5441423a0 0x7fb5441337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5440b5f70 0x7fb544065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 --2- 172.21.15.41:0/377149779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb544067a00 0x7fb544152f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 >> 172.21.15.41:0/377149779 conn(0x7fb5440639f0 msgr2=0x7fb5440ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 shutdown_connections 2021-10-21T00:03:02.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.007+0000 7fb54359e700 1 -- 172.21.15.41:0/377149779 wait complete. 2021-10-21T00:03:02.024 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":4,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":14449},{"type":"v1","addr":"172.21.15.62:6801","nonce":14449}]},"active_addr":"172.21.15.62:6801/14449","active_change":"2021-10-21T00:02:44.288710+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2813618024}]},{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":4274169973}]},{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":904818308}]}]}} 2021-10-21T00:03:02.032 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-10-21T00:03:02.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-10-21T00:03:02.034 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:02.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 Processor -- start 2021-10-21T00:03:02.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 -- start start 2021-10-21T00:03:02.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 0x7f3c0014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000609d0 con 0x7f3c000aa750 2021-10-21T00:03:02.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b1620 con 0x7f3c0005f9f0 2021-10-21T00:03:02.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3c05ab4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0005fdd0 con 0x7f3c0014b350 2021-10-21T00:03:02.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 0x7f3c0014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfeffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3c000aa750 0x7f3c0014ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35302/0 (socket says 172.21.15.41:35302) 2021-10-21T00:03:02.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:47972/0 (socket says 172.21.15.41:47972) 2021-10-21T00:03:02.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfeffd700 1 -- 172.21.15.41:0/3027724513 learned_addr learned my addr 172.21.15.41:0/3027724513 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:02.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 -- 172.21.15.41:0/3027724513 >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 msgr2=0x7f3c0014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:02.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 --2- 172.21.15.41:0/3027724513 >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 0x7f3c0014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 -- 172.21.15.41:0/3027724513 >> v1:172.21.15.62:6789/0 conn(0x7f3c000aa750 legacy=0x7f3c0014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 -- 172.21.15.41:0/3027724513 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000b1380 con 0x7f3c0014b350 2021-10-21T00:03:02.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bff7fe700 1 --2- 172.21.15.41:0/3027724513 >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 0x7f3c0014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:02.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfffff700 1 --2- 172.21.15.41:0/3027724513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3bf80032f0 tx=0x7f3bf80091d0).ready entity=mon.2 client_cookie=511360b45a17ab70 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfe7fc700 1 -- 172.21.15.41:0/3027724513 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf800b6c0 con 0x7f3c0014b350 2021-10-21T00:03:02.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfe7fc700 1 -- 172.21.15.41:0/3027724513 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800b820 con 0x7f3c0014b350 2021-10-21T00:03:02.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.131+0000 7f3bfe7fc700 1 -- 172.21.15.41:0/3027724513 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf800b990 con 0x7f3c0014b350 2021-10-21T00:03:02.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- 172.21.15.41:0/3027724513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 msgr2=0x7f3c000af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/3027724513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3bf80032f0 tx=0x7f3bf80091d0).stop 2021-10-21T00:03:02.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- 172.21.15.41:0/3027724513 shutdown_connections 2021-10-21T00:03:02.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/3027724513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0014b350 0x7f3c000af7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/3027724513 >> v2:172.21.15.62:3300/0 conn(0x7f3c0005f9f0 0x7f3c0014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- 172.21.15.41:0/3027724513 >> 172.21.15.41:0/3027724513 conn(0x7f3c0005bca0 msgr2=0x7f3c0005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- 172.21.15.41:0/3027724513 shutdown_connections 2021-10-21T00:03:02.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- 172.21.15.41:0/3027724513 wait complete. 2021-10-21T00:03:02.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 Processor -- start 2021-10-21T00:03:02.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- start start 2021-10-21T00:03:02.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0005f9f0 0x7f3c000b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c0014b350 0x7f3c00147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000aef60 con 0x7f3c000aa750 2021-10-21T00:03:02.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00154150 con 0x7f3c0014b350 2021-10-21T00:03:02.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3c05ab4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000ae0a0 con 0x7f3c0005f9f0 2021-10-21T00:03:02.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3bfeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c0014b350 0x7f3c00147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0005f9f0 0x7f3c000b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3bfeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57714/0 (socket says 172.21.15.41:57714) 2021-10-21T00:03:02.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.135+0000 7f3bfeffd700 1 -- 172.21.15.41:0/2098894932 learned_addr learned my addr 172.21.15.41:0/2098894932 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 -- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0005f9f0 msgr2=0x7f3c000b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0005f9f0 0x7f3c000b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 -- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c0014b350 msgr2=0x7f3c00147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c0014b350 0x7f3c00147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 -- 172.21.15.41:0/2098894932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf400b180 con 0x7f3c000aa750 2021-10-21T00:03:02.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfeffd700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3c000636d0 tx=0x7f3bf0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf00070d0 con 0x7f3c000aa750 2021-10-21T00:03:02.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0007230 con 0x7f3c000aa750 2021-10-21T00:03:02.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf8009470 con 0x7f3c000aa750 2021-10-21T00:03:02.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf00055f0 con 0x7f3c000aa750 2021-10-21T00:03:02.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000aecc0 con 0x7f3c000aa750 2021-10-21T00:03:02.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000678f0 con 0x7f3c000aa750 2021-10-21T00:03:02.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.139+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3bf0010070 con 0x7f3c000aa750 2021-10-21T00:03:02.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.143+0000 7f3bfcff9700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 0x7f3be0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.143+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3bf006ae70 con 0x7f3c000aa750 2021-10-21T00:03:02.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.143+0000 7f3bff7fe700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 0x7f3be0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.143+0000 7f3bff7fe700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 0x7f3be0055ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3bf400b000 tx=0x7f3bf4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.147+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3bf0041ec0 con 0x7f3c000aa750 2021-10-21T00:03:02.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.275+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c00057350 con 0x7f3c000aa750 2021-10-21T00:03:02.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3bfcff9700 1 -- 172.21.15.41:0/2098894932 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f3bf0018030 con 0x7f3c000aa750 2021-10-21T00:03:02.283 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:02.284 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:02.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 msgr2=0x7f3be0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 0x7f3be0055ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3bf400b000 tx=0x7f3bf4006df0).stop 2021-10-21T00:03:02.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 msgr2=0x7f3c00147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3c000636d0 tx=0x7f3bf0007c00).stop 2021-10-21T00:03:02.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 shutdown_connections 2021-10-21T00:03:02.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3be0053610 0x7f3be0055ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c0014b350 0x7f3c00147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c000aa750 0x7f3c00147870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 --2- 172.21.15.41:0/2098894932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0005f9f0 0x7f3c000b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 >> 172.21.15.41:0/2098894932 conn(0x7f3c0005bca0 msgr2=0x7f3c0005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 shutdown_connections 2021-10-21T00:03:02.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.279+0000 7f3c05ab4700 1 -- 172.21.15.41:0/2098894932 wait complete. 2021-10-21T00:03:02.297 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-10-21T00:03:02.297 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:02.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 Processor -- start 2021-10-21T00:03:02.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- start start 2021-10-21T00:03:02.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ee405f9f0 0x7f0ee40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ee40b0730 0x7f0ee40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee405fdd0 con 0x7f0ee40b3150 2021-10-21T00:03:02.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee4140400 con 0x7f0ee405f9f0 2021-10-21T00:03:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40b27c0 con 0x7f0ee40b0730 2021-10-21T00:03:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ee405f9f0 0x7f0ee40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ee405f9f0 0x7f0ee40b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57720/0 (socket says 172.21.15.41:57720) 2021-10-21T00:03:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 -- 172.21.15.41:0/1461561398 learned_addr learned my addr 172.21.15.41:0/1461561398 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee3fff700 1 --2- 172.21.15.41:0/1461561398 >> v2:172.21.15.62:3300/0 conn(0x7f0ee40b0730 0x7f0ee40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 -- 172.21.15.41:0/1461561398 >> v2:172.21.15.62:3300/0 conn(0x7f0ee40b0730 msgr2=0x7f0ee40b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 --2- 172.21.15.41:0/1461561398 >> v2:172.21.15.62:3300/0 conn(0x7f0ee40b0730 0x7f0ee40b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 -- 172.21.15.41:0/1461561398 >> v1:172.21.15.41:6789/0 conn(0x7f0ee40b3150 legacy=0x7f0ee4142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 -- 172.21.15.41:0/1461561398 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40b35a0 con 0x7f0ee405f9f0 2021-10-21T00:03:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee8a20700 1 --2- 172.21.15.41:0/1461561398 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee405f9f0 0x7f0ee40b0e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0ee413f630 tx=0x7f0ecc006e50).ready entity=mon.0 client_cookie=c7be79e235713eb4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee37fe700 1 -- 172.21.15.41:0/1461561398 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc00d610 con 0x7f0ee405f9f0 2021-10-21T00:03:02.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee37fe700 1 -- 172.21.15.41:0/1461561398 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc000e90 con 0x7f0ee405f9f0 2021-10-21T00:03:02.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee37fe700 1 -- 172.21.15.41:0/1461561398 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc00d960 con 0x7f0ee405f9f0 2021-10-21T00:03:02.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- 172.21.15.41:0/1461561398 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee405f9f0 msgr2=0x7f0ee40b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/1461561398 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee405f9f0 0x7f0ee40b0e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0ee413f630 tx=0x7f0ecc006e50).stop 2021-10-21T00:03:02.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- 172.21.15.41:0/1461561398 shutdown_connections 2021-10-21T00:03:02.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/1461561398 >> v2:172.21.15.62:3300/0 conn(0x7f0ee40b0730 0x7f0ee40b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/1461561398 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee405f9f0 0x7f0ee40b0e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- 172.21.15.41:0/1461561398 >> 172.21.15.41:0/1461561398 conn(0x7f0ee40637b0 msgr2=0x7f0ee4063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- 172.21.15.41:0/1461561398 shutdown_connections 2021-10-21T00:03:02.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.395+0000 7f0ee9a22700 1 -- 172.21.15.41:0/1461561398 wait complete. 2021-10-21T00:03:02.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.399+0000 7f0ee9a22700 1 Processor -- start 2021-10-21T00:03:02.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.399+0000 7f0ee9a22700 1 -- start start 2021-10-21T00:03:02.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.399+0000 7f0ee9a22700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee405f9f0 0x7f0ee413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.399+0000 7f0ee9a22700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.399+0000 7f0ee9a22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40b3150 0x7f0ee4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4067750 con 0x7f0ee40b0730 2021-10-21T00:03:02.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4067210 con 0x7f0ee40b3150 2021-10-21T00:03:02.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40674b0 con 0x7f0ee405f9f0 2021-10-21T00:03:02.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57726/0 (socket says 172.21.15.41:57726) 2021-10-21T00:03:02.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 -- 172.21.15.41:0/3671194947 learned_addr learned my addr 172.21.15.41:0/3671194947 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee8a20700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee405f9f0 0x7f0ee413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9221700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40b3150 0x7f0ee4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 -- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee405f9f0 msgr2=0x7f0ee413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee405f9f0 0x7f0ee413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 -- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40b3150 msgr2=0x7f0ee4151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40b3150 0x7f0ee4151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 -- 172.21.15.41:0/3671194947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc00b1e0 con 0x7f0ee40b0730 2021-10-21T00:03:02.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee3fff700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0edc00c000 tx=0x7f0edc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc00c6a0 con 0x7f0ee40b0730 2021-10-21T00:03:02.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00c800 con 0x7f0ee40b0730 2021-10-21T00:03:02.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40665e0 con 0x7f0ee40b0730 2021-10-21T00:03:02.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc00cb60 con 0x7f0ee40b0730 2021-10-21T00:03:02.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee41519a0 con 0x7f0ee40b0730 2021-10-21T00:03:02.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4150f80 con 0x7f0ee40b0730 2021-10-21T00:03:02.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.403+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0edc022070 con 0x7f0ee40b0730 2021-10-21T00:03:02.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.407+0000 7f0ee1ffb700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 0x7f0ec8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.407+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0edc06c060 con 0x7f0ee40b0730 2021-10-21T00:03:02.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.407+0000 7f0ee8a20700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 0x7f0ec8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.407+0000 7f0ee8a20700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 0x7f0ec8055b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0ecc01a000 tx=0x7f0ecc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.411+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0edc0430b0 con 0x7f0ee40b0730 2021-10-21T00:03:02.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.539+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ee4140080 con 0x7f0ee40b0730 2021-10-21T00:03:02.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.539+0000 7f0ee1ffb700 1 -- 172.21.15.41:0/3671194947 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f0edc0466d0 con 0x7f0ee40b0730 2021-10-21T00:03:02.545 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:02.545 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:02.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 msgr2=0x7f0ec8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 0x7f0ec8055b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0ecc01a000 tx=0x7f0ecc014000).stop 2021-10-21T00:03:02.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 msgr2=0x7f0ee4137930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0edc00c000 tx=0x7f0edc0091d0).stop 2021-10-21T00:03:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 shutdown_connections 2021-10-21T00:03:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ec8053640 0x7f0ec8055b00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40b3150 0x7f0ee4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ee40b0730 0x7f0ee4137930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 --2- 172.21.15.41:0/3671194947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee405f9f0 0x7f0ee413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 >> 172.21.15.41:0/3671194947 conn(0x7f0ee40637b0 msgr2=0x7f0ee40b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 shutdown_connections 2021-10-21T00:03:02.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.543+0000 7f0ee9a22700 1 -- 172.21.15.41:0/3671194947 wait complete. 2021-10-21T00:03:02.567 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-10-21T00:03:02.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.671+0000 7f9ba8aa7700 1 Processor -- start 2021-10-21T00:03:02.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.671+0000 7f9ba8aa7700 1 -- start start 2021-10-21T00:03:02.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ba40b0890 0x7f9ba41435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ba40b35a0 0x7f9ba40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b2f00 con 0x7f9ba40b2b20 2021-10-21T00:03:02.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40b1360 con 0x7f9ba40b0890 2021-10-21T00:03:02.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40b1600 con 0x7f9ba40b35a0 2021-10-21T00:03:02.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ba40b0890 0x7f9ba41435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ba40b0890 0x7f9ba41435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57732/0 (socket says 172.21.15.41:57732) 2021-10-21T00:03:02.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 -- 172.21.15.41:0/204148812 learned_addr learned my addr 172.21.15.41:0/204148812 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba259c700 1 --1- 172.21.15.41:0/204148812 >> v1:172.21.15.41:6789/0 conn(0x7f9ba40b2b20 0x7f9ba4142eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55502/0 (socket says 172.21.15.41:55502) 2021-10-21T00:03:02.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba2d9d700 1 --2- 172.21.15.41:0/204148812 >> v2:172.21.15.62:3300/0 conn(0x7f9ba40b35a0 0x7f9ba40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 -- 172.21.15.41:0/204148812 >> v2:172.21.15.62:3300/0 conn(0x7f9ba40b35a0 msgr2=0x7f9ba40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/204148812 >> v2:172.21.15.62:3300/0 conn(0x7f9ba40b35a0 0x7f9ba40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 -- 172.21.15.41:0/204148812 >> v1:172.21.15.41:6789/0 conn(0x7f9ba40b2b20 legacy=0x7f9ba4142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba1d9b700 1 -- 172.21.15.41:0/204148812 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016154540 0 0) 0x7f9ba40b2f00 con 0x7f9ba40b2b20 2021-10-21T00:03:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 -- 172.21.15.41:0/204148812 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40b18a0 con 0x7f9ba40b0890 2021-10-21T00:03:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/204148812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b0890 0x7f9ba41435c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9b8c002f70 tx=0x7f9b8c006eb0).ready entity=mon.0 client_cookie=ebb94c3375922551 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba1d9b700 1 -- 172.21.15.41:0/204148812 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8c00d5c0 con 0x7f9ba40b0890 2021-10-21T00:03:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba1d9b700 1 -- 172.21.15.41:0/204148812 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c000e90 con 0x7f9ba40b0890 2021-10-21T00:03:02.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba1d9b700 1 -- 172.21.15.41:0/204148812 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8c00d910 con 0x7f9ba40b0890 2021-10-21T00:03:02.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/204148812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b0890 msgr2=0x7f9ba41435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/204148812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b0890 0x7f9ba41435c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9b8c002f70 tx=0x7f9b8c006eb0).stop 2021-10-21T00:03:02.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/204148812 shutdown_connections 2021-10-21T00:03:02.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/204148812 >> v2:172.21.15.62:3300/0 conn(0x7f9ba40b35a0 0x7f9ba40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/204148812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b0890 0x7f9ba41435c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/204148812 >> 172.21.15.41:0/204148812 conn(0x7f9ba40638b0 msgr2=0x7f9ba4063cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/204148812 shutdown_connections 2021-10-21T00:03:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.675+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/204148812 wait complete. 2021-10-21T00:03:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 Processor -- start 2021-10-21T00:03:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 -- start start 2021-10-21T00:03:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba40b0890 0x7f9ba413c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ba40b2b20 0x7f9ba41397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 0x7f9ba4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41553e0 con 0x7f9ba40b35a0 2021-10-21T00:03:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba413f7c0 con 0x7f9ba40b0890 2021-10-21T00:03:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba8aa7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4138960 con 0x7f9ba40b2b20 2021-10-21T00:03:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 0x7f9ba4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 0x7f9ba4155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57742/0 (socket says 172.21.15.41:57742) 2021-10-21T00:03:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 -- 172.21.15.41:0/715888012 learned_addr learned my addr 172.21.15.41:0/715888012 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba259c700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba40b0890 0x7f9ba413c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ba40b2b20 0x7f9ba41397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 -- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ba40b2b20 msgr2=0x7f9ba41397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ba40b2b20 0x7f9ba41397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 -- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba40b0890 msgr2=0x7f9ba413c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ba40b0890 0x7f9ba413c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c00b1e0 con 0x7f9ba40b35a0 2021-10-21T00:03:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ba40b2b20 0x7f9ba41397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.679+0000 7f9ba2d9d700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 0x7f9ba4155810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9b9c006e00 tx=0x7f9b9c00b470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b9c00dac0 con 0x7f9ba40b35a0 2021-10-21T00:03:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00dc20 con 0x7f9ba40b35a0 2021-10-21T00:03:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba4138c00 con 0x7f9ba40b35a0 2021-10-21T00:03:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b9c010440 con 0x7f9ba40b35a0 2021-10-21T00:03:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba413e0e0 con 0x7f9ba40b35a0 2021-10-21T00:03:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ba4155550 con 0x7f9ba40b35a0 2021-10-21T00:03:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b9c020070 con 0x7f9ba40b35a0 2021-10-21T00:03:02.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b88053520 0x7f9b880559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9b9c06c2b0 con 0x7f9ba40b35a0 2021-10-21T00:03:02.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7f9b8805a9b0 0x7f9b8805cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b8805d430 con 0x7f9b8805a9b0 2021-10-21T00:03:02.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9c06e940 con 0x7f9ba40b35a0 2021-10-21T00:03:02.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9ba259c700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b88053520 0x7f9b880559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7f9b8805a9b0 0x7f9b8805cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9b9bfff700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7f9b8805a9b0 0x7f9b8805cdd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.683+0000 7f9ba259c700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b88053520 0x7f9b880559e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9b9400d000 tx=0x7f9b94007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.687+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== osd.0 v2:172.21.15.41:6800/14347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f9b8805d430 con 0x7f9b8805a9b0 2021-10-21T00:03:02.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 --> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ba4155f40 con 0x7f9b8805a9b0 2021-10-21T00:03:02.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9b9b7fe700 1 -- 172.21.15.41:0/715888012 <== osd.0 v2:172.21.15.41:6800/14347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ba4155f40 con 0x7f9b8805a9b0 2021-10-21T00:03:02.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7f9b8805a9b0 msgr2=0x7f9b8805cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7f9b8805a9b0 0x7f9b8805cdd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b88053520 msgr2=0x7f9b880559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b88053520 0x7f9b880559e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9b9400d000 tx=0x7f9b94007a00).stop 2021-10-21T00:03:02.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 msgr2=0x7f9ba4155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 --2- 172.21.15.41:0/715888012 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ba40b35a0 0x7f9ba4155810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9b9c006e00 tx=0x7f9b9c00b470).stop 2021-10-21T00:03:02.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba2d9d700 1 -- 172.21.15.41:0/715888012 reap_dead start 2021-10-21T00:03:02.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 shutdown_connections 2021-10-21T00:03:02.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 >> 172.21.15.41:0/715888012 conn(0x7f9ba40638b0 msgr2=0x7f9ba40b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 shutdown_connections 2021-10-21T00:03:02.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.699+0000 7f9ba8aa7700 1 -- 172.21.15.41:0/715888012 wait complete. 2021-10-21T00:03:02.742 INFO:teuthology.orchestra.run.smithi041.stdout:55834574852 2021-10-21T00:03:02.742 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-10-21T00:03:02.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 Processor -- start 2021-10-21T00:03:02.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 -- start start 2021-10-21T00:03:02.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f304005bca0 0x7f304005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304014b140 con 0x7f30400b2730 2021-10-21T00:03:02.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304014aea0 con 0x7f30400b2e00 2021-10-21T00:03:02.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303f59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400ac9a0 con 0x7f304005bca0 2021-10-21T00:03:02.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f304005bca0 0x7f304005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303dd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f30400b2730 0x7f3040146c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55520/0 (socket says 172.21.15.41:55520) 2021-10-21T00:03:02.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f304005bca0 0x7f304005c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57748/0 (socket says 172.21.15.41:57748) 2021-10-21T00:03:02.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303dd9b700 1 -- 172.21.15.41:0/4002292297 learned_addr learned my addr 172.21.15.41:0/4002292297 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:02.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303d59a700 1 -- 172.21.15.41:0/4002292297 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451057312 0 0) 0x7f304014b140 con 0x7f30400b2730 2021-10-21T00:03:02.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 -- 172.21.15.41:0/4002292297 >> v1:172.21.15.62:6789/0 conn(0x7f30400b2e00 legacy=0x7f30400672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 -- 172.21.15.41:0/4002292297 >> v1:172.21.15.41:6789/0 conn(0x7f30400b2730 legacy=0x7f3040146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 -- 172.21.15.41:0/4002292297 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400679d0 con 0x7f304005bca0 2021-10-21T00:03:02.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303e59c700 1 --2- 172.21.15.41:0/4002292297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f304005bca0 0x7f304005c080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3028002f70 tx=0x7f3028006df0).ready entity=mon.0 client_cookie=63d5992ea922c197 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303d59a700 1 -- 172.21.15.41:0/4002292297 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302800d610 con 0x7f304005bca0 2021-10-21T00:03:02.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303d59a700 1 -- 172.21.15.41:0/4002292297 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028000e90 con 0x7f304005bca0 2021-10-21T00:03:02.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.851+0000 7f303d59a700 1 -- 172.21.15.41:0/4002292297 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302800d960 con 0x7f304005bca0 2021-10-21T00:03:02.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- 172.21.15.41:0/4002292297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f304005bca0 msgr2=0x7f304005c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 --2- 172.21.15.41:0/4002292297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f304005bca0 0x7f304005c080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3028002f70 tx=0x7f3028006df0).stop 2021-10-21T00:03:02.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- 172.21.15.41:0/4002292297 shutdown_connections 2021-10-21T00:03:02.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 --2- 172.21.15.41:0/4002292297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f304005bca0 0x7f304005c080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- 172.21.15.41:0/4002292297 >> 172.21.15.41:0/4002292297 conn(0x7f3040069df0 msgr2=0x7f3040063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- 172.21.15.41:0/4002292297 shutdown_connections 2021-10-21T00:03:02.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- 172.21.15.41:0/4002292297 wait complete. 2021-10-21T00:03:02.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 Processor -- start 2021-10-21T00:03:02.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.855+0000 7f303f59e700 1 -- start start 2021-10-21T00:03:02.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304005bca0 0x7f3040143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 0x7f30400ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400b2e00 0x7f30400ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040156770 con 0x7f30400b2730 2021-10-21T00:03:02.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040156a10 con 0x7f30400b2e00 2021-10-21T00:03:02.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040156cb0 con 0x7f304005bca0 2021-10-21T00:03:02.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 0x7f30400ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 0x7f30400ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57756/0 (socket says 172.21.15.41:57756) 2021-10-21T00:03:02.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 -- 172.21.15.41:0/2800635148 learned_addr learned my addr 172.21.15.41:0/2800635148 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:02.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303e59c700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304005bca0 0x7f3040143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303ed9d700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400b2e00 0x7f30400ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 -- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304005bca0 msgr2=0x7f3040143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f304005bca0 0x7f3040143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 -- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400b2e00 msgr2=0x7f30400ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30400b2e00 0x7f30400ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302800b180 con 0x7f30400b2730 2021-10-21T00:03:02.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303dd9b700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 0x7f30400ad420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3038000f40 tx=0x7f3038007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3038005c70 con 0x7f30400b2730 2021-10-21T00:03:02.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038005dd0 con 0x7f30400b2730 2021-10-21T00:03:02.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30380072c0 con 0x7f30400b2730 2021-10-21T00:03:02.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3040142f60 con 0x7f30400b2730 2021-10-21T00:03:02.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.859+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3040156260 con 0x7f30400b2730 2021-10-21T00:03:02.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30400ae140 con 0x7f30400b2730 2021-10-21T00:03:02.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3038010070 con 0x7f30400b2730 2021-10-21T00:03:02.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240534f0 0x7f30240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f303806b420 con 0x7f30400b2730 2021-10-21T00:03:02.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f302405a980 0x7f302405cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:02.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f302405d400 con 0x7f302405a980 2021-10-21T00:03:02.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303806dab0 con 0x7f30400b2730 2021-10-21T00:03:02.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f303e59c700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240534f0 0x7f30240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f303ed9d700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f302405a980 0x7f302405cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:02.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f303ed9d700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f302405a980 0x7f302405cda0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f303e59c700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240534f0 0x7f30240559b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f302801c000 tx=0x7f3028015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:02.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.863+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== osd.1 v2:172.21.15.41:6808/14348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f302405d400 con 0x7f302405a980 2021-10-21T00:03:02.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.879+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 --> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3040156e70 con 0x7f302405a980 2021-10-21T00:03:02.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f30377fe700 1 -- 172.21.15.41:0/2800635148 <== osd.1 v2:172.21.15.41:6808/14348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3040156e70 con 0x7f302405a980 2021-10-21T00:03:02.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f302405a980 msgr2=0x7f302405cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f302405a980 0x7f302405cda0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:02.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240534f0 msgr2=0x7f30240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30240534f0 0x7f30240559b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f302801c000 tx=0x7f3028015000).stop 2021-10-21T00:03:02.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 msgr2=0x7f30400ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:02.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 --2- 172.21.15.41:0/2800635148 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30400b2730 0x7f30400ad420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3038000f40 tx=0x7f3038007de0).stop 2021-10-21T00:03:02.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303ed9d700 1 -- 172.21.15.41:0/2800635148 reap_dead start 2021-10-21T00:03:02.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 shutdown_connections 2021-10-21T00:03:02.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 >> 172.21.15.41:0/2800635148 conn(0x7f3040069df0 msgr2=0x7f30400b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:02.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 shutdown_connections 2021-10-21T00:03:02.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:02.883+0000 7f303f59e700 1 -- 172.21.15.41:0/2800635148 wait complete. 2021-10-21T00:03:02.911 INFO:teuthology.orchestra.run.smithi041.stdout:55834574852 2021-10-21T00:03:02.912 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-10-21T00:03:03.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.019+0000 7feef20d5700 1 Processor -- start 2021-10-21T00:03:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.019+0000 7feef20d5700 1 -- start start 2021-10-21T00:03:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feeec0b0fe0 0x7feeec1433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec05c5f0 con 0x7feeec1469c0 2021-10-21T00:03:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec1438b0 con 0x7feeec066730 2021-10-21T00:03:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec146e50 con 0x7feeec0b0fe0 2021-10-21T00:03:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef18d4700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7feeec1469c0 0x7feeec12b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55538/0 (socket says 172.21.15.41:55538) 2021-10-21T00:03:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef18d4700 1 -- 172.21.15.41:0/1647344090 learned_addr learned my addr 172.21.15.41:0/1647344090 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef10d3700 1 --2- 172.21.15.41:0/1647344090 >> v2:172.21.15.62:3300/0 conn(0x7feeec0b0fe0 0x7feeec1433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feed7fff700 1 -- 172.21.15.41:0/1647344090 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154717912 0 0) 0x7feeec05c5f0 con 0x7feeec1469c0 2021-10-21T00:03:03.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feed7fff700 1 -- 172.21.15.41:0/1647344090 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed0003260 con 0x7feeec1469c0 2021-10-21T00:03:03.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef10d3700 1 -- 172.21.15.41:0/1647344090 >> v1:172.21.15.62:6789/0 conn(0x7feeec066730 legacy=0x7feeec1462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef10d3700 1 -- 172.21.15.41:0/1647344090 >> v1:172.21.15.41:6789/0 conn(0x7feeec1469c0 legacy=0x7feeec12b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef10d3700 1 -- 172.21.15.41:0/1647344090 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0b13c0 con 0x7feeec0b0fe0 2021-10-21T00:03:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef10d3700 1 --2- 172.21.15.41:0/1647344090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec1433c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7feee8002f70 tx=0x7feee8006df0).ready entity=mon.1 client_cookie=b35ff06df1c9a2d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feed7fff700 1 -- 172.21.15.41:0/1647344090 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee800d610 con 0x7feeec0b0fe0 2021-10-21T00:03:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feed7fff700 1 -- 172.21.15.41:0/1647344090 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8000e90 con 0x7feeec0b0fe0 2021-10-21T00:03:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feed7fff700 1 -- 172.21.15.41:0/1647344090 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee800d960 con 0x7feeec0b0fe0 2021-10-21T00:03:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- 172.21.15.41:0/1647344090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 msgr2=0x7feeec1433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 --2- 172.21.15.41:0/1647344090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec1433c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7feee8002f70 tx=0x7feee8006df0).stop 2021-10-21T00:03:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- 172.21.15.41:0/1647344090 shutdown_connections 2021-10-21T00:03:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 --2- 172.21.15.41:0/1647344090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec1433c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- 172.21.15.41:0/1647344090 >> 172.21.15.41:0/1647344090 conn(0x7feeec0649c0 msgr2=0x7feeec064dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- 172.21.15.41:0/1647344090 shutdown_connections 2021-10-21T00:03:03.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.023+0000 7feef20d5700 1 -- 172.21.15.41:0/1647344090 wait complete. 2021-10-21T00:03:03.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 Processor -- start 2021-10-21T00:03:03.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- start start 2021-10-21T00:03:03.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 0x7feeec144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeec1469c0 0x7feeec129ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec063180 con 0x7feeec066730 2021-10-21T00:03:03.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec12dc80 con 0x7feeec0b0fe0 2021-10-21T00:03:03.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec143ed0 con 0x7feeec1469c0 2021-10-21T00:03:03.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 0x7feeec144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 0x7feeec144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57770/0 (socket says 172.21.15.41:57770) 2021-10-21T00:03:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 -- 172.21.15.41:0/3342459475 learned_addr learned my addr 172.21.15.41:0/3342459475 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef08d2700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef18d4700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeec1469c0 0x7feeec129ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 -- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeec1469c0 msgr2=0x7feeec129ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feeec1469c0 0x7feeec129ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 -- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 msgr2=0x7feeec144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feeec0b0fe0 0x7feeec144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee800b180 con 0x7feeec066730 2021-10-21T00:03:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef10d3700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 0x7feeec144ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feee8002f70 tx=0x7feee8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8016070 con 0x7feeec066730 2021-10-21T00:03:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800de90 con 0x7feeec066730 2021-10-21T00:03:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec1454e0 con 0x7feeec066730 2021-10-21T00:03:03.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8013da0 con 0x7feeec066730 2021-10-21T00:03:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.027+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec12a3d0 con 0x7feeec066730 2021-10-21T00:03:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feeec05c820 con 0x7feeec066730 2021-10-21T00:03:03.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feee8024030 con 0x7feeec066730 2021-10-21T00:03:03.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feec8053610 0x7feec8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feee806c640 con 0x7feeec066730 2021-10-21T00:03:03.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feef08d2700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feec8053610 0x7feec8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7feec805aa00 0x7feec805ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feec805d3e0 con 0x7feec805aa00 2021-10-21T00:03:03.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee806ebc0 con 0x7feeec066730 2021-10-21T00:03:03.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feef18d4700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7feec805aa00 0x7feec805ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feef18d4700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7feec805aa00 0x7feec805ce20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feef08d2700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feec8053610 0x7feec8055ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7feee000d000 tx=0x7feee0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.031+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== osd.2 v2:172.21.15.41:6823/14360 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7feec805d3e0 con 0x7feec805aa00 2021-10-21T00:03:03.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 --> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feeec057350 con 0x7feec805aa00 2021-10-21T00:03:03.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feedeffd700 1 -- 172.21.15.41:0/3342459475 <== osd.2 v2:172.21.15.41:6823/14360 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feeec057350 con 0x7feec805aa00 2021-10-21T00:03:03.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7feec805aa00 msgr2=0x7feec805ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7feec805aa00 0x7feec805ce20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feec8053610 msgr2=0x7feec8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feec8053610 0x7feec8055ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7feee000d000 tx=0x7feee0009040).stop 2021-10-21T00:03:03.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 msgr2=0x7feeec144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 --2- 172.21.15.41:0/3342459475 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feeec066730 0x7feeec144ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feee8002f70 tx=0x7feee8014000).stop 2021-10-21T00:03:03.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef18d4700 1 -- 172.21.15.41:0/3342459475 reap_dead start 2021-10-21T00:03:03.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 shutdown_connections 2021-10-21T00:03:03.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 >> 172.21.15.41:0/3342459475 conn(0x7feeec0649c0 msgr2=0x7feeec0b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 shutdown_connections 2021-10-21T00:03:03.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.051+0000 7feef20d5700 1 -- 172.21.15.41:0/3342459475 wait complete. 2021-10-21T00:03:03.069 INFO:teuthology.orchestra.run.smithi041.stdout:55834574852 2021-10-21T00:03:03.070 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-10-21T00:03:03.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.175+0000 7fc4e7fff700 1 Processor -- start 2021-10-21T00:03:03.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.175+0000 7fc4e7fff700 1 -- start start 2021-10-21T00:03:03.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 0x7fc4e8141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80ba000 con 0x7fc4e80b9c20 2021-10-21T00:03:03.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e8143bc0 con 0x7fc4e80b41a0 2021-10-21T00:03:03.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8142ad0 con 0x7fc4e80acd30 2021-10-21T00:03:03.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 0x7fc4e8141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48048/0 (socket says 172.21.15.41:48048) 2021-10-21T00:03:03.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 0x7fc4e8141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:41470/0 (socket says 172.21.15.41:41470) 2021-10-21T00:03:03.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 -- 172.21.15.41:0/2525381980 learned_addr learned my addr 172.21.15.41:0/2525381980 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 -- 172.21.15.41:0/2525381980 >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 msgr2=0x7fc4e8141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:03.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 --2- 172.21.15.41:0/2525381980 >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 0x7fc4e8141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 -- 172.21.15.41:0/2525381980 >> v1:172.21.15.62:6789/0 conn(0x7fc4e80b9c20 legacy=0x7fc4e81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 -- 172.21.15.41:0/2525381980 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8142d70 con 0x7fc4e80acd30 2021-10-21T00:03:03.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4dffff700 1 --2- 172.21.15.41:0/2525381980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc4d0002f70 tx=0x7fc4d0006eb0).ready entity=mon.2 client_cookie=926e9f476f7e02ea server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e67fc700 1 -- 172.21.15.41:0/2525381980 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4d000d570 con 0x7fc4e80acd30 2021-10-21T00:03:03.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e67fc700 1 -- 172.21.15.41:0/2525381980 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0000e90 con 0x7fc4e80acd30 2021-10-21T00:03:03.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e67fc700 1 -- 172.21.15.41:0/2525381980 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4d000d900 con 0x7fc4e80acd30 2021-10-21T00:03:03.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- 172.21.15.41:0/2525381980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 msgr2=0x7fc4e805c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/2525381980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc4d0002f70 tx=0x7fc4d0006eb0).stop 2021-10-21T00:03:03.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- 172.21.15.41:0/2525381980 shutdown_connections 2021-10-21T00:03:03.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/2525381980 >> v2:172.21.15.62:3300/0 conn(0x7fc4e80b41a0 0x7fc4e8141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/2525381980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80acd30 0x7fc4e805c860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- 172.21.15.41:0/2525381980 >> 172.21.15.41:0/2525381980 conn(0x7fc4e8062f00 msgr2=0x7fc4e80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- 172.21.15.41:0/2525381980 shutdown_connections 2021-10-21T00:03:03.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.179+0000 7fc4e7fff700 1 -- 172.21.15.41:0/2525381980 wait complete. 2021-10-21T00:03:03.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 Processor -- start 2021-10-21T00:03:03.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- start start 2021-10-21T00:03:03.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4e80acd30 0x7fc4e8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80b41a0 0x7fc4e8147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 0x7fc4e8152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8146c20 con 0x7fc4e80b9c20 2021-10-21T00:03:03.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8144840 con 0x7fc4e80acd30 2021-10-21T00:03:03.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e80ae990 con 0x7fc4e80b41a0 2021-10-21T00:03:03.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 0x7fc4e8152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 0x7fc4e8152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57790/0 (socket says 172.21.15.41:57790) 2021-10-21T00:03:03.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 -- 172.21.15.41:0/182442593 learned_addr learned my addr 172.21.15.41:0/182442593 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e6ffd700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4e80acd30 0x7fc4e8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4dffff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80b41a0 0x7fc4e8147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 -- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80b41a0 msgr2=0x7fc4e8147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4e80b41a0 0x7fc4e8147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 -- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4e80acd30 msgr2=0x7fc4e8144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4e80acd30 0x7fc4e8144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d000b1e0 con 0x7fc4e80b9c20 2021-10-21T00:03:03.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e77fe700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 0x7fc4e8152470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc4e0006e00 tx=0x7fc4e00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e0009620 con 0x7fc4e80b9c20 2021-10-21T00:03:03.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e8151d30 con 0x7fc4e80b9c20 2021-10-21T00:03:03.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000c850 con 0x7fc4e80b9c20 2021-10-21T00:03:03.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4e000cbb0 con 0x7fc4e80b9c20 2021-10-21T00:03:03.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.183+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e8147d60 con 0x7fc4e80b9c20 2021-10-21T00:03:03.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4e80b3630 con 0x7fc4e80b9c20 2021-10-21T00:03:03.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc4e0022070 con 0x7fc4e80b9c20 2021-10-21T00:03:03.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4cc0536a0 0x7fc4cc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc4e006c650 con 0x7fc4e80b9c20 2021-10-21T00:03:03.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7fc4cc05aa10 0x7fc4cc05ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4cc05d3f0 con 0x7fc4cc05aa10 2021-10-21T00:03:03.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e6ffd700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4cc0536a0 0x7fc4cc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4e006ca10 con 0x7fc4e80b9c20 2021-10-21T00:03:03.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4dffff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7fc4cc05aa10 0x7fc4cc05ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4e6ffd700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4cc0536a0 0x7fc4cc055b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc4d800b000 tx=0x7fc4d8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.187+0000 7fc4dffff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7fc4cc05aa10 0x7fc4cc05ce30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.191+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== osd.3 v2:172.21.15.41:6816/14357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fc4cc05d3f0 con 0x7fc4cc05aa10 2021-10-21T00:03:03.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.207+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 --> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4e81521d0 con 0x7fc4cc05aa10 2021-10-21T00:03:03.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.207+0000 7fc4e4ff9700 1 -- 172.21.15.41:0/182442593 <== osd.3 v2:172.21.15.41:6816/14357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4d000dcf0 con 0x7fc4cc05aa10 2021-10-21T00:03:03.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7fc4cc05aa10 msgr2=0x7fc4cc05ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7fc4cc05aa10 0x7fc4cc05ce30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4cc0536a0 msgr2=0x7fc4cc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4cc0536a0 0x7fc4cc055b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc4d800b000 tx=0x7fc4d8009040).stop 2021-10-21T00:03:03.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 msgr2=0x7fc4e8152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 --2- 172.21.15.41:0/182442593 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4e80b9c20 0x7fc4e8152470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc4e0006e00 tx=0x7fc4e00091d0).stop 2021-10-21T00:03:03.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e77fe700 1 -- 172.21.15.41:0/182442593 reap_dead start 2021-10-21T00:03:03.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 shutdown_connections 2021-10-21T00:03:03.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 >> 172.21.15.41:0/182442593 conn(0x7fc4e8062f00 msgr2=0x7fc4e80b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 shutdown_connections 2021-10-21T00:03:03.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.211+0000 7fc4e7fff700 1 -- 172.21.15.41:0/182442593 wait complete. 2021-10-21T00:03:03.227 INFO:teuthology.orchestra.run.smithi041.stdout:55834574852 2021-10-21T00:03:03.228 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-10-21T00:03:03.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 Processor -- start 2021-10-21T00:03:03.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 -- start start 2021-10-21T00:03:03.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 0x7f99a0060d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f99a0146d40 0x7f99a0147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a005cf40 con 0x7f99a00b1800 2021-10-21T00:03:03.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a005d1e0 con 0x7f99a0146d40 2021-10-21T00:03:03.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a7e9f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0147e60 con 0x7f99a0060920 2021-10-21T00:03:03.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a543a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f99a00b1800 0x7f99a005c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55568/0 (socket says 172.21.15.41:55568) 2021-10-21T00:03:03.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a543a700 1 -- 172.21.15.41:0/2257432878 learned_addr learned my addr 172.21.15.41:0/2257432878 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/2257432878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 0x7f99a0060d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a643c700 1 --2- 172.21.15.41:0/2257432878 >> v2:172.21.15.62:3300/0 conn(0x7f99a0146d40 0x7f99a0147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a4c39700 1 -- 172.21.15.41:0/2257432878 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258639052 0 0) 0x7f99a005cf40 con 0x7f99a00b1800 2021-10-21T00:03:03.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a4c39700 1 -- 172.21.15.41:0/2257432878 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9988003260 con 0x7f99a00b1800 2021-10-21T00:03:03.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 -- 172.21.15.41:0/2257432878 >> v2:172.21.15.62:3300/0 conn(0x7f99a0146d40 msgr2=0x7f99a0147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:03.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/2257432878 >> v2:172.21.15.62:3300/0 conn(0x7f99a0146d40 0x7f99a0147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 -- 172.21.15.41:0/2257432878 >> v1:172.21.15.41:6789/0 conn(0x7f99a00b1800 legacy=0x7f99a005c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 -- 172.21.15.41:0/2257432878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0147fd0 con 0x7f99a0060920 2021-10-21T00:03:03.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/2257432878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 0x7f99a0060d00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9990002f70 tx=0x7f9990006df0).ready entity=mon.2 client_cookie=b0af1e09af004dab server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a4c39700 1 -- 172.21.15.41:0/2257432878 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999000d4a0 con 0x7f99a0060920 2021-10-21T00:03:03.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a4c39700 1 -- 172.21.15.41:0/2257432878 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990000e90 con 0x7f99a0060920 2021-10-21T00:03:03.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.335+0000 7f99a4c39700 1 -- 172.21.15.41:0/2257432878 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999000d7f0 con 0x7f99a0060920 2021-10-21T00:03:03.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- 172.21.15.41:0/2257432878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 msgr2=0x7f99a0060d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/2257432878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 0x7f99a0060d00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f9990002f70 tx=0x7f9990006df0).stop 2021-10-21T00:03:03.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- 172.21.15.41:0/2257432878 shutdown_connections 2021-10-21T00:03:03.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/2257432878 >> v2:172.21.15.62:3300/0 conn(0x7f99a0146d40 0x7f99a0147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/2257432878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0060920 0x7f99a0060d00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- 172.21.15.41:0/2257432878 >> 172.21.15.41:0/2257432878 conn(0x7f99a0063b70 msgr2=0x7f99a0060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- 172.21.15.41:0/2257432878 shutdown_connections 2021-10-21T00:03:03.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- 172.21.15.41:0/2257432878 wait complete. 2021-10-21T00:03:03.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 Processor -- start 2021-10-21T00:03:03.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- start start 2021-10-21T00:03:03.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 0x7f99a00666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99a00b1800 0x7f99a0066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0146d40 0x7f99a0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0065410 con 0x7f99a0060920 2021-10-21T00:03:03.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009e4d0 con 0x7f99a00b1800 2021-10-21T00:03:03.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a7e9f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0064a90 con 0x7f99a0146d40 2021-10-21T00:03:03.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a5c3b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 0x7f99a00666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a5c3b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 0x7f99a00666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57802/0 (socket says 172.21.15.41:57802) 2021-10-21T00:03:03.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.339+0000 7f99a5c3b700 1 -- 172.21.15.41:0/1151860036 learned_addr learned my addr 172.21.15.41:0/1151860036 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a643c700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0146d40 0x7f99a0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a543a700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99a00b1800 0x7f99a0066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 -- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0146d40 msgr2=0x7f99a0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0146d40 0x7f99a0143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 -- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99a00b1800 msgr2=0x7f99a0066bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99a00b1800 0x7f99a0066bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999000b180 con 0x7f99a0060920 2021-10-21T00:03:03.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a643c700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99a0146d40 0x7f99a0143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:03.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a5c3b700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 0x7f99a00666d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9990002f70 tx=0x7f9990014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9990016070 con 0x7f99a0060920 2021-10-21T00:03:03.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900138d0 con 0x7f99a0060920 2021-10-21T00:03:03.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a0064d30 con 0x7f99a0060920 2021-10-21T00:03:03.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9990013c30 con 0x7f99a0060920 2021-10-21T00:03:03.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0065ce0 con 0x7f99a0060920 2021-10-21T00:03:03.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99a0064910 con 0x7f99a0060920 2021-10-21T00:03:03.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9990025030 con 0x7f99a0060920 2021-10-21T00:03:03.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f99800535b0 0x7f9980055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.343+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f999006cda0 con 0x7f99a0060920 2021-10-21T00:03:03.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f99a543a700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f99800535b0 0x7f9980055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f998effd700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f998005a9a0 0x7f998005cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f998005d420 con 0x7f998005a9a0 2021-10-21T00:03:03.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f999006d180 con 0x7f99a0060920 2021-10-21T00:03:03.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f99a643c700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f998005a9a0 0x7f998005cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f99a543a700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f99800535b0 0x7f9980055a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f999c00d000 tx=0x7f999c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f99a643c700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f998005a9a0 0x7f998005cdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.347+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== osd.4 v2:172.21.15.62:6814/14810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f998005d420 con 0x7f998005a9a0 2021-10-21T00:03:03.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.363+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 --> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99a00b2360 con 0x7f998005a9a0 2021-10-21T00:03:03.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.363+0000 7f998effd700 1 -- 172.21.15.41:0/1151860036 <== osd.4 v2:172.21.15.62:6814/14810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99a00b2360 con 0x7f998005a9a0 2021-10-21T00:03:03.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f998005a9a0 msgr2=0x7f998005cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f998005a9a0 0x7f998005cdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f99800535b0 msgr2=0x7f9980055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f99800535b0 0x7f9980055a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f999c00d000 tx=0x7f999c009040).stop 2021-10-21T00:03:03.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 msgr2=0x7f99a00666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 --2- 172.21.15.41:0/1151860036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99a0060920 0x7f99a00666d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9990002f70 tx=0x7f9990014000).stop 2021-10-21T00:03:03.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a643c700 1 -- 172.21.15.41:0/1151860036 reap_dead start 2021-10-21T00:03:03.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 shutdown_connections 2021-10-21T00:03:03.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 >> 172.21.15.41:0/1151860036 conn(0x7f99a0063b70 msgr2=0x7f99a0147280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 shutdown_connections 2021-10-21T00:03:03.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.367+0000 7f99a7e9f700 1 -- 172.21.15.41:0/1151860036 wait complete. 2021-10-21T00:03:03.388 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:03.389 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-10-21T00:03:03.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 Processor -- start 2021-10-21T00:03:03.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- start start 2021-10-21T00:03:03.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d800b9c20 0x7f6d800acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 0x7f6d800b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d800ba000 con 0x7f6d8005c860 2021-10-21T00:03:03.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d80143bc0 con 0x7f6d800b9c20 2021-10-21T00:03:03.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8005ccf0 con 0x7f6d800b41a0 2021-10-21T00:03:03.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d85274700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f6d8005c860 0x7f6d801434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55582/0 (socket says 172.21.15.41:55582) 2021-10-21T00:03:03.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d85274700 1 -- 172.21.15.41:0/3801640290 learned_addr learned my addr 172.21.15.41:0/3801640290 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 --2- 172.21.15.41:0/3801640290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 0x7f6d800b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d85a75700 1 --2- 172.21.15.41:0/3801640290 >> v2:172.21.15.62:3300/0 conn(0x7f6d800b9c20 0x7f6d800acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d84a73700 1 -- 172.21.15.41:0/3801640290 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508604440 0 0) 0x7f6d800ba000 con 0x7f6d8005c860 2021-10-21T00:03:03.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d84a73700 1 -- 172.21.15.41:0/3801640290 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d64003260 con 0x7f6d8005c860 2021-10-21T00:03:03.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 -- 172.21.15.41:0/3801640290 >> v2:172.21.15.62:3300/0 conn(0x7f6d800b9c20 msgr2=0x7f6d800acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:03.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 --2- 172.21.15.41:0/3801640290 >> v2:172.21.15.62:3300/0 conn(0x7f6d800b9c20 0x7f6d800acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 -- 172.21.15.41:0/3801640290 >> v1:172.21.15.41:6789/0 conn(0x7f6d8005c860 legacy=0x7f6d801434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 -- 172.21.15.41:0/3801640290 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80142ad0 con 0x7f6d800b41a0 2021-10-21T00:03:03.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86276700 1 --2- 172.21.15.41:0/3801640290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 0x7f6d800b45c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f6d780032f0 tx=0x7f6d780091d0).ready entity=mon.2 client_cookie=f9f531f639756749 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d84a73700 1 -- 172.21.15.41:0/3801640290 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7800b600 con 0x7f6d800b41a0 2021-10-21T00:03:03.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d84a73700 1 -- 172.21.15.41:0/3801640290 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7800b760 con 0x7f6d800b41a0 2021-10-21T00:03:03.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d84a73700 1 -- 172.21.15.41:0/3801640290 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7800b8d0 con 0x7f6d800b41a0 2021-10-21T00:03:03.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- 172.21.15.41:0/3801640290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 msgr2=0x7f6d800b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 --2- 172.21.15.41:0/3801640290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 0x7f6d800b45c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f6d780032f0 tx=0x7f6d780091d0).stop 2021-10-21T00:03:03.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- 172.21.15.41:0/3801640290 shutdown_connections 2021-10-21T00:03:03.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 --2- 172.21.15.41:0/3801640290 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d800b41a0 0x7f6d800b45c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 --2- 172.21.15.41:0/3801640290 >> v2:172.21.15.62:3300/0 conn(0x7f6d800b9c20 0x7f6d800acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- 172.21.15.41:0/3801640290 >> 172.21.15.41:0/3801640290 conn(0x7f6d80062f00 msgr2=0x7f6d800b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- 172.21.15.41:0/3801640290 shutdown_connections 2021-10-21T00:03:03.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.495+0000 7f6d86a77700 1 -- 172.21.15.41:0/3801640290 wait complete. 2021-10-21T00:03:03.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 Processor -- start 2021-10-21T00:03:03.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- start start 2021-10-21T00:03:03.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 0x7f6d80145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 0x7f6d80151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d800b9c20 0x7f6d801123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80112e50 con 0x7f6d800b41a0 2021-10-21T00:03:03.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80151df0 con 0x7f6d800b9c20 2021-10-21T00:03:03.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80112bb0 con 0x7f6d8005c860 2021-10-21T00:03:03.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85274700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 0x7f6d80151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 0x7f6d80145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85274700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 0x7f6d80151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57820/0 (socket says 172.21.15.41:57820) 2021-10-21T00:03:03.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 0x7f6d80145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48082/0 (socket says 172.21.15.41:48082) 2021-10-21T00:03:03.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85274700 1 -- 172.21.15.41:0/1945260056 learned_addr learned my addr 172.21.15.41:0/1945260056 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86276700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d800b9c20 0x7f6d801123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 -- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d800b9c20 msgr2=0x7f6d801123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d800b9c20 0x7f6d801123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 -- 172.21.15.41:0/1945260056 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 msgr2=0x7f6d80151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 0x7f6d80151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009470 con 0x7f6d8005c860 2021-10-21T00:03:03.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86276700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d800b9c20 0x7f6d801123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:03.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85274700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d800b41a0 0x7f6d80151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:03.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d85a75700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 0x7f6d80145ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6d800b2960 tx=0x7f6d7c006d90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7c0125e0 con 0x7f6d8005c860 2021-10-21T00:03:03.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c012740 con 0x7f6d8005c860 2021-10-21T00:03:03.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7c012aa0 con 0x7f6d8005c860 2021-10-21T00:03:03.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d80155020 con 0x7f6d8005c860 2021-10-21T00:03:03.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.499+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800afa60 con 0x7f6d8005c860 2021-10-21T00:03:03.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d801551b0 con 0x7f6d8005c860 2021-10-21T00:03:03.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d7c01b410 con 0x7f6d8005c860 2021-10-21T00:03:03.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d68053610 0x7f6d68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d7c06c1b0 con 0x7f6d8005c860 2021-10-21T00:03:03.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d85274700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d68053610 0x7f6d68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f6d6805aa00 0x7f6d6805ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d6805d3e0 con 0x7f6d6805aa00 2021-10-21T00:03:03.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7c06c480 con 0x7f6d8005c860 2021-10-21T00:03:03.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d86276700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f6d6805aa00 0x7f6d6805ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d85274700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d68053610 0x7f6d68055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6d7000d000 tx=0x7f6d70009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.503+0000 7f6d86276700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f6d6805aa00 0x7f6d6805ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.507+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== osd.5 v2:172.21.15.62:6802/14811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f6d6805d3e0 con 0x7f6d6805aa00 2021-10-21T00:03:03.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.523+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 --> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d80142d70 con 0x7f6d6805aa00 2021-10-21T00:03:03.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d76ffd700 1 -- 172.21.15.41:0/1945260056 <== osd.5 v2:172.21.15.62:6802/14811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6d80142d70 con 0x7f6d6805aa00 2021-10-21T00:03:03.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f6d6805aa00 msgr2=0x7f6d6805ce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f6d6805aa00 0x7f6d6805ce20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d68053610 msgr2=0x7f6d68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d68053610 0x7f6d68055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6d7000d000 tx=0x7f6d70009040).stop 2021-10-21T00:03:03.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 msgr2=0x7f6d80145ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 --2- 172.21.15.41:0/1945260056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d8005c860 0x7f6d80145ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6d800b2960 tx=0x7f6d7c006d90).stop 2021-10-21T00:03:03.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86276700 1 -- 172.21.15.41:0/1945260056 reap_dead start 2021-10-21T00:03:03.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 shutdown_connections 2021-10-21T00:03:03.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 >> 172.21.15.41:0/1945260056 conn(0x7f6d80062f00 msgr2=0x7f6d8013fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 shutdown_connections 2021-10-21T00:03:03.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.527+0000 7f6d86a77700 1 -- 172.21.15.41:0/1945260056 wait complete. 2021-10-21T00:03:03.548 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:03.549 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-10-21T00:03:03.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 Processor -- start 2021-10-21T00:03:03.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 -- start start 2021-10-21T00:03:03.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4c3805bca0 0x7f4c3805c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c38066490 con 0x7f4c38142880 2021-10-21T00:03:03.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c38145f60 con 0x7f4c380b2e00 2021-10-21T00:03:03.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c3c8bb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c38146db0 con 0x7f4c3805bca0 2021-10-21T00:03:03.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c377fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4c3805bca0 0x7f4c3805c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c37fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4c38142880 0x7f4c38065570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55600/0 (socket says 172.21.15.41:55600) 2021-10-21T00:03:03.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c37fff700 1 -- 172.21.15.41:0/2996152351 learned_addr learned my addr 172.21.15.41:0/2996152351 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c367fc700 1 -- 172.21.15.41:0/2996152351 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545346634 0 0) 0x7f4c38066490 con 0x7f4c38142880 2021-10-21T00:03:03.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c367fc700 1 -- 172.21.15.41:0/2996152351 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c18003260 con 0x7f4c38142880 2021-10-21T00:03:03.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c377fe700 1 -- 172.21.15.41:0/2996152351 >> v1:172.21.15.62:6789/0 conn(0x7f4c380b2e00 legacy=0x7f4c381466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c377fe700 1 -- 172.21.15.41:0/2996152351 >> v1:172.21.15.41:6789/0 conn(0x7f4c38142880 legacy=0x7f4c38065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.659+0000 7f4c377fe700 1 -- 172.21.15.41:0/2996152351 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c38146200 con 0x7f4c3805bca0 2021-10-21T00:03:03.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c377fe700 1 --2- 172.21.15.41:0/2996152351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c3805bca0 0x7f4c3805c080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4c28002f70 tx=0x7f4c28006df0).ready entity=mon.0 client_cookie=4de65f4ce75d49c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c367fc700 1 -- 172.21.15.41:0/2996152351 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c2800d610 con 0x7f4c3805bca0 2021-10-21T00:03:03.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c367fc700 1 -- 172.21.15.41:0/2996152351 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28000e90 con 0x7f4c3805bca0 2021-10-21T00:03:03.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c367fc700 1 -- 172.21.15.41:0/2996152351 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c2800d960 con 0x7f4c3805bca0 2021-10-21T00:03:03.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/2996152351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c3805bca0 msgr2=0x7f4c3805c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 --2- 172.21.15.41:0/2996152351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c3805bca0 0x7f4c3805c080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4c28002f70 tx=0x7f4c28006df0).stop 2021-10-21T00:03:03.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/2996152351 shutdown_connections 2021-10-21T00:03:03.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 --2- 172.21.15.41:0/2996152351 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c3805bca0 0x7f4c3805c080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/2996152351 >> 172.21.15.41:0/2996152351 conn(0x7f4c38069df0 msgr2=0x7f4c38063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/2996152351 shutdown_connections 2021-10-21T00:03:03.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/2996152351 wait complete. 2021-10-21T00:03:03.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 Processor -- start 2021-10-21T00:03:03.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.663+0000 7f4c3c8bb700 1 -- start start 2021-10-21T00:03:03.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c3805bca0 0x7f4c38143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 0x7f4c3812cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c38142880 0x7f4c3813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3813d150 con 0x7f4c380b2e00 2021-10-21T00:03:03.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3813d380 con 0x7f4c38142880 2021-10-21T00:03:03.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3812d780 con 0x7f4c3805bca0 2021-10-21T00:03:03.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 0x7f4c3812cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 0x7f4c3812cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57832/0 (socket says 172.21.15.41:57832) 2021-10-21T00:03:03.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 -- 172.21.15.41:0/930023911 learned_addr learned my addr 172.21.15.41:0/930023911 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c37fff700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c38142880 0x7f4c3813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c377fe700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c3805bca0 0x7f4c38143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 -- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c3805bca0 msgr2=0x7f4c38143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c3805bca0 0x7f4c38143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 -- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c38142880 msgr2=0x7f4c3813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c38142880 0x7f4c3813eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2800b180 con 0x7f4c380b2e00 2021-10-21T00:03:03.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c36ffd700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 0x7f4c3812cf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4c38062ea0 tx=0x7f4c20007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c20012400 con 0x7f4c380b2e00 2021-10-21T00:03:03.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20012560 con 0x7f4c380b2e00 2021-10-21T00:03:03.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3812d420 con 0x7f4c380b2e00 2021-10-21T00:03:03.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c200128c0 con 0x7f4c380b2e00 2021-10-21T00:03:03.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3813e0c0 con 0x7f4c380b2e00 2021-10-21T00:03:03.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c3813d580 con 0x7f4c380b2e00 2021-10-21T00:03:03.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.667+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c20019030 con 0x7f4c380b2e00 2021-10-21T00:03:03.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c1c0534f0 0x7f4c1c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c2006ad40 con 0x7f4c380b2e00 2021-10-21T00:03:03.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f4c1c05a980 0x7f4c1c05cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c1c05d400 con 0x7f4c1c05a980 2021-10-21T00:03:03.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c2006d2c0 con 0x7f4c380b2e00 2021-10-21T00:03:03.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c377fe700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c1c0534f0 0x7f4c1c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c37fff700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f4c1c05a980 0x7f4c1c05cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c377fe700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c1c0534f0 0x7f4c1c0559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4c2801a000 tx=0x7f4c28014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c37fff700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f4c1c05a980 0x7f4c1c05cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.671+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== osd.6 v2:172.21.15.62:6810/14812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f4c1c05d400 con 0x7f4c1c05a980 2021-10-21T00:03:03.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.691+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 --> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c38057350 con 0x7f4c1c05a980 2021-10-21T00:03:03.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.691+0000 7f4c34ff9700 1 -- 172.21.15.41:0/930023911 <== osd.6 v2:172.21.15.62:6810/14812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c38057350 con 0x7f4c1c05a980 2021-10-21T00:03:03.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f4c1c05a980 msgr2=0x7f4c1c05cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f4c1c05a980 0x7f4c1c05cda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c1c0534f0 msgr2=0x7f4c1c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c1c0534f0 0x7f4c1c0559b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4c2801a000 tx=0x7f4c28014000).stop 2021-10-21T00:03:03.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 msgr2=0x7f4c3812cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 --2- 172.21.15.41:0/930023911 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c380b2e00 0x7f4c3812cf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f4c38062ea0 tx=0x7f4c20007c50).stop 2021-10-21T00:03:03.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c37fff700 1 -- 172.21.15.41:0/930023911 reap_dead start 2021-10-21T00:03:03.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 shutdown_connections 2021-10-21T00:03:03.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 >> 172.21.15.41:0/930023911 conn(0x7f4c38069df0 msgr2=0x7f4c38129fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 shutdown_connections 2021-10-21T00:03:03.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.695+0000 7f4c3c8bb700 1 -- 172.21.15.41:0/930023911 wait complete. 2021-10-21T00:03:03.711 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:03.711 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-10-21T00:03:03.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 Processor -- start 2021-10-21T00:03:03.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 -- start start 2021-10-21T00:03:03.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 0x7f0a6c0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a6c0ae340 0x7f0a6c05c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c05ce40 con 0x7f0a6c0adec0 2021-10-21T00:03:03.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0ae7d0 con 0x7f0a6c0ae340 2021-10-21T00:03:03.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71b16700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b65b0 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a71315700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a6c0ae340 0x7f0a6c05c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a6c0adec0 0x7f0a6c05bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35436/0 (socket says 172.21.15.41:35436) 2021-10-21T00:03:03.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 0x7f0a6c0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6bfff700 1 -- 172.21.15.41:0/3171360140 learned_addr learned my addr 172.21.15.41:0/3171360140 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6b7fe700 1 -- 172.21.15.41:0/3171360140 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609328516 0 0) 0x7f0a6c05ce40 con 0x7f0a6c0adec0 2021-10-21T00:03:03.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6b7fe700 1 -- 172.21.15.41:0/3171360140 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a4c003260 con 0x7f0a6c0adec0 2021-10-21T00:03:03.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 -- 172.21.15.41:0/3171360140 >> v2:172.21.15.41:3300/0 conn(0x7f0a6c0ae340 msgr2=0x7f0a6c05c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:03.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 --2- 172.21.15.41:0/3171360140 >> v2:172.21.15.41:3300/0 conn(0x7f0a6c0ae340 0x7f0a6c05c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 -- 172.21.15.41:0/3171360140 >> v1:172.21.15.62:6789/0 conn(0x7f0a6c0adec0 legacy=0x7f0a6c05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 -- 172.21.15.41:0/3171360140 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0b02a0 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a70b14700 1 --2- 172.21.15.41:0/3171360140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 0x7f0a6c0b1a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54006df0).ready entity=mon.2 client_cookie=88205c1a687e8656 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6b7fe700 1 -- 172.21.15.41:0/3171360140 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5400d4a0 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6b7fe700 1 -- 172.21.15.41:0/3171360140 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54000e90 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.819+0000 7f0a6b7fe700 1 -- 172.21.15.41:0/3171360140 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5400d7f0 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- 172.21.15.41:0/3171360140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 msgr2=0x7f0a6c0b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- 172.21.15.41:0/3171360140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 0x7f0a6c0b1a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54006df0).stop 2021-10-21T00:03:03.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- 172.21.15.41:0/3171360140 shutdown_connections 2021-10-21T00:03:03.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- 172.21.15.41:0/3171360140 >> v2:172.21.15.41:3300/0 conn(0x7f0a6c0ae340 0x7f0a6c05c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- 172.21.15.41:0/3171360140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0b61d0 0x7f0a6c0b1a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- 172.21.15.41:0/3171360140 >> 172.21.15.41:0/3171360140 conn(0x7f0a6c063b80 msgr2=0x7f0a6c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- 172.21.15.41:0/3171360140 shutdown_connections 2021-10-21T00:03:03.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- 172.21.15.41:0/3171360140 wait complete. 2021-10-21T00:03:03.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 Processor -- start 2021-10-21T00:03:03.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- start start 2021-10-21T00:03:03.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 0x7f0a6c066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0ae340 0x7f0a6c144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6c0b61d0 0x7f0a6c145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c144b60 con 0x7f0a6c0adec0 2021-10-21T00:03:03.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c143ab0 con 0x7f0a6c0b61d0 2021-10-21T00:03:03.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71b16700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1441d0 con 0x7f0a6c0ae340 2021-10-21T00:03:03.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a70b14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 0x7f0a6c066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a70b14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 0x7f0a6c066910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57850/0 (socket says 172.21.15.41:57850) 2021-10-21T00:03:03.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a70b14700 1 -- 172.21.15.41:0/149308406 learned_addr learned my addr 172.21.15.41:0/149308406 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:03.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a6bfff700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0ae340 0x7f0a6c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.823+0000 7f0a71315700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6c0b61d0 0x7f0a6c145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 -- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0ae340 msgr2=0x7f0a6c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a6c0ae340 0x7f0a6c144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 -- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6c0b61d0 msgr2=0x7f0a6c145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a6c0b61d0 0x7f0a6c145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5400b180 con 0x7f0a6c0adec0 2021-10-21T00:03:03.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a70b14700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 0x7f0a6c066910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a540139c0 con 0x7f0a6c0adec0 2021-10-21T00:03:03.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54013b20 con 0x7f0a6c0adec0 2021-10-21T00:03:03.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c142ec0 con 0x7f0a6c0adec0 2021-10-21T00:03:03.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a54013e80 con 0x7f0a6c0adec0 2021-10-21T00:03:03.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c10eb10 con 0x7f0a6c0adec0 2021-10-21T00:03:03.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a6c143930 con 0x7f0a6c0adec0 2021-10-21T00:03:03.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a54025030 con 0x7f0a6c0adec0 2021-10-21T00:03:03.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a50053580 0x7f0a50055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.827+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a5406c620 con 0x7f0a6c0adec0 2021-10-21T00:03:03.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a69ffb700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f0a5005a970 0x7f0a5005cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a5005d3f0 con 0x7f0a5005a970 2021-10-21T00:03:03.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a6bfff700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a50053580 0x7f0a50055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5406ecb0 con 0x7f0a6c0adec0 2021-10-21T00:03:03.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a71315700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f0a5005a970 0x7f0a5005cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a6bfff700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a50053580 0x7f0a50055a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0a6400d000 tx=0x7f0a64009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a71315700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f0a5005a970 0x7f0a5005cd90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.831+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== osd.7 v2:172.21.15.62:6826/14821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f0a5005d3f0 con 0x7f0a5005a970 2021-10-21T00:03:03.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.847+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 --> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a6c146660 con 0x7f0a5005a970 2021-10-21T00:03:03.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a69ffb700 1 -- 172.21.15.41:0/149308406 <== osd.7 v2:172.21.15.62:6826/14821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a6c146660 con 0x7f0a5005a970 2021-10-21T00:03:03.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f0a5005a970 msgr2=0x7f0a5005cd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f0a5005a970 0x7f0a5005cd90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a50053580 msgr2=0x7f0a50055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a50053580 0x7f0a50055a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0a6400d000 tx=0x7f0a64009040).stop 2021-10-21T00:03:03.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 msgr2=0x7f0a6c066910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 --2- 172.21.15.41:0/149308406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a6c0adec0 0x7f0a6c066910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54014000).stop 2021-10-21T00:03:03.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71315700 1 -- 172.21.15.41:0/149308406 reap_dead start 2021-10-21T00:03:03.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 shutdown_connections 2021-10-21T00:03:03.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 >> 172.21.15.41:0/149308406 conn(0x7f0a6c063b80 msgr2=0x7f0a6c14cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:03.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 shutdown_connections 2021-10-21T00:03:03.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.851+0000 7f0a71b16700 1 -- 172.21.15.41:0/149308406 wait complete. 2021-10-21T00:03:03.875 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:03.876 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-10-21T00:03:03.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 Processor -- start 2021-10-21T00:03:03.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 -- start start 2021-10-21T00:03:03.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff9800aa750 0x7ff98014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff98014b350 0x7ff9800af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:03.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9800609d0 con 0x7ff98005f9f0 2021-10-21T00:03:03.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9800b1620 con 0x7ff98014b350 2021-10-21T00:03:03.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff98765f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98005fdd0 con 0x7ff9800aa750 2021-10-21T00:03:03.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff985bfc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff98014b350 0x7ff9800af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff9853fb700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff98005f9f0 0x7ff98014a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55628/0 (socket says 172.21.15.41:55628) 2021-10-21T00:03:03.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.987+0000 7ff9853fb700 1 -- 172.21.15.41:0/4271911992 learned_addr learned my addr 172.21.15.41:0/4271911992 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:03.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff984bfa700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff9800aa750 0x7ff98014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:03.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff985bfc700 1 -- 172.21.15.41:0/4271911992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff9800aa750 msgr2=0x7ff98014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:03.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff985bfc700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff9800aa750 0x7ff98014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:03.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff985bfc700 1 -- 172.21.15.41:0/4271911992 >> v1:172.21.15.41:6789/0 conn(0x7ff98005f9f0 legacy=0x7ff98014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:03.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff985bfc700 1 -- 172.21.15.41:0/4271911992 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800b1380 con 0x7ff98014b350 2021-10-21T00:03:03.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff977fff700 1 -- 172.21.15.41:0/4271911992 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163878276 0 0) 0x7ff9800609d0 con 0x7ff98005f9f0 2021-10-21T00:03:03.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff985bfc700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff98014b350 0x7ff9800af7c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff9780032f0 tx=0x7ff9780091d0).ready entity=mon.0 client_cookie=73c66eb98206ad1f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:03.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff977fff700 1 -- 172.21.15.41:0/4271911992 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97800b6c0 con 0x7ff98014b350 2021-10-21T00:03:03.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff977fff700 1 -- 172.21.15.41:0/4271911992 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800b820 con 0x7ff98014b350 2021-10-21T00:03:04.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff977fff700 1 -- 172.21.15.41:0/4271911992 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97800b990 con 0x7ff98014b350 2021-10-21T00:03:04.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 -- 172.21.15.41:0/4271911992 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff98014b350 msgr2=0x7ff9800af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:04.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff98014b350 0x7ff9800af7c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff9780032f0 tx=0x7ff9780091d0).stop 2021-10-21T00:03:04.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 -- 172.21.15.41:0/4271911992 shutdown_connections 2021-10-21T00:03:04.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff98014b350 0x7ff9800af7c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 --2- 172.21.15.41:0/4271911992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff9800aa750 0x7ff98014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 -- 172.21.15.41:0/4271911992 >> 172.21.15.41:0/4271911992 conn(0x7ff98005bca0 msgr2=0x7ff98005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:04.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 -- 172.21.15.41:0/4271911992 shutdown_connections 2021-10-21T00:03:04.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.991+0000 7ff98765f700 1 -- 172.21.15.41:0/4271911992 wait complete. 2021-10-21T00:03:04.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 Processor -- start 2021-10-21T00:03:04.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- start start 2021-10-21T00:03:04.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff98005f9f0 0x7ff980097e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:04.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:04.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff98014b350 0x7ff9800ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:04.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980098600 con 0x7ff9800aa750 2021-10-21T00:03:04.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980099580 con 0x7ff98005f9f0 2021-10-21T00:03:04.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800987f0 con 0x7ff98014b350 2021-10-21T00:03:04.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:04.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57866/0 (socket says 172.21.15.41:57866) 2021-10-21T00:03:04.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 -- 172.21.15.41:0/1653361352 learned_addr learned my addr 172.21.15.41:0/1653361352 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:04.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff9853fb700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff98005f9f0 0x7ff980097e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:04.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff985bfc700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff98014b350 0x7ff9800ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:04.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 -- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff98014b350 msgr2=0x7ff9800ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:04.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff98014b350 0x7ff9800ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 -- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff98005f9f0 msgr2=0x7ff980097e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:04.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff98005f9f0 0x7ff980097e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 -- 172.21.15.41:0/1653361352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff978009470 con 0x7ff9800aa750 2021-10-21T00:03:04.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff984bfa700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff97c00c000 tx=0x7ff97c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:04.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97c010780 con 0x7ff9800aa750 2021-10-21T00:03:04.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c0108e0 con 0x7ff9800aa750 2021-10-21T00:03:04.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9800997b0 con 0x7ff9800aa750 2021-10-21T00:03:04.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff97c010c40 con 0x7ff9800aa750 2021-10-21T00:03:04.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.995+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff980146690 con 0x7ff9800aa750 2021-10-21T00:03:04.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff97c01c460 con 0x7ff9800aa750 2021-10-21T00:03:04.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9800678f0 con 0x7ff9800aa750 2021-10-21T00:03:04.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff9767fc700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 0x7ff968055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:04.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff97c06bcb0 con 0x7ff9800aa750 2021-10-21T00:03:04.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff9853fb700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 0x7ff968055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:04.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:03.999+0000 7ff9853fb700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 0x7ff968055ad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff97000d000 tx=0x7ff970007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:04.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.003+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff97c042db0 con 0x7ff9800aa750 2021-10-21T00:03:04.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff980057350 con 0x7ff9800aa750 2021-10-21T00:03:04.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff9767fc700 1 -- 172.21.15.41:0/1653361352 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff97c0463d0 con 0x7ff9800aa750 2021-10-21T00:03:04.136 INFO:teuthology.orchestra.run.smithi041.stdout:55834574851 2021-10-21T00:03:04.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 msgr2=0x7ff968055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:04.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 0x7ff968055ad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff97000d000 tx=0x7ff970007a20).stop 2021-10-21T00:03:04.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 msgr2=0x7ff980147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:04.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff97c00c000 tx=0x7ff97c006df0).stop 2021-10-21T00:03:04.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 shutdown_connections 2021-10-21T00:03:04.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff968053610 0x7ff968055ad0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff98014b350 0x7ff9800ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff9800aa750 0x7ff980147180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 --2- 172.21.15.41:0/1653361352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff98005f9f0 0x7ff980097e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:04.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 >> 172.21.15.41:0/1653361352 conn(0x7ff98005bca0 msgr2=0x7ff9800b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:04.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 shutdown_connections 2021-10-21T00:03:04.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:04.127+0000 7ff98765f700 1 -- 172.21.15.41:0/1653361352 wait complete. 2021-10-21T00:03:04.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2021-10-21T00:03:05.152 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-10-21T00:03:05.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 Processor -- start 2021-10-21T00:03:05.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 -- start start 2021-10-21T00:03:05.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa0c05ef30 0x7faa0c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faa0c0af330 0x7faa0c062e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0b10c0 con 0x7faa0c141e30 2021-10-21T00:03:05.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0b08c0 con 0x7faa0c0af330 2021-10-21T00:03:05.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.259+0000 7faa10a53700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0afa70 con 0x7faa0c05ef30 2021-10-21T00:03:05.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faa0c0af330 0x7faa0c062e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faa0c0af330 0x7faa0c062e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57872/0 (socket says 172.21.15.41:57872) 2021-10-21T00:03:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 -- 172.21.15.41:0/2456866085 learned_addr learned my addr 172.21.15.41:0/2456866085 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0b7fe700 1 --2- 172.21.15.41:0/2456866085 >> v2:172.21.15.62:3300/0 conn(0x7faa0c05ef30 0x7faa0c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 -- 172.21.15.41:0/2456866085 >> v2:172.21.15.62:3300/0 conn(0x7faa0c05ef30 msgr2=0x7faa0c0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 --2- 172.21.15.41:0/2456866085 >> v2:172.21.15.62:3300/0 conn(0x7faa0c05ef30 0x7faa0c0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 -- 172.21.15.41:0/2456866085 >> v1:172.21.15.62:6789/0 conn(0x7faa0c141e30 legacy=0x7faa0c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 -- 172.21.15.41:0/2456866085 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0afd10 con 0x7faa0c0af330 2021-10-21T00:03:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0affd700 1 --2- 172.21.15.41:0/2456866085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c0af330 0x7faa0c062e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa9fc002f70 tx=0x7fa9fc006eb0).ready entity=mon.0 client_cookie=f0bf7eff155afbcb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0a7fc700 1 -- 172.21.15.41:0/2456866085 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc00fa10 con 0x7faa0c0af330 2021-10-21T00:03:05.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0a7fc700 1 -- 172.21.15.41:0/2456866085 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc000e90 con 0x7faa0c0af330 2021-10-21T00:03:05.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa0a7fc700 1 -- 172.21.15.41:0/2456866085 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc00fda0 con 0x7faa0c0af330 2021-10-21T00:03:05.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 -- 172.21.15.41:0/2456866085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c0af330 msgr2=0x7faa0c062e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 --2- 172.21.15.41:0/2456866085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c0af330 0x7faa0c062e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa9fc002f70 tx=0x7fa9fc006eb0).stop 2021-10-21T00:03:05.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 -- 172.21.15.41:0/2456866085 shutdown_connections 2021-10-21T00:03:05.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 --2- 172.21.15.41:0/2456866085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c0af330 0x7faa0c062e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 --2- 172.21.15.41:0/2456866085 >> v2:172.21.15.62:3300/0 conn(0x7faa0c05ef30 0x7faa0c0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 -- 172.21.15.41:0/2456866085 >> 172.21.15.41:0/2456866085 conn(0x7faa0c05bca0 msgr2=0x7faa0c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 -- 172.21.15.41:0/2456866085 shutdown_connections 2021-10-21T00:03:05.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.263+0000 7faa10a53700 1 -- 172.21.15.41:0/2456866085 wait complete. 2021-10-21T00:03:05.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 Processor -- start 2021-10-21T00:03:05.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- start start 2021-10-21T00:03:05.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 0x7faa0c0654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa0c141e30 0x7faa0c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c10e480 con 0x7faa0c05ef30 2021-10-21T00:03:05.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c142f40 con 0x7faa0c0af330 2021-10-21T00:03:05.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1431e0 con 0x7faa0c141e30 2021-10-21T00:03:05.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57878/0 (socket says 172.21.15.41:57878) 2021-10-21T00:03:05.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 -- 172.21.15.41:0/3129393999 learned_addr learned my addr 172.21.15.41:0/3129393999 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:05.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0affd700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 0x7faa0c0654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0bfff700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa0c141e30 0x7faa0c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 -- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa0c141e30 msgr2=0x7faa0c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa0c141e30 0x7faa0c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 -- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 msgr2=0x7faa0c0654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 0x7faa0c0654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 -- 172.21.15.41:0/3129393999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc00b1e0 con 0x7faa0c05ef30 2021-10-21T00:03:05.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0affd700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 0x7faa0c0654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:05.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa0b7fe700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7faa000030b0 tx=0x7faa00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa00011780 con 0x7faa0c05ef30 2021-10-21T00:03:05.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000118e0 con 0x7faa0c05ef30 2021-10-21T00:03:05.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c142bc0 con 0x7faa0c05ef30 2021-10-21T00:03:05.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa00011c40 con 0x7faa0c05ef30 2021-10-21T00:03:05.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.267+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c10e8b0 con 0x7faa0c05ef30 2021-10-21T00:03:05.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.271+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c142db0 con 0x7faa0c05ef30 2021-10-21T00:03:05.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.271+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa00012420 con 0x7faa0c05ef30 2021-10-21T00:03:05.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.271+0000 7faa08ff9700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 0x7fa9ec055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.271+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa0006b7f0 con 0x7faa0c05ef30 2021-10-21T00:03:05.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.271+0000 7faa0affd700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 0x7fa9ec055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.275+0000 7faa0affd700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 0x7fa9ec055a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa9fc01e000 tx=0x7fa9fc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.279+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa000427e0 con 0x7faa0c05ef30 2021-10-21T00:03:05.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.411+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa0c10e5c0 con 0x7faa0c05ef30 2021-10-21T00:03:05.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.411+0000 7faa08ff9700 1 -- 172.21.15.41:0/3129393999 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa00045e00 con 0x7faa0c05ef30 2021-10-21T00:03:05.420 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:05.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 msgr2=0x7fa9ec055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 0x7fa9ec055a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa9fc01e000 tx=0x7fa9fc017000).stop 2021-10-21T00:03:05.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 msgr2=0x7faa0c143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7faa000030b0 tx=0x7faa00008040).stop 2021-10-21T00:03:05.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 shutdown_connections 2021-10-21T00:03:05.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9ec053580 0x7fa9ec055a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa0c141e30 0x7faa0c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0c0af330 0x7faa0c0654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 --2- 172.21.15.41:0/3129393999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa0c05ef30 0x7faa0c143fe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 >> 172.21.15.41:0/3129393999 conn(0x7faa0c05bca0 msgr2=0x7faa0c141660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 shutdown_connections 2021-10-21T00:03:05.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.415+0000 7faa10a53700 1 -- 172.21.15.41:0/3129393999 wait complete. 2021-10-21T00:03:05.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.0 2021-10-21T00:03:05.437 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-10-21T00:03:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 Processor -- start 2021-10-21T00:03:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- start start 2021-10-21T00:03:05.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0680b2170 0x7fb0680ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680b0b50 con 0x7fb068067a80 2021-10-21T00:03:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680b2550 con 0x7fb0680af620 2021-10-21T00:03:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b0d90 con 0x7fb0680b2170 2021-10-21T00:03:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0680b2170 0x7fb0680ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0680b2170 0x7fb0680ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57888/0 (socket says 172.21.15.41:57888) 2021-10-21T00:03:05.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06e7d2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb068067a80 0x7fb068149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55658/0 (socket says 172.21.15.41:55658) 2021-10-21T00:03:05.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06d7d0700 1 --1- 172.21.15.41:0/1376777360 >> v1:172.21.15.62:6789/0 conn(0x7fb0680af620 0x7fb0680ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35480/0 (socket says 172.21.15.41:35480) 2021-10-21T00:03:05.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 -- 172.21.15.41:0/1376777360 learned_addr learned my addr 172.21.15.41:0/1376777360 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:05.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 -- 172.21.15.41:0/1376777360 >> v1:172.21.15.62:6789/0 conn(0x7fb0680af620 legacy=0x7fb0680ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 -- 172.21.15.41:0/1376777360 >> v1:172.21.15.41:6789/0 conn(0x7fb068067a80 legacy=0x7fb068149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 -- 172.21.15.41:0/1376777360 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b1030 con 0x7fb0680b2170 2021-10-21T00:03:05.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06dfd1700 1 --2- 172.21.15.41:0/1376777360 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0680b2170 0x7fb0680ab170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb0680aafa0 tx=0x7fb05c006eb0).ready entity=mon.0 client_cookie=f0dc0cbd3a242ed4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06cfcf700 1 -- 172.21.15.41:0/1376777360 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05c00d660 con 0x7fb0680b2170 2021-10-21T00:03:05.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06cfcf700 1 -- 172.21.15.41:0/1376777360 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c000e90 con 0x7fb0680b2170 2021-10-21T00:03:05.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06cfcf700 1 -- 172.21.15.41:0/1376777360 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05c00d9f0 con 0x7fb0680b2170 2021-10-21T00:03:05.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- 172.21.15.41:0/1376777360 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0680b2170 msgr2=0x7fb0680ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 --2- 172.21.15.41:0/1376777360 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0680b2170 0x7fb0680ab170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb0680aafa0 tx=0x7fb05c006eb0).stop 2021-10-21T00:03:05.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- 172.21.15.41:0/1376777360 shutdown_connections 2021-10-21T00:03:05.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 --2- 172.21.15.41:0/1376777360 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0680b2170 0x7fb0680ab170 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- 172.21.15.41:0/1376777360 >> 172.21.15.41:0/1376777360 conn(0x7fb0680b5700 msgr2=0x7fb0680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- 172.21.15.41:0/1376777360 shutdown_connections 2021-10-21T00:03:05.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.539+0000 7fb06efd3700 1 -- 172.21.15.41:0/1376777360 wait complete. 2021-10-21T00:03:05.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 Processor -- start 2021-10-21T00:03:05.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- start start 2021-10-21T00:03:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 0x7fb0681449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 0x7fb068144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068146e50 con 0x7fb068067a80 2021-10-21T00:03:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068156fe0 con 0x7fb0680b2170 2021-10-21T00:03:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680adfd0 con 0x7fb0680af620 2021-10-21T00:03:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57892/0 (socket says 172.21.15.41:57892) 2021-10-21T00:03:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 -- 172.21.15.41:0/391736686 learned_addr learned my addr 172.21.15.41:0/391736686 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06e7d2700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 0x7fb068144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06d7d0700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 0x7fb0681449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 -- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 msgr2=0x7fb0681449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 0x7fb0681449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 -- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 msgr2=0x7fb068144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 0x7fb068144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 -- 172.21.15.41:0/391736686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c00b1e0 con 0x7fb068067a80 2021-10-21T00:03:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06e7d2700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 0x7fb068144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06d7d0700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 0x7fb0681449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06dfd1700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb0680aafa0 tx=0x7fb05c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05c0068b0 con 0x7fb068067a80 2021-10-21T00:03:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c002f50 con 0x7fb068067a80 2021-10-21T00:03:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680ae250 con 0x7fb068067a80 2021-10-21T00:03:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb05c01e460 con 0x7fb068067a80 2021-10-21T00:03:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.543+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680ae6f0 con 0x7fb068067a80 2021-10-21T00:03:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb05c025030 con 0x7fb068067a80 2021-10-21T00:03:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb068157150 con 0x7fb068067a80 2021-10-21T00:03:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb05affd700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 0x7fb050055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb05c06ce90 con 0x7fb068067a80 2021-10-21T00:03:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb06d7d0700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 0x7fb050055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.547+0000 7fb06d7d0700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 0x7fb050055ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb060008000 tx=0x7fb060009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.551+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb068157150 con 0x7fb068067a80 2021-10-21T00:03:05.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb068145690 con 0x7fb068067a80 2021-10-21T00:03:05.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb05affd700 1 -- 172.21.15.41:0/391736686 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb05c06e020 con 0x7fb068067a80 2021-10-21T00:03:05.688 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:05.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 msgr2=0x7fb050055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 0x7fb050055ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb060008000 tx=0x7fb060009040).stop 2021-10-21T00:03:05.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 msgr2=0x7fb0680ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb0680aafa0 tx=0x7fb05c015000).stop 2021-10-21T00:03:05.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 shutdown_connections 2021-10-21T00:03:05.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb050053610 0x7fb050055ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0680b2170 0x7fb068144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0680af620 0x7fb0681449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 --2- 172.21.15.41:0/391736686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb068067a80 0x7fb0680ac750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 >> 172.21.15.41:0/391736686 conn(0x7fb0680b5700 msgr2=0x7fb0680b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 shutdown_connections 2021-10-21T00:03:05.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.679+0000 7fb06efd3700 1 -- 172.21.15.41:0/391736686 wait complete. 2021-10-21T00:03:05.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2021-10-21T00:03:05.702 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-10-21T00:03:05.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.795+0000 7fbb14f12700 1 Processor -- start 2021-10-21T00:03:05.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.795+0000 7fbb14f12700 1 -- start start 2021-10-21T00:03:05.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 0x7fbb101461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb1005c6b0 0x7fbb10141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1005c3c0 con 0x7fbb10067a00 2021-10-21T00:03:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb100b1920 con 0x7fbb1005c6b0 2021-10-21T00:03:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb100b27a0 con 0x7fbb1005bfe0 2021-10-21T00:03:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb10067a00 0x7fbb101466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35496/0 (socket says 172.21.15.41:35496) 2021-10-21T00:03:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0effd700 1 -- 172.21.15.41:0/1890816852 learned_addr learned my addr 172.21.15.41:0/1890816852 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/1890816852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 0x7fbb101461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0ffff700 1 --2- 172.21.15.41:0/1890816852 >> v2:172.21.15.62:3300/0 conn(0x7fbb1005c6b0 0x7fbb10141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0e7fc700 1 -- 172.21.15.41:0/1890816852 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781283644 0 0) 0x7fbb1005c3c0 con 0x7fbb10067a00 2021-10-21T00:03:05.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0e7fc700 1 -- 172.21.15.41:0/1890816852 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbafc003260 con 0x7fbb10067a00 2021-10-21T00:03:05.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/1890816852 >> v2:172.21.15.62:3300/0 conn(0x7fbb1005c6b0 msgr2=0x7fbb10141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:05.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/1890816852 >> v2:172.21.15.62:3300/0 conn(0x7fbb1005c6b0 0x7fbb10141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/1890816852 >> v1:172.21.15.62:6789/0 conn(0x7fbb10067a00 legacy=0x7fbb101466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/1890816852 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb100b2a40 con 0x7fbb1005bfe0 2021-10-21T00:03:05.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/1890816852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 0x7fbb101461c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00006d90).ready entity=mon.2 client_cookie=3412d837b217e0e7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0e7fc700 1 -- 172.21.15.41:0/1890816852 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb0000e590 con 0x7fbb1005bfe0 2021-10-21T00:03:05.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0e7fc700 1 -- 172.21.15.41:0/1890816852 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00000e90 con 0x7fbb1005bfe0 2021-10-21T00:03:05.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb0e7fc700 1 -- 172.21.15.41:0/1890816852 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb0000e8e0 con 0x7fbb1005bfe0 2021-10-21T00:03:05.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- 172.21.15.41:0/1890816852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 msgr2=0x7fbb101461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 --2- 172.21.15.41:0/1890816852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 0x7fbb101461c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00006d90).stop 2021-10-21T00:03:05.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- 172.21.15.41:0/1890816852 shutdown_connections 2021-10-21T00:03:05.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 --2- 172.21.15.41:0/1890816852 >> v2:172.21.15.62:3300/0 conn(0x7fbb1005c6b0 0x7fbb10141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 --2- 172.21.15.41:0/1890816852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb1005bfe0 0x7fbb101461c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- 172.21.15.41:0/1890816852 >> 172.21.15.41:0/1890816852 conn(0x7fbb100637b0 msgr2=0x7fbb10063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- 172.21.15.41:0/1890816852 shutdown_connections 2021-10-21T00:03:05.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.799+0000 7fbb14f12700 1 -- 172.21.15.41:0/1890816852 wait complete. 2021-10-21T00:03:05.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 Processor -- start 2021-10-21T00:03:05.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- start start 2021-10-21T00:03:05.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb1005c6b0 0x7fbb101519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb10067a00 0x7fbb10144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10144710 con 0x7fbb1005c6b0 2021-10-21T00:03:05.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10113470 con 0x7fbb1005bfe0 2021-10-21T00:03:05.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10144940 con 0x7fbb10067a00 2021-10-21T00:03:05.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb1005c6b0 0x7fbb101519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:41592/0 (socket says 172.21.15.41:41592) 2021-10-21T00:03:05.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/2649292841 learned_addr learned my addr 172.21.15.41:0/2649292841 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:05.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0ffff700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb10067a00 0x7fbb10144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb10067a00 msgr2=0x7fbb10144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb10067a00 0x7fbb10144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/2649292841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb1005c6b0 msgr2=0x7fbb101519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb1005c6b0 0x7fbb101519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 -- 172.21.15.41:0/2649292841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0000b120 con 0x7fbb1005bfe0 2021-10-21T00:03:05.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0f7fe700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb00006020 con 0x7fbb1005bfe0 2021-10-21T00:03:05.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00006180 con 0x7fbb1005bfe0 2021-10-21T00:03:05.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb10113710 con 0x7fbb1005bfe0 2021-10-21T00:03:05.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb000064e0 con 0x7fbb1005bfe0 2021-10-21T00:03:05.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.803+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb101520e0 con 0x7fbb1005bfe0 2021-10-21T00:03:05.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb10144b00 con 0x7fbb1005bfe0 2021-10-21T00:03:05.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb00022030 con 0x7fbb1005bfe0 2021-10-21T00:03:05.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb0cff9700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 0x7fbaf0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:05.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb0006bd10 con 0x7fbb1005bfe0 2021-10-21T00:03:05.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb0effd700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 0x7fbaf0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:05.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.807+0000 7fbb0effd700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 0x7fbaf0055b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbb0400d000 tx=0x7fbb04009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:05.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.815+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb00071020 con 0x7fbb1005bfe0 2021-10-21T00:03:05.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.935+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb100b11e0 con 0x7fbb1005bfe0 2021-10-21T00:03:05.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb0cff9700 1 -- 172.21.15.41:0/2649292841 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb00042d60 con 0x7fbb1005bfe0 2021-10-21T00:03:05.955 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 msgr2=0x7fbaf0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 0x7fbaf0055b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbb0400d000 tx=0x7fbb04009040).stop 2021-10-21T00:03:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 msgr2=0x7fbb10140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fbb00002f70 tx=0x7fbb00014000).stop 2021-10-21T00:03:05.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 shutdown_connections 2021-10-21T00:03:05.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbaf0053640 0x7fbaf0055b00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb10067a00 0x7fbb10144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb1005c6b0 0x7fbb101519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 --2- 172.21.15.41:0/2649292841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb1005bfe0 0x7fbb10140800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:05.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 >> 172.21.15.41:0/2649292841 conn(0x7fbb100637b0 msgr2=0x7fbb100b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:05.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 shutdown_connections 2021-10-21T00:03:05.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:05.939+0000 7fbb14f12700 1 -- 172.21.15.41:0/2649292841 wait complete. 2021-10-21T00:03:05.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2021-10-21T00:03:05.969 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-10-21T00:03:06.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 Processor -- start 2021-10-21T00:03:06.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 -- start start 2021-10-21T00:03:06.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f672409a990 0x7f6724098fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f67240aaaa0 0x7f6724099490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67240aa290 con 0x7f67240b0c10 2021-10-21T00:03:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67240b0ff0 con 0x7f67240aaaa0 2021-10-21T00:03:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672c784700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67240aa4f0 con 0x7f672409a990 2021-10-21T00:03:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672ad21700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f67240aaaa0 0x7f6724099490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672a520700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f67240b0c10 0x7f67240ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55684/0 (socket says 172.21.15.41:55684) 2021-10-21T00:03:06.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f672a520700 1 -- 172.21.15.41:0/2726859301 learned_addr learned my addr 172.21.15.41:0/2726859301 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:06.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.067+0000 7f6729d1f700 1 --2- 172.21.15.41:0/2726859301 >> v2:172.21.15.62:3300/0 conn(0x7f672409a990 0x7f6724098fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672ad21700 1 -- 172.21.15.41:0/2726859301 >> v2:172.21.15.62:3300/0 conn(0x7f672409a990 msgr2=0x7f6724098fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:06.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672ad21700 1 --2- 172.21.15.41:0/2726859301 >> v2:172.21.15.62:3300/0 conn(0x7f672409a990 0x7f6724098fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672ad21700 1 -- 172.21.15.41:0/2726859301 >> v1:172.21.15.41:6789/0 conn(0x7f67240b0c10 legacy=0x7f67240ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672951e700 1 -- 172.21.15.41:0/2726859301 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365228670 0 0) 0x7f67240aa290 con 0x7f67240b0c10 2021-10-21T00:03:06.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672ad21700 1 -- 172.21.15.41:0/2726859301 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67240aaf70 con 0x7f67240aaaa0 2021-10-21T00:03:06.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672ad21700 1 --2- 172.21.15.41:0/2726859301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f6724099490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f671c0032f0 tx=0x7f671c0091d0).ready entity=mon.0 client_cookie=2a6e7408c94e92c7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672951e700 1 -- 172.21.15.41:0/2726859301 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c00b680 con 0x7f67240aaaa0 2021-10-21T00:03:06.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672951e700 1 -- 172.21.15.41:0/2726859301 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c00b7e0 con 0x7f67240aaaa0 2021-10-21T00:03:06.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672951e700 1 -- 172.21.15.41:0/2726859301 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c00b950 con 0x7f67240aaaa0 2021-10-21T00:03:06.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- 172.21.15.41:0/2726859301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 msgr2=0x7f6724099490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 --2- 172.21.15.41:0/2726859301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f6724099490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f671c0032f0 tx=0x7f671c0091d0).stop 2021-10-21T00:03:06.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- 172.21.15.41:0/2726859301 shutdown_connections 2021-10-21T00:03:06.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 --2- 172.21.15.41:0/2726859301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f6724099490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 --2- 172.21.15.41:0/2726859301 >> v2:172.21.15.62:3300/0 conn(0x7f672409a990 0x7f6724098fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- 172.21.15.41:0/2726859301 >> 172.21.15.41:0/2726859301 conn(0x7f672405bca0 msgr2=0x7f672405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- 172.21.15.41:0/2726859301 shutdown_connections 2021-10-21T00:03:06.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- 172.21.15.41:0/2726859301 wait complete. 2021-10-21T00:03:06.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 Processor -- start 2021-10-21T00:03:06.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.071+0000 7f672c784700 1 -- start start 2021-10-21T00:03:06.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 0x7f6724152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67240b0c10 0x7f6724065f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724066b70 con 0x7f67240aaaa0 2021-10-21T00:03:06.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672408fad0 con 0x7f672409a990 2021-10-21T00:03:06.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6724066410 con 0x7f67240b0c10 2021-10-21T00:03:06.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f6729d1f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 0x7f6724152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f6729d1f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57922/0 (socket says 172.21.15.41:57922) 2021-10-21T00:03:06.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f6729d1f700 1 -- 172.21.15.41:0/2531874977 learned_addr learned my addr 172.21.15.41:0/2531874977 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672ad21700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67240b0c10 0x7f6724065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 -- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67240b0c10 msgr2=0x7f6724065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67240b0c10 0x7f6724065f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 -- 172.21.15.41:0/2531874977 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 msgr2=0x7f67240aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 -- 172.21.15.41:0/2531874977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009470 con 0x7f672409a990 2021-10-21T00:03:06.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f6729d1f700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:06.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672a520700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 0x7f6724152790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6720000ed0 tx=0x7f6720007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720001d50 con 0x7f672409a990 2021-10-21T00:03:06.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724066630 con 0x7f672409a990 2021-10-21T00:03:06.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67200070d0 con 0x7f672409a990 2021-10-21T00:03:06.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720007430 con 0x7f672409a990 2021-10-21T00:03:06.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67240659c0 con 0x7f672409a990 2021-10-21T00:03:06.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67240667c0 con 0x7f672409a990 2021-10-21T00:03:06.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.075+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6720010070 con 0x7f672409a990 2021-10-21T00:03:06.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.079+0000 7f67137fe700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 0x7f6704055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.079+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f672006aea0 con 0x7f672409a990 2021-10-21T00:03:06.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.079+0000 7f6729d1f700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 0x7f6704055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.079+0000 7f6729d1f700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 0x7f6704055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f671400b000 tx=0x7f6714006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.087+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6720041f60 con 0x7f672409a990 2021-10-21T00:03:06.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.219+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f67240a9fb0 con 0x7f672409a990 2021-10-21T00:03:06.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.219+0000 7f67137fe700 1 -- 172.21.15.41:0/2531874977 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6720045580 con 0x7f672409a990 2021-10-21T00:03:06.229 INFO:teuthology.orchestra.run.smithi041.stdout:55834574853 2021-10-21T00:03:06.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 msgr2=0x7f6704055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 0x7f6704055ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f671400b000 tx=0x7f6714006df0).stop 2021-10-21T00:03:06.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 msgr2=0x7f6724152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 0x7f6724152790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6720000ed0 tx=0x7f6720007c20).stop 2021-10-21T00:03:06.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 shutdown_connections 2021-10-21T00:03:06.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6704053610 0x7f6704055ad0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67240b0c10 0x7f6724065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67240aaaa0 0x7f67240aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 --2- 172.21.15.41:0/2531874977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f672409a990 0x7f6724152790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 >> 172.21.15.41:0/2531874977 conn(0x7f672405bca0 msgr2=0x7f672405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 shutdown_connections 2021-10-21T00:03:06.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.223+0000 7f672c784700 1 -- 172.21.15.41:0/2531874977 wait complete. 2021-10-21T00:03:06.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2021-10-21T00:03:06.277 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-10-21T00:03:06.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.391+0000 7fe7a9a95700 1 Processor -- start 2021-10-21T00:03:06.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.391+0000 7fe7a9a95700 1 -- start start 2021-10-21T00:03:06.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 0x7fe7a40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a405bd40 con 0x7fe7a40b3a20 2021-10-21T00:03:06.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a405bf70 con 0x7fe7a4062330 2021-10-21T00:03:06.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4142cb0 con 0x7fe7a4062f70 2021-10-21T00:03:06.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a8a93700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 0x7fe7a40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48194/0 (socket says 172.21.15.41:48194) 2021-10-21T00:03:06.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a8a93700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 0x7fe7a40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:41616/0 (socket says 172.21.15.41:41616) 2021-10-21T00:03:06.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 -- 172.21.15.41:0/4110838836 learned_addr learned my addr 172.21.15.41:0/4110838836 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9294700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe7a40b3a20 0x7fe7a413c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35524/0 (socket says 172.21.15.41:35524) 2021-10-21T00:03:06.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 -- 172.21.15.41:0/4110838836 >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 msgr2=0x7fe7a40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:06.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 --2- 172.21.15.41:0/4110838836 >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 0x7fe7a40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 -- 172.21.15.41:0/4110838836 >> v1:172.21.15.62:6789/0 conn(0x7fe7a40b3a20 legacy=0x7fe7a413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 -- 172.21.15.41:0/4110838836 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4142950 con 0x7fe7a4062f70 2021-10-21T00:03:06.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a3fff700 1 --2- 172.21.15.41:0/4110838836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe798002f70 tx=0x7fe798006eb0).ready entity=mon.2 client_cookie=7f2613763cf90e6c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a37fe700 1 -- 172.21.15.41:0/4110838836 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79800d570 con 0x7fe7a4062f70 2021-10-21T00:03:06.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a37fe700 1 -- 172.21.15.41:0/4110838836 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798000e90 con 0x7fe7a4062f70 2021-10-21T00:03:06.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a37fe700 1 -- 172.21.15.41:0/4110838836 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79800d900 con 0x7fe7a4062f70 2021-10-21T00:03:06.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- 172.21.15.41:0/4110838836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 msgr2=0x7fe7a405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/4110838836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe798002f70 tx=0x7fe798006eb0).stop 2021-10-21T00:03:06.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- 172.21.15.41:0/4110838836 shutdown_connections 2021-10-21T00:03:06.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/4110838836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a405c410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/4110838836 >> v2:172.21.15.62:3300/0 conn(0x7fe7a4062330 0x7fe7a40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- 172.21.15.41:0/4110838836 >> 172.21.15.41:0/4110838836 conn(0x7fe7a40b9080 msgr2=0x7fe7a40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- 172.21.15.41:0/4110838836 shutdown_connections 2021-10-21T00:03:06.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.395+0000 7fe7a9a95700 1 -- 172.21.15.41:0/4110838836 wait complete. 2021-10-21T00:03:06.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.399+0000 7fe7a9a95700 1 Processor -- start 2021-10-21T00:03:06.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.399+0000 7fe7a9a95700 1 -- start start 2021-10-21T00:03:06.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.399+0000 7fe7a9a95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.399+0000 7fe7a9a95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7a40b3a20 0x7fe7a41145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40af570 con 0x7fe7a4062330 2021-10-21T00:03:06.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41469d0 con 0x7fe7a40b3a20 2021-10-21T00:03:06.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a41458c0 con 0x7fe7a4062f70 2021-10-21T00:03:06.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57934/0 (socket says 172.21.15.41:57934) 2021-10-21T00:03:06.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 -- 172.21.15.41:0/1790046870 learned_addr learned my addr 172.21.15.41:0/1790046870 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a3fff700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9294700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7a40b3a20 0x7fe7a41145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 -- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 msgr2=0x7fe7a40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a40aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 -- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7a40b3a20 msgr2=0x7fe7a41145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7a40b3a20 0x7fe7a41145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 -- 172.21.15.41:0/1790046870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79800b1e0 con 0x7fe7a4062330 2021-10-21T00:03:06.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a8a93700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe79400c000 tx=0x7fe794006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe794010780 con 0x7fe7a4062330 2021-10-21T00:03:06.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7940108e0 con 0x7fe7a4062330 2021-10-21T00:03:06.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a41454c0 con 0x7fe7a4062330 2021-10-21T00:03:06.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe794010c40 con 0x7fe7a4062330 2021-10-21T00:03:06.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4112de0 con 0x7fe7a4062330 2021-10-21T00:03:06.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe79401c460 con 0x7fe7a4062330 2021-10-21T00:03:06.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.403+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4146b40 con 0x7fe7a4062330 2021-10-21T00:03:06.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.407+0000 7fe7a1ffb700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 0x7fe7840559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.407+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe79406bcc0 con 0x7fe7a4062330 2021-10-21T00:03:06.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.407+0000 7fe7a3fff700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 0x7fe7840559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.407+0000 7fe7a3fff700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 0x7fe7840559e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe79801c000 tx=0x7fe798015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.411+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7a4146b40 con 0x7fe7a4062330 2021-10-21T00:03:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.539+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe7a4146b40 con 0x7fe7a4062330 2021-10-21T00:03:06.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a1ffb700 1 -- 172.21.15.41:0/1790046870 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7a4146b40 con 0x7fe7a4062330 2021-10-21T00:03:06.550 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:06.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 msgr2=0x7fe7840559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 0x7fe7840559e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe79801c000 tx=0x7fe798015000).stop 2021-10-21T00:03:06.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 msgr2=0x7fe7a41556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe79400c000 tx=0x7fe794006df0).stop 2021-10-21T00:03:06.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 shutdown_connections 2021-10-21T00:03:06.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe784053520 0x7fe7840559e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7a40b3a20 0x7fe7a41145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7a4062f70 0x7fe7a40aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 --2- 172.21.15.41:0/1790046870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7a4062330 0x7fe7a41556a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 >> 172.21.15.41:0/1790046870 conn(0x7fe7a40b9080 msgr2=0x7fe7a40b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 shutdown_connections 2021-10-21T00:03:06.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.543+0000 7fe7a9a95700 1 -- 172.21.15.41:0/1790046870 wait complete. 2021-10-21T00:03:06.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2021-10-21T00:03:06.571 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-10-21T00:03:06.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 Processor -- start 2021-10-21T00:03:06.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 -- start start 2021-10-21T00:03:06.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c240af620 0x7f1c240ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1c24067a80 0x7f1c24149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240b0b50 con 0x7f1c240b2170 2021-10-21T00:03:06.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240b2550 con 0x7f1c24067a80 2021-10-21T00:03:06.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2ab98700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240b0d90 con 0x7f1c240af620 2021-10-21T00:03:06.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1c24067a80 0x7f1c24149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1c24067a80 0x7f1c24149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57946/0 (socket says 172.21.15.41:57946) 2021-10-21T00:03:06.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 -- 172.21.15.41:0/511290844 learned_addr learned my addr 172.21.15.41:0/511290844 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c29395700 1 --2- 172.21.15.41:0/511290844 >> v2:172.21.15.62:3300/0 conn(0x7f1c240af620 0x7f1c240ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 -- 172.21.15.41:0/511290844 >> v2:172.21.15.62:3300/0 conn(0x7f1c240af620 msgr2=0x7f1c240ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:06.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 --2- 172.21.15.41:0/511290844 >> v2:172.21.15.62:3300/0 conn(0x7f1c240af620 0x7f1c240ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 -- 172.21.15.41:0/511290844 >> v1:172.21.15.62:6789/0 conn(0x7f1c240b2170 legacy=0x7f1c240ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 -- 172.21.15.41:0/511290844 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240b1030 con 0x7f1c24067a80 2021-10-21T00:03:06.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c2a397700 1 --2- 172.21.15.41:0/511290844 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24149320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1c240aafa0 tx=0x7f1c20006eb0).ready entity=mon.0 client_cookie=d87f359d2d388697 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c28b94700 1 -- 172.21.15.41:0/511290844 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2000d610 con 0x7f1c24067a80 2021-10-21T00:03:06.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c28b94700 1 -- 172.21.15.41:0/511290844 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20000e90 con 0x7f1c24067a80 2021-10-21T00:03:06.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.683+0000 7f1c28b94700 1 -- 172.21.15.41:0/511290844 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c2000d960 con 0x7f1c24067a80 2021-10-21T00:03:06.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- 172.21.15.41:0/511290844 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 msgr2=0x7f1c24149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/511290844 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24149320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1c240aafa0 tx=0x7f1c20006eb0).stop 2021-10-21T00:03:06.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- 172.21.15.41:0/511290844 shutdown_connections 2021-10-21T00:03:06.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/511290844 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24149320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/511290844 >> v2:172.21.15.62:3300/0 conn(0x7f1c240af620 0x7f1c240ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- 172.21.15.41:0/511290844 >> 172.21.15.41:0/511290844 conn(0x7f1c240b5700 msgr2=0x7f1c240b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- 172.21.15.41:0/511290844 shutdown_connections 2021-10-21T00:03:06.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- 172.21.15.41:0/511290844 wait complete. 2021-10-21T00:03:06.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 Processor -- start 2021-10-21T00:03:06.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.687+0000 7f1c2ab98700 1 -- start start 2021-10-21T00:03:06.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c240af620 0x7f1c240ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 0x7f1c240635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24149b40 con 0x7f1c24067a80 2021-10-21T00:03:06.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24156360 con 0x7f1c240b2170 2021-10-21T00:03:06.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24066b50 con 0x7f1c240af620 2021-10-21T00:03:06.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57948/0 (socket says 172.21.15.41:57948) 2021-10-21T00:03:06.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 -- 172.21.15.41:0/2347460091 learned_addr learned my addr 172.21.15.41:0/2347460091 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2a397700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 0x7f1c240635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29395700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c240af620 0x7f1c240ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 -- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c240af620 msgr2=0x7f1c240ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c240af620 0x7f1c240ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 -- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 msgr2=0x7f1c240635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 0x7f1c240635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 -- 172.21.15.41:0/2347460091 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2000b1e0 con 0x7f1c24067a80 2021-10-21T00:03:06.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2a397700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 0x7f1c240635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:06.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c29b96700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f1c24062470 tx=0x7f1c1c001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00e4a0 con 0x7f1c24067a80 2021-10-21T00:03:06.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00e600 con 0x7f1c24067a80 2021-10-21T00:03:06.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24066d80 con 0x7f1c24067a80 2021-10-21T00:03:06.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00e960 con 0x7f1c24067a80 2021-10-21T00:03:06.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.691+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240976f0 con 0x7f1c24067a80 2021-10-21T00:03:06.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c240b12d0 con 0x7f1c24067a80 2021-10-21T00:03:06.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c1c019030 con 0x7f1c24067a80 2021-10-21T00:03:06.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c12ffd700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 0x7f1c04055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c1c06b0e0 con 0x7f1c24067a80 2021-10-21T00:03:06.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c29395700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 0x7f1c04055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.695+0000 7f1c29395700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 0x7f1c04055ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1c1400c000 tx=0x7f1c14008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.699+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c1c0420b0 con 0x7f1c24067a80 2021-10-21T00:03:06.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.823+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1c240b0b50 con 0x7f1c24067a80 2021-10-21T00:03:06.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.823+0000 7f1c12ffd700 1 -- 172.21.15.41:0/2347460091 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c240b0b50 con 0x7f1c24067a80 2021-10-21T00:03:06.834 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:06.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 msgr2=0x7f1c04055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 0x7f1c04055ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1c1400c000 tx=0x7f1c14008040).stop 2021-10-21T00:03:06.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 msgr2=0x7f1c24067130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f1c24062470 tx=0x7f1c1c001400).stop 2021-10-21T00:03:06.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 shutdown_connections 2021-10-21T00:03:06.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c04053610 0x7f1c04055ad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c240b2170 0x7f1c240635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c240af620 0x7f1c240ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 --2- 172.21.15.41:0/2347460091 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1c24067a80 0x7f1c24067130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 >> 172.21.15.41:0/2347460091 conn(0x7f1c240b5700 msgr2=0x7f1c2405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 shutdown_connections 2021-10-21T00:03:06.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.827+0000 7f1c2ab98700 1 -- 172.21.15.41:0/2347460091 wait complete. 2021-10-21T00:03:06.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2021-10-21T00:03:06.870 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-10-21T00:03:06.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 Processor -- start 2021-10-21T00:03:06.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 -- start start 2021-10-21T00:03:06.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5cf00b9c70 0x7f5cf0143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5cf00b3bc0 0x7f5cf0143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf0143a00 0x7f5cf005bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:06.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf01429a0 con 0x7f5cf00b9c70 2021-10-21T00:03:06.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf0142bc0 con 0x7f5cf00b3bc0 2021-10-21T00:03:06.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cf5af6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00ba050 con 0x7f5cf0143a00 2021-10-21T00:03:06.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5cf00b9c70 0x7f5cf0143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5cf00b9c70 0x7f5cf0143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57956/0 (socket says 172.21.15.41:57956) 2021-10-21T00:03:06.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 -- 172.21.15.41:0/406749693 learned_addr learned my addr 172.21.15.41:0/406749693 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5ceeffd700 1 --2- 172.21.15.41:0/406749693 >> v2:172.21.15.62:3300/0 conn(0x7f5cf00b3bc0 0x7f5cf0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5ceffff700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf0143a00 0x7f5cf005bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 -- 172.21.15.41:0/406749693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf0143a00 msgr2=0x7f5cf005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf0143a00 0x7f5cf005bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 -- 172.21.15.41:0/406749693 >> v2:172.21.15.62:3300/0 conn(0x7f5cf00b3bc0 msgr2=0x7f5cf0143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/406749693 >> v2:172.21.15.62:3300/0 conn(0x7f5cf00b3bc0 0x7f5cf0143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 -- 172.21.15.41:0/406749693 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf01463c0 con 0x7f5cf00b9c70 2021-10-21T00:03:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.971+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b9c70 0x7f5cf0143020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5ce00032f0 tx=0x7f5ce0009290).ready entity=mon.0 client_cookie=e98f714b6a742409 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cee7fc700 1 -- 172.21.15.41:0/406749693 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce000b680 con 0x7f5cf00b9c70 2021-10-21T00:03:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cee7fc700 1 -- 172.21.15.41:0/406749693 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000b7e0 con 0x7f5cf00b9c70 2021-10-21T00:03:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cee7fc700 1 -- 172.21.15.41:0/406749693 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce000b950 con 0x7f5cf00b9c70 2021-10-21T00:03:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- 172.21.15.41:0/406749693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b9c70 msgr2=0x7f5cf0143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b9c70 0x7f5cf0143020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5ce00032f0 tx=0x7f5ce0009290).stop 2021-10-21T00:03:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- 172.21.15.41:0/406749693 shutdown_connections 2021-10-21T00:03:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf0143a00 0x7f5cf005bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/406749693 >> v2:172.21.15.62:3300/0 conn(0x7f5cf00b3bc0 0x7f5cf0143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/406749693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b9c70 0x7f5cf0143020 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- 172.21.15.41:0/406749693 >> 172.21.15.41:0/406749693 conn(0x7f5cf0062e80 msgr2=0x7f5cf00b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- 172.21.15.41:0/406749693 shutdown_connections 2021-10-21T00:03:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- 172.21.15.41:0/406749693 wait complete. 2021-10-21T00:03:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 Processor -- start 2021-10-21T00:03:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- start start 2021-10-21T00:03:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf00b9c70 0x7f5cf00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cf0143a00 0x7f5cf013dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0113080 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00af010 con 0x7f5cf0143a00 2021-10-21T00:03:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cf5af6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0113be0 con 0x7f5cf00b9c70 2021-10-21T00:03:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57962/0 (socket says 172.21.15.41:57962) 2021-10-21T00:03:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 -- 172.21.15.41:0/544432942 learned_addr learned my addr 172.21.15.41:0/544432942 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5ceffff700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cf0143a00 0x7f5cf013dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5ceeffd700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf00b9c70 0x7f5cf00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 -- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf00b9c70 msgr2=0x7f5cf00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf00b9c70 0x7f5cf00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 -- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cf0143a00 msgr2=0x7f5cf013dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cf0143a00 0x7f5cf013dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 -- 172.21.15.41:0/544432942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0009530 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cef7fe700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5ce00032f0 tx=0x7f5ce0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.975+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce000b680 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0011e50 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf0113e80 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce000bee0 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf013e470 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ce000f070 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0146120 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cecff9700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 0x7f5cd40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ce006d180 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5ceeffd700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 0x7f5cd40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.979+0000 7f5ceeffd700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 0x7f5cd40559b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5cd800b000 tx=0x7f5cd8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:06.983+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ce0044320 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5cf0057350 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cecff9700 1 -- 172.21.15.41:0/544432942 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ce001f020 con 0x7f5cf00b3bc0 2021-10-21T00:03:07.121 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:07.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 msgr2=0x7f5cd40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 0x7f5cd40559b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5cd800b000 tx=0x7f5cd8006df0).stop 2021-10-21T00:03:07.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 msgr2=0x7f5cf01145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5ce00032f0 tx=0x7f5ce0017000).stop 2021-10-21T00:03:07.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 shutdown_connections 2021-10-21T00:03:07.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cd40534f0 0x7f5cd40559b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cf0143a00 0x7f5cf013dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5cf00b9c70 0x7f5cf00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 --2- 172.21.15.41:0/544432942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5cf00b3bc0 0x7f5cf01145c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 >> 172.21.15.41:0/544432942 conn(0x7f5cf0062e80 msgr2=0x7f5cf00b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 shutdown_connections 2021-10-21T00:03:07.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.111+0000 7f5cf5af6700 1 -- 172.21.15.41:0/544432942 wait complete. 2021-10-21T00:03:07.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2021-10-21T00:03:07.133 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-10-21T00:03:07.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 Processor -- start 2021-10-21T00:03:07.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 -- start start 2021-10-21T00:03:07.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc37413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc374143660 con 0x7fc3740601b0 2021-10-21T00:03:07.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc374142870 con 0x7fc374143250 2021-10-21T00:03:07.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc379f1e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc374142b10 con 0x7fc3740b09e0 2021-10-21T00:03:07.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc3737fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc3740601b0 0x7fc37413f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55740/0 (socket says 172.21.15.41:55740) 2021-10-21T00:03:07.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc3737fe700 1 -- 172.21.15.41:0/1822445534 learned_addr learned my addr 172.21.15.41:0/1822445534 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:07.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc36bfff700 1 --2- 172.21.15.41:0/1822445534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc37413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367710068 0 0) 0x7fc364001110 con 0x7fc3740601b0 2021-10-21T00:03:07.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.235+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc354003260 con 0x7fc3740601b0 2021-10-21T00:03:07.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011317212 0 0) 0x7fc374142870 con 0x7fc374143250 2021-10-21T00:03:07.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc364001110 con 0x7fc374143250 2021-10-21T00:03:07.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105872531 0 0) 0x7fc354003260 con 0x7fc3740601b0 2021-10-21T00:03:07.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc36bfff700 1 -- 172.21.15.41:0/1822445534 >> v1:172.21.15.62:6789/0 conn(0x7fc374143250 legacy=0x7fc374098600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc36bfff700 1 -- 172.21.15.41:0/1822445534 >> v1:172.21.15.41:6789/0 conn(0x7fc3740601b0 legacy=0x7fc37413f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc36bfff700 1 -- 172.21.15.41:0/1822445534 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374142db0 con 0x7fc3740b09e0 2021-10-21T00:03:07.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc36bfff700 1 --2- 172.21.15.41:0/1822445534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc37413f8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc3640012a0 tx=0x7fc35c006df0).ready entity=mon.2 client_cookie=53e2121a6e9e27cd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3640017f0 con 0x7fc3740b09e0 2021-10-21T00:03:07.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c000e90 con 0x7fc3740b09e0 2021-10-21T00:03:07.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc372ffd700 1 -- 172.21.15.41:0/1822445534 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35c012460 con 0x7fc3740b09e0 2021-10-21T00:03:07.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- 172.21.15.41:0/1822445534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 msgr2=0x7fc37413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 --2- 172.21.15.41:0/1822445534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc37413f8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc3640012a0 tx=0x7fc35c006df0).stop 2021-10-21T00:03:07.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- 172.21.15.41:0/1822445534 shutdown_connections 2021-10-21T00:03:07.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 --2- 172.21.15.41:0/1822445534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc37413f8a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- 172.21.15.41:0/1822445534 >> 172.21.15.41:0/1822445534 conn(0x7fc37405bca0 msgr2=0x7fc37405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- 172.21.15.41:0/1822445534 shutdown_connections 2021-10-21T00:03:07.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- 172.21.15.41:0/1822445534 wait complete. 2021-10-21T00:03:07.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 Processor -- start 2021-10-21T00:03:07.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.239+0000 7fc379f1e700 1 -- start start 2021-10-21T00:03:07.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc3740acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc374143250 0x7fc374066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740ae690 con 0x7fc3740601b0 2021-10-21T00:03:07.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740ae930 con 0x7fc374143250 2021-10-21T00:03:07.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740aebd0 con 0x7fc3740b09e0 2021-10-21T00:03:07.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57976/0 (socket says 172.21.15.41:57976) 2021-10-21T00:03:07.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 -- 172.21.15.41:0/3364869699 learned_addr learned my addr 172.21.15.41:0/3364869699 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:07.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc36bfff700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc3740acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc373fff700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc374143250 0x7fc374066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 -- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 msgr2=0x7fc3740acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc3740acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 -- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc374143250 msgr2=0x7fc374066df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc374143250 0x7fc374066df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 -- 172.21.15.41:0/3364869699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c00b180 con 0x7fc3740601b0 2021-10-21T00:03:07.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3737fe700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc3640019d0 tx=0x7fc364001500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc364007170 con 0x7fc3740601b0 2021-10-21T00:03:07.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640072d0 con 0x7fc3740601b0 2021-10-21T00:03:07.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3740af070 con 0x7fc3740601b0 2021-10-21T00:03:07.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc364004920 con 0x7fc3740601b0 2021-10-21T00:03:07.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.243+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc374063b90 con 0x7fc3740601b0 2021-10-21T00:03:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc36401b070 con 0x7fc3740601b0 2021-10-21T00:03:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3740ae4e0 con 0x7fc3740601b0 2021-10-21T00:03:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc3717fa700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 0x7fc358055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc36406afe0 con 0x7fc3740601b0 2021-10-21T00:03:07.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc36bfff700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 0x7fc358055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.247+0000 7fc36bfff700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 0x7fc358055a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc35c01a000 tx=0x7fc35c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.255+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3640420a0 con 0x7fc3740601b0 2021-10-21T00:03:07.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.379+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc374143660 con 0x7fc3740601b0 2021-10-21T00:03:07.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.379+0000 7fc3717fa700 1 -- 172.21.15.41:0/3364869699 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc374143660 con 0x7fc3740601b0 2021-10-21T00:03:07.394 INFO:teuthology.orchestra.run.smithi041.stdout:55834574854 2021-10-21T00:03:07.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 msgr2=0x7fc358055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 0x7fc358055a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc35c01a000 tx=0x7fc35c014000).stop 2021-10-21T00:03:07.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 msgr2=0x7fc3740adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc3640019d0 tx=0x7fc364001500).stop 2021-10-21T00:03:07.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 shutdown_connections 2021-10-21T00:03:07.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc358053580 0x7fc358055a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc374143250 0x7fc374066df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3740b09e0 0x7fc3740acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 --2- 172.21.15.41:0/3364869699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3740601b0 0x7fc3740adff0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 >> 172.21.15.41:0/3364869699 conn(0x7fc37405bca0 msgr2=0x7fc3740a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 shutdown_connections 2021-10-21T00:03:07.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.383+0000 7fc379f1e700 1 -- 172.21.15.41:0/3364869699 wait complete. 2021-10-21T00:03:07.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2021-10-21T00:03:07.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-10-21T00:03:07.408 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:03:07.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 Processor -- start 2021-10-21T00:03:07.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- start start 2021-10-21T00:03:07.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 0x7f3b240b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b240b6350 con 0x7f3b240b5f70 2021-10-21T00:03:07.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b240b0e10 con 0x7f3b241423a0 2021-10-21T00:03:07.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240b10b0 con 0x7f3b24067a00 2021-10-21T00:03:07.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2920a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3b240b5f70 0x7f3b240672f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55754/0 (socket says 172.21.15.41:55754) 2021-10-21T00:03:07.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2920a700 1 -- 172.21.15.41:0/1391215817 learned_addr learned my addr 172.21.15.41:0/1391215817 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:07.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b28a09700 1 --2- 172.21.15.41:0/1391215817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 0x7f3b240b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746656470 0 0) 0x7f3b240b6350 con 0x7f3b240b5f70 2021-10-21T00:03:07.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b08003260 con 0x7f3b240b5f70 2021-10-21T00:03:07.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250050711 0 0) 0x7f3b240b0e10 con 0x7f3b241423a0 2021-10-21T00:03:07.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b240b6350 con 0x7f3b241423a0 2021-10-21T00:03:07.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b28a09700 1 -- 172.21.15.41:0/1391215817 >> v1:172.21.15.62:6789/0 conn(0x7f3b241423a0 legacy=0x7f3b2413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b28a09700 1 -- 172.21.15.41:0/1391215817 >> v1:172.21.15.41:6789/0 conn(0x7f3b240b5f70 legacy=0x7f3b240672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b28a09700 1 -- 172.21.15.41:0/1391215817 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240b1350 con 0x7f3b24067a00 2021-10-21T00:03:07.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b28a09700 1 --2- 172.21.15.41:0/1391215817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 0x7f3b240b1a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3b20002f70 tx=0x7f3b20006e80).ready entity=mon.2 client_cookie=cf7b7d7c2aec1f28 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b20010400 con 0x7f3b24067a00 2021-10-21T00:03:07.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20000e90 con 0x7f3b24067a00 2021-10-21T00:03:07.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b1bfff700 1 -- 172.21.15.41:0/1391215817 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b20010750 con 0x7f3b24067a00 2021-10-21T00:03:07.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- 172.21.15.41:0/1391215817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 msgr2=0x7f3b240b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/1391215817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 0x7f3b240b1a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3b20002f70 tx=0x7f3b20006e80).stop 2021-10-21T00:03:07.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- 172.21.15.41:0/1391215817 shutdown_connections 2021-10-21T00:03:07.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/1391215817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b24067a00 0x7f3b240b1a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- 172.21.15.41:0/1391215817 >> 172.21.15.41:0/1391215817 conn(0x7f3b240639f0 msgr2=0x7f3b240b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- 172.21.15.41:0/1391215817 shutdown_connections 2021-10-21T00:03:07.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.511+0000 7f3b2a20c700 1 -- 172.21.15.41:0/1391215817 wait complete. 2021-10-21T00:03:07.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 Processor -- start 2021-10-21T00:03:07.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- start start 2021-10-21T00:03:07.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 0x7f3b24151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b240b5f70 0x7f3b24152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 0x7f3b24147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24152a20 con 0x7f3b24067a00 2021-10-21T00:03:07.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241441b0 con 0x7f3b241423a0 2021-10-21T00:03:07.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24152740 con 0x7f3b240b5f70 2021-10-21T00:03:07.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2920a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 0x7f3b24151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2920a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 0x7f3b24151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:57990/0 (socket says 172.21.15.41:57990) 2021-10-21T00:03:07.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2920a700 1 -- 172.21.15.41:0/768528849 learned_addr learned my addr 172.21.15.41:0/768528849 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:07.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 0x7f3b24147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b28a09700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b240b5f70 0x7f3b24152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 -- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b240b5f70 msgr2=0x7f3b24152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b240b5f70 0x7f3b24152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 -- 172.21.15.41:0/768528849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 msgr2=0x7f3b24151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 0x7f3b24151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 -- 172.21.15.41:0/768528849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2000c310 con 0x7f3b241423a0 2021-10-21T00:03:07.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b29a0b700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 0x7f3b24147ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3b1c001490 tx=0x7f3b1c007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1c00ce30 con 0x7f3b241423a0 2021-10-21T00:03:07.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b24144650 con 0x7f3b241423a0 2021-10-21T00:03:07.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00f470 con 0x7f3b241423a0 2021-10-21T00:03:07.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b24148190 con 0x7f3b241423a0 2021-10-21T00:03:07.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.515+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1c00f7d0 con 0x7f3b241423a0 2021-10-21T00:03:07.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b1c019030 con 0x7f3b241423a0 2021-10-21T00:03:07.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b1a7fc700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 0x7f3b0c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b240b15f0 con 0x7f3b241423a0 2021-10-21T00:03:07.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b1c06adb0 con 0x7f3b241423a0 2021-10-21T00:03:07.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b2920a700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 0x7f3b0c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.519+0000 7f3b2920a700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 0x7f3b0c055a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3b1400d000 tx=0x7f3b14009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.527+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b1c041ec0 con 0x7f3b241423a0 2021-10-21T00:03:07.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.647+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b24144030 con 0x7f3b0c053580 2021-10-21T00:03:07.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b1a7fc700 1 -- 172.21.15.41:0/768528849 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82210 (secure 0 0 0) 0x7f3b14001cb0 con 0x7f3b0c053580 2021-10-21T00:03:07.669 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:07.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 msgr2=0x7f3b0c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 0x7f3b0c055a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3b1400d000 tx=0x7f3b14009040).stop 2021-10-21T00:03:07.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 msgr2=0x7f3b24147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 0x7f3b24147ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3b1c001490 tx=0x7f3b1c007d40).stop 2021-10-21T00:03:07.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 shutdown_connections 2021-10-21T00:03:07.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b0c053580 0x7f3b0c055a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b241423a0 0x7f3b24147ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b240b5f70 0x7f3b24152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 --2- 172.21.15.41:0/768528849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b24067a00 0x7f3b24151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 >> 172.21.15.41:0/768528849 conn(0x7f3b240639f0 msgr2=0x7f3b240aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 shutdown_connections 2021-10-21T00:03:07.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.659+0000 7f3b2a20c700 1 -- 172.21.15.41:0/768528849 wait complete. 2021-10-21T00:03:07.684 INFO:teuthology.orchestra.run.smithi041.stderr:dumped all 2021-10-21T00:03:07.686 INFO:teuthology.orchestra.run.smithi041.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2021-10-21T00:03:06.305028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6366784,"kb_used_data":743228256,"kb_used_omap":592,"kb_used_meta":0,"kb_avail":743228256,"statfs":{"total":767585320960,"available":761065734144,"internally_reserved":0,"allocated":761065734144,"data_stored":761065734144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":606282,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.510117"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804139+0000","last_change":"2021-10-21T00:02:57.803826+0000","last_active":"2021-10-21T00:02:57.804139+0000","last_peered":"2021-10-21T00:02:57.804139+0000","last_clean":"2021-10-21T00:02:57.804139+0000","last_became_active":"2021-10-21T00:02:57.803364+0000","last_became_peered":"2021-10-21T00:02:57.803364+0000","last_unstale":"2021-10-21T00:02:57.804139+0000","last_undegraded":"2021-10-21T00:02:57.804139+0000","last_fullsized":"2021-10-21T00:02:57.804139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799331+0000","last_change":"2021-10-21T00:02:48.921294+0000","last_active":"2021-10-21T00:02:57.799331+0000","last_peered":"2021-10-21T00:02:57.799331+0000","last_clean":"2021-10-21T00:02:57.799331+0000","last_became_active":"2021-10-21T00:02:48.920214+0000","last_became_peered":"2021-10-21T00:02:48.920214+0000","last_unstale":"2021-10-21T00:02:57.799331+0000","last_undegraded":"2021-10-21T00:02:57.799331+0000","last_fullsized":"2021-10-21T00:02:57.799331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_clean_scrub_stamp":"2021-10-21T00:02:44.356620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800632+0000","last_change":"2021-10-21T00:02:54.442999+0000","last_active":"2021-10-21T00:02:57.800632+0000","last_peered":"2021-10-21T00:02:57.800632+0000","last_clean":"2021-10-21T00:02:57.800632+0000","last_became_active":"2021-10-21T00:02:54.442653+0000","last_became_peered":"2021-10-21T00:02:54.442653+0000","last_unstale":"2021-10-21T00:02:57.800632+0000","last_undegraded":"2021-10-21T00:02:57.800632+0000","last_fullsized":"2021-10-21T00:02:57.800632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.808349+0000","last_change":"2021-10-21T00:02:57.466019+0000","last_active":"2021-10-21T00:02:58.808349+0000","last_peered":"2021-10-21T00:02:58.808349+0000","last_clean":"2021-10-21T00:02:58.808349+0000","last_became_active":"2021-10-21T00:02:57.464076+0000","last_became_peered":"2021-10-21T00:02:57.464076+0000","last_unstale":"2021-10-21T00:02:58.808349+0000","last_undegraded":"2021-10-21T00:02:58.808349+0000","last_fullsized":"2021-10-21T00:02:58.808349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.802980+0000","last_change":"2021-10-21T00:02:57.802774+0000","last_active":"2021-10-21T00:02:57.802980+0000","last_peered":"2021-10-21T00:02:57.802980+0000","last_clean":"2021-10-21T00:02:57.802980+0000","last_became_active":"2021-10-21T00:02:57.802086+0000","last_became_peered":"2021-10-21T00:02:57.802086+0000","last_unstale":"2021-10-21T00:02:57.802980+0000","last_undegraded":"2021-10-21T00:02:57.802980+0000","last_fullsized":"2021-10-21T00:02:57.802980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799295+0000","last_change":"2021-10-21T00:02:54.443329+0000","last_active":"2021-10-21T00:02:57.799295+0000","last_peered":"2021-10-21T00:02:57.799295+0000","last_clean":"2021-10-21T00:02:57.799295+0000","last_became_active":"2021-10-21T00:02:54.442888+0000","last_became_peered":"2021-10-21T00:02:54.442888+0000","last_unstale":"2021-10-21T00:02:57.799295+0000","last_undegraded":"2021-10-21T00:02:57.799295+0000","last_fullsized":"2021-10-21T00:02:57.799295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.798400+0000","last_change":"2021-10-21T00:02:57.470066+0000","last_active":"2021-10-21T00:02:57.798400+0000","last_peered":"2021-10-21T00:02:57.798400+0000","last_clean":"2021-10-21T00:02:57.798400+0000","last_became_active":"2021-10-21T00:02:57.468298+0000","last_became_peered":"2021-10-21T00:02:57.468298+0000","last_unstale":"2021-10-21T00:02:57.798400+0000","last_undegraded":"2021-10-21T00:02:57.798400+0000","last_fullsized":"2021-10-21T00:02:57.798400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804478+0000","last_change":"2021-10-21T00:02:57.804323+0000","last_active":"2021-10-21T00:02:57.804478+0000","last_peered":"2021-10-21T00:02:57.804478+0000","last_clean":"2021-10-21T00:02:57.804478+0000","last_became_active":"2021-10-21T00:02:57.803822+0000","last_became_peered":"2021-10-21T00:02:57.803822+0000","last_unstale":"2021-10-21T00:02:57.804478+0000","last_undegraded":"2021-10-21T00:02:57.804478+0000","last_fullsized":"2021-10-21T00:02:57.804478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.065827+0000","last_change":"2021-10-21T00:02:55.009600+0000","last_active":"2021-10-21T00:02:58.065827+0000","last_peered":"2021-10-21T00:02:58.065827+0000","last_clean":"2021-10-21T00:02:58.065827+0000","last_became_active":"2021-10-21T00:02:55.009083+0000","last_became_peered":"2021-10-21T00:02:55.009083+0000","last_unstale":"2021-10-21T00:02:58.065827+0000","last_undegraded":"2021-10-21T00:02:58.065827+0000","last_fullsized":"2021-10-21T00:02:58.065827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493975+0000","last_change":"2021-10-21T00:02:57.473951+0000","last_active":"2021-10-21T00:02:59.493975+0000","last_peered":"2021-10-21T00:02:59.493975+0000","last_clean":"2021-10-21T00:02:59.493975+0000","last_became_active":"2021-10-21T00:02:57.473628+0000","last_became_peered":"2021-10-21T00:02:57.473628+0000","last_unstale":"2021-10-21T00:02:59.493975+0000","last_undegraded":"2021-10-21T00:02:59.493975+0000","last_fullsized":"2021-10-21T00:02:59.493975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.067436+0000","last_change":"2021-10-21T00:02:58.067286+0000","last_active":"2021-10-21T00:02:58.067436+0000","last_peered":"2021-10-21T00:02:58.067436+0000","last_clean":"2021-10-21T00:02:58.067436+0000","last_became_active":"2021-10-21T00:02:58.066988+0000","last_became_peered":"2021-10-21T00:02:58.066988+0000","last_unstale":"2021-10-21T00:02:58.067436+0000","last_undegraded":"2021-10-21T00:02:58.067436+0000","last_fullsized":"2021-10-21T00:02:58.067436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800363+0000","last_change":"2021-10-21T00:02:54.443795+0000","last_active":"2021-10-21T00:02:57.800363+0000","last_peered":"2021-10-21T00:02:57.800363+0000","last_clean":"2021-10-21T00:02:57.800363+0000","last_became_active":"2021-10-21T00:02:54.443329+0000","last_became_peered":"2021-10-21T00:02:54.443329+0000","last_unstale":"2021-10-21T00:02:57.800363+0000","last_undegraded":"2021-10-21T00:02:57.800363+0000","last_fullsized":"2021-10-21T00:02:57.800363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.487805+0000","last_change":"2021-10-21T00:02:57.469597+0000","last_active":"2021-10-21T00:02:59.487805+0000","last_peered":"2021-10-21T00:02:59.487805+0000","last_clean":"2021-10-21T00:02:59.487805+0000","last_became_active":"2021-10-21T00:02:57.469198+0000","last_became_peered":"2021-10-21T00:02:57.469198+0000","last_unstale":"2021-10-21T00:02:59.487805+0000","last_undegraded":"2021-10-21T00:02:59.487805+0000","last_fullsized":"2021-10-21T00:02:59.487805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804911+0000","last_change":"2021-10-21T00:02:57.804144+0000","last_active":"2021-10-21T00:02:57.804911+0000","last_peered":"2021-10-21T00:02:57.804911+0000","last_clean":"2021-10-21T00:02:57.804911+0000","last_became_active":"2021-10-21T00:02:57.803631+0000","last_became_peered":"2021-10-21T00:02:57.803631+0000","last_unstale":"2021-10-21T00:02:57.804911+0000","last_undegraded":"2021-10-21T00:02:57.804911+0000","last_fullsized":"2021-10-21T00:02:57.804911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493663+0000","last_change":"2021-10-21T00:02:57.466175+0000","last_active":"2021-10-21T00:02:59.493663+0000","last_peered":"2021-10-21T00:02:59.493663+0000","last_clean":"2021-10-21T00:02:59.493663+0000","last_became_active":"2021-10-21T00:02:57.464687+0000","last_became_peered":"2021-10-21T00:02:57.464687+0000","last_unstale":"2021-10-21T00:02:59.493663+0000","last_undegraded":"2021-10-21T00:02:59.493663+0000","last_fullsized":"2021-10-21T00:02:59.493663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.801009+0000","last_change":"2021-10-21T00:02:55.002147+0000","last_active":"2021-10-21T00:02:57.801009+0000","last_peered":"2021-10-21T00:02:57.801009+0000","last_clean":"2021-10-21T00:02:57.801009+0000","last_became_active":"2021-10-21T00:02:55.001733+0000","last_became_peered":"2021-10-21T00:02:55.001733+0000","last_unstale":"2021-10-21T00:02:57.801009+0000","last_undegraded":"2021-10-21T00:02:57.801009+0000","last_fullsized":"2021-10-21T00:02:57.801009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804282+0000","last_change":"2021-10-21T00:02:57.803770+0000","last_active":"2021-10-21T00:02:57.804282+0000","last_peered":"2021-10-21T00:02:57.804282+0000","last_clean":"2021-10-21T00:02:57.804282+0000","last_became_active":"2021-10-21T00:02:57.802969+0000","last_became_peered":"2021-10-21T00:02:57.802969+0000","last_unstale":"2021-10-21T00:02:57.804282+0000","last_undegraded":"2021-10-21T00:02:57.804282+0000","last_fullsized":"2021-10-21T00:02:57.804282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.495413+0000","last_change":"2021-10-21T00:02:57.473878+0000","last_active":"2021-10-21T00:02:59.495413+0000","last_peered":"2021-10-21T00:02:59.495413+0000","last_clean":"2021-10-21T00:02:59.495413+0000","last_became_active":"2021-10-21T00:02:57.473582+0000","last_became_peered":"2021-10-21T00:02:57.473582+0000","last_unstale":"2021-10-21T00:02:59.495413+0000","last_undegraded":"2021-10-21T00:02:59.495413+0000","last_fullsized":"2021-10-21T00:02:59.495413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799417+0000","last_change":"2021-10-21T00:02:55.003763+0000","last_active":"2021-10-21T00:02:57.799417+0000","last_peered":"2021-10-21T00:02:57.799417+0000","last_clean":"2021-10-21T00:02:57.799417+0000","last_became_active":"2021-10-21T00:02:55.003018+0000","last_became_peered":"2021-10-21T00:02:55.003018+0000","last_unstale":"2021-10-21T00:02:57.799417+0000","last_undegraded":"2021-10-21T00:02:57.799417+0000","last_fullsized":"2021-10-21T00:02:57.799417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.807034+0000","last_change":"2021-10-21T00:02:57.806864+0000","last_active":"2021-10-21T00:02:57.807034+0000","last_peered":"2021-10-21T00:02:57.807034+0000","last_clean":"2021-10-21T00:02:57.807034+0000","last_became_active":"2021-10-21T00:02:57.806614+0000","last_became_peered":"2021-10-21T00:02:57.806614+0000","last_unstale":"2021-10-21T00:02:57.807034+0000","last_undegraded":"2021-10-21T00:02:57.807034+0000","last_fullsized":"2021-10-21T00:02:57.807034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.491788+0000","last_change":"2021-10-21T00:02:57.468218+0000","last_active":"2021-10-21T00:02:59.491788+0000","last_peered":"2021-10-21T00:02:59.491788+0000","last_clean":"2021-10-21T00:02:59.491788+0000","last_became_active":"2021-10-21T00:02:57.467521+0000","last_became_peered":"2021-10-21T00:02:57.467521+0000","last_unstale":"2021-10-21T00:02:59.491788+0000","last_undegraded":"2021-10-21T00:02:59.491788+0000","last_fullsized":"2021-10-21T00:02:59.491788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.801716+0000","last_change":"2021-10-21T00:02:54.444552+0000","last_active":"2021-10-21T00:02:57.801716+0000","last_peered":"2021-10-21T00:02:57.801716+0000","last_clean":"2021-10-21T00:02:57.801716+0000","last_became_active":"2021-10-21T00:02:54.443600+0000","last_became_peered":"2021-10-21T00:02:54.443600+0000","last_unstale":"2021-10-21T00:02:57.801716+0000","last_undegraded":"2021-10-21T00:02:57.801716+0000","last_fullsized":"2021-10-21T00:02:57.801716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804991+0000","last_change":"2021-10-21T00:02:57.804761+0000","last_active":"2021-10-21T00:02:57.804991+0000","last_peered":"2021-10-21T00:02:57.804991+0000","last_clean":"2021-10-21T00:02:57.804991+0000","last_became_active":"2021-10-21T00:02:57.804241+0000","last_became_peered":"2021-10-21T00:02:57.804241+0000","last_unstale":"2021-10-21T00:02:57.804991+0000","last_undegraded":"2021-10-21T00:02:57.804991+0000","last_fullsized":"2021-10-21T00:02:57.804991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493256+0000","last_change":"2021-10-21T00:02:57.470733+0000","last_active":"2021-10-21T00:02:59.493256+0000","last_peered":"2021-10-21T00:02:59.493256+0000","last_clean":"2021-10-21T00:02:59.493256+0000","last_became_active":"2021-10-21T00:02:57.470444+0000","last_became_peered":"2021-10-21T00:02:57.470444+0000","last_unstale":"2021-10-21T00:02:59.493256+0000","last_undegraded":"2021-10-21T00:02:59.493256+0000","last_fullsized":"2021-10-21T00:02:59.493256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800564+0000","last_change":"2021-10-21T00:02:54.441675+0000","last_active":"2021-10-21T00:02:57.800564+0000","last_peered":"2021-10-21T00:02:57.800564+0000","last_clean":"2021-10-21T00:02:57.800564+0000","last_became_active":"2021-10-21T00:02:54.441301+0000","last_became_peered":"2021-10-21T00:02:54.441301+0000","last_unstale":"2021-10-21T00:02:57.800564+0000","last_undegraded":"2021-10-21T00:02:57.800564+0000","last_fullsized":"2021-10-21T00:02:57.800564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795848,"kb_used_data":92903532,"kb_used_omap":80,"kb_used_meta":0,"kb_avail":92903532,"statfs":{"total":95948165120,"available":95133216768,"internally_reserved":0,"allocated":95133216768,"data_stored":95133216768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82257,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795840,"kb_used_data":92903540,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903540,"statfs":{"total":95948165120,"available":95133224960,"internally_reserved":0,"allocated":95133224960,"data_stored":95133224960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43305,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795848,"kb_used_data":92903532,"kb_used_omap":77,"kb_used_meta":0,"kb_avail":92903532,"statfs":{"total":95948165120,"available":95133216768,"internally_reserved":0,"allocated":95133216768,"data_stored":95133216768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":79355,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795844,"kb_used_data":92903536,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903536,"statfs":{"total":95948165120,"available":95133220864,"internally_reserved":0,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62935,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795856,"kb_used_data":92903524,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":92903524,"statfs":{"total":95948165120,"available":95133208576,"internally_reserved":0,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66733,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903528,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":0,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73999,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903528,"kb_used_omap":100,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":0,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102992,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795844,"kb_used_data":92903536,"kb_used_omap":92,"kb_used_meta":0,"kb_avail":92903536,"statfs":{"total":95948165120,"available":95133220864,"internally_reserved":0,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":94706,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]}]}} 2021-10-21T00:03:07.689 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:03:07.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.795+0000 7faa88405700 1 Processor -- start 2021-10-21T00:03:07.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.795+0000 7faa88405700 1 -- start start 2021-10-21T00:03:07.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 0x7faa8014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 0x7faa800af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa800609d0 con 0x7faa800aa750 2021-10-21T00:03:07.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800b1620 con 0x7faa8005f9f0 2021-10-21T00:03:07.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8005fdd0 con 0x7faa8014b350 2021-10-21T00:03:07.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa861a1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 0x7faa8014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa859a0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa800aa750 0x7faa8014ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35592/0 (socket says 172.21.15.41:35592) 2021-10-21T00:03:07.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa859a0700 1 -- 172.21.15.41:0/1913743869 learned_addr learned my addr 172.21.15.41:0/1913743869 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:07.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 --2- 172.21.15.41:0/1913743869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 0x7faa800af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa8519f700 1 -- 172.21.15.41:0/1913743869 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197367253 0 0) 0x7faa800609d0 con 0x7faa800aa750 2021-10-21T00:03:07.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa8519f700 1 -- 172.21.15.41:0/1913743869 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa68003260 con 0x7faa800aa750 2021-10-21T00:03:07.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 -- 172.21.15.41:0/1913743869 >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 msgr2=0x7faa8014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:07.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 --2- 172.21.15.41:0/1913743869 >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 0x7faa8014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 -- 172.21.15.41:0/1913743869 >> v1:172.21.15.62:6789/0 conn(0x7faa800aa750 legacy=0x7faa8014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 -- 172.21.15.41:0/1913743869 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800b1380 con 0x7faa8014b350 2021-10-21T00:03:07.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa861a1700 1 --2- 172.21.15.41:0/1913743869 >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 0x7faa8014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:07.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa869a2700 1 --2- 172.21.15.41:0/1913743869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 0x7faa800af7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faa78002f70 tx=0x7faa78006df0).ready entity=mon.2 client_cookie=c4f1eea63b11487d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa8519f700 1 -- 172.21.15.41:0/1913743869 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7800d4a0 con 0x7faa8014b350 2021-10-21T00:03:07.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa8519f700 1 -- 172.21.15.41:0/1913743869 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa78000e90 con 0x7faa8014b350 2021-10-21T00:03:07.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa8519f700 1 -- 172.21.15.41:0/1913743869 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7800d7f0 con 0x7faa8014b350 2021-10-21T00:03:07.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- 172.21.15.41:0/1913743869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 msgr2=0x7faa800af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 --2- 172.21.15.41:0/1913743869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 0x7faa800af7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faa78002f70 tx=0x7faa78006df0).stop 2021-10-21T00:03:07.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- 172.21.15.41:0/1913743869 shutdown_connections 2021-10-21T00:03:07.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 --2- 172.21.15.41:0/1913743869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8014b350 0x7faa800af7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 --2- 172.21.15.41:0/1913743869 >> v2:172.21.15.62:3300/0 conn(0x7faa8005f9f0 0x7faa8014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- 172.21.15.41:0/1913743869 >> 172.21.15.41:0/1913743869 conn(0x7faa8005bca0 msgr2=0x7faa8005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- 172.21.15.41:0/1913743869 shutdown_connections 2021-10-21T00:03:07.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.799+0000 7faa88405700 1 -- 172.21.15.41:0/1913743869 wait complete. 2021-10-21T00:03:07.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 Processor -- start 2021-10-21T00:03:07.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 -- start start 2021-10-21T00:03:07.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8005f9f0 0x7faa800b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa800aa750 0x7faa80066ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80062d30 con 0x7faa8014b350 2021-10-21T00:03:07.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80067680 con 0x7faa800aa750 2021-10-21T00:03:07.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.803+0000 7faa88405700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800acd40 con 0x7faa8005f9f0 2021-10-21T00:03:07.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58008/0 (socket says 172.21.15.41:58008) 2021-10-21T00:03:07.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 -- 172.21.15.41:0/3151858525 learned_addr learned my addr 172.21.15.41:0/3151858525 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:07.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa859a0700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa800aa750 0x7faa80066ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa861a1700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8005f9f0 0x7faa800b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 -- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8005f9f0 msgr2=0x7faa800b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8005f9f0 0x7faa800b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 -- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa800aa750 msgr2=0x7faa80066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa800aa750 0x7faa80066ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 -- 172.21.15.41:0/3151858525 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7000b180 con 0x7faa8014b350 2021-10-21T00:03:07.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa869a2700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faa80067810 tx=0x7faa78014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa78012930 con 0x7faa8014b350 2021-10-21T00:03:07.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7800b180 con 0x7faa8014b350 2021-10-21T00:03:07.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa78012a90 con 0x7faa8014b350 2021-10-21T00:03:07.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa78012df0 con 0x7faa8014b350 2021-10-21T00:03:07.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa800ad280 con 0x7faa8014b350 2021-10-21T00:03:07.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800ad440 con 0x7faa8014b350 2021-10-21T00:03:07.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.807+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa7801c070 con 0x7faa8014b350 2021-10-21T00:03:07.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.811+0000 7faa6f7fe700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:07.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.811+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa7806c550 con 0x7faa8014b350 2021-10-21T00:03:07.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.811+0000 7faa861a1700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:07.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.811+0000 7faa861a1700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 0x7faa60055ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faa7000b000 tx=0x7faa70006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:07.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.811+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa78043650 con 0x7faa8014b350 2021-10-21T00:03:07.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.935+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa80057350 con 0x7faa60053610 2021-10-21T00:03:07.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa6f7fe700 1 -- 172.21.15.41:0/3151858525 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82210 (secure 0 0 0) 0x7faa80057350 con 0x7faa60053610 2021-10-21T00:03:07.957 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:07.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 msgr2=0x7faa60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 0x7faa60055ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faa7000b000 tx=0x7faa70006df0).stop 2021-10-21T00:03:07.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 msgr2=0x7faa80067190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:07.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faa80067810 tx=0x7faa78014000).stop 2021-10-21T00:03:07.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 shutdown_connections 2021-10-21T00:03:07.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faa60053610 0x7faa60055ad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faa8014b350 0x7faa80067190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa800aa750 0x7faa80066ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 --2- 172.21.15.41:0/3151858525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa8005f9f0 0x7faa800b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:07.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.943+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 >> 172.21.15.41:0/3151858525 conn(0x7faa8005bca0 msgr2=0x7faa80148b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:07.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.947+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 shutdown_connections 2021-10-21T00:03:07.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:07.947+0000 7faa88405700 1 -- 172.21.15.41:0/3151858525 wait complete. 2021-10-21T00:03:07.965 INFO:teuthology.orchestra.run.smithi041.stderr:dumped all 2021-10-21T00:03:07.972 INFO:teuthology.orchestra.run.smithi041.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2021-10-21T00:03:06.305028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6366784,"kb_used_data":743228256,"kb_used_omap":592,"kb_used_meta":0,"kb_avail":743228256,"statfs":{"total":767585320960,"available":761065734144,"internally_reserved":0,"allocated":761065734144,"data_stored":761065734144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":606282,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.510117"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804139+0000","last_change":"2021-10-21T00:02:57.803826+0000","last_active":"2021-10-21T00:02:57.804139+0000","last_peered":"2021-10-21T00:02:57.804139+0000","last_clean":"2021-10-21T00:02:57.804139+0000","last_became_active":"2021-10-21T00:02:57.803364+0000","last_became_peered":"2021-10-21T00:02:57.803364+0000","last_unstale":"2021-10-21T00:02:57.804139+0000","last_undegraded":"2021-10-21T00:02:57.804139+0000","last_fullsized":"2021-10-21T00:02:57.804139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799331+0000","last_change":"2021-10-21T00:02:48.921294+0000","last_active":"2021-10-21T00:02:57.799331+0000","last_peered":"2021-10-21T00:02:57.799331+0000","last_clean":"2021-10-21T00:02:57.799331+0000","last_became_active":"2021-10-21T00:02:48.920214+0000","last_became_peered":"2021-10-21T00:02:48.920214+0000","last_unstale":"2021-10-21T00:02:57.799331+0000","last_undegraded":"2021-10-21T00:02:57.799331+0000","last_fullsized":"2021-10-21T00:02:57.799331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_clean_scrub_stamp":"2021-10-21T00:02:44.356620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800632+0000","last_change":"2021-10-21T00:02:54.442999+0000","last_active":"2021-10-21T00:02:57.800632+0000","last_peered":"2021-10-21T00:02:57.800632+0000","last_clean":"2021-10-21T00:02:57.800632+0000","last_became_active":"2021-10-21T00:02:54.442653+0000","last_became_peered":"2021-10-21T00:02:54.442653+0000","last_unstale":"2021-10-21T00:02:57.800632+0000","last_undegraded":"2021-10-21T00:02:57.800632+0000","last_fullsized":"2021-10-21T00:02:57.800632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.808349+0000","last_change":"2021-10-21T00:02:57.466019+0000","last_active":"2021-10-21T00:02:58.808349+0000","last_peered":"2021-10-21T00:02:58.808349+0000","last_clean":"2021-10-21T00:02:58.808349+0000","last_became_active":"2021-10-21T00:02:57.464076+0000","last_became_peered":"2021-10-21T00:02:57.464076+0000","last_unstale":"2021-10-21T00:02:58.808349+0000","last_undegraded":"2021-10-21T00:02:58.808349+0000","last_fullsized":"2021-10-21T00:02:58.808349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.802980+0000","last_change":"2021-10-21T00:02:57.802774+0000","last_active":"2021-10-21T00:02:57.802980+0000","last_peered":"2021-10-21T00:02:57.802980+0000","last_clean":"2021-10-21T00:02:57.802980+0000","last_became_active":"2021-10-21T00:02:57.802086+0000","last_became_peered":"2021-10-21T00:02:57.802086+0000","last_unstale":"2021-10-21T00:02:57.802980+0000","last_undegraded":"2021-10-21T00:02:57.802980+0000","last_fullsized":"2021-10-21T00:02:57.802980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799295+0000","last_change":"2021-10-21T00:02:54.443329+0000","last_active":"2021-10-21T00:02:57.799295+0000","last_peered":"2021-10-21T00:02:57.799295+0000","last_clean":"2021-10-21T00:02:57.799295+0000","last_became_active":"2021-10-21T00:02:54.442888+0000","last_became_peered":"2021-10-21T00:02:54.442888+0000","last_unstale":"2021-10-21T00:02:57.799295+0000","last_undegraded":"2021-10-21T00:02:57.799295+0000","last_fullsized":"2021-10-21T00:02:57.799295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.798400+0000","last_change":"2021-10-21T00:02:57.470066+0000","last_active":"2021-10-21T00:02:57.798400+0000","last_peered":"2021-10-21T00:02:57.798400+0000","last_clean":"2021-10-21T00:02:57.798400+0000","last_became_active":"2021-10-21T00:02:57.468298+0000","last_became_peered":"2021-10-21T00:02:57.468298+0000","last_unstale":"2021-10-21T00:02:57.798400+0000","last_undegraded":"2021-10-21T00:02:57.798400+0000","last_fullsized":"2021-10-21T00:02:57.798400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804478+0000","last_change":"2021-10-21T00:02:57.804323+0000","last_active":"2021-10-21T00:02:57.804478+0000","last_peered":"2021-10-21T00:02:57.804478+0000","last_clean":"2021-10-21T00:02:57.804478+0000","last_became_active":"2021-10-21T00:02:57.803822+0000","last_became_peered":"2021-10-21T00:02:57.803822+0000","last_unstale":"2021-10-21T00:02:57.804478+0000","last_undegraded":"2021-10-21T00:02:57.804478+0000","last_fullsized":"2021-10-21T00:02:57.804478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.065827+0000","last_change":"2021-10-21T00:02:55.009600+0000","last_active":"2021-10-21T00:02:58.065827+0000","last_peered":"2021-10-21T00:02:58.065827+0000","last_clean":"2021-10-21T00:02:58.065827+0000","last_became_active":"2021-10-21T00:02:55.009083+0000","last_became_peered":"2021-10-21T00:02:55.009083+0000","last_unstale":"2021-10-21T00:02:58.065827+0000","last_undegraded":"2021-10-21T00:02:58.065827+0000","last_fullsized":"2021-10-21T00:02:58.065827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493975+0000","last_change":"2021-10-21T00:02:57.473951+0000","last_active":"2021-10-21T00:02:59.493975+0000","last_peered":"2021-10-21T00:02:59.493975+0000","last_clean":"2021-10-21T00:02:59.493975+0000","last_became_active":"2021-10-21T00:02:57.473628+0000","last_became_peered":"2021-10-21T00:02:57.473628+0000","last_unstale":"2021-10-21T00:02:59.493975+0000","last_undegraded":"2021-10-21T00:02:59.493975+0000","last_fullsized":"2021-10-21T00:02:59.493975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:58.067436+0000","last_change":"2021-10-21T00:02:58.067286+0000","last_active":"2021-10-21T00:02:58.067436+0000","last_peered":"2021-10-21T00:02:58.067436+0000","last_clean":"2021-10-21T00:02:58.067436+0000","last_became_active":"2021-10-21T00:02:58.066988+0000","last_became_peered":"2021-10-21T00:02:58.066988+0000","last_unstale":"2021-10-21T00:02:58.067436+0000","last_undegraded":"2021-10-21T00:02:58.067436+0000","last_fullsized":"2021-10-21T00:02:58.067436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800363+0000","last_change":"2021-10-21T00:02:54.443795+0000","last_active":"2021-10-21T00:02:57.800363+0000","last_peered":"2021-10-21T00:02:57.800363+0000","last_clean":"2021-10-21T00:02:57.800363+0000","last_became_active":"2021-10-21T00:02:54.443329+0000","last_became_peered":"2021-10-21T00:02:54.443329+0000","last_unstale":"2021-10-21T00:02:57.800363+0000","last_undegraded":"2021-10-21T00:02:57.800363+0000","last_fullsized":"2021-10-21T00:02:57.800363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.487805+0000","last_change":"2021-10-21T00:02:57.469597+0000","last_active":"2021-10-21T00:02:59.487805+0000","last_peered":"2021-10-21T00:02:59.487805+0000","last_clean":"2021-10-21T00:02:59.487805+0000","last_became_active":"2021-10-21T00:02:57.469198+0000","last_became_peered":"2021-10-21T00:02:57.469198+0000","last_unstale":"2021-10-21T00:02:59.487805+0000","last_undegraded":"2021-10-21T00:02:59.487805+0000","last_fullsized":"2021-10-21T00:02:59.487805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804911+0000","last_change":"2021-10-21T00:02:57.804144+0000","last_active":"2021-10-21T00:02:57.804911+0000","last_peered":"2021-10-21T00:02:57.804911+0000","last_clean":"2021-10-21T00:02:57.804911+0000","last_became_active":"2021-10-21T00:02:57.803631+0000","last_became_peered":"2021-10-21T00:02:57.803631+0000","last_unstale":"2021-10-21T00:02:57.804911+0000","last_undegraded":"2021-10-21T00:02:57.804911+0000","last_fullsized":"2021-10-21T00:02:57.804911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493663+0000","last_change":"2021-10-21T00:02:57.466175+0000","last_active":"2021-10-21T00:02:59.493663+0000","last_peered":"2021-10-21T00:02:59.493663+0000","last_clean":"2021-10-21T00:02:59.493663+0000","last_became_active":"2021-10-21T00:02:57.464687+0000","last_became_peered":"2021-10-21T00:02:57.464687+0000","last_unstale":"2021-10-21T00:02:59.493663+0000","last_undegraded":"2021-10-21T00:02:59.493663+0000","last_fullsized":"2021-10-21T00:02:59.493663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.801009+0000","last_change":"2021-10-21T00:02:55.002147+0000","last_active":"2021-10-21T00:02:57.801009+0000","last_peered":"2021-10-21T00:02:57.801009+0000","last_clean":"2021-10-21T00:02:57.801009+0000","last_became_active":"2021-10-21T00:02:55.001733+0000","last_became_peered":"2021-10-21T00:02:55.001733+0000","last_unstale":"2021-10-21T00:02:57.801009+0000","last_undegraded":"2021-10-21T00:02:57.801009+0000","last_fullsized":"2021-10-21T00:02:57.801009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804282+0000","last_change":"2021-10-21T00:02:57.803770+0000","last_active":"2021-10-21T00:02:57.804282+0000","last_peered":"2021-10-21T00:02:57.804282+0000","last_clean":"2021-10-21T00:02:57.804282+0000","last_became_active":"2021-10-21T00:02:57.802969+0000","last_became_peered":"2021-10-21T00:02:57.802969+0000","last_unstale":"2021-10-21T00:02:57.804282+0000","last_undegraded":"2021-10-21T00:02:57.804282+0000","last_fullsized":"2021-10-21T00:02:57.804282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.495413+0000","last_change":"2021-10-21T00:02:57.473878+0000","last_active":"2021-10-21T00:02:59.495413+0000","last_peered":"2021-10-21T00:02:59.495413+0000","last_clean":"2021-10-21T00:02:59.495413+0000","last_became_active":"2021-10-21T00:02:57.473582+0000","last_became_peered":"2021-10-21T00:02:57.473582+0000","last_unstale":"2021-10-21T00:02:59.495413+0000","last_undegraded":"2021-10-21T00:02:59.495413+0000","last_fullsized":"2021-10-21T00:02:59.495413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.799417+0000","last_change":"2021-10-21T00:02:55.003763+0000","last_active":"2021-10-21T00:02:57.799417+0000","last_peered":"2021-10-21T00:02:57.799417+0000","last_clean":"2021-10-21T00:02:57.799417+0000","last_became_active":"2021-10-21T00:02:55.003018+0000","last_became_peered":"2021-10-21T00:02:55.003018+0000","last_unstale":"2021-10-21T00:02:57.799417+0000","last_undegraded":"2021-10-21T00:02:57.799417+0000","last_fullsized":"2021-10-21T00:02:57.799417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.807034+0000","last_change":"2021-10-21T00:02:57.806864+0000","last_active":"2021-10-21T00:02:57.807034+0000","last_peered":"2021-10-21T00:02:57.807034+0000","last_clean":"2021-10-21T00:02:57.807034+0000","last_became_active":"2021-10-21T00:02:57.806614+0000","last_became_peered":"2021-10-21T00:02:57.806614+0000","last_unstale":"2021-10-21T00:02:57.807034+0000","last_undegraded":"2021-10-21T00:02:57.807034+0000","last_fullsized":"2021-10-21T00:02:57.807034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.491788+0000","last_change":"2021-10-21T00:02:57.468218+0000","last_active":"2021-10-21T00:02:59.491788+0000","last_peered":"2021-10-21T00:02:59.491788+0000","last_clean":"2021-10-21T00:02:59.491788+0000","last_became_active":"2021-10-21T00:02:57.467521+0000","last_became_peered":"2021-10-21T00:02:57.467521+0000","last_unstale":"2021-10-21T00:02:59.491788+0000","last_undegraded":"2021-10-21T00:02:59.491788+0000","last_fullsized":"2021-10-21T00:02:59.491788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.801716+0000","last_change":"2021-10-21T00:02:54.444552+0000","last_active":"2021-10-21T00:02:57.801716+0000","last_peered":"2021-10-21T00:02:57.801716+0000","last_clean":"2021-10-21T00:02:57.801716+0000","last_became_active":"2021-10-21T00:02:54.443600+0000","last_became_peered":"2021-10-21T00:02:54.443600+0000","last_unstale":"2021-10-21T00:02:57.801716+0000","last_undegraded":"2021-10-21T00:02:57.801716+0000","last_fullsized":"2021-10-21T00:02:57.801716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.804991+0000","last_change":"2021-10-21T00:02:57.804761+0000","last_active":"2021-10-21T00:02:57.804991+0000","last_peered":"2021-10-21T00:02:57.804991+0000","last_clean":"2021-10-21T00:02:57.804991+0000","last_became_active":"2021-10-21T00:02:57.804241+0000","last_became_peered":"2021-10-21T00:02:57.804241+0000","last_unstale":"2021-10-21T00:02:57.804991+0000","last_undegraded":"2021-10-21T00:02:57.804991+0000","last_fullsized":"2021-10-21T00:02:57.804991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:57.453521+0000","last_clean_scrub_stamp":"2021-10-21T00:02:57.453521+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2021-10-21T00:02:59.493256+0000","last_change":"2021-10-21T00:02:57.470733+0000","last_active":"2021-10-21T00:02:59.493256+0000","last_peered":"2021-10-21T00:02:59.493256+0000","last_clean":"2021-10-21T00:02:59.493256+0000","last_became_active":"2021-10-21T00:02:57.470444+0000","last_became_peered":"2021-10-21T00:02:57.470444+0000","last_unstale":"2021-10-21T00:02:59.493256+0000","last_undegraded":"2021-10-21T00:02:59.493256+0000","last_fullsized":"2021-10-21T00:02:59.493256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:56.442973+0000","last_clean_scrub_stamp":"2021-10-21T00:02:56.442973+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2021-10-21T00:02:57.800564+0000","last_change":"2021-10-21T00:02:54.441675+0000","last_active":"2021-10-21T00:02:57.800564+0000","last_peered":"2021-10-21T00:02:57.800564+0000","last_clean":"2021-10-21T00:02:57.800564+0000","last_became_active":"2021-10-21T00:02:54.441301+0000","last_became_peered":"2021-10-21T00:02:54.441301+0000","last_unstale":"2021-10-21T00:02:57.800564+0000","last_undegraded":"2021-10-21T00:02:57.800564+0000","last_fullsized":"2021-10-21T00:02:57.800564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795848,"kb_used_data":92903532,"kb_used_omap":80,"kb_used_meta":0,"kb_avail":92903532,"statfs":{"total":95948165120,"available":95133216768,"internally_reserved":0,"allocated":95133216768,"data_stored":95133216768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82257,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795840,"kb_used_data":92903540,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903540,"statfs":{"total":95948165120,"available":95133224960,"internally_reserved":0,"allocated":95133224960,"data_stored":95133224960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43305,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795848,"kb_used_data":92903532,"kb_used_omap":77,"kb_used_meta":0,"kb_avail":92903532,"statfs":{"total":95948165120,"available":95133216768,"internally_reserved":0,"allocated":95133216768,"data_stored":95133216768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":79355,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795844,"kb_used_data":92903536,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903536,"statfs":{"total":95948165120,"available":95133220864,"internally_reserved":0,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62935,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795856,"kb_used_data":92903524,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":92903524,"statfs":{"total":95948165120,"available":95133208576,"internally_reserved":0,"allocated":95133208576,"data_stored":95133208576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66733,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903528,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":0,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73999,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903528,"kb_used_omap":100,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":0,"allocated":95133212672,"data_stored":95133212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102992,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795844,"kb_used_data":92903536,"kb_used_omap":92,"kb_used_meta":0,"kb_avail":92903536,"statfs":{"total":95948165120,"available":95133220864,"internally_reserved":0,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":94706,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]}]}} 2021-10-21T00:03:07.974 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-10-21T00:03:07.975 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-10-21T00:03:07.975 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-10-21T00:03:07.976 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-10-21T00:03:08.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 Processor -- start 2021-10-21T00:03:08.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 -- start start 2021-10-21T00:03:08.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 0x7f6f200b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200b4120 con 0x7f6f200b5310 2021-10-21T00:03:08.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200b46e0 con 0x7f6f200b0ac0 2021-10-21T00:03:08.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f252dc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200b4980 con 0x7f6f200b9b10 2021-10-21T00:03:08.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 0x7f6f200b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48278/0 (socket says 172.21.15.41:48278) 2021-10-21T00:03:08.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 -- 172.21.15.41:0/3604756636 learned_addr learned my addr 172.21.15.41:0/3604756636 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1f7fe700 1 --1- 172.21.15.41:0/3604756636 >> v1:172.21.15.62:6789/0 conn(0x7f6f200b5310 0x7f6f2005bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35608/0 (socket says 172.21.15.41:35608) 2021-10-21T00:03:08.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 -- 172.21.15.41:0/3604756636 >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 msgr2=0x7f6f200b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 --2- 172.21.15.41:0/3604756636 >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 0x7f6f200b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 -- 172.21.15.41:0/3604756636 >> v1:172.21.15.62:6789/0 conn(0x7f6f200b5310 legacy=0x7f6f2005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 -- 172.21.15.41:0/3604756636 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200b9ef0 con 0x7f6f200b9b10 2021-10-21T00:03:08.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1e7fc700 1 --2- 172.21.15.41:0/3604756636 >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 0x7f6f200b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:08.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1effd700 1 --2- 172.21.15.41:0/3604756636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6f10002f70 tx=0x7f6f10006eb0).ready entity=mon.2 client_cookie=cf54a60abf72c3b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1dffb700 1 -- 172.21.15.41:0/3604756636 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1000d570 con 0x7f6f200b9b10 2021-10-21T00:03:08.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1dffb700 1 -- 172.21.15.41:0/3604756636 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f10000e90 con 0x7f6f200b9b10 2021-10-21T00:03:08.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.075+0000 7f6f1dffb700 1 -- 172.21.15.41:0/3604756636 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1000d900 con 0x7f6f200b9b10 2021-10-21T00:03:08.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- 172.21.15.41:0/3604756636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 msgr2=0x7f6f20146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- 172.21.15.41:0/3604756636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6f10002f70 tx=0x7f6f10006eb0).stop 2021-10-21T00:03:08.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- 172.21.15.41:0/3604756636 shutdown_connections 2021-10-21T00:03:08.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- 172.21.15.41:0/3604756636 >> v2:172.21.15.62:3300/0 conn(0x7f6f200b0ac0 0x7f6f200b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- 172.21.15.41:0/3604756636 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b9b10 0x7f6f20146d30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- 172.21.15.41:0/3604756636 >> 172.21.15.41:0/3604756636 conn(0x7f6f20062ec0 msgr2=0x7f6f200b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- 172.21.15.41:0/3604756636 shutdown_connections 2021-10-21T00:03:08.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- 172.21.15.41:0/3604756636 wait complete. 2021-10-21T00:03:08.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 Processor -- start 2021-10-21T00:03:08.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- start start 2021-10-21T00:03:08.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f200b0ac0 0x7f6f200af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b5310 0x7f6f201525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20115530 con 0x7f6f200b9b10 2021-10-21T00:03:08.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201157d0 con 0x7f6f200b0ac0 2021-10-21T00:03:08.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f252dc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20115a70 con 0x7f6f200b5310 2021-10-21T00:03:08.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58022/0 (socket says 172.21.15.41:58022) 2021-10-21T00:03:08.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f1f7fe700 1 -- 172.21.15.41:0/4094398236 learned_addr learned my addr 172.21.15.41:0/4094398236 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f1e7fc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b5310 0x7f6f201525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.079+0000 7f6f1effd700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f200b0ac0 0x7f6f200af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 -- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b5310 msgr2=0x7f6f201525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b5310 0x7f6f201525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 -- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f200b0ac0 msgr2=0x7f6f200af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f200b0ac0 0x7f6f200af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 -- 172.21.15.41:0/4094398236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1400b120 con 0x7f6f200b9b10 2021-10-21T00:03:08.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f1f7fe700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6f20068770 tx=0x7f6f18007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f18005ae0 con 0x7f6f200b9b10 2021-10-21T00:03:08.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f18005c40 con 0x7f6f200b9b10 2021-10-21T00:03:08.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1000b1e0 con 0x7f6f200b9b10 2021-10-21T00:03:08.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f180070d0 con 0x7f6f200b9b10 2021-10-21T00:03:08.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201151b0 con 0x7f6f200b9b10 2021-10-21T00:03:08.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.083+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20115c30 con 0x7f6f200b9b10 2021-10-21T00:03:08.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.087+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f18010070 con 0x7f6f200b9b10 2021-10-21T00:03:08.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.087+0000 7f6f0ffff700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 0x7f6efc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.087+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f1806b090 con 0x7f6f200b9b10 2021-10-21T00:03:08.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.087+0000 7f6f1effd700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 0x7f6efc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.087+0000 7f6f1effd700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 0x7f6efc055ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6f1001c000 tx=0x7f6f10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.091+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f180421f0 con 0x7f6f200b9b10 2021-10-21T00:03:08.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.259+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f200b9750 con 0x7f6f200b9b10 2021-10-21T00:03:08.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f0ffff700 1 -- 172.21.15.41:0/4094398236 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f6f18018070 con 0x7f6f200b9b10 2021-10-21T00:03:08.271 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:08.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 msgr2=0x7f6efc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 0x7f6efc055ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6f1001c000 tx=0x7f6f10015000).stop 2021-10-21T00:03:08.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 msgr2=0x7f6f20152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6f20068770 tx=0x7f6f18007f00).stop 2021-10-21T00:03:08.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 shutdown_connections 2021-10-21T00:03:08.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6efc053610 0x7f6efc055ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6f200b9b10 0x7f6f20152ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6f200b5310 0x7f6f201525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 --2- 172.21.15.41:0/4094398236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f200b0ac0 0x7f6f200af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 >> 172.21.15.41:0/4094398236 conn(0x7f6f20062ec0 msgr2=0x7f6f200b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 shutdown_connections 2021-10-21T00:03:08.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.263+0000 7f6f252dc700 1 -- 172.21.15.41:0/4094398236 wait complete. 2021-10-21T00:03:08.284 INFO:teuthology.orchestra.run.smithi041.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-10-21T00:03:08.284 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-10-21T00:03:08.285 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:08.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 Processor -- start 2021-10-21T00:03:08.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 -- start start 2021-10-21T00:03:08.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93c0067a80 0x7f93c00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00b0b50 con 0x7f93c00af620 2021-10-21T00:03:08.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00b2550 con 0x7f93c00b2170 2021-10-21T00:03:08.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93c4911700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00b0d90 con 0x7f93c0067a80 2021-10-21T00:03:08.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93be59c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f93c00af620 0x7f93c0149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55796/0 (socket says 172.21.15.41:55796) 2021-10-21T00:03:08.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93be59c700 1 -- 172.21.15.41:0/1615326362 learned_addr learned my addr 172.21.15.41:0/1615326362 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:08.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bf59e700 1 --2- 172.21.15.41:0/1615326362 >> v2:172.21.15.62:3300/0 conn(0x7f93c0067a80 0x7f93c00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971890976 0 0) 0x7f93b8001490 con 0x7f93c00af620 2021-10-21T00:03:08.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a4003260 con 0x7f93c00af620 2021-10-21T00:03:08.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368908576 0 0) 0x7f93c00b2550 con 0x7f93c00b2170 2021-10-21T00:03:08.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b8001490 con 0x7f93c00b2170 2021-10-21T00:03:08.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214129962 0 0) 0x7f93a4003260 con 0x7f93c00af620 2021-10-21T00:03:08.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 >> v2:172.21.15.62:3300/0 conn(0x7f93c0067a80 msgr2=0x7f93c00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 --2- 172.21.15.41:0/1615326362 >> v2:172.21.15.62:3300/0 conn(0x7f93c0067a80 0x7f93c00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 >> v1:172.21.15.62:6789/0 conn(0x7f93c00b2170 legacy=0x7f93c00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00b1030 con 0x7f93c00af620 2021-10-21T00:03:08.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f93b8001b70 con 0x7f93c00af620 2021-10-21T00:03:08.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 >> v1:172.21.15.41:6789/0 conn(0x7f93c00af620 legacy=0x7f93c0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93a4003910 0x7f93a4003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 0x7f93a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004e70 0x7f93a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00b0d90 con 0x7f93a4004500 2021-10-21T00:03:08.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a400bd20 con 0x7f93a4004e70 2021-10-21T00:03:08.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.379+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a400bee0 con 0x7f93a4003910 2021-10-21T00:03:08.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 0x7f93a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bed9d700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93a4003910 0x7f93a4003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bf59e700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004e70 0x7f93a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 -- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93a4003910 msgr2=0x7f93a4003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93a4003910 0x7f93a4003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 -- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004e70 msgr2=0x7f93a400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004e70 0x7f93a400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bf59e700 1 -- 172.21.15.41:0/1615326362 reap_dead start 2021-10-21T00:03:08.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 -- 172.21.15.41:0/1615326362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4003260 con 0x7f93a4004500 2021-10-21T00:03:08.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93be59c700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 0x7f93a4004980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f93b8001940 tx=0x7f93c00b11c0).ready entity=mon.0 client_cookie=2e88a0af5db8f443 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b800cd10 con 0x7f93a4004500 2021-10-21T00:03:08.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800ce70 con 0x7f93a4004500 2021-10-21T00:03:08.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93bdd9b700 1 -- 172.21.15.41:0/1615326362 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b8005b80 con 0x7f93a4004500 2021-10-21T00:03:08.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 -- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 msgr2=0x7f93a4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 0x7f93a4004980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f93b8001940 tx=0x7f93c00b11c0).stop 2021-10-21T00:03:08.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 -- 172.21.15.41:0/1615326362 shutdown_connections 2021-10-21T00:03:08.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 --2- 172.21.15.41:0/1615326362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93a4004500 0x7f93a4004980 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 -- 172.21.15.41:0/1615326362 >> 172.21.15.41:0/1615326362 conn(0x7f93c00b5700 msgr2=0x7f93c00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 -- 172.21.15.41:0/1615326362 shutdown_connections 2021-10-21T00:03:08.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.383+0000 7f93c4911700 1 -- 172.21.15.41:0/1615326362 wait complete. 2021-10-21T00:03:08.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 Processor -- start 2021-10-21T00:03:08.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- start start 2021-10-21T00:03:08.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 0x7f93c0064880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93c01487d0 0x7f93c0064f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c008fa10 con 0x7f93c00672b0 2021-10-21T00:03:08.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00ad3b0 con 0x7f93a4004500 2021-10-21T00:03:08.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c008f540 con 0x7f93c01487d0 2021-10-21T00:03:08.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58040/0 (socket says 172.21.15.41:58040) 2021-10-21T00:03:08.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 -- 172.21.15.41:0/2023627346 learned_addr learned my addr 172.21.15.41:0/2023627346 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93bf59e700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93c01487d0 0x7f93c0064f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93bed9d700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 0x7f93c0064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 -- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93c01487d0 msgr2=0x7f93c0064f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93c01487d0 0x7f93c0064f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 -- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 msgr2=0x7f93c0064880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 0x7f93c0064880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 -- 172.21.15.41:0/2023627346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c008f7e0 con 0x7f93c00672b0 2021-10-21T00:03:08.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93bed9d700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 0x7f93c0064880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:08.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93be59c700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f93b8001940 tx=0x7f93b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b80020a0 con 0x7f93c00672b0 2021-10-21T00:03:08.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80072c0 con 0x7f93c00672b0 2021-10-21T00:03:08.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0066e10 con 0x7f93c00672b0 2021-10-21T00:03:08.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93b8007620 con 0x7f93c00672b0 2021-10-21T00:03:08.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.387+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c00655d0 con 0x7f93c00672b0 2021-10-21T00:03:08.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c0065a20 con 0x7f93c00672b0 2021-10-21T00:03:08.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f93b8025020 con 0x7f93c00672b0 2021-10-21T00:03:08.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93affff700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 0x7f939c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93b806c880 con 0x7f93c00672b0 2021-10-21T00:03:08.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93bed9d700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 0x7f939c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.391+0000 7f93bed9d700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 0x7f939c055a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f93b4003000 tx=0x7f93b4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.395+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93b80439e0 con 0x7f93c00672b0 2021-10-21T00:03:08.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.519+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93c00b0b50 con 0x7f93c00672b0 2021-10-21T00:03:08.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93affff700 1 -- 172.21.15.41:0/2023627346 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f93c00b0b50 con 0x7f93c00672b0 2021-10-21T00:03:08.531 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:08.531 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:08.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 msgr2=0x7f939c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 0x7f939c055a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f93b4003000 tx=0x7f93b4009040).stop 2021-10-21T00:03:08.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 msgr2=0x7f93c00ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f93b8001940 tx=0x7f93b8015000).stop 2021-10-21T00:03:08.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 shutdown_connections 2021-10-21T00:03:08.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f939c053580 0x7f939c055a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93c01487d0 0x7f93c0064f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93c00672b0 0x7f93c00ac700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 --2- 172.21.15.41:0/2023627346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93a4004500 0x7f93c0064880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 >> 172.21.15.41:0/2023627346 conn(0x7f93c00b5700 msgr2=0x7f93c005fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 shutdown_connections 2021-10-21T00:03:08.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.523+0000 7f93c4911700 1 -- 172.21.15.41:0/2023627346 wait complete. 2021-10-21T00:03:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:08.546 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:08.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 Processor -- start 2021-10-21T00:03:08.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 -- start start 2021-10-21T00:03:08.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a700b5f70 0x7f3a700b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a700677e0 0x7f3a7013ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a700b6350 con 0x7f3a700677e0 2021-10-21T00:03:08.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a700b0e10 con 0x7f3a700b5f70 2021-10-21T00:03:08.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7743f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700b10b0 con 0x7f3a701423a0 2021-10-21T00:03:08.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a700677e0 0x7f3a7013ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a700677e0 0x7f3a7013ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58048/0 (socket says 172.21.15.41:58048) 2021-10-21T00:03:08.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 -- 172.21.15.41:0/2084585653 learned_addr learned my addr 172.21.15.41:0/2084585653 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7643d700 1 --2- 172.21.15.41:0/2084585653 >> v2:172.21.15.62:3300/0 conn(0x7f3a700b5f70 0x7f3a700b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a75c3c700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 -- 172.21.15.41:0/2084585653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 msgr2=0x7f3a700672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700672f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 -- 172.21.15.41:0/2084585653 >> v2:172.21.15.62:3300/0 conn(0x7f3a700b5f70 msgr2=0x7f3a700b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 --2- 172.21.15.41:0/2084585653 >> v2:172.21.15.62:3300/0 conn(0x7f3a700b5f70 0x7f3a700b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 -- 172.21.15.41:0/2084585653 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700b1350 con 0x7f3a700677e0 2021-10-21T00:03:08.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a76c3e700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700677e0 0x7f3a7013ee00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3a680032f0 tx=0x7f3a68009290).ready entity=mon.0 client_cookie=8488960db4469be4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7543b700 1 -- 172.21.15.41:0/2084585653 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6800b680 con 0x7f3a700677e0 2021-10-21T00:03:08.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7543b700 1 -- 172.21.15.41:0/2084585653 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6800b7e0 con 0x7f3a700677e0 2021-10-21T00:03:08.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.647+0000 7f3a7543b700 1 -- 172.21.15.41:0/2084585653 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6800b950 con 0x7f3a700677e0 2021-10-21T00:03:08.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- 172.21.15.41:0/2084585653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700677e0 msgr2=0x7f3a7013ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700677e0 0x7f3a7013ee00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3a680032f0 tx=0x7f3a68009290).stop 2021-10-21T00:03:08.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- 172.21.15.41:0/2084585653 shutdown_connections 2021-10-21T00:03:08.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700677e0 0x7f3a7013ee00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- 172.21.15.41:0/2084585653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- 172.21.15.41:0/2084585653 >> v2:172.21.15.62:3300/0 conn(0x7f3a700b5f70 0x7f3a700b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- 172.21.15.41:0/2084585653 >> 172.21.15.41:0/2084585653 conn(0x7f3a700639f0 msgr2=0x7f3a700b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- 172.21.15.41:0/2084585653 shutdown_connections 2021-10-21T00:03:08.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- 172.21.15.41:0/2084585653 wait complete. 2021-10-21T00:03:08.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 Processor -- start 2021-10-21T00:03:08.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- start start 2021-10-21T00:03:08.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a700677e0 0x7f3a700642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70065b90 con 0x7f3a700b5f70 2021-10-21T00:03:08.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70065e30 con 0x7f3a700677e0 2021-10-21T00:03:08.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7743f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700660d0 con 0x7f3a701423a0 2021-10-21T00:03:08.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a75c3c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a75c3c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58054/0 (socket says 172.21.15.41:58054) 2021-10-21T00:03:08.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a75c3c700 1 -- 172.21.15.41:0/906572063 learned_addr learned my addr 172.21.15.41:0/906572063 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a7643d700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a700677e0 0x7f3a700642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.651+0000 7f3a76c3e700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 -- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 msgr2=0x7f3a700b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 -- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a700677e0 msgr2=0x7f3a700642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a700677e0 0x7f3a700642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 -- 172.21.15.41:0/906572063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009530 con 0x7f3a700b5f70 2021-10-21T00:03:08.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a75c3c700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a6c00c000 tx=0x7f3a6c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c010780 con 0x7f3a700b5f70 2021-10-21T00:03:08.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0108e0 con 0x7f3a700b5f70 2021-10-21T00:03:08.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c010c40 con 0x7f3a700b5f70 2021-10-21T00:03:08.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a70066570 con 0x7f3a700b5f70 2021-10-21T00:03:08.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a70065820 con 0x7f3a700b5f70 2021-10-21T00:03:08.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a70066290 con 0x7f3a700b5f70 2021-10-21T00:03:08.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.655+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a6c01c460 con 0x7f3a700b5f70 2021-10-21T00:03:08.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.659+0000 7f3a5f7fe700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 0x7f3a50055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.659+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a6c06be40 con 0x7f3a700b5f70 2021-10-21T00:03:08.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.659+0000 7f3a7643d700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 0x7f3a50055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.659+0000 7f3a7643d700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 0x7f3a50055a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3a6000b000 tx=0x7f3a60006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.663+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a6c042e30 con 0x7f3a700b5f70 2021-10-21T00:03:08.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.787+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a700b15f0 con 0x7f3a700b5f70 2021-10-21T00:03:08.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a5f7fe700 1 -- 172.21.15.41:0/906572063 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3a6c046450 con 0x7f3a700b5f70 2021-10-21T00:03:08.799 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:08.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 msgr2=0x7f3a50055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 0x7f3a50055a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3a6000b000 tx=0x7f3a60006df0).stop 2021-10-21T00:03:08.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 msgr2=0x7f3a700b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a6c00c000 tx=0x7f3a6c006df0).stop 2021-10-21T00:03:08.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 shutdown_connections 2021-10-21T00:03:08.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a50053580 0x7f3a50055a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a701423a0 0x7f3a700b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a700b5f70 0x7f3a700b3350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 --2- 172.21.15.41:0/906572063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a700677e0 0x7f3a700642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 >> 172.21.15.41:0/906572063 conn(0x7f3a700639f0 msgr2=0x7f3a700af070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 shutdown_connections 2021-10-21T00:03:08.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.791+0000 7f3a7743f700 1 -- 172.21.15.41:0/906572063 wait complete. 2021-10-21T00:03:08.812 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:08.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.915+0000 7f32ff013700 1 Processor -- start 2021-10-21T00:03:08.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.915+0000 7f32ff013700 1 -- start start 2021-10-21T00:03:08.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32f80b9ca0 0x7f32f80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f32f80b26d0 0x7f32f8141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80ba080 con 0x7f32f80b31e0 2021-10-21T00:03:08.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f805c670 con 0x7f32f80b26d0 2021-10-21T00:03:08.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f805c8e0 con 0x7f32f80b9ca0 2021-10-21T00:03:08.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f32f80b31e0 0x7f32f80b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55830/0 (socket says 172.21.15.41:55830) 2021-10-21T00:03:08.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f7fff700 1 -- 172.21.15.41:0/3835525802 learned_addr learned my addr 172.21.15.41:0/3835525802 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:08.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> v2:172.21.15.41:3300/0 conn(0x7f32f80b26d0 0x7f32f8141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fcdaf700 1 --2- 172.21.15.41:0/3835525802 >> v2:172.21.15.62:3300/0 conn(0x7f32f80b9ca0 0x7f32f80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817227117 0 0) 0x7f32f80ba080 con 0x7f32f80b31e0 2021-10-21T00:03:08.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32dc003260 con 0x7f32f80b31e0 2021-10-21T00:03:08.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 513962762 0 0) 0x7f32dc003260 con 0x7f32f80b31e0 2021-10-21T00:03:08.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 >> v2:172.21.15.62:3300/0 conn(0x7f32f80b9ca0 msgr2=0x7f32f80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 --2- 172.21.15.41:0/3835525802 >> v2:172.21.15.62:3300/0 conn(0x7f32f80b9ca0 0x7f32f80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 >> v2:172.21.15.41:3300/0 conn(0x7f32f80b26d0 msgr2=0x7f32f8141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 --2- 172.21.15.41:0/3835525802 >> v2:172.21.15.41:3300/0 conn(0x7f32f80b26d0 0x7f32f8141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f805cb80 con 0x7f32f80b31e0 2021-10-21T00:03:08.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f32e00019e0 con 0x7f32f80b31e0 2021-10-21T00:03:08.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 >> v1:172.21.15.41:6789/0 conn(0x7f32f80b31e0 legacy=0x7f32f80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32dc003820 0x7f32dc003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004500 0x7f32dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 0x7f32dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f805c670 con 0x7f32dc004e70 2021-10-21T00:03:08.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f805c8e0 con 0x7f32dc003820 2021-10-21T00:03:08.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc00bd70 con 0x7f32dc004500 2021-10-21T00:03:08.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> v2:172.21.15.41:3300/0 conn(0x7f32f80b26d0 0x7f32f8141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:08.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f7fff700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004500 0x7f32dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fcdaf700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32dc003820 0x7f32dc003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 0x7f32dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 -- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004500 msgr2=0x7f32dc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004500 0x7f32dc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 -- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32dc003820 msgr2=0x7f32dc003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:08.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32dc003820 0x7f32dc003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 -- 172.21.15.41:0/3835525802 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc003260 con 0x7f32dc004e70 2021-10-21T00:03:08.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 -- 172.21.15.41:0/3835525802 reap_dead start 2021-10-21T00:03:08.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 0x7f32dc00b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f32e800c000 tx=0x7f32e8006df0).ready entity=mon.0 client_cookie=b6e3bac5e66a1806 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32e800e800 con 0x7f32dc004e70 2021-10-21T00:03:08.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800e960 con 0x7f32dc004e70 2021-10-21T00:03:08.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32f77fe700 1 -- 172.21.15.41:0/3835525802 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32e800ecc0 con 0x7f32dc004e70 2021-10-21T00:03:08.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 -- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 msgr2=0x7f32dc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.919+0000 7f32ff013700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 0x7f32dc00b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f32e800c000 tx=0x7f32e8006df0).stop 2021-10-21T00:03:08.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- 172.21.15.41:0/3835525802 shutdown_connections 2021-10-21T00:03:08.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 --2- 172.21.15.41:0/3835525802 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32dc004e70 0x7f32dc00b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- 172.21.15.41:0/3835525802 >> 172.21.15.41:0/3835525802 conn(0x7f32f8062f00 msgr2=0x7f32f80b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:08.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- 172.21.15.41:0/3835525802 shutdown_connections 2021-10-21T00:03:08.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- 172.21.15.41:0/3835525802 wait complete. 2021-10-21T00:03:08.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 Processor -- start 2021-10-21T00:03:08.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- start start 2021-10-21T00:03:08.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 0x7f32f80adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32f80afc60 0x7f32f8142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 0x7f32f8113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f8155570 con 0x7f32f81550f0 2021-10-21T00:03:08.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80ad7c0 con 0x7f32f80afc60 2021-10-21T00:03:08.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32ff013700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80ada60 con 0x7f32dc004e70 2021-10-21T00:03:08.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fcdaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 0x7f32f80adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 0x7f32f8113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fcdaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 0x7f32f80adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48338/0 (socket says 172.21.15.41:48338) 2021-10-21T00:03:08.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fcdaf700 1 -- 172.21.15.41:0/730808785 learned_addr learned my addr 172.21.15.41:0/730808785 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:08.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32f7fff700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32f80afc60 0x7f32f8142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 -- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 msgr2=0x7f32f80adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 0x7f32f80adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 -- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32f80afc60 msgr2=0x7f32f8142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:08.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32f80afc60 0x7f32f8142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:08.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.923+0000 7f32fd5b0700 1 -- 172.21.15.41:0/730808785 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8113460 con 0x7f32f81550f0 2021-10-21T00:03:08.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32fd5b0700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 0x7f32f8113900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f32e800c000 tx=0x7f32e8019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32e801b610 con 0x7f32f81550f0 2021-10-21T00:03:08.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8000e90 con 0x7f32f81550f0 2021-10-21T00:03:08.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f8113df0 con 0x7f32f81550f0 2021-10-21T00:03:08.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32e801b960 con 0x7f32f81550f0 2021-10-21T00:03:08.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f8142c70 con 0x7f32f81550f0 2021-10-21T00:03:08.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f80b0040 con 0x7f32f81550f0 2021-10-21T00:03:08.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f32e801bac0 con 0x7f32f81550f0 2021-10-21T00:03:08.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 0x7f32d0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:08.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f32e806c770 con 0x7f32f81550f0 2021-10-21T00:03:08.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.927+0000 7f32fcdaf700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 0x7f32d0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:08.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.931+0000 7f32fcdaf700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 0x7f32d0055a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f32f000b000 tx=0x7f32f0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:08.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:08.935+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32e80438d0 con 0x7f32f81550f0 2021-10-21T00:03:09.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.063+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32f81135f0 con 0x7f32f81550f0 2021-10-21T00:03:09.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.063+0000 7f32f5ffb700 1 -- 172.21.15.41:0/730808785 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32e8046ef0 con 0x7f32f81550f0 2021-10-21T00:03:09.073 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:09.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 msgr2=0x7f32d0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 0x7f32d0055a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f32f000b000 tx=0x7f32f0006df0).stop 2021-10-21T00:03:09.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 msgr2=0x7f32f8113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 0x7f32f8113900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f32e800c000 tx=0x7f32e8019000).stop 2021-10-21T00:03:09.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 shutdown_connections 2021-10-21T00:03:09.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32d00535b0 0x7f32d0055a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32f81550f0 0x7f32f8113900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32f80afc60 0x7f32f8142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 --2- 172.21.15.41:0/730808785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32dc004e70 0x7f32f80adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 >> 172.21.15.41:0/730808785 conn(0x7f32f8062f00 msgr2=0x7f32f80b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 shutdown_connections 2021-10-21T00:03:09.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.067+0000 7f32ff013700 1 -- 172.21.15.41:0/730808785 wait complete. 2021-10-21T00:03:09.086 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:09.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.183+0000 7fdc79120700 1 Processor -- start 2021-10-21T00:03:09.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.183+0000 7fdc79120700 1 -- start start 2021-10-21T00:03:09.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc740b1800 0x7fdc740b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 0x7fdc74142940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7405caf0 con 0x7fdc740af770 2021-10-21T00:03:09.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc74146e00 con 0x7fdc740b1800 2021-10-21T00:03:09.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7405bfb0 con 0x7fdc7413c670 2021-10-21T00:03:09.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc740b1800 0x7fdc740b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc740b1800 0x7fdc740b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58082/0 (socket says 172.21.15.41:58082) 2021-10-21T00:03:09.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 -- 172.21.15.41:0/97836344 learned_addr learned my addr 172.21.15.41:0/97836344 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:09.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc7891f700 1 --2- 172.21.15.41:0/97836344 >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 0x7fdc74142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 -- 172.21.15.41:0/97836344 >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 msgr2=0x7fdc74142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 --2- 172.21.15.41:0/97836344 >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 0x7fdc74142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 -- 172.21.15.41:0/97836344 >> v1:172.21.15.62:6789/0 conn(0x7fdc740af770 legacy=0x7fdc741466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 -- 172.21.15.41:0/97836344 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74145fb0 con 0x7fdc740b1800 2021-10-21T00:03:09.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc72ffd700 1 -- 172.21.15.41:0/97836344 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375937984 0 0) 0x7fdc7405caf0 con 0x7fdc740af770 2021-10-21T00:03:09.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc7891f700 1 --2- 172.21.15.41:0/97836344 >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 0x7fdc74142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:09.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc73fff700 1 --2- 172.21.15.41:0/97836344 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc740b1800 0x7fdc740b1be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc64002f70 tx=0x7fdc64006eb0).ready entity=mon.0 client_cookie=dde10e044d3dcee2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc72ffd700 1 -- 172.21.15.41:0/97836344 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc6400d610 con 0x7fdc740b1800 2021-10-21T00:03:09.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc72ffd700 1 -- 172.21.15.41:0/97836344 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64000e90 con 0x7fdc740b1800 2021-10-21T00:03:09.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc72ffd700 1 -- 172.21.15.41:0/97836344 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc6400d960 con 0x7fdc740b1800 2021-10-21T00:03:09.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- 172.21.15.41:0/97836344 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc740b1800 msgr2=0x7fdc740b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 --2- 172.21.15.41:0/97836344 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc740b1800 0x7fdc740b1be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc64002f70 tx=0x7fdc64006eb0).stop 2021-10-21T00:03:09.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- 172.21.15.41:0/97836344 shutdown_connections 2021-10-21T00:03:09.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 --2- 172.21.15.41:0/97836344 >> v2:172.21.15.62:3300/0 conn(0x7fdc7413c670 0x7fdc74142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 --2- 172.21.15.41:0/97836344 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc740b1800 0x7fdc740b1be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- 172.21.15.41:0/97836344 >> 172.21.15.41:0/97836344 conn(0x7fdc740627b0 msgr2=0x7fdc74062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- 172.21.15.41:0/97836344 shutdown_connections 2021-10-21T00:03:09.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.187+0000 7fdc79120700 1 -- 172.21.15.41:0/97836344 wait complete. 2021-10-21T00:03:09.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 Processor -- start 2021-10-21T00:03:09.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- start start 2021-10-21T00:03:09.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc740af770 0x7fdc74152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc740b1800 0x7fdc7413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7413f740 con 0x7fdc7413c670 2021-10-21T00:03:09.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7413ccd0 con 0x7fdc740b1800 2021-10-21T00:03:09.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7413cf00 con 0x7fdc740af770 2021-10-21T00:03:09.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58090/0 (socket says 172.21.15.41:58090) 2021-10-21T00:03:09.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 -- 172.21.15.41:0/3022872982 learned_addr learned my addr 172.21.15.41:0/3022872982 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:09.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc73fff700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc740af770 0x7fdc74152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc737fe700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc740b1800 0x7fdc7413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 -- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc740af770 msgr2=0x7fdc74152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc740af770 0x7fdc74152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 -- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc740b1800 msgr2=0x7fdc7413e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc740b1800 0x7fdc7413e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 -- 172.21.15.41:0/3022872982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6400b1e0 con 0x7fdc7413c670 2021-10-21T00:03:09.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc7891f700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdc6c006cc0 tx=0x7fdc6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc6c00f710 con 0x7fdc7413c670 2021-10-21T00:03:09.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c00f870 con 0x7fdc7413c670 2021-10-21T00:03:09.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc6c00fbd0 con 0x7fdc7413c670 2021-10-21T00:03:09.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7413d1a0 con 0x7fdc7413c670 2021-10-21T00:03:09.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.191+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7413f010 con 0x7fdc7413c670 2021-10-21T00:03:09.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc6c01a030 con 0x7fdc7413c670 2021-10-21T00:03:09.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc74146250 con 0x7fdc7413c670 2021-10-21T00:03:09.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc717fa700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 0x7fdc58055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc6c06b8b0 con 0x7fdc7413c670 2021-10-21T00:03:09.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc73fff700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 0x7fdc58055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.195+0000 7fdc73fff700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 0x7fdc58055ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc6401c000 tx=0x7fdc64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.199+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc6c042a10 con 0x7fdc7413c670 2021-10-21T00:03:09.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.327+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc740b1be0 con 0x7fdc7413c670 2021-10-21T00:03:09.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.327+0000 7fdc717fa700 1 -- 172.21.15.41:0/3022872982 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdc6c046030 con 0x7fdc7413c670 2021-10-21T00:03:09.336 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:09.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 msgr2=0x7fdc58055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 0x7fdc58055ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc6401c000 tx=0x7fdc64015000).stop 2021-10-21T00:03:09.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 msgr2=0x7fdc7413e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdc6c006cc0 tx=0x7fdc6c008040).stop 2021-10-21T00:03:09.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 shutdown_connections 2021-10-21T00:03:09.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc58053610 0x7fdc58055ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc7413c670 0x7fdc7413e850 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc740b1800 0x7fdc7413e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 --2- 172.21.15.41:0/3022872982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc740af770 0x7fdc74152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 >> 172.21.15.41:0/3022872982 conn(0x7fdc740627b0 msgr2=0x7fdc74142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 shutdown_connections 2021-10-21T00:03:09.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.331+0000 7fdc79120700 1 -- 172.21.15.41:0/3022872982 wait complete. 2021-10-21T00:03:09.356 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:09.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 Processor -- start 2021-10-21T00:03:09.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 -- start start 2021-10-21T00:03:09.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f08ac13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f08ac066110 0x7f08ac14b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0b76e0 con 0x7f08ac13a9b0 2021-10-21T00:03:09.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac144de0 con 0x7f08ac066110 2021-10-21T00:03:09.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b4285700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0ac890 con 0x7f08ac0b7300 2021-10-21T00:03:09.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b1820700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f08ac13a9b0 0x7f08ac065a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55864/0 (socket says 172.21.15.41:55864) 2021-10-21T00:03:09.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.463+0000 7f08b1820700 1 -- 172.21.15.41:0/1518307517 learned_addr learned my addr 172.21.15.41:0/1518307517 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:09.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b2021700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f08ac13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b2822700 1 --2- 172.21.15.41:0/1518307517 >> v2:172.21.15.62:3300/0 conn(0x7f08ac066110 0x7f08ac14b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973806232 0 0) 0x7f08ac0b76e0 con 0x7f08ac13a9b0 2021-10-21T00:03:09.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0894003260 con 0x7f08ac13a9b0 2021-10-21T00:03:09.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910216391 0 0) 0x7f0894003260 con 0x7f08ac13a9b0 2021-10-21T00:03:09.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 msgr2=0x7f08ac13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f08ac13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 >> v2:172.21.15.62:3300/0 conn(0x7f08ac066110 msgr2=0x7f08ac14b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 --2- 172.21.15.41:0/1518307517 >> v2:172.21.15.62:3300/0 conn(0x7f08ac066110 0x7f08ac14b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0acb30 con 0x7f08ac13a9b0 2021-10-21T00:03:09.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f08a0001660 con 0x7f08ac13a9b0 2021-10-21T00:03:09.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 >> v1:172.21.15.41:6789/0 conn(0x7f08ac13a9b0 legacy=0x7f08ac065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f0894003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f0894004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08940049f0 0x7f0894004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac144de0 con 0x7f0894003c80 2021-10-21T00:03:09.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0ac890 con 0x7f08940049f0 2021-10-21T00:03:09.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089400b750 con 0x7f08ac0b7300 2021-10-21T00:03:09.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f0894004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b2021700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f0894003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b2822700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08940049f0 0x7f0894004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 -- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 msgr2=0x7f0894003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b7300 0x7f0894003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 -- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08940049f0 msgr2=0x7f0894004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08940049f0 0x7f0894004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 -- 172.21.15.41:0/1518307517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894003260 con 0x7f0894003c80 2021-10-21T00:03:09.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b1820700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f0894004500 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f08940054d0 tx=0x7f08a0001e50).ready entity=mon.0 client_cookie=a4d454f8ccde6f98 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a00070d0 con 0x7f0894003c80 2021-10-21T00:03:09.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0007230 con 0x7f0894003c80 2021-10-21T00:03:09.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b101f700 1 -- 172.21.15.41:0/1518307517 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a000c980 con 0x7f0894003c80 2021-10-21T00:03:09.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 -- 172.21.15.41:0/1518307517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 msgr2=0x7f0894004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 --2- 172.21.15.41:0/1518307517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f0894004500 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f08940054d0 tx=0x7f08a0001e50).stop 2021-10-21T00:03:09.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b2822700 1 -- 172.21.15.41:0/1518307517 reap_dead start 2021-10-21T00:03:09.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 -- 172.21.15.41:0/1518307517 shutdown_connections 2021-10-21T00:03:09.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 -- 172.21.15.41:0/1518307517 >> 172.21.15.41:0/1518307517 conn(0x7f08ac069df0 msgr2=0x7f08ac064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 -- 172.21.15.41:0/1518307517 shutdown_connections 2021-10-21T00:03:09.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.467+0000 7f08b4285700 1 -- 172.21.15.41:0/1518307517 wait complete. 2021-10-21T00:03:09.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 Processor -- start 2021-10-21T00:03:09.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- start start 2021-10-21T00:03:09.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08ac061db0 0x7f08ac0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 0x7f08ac0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0af8a0 con 0x7f0894003c80 2021-10-21T00:03:09.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0ae440 con 0x7f08ac061db0 2021-10-21T00:03:09.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0ae6e0 con 0x7f08ac0b0840 2021-10-21T00:03:09.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b1820700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08ac061db0 0x7f08ac0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2822700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 0x7f08ac0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58106/0 (socket says 172.21.15.41:58106) 2021-10-21T00:03:09.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2822700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 0x7f08ac0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48374/0 (socket says 172.21.15.41:48374) 2021-10-21T00:03:09.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 -- 172.21.15.41:0/2662549138 learned_addr learned my addr 172.21.15.41:0/2662549138 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:09.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 -- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 msgr2=0x7f08ac0b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 0x7f08ac0b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 -- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08ac061db0 msgr2=0x7f08ac0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08ac061db0 0x7f08ac0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 -- 172.21.15.41:0/2662549138 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0ae980 con 0x7f0894003c80 2021-10-21T00:03:09.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b2021700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f08a800b000 tx=0x7f08a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a8012610 con 0x7f0894003c80 2021-10-21T00:03:09.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8012770 con 0x7f0894003c80 2021-10-21T00:03:09.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac0aee20 con 0x7f0894003c80 2021-10-21T00:03:09.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a8012ad0 con 0x7f0894003c80 2021-10-21T00:03:09.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.471+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac142f00 con 0x7f0894003c80 2021-10-21T00:03:09.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08a8012c30 con 0x7f0894003c80 2021-10-21T00:03:09.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac0aeb10 con 0x7f0894003c80 2021-10-21T00:03:09.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f089f7fe700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 0x7f088c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f08a806c240 con 0x7f0894003c80 2021-10-21T00:03:09.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f08b1820700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 0x7f088c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.475+0000 7f08b1820700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 0x7f088c055b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f08a001a000 tx=0x7f08a0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.479+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08a8043210 con 0x7f0894003c80 2021-10-21T00:03:09.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08ac0ad9d0 con 0x7f0894003c80 2021-10-21T00:03:09.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f089f7fe700 1 -- 172.21.15.41:0/2662549138 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f08a8006980 con 0x7f0894003c80 2021-10-21T00:03:09.615 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:09.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 msgr2=0x7f088c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 0x7f088c055b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f08a001a000 tx=0x7f08a0015000).stop 2021-10-21T00:03:09.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 msgr2=0x7f08ac138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f08a800b000 tx=0x7f08a8008040).stop 2021-10-21T00:03:09.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 shutdown_connections 2021-10-21T00:03:09.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f088c0536a0 0x7f088c055b60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08ac0b0840 0x7f08ac0b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08ac061db0 0x7f08ac0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 --2- 172.21.15.41:0/2662549138 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0894003c80 0x7f08ac138ed0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 >> 172.21.15.41:0/2662549138 conn(0x7f08ac069df0 msgr2=0x7f08ac0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 shutdown_connections 2021-10-21T00:03:09.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.607+0000 7f08b4285700 1 -- 172.21.15.41:0/2662549138 wait complete. 2021-10-21T00:03:09.631 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:09.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.727+0000 7f0ba49fc700 1 Processor -- start 2021-10-21T00:03:09.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.727+0000 7f0ba49fc700 1 -- start start 2021-10-21T00:03:09.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ba0062f70 0x7f0ba005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 0x7f0ba013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba005bd40 con 0x7f0ba0062330 2021-10-21T00:03:09.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba005bf70 con 0x7f0ba0062f70 2021-10-21T00:03:09.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0142cb0 con 0x7f0ba00b3a20 2021-10-21T00:03:09.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ba0062f70 0x7f0ba005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 0x7f0ba013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ba0062f70 0x7f0ba005c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58116/0 (socket says 172.21.15.41:58116) 2021-10-21T00:03:09.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 -- 172.21.15.41:0/1483482897 learned_addr learned my addr 172.21.15.41:0/1483482897 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:09.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9f7fe700 1 --1- 172.21.15.41:0/1483482897 >> v1:172.21.15.62:6789/0 conn(0x7f0ba0062330 0x7f0ba00b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35708/0 (socket says 172.21.15.41:35708) 2021-10-21T00:03:09.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 -- 172.21.15.41:0/1483482897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 msgr2=0x7f0ba013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:09.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 0x7f0ba013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 -- 172.21.15.41:0/1483482897 >> v1:172.21.15.62:6789/0 conn(0x7f0ba0062330 legacy=0x7f0ba00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9e7fc700 1 -- 172.21.15.41:0/1483482897 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374344672 0 0) 0x7f0ba005bd40 con 0x7f0ba0062330 2021-10-21T00:03:09.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 -- 172.21.15.41:0/1483482897 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba0142950 con 0x7f0ba0062f70 2021-10-21T00:03:09.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9ffff700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 0x7f0ba013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:09.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062f70 0x7f0ba005c410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0b880032f0 tx=0x7f0b88009290).ready entity=mon.0 client_cookie=75d6951f5e57fab9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9e7fc700 1 -- 172.21.15.41:0/1483482897 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8800b8a0 con 0x7f0ba0062f70 2021-10-21T00:03:09.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9e7fc700 1 -- 172.21.15.41:0/1483482897 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800ba00 con 0x7f0ba0062f70 2021-10-21T00:03:09.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0b9e7fc700 1 -- 172.21.15.41:0/1483482897 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8800bb70 con 0x7f0ba0062f70 2021-10-21T00:03:09.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1483482897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062f70 msgr2=0x7f0ba005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062f70 0x7f0ba005c410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0b880032f0 tx=0x7f0b88009290).stop 2021-10-21T00:03:09.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1483482897 shutdown_connections 2021-10-21T00:03:09.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba00b3a20 0x7f0ba013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1483482897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062f70 0x7f0ba005c410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.731+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1483482897 >> 172.21.15.41:0/1483482897 conn(0x7f0ba00b9080 msgr2=0x7f0ba00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.735+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1483482897 shutdown_connections 2021-10-21T00:03:09.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.735+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1483482897 wait complete. 2021-10-21T00:03:09.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.735+0000 7f0ba49fc700 1 Processor -- start 2021-10-21T00:03:09.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.735+0000 7f0ba49fc700 1 -- start start 2021-10-21T00:03:09.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 0x7f0ba0146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba00b3a20 0x7f0ba0146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0145ae0 con 0x7f0ba0062330 2021-10-21T00:03:09.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0146e30 con 0x7f0ba00b3a20 2021-10-21T00:03:09.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01129f0 con 0x7f0ba0062f70 2021-10-21T00:03:09.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58120/0 (socket says 172.21.15.41:58120) 2021-10-21T00:03:09.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 -- 172.21.15.41:0/1723254854 learned_addr learned my addr 172.21.15.41:0/1723254854 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:09.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9ffff700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba00b3a20 0x7f0ba0146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 0x7f0ba0146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 -- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 msgr2=0x7f0ba0146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 0x7f0ba0146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 -- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba00b3a20 msgr2=0x7f0ba0146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba00b3a20 0x7f0ba0146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 -- 172.21.15.41:0/1723254854 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9800b180 con 0x7f0ba0062330 2021-10-21T00:03:09.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 0x7f0ba0146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:09.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9f7fe700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0b90000bc0 tx=0x7f0b90007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b900070d0 con 0x7f0ba0062330 2021-10-21T00:03:09.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b90007230 con 0x7f0ba0062330 2021-10-21T00:03:09.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b88009530 con 0x7f0ba0062330 2021-10-21T00:03:09.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b90005740 con 0x7f0ba0062330 2021-10-21T00:03:09.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba01126e0 con 0x7f0ba0062330 2021-10-21T00:03:09.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.739+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba0114810 con 0x7f0ba0062330 2021-10-21T00:03:09.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.743+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b90010070 con 0x7f0ba0062330 2021-10-21T00:03:09.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.743+0000 7f0b9cff9700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 0x7f0b84055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:09.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.743+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b9006b140 con 0x7f0ba0062330 2021-10-21T00:03:09.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.743+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 0x7f0b84055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:09.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.743+0000 7f0b9effd700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 0x7f0b84055a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0b88019000 tx=0x7f0b88016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:09.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.751+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b90042190 con 0x7f0ba0062330 2021-10-21T00:03:09.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ba0057350 con 0x7f0ba0062330 2021-10-21T00:03:09.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0b9cff9700 1 -- 172.21.15.41:0/1723254854 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2131 (secure 0 0 0) 0x7f0b900457b0 con 0x7f0ba0062330 2021-10-21T00:03:09.916 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:09.917 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:00.471696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:09.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 msgr2=0x7f0b84055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 0x7f0b84055a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0b88019000 tx=0x7f0b88016000).stop 2021-10-21T00:03:09.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 msgr2=0x7f0ba00ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:09.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.907+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0b90000bc0 tx=0x7f0b90007a60).stop 2021-10-21T00:03:09.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 shutdown_connections 2021-10-21T00:03:09.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b840535b0 0x7f0b84055a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba00b3a20 0x7f0ba0146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ba0062f70 0x7f0ba0146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 --2- 172.21.15.41:0/1723254854 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ba0062330 0x7f0ba00ae9a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:09.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 >> 172.21.15.41:0/1723254854 conn(0x7f0ba00b9080 msgr2=0x7f0ba013f060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:09.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 shutdown_connections 2021-10-21T00:03:09.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:09.911+0000 7f0ba49fc700 1 -- 172.21.15.41:0/1723254854 wait complete. 2021-10-21T00:03:09.922 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 5 2021-10-21T00:03:10.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:02:57.790214+0000', 'modified': '2021-10-21T00:03:00.471696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3079329835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3079329835}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3079329835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:10.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:10.133 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:10.251 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":10.764184039,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":22,"uptime":15.699808699} 2021-10-21T00:03:10.252 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4269, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "rank_uptime": 10.764184039, "state": "up:active", "uptime": 15.699808699, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:10.252 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-10-21T00:03:10.292 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-10-21T00:03:10.292 INFO:tasks.ceph_fuse:config is None 2021-10-21T00:03:10.293 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-10-21T00:03:10.293 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-10-21T00:03:10.293 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 Processor -- start 2021-10-21T00:03:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 -- start start 2021-10-21T00:03:10.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd44c14b0a0 0x7fd44c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0b14b0 con 0x7fd44c0b02a0 2021-10-21T00:03:10.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c14a4f0 con 0x7fd44c0b5de0 2021-10-21T00:03:10.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd4524b6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c05d0a0 con 0x7fd44c14b0a0 2021-10-21T00:03:10.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd44c0b02a0 0x7fd44c14a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55898/0 (socket says 172.21.15.41:55898) 2021-10-21T00:03:10.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44b7fe700 1 -- 172.21.15.41:0/3479504687 learned_addr learned my addr 172.21.15.41:0/3479504687 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:10.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd450a53700 1 --2- 172.21.15.41:0/3479504687 >> v2:172.21.15.62:3300/0 conn(0x7fd44c14b0a0 0x7fd44c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326162502 0 0) 0x7fd44c0b14b0 con 0x7fd44c0b02a0 2021-10-21T00:03:10.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd42c003260 con 0x7fd44c0b02a0 2021-10-21T00:03:10.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637114500 0 0) 0x7fd44c14a4f0 con 0x7fd44c0b5de0 2021-10-21T00:03:10.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd44c0b14b0 con 0x7fd44c0b5de0 2021-10-21T00:03:10.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215090085 0 0) 0x7fd42c003260 con 0x7fd44c0b02a0 2021-10-21T00:03:10.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 >> v2:172.21.15.62:3300/0 conn(0x7fd44c14b0a0 msgr2=0x7fd44c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:10.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 --2- 172.21.15.41:0/3479504687 >> v2:172.21.15.62:3300/0 conn(0x7fd44c14b0a0 0x7fd44c0b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 >> v1:172.21.15.62:6789/0 conn(0x7fd44c0b5de0 legacy=0x7fd44c147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0b11e0 con 0x7fd44c0b02a0 2021-10-21T00:03:10.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd43c0019e0 con 0x7fd44c0b02a0 2021-10-21T00:03:10.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd450a53700 1 --2- 172.21.15.41:0/3479504687 >> v2:172.21.15.62:3300/0 conn(0x7fd44c14b0a0 0x7fd44c0b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:10.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 >> v1:172.21.15.41:6789/0 conn(0x7fd44c0b02a0 legacy=0x7fd44c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c0038e0 0x7fd42c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 0x7fd42c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd42c004e70 0x7fd42c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c05d0a0 con 0x7fd42c004500 2021-10-21T00:03:10.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c00bcf0 con 0x7fd42c004e70 2021-10-21T00:03:10.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c00beb0 con 0x7fd42c0038e0 2021-10-21T00:03:10.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 0x7fd42c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd44bfff700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c0038e0 0x7fd42c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.399+0000 7fd450a53700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd42c004e70 0x7fd42c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 -- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c0038e0 msgr2=0x7fd42c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:10.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c0038e0 0x7fd42c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 -- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd42c004e70 msgr2=0x7fd42c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:10.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd42c004e70 0x7fd42c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd450a53700 1 -- 172.21.15.41:0/3479504687 reap_dead start 2021-10-21T00:03:10.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 -- 172.21.15.41:0/3479504687 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c003260 con 0x7fd42c004500 2021-10-21T00:03:10.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 0x7fd42c004980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd43c0017b0 tx=0x7fd44c0ad2e0).ready entity=mon.0 client_cookie=9e4002e27ffd2ad7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43c00cb10 con 0x7fd42c004500 2021-10-21T00:03:10.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00cc70 con 0x7fd42c004500 2021-10-21T00:03:10.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd44affd700 1 -- 172.21.15.41:0/3479504687 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43c005990 con 0x7fd42c004500 2021-10-21T00:03:10.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 -- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 msgr2=0x7fd42c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 0x7fd42c004980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd43c0017b0 tx=0x7fd44c0ad2e0).stop 2021-10-21T00:03:10.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 -- 172.21.15.41:0/3479504687 shutdown_connections 2021-10-21T00:03:10.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 --2- 172.21.15.41:0/3479504687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd42c004500 0x7fd42c004980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 -- 172.21.15.41:0/3479504687 >> 172.21.15.41:0/3479504687 conn(0x7fd44c063ae0 msgr2=0x7fd44c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:10.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 -- 172.21.15.41:0/3479504687 shutdown_connections 2021-10-21T00:03:10.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.403+0000 7fd4524b6700 1 -- 172.21.15.41:0/3479504687 wait complete. 2021-10-21T00:03:10.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 Processor -- start 2021-10-21T00:03:10.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 -- start start 2021-10-21T00:03:10.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c004500 0x7fd44c064fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 0x7fd44c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0656a0 con 0x7fd44c159d10 2021-10-21T00:03:10.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1124d0 con 0x7fd44c0661f0 2021-10-21T00:03:10.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd4524b6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0644c0 con 0x7fd42c004500 2021-10-21T00:03:10.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd450a53700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd450a53700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58144/0 (socket says 172.21.15.41:58144) 2021-10-21T00:03:10.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd450a53700 1 -- 172.21.15.41:0/2313574238 learned_addr learned my addr 172.21.15.41:0/2313574238 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:10.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44bfff700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c004500 0x7fd44c064fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 0x7fd44c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 -- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c004500 msgr2=0x7fd44c064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c004500 0x7fd44c064fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 -- 172.21.15.41:0/2313574238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 msgr2=0x7fd44c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd44b7fe700 1 -- 172.21.15.41:0/2313574238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c064060 con 0x7fd44c0661f0 2021-10-21T00:03:10.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.407+0000 7fd450a53700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:10.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd44b7fe700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 0x7fd44c159820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd44c0643a0 tx=0x7fd43c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43c00cb10 con 0x7fd44c0661f0 2021-10-21T00:03:10.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c0072c0 con 0x7fd44c0661f0 2021-10-21T00:03:10.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c112700 con 0x7fd44c0661f0 2021-10-21T00:03:10.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43c001f10 con 0x7fd44c0661f0 2021-10-21T00:03:10.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c064700 con 0x7fd44c0661f0 2021-10-21T00:03:10.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c057350 con 0x7fd44c0661f0 2021-10-21T00:03:10.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd43c026020 con 0x7fd44c0661f0 2021-10-21T00:03:10.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 0x7fd430055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd43c06ca70 con 0x7fd44c0661f0 2021-10-21T00:03:10.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd44bfff700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 0x7fd430055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.411+0000 7fd44bfff700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 0x7fd430055b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd434003000 tx=0x7fd434007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.419+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd43c043b30 con 0x7fd44c0661f0 2021-10-21T00:03:10.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.551+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd44c1124d0 con 0x7fd44c0661f0 2021-10-21T00:03:10.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.551+0000 7fd4497fa700 1 -- 172.21.15.41:0/2313574238 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fd43c06ce60 con 0x7fd44c0661f0 2021-10-21T00:03:10.561 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:10.561 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:10.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 msgr2=0x7fd430055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 0x7fd430055b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd434003000 tx=0x7fd434007a00).stop 2021-10-21T00:03:10.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 msgr2=0x7fd44c159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 0x7fd44c159820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd44c0643a0 tx=0x7fd43c015000).stop 2021-10-21T00:03:10.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 shutdown_connections 2021-10-21T00:03:10.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd430053640 0x7fd430055b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd44c159d10 0x7fd44c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd44c0661f0 0x7fd44c159820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 --2- 172.21.15.41:0/2313574238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd42c004500 0x7fd44c064fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 >> 172.21.15.41:0/2313574238 conn(0x7fd44c063ae0 msgr2=0x7fd44c0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:10.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 shutdown_connections 2021-10-21T00:03:10.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.555+0000 7fd4524b6700 1 -- 172.21.15.41:0/2313574238 wait complete. 2021-10-21T00:03:10.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:10.575 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:10.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 Processor -- start 2021-10-21T00:03:10.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 -- start start 2021-10-21T00:03:10.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080b2170 0x7fa2080ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2080af620 0x7fa2080ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080b0b50 con 0x7fa2080abb50 2021-10-21T00:03:10.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2080b2550 con 0x7fa2080af620 2021-10-21T00:03:10.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20e646700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080b0d90 con 0x7fa2080b2170 2021-10-21T00:03:10.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2080af620 0x7fa2080ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20de45700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa2080abb50 0x7fa20814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35742/0 (socket says 172.21.15.41:35742) 2021-10-21T00:03:10.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20de45700 1 -- 172.21.15.41:0/2905048202 learned_addr learned my addr 172.21.15.41:0/2905048202 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:10.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20d644700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080b2170 0x7fa2080ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa1fffff700 1 -- 172.21.15.41:0/2905048202 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762123415 0 0) 0x7fa200001490 con 0x7fa2080abb50 2021-10-21T00:03:10.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa1fffff700 1 -- 172.21.15.41:0/2905048202 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ec003260 con 0x7fa2080abb50 2021-10-21T00:03:10.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 -- 172.21.15.41:0/2905048202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080b2170 msgr2=0x7fa2080ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:10.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080b2170 0x7fa2080ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 -- 172.21.15.41:0/2905048202 >> v1:172.21.15.62:6789/0 conn(0x7fa2080abb50 legacy=0x7fa20814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 -- 172.21.15.41:0/2905048202 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080b1030 con 0x7fa2080af620 2021-10-21T00:03:10.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa20ce43700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080af620 0x7fa2080ab660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa204002f70 tx=0x7fa204006df0).ready entity=mon.0 client_cookie=a136616b6d949c7b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa1fffff700 1 -- 172.21.15.41:0/2905048202 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20400d4a0 con 0x7fa2080af620 2021-10-21T00:03:10.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa1fffff700 1 -- 172.21.15.41:0/2905048202 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa204000e90 con 0x7fa2080af620 2021-10-21T00:03:10.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.675+0000 7fa1fffff700 1 -- 172.21.15.41:0/2905048202 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20400d7f0 con 0x7fa2080af620 2021-10-21T00:03:10.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- 172.21.15.41:0/2905048202 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080af620 msgr2=0x7fa2080ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080af620 0x7fa2080ab660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa204002f70 tx=0x7fa204006df0).stop 2021-10-21T00:03:10.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- 172.21.15.41:0/2905048202 shutdown_connections 2021-10-21T00:03:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080af620 0x7fa2080ab660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 --2- 172.21.15.41:0/2905048202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080b2170 0x7fa2080ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- 172.21.15.41:0/2905048202 >> 172.21.15.41:0/2905048202 conn(0x7fa2080b5700 msgr2=0x7fa2080b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- 172.21.15.41:0/2905048202 shutdown_connections 2021-10-21T00:03:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- 172.21.15.41:0/2905048202 wait complete. 2021-10-21T00:03:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 Processor -- start 2021-10-21T00:03:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.679+0000 7fa20e646700 1 -- start start 2021-10-21T00:03:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2080abb50 0x7fa2080b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080af620 0x7fa208159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208067500 con 0x7fa2080b2170 2021-10-21T00:03:10.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080ae3e0 con 0x7fa2080abb50 2021-10-21T00:03:10.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080add60 con 0x7fa2080af620 2021-10-21T00:03:10.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58158/0 (socket says 172.21.15.41:58158) 2021-10-21T00:03:10.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 -- 172.21.15.41:0/184334554 learned_addr learned my addr 172.21.15.41:0/184334554 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:10.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20ce43700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080af620 0x7fa208159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20d644700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2080abb50 0x7fa2080b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 -- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080af620 msgr2=0x7fa208159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080af620 0x7fa208159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 -- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2080abb50 msgr2=0x7fa2080b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2080abb50 0x7fa2080b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 -- 172.21.15.41:0/184334554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20400b180 con 0x7fa2080b2170 2021-10-21T00:03:10.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20de45700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa200001620 tx=0x7fa200007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa200005ba0 con 0x7fa2080b2170 2021-10-21T00:03:10.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200005d00 con 0x7fa2080b2170 2021-10-21T00:03:10.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa208148d50 con 0x7fa2080b2170 2021-10-21T00:03:10.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2000072c0 con 0x7fa2080b2170 2021-10-21T00:03:10.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2080ae8c0 con 0x7fa2080b2170 2021-10-21T00:03:10.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.683+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080aea80 con 0x7fa2080b2170 2021-10-21T00:03:10.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.687+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa200010070 con 0x7fa2080b2170 2021-10-21T00:03:10.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.687+0000 7fa1fe7fc700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 0x7fa1f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.687+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa20006b1d0 con 0x7fa2080b2170 2021-10-21T00:03:10.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.687+0000 7fa20d644700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 0x7fa1f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.687+0000 7fa20d644700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 0x7fa1f0055ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa1f800b000 tx=0x7fa1f8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.691+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa200042290 con 0x7fa2080b2170 2021-10-21T00:03:10.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa2080adf20 con 0x7fa2080b2170 2021-10-21T00:03:10.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa1fe7fc700 1 -- 172.21.15.41:0/184334554 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa2000458b0 con 0x7fa2080b2170 2021-10-21T00:03:10.832 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:10.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 msgr2=0x7fa1f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 0x7fa1f0055ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa1f800b000 tx=0x7fa1f8006df0).stop 2021-10-21T00:03:10.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 msgr2=0x7fa20815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa200001620 tx=0x7fa200007c60).stop 2021-10-21T00:03:10.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 shutdown_connections 2021-10-21T00:03:10.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1f0053610 0x7fa1f0055ad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2080b2170 0x7fa20815a010 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2080af620 0x7fa208159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 --2- 172.21.15.41:0/184334554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2080abb50 0x7fa2080b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 >> 172.21.15.41:0/184334554 conn(0x7fa2080b5700 msgr2=0x7fa20805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:10.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 shutdown_connections 2021-10-21T00:03:10.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.823+0000 7fa20e646700 1 -- 172.21.15.41:0/184334554 wait complete. 2021-10-21T00:03:10.845 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:10.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 Processor -- start 2021-10-21T00:03:10.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 -- start start 2021-10-21T00:03:10.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0b2170 0x7fd86c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c0af620 0x7fd86c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86c0b0b50 con 0x7fd86c0abb50 2021-10-21T00:03:10.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c0b2550 con 0x7fd86c0af620 2021-10-21T00:03:10.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.943+0000 7fd870a1c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0b0d90 con 0x7fd86c0b2170 2021-10-21T00:03:10.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c0af620 0x7fd86c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0b2170 0x7fd86c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c0af620 0x7fd86c0ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:41848/0 (socket says 172.21.15.41:41848) 2021-10-21T00:03:10.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd86c0abb50 0x7fd86c14a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35756/0 (socket says 172.21.15.41:35756) 2021-10-21T00:03:10.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 -- 172.21.15.41:0/3914435529 learned_addr learned my addr 172.21.15.41:0/3914435529 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:10.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 -- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0b2170 msgr2=0x7fd86c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:10.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 --2- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0b2170 0x7fd86c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 -- 172.21.15.41:0/3914435529 >> v1:172.21.15.62:6789/0 conn(0x7fd86c0abb50 legacy=0x7fd86c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86a7fc700 1 -- 172.21.15.41:0/3914435529 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445942804 0 0) 0x7fd864001490 con 0x7fd86c0abb50 2021-10-21T00:03:10.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 -- 172.21.15.41:0/3914435529 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c0b1030 con 0x7fd86c0af620 2021-10-21T00:03:10.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86affd700 1 --2- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c0ab660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd85c002f70 tx=0x7fd85c006eb0).ready entity=mon.1 client_cookie=abd6bc758e8557eb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86a7fc700 1 -- 172.21.15.41:0/3914435529 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85c00d570 con 0x7fd86c0af620 2021-10-21T00:03:10.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86a7fc700 1 -- 172.21.15.41:0/3914435529 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c000e90 con 0x7fd86c0af620 2021-10-21T00:03:10.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd86a7fc700 1 -- 172.21.15.41:0/3914435529 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85c00d8c0 con 0x7fd86c0af620 2021-10-21T00:03:10.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 -- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 msgr2=0x7fd86c0ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 --2- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c0ab660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fd85c002f70 tx=0x7fd85c006eb0).stop 2021-10-21T00:03:10.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 -- 172.21.15.41:0/3914435529 shutdown_connections 2021-10-21T00:03:10.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 --2- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c0ab660 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 --2- 172.21.15.41:0/3914435529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0b2170 0x7fd86c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 -- 172.21.15.41:0/3914435529 >> 172.21.15.41:0/3914435529 conn(0x7fd86c0b5700 msgr2=0x7fd86c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:10.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 -- 172.21.15.41:0/3914435529 shutdown_connections 2021-10-21T00:03:10.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 -- 172.21.15.41:0/3914435529 wait complete. 2021-10-21T00:03:10.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.947+0000 7fd870a1c700 1 Processor -- start 2021-10-21T00:03:10.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- start start 2021-10-21T00:03:10.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0abb50 0x7fd86c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 0x7fd86c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0adef0 con 0x7fd86c0b2170 2021-10-21T00:03:10.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0ae120 con 0x7fd86c0af620 2021-10-21T00:03:10.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0ae3c0 con 0x7fd86c0abb50 2021-10-21T00:03:10.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 0x7fd86c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:41854/0 (socket says 172.21.15.41:41854) 2021-10-21T00:03:10.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0abb50 0x7fd86c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 -- 172.21.15.41:0/2269649176 learned_addr learned my addr 172.21.15.41:0/2269649176 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86bfff700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 0x7fd86c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58172/0 (socket says 172.21.15.41:58172) 2021-10-21T00:03:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 -- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0abb50 msgr2=0x7fd86c147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0abb50 0x7fd86c147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 -- 172.21.15.41:0/2269649176 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 msgr2=0x7fd86c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:10.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 0x7fd86c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:10.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 -- 172.21.15.41:0/2269649176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c00b1e0 con 0x7fd86c0af620 2021-10-21T00:03:10.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd86affd700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd86c148860 tx=0x7fd85c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85c011840 con 0x7fd86c0af620 2021-10-21T00:03:10.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0119a0 con 0x7fd86c0af620 2021-10-21T00:03:10.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c0ae660 con 0x7fd86c0af620 2021-10-21T00:03:10.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85c011d00 con 0x7fd86c0af620 2021-10-21T00:03:10.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.951+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c148aa0 con 0x7fd86c0af620 2021-10-21T00:03:10.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c0ae7f0 con 0x7fd86c0af620 2021-10-21T00:03:10.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd85c025030 con 0x7fd86c0af620 2021-10-21T00:03:10.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd868ff9700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 0x7fd84c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:10.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd85c06ca60 con 0x7fd86c0af620 2021-10-21T00:03:10.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd86b7fe700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 0x7fd84c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:10.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.955+0000 7fd86b7fe700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 0x7fd84c055b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd86000b000 tx=0x7fd860006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:10.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:10.963+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd85c043bc0 con 0x7fd86c0af620 2021-10-21T00:03:11.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.091+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd86c0b12d0 con 0x7fd86c0af620 2021-10-21T00:03:11.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd868ff9700 1 -- 172.21.15.41:0/2269649176 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd85c023070 con 0x7fd86c0af620 2021-10-21T00:03:11.106 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:11.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 msgr2=0x7fd84c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 0x7fd84c055b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd86000b000 tx=0x7fd860006df0).stop 2021-10-21T00:03:11.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 msgr2=0x7fd86c145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd86c148860 tx=0x7fd85c015000).stop 2021-10-21T00:03:11.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 shutdown_connections 2021-10-21T00:03:11.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd84c0536a0 0x7fd84c055b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd86c0b2170 0x7fd86c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c0af620 0x7fd86c145fa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 --2- 172.21.15.41:0/2269649176 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd86c0abb50 0x7fd86c147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 >> 172.21.15.41:0/2269649176 conn(0x7fd86c0b5700 msgr2=0x7fd86c05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 shutdown_connections 2021-10-21T00:03:11.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.095+0000 7fd870a1c700 1 -- 172.21.15.41:0/2269649176 wait complete. 2021-10-21T00:03:11.116 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:11.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 Processor -- start 2021-10-21T00:03:11.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 -- start start 2021-10-21T00:03:11.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07800aa770 0x7f0780147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078005cad0 con 0x7f078005c6f0 2021-10-21T00:03:11.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800b0e30 con 0x7f07800aa770 2021-10-21T00:03:11.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078719f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07800b10d0 con 0x7f07800608b0 2021-10-21T00:03:11.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078573c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07800aa770 0x7f0780147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078573c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48446/0 (socket says 172.21.15.41:48446) 2021-10-21T00:03:11.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078573c700 1 -- 172.21.15.41:0/525964199 learned_addr learned my addr 172.21.15.41:0/525964199 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:11.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 -- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 msgr2=0x7f07800af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:11.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 -- 172.21.15.41:0/525964199 >> v1:172.21.15.62:6789/0 conn(0x7f078005c6f0 legacy=0x7f0780147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 -- 172.21.15.41:0/525964199 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800b1370 con 0x7f07800aa770 2021-10-21T00:03:11.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f078573c700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:11.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.219+0000 7f077ffff700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07800aa770 0x7f0780147f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0770002f70 tx=0x7f0770006df0).ready entity=mon.1 client_cookie=ed31555ecef60fe6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f077f7fe700 1 -- 172.21.15.41:0/525964199 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077000d570 con 0x7f07800aa770 2021-10-21T00:03:11.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f077f7fe700 1 -- 172.21.15.41:0/525964199 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770000e90 con 0x7f07800aa770 2021-10-21T00:03:11.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f077f7fe700 1 -- 172.21.15.41:0/525964199 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077000d8c0 con 0x7f07800aa770 2021-10-21T00:03:11.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 -- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07800aa770 msgr2=0x7f0780147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07800aa770 0x7f0780147f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0770002f70 tx=0x7f0770006df0).stop 2021-10-21T00:03:11.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 -- 172.21.15.41:0/525964199 shutdown_connections 2021-10-21T00:03:11.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f07800af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 --2- 172.21.15.41:0/525964199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07800aa770 0x7f0780147f40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 -- 172.21.15.41:0/525964199 >> 172.21.15.41:0/525964199 conn(0x7f07800b2380 msgr2=0x7f078005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 -- 172.21.15.41:0/525964199 shutdown_connections 2021-10-21T00:03:11.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.227+0000 7f078719f700 1 -- 172.21.15.41:0/525964199 wait complete. 2021-10-21T00:03:11.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 Processor -- start 2021-10-21T00:03:11.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 -- start start 2021-10-21T00:03:11.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078005c6f0 0x7f0780156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f078014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780157c80 con 0x7f07800aa770 2021-10-21T00:03:11.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780145d30 con 0x7f078005c6f0 2021-10-21T00:03:11.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0780145fd0 con 0x7f07800608b0 2021-10-21T00:03:11.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58186/0 (socket says 172.21.15.41:58186) 2021-10-21T00:03:11.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f077ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f078014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 -- 172.21.15.41:0/1534093050 learned_addr learned my addr 172.21.15.41:0/1534093050 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:11.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f0784f3b700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078005c6f0 0x7f0780156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 -- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 msgr2=0x7f078014ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f078014ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 -- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078005c6f0 msgr2=0x7f0780156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078005c6f0 0x7f0780156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 -- 172.21.15.41:0/1534093050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778009530 con 0x7f07800aa770 2021-10-21T00:03:11.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078573c700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f0778006ec0 tx=0x7f0778009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077800c850 con 0x7f07800aa770 2021-10-21T00:03:11.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800c9b0 con 0x7f07800aa770 2021-10-21T00:03:11.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077000b180 con 0x7f07800aa770 2021-10-21T00:03:11.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.231+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077800cd10 con 0x7f07800aa770 2021-10-21T00:03:11.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0780146c80 con 0x7f07800aa770 2021-10-21T00:03:11.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780057350 con 0x7f07800aa770 2021-10-21T00:03:11.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0778022070 con 0x7f07800aa770 2021-10-21T00:03:11.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f077dffb700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 0x7f0760055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f077806c0e0 con 0x7f07800aa770 2021-10-21T00:03:11.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f0784f3b700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 0x7f0760055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.235+0000 7f0784f3b700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 0x7f0760055b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f077400d000 tx=0x7f0774000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.243+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0778043240 con 0x7f07800aa770 2021-10-21T00:03:11.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.367+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07800af4a0 con 0x7f07800aa770 2021-10-21T00:03:11.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.367+0000 7f077dffb700 1 -- 172.21.15.41:0/1534093050 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f07780160a0 con 0x7f07800aa770 2021-10-21T00:03:11.377 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:11.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 msgr2=0x7f0760055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 0x7f0760055b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f077400d000 tx=0x7f0774000bc0).stop 2021-10-21T00:03:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 msgr2=0x7f0780146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f0778006ec0 tx=0x7f0778009290).stop 2021-10-21T00:03:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 shutdown_connections 2021-10-21T00:03:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07600536a0 0x7f0760055b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07800aa770 0x7f0780146710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07800608b0 0x7f078014ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 --2- 172.21.15.41:0/1534093050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f078005c6f0 0x7f0780156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 >> 172.21.15.41:0/1534093050 conn(0x7f07800b2380 msgr2=0x7f078009a770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 shutdown_connections 2021-10-21T00:03:11.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.371+0000 7f078719f700 1 -- 172.21.15.41:0/1534093050 wait complete. 2021-10-21T00:03:11.393 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 Processor -- start 2021-10-21T00:03:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 -- start start 2021-10-21T00:03:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90cc0b7300 0x7f90cc13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc0b76e0 con 0x7f90cc13a9b0 2021-10-21T00:03:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc0ac890 con 0x7f90cc066110 2021-10-21T00:03:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90d14bb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc144de0 con 0x7f90cc0b7300 2021-10-21T00:03:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90ca7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f90cc13a9b0 0x7f90cc065a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55962/0 (socket says 172.21.15.41:55962) 2021-10-21T00:03:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90ca7fc700 1 -- 172.21.15.41:0/2668824539 learned_addr learned my addr 172.21.15.41:0/2668824539 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.499+0000 7f90caffd700 1 --2- 172.21.15.41:0/2668824539 >> v2:172.21.15.62:3300/0 conn(0x7f90cc0b7300 0x7f90cc13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408255046 0 0) 0x7f90cc0b76e0 con 0x7f90cc13a9b0 2021-10-21T00:03:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003260 con 0x7f90cc13a9b0 2021-10-21T00:03:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024166237 0 0) 0x7f90cc0ac890 con 0x7f90cc066110 2021-10-21T00:03:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90cc0b76e0 con 0x7f90cc066110 2021-10-21T00:03:11.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90caffd700 1 -- 172.21.15.41:0/2668824539 >> v1:172.21.15.62:6789/0 conn(0x7f90cc066110 legacy=0x7f90cc14b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 340210203 0 0) 0x7f90b0003260 con 0x7f90cc13a9b0 2021-10-21T00:03:11.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90caffd700 1 -- 172.21.15.41:0/2668824539 >> v1:172.21.15.41:6789/0 conn(0x7f90cc13a9b0 legacy=0x7f90cc065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90caffd700 1 -- 172.21.15.41:0/2668824539 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0acb30 con 0x7f90cc0b7300 2021-10-21T00:03:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90caffd700 1 --2- 172.21.15.41:0/2668824539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc13a4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f90bc001110 tx=0x7f90c0006df0).ready entity=mon.1 client_cookie=7142cfb1ed99dbe0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90bc001660 con 0x7f90cc0b7300 2021-10-21T00:03:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0000e90 con 0x7f90cc0b7300 2021-10-21T00:03:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90c9ffb700 1 -- 172.21.15.41:0/2668824539 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c0012460 con 0x7f90cc0b7300 2021-10-21T00:03:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 -- 172.21.15.41:0/2668824539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 msgr2=0x7f90cc13a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2668824539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc13a4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f90bc001110 tx=0x7f90c0006df0).stop 2021-10-21T00:03:11.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 -- 172.21.15.41:0/2668824539 shutdown_connections 2021-10-21T00:03:11.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2668824539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc13a4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 -- 172.21.15.41:0/2668824539 >> 172.21.15.41:0/2668824539 conn(0x7f90cc069df0 msgr2=0x7f90cc064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 -- 172.21.15.41:0/2668824539 shutdown_connections 2021-10-21T00:03:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.503+0000 7f90d14bb700 1 -- 172.21.15.41:0/2668824539 wait complete. 2021-10-21T00:03:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 Processor -- start 2021-10-21T00:03:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 -- start start 2021-10-21T00:03:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc0af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90cc13a9b0 0x7f90cc13b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0ae840 con 0x7f90cc066110 2021-10-21T00:03:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0af1b0 con 0x7f90cc0b7300 2021-10-21T00:03:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90d14bb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0afb40 con 0x7f90cc13a9b0 2021-10-21T00:03:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58196/0 (socket says 172.21.15.41:58196) 2021-10-21T00:03:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 -- 172.21.15.41:0/2971835545 learned_addr learned my addr 172.21.15.41:0/2971835545 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90ca7fc700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90cb7fe700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90cc13a9b0 0x7f90cc13b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 -- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90cc13a9b0 msgr2=0x7f90cc13b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90cc13a9b0 0x7f90cc13b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 -- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 msgr2=0x7f90cc0af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc0af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 -- 172.21.15.41:0/2971835545 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c000b180 con 0x7f90cc066110 2021-10-21T00:03:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90caffd700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f90bc001110 tx=0x7f90c0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c000d8a0 con 0x7f90cc066110 2021-10-21T00:03:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.507+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000da00 con 0x7f90cc066110 2021-10-21T00:03:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc143d30 con 0x7f90cc066110 2021-10-21T00:03:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c000dd60 con 0x7f90cc066110 2021-10-21T00:03:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc0ae5c0 con 0x7f90cc066110 2021-10-21T00:03:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc13de00 con 0x7f90cc066110 2021-10-21T00:03:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f90c0025030 con 0x7f90cc066110 2021-10-21T00:03:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90bbfff700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 0x7f90a8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f90c006c450 con 0x7f90cc066110 2021-10-21T00:03:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.511+0000 7f90ca7fc700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 0x7f90a8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.515+0000 7f90ca7fc700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 0x7f90a8055a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90bc00d000 tx=0x7f90bc000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.519+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90cc13de00 con 0x7f90cc066110 2021-10-21T00:03:11.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.647+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90cc13de00 con 0x7f90cc066110 2021-10-21T00:03:11.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90bbfff700 1 -- 172.21.15.41:0/2971835545 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f90cc13de00 con 0x7f90cc066110 2021-10-21T00:03:11.659 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:11.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 msgr2=0x7f90a8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 0x7f90a8055a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90bc00d000 tx=0x7f90bc000bc0).stop 2021-10-21T00:03:11.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 msgr2=0x7f90cc0b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f90bc001110 tx=0x7f90c0014000).stop 2021-10-21T00:03:11.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 shutdown_connections 2021-10-21T00:03:11.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053580 0x7f90a8055a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90cc13a9b0 0x7f90cc13b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90cc0b7300 0x7f90cc0af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 --2- 172.21.15.41:0/2971835545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90cc066110 0x7f90cc0b4210 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 >> 172.21.15.41:0/2971835545 conn(0x7f90cc069df0 msgr2=0x7f90cc143fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 shutdown_connections 2021-10-21T00:03:11.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.651+0000 7f90d14bb700 1 -- 172.21.15.41:0/2971835545 wait complete. 2021-10-21T00:03:11.670 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:03:11.671 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:11.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 Processor -- start 2021-10-21T00:03:11.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 -- start start 2021-10-21T00:03:11.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa494062330 0x7fa4940b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49405bd40 con 0x7fa494062f70 2021-10-21T00:03:11.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49405bf70 con 0x7fa4940b3a20 2021-10-21T00:03:11.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49ab79700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa494142cb0 con 0x7fa494062330 2021-10-21T00:03:11.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49a378700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49a378700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58208/0 (socket says 172.21.15.41:58208) 2021-10-21T00:03:11.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa49a378700 1 -- 172.21.15.41:0/131052044 learned_addr learned my addr 172.21.15.41:0/131052044 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:11.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.767+0000 7fa499b77700 1 --2- 172.21.15.41:0/131052044 >> v2:172.21.15.62:3300/0 conn(0x7fa494062330 0x7fa4940b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa499b77700 1 -- 172.21.15.41:0/131052044 >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 msgr2=0x7fa49413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:11.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa499b77700 1 --2- 172.21.15.41:0/131052044 >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa499b77700 1 -- 172.21.15.41:0/131052044 >> v1:172.21.15.62:6789/0 conn(0x7fa494062f70 legacy=0x7fa49405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa498b75700 1 -- 172.21.15.41:0/131052044 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814217835 0 0) 0x7fa49405bd40 con 0x7fa494062f70 2021-10-21T00:03:11.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa499b77700 1 -- 172.21.15.41:0/131052044 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494142950 con 0x7fa494062330 2021-10-21T00:03:11.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49a378700 1 --2- 172.21.15.41:0/131052044 >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:11.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa499b77700 1 --2- 172.21.15.41:0/131052044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494062330 0x7fa4940b3f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa48c0032f0 tx=0x7fa48c0091d0).ready entity=mon.1 client_cookie=ea0e0199d2e1c516 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa498b75700 1 -- 172.21.15.41:0/131052044 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00b680 con 0x7fa494062330 2021-10-21T00:03:11.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa498b75700 1 -- 172.21.15.41:0/131052044 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c00b7e0 con 0x7fa494062330 2021-10-21T00:03:11.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa498b75700 1 -- 172.21.15.41:0/131052044 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00b950 con 0x7fa494062330 2021-10-21T00:03:11.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 -- 172.21.15.41:0/131052044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494062330 msgr2=0x7fa4940b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 --2- 172.21.15.41:0/131052044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494062330 0x7fa4940b3f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa48c0032f0 tx=0x7fa48c0091d0).stop 2021-10-21T00:03:11.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 -- 172.21.15.41:0/131052044 shutdown_connections 2021-10-21T00:03:11.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 --2- 172.21.15.41:0/131052044 >> v2:172.21.15.41:3300/0 conn(0x7fa4940b3a20 0x7fa49413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 --2- 172.21.15.41:0/131052044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494062330 0x7fa4940b3f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 -- 172.21.15.41:0/131052044 >> 172.21.15.41:0/131052044 conn(0x7fa4940b9080 msgr2=0x7fa4940b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 -- 172.21.15.41:0/131052044 shutdown_connections 2021-10-21T00:03:11.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.771+0000 7fa49ab79700 1 -- 172.21.15.41:0/131052044 wait complete. 2021-10-21T00:03:11.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 Processor -- start 2021-10-21T00:03:11.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 -- start start 2021-10-21T00:03:11.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 0x7fa4940adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 0x7fa4941497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4940b3a20 0x7fa494155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4941553d0 con 0x7fa494062f70 2021-10-21T00:03:11.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa494155670 con 0x7fa4940b3a20 2021-10-21T00:03:11.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49ab79700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa494155910 con 0x7fa494062330 2021-10-21T00:03:11.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499376700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 0x7fa4941497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499376700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 0x7fa4941497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58212/0 (socket says 172.21.15.41:58212) 2021-10-21T00:03:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499376700 1 -- 172.21.15.41:0/2105300045 learned_addr learned my addr 172.21.15.41:0/2105300045 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 0x7fa4940adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa49a378700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4940b3a20 0x7fa494155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 -- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4940b3a20 msgr2=0x7fa494155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4940b3a20 0x7fa494155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 -- 172.21.15.41:0/2105300045 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 msgr2=0x7fa4941497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 0x7fa4941497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 -- 172.21.15.41:0/2105300045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49000b1e0 con 0x7fa494062330 2021-10-21T00:03:11.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.775+0000 7fa499b77700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 0x7fa4940adc10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa48c0032f0 tx=0x7fa48c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00b950 con 0x7fa494062330 2021-10-21T00:03:11.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c0107a0 con 0x7fa494062330 2021-10-21T00:03:11.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00b680 con 0x7fa494062330 2021-10-21T00:03:11.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c009470 con 0x7fa494062330 2021-10-21T00:03:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4941484d0 con 0x7fa494062330 2021-10-21T00:03:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa494155ad0 con 0x7fa494062330 2021-10-21T00:03:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa48c029070 con 0x7fa494062330 2021-10-21T00:03:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa48c06cae0 con 0x7fa494062330 2021-10-21T00:03:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa499376700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.779+0000 7fa499376700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 0x7fa47c055b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa48400d000 tx=0x7fa484007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.791+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa48c043b30 con 0x7fa494062330 2021-10-21T00:03:11.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa494057350 con 0x7fa494062330 2021-10-21T00:03:11.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa48affd700 1 -- 172.21.15.41:0/2105300045 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2131 (secure 0 0 0) 0x7fa48c015020 con 0x7fa494062330 2021-10-21T00:03:11.968 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:11.969 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:00.471696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:11.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 msgr2=0x7fa47c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 0x7fa47c055b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa48400d000 tx=0x7fa484007a40).stop 2021-10-21T00:03:11.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 msgr2=0x7fa4940adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:11.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.959+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 0x7fa4940adc10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa48c0032f0 tx=0x7fa48c016000).stop 2021-10-21T00:03:11.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 shutdown_connections 2021-10-21T00:03:11.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa47c0536a0 0x7fa47c055b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4940b3a20 0x7fa494155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa494062f70 0x7fa4941497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 --2- 172.21.15.41:0/2105300045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494062330 0x7fa4940adc10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:11.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 >> 172.21.15.41:0/2105300045 conn(0x7fa4940b9080 msgr2=0x7fa49405c330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:11.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 shutdown_connections 2021-10-21T00:03:11.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:11.963+0000 7fa49ab79700 1 -- 172.21.15.41:0/2105300045 wait complete. 2021-10-21T00:03:11.976 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 5 2021-10-21T00:03:12.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:02:57.790214+0000', 'modified': '2021-10-21T00:03:00.471696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3079329835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3079329835}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3079329835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:12.187 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:12.187 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:12.307 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":12.819651449,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":22,"uptime":17.755277758999998} 2021-10-21T00:03:12.307 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4269, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "rank_uptime": 12.819651449, "state": "up:active", "uptime": 17.755277759, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:12.308 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:03:12.308 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:03:12.309 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:03:12.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:12.309 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:12.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:03:12.336 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:12.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:12.352 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:12.353 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:12.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:12.355 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:03:12.403 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:03:12.403 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:12.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:03:12.442 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:12.443 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:12.469 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:12.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:12.471 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:03:12.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:03:12.493+0000 7f679da1a080 -1 init, newargv = 0x561326102470 newargc=9ceph-fuse[13844]: starting ceph client 2021-10-21T00:03:12.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr: 2021-10-21T00:03:12.507 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[13844]: starting fuse 2021-10-21T00:03:12.522 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:03:12.523 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:03:12.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:12.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:03:12.524 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:03:12.537 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:03:12.565 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:03:12.565 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:03:12.566 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:12.566 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:03:12.566 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:03:12.567 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:03:12.568 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:12.568 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:03:12.568 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:03:12.569 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:03:12.569 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:03:12.569 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:12.569 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:03:12.570 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:03:12.570 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:03:12.570 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:03:12.573 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:03:12.574 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:12.574 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:03:12.574 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:03:12.624 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.13844.asok 2021-10-21T00:03:12.628 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13844.asok 2021-10-21T00:03:12.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:12.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13844.asok status 2021-10-21T00:03:12.767 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:03:12.767 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:03:12.767 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:03:12.768 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:03:12.768 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:03:12.768 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:03:12.768 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:03:12.768 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "13844", 2021-10-21T00:03:12.769 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:03:12.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:12.769 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:03:12.769 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:03:12.769 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4633, 2021-10-21T00:03:12.770 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:03:12.770 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:03:12.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:03:12.770 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4633 2021-10-21T00:03:12.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:12.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:03:12.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:03:12.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:03:12.772 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 499796430 2021-10-21T00:03:12.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:03:12.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:03:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:03:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:03:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 499796430 2021-10-21T00:03:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:12.774 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4633 172.21.15.71:0/499796430", 2021-10-21T00:03:12.774 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/499796430", 2021-10-21T00:03:12.774 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:03:12.775 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 5, 2021-10-21T00:03:12.775 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 22, 2021-10-21T00:03:12.776 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:03:12.776 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:03:12.777 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:03:12.777 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:03:12.779 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:12.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 Processor -- start 2021-10-21T00:03:12.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 -- start start 2021-10-21T00:03:12.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 0x7f38cc0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc0672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc0b6350 con 0x7f38cc0677e0 2021-10-21T00:03:12.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0b0e10 con 0x7f38cc0b5f70 2021-10-21T00:03:12.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38d0cc4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0b10b0 con 0x7f38cc1423a0 2021-10-21T00:03:12.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38cbfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f38cc0677e0 0x7f38cc13ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:55992/0 (socket says 172.21.15.41:55992) 2021-10-21T00:03:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38cbfff700 1 -- 172.21.15.41:0/2152319843 learned_addr learned my addr 172.21.15.41:0/2152319843 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.883+0000 7f38cb7fe700 1 --2- 172.21.15.41:0/2152319843 >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 0x7f38cc0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 --2- 172.21.15.41:0/2152319843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc0672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38ca7fc700 1 -- 172.21.15.41:0/2152319843 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141437785 0 0) 0x7f38cc0b6350 con 0x7f38cc0677e0 2021-10-21T00:03:12.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38ca7fc700 1 -- 172.21.15.41:0/2152319843 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38ac003260 con 0x7f38cc0677e0 2021-10-21T00:03:12.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 -- 172.21.15.41:0/2152319843 >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 msgr2=0x7f38cc0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:12.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 --2- 172.21.15.41:0/2152319843 >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 0x7f38cc0b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:12.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 -- 172.21.15.41:0/2152319843 >> v1:172.21.15.41:6789/0 conn(0x7f38cc0677e0 legacy=0x7f38cc13ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:12.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 -- 172.21.15.41:0/2152319843 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0b1350 con 0x7f38cc1423a0 2021-10-21T00:03:12.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38cb7fe700 1 --2- 172.21.15.41:0/2152319843 >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 0x7f38cc0b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:12.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38caffd700 1 --2- 172.21.15.41:0/2152319843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc0672f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f38b40032f0 tx=0x7f38b40091d0).ready entity=mon.2 client_cookie=f70459c2a134493c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:12.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38ca7fc700 1 -- 172.21.15.41:0/2152319843 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b400b600 con 0x7f38cc1423a0 2021-10-21T00:03:12.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38ca7fc700 1 -- 172.21.15.41:0/2152319843 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b400b760 con 0x7f38cc1423a0 2021-10-21T00:03:12.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38ca7fc700 1 -- 172.21.15.41:0/2152319843 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b400b8d0 con 0x7f38cc1423a0 2021-10-21T00:03:12.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- 172.21.15.41:0/2152319843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 msgr2=0x7f38cc0672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:12.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/2152319843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc0672f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f38b40032f0 tx=0x7f38b40091d0).stop 2021-10-21T00:03:12.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- 172.21.15.41:0/2152319843 shutdown_connections 2021-10-21T00:03:12.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/2152319843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc0672f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:12.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/2152319843 >> v2:172.21.15.41:3300/0 conn(0x7f38cc0b5f70 0x7f38cc0b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- 172.21.15.41:0/2152319843 >> 172.21.15.41:0/2152319843 conn(0x7f38cc0639f0 msgr2=0x7f38cc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- 172.21.15.41:0/2152319843 shutdown_connections 2021-10-21T00:03:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- 172.21.15.41:0/2152319843 wait complete. 2021-10-21T00:03:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 Processor -- start 2021-10-21T00:03:12.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.887+0000 7f38d0cc4700 1 -- start start 2021-10-21T00:03:12.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38cc0677e0 0x7f38cc141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc10ecf0 con 0x7f38cc0b5f70 2021-10-21T00:03:12.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc110890 con 0x7f38cc0677e0 2021-10-21T00:03:12.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc064020 con 0x7f38cc1423a0 2021-10-21T00:03:12.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58224/0 (socket says 172.21.15.41:58224) 2021-10-21T00:03:12.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 -- 172.21.15.41:0/976743023 learned_addr learned my addr 172.21.15.41:0/976743023 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:12.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38cb7fe700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38cc0677e0 0x7f38cc141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38cbfff700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 -- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 msgr2=0x7f38cc151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:12.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:12.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 -- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38cc0677e0 msgr2=0x7f38cc141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:12.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38cc0677e0 0x7f38cc141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 -- 172.21.15.41:0/976743023 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc00b180 con 0x7f38cc0b5f70 2021-10-21T00:03:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38caffd700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f38cc10f8f0 tx=0x7f38b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b4011c00 con 0x7f38cc0b5f70 2021-10-21T00:03:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4011d60 con 0x7f38cc0b5f70 2021-10-21T00:03:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b401f5e0 con 0x7f38cc0b5f70 2021-10-21T00:03:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b4009470 con 0x7f38cc0b5f70 2021-10-21T00:03:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc065680 con 0x7f38cc0b5f70 2021-10-21T00:03:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38b4026030 con 0x7f38cc0b5f70 2021-10-21T00:03:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc0b15f0 con 0x7f38cc0b5f70 2021-10-21T00:03:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 0x7f38b00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.891+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f38b406c360 con 0x7f38cc0b5f70 2021-10-21T00:03:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.895+0000 7f38cb7fe700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 0x7f38b00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.895+0000 7f38cb7fe700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 0x7f38b00559e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f38bc00b000 tx=0x7f38bc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:12.899+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38b4043420 con 0x7f38cc0b5f70 2021-10-21T00:03:13.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.031+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38cc0b0bf0 con 0x7f38cc0b5f70 2021-10-21T00:03:13.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.031+0000 7f38c8ff9700 1 -- 172.21.15.41:0/976743023 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f38b4015090 con 0x7f38cc0b5f70 2021-10-21T00:03:13.042 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:13.042 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:13.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 msgr2=0x7f38b00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 0x7f38b00559e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f38bc00b000 tx=0x7f38bc006df0).stop 2021-10-21T00:03:13.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 msgr2=0x7f38cc064760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f38cc10f8f0 tx=0x7f38b4016000).stop 2021-10-21T00:03:13.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 shutdown_connections 2021-10-21T00:03:13.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053520 0x7f38b00559e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38cc1423a0 0x7f38cc151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38cc0b5f70 0x7f38cc064760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 --2- 172.21.15.41:0/976743023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38cc0677e0 0x7f38cc141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 >> 172.21.15.41:0/976743023 conn(0x7f38cc0639f0 msgr2=0x7f38cc13ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 shutdown_connections 2021-10-21T00:03:13.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.035+0000 7f38d0cc4700 1 -- 172.21.15.41:0/976743023 wait complete. 2021-10-21T00:03:13.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:13.055 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:13.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.155+0000 7fe5a989b700 1 Processor -- start 2021-10-21T00:03:13.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.155+0000 7fe5a989b700 1 -- start start 2021-10-21T00:03:13.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.155+0000 7fe5a989b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5a40b4380 0x7fe5a40ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 0x7fe5a4062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40ae020 con 0x7fe5a40b1830 2021-10-21T00:03:13.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a40ade00 con 0x7fe5a40b4380 2021-10-21T00:03:13.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a405fe50 con 0x7fe5a41433e0 2021-10-21T00:03:13.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a3fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe5a40b1830 0x7fe5a405f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56006/0 (socket says 172.21.15.41:56006) 2021-10-21T00:03:13.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a3fff700 1 -- 172.21.15.41:0/243840808 learned_addr learned my addr 172.21.15.41:0/243840808 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:13.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a909a700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 0x7fe5a4062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 --2- 172.21.15.41:0/243840808 >> v2:172.21.15.62:3300/0 conn(0x7fe5a40b4380 0x7fe5a40ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a37fe700 1 -- 172.21.15.41:0/243840808 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743843382 0 0) 0x7fe5a40ae020 con 0x7fe5a40b1830 2021-10-21T00:03:13.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a37fe700 1 -- 172.21.15.41:0/243840808 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003260 con 0x7fe5a40b1830 2021-10-21T00:03:13.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 -- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 msgr2=0x7fe5a4062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:13.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 0x7fe5a4062940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 -- 172.21.15.41:0/243840808 >> v1:172.21.15.41:6789/0 conn(0x7fe5a40b1830 legacy=0x7fe5a405f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 -- 172.21.15.41:0/243840808 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b4760 con 0x7fe5a40b4380 2021-10-21T00:03:13.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a909a700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 0x7fe5a4062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:13.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a8899700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe58c002f70 tx=0x7fe58c006df0).ready entity=mon.1 client_cookie=2a151c2df7865dc3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a37fe700 1 -- 172.21.15.41:0/243840808 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00d4a0 con 0x7fe5a40b4380 2021-10-21T00:03:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a37fe700 1 -- 172.21.15.41:0/243840808 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c000e90 con 0x7fe5a40b4380 2021-10-21T00:03:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a37fe700 1 -- 172.21.15.41:0/243840808 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00d7f0 con 0x7fe5a40b4380 2021-10-21T00:03:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a40b4380 msgr2=0x7fe5a40ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe58c002f70 tx=0x7fe58c006df0).stop 2021-10-21T00:03:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- 172.21.15.41:0/243840808 shutdown_connections 2021-10-21T00:03:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a41433e0 0x7fe5a4062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 --2- 172.21.15.41:0/243840808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- 172.21.15.41:0/243840808 >> 172.21.15.41:0/243840808 conn(0x7fe5a40b7910 msgr2=0x7fe5a40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- 172.21.15.41:0/243840808 shutdown_connections 2021-10-21T00:03:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.159+0000 7fe5a989b700 1 -- 172.21.15.41:0/243840808 wait complete. 2021-10-21T00:03:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 Processor -- start 2021-10-21T00:03:13.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- start start 2021-10-21T00:03:13.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a40b1830 0x7fe5a409aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a41433e0 0x7fe5a4156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4156680 con 0x7fe5a40b4380 2021-10-21T00:03:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4159e10 con 0x7fe5a41433e0 2021-10-21T00:03:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4159b70 con 0x7fe5a40b1830 2021-10-21T00:03:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58240/0 (socket says 172.21.15.41:58240) 2021-10-21T00:03:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 -- 172.21.15.41:0/1009892947 learned_addr learned my addr 172.21.15.41:0/1009892947 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a909a700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a41433e0 0x7fe5a4156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a8899700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a40b1830 0x7fe5a409aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 -- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a40b1830 msgr2=0x7fe5a409aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a40b1830 0x7fe5a409aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 -- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a41433e0 msgr2=0x7fe5a4156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a41433e0 0x7fe5a4156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 -- 172.21.15.41:0/1009892947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009470 con 0x7fe5a40b4380 2021-10-21T00:03:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a3fff700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe5a40b0840 tx=0x7fe594007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5940070d0 con 0x7fe5a40b4380 2021-10-21T00:03:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594007230 con 0x7fe5a40b4380 2021-10-21T00:03:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c00b180 con 0x7fe5a40b4380 2021-10-21T00:03:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594005610 con 0x7fe5a40b4380 2021-10-21T00:03:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.163+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40b03e0 con 0x7fe5a40b4380 2021-10-21T00:03:13.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe59401a060 con 0x7fe5a40b4380 2021-10-21T00:03:13.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4156820 con 0x7fe5a40b4380 2021-10-21T00:03:13.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a1ffb700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 0x7fe588055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe59406ae90 con 0x7fe5a40b4380 2021-10-21T00:03:13.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a8899700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 0x7fe588055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.167+0000 7fe5a8899700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 0x7fe588055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe58c018000 tx=0x7fe58c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.175+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5a4156820 con 0x7fe5a40b4380 2021-10-21T00:03:13.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.299+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe5a4156820 con 0x7fe5a40b4380 2021-10-21T00:03:13.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.299+0000 7fe5a1ffb700 1 -- 172.21.15.41:0/1009892947 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5a4156820 con 0x7fe5a40b4380 2021-10-21T00:03:13.310 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:13.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 msgr2=0x7fe588055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 0x7fe588055ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe58c018000 tx=0x7fe58c014000).stop 2021-10-21T00:03:13.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 msgr2=0x7fe5a40ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fe5a40b0840 tx=0x7fe594007aa0).stop 2021-10-21T00:03:13.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 shutdown_connections 2021-10-21T00:03:13.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe588053610 0x7fe588055ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a41433e0 0x7fe5a4156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a40b4380 0x7fe5a40ad190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 --2- 172.21.15.41:0/1009892947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a40b1830 0x7fe5a409aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 >> 172.21.15.41:0/1009892947 conn(0x7fe5a40b7910 msgr2=0x7fe5a4140de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 shutdown_connections 2021-10-21T00:03:13.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.303+0000 7fe5a989b700 1 -- 172.21.15.41:0/1009892947 wait complete. 2021-10-21T00:03:13.323 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 Processor -- start 2021-10-21T00:03:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 -- start start 2021-10-21T00:03:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa95414f9c0 0x7fa954151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95405cad0 con 0x7fa9540aeec0 2021-10-21T00:03:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540b1380 con 0x7fa95405c6f0 2021-10-21T00:03:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa95a67a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9540aece0 con 0x7fa95414f9c0 2021-10-21T00:03:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa958c17700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa95414f9c0 0x7fa954151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa9537fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa9540aeec0 0x7fa9540b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56018/0 (socket says 172.21.15.41:56018) 2021-10-21T00:03:13.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa9537fe700 1 -- 172.21.15.41:0/469388660 learned_addr learned my addr 172.21.15.41:0/469388660 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:13.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147562482 0 0) 0x7fa95405cad0 con 0x7fa9540aeec0 2021-10-21T00:03:13.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa940003260 con 0x7fa9540aeec0 2021-10-21T00:03:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa958c17700 1 -- 172.21.15.41:0/469388660 >> v1:172.21.15.62:6789/0 conn(0x7fa95405c6f0 legacy=0x7fa9540b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280705543 0 0) 0x7fa9540b1380 con 0x7fa95405c6f0 2021-10-21T00:03:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa958c17700 1 -- 172.21.15.41:0/469388660 >> v1:172.21.15.41:6789/0 conn(0x7fa9540aeec0 legacy=0x7fa9540b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.423+0000 7fa958c17700 1 -- 172.21.15.41:0/469388660 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540ae300 con 0x7fa95414f9c0 2021-10-21T00:03:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa958c17700 1 --2- 172.21.15.41:0/469388660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa954151db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa944002f70 tx=0x7fa944006df0).ready entity=mon.0 client_cookie=179fc8bd97ea5fd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94400d610 con 0x7fa95414f9c0 2021-10-21T00:03:13.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944000e90 con 0x7fa95414f9c0 2021-10-21T00:03:13.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa952ffd700 1 -- 172.21.15.41:0/469388660 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94400d960 con 0x7fa95414f9c0 2021-10-21T00:03:13.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- 172.21.15.41:0/469388660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 msgr2=0x7fa954151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 --2- 172.21.15.41:0/469388660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa954151db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa944002f70 tx=0x7fa944006df0).stop 2021-10-21T00:03:13.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- 172.21.15.41:0/469388660 shutdown_connections 2021-10-21T00:03:13.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 --2- 172.21.15.41:0/469388660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa954151db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- 172.21.15.41:0/469388660 >> 172.21.15.41:0/469388660 conn(0x7fa954063210 msgr2=0x7fa95405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- 172.21.15.41:0/469388660 shutdown_connections 2021-10-21T00:03:13.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- 172.21.15.41:0/469388660 wait complete. 2021-10-21T00:03:13.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 Processor -- start 2021-10-21T00:03:13.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.427+0000 7fa95a67a700 1 -- start start 2021-10-21T00:03:13.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa95405c6f0 0x7fa9540671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9540aeec0 0x7fa954066b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954067740 con 0x7fa95414f9c0 2021-10-21T00:03:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95414a9c0 con 0x7fa95405c6f0 2021-10-21T00:03:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95414ae60 con 0x7fa9540aeec0 2021-10-21T00:03:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58256/0 (socket says 172.21.15.41:58256) 2021-10-21T00:03:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 -- 172.21.15.41:0/349576544 learned_addr learned my addr 172.21.15.41:0/349576544 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa953fff700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa95405c6f0 0x7fa9540671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa9537fe700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9540aeec0 0x7fa954066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 -- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9540aeec0 msgr2=0x7fa954066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9540aeec0 0x7fa954066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 -- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa95405c6f0 msgr2=0x7fa9540671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa95405c6f0 0x7fa9540671a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 -- 172.21.15.41:0/349576544 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94400b180 con 0x7fa95414f9c0 2021-10-21T00:03:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa958c17700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa944002f70 tx=0x7fa944014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa944016070 con 0x7fa95414f9c0 2021-10-21T00:03:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400d290 con 0x7fa95414f9c0 2021-10-21T00:03:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9541401a0 con 0x7fa95414f9c0 2021-10-21T00:03:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa944013d60 con 0x7fa95414f9c0 2021-10-21T00:03:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954140720 con 0x7fa95414f9c0 2021-10-21T00:03:13.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95414ab80 con 0x7fa95414f9c0 2021-10-21T00:03:13.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.431+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa944025030 con 0x7fa95414f9c0 2021-10-21T00:03:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.435+0000 7fa9517fa700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 0x7fa934055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.435+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa94406c850 con 0x7fa95414f9c0 2021-10-21T00:03:13.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.435+0000 7fa953fff700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 0x7fa934055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.435+0000 7fa953fff700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 0x7fa934055a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa94c00d000 tx=0x7fa94c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.439+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9440439b0 con 0x7fa95414f9c0 2021-10-21T00:03:13.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.567+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9540ae5a0 con 0x7fa95414f9c0 2021-10-21T00:03:13.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.567+0000 7fa9517fa700 1 -- 172.21.15.41:0/349576544 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9440230a0 con 0x7fa95414f9c0 2021-10-21T00:03:13.582 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:13.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 msgr2=0x7fa934055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 0x7fa934055a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa94c00d000 tx=0x7fa94c009040).stop 2021-10-21T00:03:13.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 msgr2=0x7fa9540b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa944002f70 tx=0x7fa944014000).stop 2021-10-21T00:03:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 shutdown_connections 2021-10-21T00:03:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa934053580 0x7fa934055a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa95414f9c0 0x7fa9540b3ca0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9540aeec0 0x7fa954066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 --2- 172.21.15.41:0/349576544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa95405c6f0 0x7fa9540671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 >> 172.21.15.41:0/349576544 conn(0x7fa954063210 msgr2=0x7fa954146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 shutdown_connections 2021-10-21T00:03:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.571+0000 7fa95a67a700 1 -- 172.21.15.41:0/349576544 wait complete. 2021-10-21T00:03:13.601 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:13.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.707+0000 7f7c13fff700 1 Processor -- start 2021-10-21T00:03:13.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 -- start start 2021-10-21T00:03:13.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 0x7f7c140acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 0x7f7c140b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c140ba000 con 0x7f7c1405c860 2021-10-21T00:03:13.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c14143bc0 con 0x7f7c140b9c20 2021-10-21T00:03:13.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c13fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1405ccf0 con 0x7f7c140b41a0 2021-10-21T00:03:13.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c12ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 0x7f7c140acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c127fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7c1405c860 0x7f7c141434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56034/0 (socket says 172.21.15.41:56034) 2021-10-21T00:03:13.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c127fc700 1 -- 172.21.15.41:0/1420596494 learned_addr learned my addr 172.21.15.41:0/1420596494 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:13.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 --2- 172.21.15.41:0/1420596494 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 0x7f7c140b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131961572 0 0) 0x7f7c140ba000 con 0x7f7c1405c860 2021-10-21T00:03:13.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf4003260 con 0x7f7c1405c860 2021-10-21T00:03:13.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 -- 172.21.15.41:0/1420596494 >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 msgr2=0x7f7c140acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:13.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 --2- 172.21.15.41:0/1420596494 >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 0x7f7c140acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 -- 172.21.15.41:0/1420596494 >> v1:172.21.15.41:6789/0 conn(0x7f7c1405c860 legacy=0x7f7c141434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393550908 0 0) 0x7f7bf4003260 con 0x7f7c1405c860 2021-10-21T00:03:13.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 -- 172.21.15.41:0/1420596494 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14142ad0 con 0x7f7c140b41a0 2021-10-21T00:03:13.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c12ffd700 1 --2- 172.21.15.41:0/1420596494 >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 0x7f7c140acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:13.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c137fe700 1 --2- 172.21.15.41:0/1420596494 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 0x7f7c140b45c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7bfc001800 tx=0x7f7c0c0091d0).ready entity=mon.2 client_cookie=5000385b3ce833f6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc001660 con 0x7f7c140b41a0 2021-10-21T00:03:13.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00f510 con 0x7f7c140b41a0 2021-10-21T00:03:13.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.711+0000 7f7c11ffb700 1 -- 172.21.15.41:0/1420596494 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c0c00f680 con 0x7f7c140b41a0 2021-10-21T00:03:13.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- 172.21.15.41:0/1420596494 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 msgr2=0x7f7c140b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- 172.21.15.41:0/1420596494 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 0x7f7c140b45c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7bfc001800 tx=0x7f7c0c0091d0).stop 2021-10-21T00:03:13.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- 172.21.15.41:0/1420596494 shutdown_connections 2021-10-21T00:03:13.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- 172.21.15.41:0/1420596494 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b41a0 0x7f7c140b45c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- 172.21.15.41:0/1420596494 >> v2:172.21.15.41:3300/0 conn(0x7f7c140b9c20 0x7f7c140acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- 172.21.15.41:0/1420596494 >> 172.21.15.41:0/1420596494 conn(0x7f7c14062f00 msgr2=0x7f7c140b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- 172.21.15.41:0/1420596494 shutdown_connections 2021-10-21T00:03:13.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- 172.21.15.41:0/1420596494 wait complete. 2021-10-21T00:03:13.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 Processor -- start 2021-10-21T00:03:13.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- start start 2021-10-21T00:03:13.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 0x7f7c14145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 0x7f7c1413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14112e40 con 0x7f7c140b41a0 2021-10-21T00:03:13.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b1010 con 0x7f7c1405c860 2021-10-21T00:03:13.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c13fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1413ee70 con 0x7f7c140b9c20 2021-10-21T00:03:13.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c127fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c127fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58266/0 (socket says 172.21.15.41:58266) 2021-10-21T00:03:13.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c127fc700 1 -- 172.21.15.41:0/554310317 learned_addr learned my addr 172.21.15.41:0/554310317 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:13.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c12ffd700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 0x7f7c14145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c127fc700 1 -- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 msgr2=0x7f7c1413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.715+0000 7f7c137fe700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 0x7f7c1413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c127fc700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 0x7f7c1413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c127fc700 1 -- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 msgr2=0x7f7c14145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c127fc700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 0x7f7c14145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c127fc700 1 -- 172.21.15.41:0/554310317 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0400b120 con 0x7f7c140b41a0 2021-10-21T00:03:13.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c12ffd700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 0x7f7c14145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:13.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c137fe700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 0x7f7c1413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:13.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c127fc700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7c140afd00 tx=0x7f7bfc0011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc007170 con 0x7f7c140b41a0 2021-10-21T00:03:13.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0072d0 con 0x7f7c140b41a0 2021-10-21T00:03:13.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c009470 con 0x7f7c140b41a0 2021-10-21T00:03:13.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc004920 con 0x7f7c140b41a0 2021-10-21T00:03:13.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c141462e0 con 0x7f7c140b41a0 2021-10-21T00:03:13.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140b0e30 con 0x7f7c140b41a0 2021-10-21T00:03:13.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bfc004a80 con 0x7f7c140b41a0 2021-10-21T00:03:13.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 0x7f7bf8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bfc06b650 con 0x7f7c140b41a0 2021-10-21T00:03:13.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c12ffd700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 0x7f7bf8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:13.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.719+0000 7f7c12ffd700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 0x7f7bf8055ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7c04008000 tx=0x7f7c04008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:13.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.723+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bfc0427b0 con 0x7f7c140b41a0 2021-10-21T00:03:13.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c14142d70 con 0x7f7c140b41a0 2021-10-21T00:03:13.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c0bfff700 1 -- 172.21.15.41:0/554310317 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7bfc001be0 con 0x7f7c140b41a0 2021-10-21T00:03:13.861 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:13.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 msgr2=0x7f7bf8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 0x7f7bf8055ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7c04008000 tx=0x7f7c04008040).stop 2021-10-21T00:03:13.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 msgr2=0x7f7c1413e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:13.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.851+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7c140afd00 tx=0x7f7bfc0011a0).stop 2021-10-21T00:03:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 shutdown_connections 2021-10-21T00:03:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bf8053610 0x7f7bf8055ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c140b9c20 0x7f7c1413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c140b41a0 0x7f7c1413e490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 --2- 172.21.15.41:0/554310317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c1405c860 0x7f7c14145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 >> 172.21.15.41:0/554310317 conn(0x7f7c14062f00 msgr2=0x7f7c1413f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 shutdown_connections 2021-10-21T00:03:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.855+0000 7f7c13fff700 1 -- 172.21.15.41:0/554310317 wait complete. 2021-10-21T00:03:13.873 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:13.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.975+0000 7f5a295e2700 1 Processor -- start 2021-10-21T00:03:13.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.975+0000 7f5a295e2700 1 -- start start 2021-10-21T00:03:13.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a240b6130 0x7f5a240b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:13.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a240ac610 con 0x7f5a240b0290 2021-10-21T00:03:14.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a240b6510 con 0x7f5a240b6130 2021-10-21T00:03:14.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240ace50 con 0x7f5a24143110 2021-10-21T00:03:14.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a22ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a240b6130 0x7f5a240b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:48542/0 (socket says 172.21.15.41:48542) 2021-10-21T00:03:14.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 -- 172.21.15.41:0/4206640927 learned_addr learned my addr 172.21.15.41:0/4206640927 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:14.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a227fc700 1 --1- 172.21.15.41:0/4206640927 >> v1:172.21.15.62:6789/0 conn(0x7f5a240b0290 0x7f5a24142a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:35870/0 (socket says 172.21.15.41:35870) 2021-10-21T00:03:14.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 -- 172.21.15.41:0/4206640927 >> v2:172.21.15.62:3300/0 conn(0x7f5a240b6130 msgr2=0x7f5a240b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:14.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 --2- 172.21.15.41:0/4206640927 >> v2:172.21.15.62:3300/0 conn(0x7f5a240b6130 0x7f5a240b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 -- 172.21.15.41:0/4206640927 >> v1:172.21.15.62:6789/0 conn(0x7f5a240b0290 legacy=0x7f5a24142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a21ffb700 1 -- 172.21.15.41:0/4206640927 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138970629 0 0) 0x7f5a240ac610 con 0x7f5a240b0290 2021-10-21T00:03:14.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 -- 172.21.15.41:0/4206640927 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240ad0f0 con 0x7f5a24143110 2021-10-21T00:03:14.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a237fe700 1 --2- 172.21.15.41:0/4206640927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5a1c002f70 tx=0x7f5a1c006eb0).ready entity=mon.2 client_cookie=9899e4efdca56573 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a21ffb700 1 -- 172.21.15.41:0/4206640927 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1c00d570 con 0x7f5a24143110 2021-10-21T00:03:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a21ffb700 1 -- 172.21.15.41:0/4206640927 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c000e90 con 0x7f5a24143110 2021-10-21T00:03:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a21ffb700 1 -- 172.21.15.41:0/4206640927 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1c00d8c0 con 0x7f5a24143110 2021-10-21T00:03:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- 172.21.15.41:0/4206640927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 msgr2=0x7f5a2405bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4206640927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5a1c002f70 tx=0x7f5a1c006eb0).stop 2021-10-21T00:03:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- 172.21.15.41:0/4206640927 shutdown_connections 2021-10-21T00:03:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4206640927 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a2405bca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4206640927 >> v2:172.21.15.62:3300/0 conn(0x7f5a240b6130 0x7f5a240b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- 172.21.15.41:0/4206640927 >> 172.21.15.41:0/4206640927 conn(0x7f5a24063b40 msgr2=0x7f5a240b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- 172.21.15.41:0/4206640927 shutdown_connections 2021-10-21T00:03:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.979+0000 7f5a295e2700 1 -- 172.21.15.41:0/4206640927 wait complete. 2021-10-21T00:03:14.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 Processor -- start 2021-10-21T00:03:14.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 -- start start 2021-10-21T00:03:14.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a240b6130 0x7f5a240b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a24132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2414b890 con 0x7f5a240b0290 2021-10-21T00:03:14.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2414bb30 con 0x7f5a240b6130 2021-10-21T00:03:14.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a295e2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240640e0 con 0x7f5a24143110 2021-10-21T00:03:14.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a24132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58280/0 (socket says 172.21.15.41:58280) 2021-10-21T00:03:14.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a227fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a240b6130 0x7f5a240b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 -- 172.21.15.41:0/4112351945 learned_addr learned my addr 172.21.15.41:0/4112351945 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:14.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 -- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 msgr2=0x7f5a24132310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a24132310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 -- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a240b6130 msgr2=0x7f5a240b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a240b6130 0x7f5a240b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 -- 172.21.15.41:0/4112351945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c00b1e0 con 0x7f5a240b0290 2021-10-21T00:03:14.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.983+0000 7f5a22ffd700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f5a1400c000 tx=0x7f5a140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1400c6a0 con 0x7f5a240b0290 2021-10-21T00:03:14.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400c800 con 0x7f5a240b0290 2021-10-21T00:03:14.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a241358f0 con 0x7f5a240b0290 2021-10-21T00:03:14.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a1400cb60 con 0x7f5a240b0290 2021-10-21T00:03:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a240654a0 con 0x7f5a240b0290 2021-10-21T00:03:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a240642a0 con 0x7f5a240b0290 2021-10-21T00:03:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a14022070 con 0x7f5a240b0290 2021-10-21T00:03:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 0x7f59fc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a1406bf80 con 0x7f5a240b0290 2021-10-21T00:03:14.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.987+0000 7f5a227fc700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 0x7f59fc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.991+0000 7f5a227fc700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 0x7f59fc055b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5a0c00d000 tx=0x7f5a0c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:13.995+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a14042fd0 con 0x7f5a240b0290 2021-10-21T00:03:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.115+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a240ad390 con 0x7f5a240b0290 2021-10-21T00:03:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a1bfff700 1 -- 172.21.15.41:0/4112351945 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5a140465f0 con 0x7f5a240b0290 2021-10-21T00:03:14.126 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:14.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 msgr2=0x7f59fc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 0x7f59fc055b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5a0c00d000 tx=0x7f5a0c009040).stop 2021-10-21T00:03:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 msgr2=0x7f5a240656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f5a1400c000 tx=0x7f5a140091d0).stop 2021-10-21T00:03:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 shutdown_connections 2021-10-21T00:03:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59fc0536d0 0x7f59fc055b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a24143110 0x7f5a24132310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a240b6130 0x7f5a240b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 --2- 172.21.15.41:0/4112351945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a240b0290 0x7f5a240656e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 >> 172.21.15.41:0/4112351945 conn(0x7f5a24063b40 msgr2=0x7f5a2405be30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:14.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 shutdown_connections 2021-10-21T00:03:14.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.119+0000 7f5a295e2700 1 -- 172.21.15.41:0/4112351945 wait complete. 2021-10-21T00:03:14.140 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:03:14.140 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:14.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 Processor -- start 2021-10-21T00:03:14.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 -- start start 2021-10-21T00:03:14.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee80af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2ee81426d0 0x7f2ee805c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee8146b20 con 0x7f2ee80b5f80 2021-10-21T00:03:14.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee8146dc0 con 0x7f2ee81426d0 2021-10-21T00:03:14.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eeefd6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80b6360 con 0x7f2ee80b04d0 2021-10-21T00:03:14.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eecd72700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2ee80b5f80 0x7f2ee8141fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56056/0 (socket says 172.21.15.41:56056) 2021-10-21T00:03:14.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eecd72700 1 -- 172.21.15.41:0/1967841449 learned_addr learned my addr 172.21.15.41:0/1967841449 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:14.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 --2- 172.21.15.41:0/1967841449 >> v2:172.21.15.41:3300/0 conn(0x7f2ee81426d0 0x7f2ee805c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee7fff700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee80af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee77fe700 1 -- 172.21.15.41:0/1967841449 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934520152 0 0) 0x7f2ee8146b20 con 0x7f2ee80b5f80 2021-10-21T00:03:14.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee77fe700 1 -- 172.21.15.41:0/1967841449 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003260 con 0x7f2ee80b5f80 2021-10-21T00:03:14.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 -- 172.21.15.41:0/1967841449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 msgr2=0x7f2ee80af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:14.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee80af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 -- 172.21.15.41:0/1967841449 >> v1:172.21.15.41:6789/0 conn(0x7f2ee80b5f80 legacy=0x7f2ee8141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 -- 172.21.15.41:0/1967841449 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80b64d0 con 0x7f2ee81426d0 2021-10-21T00:03:14.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2eed573700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee805c5d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2ee00032f0 tx=0x7f2ee00091d0).ready entity=mon.0 client_cookie=5b2d7b6da1505bec server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee77fe700 1 -- 172.21.15.41:0/1967841449 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee000b600 con 0x7f2ee81426d0 2021-10-21T00:03:14.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee77fe700 1 -- 172.21.15.41:0/1967841449 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000b760 con 0x7f2ee81426d0 2021-10-21T00:03:14.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.235+0000 7f2ee77fe700 1 -- 172.21.15.41:0/1967841449 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee000b8d0 con 0x7f2ee81426d0 2021-10-21T00:03:14.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1967841449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 msgr2=0x7f2ee805c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee805c5d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f2ee00032f0 tx=0x7f2ee00091d0).stop 2021-10-21T00:03:14.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1967841449 shutdown_connections 2021-10-21T00:03:14.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee805c5d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1967841449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee80af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1967841449 >> 172.21.15.41:0/1967841449 conn(0x7f2ee8063ae0 msgr2=0x7f2ee80b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:14.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1967841449 shutdown_connections 2021-10-21T00:03:14.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1967841449 wait complete. 2021-10-21T00:03:14.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 Processor -- start 2021-10-21T00:03:14.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- start start 2021-10-21T00:03:14.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee8066c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee80b5f80 0x7f2ee81403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8144fd0 con 0x7f2ee81426d0 2021-10-21T00:03:14.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8144610 con 0x7f2ee80b5f80 2021-10-21T00:03:14.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.239+0000 7f2eeefd6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee81448b0 con 0x7f2ee80b04d0 2021-10-21T00:03:14.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58294/0 (socket says 172.21.15.41:58294) 2021-10-21T00:03:14.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 -- 172.21.15.41:0/1120796499 learned_addr learned my addr 172.21.15.41:0/1120796499 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:14.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eecd72700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee8066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2ee7fff700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee80b5f80 0x7f2ee81403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 -- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 msgr2=0x7f2ee8066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee8066c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 -- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee80b5f80 msgr2=0x7f2ee81403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee80b5f80 0x7f2ee81403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 -- 172.21.15.41:0/1120796499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009470 con 0x7f2ee81426d0 2021-10-21T00:03:14.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eecd72700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee8066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:14.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eed573700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2ee00032f0 tx=0x7f2ee0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee000b600 con 0x7f2ee81426d0 2021-10-21T00:03:14.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee8144290 con 0x7f2ee81426d0 2021-10-21T00:03:14.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee0011c10 con 0x7f2ee81426d0 2021-10-21T00:03:14.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee001f3f0 con 0x7f2ee81426d0 2021-10-21T00:03:14.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.243+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8145d60 con 0x7f2ee81426d0 2021-10-21T00:03:14.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ee0026030 con 0x7f2ee81426d0 2021-10-21T00:03:14.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2ee5ffb700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 0x7f2ec0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:14.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee8145140 con 0x7f2ee81426d0 2021-10-21T00:03:14.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ee006c7f0 con 0x7f2ee81426d0 2021-10-21T00:03:14.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2eecd72700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 0x7f2ec0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:14.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.247+0000 7f2eecd72700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 0x7f2ec0055a40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2ed000d000 tx=0x7f2ed0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:14.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.251+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ee8145140 con 0x7f2ee81426d0 2021-10-21T00:03:14.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.415+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ee8144480 con 0x7f2ee81426d0 2021-10-21T00:03:14.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.415+0000 7f2ee5ffb700 1 -- 172.21.15.41:0/1120796499 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2131 (secure 0 0 0) 0x7f2ee00472e0 con 0x7f2ee81426d0 2021-10-21T00:03:14.426 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:14.426 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:00.471696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:14.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 msgr2=0x7f2ec0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 0x7f2ec0055a40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2ed000d000 tx=0x7f2ed0009040).stop 2021-10-21T00:03:14.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 msgr2=0x7f2ee8145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:14.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2ee00032f0 tx=0x7f2ee0016000).stop 2021-10-21T00:03:14.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 shutdown_connections 2021-10-21T00:03:14.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ec0053580 0x7f2ec0055a40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ee81426d0 0x7f2ee8145400 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ee80b5f80 0x7f2ee81403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 --2- 172.21.15.41:0/1120796499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ee80b04d0 0x7f2ee8066c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:14.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 >> 172.21.15.41:0/1120796499 conn(0x7f2ee8063ae0 msgr2=0x7f2ee80b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:14.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 shutdown_connections 2021-10-21T00:03:14.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:14.419+0000 7f2eeefd6700 1 -- 172.21.15.41:0/1120796499 wait complete. 2021-10-21T00:03:14.431 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 5 2021-10-21T00:03:14.645 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:02:57.790214+0000', 'modified': '2021-10-21T00:03:00.471696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3079329835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3079329835}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3079329835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:14.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:14.647 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:14.764 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":15.277834316,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":22,"uptime":20.213461177999999} 2021-10-21T00:03:14.765 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4269, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "rank_uptime": 15.277834316, "state": "up:active", "uptime": 20.213461178, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:14.766 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:03:14.766 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:03:14.767 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:03:14.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:14.768 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:14.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:03:14.856 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:14.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:14.923 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:14.924 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:14.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:14.925 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:03:14.932 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:03:14.932 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:14.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:03:14.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:15.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:15.020 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:15.021 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:15.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:15.021 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:03:15.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:03:15.062+0000 7fe1279f9080 -1 init, newargv = 0x558537c0f050 newargc=9ceph-fuse[13778]: starting ceph client 2021-10-21T00:03:15.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr: 2021-10-21T00:03:15.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[13778]: starting fuse 2021-10-21T00:03:16.188 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:03:16.210 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:16.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:16.271 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:16.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:16.273 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:03:16.279 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:03:16.279 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:03:16.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:16.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:03:16.281 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:03:16.281 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:03:16.281 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:03:16.281 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:03:16.282 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:03:16.282 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:03:16.282 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:03:16.283 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:03:16.283 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:03:16.283 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:03:16.284 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:03:16.284 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:03:16.284 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:03:16.285 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:03:16.285 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:03:16.285 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:03:16.286 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:03:16.286 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:03:16.286 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:03:16.287 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:03:16.287 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:03:16.287 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:03:16.364 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.13778.asok 2021-10-21T00:03:16.369 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13778.asok 2021-10-21T00:03:16.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:16.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13778.asok status 2021-10-21T00:03:16.479 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:03:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:03:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:03:16.479 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:03:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:03:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:03:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:03:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "13778", 2021-10-21T00:03:16.480 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:03:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:03:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:03:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:03:16.481 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4666, 2021-10-21T00:03:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:03:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:03:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:03:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4666 2021-10-21T00:03:16.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:03:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:03:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:03:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:03:16.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 881984551 2021-10-21T00:03:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:03:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:03:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:03:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:03:16.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:03:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 881984551 2021-10-21T00:03:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:03:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4666 172.21.15.99:0/881984551", 2021-10-21T00:03:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/881984551", 2021-10-21T00:03:16.485 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:03:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 5, 2021-10-21T00:03:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 22, 2021-10-21T00:03:16.486 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:03:16.487 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:03:16.488 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:03:16.488 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:03:16.490 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:16.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 Processor -- start 2021-10-21T00:03:16.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 -- start start 2021-10-21T00:03:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 0x7f89e40ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40b0b50 con 0x7f89e40b2170 2021-10-21T00:03:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40b2550 con 0x7f89e40af620 2021-10-21T00:03:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89ea7d3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b0d90 con 0x7f89e4067a80 2021-10-21T00:03:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89e97d1700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f89e40b2170 0x7f89e40ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56072/0 (socket says 172.21.15.41:56072) 2021-10-21T00:03:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89e97d1700 1 -- 172.21.15.41:0/975090015 learned_addr learned my addr 172.21.15.41:0/975090015 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.595+0000 7f89e9fd2700 1 --2- 172.21.15.41:0/975090015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 0x7f89e40ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493087484 0 0) 0x7f89e40b2550 con 0x7f89e40af620 2021-10-21T00:03:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d0003260 con 0x7f89e40af620 2021-10-21T00:03:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902703688 0 0) 0x7f89d8001040 con 0x7f89e40b2170 2021-10-21T00:03:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e40b2550 con 0x7f89e40b2170 2021-10-21T00:03:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e9fd2700 1 -- 172.21.15.41:0/975090015 >> v1:172.21.15.62:6789/0 conn(0x7f89e40af620 legacy=0x7f89e4149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e9fd2700 1 -- 172.21.15.41:0/975090015 >> v1:172.21.15.41:6789/0 conn(0x7f89e40b2170 legacy=0x7f89e40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e9fd2700 1 -- 172.21.15.41:0/975090015 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40b1030 con 0x7f89e4067a80 2021-10-21T00:03:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e9fd2700 1 --2- 172.21.15.41:0/975090015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 0x7f89e40ab880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f89dc0032f0 tx=0x7f89dc0091d0).ready entity=mon.2 client_cookie=b793a27f9cd700d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89dc00b640 con 0x7f89e4067a80 2021-10-21T00:03:16.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00b7a0 con 0x7f89e4067a80 2021-10-21T00:03:16.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89e3fff700 1 -- 172.21.15.41:0/975090015 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89dc00b910 con 0x7f89e4067a80 2021-10-21T00:03:16.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- 172.21.15.41:0/975090015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 msgr2=0x7f89e40ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/975090015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 0x7f89e40ab880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f89dc0032f0 tx=0x7f89dc0091d0).stop 2021-10-21T00:03:16.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- 172.21.15.41:0/975090015 shutdown_connections 2021-10-21T00:03:16.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/975090015 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e4067a80 0x7f89e40ab880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- 172.21.15.41:0/975090015 >> 172.21.15.41:0/975090015 conn(0x7f89e40b5700 msgr2=0x7f89e40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:16.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- 172.21.15.41:0/975090015 shutdown_connections 2021-10-21T00:03:16.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- 172.21.15.41:0/975090015 wait complete. 2021-10-21T00:03:16.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 Processor -- start 2021-10-21T00:03:16.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 -- start start 2021-10-21T00:03:16.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.599+0000 7f89ea7d3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e4067a80 0x7f89e4063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e40b2170 0x7f89e4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40654c0 con 0x7f89e40af620 2021-10-21T00:03:16.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4097900 con 0x7f89e4067a80 2021-10-21T00:03:16.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40661f0 con 0x7f89e40b2170 2021-10-21T00:03:16.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58310/0 (socket says 172.21.15.41:58310) 2021-10-21T00:03:16.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 -- 172.21.15.41:0/2841415550 learned_addr learned my addr 172.21.15.41:0/2841415550 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:16.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e97d1700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e4067a80 0x7f89e4063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e9fd2700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e40b2170 0x7f89e4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 -- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e40b2170 msgr2=0x7f89e4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e40b2170 0x7f89e4156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 -- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e4067a80 msgr2=0x7f89e4063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e4067a80 0x7f89e4063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 -- 172.21.15.41:0/2841415550 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc009470 con 0x7f89e40af620 2021-10-21T00:03:16.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e8fd0700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f89d4001110 tx=0x7f89d4007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d4012400 con 0x7f89e40af620 2021-10-21T00:03:16.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4012560 con 0x7f89e40af620 2021-10-21T00:03:16.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e4066450 con 0x7f89e40af620 2021-10-21T00:03:16.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89d40128c0 con 0x7f89e40af620 2021-10-21T00:03:16.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e40635e0 con 0x7f89e40af620 2021-10-21T00:03:16.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e4067570 con 0x7f89e40af620 2021-10-21T00:03:16.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89d4019030 con 0x7f89e40af620 2021-10-21T00:03:16.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.603+0000 7f89e27fc700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 0x7f89c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.607+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89d406ac60 con 0x7f89e40af620 2021-10-21T00:03:16.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.607+0000 7f89e97d1700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 0x7f89c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.607+0000 7f89e97d1700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 0x7f89c4055b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f89d800d000 tx=0x7f89d8007900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.611+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89e4067570 con 0x7f89e40af620 2021-10-21T00:03:16.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.739+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89e41566a0 con 0x7f89e40af620 2021-10-21T00:03:16.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.739+0000 7f89e27fc700 1 -- 172.21.15.41:0/2841415550 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f89e41566a0 con 0x7f89e40af620 2021-10-21T00:03:16.749 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:16.749 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:16.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 msgr2=0x7f89c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 0x7f89c4055b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f89d800d000 tx=0x7f89d8007900).stop 2021-10-21T00:03:16.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 msgr2=0x7f89e40ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f89d4001110 tx=0x7f89d4007a90).stop 2021-10-21T00:03:16.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 shutdown_connections 2021-10-21T00:03:16.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f89c40536a0 0x7f89c4055b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89e40b2170 0x7f89e4156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f89e40af620 0x7f89e40ae690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 --2- 172.21.15.41:0/2841415550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e4067a80 0x7f89e4063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 >> 172.21.15.41:0/2841415550 conn(0x7f89e40b5700 msgr2=0x7f89e41491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 shutdown_connections 2021-10-21T00:03:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.743+0000 7f89ea7d3700 1 -- 172.21.15.41:0/2841415550 wait complete. 2021-10-21T00:03:16.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:16.768 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:16.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 Processor -- start 2021-10-21T00:03:16.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 -- start start 2021-10-21T00:03:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc05bfe0 0x7f37bc1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37bc05c6b0 0x7f37bc141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc05c3c0 con 0x7f37bc067a00 2021-10-21T00:03:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0b1920 con 0x7f37bc05c6b0 2021-10-21T00:03:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.871+0000 7f37c12f5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0b27a0 con 0x7f37bc05bfe0 2021-10-21T00:03:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37b37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f37bc067a00 0x7f37bc1466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56088/0 (socket says 172.21.15.41:56088) 2021-10-21T00:03:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37b37fe700 1 -- 172.21.15.41:0/2974979955 learned_addr learned my addr 172.21.15.41:0/2974979955 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 --2- 172.21.15.41:0/2974979955 >> v2:172.21.15.62:3300/0 conn(0x7f37bc05c6b0 0x7f37bc141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bbfff700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc05bfe0 0x7f37bc1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bb7fe700 1 -- 172.21.15.41:0/2974979955 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208039202 0 0) 0x7f37bc05c3c0 con 0x7f37bc067a00 2021-10-21T00:03:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bb7fe700 1 -- 172.21.15.41:0/2974979955 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379c003260 con 0x7f37bc067a00 2021-10-21T00:03:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 -- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc05bfe0 msgr2=0x7f37bc1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc05bfe0 0x7f37bc1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 -- 172.21.15.41:0/2974979955 >> v1:172.21.15.41:6789/0 conn(0x7f37bc067a00 legacy=0x7f37bc1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 -- 172.21.15.41:0/2974979955 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0b2a40 con 0x7f37bc05c6b0 2021-10-21T00:03:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c0af4700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05c6b0 0x7f37bc141930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f37b40032f0 tx=0x7f37b40091d0).ready entity=mon.1 client_cookie=24ca3de32021b5a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bb7fe700 1 -- 172.21.15.41:0/2974979955 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b400b600 con 0x7f37bc05c6b0 2021-10-21T00:03:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bb7fe700 1 -- 172.21.15.41:0/2974979955 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400b760 con 0x7f37bc05c6b0 2021-10-21T00:03:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37bb7fe700 1 -- 172.21.15.41:0/2974979955 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b400b8d0 con 0x7f37bc05c6b0 2021-10-21T00:03:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 -- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05c6b0 msgr2=0x7f37bc141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05c6b0 0x7f37bc141930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f37b40032f0 tx=0x7f37b40091d0).stop 2021-10-21T00:03:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 -- 172.21.15.41:0/2974979955 shutdown_connections 2021-10-21T00:03:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05c6b0 0x7f37bc141930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 --2- 172.21.15.41:0/2974979955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc05bfe0 0x7f37bc1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 -- 172.21.15.41:0/2974979955 >> 172.21.15.41:0/2974979955 conn(0x7f37bc0637b0 msgr2=0x7f37bc063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 -- 172.21.15.41:0/2974979955 shutdown_connections 2021-10-21T00:03:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.875+0000 7f37c12f5700 1 -- 172.21.15.41:0/2974979955 wait complete. 2021-10-21T00:03:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 Processor -- start 2021-10-21T00:03:16.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 -- start start 2021-10-21T00:03:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05bfe0 0x7f37bc115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc067a00 0x7f37bc0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0afdc0 con 0x7f37bc05c6b0 2021-10-21T00:03:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc114d60 con 0x7f37bc05bfe0 2021-10-21T00:03:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc115000 con 0x7f37bc067a00 2021-10-21T00:03:16.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58322/0 (socket says 172.21.15.41:58322) 2021-10-21T00:03:16.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 -- 172.21.15.41:0/187820249 learned_addr learned my addr 172.21.15.41:0/187820249 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:16.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37bbfff700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05bfe0 0x7f37bc115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c0af4700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc067a00 0x7f37bc0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 -- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc067a00 msgr2=0x7f37bc0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc067a00 0x7f37bc0ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 -- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05bfe0 msgr2=0x7f37bc115740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:16.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05bfe0 0x7f37bc115740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:16.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 -- 172.21.15.41:0/187820249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009470 con 0x7f37bc05c6b0 2021-10-21T00:03:16.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b37fe700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f37a4001110 tx=0x7f37a4007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a40070d0 con 0x7f37bc05c6b0 2021-10-21T00:03:16.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4007230 con 0x7f37bc05c6b0 2021-10-21T00:03:16.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.879+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc1152a0 con 0x7f37bc05c6b0 2021-10-21T00:03:16.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a4005610 con 0x7f37bc05c6b0 2021-10-21T00:03:16.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc113390 con 0x7f37bc05c6b0 2021-10-21T00:03:16.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc115430 con 0x7f37bc05c6b0 2021-10-21T00:03:16.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37a401a070 con 0x7f37bc05c6b0 2021-10-21T00:03:16.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37b9ffb700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 0x7f37a00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:16.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f37a406a8c0 con 0x7f37bc05c6b0 2021-10-21T00:03:16.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37bbfff700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 0x7f37a00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:16.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.883+0000 7f37bbfff700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 0x7f37a00559e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f37ac006000 tx=0x7f37ac006d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:16.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:16.891+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37a4041a20 con 0x7f37bc05c6b0 2021-10-21T00:03:17.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.011+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37bc0b11e0 con 0x7f37bc05c6b0 2021-10-21T00:03:17.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.011+0000 7f37b9ffb700 1 -- 172.21.15.41:0/187820249 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37a4045040 con 0x7f37bc05c6b0 2021-10-21T00:03:17.024 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:17.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 msgr2=0x7f37a00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 0x7f37a00559e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f37ac006000 tx=0x7f37ac006d90).stop 2021-10-21T00:03:17.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 msgr2=0x7f37bc113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f37a4001110 tx=0x7f37a4007a60).stop 2021-10-21T00:03:17.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 shutdown_connections 2021-10-21T00:03:17.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a0053520 0x7f37a00559e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37bc067a00 0x7f37bc0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37bc05c6b0 0x7f37bc113990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 --2- 172.21.15.41:0/187820249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37bc05bfe0 0x7f37bc115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 >> 172.21.15.41:0/187820249 conn(0x7f37bc0637b0 msgr2=0x7f37bc13fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 shutdown_connections 2021-10-21T00:03:17.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.015+0000 7f37c12f5700 1 -- 172.21.15.41:0/187820249 wait complete. 2021-10-21T00:03:17.039 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:17.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 Processor -- start 2021-10-21T00:03:17.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 -- start start 2021-10-21T00:03:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcd20062330 0x7fcd200b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcd20062f70 0x7fcd2005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2005bd40 con 0x7fcd200b3a20 2021-10-21T00:03:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2005bf70 con 0x7fcd20062f70 2021-10-21T00:03:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.143+0000 7fcd24f65700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd20142cb0 con 0x7fcd20062330 2021-10-21T00:03:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcd20062f70 0x7fcd2005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcd200b3a20 0x7fcd2013c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56100/0 (socket says 172.21.15.41:56100) 2021-10-21T00:03:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1ffff700 1 -- 172.21.15.41:0/1089369712 learned_addr learned my addr 172.21.15.41:0/1089369712 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1f7fe700 1 --2- 172.21.15.41:0/1089369712 >> v2:172.21.15.62:3300/0 conn(0x7fcd20062330 0x7fcd200b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1effd700 1 -- 172.21.15.41:0/1089369712 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688685600 0 0) 0x7fcd2005bd40 con 0x7fcd200b3a20 2021-10-21T00:03:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1effd700 1 -- 172.21.15.41:0/1089369712 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd00003260 con 0x7fcd200b3a20 2021-10-21T00:03:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 -- 172.21.15.41:0/1089369712 >> v2:172.21.15.62:3300/0 conn(0x7fcd20062330 msgr2=0x7fcd200b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 --2- 172.21.15.41:0/1089369712 >> v2:172.21.15.62:3300/0 conn(0x7fcd20062330 0x7fcd200b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 -- 172.21.15.41:0/1089369712 >> v1:172.21.15.41:6789/0 conn(0x7fcd200b3a20 legacy=0x7fcd2013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 -- 172.21.15.41:0/1089369712 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20142950 con 0x7fcd20062f70 2021-10-21T00:03:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd16ffd700 1 --2- 172.21.15.41:0/1089369712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd2005c410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcd08002f70 tx=0x7fcd08006df0).ready entity=mon.0 client_cookie=56b3ee2aa2e3f751 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1effd700 1 -- 172.21.15.41:0/1089369712 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd0800d4f0 con 0x7fcd20062f70 2021-10-21T00:03:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1effd700 1 -- 172.21.15.41:0/1089369712 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08000e90 con 0x7fcd20062f70 2021-10-21T00:03:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd1effd700 1 -- 172.21.15.41:0/1089369712 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd0800d840 con 0x7fcd20062f70 2021-10-21T00:03:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 -- 172.21.15.41:0/1089369712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 msgr2=0x7fcd2005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 --2- 172.21.15.41:0/1089369712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd2005c410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcd08002f70 tx=0x7fcd08006df0).stop 2021-10-21T00:03:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 -- 172.21.15.41:0/1089369712 shutdown_connections 2021-10-21T00:03:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 --2- 172.21.15.41:0/1089369712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd2005c410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 --2- 172.21.15.41:0/1089369712 >> v2:172.21.15.62:3300/0 conn(0x7fcd20062330 0x7fcd200b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 -- 172.21.15.41:0/1089369712 >> 172.21.15.41:0/1089369712 conn(0x7fcd200b9080 msgr2=0x7fcd200b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 -- 172.21.15.41:0/1089369712 shutdown_connections 2021-10-21T00:03:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 -- 172.21.15.41:0/1089369712 wait complete. 2021-10-21T00:03:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.147+0000 7fcd24f65700 1 Processor -- start 2021-10-21T00:03:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- start start 2021-10-21T00:03:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd20062330 0x7fcd20143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd200b3a20 0x7fcd20155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20140f00 con 0x7fcd20062f70 2021-10-21T00:03:17.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20145bc0 con 0x7fcd200b3a20 2021-10-21T00:03:17.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20141130 con 0x7fcd20062330 2021-10-21T00:03:17.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58336/0 (socket says 172.21.15.41:58336) 2021-10-21T00:03:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd1f7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd20062330 0x7fcd20143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 -- 172.21.15.41:0/2832303786 learned_addr learned my addr 172.21.15.41:0/2832303786 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd1ffff700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd200b3a20 0x7fcd20155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 -- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd20062330 msgr2=0x7fcd20143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd20062330 0x7fcd20143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 -- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd200b3a20 msgr2=0x7fcd20155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd200b3a20 0x7fcd20155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 -- 172.21.15.41:0/2832303786 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0800b180 con 0x7fcd20062f70 2021-10-21T00:03:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd16ffd700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fcd08002f70 tx=0x7fcd08014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd08013e90 con 0x7fcd20062f70 2021-10-21T00:03:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0800de60 con 0x7fcd20062f70 2021-10-21T00:03:17.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd0801e5f0 con 0x7fcd20062f70 2021-10-21T00:03:17.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd20145e20 con 0x7fcd20062f70 2021-10-21T00:03:17.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.151+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2013fc50 con 0x7fcd20062f70 2021-10-21T00:03:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20140ca0 con 0x7fcd20062f70 2021-10-21T00:03:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd0801c070 con 0x7fcd20062f70 2021-10-21T00:03:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd1d7fa700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 0x7fcd04055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd0806c2d0 con 0x7fcd20062f70 2021-10-21T00:03:17.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd1f7fe700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 0x7fcd04055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.155+0000 7fcd1f7fe700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 0x7fcd04055ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcd1000b000 tx=0x7fcd10006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.163+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd08043430 con 0x7fcd20062f70 2021-10-21T00:03:17.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.287+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcd20145fe0 con 0x7fcd20062f70 2021-10-21T00:03:17.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.287+0000 7fcd1d7fa700 1 -- 172.21.15.41:0/2832303786 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcd08023020 con 0x7fcd20062f70 2021-10-21T00:03:17.297 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:17.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 msgr2=0x7fcd04055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 0x7fcd04055ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcd1000b000 tx=0x7fcd10006df0).stop 2021-10-21T00:03:17.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 msgr2=0x7fcd200aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fcd08002f70 tx=0x7fcd08014000).stop 2021-10-21T00:03:17.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 shutdown_connections 2021-10-21T00:03:17.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd04053610 0x7fcd04055ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd200b3a20 0x7fcd20155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd20062f70 0x7fcd200aede0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 --2- 172.21.15.41:0/2832303786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd20062330 0x7fcd20143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 >> 172.21.15.41:0/2832303786 conn(0x7fcd200b9080 msgr2=0x7fcd2005c330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 shutdown_connections 2021-10-21T00:03:17.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.291+0000 7fcd24f65700 1 -- 172.21.15.41:0/2832303786 wait complete. 2021-10-21T00:03:17.311 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:17.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 Processor -- start 2021-10-21T00:03:17.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 -- start start 2021-10-21T00:03:17.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 0x7fb5a41465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a40aff30 con 0x7fb5a40b1b40 2021-10-21T00:03:17.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a40b1f20 con 0x7fb5a40b1350 2021-10-21T00:03:17.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9984700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40aca60 con 0x7fb5a40b0a70 2021-10-21T00:03:17.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a8982700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb5a40b1b40 0x7fb5a40b0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56112/0 (socket says 172.21.15.41:56112) 2021-10-21T00:03:17.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a8982700 1 -- 172.21.15.41:0/4086262919 learned_addr learned my addr 172.21.15.41:0/4086262919 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9183700 1 --2- 172.21.15.41:0/4086262919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 0x7fb5a41465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864591227 0 0) 0x7fb5a40aff30 con 0x7fb5a40b1b40 2021-10-21T00:03:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb584003260 con 0x7fb5a40b1b40 2021-10-21T00:03:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671411444 0 0) 0x7fb5a40b1f20 con 0x7fb5a40b1350 2021-10-21T00:03:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a40aff30 con 0x7fb5a40b1350 2021-10-21T00:03:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9183700 1 -- 172.21.15.41:0/4086262919 >> v1:172.21.15.62:6789/0 conn(0x7fb5a40b1350 legacy=0x7fb5a4145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9183700 1 -- 172.21.15.41:0/4086262919 >> v1:172.21.15.41:6789/0 conn(0x7fb5a40b1b40 legacy=0x7fb5a40b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9183700 1 -- 172.21.15.41:0/4086262919 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a414a310 con 0x7fb5a40b0a70 2021-10-21T00:03:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a9183700 1 --2- 172.21.15.41:0/4086262919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 0x7fb5a41465a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb59c0032f0 tx=0x7fb59c0091d0).ready entity=mon.2 client_cookie=9e054e5ee4a5b218 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00b640 con 0x7fb5a40b0a70 2021-10-21T00:03:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00b7a0 con 0x7fb5a40b0a70 2021-10-21T00:03:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.407+0000 7fb5a37fe700 1 -- 172.21.15.41:0/4086262919 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00b910 con 0x7fb5a40b0a70 2021-10-21T00:03:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- 172.21.15.41:0/4086262919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 msgr2=0x7fb5a41465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 --2- 172.21.15.41:0/4086262919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 0x7fb5a41465a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb59c0032f0 tx=0x7fb59c0091d0).stop 2021-10-21T00:03:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- 172.21.15.41:0/4086262919 shutdown_connections 2021-10-21T00:03:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 --2- 172.21.15.41:0/4086262919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b0a70 0x7fb5a41465a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- 172.21.15.41:0/4086262919 >> 172.21.15.41:0/4086262919 conn(0x7fb5a40627b0 msgr2=0x7fb5a4062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- 172.21.15.41:0/4086262919 shutdown_connections 2021-10-21T00:03:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- 172.21.15.41:0/4086262919 wait complete. 2021-10-21T00:03:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 Processor -- start 2021-10-21T00:03:17.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- start start 2021-10-21T00:03:17.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b1350 0x7fb5a4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 0x7fb5a4159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a410ed80 con 0x7fb5a40b0a70 2021-10-21T00:03:17.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a410f020 con 0x7fb5a40b1b40 2021-10-21T00:03:17.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9984700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a410eac0 con 0x7fb5a40b1350 2021-10-21T00:03:17.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58348/0 (socket says 172.21.15.41:58348) 2021-10-21T00:03:17.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 -- 172.21.15.41:0/371414652 learned_addr learned my addr 172.21.15.41:0/371414652 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:17.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a3fff700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b1350 0x7fb5a4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a9183700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 0x7fb5a4159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 -- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b1350 msgr2=0x7fb5a4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b1350 0x7fb5a4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 -- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 msgr2=0x7fb5a4159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 0x7fb5a4159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.411+0000 7fb5a8982700 1 -- 172.21.15.41:0/371414652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009470 con 0x7fb5a40b0a70 2021-10-21T00:03:17.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a9183700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 0x7fb5a4159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:17.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a8982700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb5940010d0 tx=0x7fb594007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5940070d0 con 0x7fb5a40b0a70 2021-10-21T00:03:17.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb594007230 con 0x7fb5a40b0a70 2021-10-21T00:03:17.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a414e430 con 0x7fb5a40b0a70 2021-10-21T00:03:17.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb594005610 con 0x7fb5a40b0a70 2021-10-21T00:03:17.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a414c830 con 0x7fb5a40b0a70 2021-10-21T00:03:17.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a40b0f20 con 0x7fb5a40b0a70 2021-10-21T00:03:17.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb59401a070 con 0x7fb5a40b0a70 2021-10-21T00:03:17.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 0x7fb588055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb59406aaf0 con 0x7fb5a40b0a70 2021-10-21T00:03:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a3fff700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 0x7fb588055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.415+0000 7fb5a3fff700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 0x7fb588055a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb58c00d000 tx=0x7fb58c007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.419+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb594041c50 con 0x7fb5a40b0a70 2021-10-21T00:03:17.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.543+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5a4057350 con 0x7fb5a40b0a70 2021-10-21T00:03:17.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a1ffb700 1 -- 172.21.15.41:0/371414652 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb594045270 con 0x7fb5a40b0a70 2021-10-21T00:03:17.562 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:17.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 msgr2=0x7fb588055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 0x7fb588055a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb58c00d000 tx=0x7fb58c007a20).stop 2021-10-21T00:03:17.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 msgr2=0x7fb5a4110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb5940010d0 tx=0x7fb594007b00).stop 2021-10-21T00:03:17.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 shutdown_connections 2021-10-21T00:03:17.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5880535b0 0x7fb588055a70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a40b1b40 0x7fb5a4159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5a40b1350 0x7fb5a4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 --2- 172.21.15.41:0/371414652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5a40b0a70 0x7fb5a4110670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 >> 172.21.15.41:0/371414652 conn(0x7fb5a40627b0 msgr2=0x7fb5a4149580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 shutdown_connections 2021-10-21T00:03:17.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.547+0000 7fb5a9984700 1 -- 172.21.15.41:0/371414652 wait complete. 2021-10-21T00:03:17.567 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:17.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.679+0000 7f1a3c831700 1 Processor -- start 2021-10-21T00:03:17.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.679+0000 7f1a3c831700 1 -- start start 2021-10-21T00:03:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a3c831700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a380ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a3c831700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a380b0b50 con 0x7f1a380af620 2021-10-21T00:03:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a3c831700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a380b2550 con 0x7f1a38067a80 2021-10-21T00:03:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a3c831700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380b0d90 con 0x7f1a380b2170 2021-10-21T00:03:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1a380af620 0x7f1a380ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56126/0 (socket says 172.21.15.41:56126) 2021-10-21T00:03:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 -- 172.21.15.41:0/1555683227 learned_addr learned my addr 172.21.15.41:0/1555683227 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a377fe700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a380ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107665948 0 0) 0x7f1a28001110 con 0x7f1a380af620 2021-10-21T00:03:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a24003260 con 0x7f1a380af620 2021-10-21T00:03:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497028164 0 0) 0x7f1a380b2550 con 0x7f1a38067a80 2021-10-21T00:03:17.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a28001110 con 0x7f1a38067a80 2021-10-21T00:03:17.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321646446 0 0) 0x7f1a24003260 con 0x7f1a380af620 2021-10-21T00:03:17.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 msgr2=0x7f1a380ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a380ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 >> v1:172.21.15.62:6789/0 conn(0x7f1a38067a80 legacy=0x7f1a38149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380b1030 con 0x7f1a380af620 2021-10-21T00:03:17.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f1a280017f0 con 0x7f1a380af620 2021-10-21T00:03:17.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 >> v1:172.21.15.41:6789/0 conn(0x7f1a380af620 legacy=0x7f1a380ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a24003910 0x7f1a24003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a24004500 0x7f1a24004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a24004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380b0d90 con 0x7f1a24004500 2021-10-21T00:03:17.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2400b780 con 0x7f1a24003910 2021-10-21T00:03:17.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2400b940 con 0x7f1a380b2170 2021-10-21T00:03:17.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a24004500 0x7f1a24004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a37fff700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a24004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a377fe700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a24003910 0x7f1a24003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 -- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 msgr2=0x7f1a24004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a380b2170 0x7f1a24004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 -- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a24003910 msgr2=0x7f1a24003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a24003910 0x7f1a24003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 -- 172.21.15.41:0/1555683227 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24003260 con 0x7f1a24004500 2021-10-21T00:03:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a24004500 0x7f1a24004980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1a280015c0 tx=0x7f1a38061f20).ready entity=mon.0 client_cookie=baaf447a26b74798 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a280070d0 con 0x7f1a24004500 2021-10-21T00:03:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a28007230 con 0x7f1a24004500 2021-10-21T00:03:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.683+0000 7f1a367fc700 1 -- 172.21.15.41:0/1555683227 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a2800ca20 con 0x7f1a24004500 2021-10-21T00:03:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- 172.21.15.41:0/1555683227 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a24004500 msgr2=0x7f1a24004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 --2- 172.21.15.41:0/1555683227 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a24004500 0x7f1a24004980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1a280015c0 tx=0x7f1a38061f20).stop 2021-10-21T00:03:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a37fff700 1 -- 172.21.15.41:0/1555683227 reap_dead start 2021-10-21T00:03:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- 172.21.15.41:0/1555683227 shutdown_connections 2021-10-21T00:03:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- 172.21.15.41:0/1555683227 >> 172.21.15.41:0/1555683227 conn(0x7f1a380b5700 msgr2=0x7f1a380b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- 172.21.15.41:0/1555683227 shutdown_connections 2021-10-21T00:03:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- 172.21.15.41:0/1555683227 wait complete. 2021-10-21T00:03:17.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 Processor -- start 2021-10-21T00:03:17.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- start start 2021-10-21T00:03:17.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a24004500 0x7f1a38064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 0x7f1a38064840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38159e60 con 0x7f1a38147d60 2021-10-21T00:03:17.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a381486d0 con 0x7f1a380ac500 2021-10-21T00:03:17.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.687+0000 7f1a3c831700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815a0f0 con 0x7f1a24004500 2021-10-21T00:03:17.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58372/0 (socket says 172.21.15.41:58372) 2021-10-21T00:03:17.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 -- 172.21.15.41:0/3562858932 learned_addr learned my addr 172.21.15.41:0/3562858932 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:17.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 0x7f1a38064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a377fe700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a24004500 0x7f1a38064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 -- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a24004500 msgr2=0x7f1a38064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a24004500 0x7f1a38064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 -- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 msgr2=0x7f1a38064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 0x7f1a38064840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 -- 172.21.15.41:0/3562858932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3815a390 con 0x7f1a38147d60 2021-10-21T00:03:17.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a36ffd700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 0x7f1a38064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:17.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a37fff700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1a30000b60 tx=0x7f1a30007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a30012780 con 0x7f1a38147d60 2021-10-21T00:03:17.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a300128e0 con 0x7f1a38147d60 2021-10-21T00:03:17.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a38155fe0 con 0x7f1a38147d60 2021-10-21T00:03:17.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a30012c40 con 0x7f1a38147d60 2021-10-21T00:03:17.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a38156490 con 0x7f1a38147d60 2021-10-21T00:03:17.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1a3001d460 con 0x7f1a38147d60 2021-10-21T00:03:17.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a380b12d0 con 0x7f1a38147d60 2021-10-21T00:03:17.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 0x7f1a18055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.691+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a3006beb0 con 0x7f1a38147d60 2021-10-21T00:03:17.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.695+0000 7f1a377fe700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 0x7f1a18055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.695+0000 7f1a377fe700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 0x7f1a18055b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1a2c00b000 tx=0x7f1a2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.703+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1a30042fb0 con 0x7f1a38147d60 2021-10-21T00:03:17.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.831+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a38057350 con 0x7f1a38147d60 2021-10-21T00:03:17.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.831+0000 7f1a34ff9700 1 -- 172.21.15.41:0/3562858932 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1a300465d0 con 0x7f1a38147d60 2021-10-21T00:03:17.841 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:17.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 msgr2=0x7f1a18055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 0x7f1a18055b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1a2c00b000 tx=0x7f1a2c008040).stop 2021-10-21T00:03:17.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 msgr2=0x7f1a381481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1a30000b60 tx=0x7f1a30007d80).stop 2021-10-21T00:03:17.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 shutdown_connections 2021-10-21T00:03:17.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1a180536a0 0x7f1a18055b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1a38147d60 0x7f1a381481e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a380ac500 0x7f1a38064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 --2- 172.21.15.41:0/3562858932 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1a24004500 0x7f1a38064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 >> 172.21.15.41:0/3562858932 conn(0x7f1a380b5700 msgr2=0x7f1a380b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 shutdown_connections 2021-10-21T00:03:17.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.835+0000 7f1a3c831700 1 -- 172.21.15.41:0/3562858932 wait complete. 2021-10-21T00:03:17.860 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:03:17.861 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:17.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 Processor -- start 2021-10-21T00:03:17.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 -- start start 2021-10-21T00:03:17.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f175c0b2170 0x7f175c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 0x7f175c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0abb50 0x7f175c14a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0b0b50 con 0x7f175c0b2170 2021-10-21T00:03:17.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0b2550 con 0x7f175c0af620 2021-10-21T00:03:17.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0b0d90 con 0x7f175c0abb50 2021-10-21T00:03:17.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f175c0b2170 0x7f175c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f175c0b2170 0x7f175c0ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58378/0 (socket says 172.21.15.41:58378) 2021-10-21T00:03:17.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 -- 172.21.15.41:0/508139985 learned_addr learned my addr 172.21.15.41:0/508139985 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:17.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175a7fc700 1 --2- 172.21.15.41:0/508139985 >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 0x7f175c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175b7fe700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0abb50 0x7f175c14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 -- 172.21.15.41:0/508139985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0abb50 msgr2=0x7f175c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0abb50 0x7f175c14a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 -- 172.21.15.41:0/508139985 >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 msgr2=0x7f175c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:17.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 --2- 172.21.15.41:0/508139985 >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 0x7f175c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 -- 172.21.15.41:0/508139985 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0b1030 con 0x7f175c0b2170 2021-10-21T00:03:17.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175a7fc700 1 --2- 172.21.15.41:0/508139985 >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 0x7f175c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:17.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.959+0000 7f175affd700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0b2170 0x7f175c0ab170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1750002f70 tx=0x7f1750006eb0).ready entity=mon.0 client_cookie=3e6ecab73dc342e2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f1759ffb700 1 -- 172.21.15.41:0/508139985 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f175000d570 con 0x7f175c0b2170 2021-10-21T00:03:17.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f1759ffb700 1 -- 172.21.15.41:0/508139985 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750000e90 con 0x7f175c0b2170 2021-10-21T00:03:17.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f1759ffb700 1 -- 172.21.15.41:0/508139985 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f175000d900 con 0x7f175c0b2170 2021-10-21T00:03:17.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- 172.21.15.41:0/508139985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0b2170 msgr2=0x7f175c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0b2170 0x7f175c0ab170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1750002f70 tx=0x7f1750006eb0).stop 2021-10-21T00:03:17.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- 172.21.15.41:0/508139985 shutdown_connections 2021-10-21T00:03:17.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0abb50 0x7f175c14a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- 172.21.15.41:0/508139985 >> v2:172.21.15.62:3300/0 conn(0x7f175c0af620 0x7f175c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- 172.21.15.41:0/508139985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0b2170 0x7f175c0ab170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- 172.21.15.41:0/508139985 >> 172.21.15.41:0/508139985 conn(0x7f175c0b5700 msgr2=0x7f175c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:17.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- 172.21.15.41:0/508139985 shutdown_connections 2021-10-21T00:03:17.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- 172.21.15.41:0/508139985 wait complete. 2021-10-21T00:03:17.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 Processor -- start 2021-10-21T00:03:17.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- start start 2021-10-21T00:03:17.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 0x7f175c144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0b2170 0x7f175c0ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c145380 con 0x7f175c0abb50 2021-10-21T00:03:17.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c156e30 con 0x7f175c0af620 2021-10-21T00:03:17.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0aca60 con 0x7f175c0b2170 2021-10-21T00:03:17.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58382/0 (socket says 172.21.15.41:58382) 2021-10-21T00:03:17.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0b2170 0x7f175c0ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 -- 172.21.15.41:0/1115969841 learned_addr learned my addr 172.21.15.41:0/1115969841 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:17.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175a7fc700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 0x7f175c144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 -- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0b2170 msgr2=0x7f175c0ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0b2170 0x7f175c0ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 -- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 msgr2=0x7f175c144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:17.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 0x7f175c144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:17.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.963+0000 7f175affd700 1 -- 172.21.15.41:0/1115969841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009470 con 0x7f175c0abb50 2021-10-21T00:03:17.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f175a7fc700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 0x7f175c144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:17.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f175affd700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1750002f70 tx=0x7f1750015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17500117e0 con 0x7f175c0abb50 2021-10-21T00:03:17.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750011940 con 0x7f175c0abb50 2021-10-21T00:03:17.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1750011ca0 con 0x7f175c0abb50 2021-10-21T00:03:17.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175000b1e0 con 0x7f175c0abb50 2021-10-21T00:03:17.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c1562b0 con 0x7f175c0abb50 2021-10-21T00:03:17.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c0b12d0 con 0x7f175c0abb50 2021-10-21T00:03:17.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1750025030 con 0x7f175c0abb50 2021-10-21T00:03:17.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 0x7f1738055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:17.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.967+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f175006ca70 con 0x7f175c0abb50 2021-10-21T00:03:17.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.971+0000 7f175a7fc700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 0x7f1738055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:17.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.971+0000 7f175a7fc700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 0x7f1738055ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f174c00b000 tx=0x7f174c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:17.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:17.975+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1750043be0 con 0x7f175c0abb50 2021-10-21T00:03:18.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.135+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f175c057350 con 0x7f175c0abb50 2021-10-21T00:03:18.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f174bfff700 1 -- 172.21.15.41:0/1115969841 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2131 (secure 0 0 0) 0x7f175006ce60 con 0x7f175c0abb50 2021-10-21T00:03:18.146 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:18.147 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:00.471696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:18.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 msgr2=0x7f1738055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:18.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 0x7f1738055ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f174c00b000 tx=0x7f174c008040).stop 2021-10-21T00:03:18.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 msgr2=0x7f175c1445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:18.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1750002f70 tx=0x7f1750015000).stop 2021-10-21T00:03:18.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 shutdown_connections 2021-10-21T00:03:18.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1738053610 0x7f1738055ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:18.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f175c0b2170 0x7f175c0ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:18.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f175c0af620 0x7f175c144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:18.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 --2- 172.21.15.41:0/1115969841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f175c0abb50 0x7f175c1445a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:18.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 >> 172.21.15.41:0/1115969841 conn(0x7f175c0b5700 msgr2=0x7f175c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:18.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 shutdown_connections 2021-10-21T00:03:18.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:18.139+0000 7f175bfff700 1 -- 172.21.15.41:0/1115969841 wait complete. 2021-10-21T00:03:18.152 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 5 2021-10-21T00:03:18.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:02:57.790214+0000', 'modified': '2021-10-21T00:03:00.471696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3079329835', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3079329835}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3079329835}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:18.361 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:18.361 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:18.480 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":18.993483315999999,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":22,"uptime":23.929098152000002} 2021-10-21T00:03:18.480 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4269, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 22, "rank_uptime": 18.993483316, "state": "up:active", "uptime": 23.929098152, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:18.481 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:03:18.481 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-10-21T00:03:18.482 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-10-21T00:03:18.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.483 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:18.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-10-21T00:03:18.509 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:18.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:18.523 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:18.524 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:18.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.525 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-10-21T00:03:18.573 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:03:18.573 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:18.576 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-10-21T00:03:18.594 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:18.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:18.661 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:18.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.664 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-10-21T00:03:18.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:2021-10-21T00:03:18.658+0000 7fb169371080 -1 init, newargv = 0x56046b696730 newargc=9ceph-fuse[13795 2021-10-21T00:03:18.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:]: starting ceph client 2021-10-21T00:03:18.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:ceph-fuse[13795]: starting fuse 2021-10-21T00:03:18.676 INFO:teuthology.orchestra.run.smithi102.stdout:51 2021-10-21T00:03:18.676 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [51] 2021-10-21T00:03:18.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-10-21T00:03:18.678 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-10-21T00:03:18.679 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-10-21T00:03:18.680 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-10-21T00:03:18.680 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-10-21T00:03:18.681 DEBUG:teuthology.orchestra.run.smithi102:> 2021-10-21T00:03:18.682 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-10-21T00:03:18.683 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-10-21T00:03:18.683 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-10-21T00:03:18.684 DEBUG:teuthology.orchestra.run.smithi102:> 2021-10-21T00:03:18.684 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-10-21T00:03:18.684 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-10-21T00:03:18.685 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-10-21T00:03:18.685 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-10-21T00:03:18.685 DEBUG:teuthology.orchestra.run.smithi102:> 2021-10-21T00:03:18.686 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-10-21T00:03:18.686 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:03:18.686 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:03:18.687 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-10-21T00:03:18.687 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:03:18.688 DEBUG:teuthology.orchestra.run.smithi102:> 2021-10-21T00:03:18.688 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.2")) 2021-10-21T00:03:18.689 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-10-21T00:03:18.757 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.2.13795.asok 2021-10-21T00:03:18.761 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.13795.asok 2021-10-21T00:03:18.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.13795.asok status 2021-10-21T00:03:18.845 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-10-21T00:03:18.845 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-10-21T00:03:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:03:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:03:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "2", 2021-10-21T00:03:18.846 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-10-21T00:03:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-10-21T00:03:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "13795", 2021-10-21T00:03:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-10-21T00:03:18.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-10-21T00:03:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-10-21T00:03:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-10-21T00:03:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4711, 2021-10-21T00:03:18.848 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-10-21T00:03:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-10-21T00:03:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-10-21T00:03:18.849 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4711 2021-10-21T00:03:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-10-21T00:03:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-10-21T00:03:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-10-21T00:03:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-10-21T00:03:18.850 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3582602127 2021-10-21T00:03:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-10-21T00:03:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-10-21T00:03:18.851 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-10-21T00:03:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-10-21T00:03:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-10-21T00:03:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3582602127 2021-10-21T00:03:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-10-21T00:03:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4711 172.21.15.102:0/3582602127", 2021-10-21T00:03:18.853 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/3582602127", 2021-10-21T00:03:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-10-21T00:03:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 5, 2021-10-21T00:03:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 22, 2021-10-21T00:03:18.854 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:03:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-10-21T00:03:18.855 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-10-21T00:03:18.855 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-10-21T00:03:18.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.858 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:18.858 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:18.867 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:03:18.868 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:18.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.868 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:18.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.933 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:18.933 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:18.941 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:03:18.943 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:03:18.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:18.944 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:19.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:19.010 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:19.010 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:19.018 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-10-21T00:03:19.019 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-10-21T00:03:19.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:19.020 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:19.086 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-10-21T00:03:19.152 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:19.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 Processor -- start 2021-10-21T00:03:19.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 -- start start 2021-10-21T00:03:19.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ad80b2170 0x7f2ad80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2ad80af620 0x7f2ad80ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80b0b50 con 0x7f2ad80abb50 2021-10-21T00:03:19.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80b2550 con 0x7f2ad80af620 2021-10-21T00:03:19.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2ade2d1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80b0d90 con 0x7f2ad80b2170 2021-10-21T00:03:19.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2ad80af620 0x7f2ad80ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2addad0700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2ad80abb50 0x7f2ad814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56164/0 (socket says 172.21.15.41:56164) 2021-10-21T00:03:19.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2addad0700 1 -- 172.21.15.41:0/2463856598 learned_addr learned my addr 172.21.15.41:0/2463856598 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:19.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2add2cf700 1 --2- 172.21.15.41:0/2463856598 >> v2:172.21.15.62:3300/0 conn(0x7f2ad80b2170 0x7f2ad80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 -- 172.21.15.41:0/2463856598 >> v2:172.21.15.62:3300/0 conn(0x7f2ad80b2170 msgr2=0x7f2ad80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 --2- 172.21.15.41:0/2463856598 >> v2:172.21.15.62:3300/0 conn(0x7f2ad80b2170 0x7f2ad80ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 -- 172.21.15.41:0/2463856598 >> v1:172.21.15.41:6789/0 conn(0x7f2ad80abb50 legacy=0x7f2ad814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 -- 172.21.15.41:0/2463856598 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80b1030 con 0x7f2ad80af620 2021-10-21T00:03:19.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2adcace700 1 --2- 172.21.15.41:0/2463856598 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80af620 0x7f2ad80ab660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2ad40032f0 tx=0x7f2ad40091d0).ready entity=mon.0 client_cookie=86687e5252dacf1d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2acffff700 1 -- 172.21.15.41:0/2463856598 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad400b680 con 0x7f2ad80af620 2021-10-21T00:03:19.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2acffff700 1 -- 172.21.15.41:0/2463856598 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400b7e0 con 0x7f2ad80af620 2021-10-21T00:03:19.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.259+0000 7f2acffff700 1 -- 172.21.15.41:0/2463856598 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad400b950 con 0x7f2ad80af620 2021-10-21T00:03:19.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2463856598 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80af620 msgr2=0x7f2ad80ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2463856598 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80af620 0x7f2ad80ab660 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2ad40032f0 tx=0x7f2ad40091d0).stop 2021-10-21T00:03:19.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2463856598 shutdown_connections 2021-10-21T00:03:19.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2463856598 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80af620 0x7f2ad80ab660 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2463856598 >> v2:172.21.15.62:3300/0 conn(0x7f2ad80b2170 0x7f2ad80ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2463856598 >> 172.21.15.41:0/2463856598 conn(0x7f2ad80b5700 msgr2=0x7f2ad80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2463856598 shutdown_connections 2021-10-21T00:03:19.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2463856598 wait complete. 2021-10-21T00:03:19.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 Processor -- start 2021-10-21T00:03:19.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.263+0000 7f2ade2d1700 1 -- start start 2021-10-21T00:03:19.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ad80af620 0x7f2ad8064710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ad80b2170 0x7f2ad8064c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80ad760 con 0x7f2ad80abb50 2021-10-21T00:03:19.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80639f0 con 0x7f2ad80b2170 2021-10-21T00:03:19.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80aecb0 con 0x7f2ad80af620 2021-10-21T00:03:19.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58396/0 (socket says 172.21.15.41:58396) 2021-10-21T00:03:19.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 -- 172.21.15.41:0/2234492240 learned_addr learned my addr 172.21.15.41:0/2234492240 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:19.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2addad0700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ad80b2170 0x7f2ad8064c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2adcace700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ad80af620 0x7f2ad8064710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 -- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ad80af620 msgr2=0x7f2ad8064710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ad80af620 0x7f2ad8064710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 -- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ad80b2170 msgr2=0x7f2ad8064c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ad80b2170 0x7f2ad8064c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 -- 172.21.15.41:0/2234492240 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009470 con 0x7f2ad80abb50 2021-10-21T00:03:19.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2add2cf700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2ad8066ce0 tx=0x7f2ac8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ac8010780 con 0x7f2ad80abb50 2021-10-21T00:03:19.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80108e0 con 0x7f2ad80abb50 2021-10-21T00:03:19.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80aef30 con 0x7f2ad80abb50 2021-10-21T00:03:19.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ac8010c40 con 0x7f2ad80abb50 2021-10-21T00:03:19.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad8066e70 con 0x7f2ad80abb50 2021-10-21T00:03:19.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.267+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad80af0c0 con 0x7f2ad80abb50 2021-10-21T00:03:19.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.271+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ac801c460 con 0x7f2ad80abb50 2021-10-21T00:03:19.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.271+0000 7f2ace7fc700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 0x7f2ac0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.271+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ac806bdc0 con 0x7f2ad80abb50 2021-10-21T00:03:19.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.271+0000 7f2adcace700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 0x7f2ac0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.271+0000 7f2adcace700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 0x7f2ac0055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2ad4019000 tx=0x7f2ad4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.275+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ac8042ec0 con 0x7f2ad80abb50 2021-10-21T00:03:19.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.407+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad80b12d0 con 0x7f2ad80abb50 2021-10-21T00:03:19.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.407+0000 7f2ace7fc700 1 -- 172.21.15.41:0/2234492240 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f2ac80464e0 con 0x7f2ad80abb50 2021-10-21T00:03:19.416 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:19.416 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:19.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 msgr2=0x7f2ac0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 0x7f2ac0055b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2ad4019000 tx=0x7f2ad4016000).stop 2021-10-21T00:03:19.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 msgr2=0x7f2ad8147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2ad8066ce0 tx=0x7f2ac8006df0).stop 2021-10-21T00:03:19.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 shutdown_connections 2021-10-21T00:03:19.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2ac00536a0 0x7f2ac0055b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ad80b2170 0x7f2ad8064c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ad80af620 0x7f2ad8064710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 --2- 172.21.15.41:0/2234492240 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ad80abb50 0x7f2ad8147180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 >> 172.21.15.41:0/2234492240 conn(0x7f2ad80b5700 msgr2=0x7f2ad80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 shutdown_connections 2021-10-21T00:03:19.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.411+0000 7f2ade2d1700 1 -- 172.21.15.41:0/2234492240 wait complete. 2021-10-21T00:03:19.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:19.431 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:19.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 Processor -- start 2021-10-21T00:03:19.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 -- start start 2021-10-21T00:03:19.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66440b4380 0x7f664405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6644140890 0x7f6644140d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66440b4760 con 0x7f66440b1830 2021-10-21T00:03:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66440ad4c0 con 0x7f6644140890 2021-10-21T00:03:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.535+0000 7f664b12d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66440ad760 con 0x7f66440b4380 2021-10-21T00:03:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664992a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f66440b1830 0x7f664405fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56176/0 (socket says 172.21.15.41:56176) 2021-10-21T00:03:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664992a700 1 -- 172.21.15.41:0/3392633901 learned_addr learned my addr 172.21.15.41:0/3392633901 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 --2- 172.21.15.41:0/3392633901 >> v2:172.21.15.62:3300/0 conn(0x7f6644140890 0x7f6644140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a12b700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66440b4380 0x7f664405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f6649129700 1 -- 172.21.15.41:0/3392633901 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344973974 0 0) 0x7f66440b4760 con 0x7f66440b1830 2021-10-21T00:03:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f6649129700 1 -- 172.21.15.41:0/3392633901 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6630003260 con 0x7f66440b1830 2021-10-21T00:03:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 -- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66440b4380 msgr2=0x7f664405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66440b4380 0x7f664405f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 -- 172.21.15.41:0/3392633901 >> v1:172.21.15.41:6789/0 conn(0x7f66440b1830 legacy=0x7f664405fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 -- 172.21.15.41:0/3392633901 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66440ada00 con 0x7f6644140890 2021-10-21T00:03:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664a92c700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6644140890 0x7f6644140d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f663c002f70 tx=0x7f663c006df0).ready entity=mon.1 client_cookie=1fdfa53aa8335667 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f6649129700 1 -- 172.21.15.41:0/3392633901 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663c00d4a0 con 0x7f6644140890 2021-10-21T00:03:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f6649129700 1 -- 172.21.15.41:0/3392633901 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c000e90 con 0x7f6644140890 2021-10-21T00:03:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f6649129700 1 -- 172.21.15.41:0/3392633901 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663c00d7f0 con 0x7f6644140890 2021-10-21T00:03:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 -- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6644140890 msgr2=0x7f6644140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6644140890 0x7f6644140d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f663c002f70 tx=0x7f663c006df0).stop 2021-10-21T00:03:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 -- 172.21.15.41:0/3392633901 shutdown_connections 2021-10-21T00:03:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6644140890 0x7f6644140d20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 --2- 172.21.15.41:0/3392633901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66440b4380 0x7f664405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 -- 172.21.15.41:0/3392633901 >> 172.21.15.41:0/3392633901 conn(0x7f66440b7910 msgr2=0x7f66440b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 -- 172.21.15.41:0/3392633901 shutdown_connections 2021-10-21T00:03:19.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.539+0000 7f664b12d700 1 -- 172.21.15.41:0/3392633901 wait complete. 2021-10-21T00:03:19.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 Processor -- start 2021-10-21T00:03:19.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- start start 2021-10-21T00:03:19.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66440b4380 0x7f66441445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6644140890 0x7f6644099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644141f70 con 0x7f66440b1830 2021-10-21T00:03:19.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644143d30 con 0x7f66440b4380 2021-10-21T00:03:19.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6644143fd0 con 0x7f6644140890 2021-10-21T00:03:19.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58410/0 (socket says 172.21.15.41:58410) 2021-10-21T00:03:19.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 -- 172.21.15.41:0/2816014936 learned_addr learned my addr 172.21.15.41:0/2816014936 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:19.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664992a700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66440b4380 0x7f66441445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a92c700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6644140890 0x7f6644099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 -- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6644140890 msgr2=0x7f6644099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6644140890 0x7f6644099f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 -- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66440b4380 msgr2=0x7f66441445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66440b4380 0x7f66441445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 -- 172.21.15.41:0/2816014936 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c00b180 con 0x7f66440b1830 2021-10-21T00:03:19.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664a12b700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f663400c000 tx=0x7f6634006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6634010780 con 0x7f66440b1830 2021-10-21T00:03:19.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66340108e0 con 0x7f66440b1830 2021-10-21T00:03:19.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66440657f0 con 0x7f66440b1830 2021-10-21T00:03:19.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6634010c40 con 0x7f66440b1830 2021-10-21T00:03:19.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.543+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664409b570 con 0x7f66440b1830 2021-10-21T00:03:19.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6644140490 con 0x7f66440b1830 2021-10-21T00:03:19.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f663401c460 con 0x7f66440b1830 2021-10-21T00:03:19.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f663b7fe700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 0x7f6624055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f663406bf90 con 0x7f66440b1830 2021-10-21T00:03:19.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f664992a700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 0x7f6624055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.547+0000 7f664992a700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 0x7f6624055a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f664000b000 tx=0x7f6640009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.555+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6644140490 con 0x7f66440b1830 2021-10-21T00:03:19.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6644140490 con 0x7f66440b1830 2021-10-21T00:03:19.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f663b7fe700 1 -- 172.21.15.41:0/2816014936 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6644140490 con 0x7f66440b1830 2021-10-21T00:03:19.691 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:19.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 msgr2=0x7f6624055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 0x7f6624055a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f664000b000 tx=0x7f6640009040).stop 2021-10-21T00:03:19.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 msgr2=0x7f6644065c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f663400c000 tx=0x7f6634006df0).stop 2021-10-21T00:03:19.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 shutdown_connections 2021-10-21T00:03:19.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6624053580 0x7f6624055a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6644140890 0x7f6644099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66440b4380 0x7f66441445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 --2- 172.21.15.41:0/2816014936 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66440b1830 0x7f6644065c90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 >> 172.21.15.41:0/2816014936 conn(0x7f66440b7910 msgr2=0x7f664405f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 shutdown_connections 2021-10-21T00:03:19.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.683+0000 7f664b12d700 1 -- 172.21.15.41:0/2816014936 wait complete. 2021-10-21T00:03:19.704 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:19.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.807+0000 7fd162624700 1 Processor -- start 2021-10-21T00:03:19.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.807+0000 7fd162624700 1 -- start start 2021-10-21T00:03:19.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd154047ca0 0x7fd1540d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1540d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1540d11a0 con 0x7fd1540420c0 2021-10-21T00:03:19.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15403eb30 con 0x7fd154047ca0 2021-10-21T00:03:19.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d4310 con 0x7fd154040bb0 2021-10-21T00:03:19.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd1540420c0 0x7fd15403d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56188/0 (socket says 172.21.15.41:56188) 2021-10-21T00:03:19.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 -- 172.21.15.41:0/1199612039 learned_addr learned my addr 172.21.15.41:0/1199612039 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:19.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161622700 1 --2- 172.21.15.41:0/1199612039 >> v2:172.21.15.41:3300/0 conn(0x7fd154047ca0 0x7fd1540d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd160e21700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1540d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517285915 0 0) 0x7fd15c05ba60 con 0x7fd1540420c0 2021-10-21T00:03:19.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd140003260 con 0x7fd1540420c0 2021-10-21T00:03:19.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1459651372 0 0) 0x7fd140003260 con 0x7fd1540420c0 2021-10-21T00:03:19.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 msgr2=0x7fd1540d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1540d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 >> v2:172.21.15.41:3300/0 conn(0x7fd154047ca0 msgr2=0x7fd1540d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 --2- 172.21.15.41:0/1199612039 >> v2:172.21.15.41:3300/0 conn(0x7fd154047ca0 0x7fd1540d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15403edd0 con 0x7fd1540420c0 2021-10-21T00:03:19.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd15c05abb0 con 0x7fd1540420c0 2021-10-21T00:03:19.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 >> v1:172.21.15.41:6789/0 conn(0x7fd1540420c0 legacy=0x7fd15403d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1400037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd140003d00 0x7fd140004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1400049f0 0x7fd140004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15403eb30 con 0x7fd1400049f0 2021-10-21T00:03:19.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d4310 con 0x7fd140003d00 2021-10-21T00:03:19.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14000b6c0 con 0x7fd154040bb0 2021-10-21T00:03:19.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161622700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1400037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1400049f0 0x7fd140004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd160e21700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd140003d00 0x7fd140004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 -- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 msgr2=0x7fd1400037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd154040bb0 0x7fd1400037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 -- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd140003d00 msgr2=0x7fd140004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:19.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd140003d00 0x7fd140004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 -- 172.21.15.41:0/1199612039 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140003260 con 0x7fd1400049f0 2021-10-21T00:03:19.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1400049f0 0x7fd140004e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd140004470 tx=0x7fd154008860).ready entity=mon.0 client_cookie=930df7252783c214 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd15c06afe0 con 0x7fd1400049f0 2021-10-21T00:03:19.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c084070 con 0x7fd1400049f0 2021-10-21T00:03:19.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd147fff700 1 -- 172.21.15.41:0/1199612039 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd15c05d2c0 con 0x7fd1400049f0 2021-10-21T00:03:19.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- 172.21.15.41:0/1199612039 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1400049f0 msgr2=0x7fd140004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 --2- 172.21.15.41:0/1199612039 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1400049f0 0x7fd140004e70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd140004470 tx=0x7fd154008860).stop 2021-10-21T00:03:19.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd161e23700 1 -- 172.21.15.41:0/1199612039 reap_dead start 2021-10-21T00:03:19.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- 172.21.15.41:0/1199612039 shutdown_connections 2021-10-21T00:03:19.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- 172.21.15.41:0/1199612039 >> 172.21.15.41:0/1199612039 conn(0x7fd15400e240 msgr2=0x7fd1540473f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- 172.21.15.41:0/1199612039 shutdown_connections 2021-10-21T00:03:19.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.811+0000 7fd162624700 1 -- 172.21.15.41:0/1199612039 wait complete. 2021-10-21T00:03:19.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 Processor -- start 2021-10-21T00:03:19.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- start start 2021-10-21T00:03:19.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1540d3630 0x7fd15403d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd15403da50 0x7fd1540d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540e7580 con 0x7fd1540e6be0 2021-10-21T00:03:19.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d3a10 con 0x7fd15403da50 2021-10-21T00:03:19.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d7ae0 con 0x7fd1540d3630 2021-10-21T00:03:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58434/0 (socket says 172.21.15.41:58434) 2021-10-21T00:03:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd160e21700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd15403da50 0x7fd1540d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161622700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1540d3630 0x7fd15403d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 -- 172.21.15.41:0/1128863608 learned_addr learned my addr 172.21.15.41:0/1128863608 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:19.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 -- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1540d3630 msgr2=0x7fd15403d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1540d3630 0x7fd15403d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 -- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd15403da50 msgr2=0x7fd1540d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd15403da50 0x7fd1540d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 -- 172.21.15.41:0/1128863608 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540d7d80 con 0x7fd1540e6be0 2021-10-21T00:03:19.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd161e23700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd154048450 tx=0x7fd15c086000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd15c05ba60 con 0x7fd1540e6be0 2021-10-21T00:03:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c043e70 con 0x7fd1540e6be0 2021-10-21T00:03:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1540e6740 con 0x7fd1540e6be0 2021-10-21T00:03:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd15c05f330 con 0x7fd1540e6be0 2021-10-21T00:03:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.815+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1540c9760 con 0x7fd1540e6be0 2021-10-21T00:03:19.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1540e68d0 con 0x7fd1540e6be0 2021-10-21T00:03:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd15c0682a0 con 0x7fd1540e6be0 2021-10-21T00:03:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd14effd700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 0x7fd138055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd15c0d9b00 con 0x7fd1540e6be0 2021-10-21T00:03:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd161622700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 0x7fd138055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.819+0000 7fd161622700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 0x7fd138055a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd15000b000 tx=0x7fd150006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.827+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd15c0dbe60 con 0x7fd1540e6be0 2021-10-21T00:03:19.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.951+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1540d11a0 con 0x7fd1540e6be0 2021-10-21T00:03:19.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd14effd700 1 -- 172.21.15.41:0/1128863608 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1540d11a0 con 0x7fd1540e6be0 2021-10-21T00:03:19.962 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:19.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 msgr2=0x7fd138055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 0x7fd138055a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd15000b000 tx=0x7fd150006df0).stop 2021-10-21T00:03:19.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 msgr2=0x7fd1540e7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:19.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd154048450 tx=0x7fd15c086000).stop 2021-10-21T00:03:19.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 shutdown_connections 2021-10-21T00:03:19.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1380535b0 0x7fd138055a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1540e6be0 0x7fd1540e7090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd15403da50 0x7fd1540d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 --2- 172.21.15.41:0/1128863608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1540d3630 0x7fd15403d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:19.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 >> 172.21.15.41:0/1128863608 conn(0x7fd15400e240 msgr2=0x7fd1540447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:19.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 shutdown_connections 2021-10-21T00:03:19.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:19.955+0000 7fd162624700 1 -- 172.21.15.41:0/1128863608 wait complete. 2021-10-21T00:03:19.979 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:20.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 Processor -- start 2021-10-21T00:03:20.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 -- start start 2021-10-21T00:03:20.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388143f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13880665b0 0x7f138813d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13880b4110 con 0x7f13880acaa0 2021-10-21T00:03:20.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1388141c50 con 0x7f13880665b0 2021-10-21T00:03:20.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138fcaf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13880ad160 con 0x7f13880b3d30 2021-10-21T00:03:20.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138d24a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f13880acaa0 0x7f1388065ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56208/0 (socket says 172.21.15.41:56208) 2021-10-21T00:03:20.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138d24a700 1 -- 172.21.15.41:0/2608979918 learned_addr learned my addr 172.21.15.41:0/2608979918 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:20.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138e24c700 1 --2- 172.21.15.41:0/2608979918 >> v2:172.21.15.62:3300/0 conn(0x7f13880665b0 0x7f138813d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138da4b700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138ca49700 1 -- 172.21.15.41:0/2608979918 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836520108 0 0) 0x7f13880b4110 con 0x7f13880acaa0 2021-10-21T00:03:20.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138ca49700 1 -- 172.21.15.41:0/2608979918 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1370003260 con 0x7f13880acaa0 2021-10-21T00:03:20.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138e24c700 1 -- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 msgr2=0x7f1388143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:20.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138e24c700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138e24c700 1 -- 172.21.15.41:0/2608979918 >> v1:172.21.15.41:6789/0 conn(0x7f13880acaa0 legacy=0x7f1388065ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.079+0000 7f138e24c700 1 -- 172.21.15.41:0/2608979918 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880ad400 con 0x7f13880665b0 2021-10-21T00:03:20.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138e24c700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f138813d890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1380002f70 tx=0x7f1380006df0).ready entity=mon.1 client_cookie=ad17e78244633051 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138ca49700 1 -- 172.21.15.41:0/2608979918 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f138000d4a0 con 0x7f13880665b0 2021-10-21T00:03:20.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138ca49700 1 -- 172.21.15.41:0/2608979918 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380000e90 con 0x7f13880665b0 2021-10-21T00:03:20.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138ca49700 1 -- 172.21.15.41:0/2608979918 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f138000d7f0 con 0x7f13880665b0 2021-10-21T00:03:20.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 msgr2=0x7f138813d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f138813d890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1380002f70 tx=0x7f1380006df0).stop 2021-10-21T00:03:20.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- 172.21.15.41:0/2608979918 shutdown_connections 2021-10-21T00:03:20.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f138813d890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 --2- 172.21.15.41:0/2608979918 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- 172.21.15.41:0/2608979918 >> 172.21.15.41:0/2608979918 conn(0x7f1388064910 msgr2=0x7f1388064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- 172.21.15.41:0/2608979918 shutdown_connections 2021-10-21T00:03:20.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- 172.21.15.41:0/2608979918 wait complete. 2021-10-21T00:03:20.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 Processor -- start 2021-10-21T00:03:20.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.083+0000 7f138fcaf700 1 -- start start 2021-10-21T00:03:20.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 0x7f138813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388147100 con 0x7f13880acaa0 2021-10-21T00:03:20.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13880b0fb0 con 0x7f13880665b0 2021-10-21T00:03:20.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138813e110 con 0x7f13880b3d30 2021-10-21T00:03:20.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138d24a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 0x7f138813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138e24c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42128/0 (socket says 172.21.15.41:42128) 2021-10-21T00:03:20.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 -- 172.21.15.41:0/15310352 learned_addr learned my addr 172.21.15.41:0/15310352 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:20.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 -- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 msgr2=0x7f1388140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 -- 172.21.15.41:0/15310352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 msgr2=0x7f138813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 0x7f138813fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 -- 172.21.15.41:0/15310352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138000b180 con 0x7f13880665b0 2021-10-21T00:03:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138d24a700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 0x7f138813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138da4b700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f138400c000 tx=0x7f13840091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1384012600 con 0x7f13880665b0 2021-10-21T00:03:20.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384012760 con 0x7f13880665b0 2021-10-21T00:03:20.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1384012ac0 con 0x7f13880665b0 2021-10-21T00:03:20.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880b1250 con 0x7f13880665b0 2021-10-21T00:03:20.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13880afd00 con 0x7f13880665b0 2021-10-21T00:03:20.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.087+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13880659d0 con 0x7f13880665b0 2021-10-21T00:03:20.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.091+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1384012c20 con 0x7f13880665b0 2021-10-21T00:03:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.091+0000 7f137affd700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 0x7f1368055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.091+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f138406c410 con 0x7f13880665b0 2021-10-21T00:03:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.091+0000 7f138d24a700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 0x7f1368055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.091+0000 7f138d24a700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 0x7f1368055b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f137c00d000 tx=0x7f137c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.099+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1384043460 con 0x7f13880665b0 2021-10-21T00:03:20.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.227+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1388057350 con 0x7f13880665b0 2021-10-21T00:03:20.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f137affd700 1 -- 172.21.15.41:0/15310352 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1384046a80 con 0x7f13880665b0 2021-10-21T00:03:20.238 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:20.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 msgr2=0x7f1368055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 0x7f1368055b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f137c00d000 tx=0x7f137c009040).stop 2021-10-21T00:03:20.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 msgr2=0x7f1388146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f138400c000 tx=0x7f13840091d0).stop 2021-10-21T00:03:20.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 shutdown_connections 2021-10-21T00:03:20.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13680536d0 0x7f1368055b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13880b3d30 0x7f1388140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13880acaa0 0x7f138813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 --2- 172.21.15.41:0/15310352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13880665b0 0x7f1388146500 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 >> 172.21.15.41:0/15310352 conn(0x7f1388064910 msgr2=0x7f1388064cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 shutdown_connections 2021-10-21T00:03:20.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.231+0000 7f138fcaf700 1 -- 172.21.15.41:0/15310352 wait complete. 2021-10-21T00:03:20.252 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:20.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.351+0000 7f450a52e700 1 Processor -- start 2021-10-21T00:03:20.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.351+0000 7f450a52e700 1 -- start start 2021-10-21T00:03:20.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 0x7f45040b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040b6350 con 0x7f4504142520 2021-10-21T00:03:20.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450405cee0 con 0x7f45040b5f70 2021-10-21T00:03:20.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4504067d00 con 0x7f450405c7c0 2021-10-21T00:03:20.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4508d2b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4504142520 0x7f4504145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56222/0 (socket says 172.21.15.41:56222) 2021-10-21T00:03:20.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4508d2b700 1 -- 172.21.15.41:0/686345517 learned_addr learned my addr 172.21.15.41:0/686345517 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:20.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4509d2d700 1 --2- 172.21.15.41:0/686345517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 0x7f45040b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f44f7fff700 1 -- 172.21.15.41:0/686345517 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216600195 0 0) 0x7f45040b6350 con 0x7f4504142520 2021-10-21T00:03:20.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f44f7fff700 1 -- 172.21.15.41:0/686345517 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec003260 con 0x7f4504142520 2021-10-21T00:03:20.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4509d2d700 1 -- 172.21.15.41:0/686345517 >> v1:172.21.15.62:6789/0 conn(0x7f45040b5f70 legacy=0x7f4504141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4509d2d700 1 -- 172.21.15.41:0/686345517 >> v1:172.21.15.41:6789/0 conn(0x7f4504142520 legacy=0x7f4504145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4509d2d700 1 -- 172.21.15.41:0/686345517 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450405d180 con 0x7f450405c7c0 2021-10-21T00:03:20.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f4509d2d700 1 --2- 172.21.15.41:0/686345517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 0x7f45040b1a50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f44fc0032f0 tx=0x7f44fc0091d0).ready entity=mon.2 client_cookie=a094bd5e87e8cab9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f44f7fff700 1 -- 172.21.15.41:0/686345517 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44fc00b6c0 con 0x7f450405c7c0 2021-10-21T00:03:20.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f44f7fff700 1 -- 172.21.15.41:0/686345517 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc00b820 con 0x7f450405c7c0 2021-10-21T00:03:20.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f44f7fff700 1 -- 172.21.15.41:0/686345517 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44fc00b990 con 0x7f450405c7c0 2021-10-21T00:03:20.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- 172.21.15.41:0/686345517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 msgr2=0x7f45040b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 --2- 172.21.15.41:0/686345517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 0x7f45040b1a50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f44fc0032f0 tx=0x7f44fc0091d0).stop 2021-10-21T00:03:20.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- 172.21.15.41:0/686345517 shutdown_connections 2021-10-21T00:03:20.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 --2- 172.21.15.41:0/686345517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f450405c7c0 0x7f45040b1a50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- 172.21.15.41:0/686345517 >> 172.21.15.41:0/686345517 conn(0x7f45040639f0 msgr2=0x7f45040b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- 172.21.15.41:0/686345517 shutdown_connections 2021-10-21T00:03:20.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.355+0000 7f450a52e700 1 -- 172.21.15.41:0/686345517 wait complete. 2021-10-21T00:03:20.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 Processor -- start 2021-10-21T00:03:20.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 -- start start 2021-10-21T00:03:20.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45040b5f70 0x7f4504146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4504142520 0x7f45040adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040ae3e0 con 0x7f450405c7c0 2021-10-21T00:03:20.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040ae8a0 con 0x7f45040b5f70 2021-10-21T00:03:20.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450a52e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040ae600 con 0x7f4504142520 2021-10-21T00:03:20.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58456/0 (socket says 172.21.15.41:58456) 2021-10-21T00:03:20.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f4508d2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45040b5f70 0x7f4504146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f4509d2d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4504142520 0x7f45040adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 -- 172.21.15.41:0/2621356852 learned_addr learned my addr 172.21.15.41:0/2621356852 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:20.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 -- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4504142520 msgr2=0x7f45040adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4504142520 0x7f45040adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 -- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45040b5f70 msgr2=0x7f4504146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45040b5f70 0x7f4504146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.359+0000 7f450952c700 1 -- 172.21.15.41:0/2621356852 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc009470 con 0x7f450405c7c0 2021-10-21T00:03:20.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f450952c700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f45040b30c0 tx=0x7f4500007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4500007030 con 0x7f450405c7c0 2021-10-21T00:03:20.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500007190 con 0x7f450405c7c0 2021-10-21T00:03:20.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504155200 con 0x7f450405c7c0 2021-10-21T00:03:20.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4500006510 con 0x7f450405c7c0 2021-10-21T00:03:20.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4504064390 con 0x7f450405c7c0 2021-10-21T00:03:20.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040af3f0 con 0x7f450405c7c0 2021-10-21T00:03:20.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4500010030 con 0x7f450405c7c0 2021-10-21T00:03:20.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 0x7f44e4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.363+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f450006b530 con 0x7f450405c7c0 2021-10-21T00:03:20.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.367+0000 7f4508d2b700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 0x7f44e4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.367+0000 7f4508d2b700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 0x7f44e4055a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f44f800d000 tx=0x7f44f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.371+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45000425f0 con 0x7f450405c7c0 2021-10-21T00:03:20.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f450405d8f0 con 0x7f450405c7c0 2021-10-21T00:03:20.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f44f67fc700 1 -- 172.21.15.41:0/2621356852 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4500045c10 con 0x7f450405c7c0 2021-10-21T00:03:20.511 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:20.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 msgr2=0x7f44e4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 0x7f44e4055a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f44f800d000 tx=0x7f44f8009040).stop 2021-10-21T00:03:20.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 msgr2=0x7f4504067010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f45040b30c0 tx=0x7f4500007c10).stop 2021-10-21T00:03:20.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 shutdown_connections 2021-10-21T00:03:20.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f44e4053580 0x7f44e4055a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4504142520 0x7f45040adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45040b5f70 0x7f4504146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 --2- 172.21.15.41:0/2621356852 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f450405c7c0 0x7f4504067010 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 >> 172.21.15.41:0/2621356852 conn(0x7f45040639f0 msgr2=0x7f45040b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 shutdown_connections 2021-10-21T00:03:20.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.503+0000 7f450a52e700 1 -- 172.21.15.41:0/2621356852 wait complete. 2021-10-21T00:03:20.524 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:20.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.615+0000 7fb0f738f700 1 Processor -- start 2021-10-21T00:03:20.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.615+0000 7fb0f738f700 1 -- start start 2021-10-21T00:03:20.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f0062f70 0x7fb0f005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0f00b3a20 0x7fb0f013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f005bd40 con 0x7fb0f0062330 2021-10-21T00:03:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f005bf70 con 0x7fb0f00b3a20 2021-10-21T00:03:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0142cb0 con 0x7fb0f0062f70 2021-10-21T00:03:20.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f638d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb0f0062330 0x7fb0f00b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56234/0 (socket says 172.21.15.41:56234) 2021-10-21T00:03:20.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f638d700 1 -- 172.21.15.41:0/1079030086 learned_addr learned my addr 172.21.15.41:0/1079030086 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:20.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 --2- 172.21.15.41:0/1079030086 >> v2:172.21.15.62:3300/0 conn(0x7fb0f00b3a20 0x7fb0f013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f5b8c700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f0062f70 0x7fb0f005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21707504 0 0) 0x7fb0f005bd40 con 0x7fb0f0062330 2021-10-21T00:03:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d8003260 con 0x7fb0f0062330 2021-10-21T00:03:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734950790 0 0) 0x7fb0d8003260 con 0x7fb0f0062330 2021-10-21T00:03:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 -- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f0062f70 msgr2=0x7fb0f005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:20.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f0062f70 0x7fb0f005c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 -- 172.21.15.41:0/1079030086 >> v1:172.21.15.41:6789/0 conn(0x7fb0f0062330 legacy=0x7fb0f00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 -- 172.21.15.41:0/1079030086 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0142950 con 0x7fb0f00b3a20 2021-10-21T00:03:20.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f6b8e700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f00b3a20 0x7fb0f013c510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb0ec001800 tx=0x7fb0e80091d0).ready entity=mon.1 client_cookie=a3cb6d98f1e5ae6e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec001660 con 0x7fb0f00b3a20 2021-10-21T00:03:20.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800f510 con 0x7fb0f00b3a20 2021-10-21T00:03:20.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f538b700 1 -- 172.21.15.41:0/1079030086 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e800f680 con 0x7fb0f00b3a20 2021-10-21T00:03:20.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f00b3a20 msgr2=0x7fb0f013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f00b3a20 0x7fb0f013c510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb0ec001800 tx=0x7fb0e80091d0).stop 2021-10-21T00:03:20.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- 172.21.15.41:0/1079030086 shutdown_connections 2021-10-21T00:03:20.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f00b3a20 0x7fb0f013c510 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1079030086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f0062f70 0x7fb0f005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- 172.21.15.41:0/1079030086 >> 172.21.15.41:0/1079030086 conn(0x7fb0f00b9080 msgr2=0x7fb0f00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- 172.21.15.41:0/1079030086 shutdown_connections 2021-10-21T00:03:20.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.619+0000 7fb0f738f700 1 -- 172.21.15.41:0/1079030086 wait complete. 2021-10-21T00:03:20.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 Processor -- start 2021-10-21T00:03:20.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 -- start start 2021-10-21T00:03:20.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f0062f70 0x7fb0f00ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f00b3a20 0x7fb0f013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f013f450 con 0x7fb0f0062330 2021-10-21T00:03:20.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f013f6f0 con 0x7fb0f0062f70 2021-10-21T00:03:20.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f738f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f00ae810 con 0x7fb0f00b3a20 2021-10-21T00:03:20.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f638d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f638d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58470/0 (socket says 172.21.15.41:58470) 2021-10-21T00:03:20.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.623+0000 7fb0f638d700 1 -- 172.21.15.41:0/1449901497 learned_addr learned my addr 172.21.15.41:0/1449901497 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:20.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f5b8c700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f0062f70 0x7fb0f00ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f6b8e700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f00b3a20 0x7fb0f013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 -- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f00b3a20 msgr2=0x7fb0f013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f00b3a20 0x7fb0f013e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 -- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f0062f70 msgr2=0x7fb0f00ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f0062f70 0x7fb0f00ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 -- 172.21.15.41:0/1449901497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009470 con 0x7fb0f0062330 2021-10-21T00:03:20.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f638d700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb0ec0018c0 tx=0x7fb0ec001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec007170 con 0x7fb0f0062330 2021-10-21T00:03:20.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0072d0 con 0x7fb0f0062330 2021-10-21T00:03:20.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec004920 con 0x7fb0f0062330 2021-10-21T00:03:20.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0155160 con 0x7fb0f0062330 2021-10-21T00:03:20.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f00ae500 con 0x7fb0f0062330 2021-10-21T00:03:20.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f013fa70 con 0x7fb0f0062330 2021-10-21T00:03:20.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0ec004a80 con 0x7fb0f0062330 2021-10-21T00:03:20.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 0x7fb0d0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb0ec06b6c0 con 0x7fb0f0062330 2021-10-21T00:03:20.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.627+0000 7fb0f5b8c700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 0x7fb0d0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.631+0000 7fb0f5b8c700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 0x7fb0d0055ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb0e000b000 tx=0x7fb0e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.635+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0ec042780 con 0x7fb0f0062330 2021-10-21T00:03:20.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.763+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0f0057350 con 0x7fb0f0062330 2021-10-21T00:03:20.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.763+0000 7fb0df7fe700 1 -- 172.21.15.41:0/1449901497 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fb0ec045da0 con 0x7fb0f0062330 2021-10-21T00:03:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:20.780 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:20.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 msgr2=0x7fb0d0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 0x7fb0d0055ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb0e000b000 tx=0x7fb0e0008040).stop 2021-10-21T00:03:20.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 msgr2=0x7fb0f0144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb0ec0018c0 tx=0x7fb0ec001b30).stop 2021-10-21T00:03:20.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 shutdown_connections 2021-10-21T00:03:20.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0d0053610 0x7fb0d0055ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0f00b3a20 0x7fb0f013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0f0062f70 0x7fb0f00ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 --2- 172.21.15.41:0/1449901497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0f0062330 0x7fb0f0144650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 >> 172.21.15.41:0/1449901497 conn(0x7fb0f00b9080 msgr2=0x7fb0f0141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 shutdown_connections 2021-10-21T00:03:20.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.767+0000 7fb0f738f700 1 -- 172.21.15.41:0/1449901497 wait complete. 2021-10-21T00:03:20.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:20.794 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:20.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 Processor -- start 2021-10-21T00:03:20.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- start start 2021-10-21T00:03:20.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcd940b5f70 0x7fcd940b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 0x7fcd9413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940b6350 con 0x7fcd941423a0 2021-10-21T00:03:20.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940b0e10 con 0x7fcd940b5f70 2021-10-21T00:03:20.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940b10b0 con 0x7fcd94067a00 2021-10-21T00:03:20.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcd940b5f70 0x7fcd940b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcd940b5f70 0x7fcd940b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58480/0 (socket says 172.21.15.41:58480) 2021-10-21T00:03:20.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 -- 172.21.15.41:0/959126032 learned_addr learned my addr 172.21.15.41:0/959126032 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:20.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd99cf7700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 0x7fcd9413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 -- 172.21.15.41:0/959126032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 msgr2=0x7fcd9413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:20.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 0x7fcd9413ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 -- 172.21.15.41:0/959126032 >> v1:172.21.15.62:6789/0 conn(0x7fcd941423a0 legacy=0x7fcd940672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd8bfff700 1 -- 172.21.15.41:0/959126032 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918911951 0 0) 0x7fcd940b6350 con 0x7fcd941423a0 2021-10-21T00:03:20.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 -- 172.21.15.41:0/959126032 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940b1350 con 0x7fcd940b5f70 2021-10-21T00:03:20.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd99cf7700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 0x7fcd9413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:20.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd994f6700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd940b1a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcd84002f70 tx=0x7fcd84006eb0).ready entity=mon.0 client_cookie=ec4f78e5f9da6904 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd8bfff700 1 -- 172.21.15.41:0/959126032 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8400d570 con 0x7fcd940b5f70 2021-10-21T00:03:20.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd8bfff700 1 -- 172.21.15.41:0/959126032 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84000e90 con 0x7fcd940b5f70 2021-10-21T00:03:20.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd8bfff700 1 -- 172.21.15.41:0/959126032 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8400d8c0 con 0x7fcd940b5f70 2021-10-21T00:03:20.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/959126032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 msgr2=0x7fcd940b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd940b1a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcd84002f70 tx=0x7fcd84006eb0).stop 2021-10-21T00:03:20.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/959126032 shutdown_connections 2021-10-21T00:03:20.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd94067a00 0x7fcd9413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/959126032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd940b1a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.899+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/959126032 >> 172.21.15.41:0/959126032 conn(0x7fcd940639f0 msgr2=0x7fcd940b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:20.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/959126032 shutdown_connections 2021-10-21T00:03:20.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/959126032 wait complete. 2021-10-21T00:03:20.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 Processor -- start 2021-10-21T00:03:20.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- start start 2021-10-21T00:03:20.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd94067a00 0x7fcd9413db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd941423a0 0x7fcd94066dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941520c0 con 0x7fcd940b5f70 2021-10-21T00:03:20.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9413e160 con 0x7fcd94067a00 2021-10-21T00:03:20.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940654f0 con 0x7fcd941423a0 2021-10-21T00:03:20.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58486/0 (socket says 172.21.15.41:58486) 2021-10-21T00:03:20.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 -- 172.21.15.41:0/4035015534 learned_addr learned my addr 172.21.15.41:0/4035015534 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:20.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd994f6700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd94067a00 0x7fcd9413db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd99cf7700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd941423a0 0x7fcd94066dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 -- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd941423a0 msgr2=0x7fcd94066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd941423a0 0x7fcd94066dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 -- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd94067a00 msgr2=0x7fcd9413db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:20.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd94067a00 0x7fcd9413db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:20.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 -- 172.21.15.41:0/4035015534 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c00b180 con 0x7fcd940b5f70 2021-10-21T00:03:20.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd98cf5700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcd94065680 tx=0x7fcd900013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9000f470 con 0x7fcd940b5f70 2021-10-21T00:03:20.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8400b1e0 con 0x7fcd940b5f70 2021-10-21T00:03:20.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000f5d0 con 0x7fcd940b5f70 2021-10-21T00:03:20.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd9000f930 con 0x7fcd940b5f70 2021-10-21T00:03:20.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.903+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94065250 con 0x7fcd940b5f70 2021-10-21T00:03:20.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70003410 con 0x7fcd940b5f70 2021-10-21T00:03:20.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcd90019030 con 0x7fcd940b5f70 2021-10-21T00:03:20.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd8a7fc700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 0x7fcd7c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:20.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd9006aff0 con 0x7fcd940b5f70 2021-10-21T00:03:20.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd994f6700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 0x7fcd7c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:20.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.907+0000 7fcd994f6700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 0x7fcd7c055a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd8401c000 tx=0x7fcd84015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:20.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:20.915+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd900420b0 con 0x7fcd940b5f70 2021-10-21T00:03:21.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.039+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcd70003c40 con 0x7fcd940b5f70 2021-10-21T00:03:21.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd8a7fc700 1 -- 172.21.15.41:0/4035015534 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcd900456d0 con 0x7fcd940b5f70 2021-10-21T00:03:21.051 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:21.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 msgr2=0x7fcd7c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 0x7fcd7c055a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd8401c000 tx=0x7fcd84015000).stop 2021-10-21T00:03:21.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 msgr2=0x7fcd94151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcd94065680 tx=0x7fcd900013f0).stop 2021-10-21T00:03:21.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 shutdown_connections 2021-10-21T00:03:21.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcd7c053580 0x7fcd7c055a40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd941423a0 0x7fcd94066dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcd940b5f70 0x7fcd94151bd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 --2- 172.21.15.41:0/4035015534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd94067a00 0x7fcd9413db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 >> 172.21.15.41:0/4035015534 conn(0x7fcd940639f0 msgr2=0x7fcd940b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 shutdown_connections 2021-10-21T00:03:21.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.043+0000 7fcd9a4f8700 1 -- 172.21.15.41:0/4035015534 wait complete. 2021-10-21T00:03:21.064 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:21.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 Processor -- start 2021-10-21T00:03:21.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 -- start start 2021-10-21T00:03:21.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb3200ab9a0 0x7fb320142b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb32013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32005fee0 con 0x7fb32005fb00 2021-10-21T00:03:21.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb320060640 con 0x7fb3200ab9a0 2021-10-21T00:03:21.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb326930700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200aa0a0 con 0x7fb320143080 2021-10-21T00:03:21.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb32592e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb32005fb00 0x7fb320142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56262/0 (socket says 172.21.15.41:56262) 2021-10-21T00:03:21.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb32592e700 1 -- 172.21.15.41:0/2081325480 learned_addr learned my addr 172.21.15.41:0/2081325480 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:21.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb32512d700 1 --2- 172.21.15.41:0/2081325480 >> v2:172.21.15.62:3300/0 conn(0x7fb3200ab9a0 0x7fb320142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.163+0000 7fb32612f700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb32013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212235957 0 0) 0x7fb32005fee0 con 0x7fb32005fb00 2021-10-21T00:03:21.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308007670 con 0x7fb32005fb00 2021-10-21T00:03:21.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330405682 0 0) 0x7fb308007670 con 0x7fb32005fb00 2021-10-21T00:03:21.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 msgr2=0x7fb32013f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb32013f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 >> v2:172.21.15.62:3300/0 conn(0x7fb3200ab9a0 msgr2=0x7fb320142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 --2- 172.21.15.41:0/2081325480 >> v2:172.21.15.62:3300/0 conn(0x7fb3200ab9a0 0x7fb320142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200aa340 con 0x7fb32005fb00 2021-10-21T00:03:21.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fb31c001680 con 0x7fb32005fb00 2021-10-21T00:03:21.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 >> v1:172.21.15.41:6789/0 conn(0x7fb32005fb00 legacy=0x7fb320142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb308007b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb308008910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb308008e00 0x7fb308009280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320060640 con 0x7fb308008090 2021-10-21T00:03:21.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200aa0a0 con 0x7fb308008e00 2021-10-21T00:03:21.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30800fb60 con 0x7fb320143080 2021-10-21T00:03:21.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb308008910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32592e700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb308007b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32612f700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb308008e00 0x7fb308009280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 -- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 msgr2=0x7fb308007b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb320143080 0x7fb308007b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 -- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb308008e00 msgr2=0x7fb308009280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb308008e00 0x7fb308009280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 -- 172.21.15.41:0/2081325480 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308007670 con 0x7fb308008090 2021-10-21T00:03:21.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32612f700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb308008e00 0x7fb308009280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:21.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32512d700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb308008910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fb3080098e0 tx=0x7fb314006df0).ready entity=mon.0 client_cookie=be24fd67e460484b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31400e830 con 0x7fb308008090 2021-10-21T00:03:21.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400be90 con 0x7fb308008090 2021-10-21T00:03:21.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32492c700 1 -- 172.21.15.41:0/2081325480 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31400eb80 con 0x7fb308008090 2021-10-21T00:03:21.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 -- 172.21.15.41:0/2081325480 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 msgr2=0x7fb308008910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 --2- 172.21.15.41:0/2081325480 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb308008910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fb3080098e0 tx=0x7fb314006df0).stop 2021-10-21T00:03:21.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb32612f700 1 -- 172.21.15.41:0/2081325480 reap_dead start 2021-10-21T00:03:21.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 -- 172.21.15.41:0/2081325480 shutdown_connections 2021-10-21T00:03:21.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 -- 172.21.15.41:0/2081325480 >> 172.21.15.41:0/2081325480 conn(0x7fb3200b5700 msgr2=0x7fb3200b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 -- 172.21.15.41:0/2081325480 shutdown_connections 2021-10-21T00:03:21.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.167+0000 7fb326930700 1 -- 172.21.15.41:0/2081325480 wait complete. 2021-10-21T00:03:21.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 Processor -- start 2021-10-21T00:03:21.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- start start 2021-10-21T00:03:21.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb320065e30 0x7fb320064680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb32009a6b0 0x7fb320067110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200ae6c0 con 0x7fb308008090 2021-10-21T00:03:21.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200ae180 con 0x7fb320065e30 2021-10-21T00:03:21.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200ae420 con 0x7fb32009a6b0 2021-10-21T00:03:21.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58504/0 (socket says 172.21.15.41:58504) 2021-10-21T00:03:21.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 -- 172.21.15.41:0/589951231 learned_addr learned my addr 172.21.15.41:0/589951231 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:21.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32512d700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb320065e30 0x7fb320064680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32612f700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb32009a6b0 0x7fb320067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 -- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb32009a6b0 msgr2=0x7fb320067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb32009a6b0 0x7fb320067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 -- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb320065e30 msgr2=0x7fb320064680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb320065e30 0x7fb320064680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 -- 172.21.15.41:0/589951231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320067600 con 0x7fb308008090 2021-10-21T00:03:21.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb32592e700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb31c00b000 tx=0x7fb31c0014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c010640 con 0x7fb308008090 2021-10-21T00:03:21.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0107a0 con 0x7fb308008090 2021-10-21T00:03:21.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31c010b00 con 0x7fb308008090 2021-10-21T00:03:21.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb320067850 con 0x7fb308008090 2021-10-21T00:03:21.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.171+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3200ac0c0 con 0x7fb308008090 2021-10-21T00:03:21.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32009aa90 con 0x7fb308008090 2021-10-21T00:03:21.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb31c010c60 con 0x7fb308008090 2021-10-21T00:03:21.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb312ffd700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 0x7fb300055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb31c06be30 con 0x7fb308008090 2021-10-21T00:03:21.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb32512d700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 0x7fb300055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.175+0000 7fb32512d700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 0x7fb300055a40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb31401e000 tx=0x7fb314019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.183+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb31c042f90 con 0x7fb308008090 2021-10-21T00:03:21.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3200602c0 con 0x7fb308008090 2021-10-21T00:03:21.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb312ffd700 1 -- 172.21.15.41:0/589951231 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb31c0465b0 con 0x7fb308008090 2021-10-21T00:03:21.320 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:21.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 msgr2=0x7fb300055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 0x7fb300055a40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb31401e000 tx=0x7fb314019000).stop 2021-10-21T00:03:21.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 msgr2=0x7fb3200aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb31c00b000 tx=0x7fb31c0014e0).stop 2021-10-21T00:03:21.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 shutdown_connections 2021-10-21T00:03:21.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb300053580 0x7fb300055a40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb32009a6b0 0x7fb320067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb320065e30 0x7fb320064680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 --2- 172.21.15.41:0/589951231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb308008090 0x7fb3200aed10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 >> 172.21.15.41:0/589951231 conn(0x7fb3200b5700 msgr2=0x7fb3200b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 shutdown_connections 2021-10-21T00:03:21.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.311+0000 7fb326930700 1 -- 172.21.15.41:0/589951231 wait complete. 2021-10-21T00:03:21.332 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:21.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 Processor -- start 2021-10-21T00:03:21.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 -- start start 2021-10-21T00:03:21.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe92c0acd30 0x7fe92c05c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c0ba000 con 0x7fe92c0b9c20 2021-10-21T00:03:21.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c142ad0 con 0x7fe92c0b41a0 2021-10-21T00:03:21.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92b59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c143bc0 con 0x7fe92c0acd30 2021-10-21T00:03:21.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92a59c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe92c0b9c20 0x7fe92c1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56282/0 (socket says 172.21.15.41:56282) 2021-10-21T00:03:21.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe92a59c700 1 -- 172.21.15.41:0/1720161832 learned_addr learned my addr 172.21.15.41:0/1720161832 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:21.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.435+0000 7fe921d9b700 1 --2- 172.21.15.41:0/1720161832 >> v2:172.21.15.41:3300/0 conn(0x7fe92c0acd30 0x7fe92c05c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe921d9b700 1 -- 172.21.15.41:0/1720161832 >> v1:172.21.15.62:6789/0 conn(0x7fe92c0b41a0 legacy=0x7fe92c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe921d9b700 1 -- 172.21.15.41:0/1720161832 >> v1:172.21.15.41:6789/0 conn(0x7fe92c0b9c20 legacy=0x7fe92c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe929d9b700 1 -- 172.21.15.41:0/1720161832 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430084119 0 0) 0x7fe92c0ba000 con 0x7fe92c0b9c20 2021-10-21T00:03:21.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe921d9b700 1 -- 172.21.15.41:0/1720161832 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c142d70 con 0x7fe92c0acd30 2021-10-21T00:03:21.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe921d9b700 1 --2- 172.21.15.41:0/1720161832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c05c860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe914002f70 tx=0x7fe914006df0).ready entity=mon.0 client_cookie=446683d63b19ea9e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe929d9b700 1 -- 172.21.15.41:0/1720161832 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91400d610 con 0x7fe92c0acd30 2021-10-21T00:03:21.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe929d9b700 1 -- 172.21.15.41:0/1720161832 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914000e90 con 0x7fe92c0acd30 2021-10-21T00:03:21.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe929d9b700 1 -- 172.21.15.41:0/1720161832 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91400d960 con 0x7fe92c0acd30 2021-10-21T00:03:21.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- 172.21.15.41:0/1720161832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 msgr2=0x7fe92c05c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 --2- 172.21.15.41:0/1720161832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c05c860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe914002f70 tx=0x7fe914006df0).stop 2021-10-21T00:03:21.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- 172.21.15.41:0/1720161832 shutdown_connections 2021-10-21T00:03:21.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 --2- 172.21.15.41:0/1720161832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c05c860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- 172.21.15.41:0/1720161832 >> 172.21.15.41:0/1720161832 conn(0x7fe92c062f00 msgr2=0x7fe92c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- 172.21.15.41:0/1720161832 shutdown_connections 2021-10-21T00:03:21.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- 172.21.15.41:0/1720161832 wait complete. 2021-10-21T00:03:21.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 Processor -- start 2021-10-21T00:03:21.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.439+0000 7fe92b59e700 1 -- start start 2021-10-21T00:03:21.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 0x7fe92c13e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 0x7fe92c13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b0100 con 0x7fe92c0acd30 2021-10-21T00:03:21.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b03a0 con 0x7fe92c0b9c20 2021-10-21T00:03:21.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b0640 con 0x7fe92c0b41a0 2021-10-21T00:03:21.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58518/0 (socket says 172.21.15.41:58518) 2021-10-21T00:03:21.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 -- 172.21.15.41:0/2113768313 learned_addr learned my addr 172.21.15.41:0/2113768313 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:21.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92ad9d700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 0x7fe92c13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe921d9b700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 0x7fe92c13e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 -- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 msgr2=0x7fe92c13e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 0x7fe92c13e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 -- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 msgr2=0x7fe92c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 0x7fe92c13ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 -- 172.21.15.41:0/2113768313 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91400b180 con 0x7fe92c0acd30 2021-10-21T00:03:21.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe921d9b700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 0x7fe92c13e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:21.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92ad9d700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 0x7fe92c13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:21.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92a59c700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe91c000bc0 tx=0x7fe91c007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c0070d0 con 0x7fe92c0acd30 2021-10-21T00:03:21.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c007230 con 0x7fe92c0acd30 2021-10-21T00:03:21.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c0af180 con 0x7fe92c0acd30 2021-10-21T00:03:21.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c0073a0 con 0x7fe92c0acd30 2021-10-21T00:03:21.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c151b70 con 0x7fe92c0acd30 2021-10-21T00:03:21.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c155120 con 0x7fe92c0acd30 2021-10-21T00:03:21.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.443+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe91c01a060 con 0x7fe92c0acd30 2021-10-21T00:03:21.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.447+0000 7fe923fff700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 0x7fe910055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.447+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe91c06b0e0 con 0x7fe92c0acd30 2021-10-21T00:03:21.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.447+0000 7fe921d9b700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 0x7fe910055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.447+0000 7fe921d9b700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 0x7fe910055ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe914017000 tx=0x7fe914015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.451+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe91c042240 con 0x7fe92c0acd30 2021-10-21T00:03:21.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.575+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe92c0aff30 con 0x7fe92c0acd30 2021-10-21T00:03:21.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.575+0000 7fe923fff700 1 -- 172.21.15.41:0/2113768313 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe91c018070 con 0x7fe92c0acd30 2021-10-21T00:03:21.586 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:21.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 msgr2=0x7fe910055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 0x7fe910055ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe914017000 tx=0x7fe914015000).stop 2021-10-21T00:03:21.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 msgr2=0x7fe92c145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe91c000bc0 tx=0x7fe91c007b00).stop 2021-10-21T00:03:21.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 shutdown_connections 2021-10-21T00:03:21.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe910053610 0x7fe910055ad0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe92c0b9c20 0x7fe92c13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe92c0b41a0 0x7fe92c13e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 --2- 172.21.15.41:0/2113768313 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe92c0acd30 0x7fe92c145e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 >> 172.21.15.41:0/2113768313 conn(0x7fe92c062f00 msgr2=0x7fe92c0b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 shutdown_connections 2021-10-21T00:03:21.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.579+0000 7fe92b59e700 1 -- 172.21.15.41:0/2113768313 wait complete. 2021-10-21T00:03:21.599 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:21.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.695+0000 7feed7fff700 1 Processor -- start 2021-10-21T00:03:21.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.695+0000 7feed7fff700 1 -- start start 2021-10-21T00:03:21.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feed8062330 0x7feed80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed805bd40 con 0x7feed8062f70 2021-10-21T00:03:21.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed805bf70 con 0x7feed80b3a20 2021-10-21T00:03:21.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed8142cb0 con 0x7feed8062330 2021-10-21T00:03:21.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feece7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7feed8062f70 0x7feed805c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56298/0 (socket says 172.21.15.41:56298) 2021-10-21T00:03:21.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feece7fc700 1 -- 172.21.15.41:0/2768219035 learned_addr learned my addr 172.21.15.41:0/2768219035 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:21.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed6ffd700 1 --2- 172.21.15.41:0/2768219035 >> v2:172.21.15.62:3300/0 conn(0x7feed8062330 0x7feed80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed67fc700 1 -- 172.21.15.41:0/2768219035 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203655423 0 0) 0x7feed805bd40 con 0x7feed8062f70 2021-10-21T00:03:21.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed67fc700 1 -- 172.21.15.41:0/2768219035 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb8003260 con 0x7feed8062f70 2021-10-21T00:03:21.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed6ffd700 1 -- 172.21.15.41:0/2768219035 >> v1:172.21.15.62:6789/0 conn(0x7feed80b3a20 legacy=0x7feed813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed6ffd700 1 -- 172.21.15.41:0/2768219035 >> v1:172.21.15.41:6789/0 conn(0x7feed8062f70 legacy=0x7feed805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed6ffd700 1 -- 172.21.15.41:0/2768219035 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8142950 con 0x7feed8062330 2021-10-21T00:03:21.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed6ffd700 1 --2- 172.21.15.41:0/2768219035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062330 0x7feed80b3f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7feec8002f70 tx=0x7feec8006df0).ready entity=mon.1 client_cookie=d54fd0af80df8c86 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed67fc700 1 -- 172.21.15.41:0/2768219035 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec800d610 con 0x7feed8062330 2021-10-21T00:03:21.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed67fc700 1 -- 172.21.15.41:0/2768219035 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8000e90 con 0x7feed8062330 2021-10-21T00:03:21.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed67fc700 1 -- 172.21.15.41:0/2768219035 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec800d960 con 0x7feed8062330 2021-10-21T00:03:21.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- 172.21.15.41:0/2768219035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062330 msgr2=0x7feed80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 --2- 172.21.15.41:0/2768219035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062330 0x7feed80b3f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7feec8002f70 tx=0x7feec8006df0).stop 2021-10-21T00:03:21.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- 172.21.15.41:0/2768219035 shutdown_connections 2021-10-21T00:03:21.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 --2- 172.21.15.41:0/2768219035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062330 0x7feed80b3f30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- 172.21.15.41:0/2768219035 >> 172.21.15.41:0/2768219035 conn(0x7feed80b9080 msgr2=0x7feed80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- 172.21.15.41:0/2768219035 shutdown_connections 2021-10-21T00:03:21.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.699+0000 7feed7fff700 1 -- 172.21.15.41:0/2768219035 wait complete. 2021-10-21T00:03:21.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 Processor -- start 2021-10-21T00:03:21.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 -- start start 2021-10-21T00:03:21.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 0x7feed8155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feed80b3a20 0x7feed8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8153260 con 0x7feed8062330 2021-10-21T00:03:21.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8155620 con 0x7feed8062f70 2021-10-21T00:03:21.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed8146de0 con 0x7feed80b3a20 2021-10-21T00:03:21.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58532/0 (socket says 172.21.15.41:58532) 2021-10-21T00:03:21.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed6ffd700 1 -- 172.21.15.41:0/3871389865 learned_addr learned my addr 172.21.15.41:0/3871389865 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:21.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 0x7feed8155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed77fe700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feed80b3a20 0x7feed8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 -- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feed80b3a20 msgr2=0x7feed8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feed80b3a20 0x7feed8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 -- 172.21.15.41:0/3871389865 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 msgr2=0x7feed80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 -- 172.21.15.41:0/3871389865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec800b180 con 0x7feed8062f70 2021-10-21T00:03:21.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feed6ffd700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:21.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.703+0000 7feece7fc700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 0x7feed8155a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7feec0001110 tx=0x7feec0007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec000ce80 con 0x7feed8062f70 2021-10-21T00:03:21.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00070d0 con 0x7feed8062f70 2021-10-21T00:03:21.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed81127a0 con 0x7feed8062f70 2021-10-21T00:03:21.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feec0007430 con 0x7feed8062f70 2021-10-21T00:03:21.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed8145c40 con 0x7feed8062f70 2021-10-21T00:03:21.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed81454d0 con 0x7feed8062f70 2021-10-21T00:03:21.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feec001a060 con 0x7feed8062f70 2021-10-21T00:03:21.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 0x7feebc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feec006b060 con 0x7feed8062f70 2021-10-21T00:03:21.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.707+0000 7feed6ffd700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 0x7feebc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.711+0000 7feed6ffd700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 0x7feebc055b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7feec801a000 tx=0x7feec8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.719+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feec00420b0 con 0x7feed8062f70 2021-10-21T00:03:21.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.843+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feed8112930 con 0x7feed8062f70 2021-10-21T00:03:21.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.843+0000 7feed4ff9700 1 -- 172.21.15.41:0/3871389865 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7feec0018030 con 0x7feed8062f70 2021-10-21T00:03:21.853 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:21.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 msgr2=0x7feebc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 0x7feebc055b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7feec801a000 tx=0x7feec8014000).stop 2021-10-21T00:03:21.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 msgr2=0x7feed8155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 0x7feed8155a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7feec0001110 tx=0x7feec0007a20).stop 2021-10-21T00:03:21.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 shutdown_connections 2021-10-21T00:03:21.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feebc0536a0 0x7feebc055b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feed80b3a20 0x7feed8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8062f70 0x7feed8155a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 --2- 172.21.15.41:0/3871389865 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feed8062330 0x7feed80aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 >> 172.21.15.41:0/3871389865 conn(0x7feed80b9080 msgr2=0x7feed813f060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 shutdown_connections 2021-10-21T00:03:21.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.847+0000 7feed7fff700 1 -- 172.21.15.41:0/3871389865 wait complete. 2021-10-21T00:03:21.866 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:21.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.955+0000 7f6978fa1700 1 Processor -- start 2021-10-21T00:03:21.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- start start 2021-10-21T00:03:21.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f697405f9f0 0x7f697414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69740aa750 0x7f697414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697414b130 0x7f69741495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740b1620 con 0x7f697405f9f0 2021-10-21T00:03:21.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740609d0 con 0x7f69740aa750 2021-10-21T00:03:21.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697405fdd0 con 0x7f697414b130 2021-10-21T00:03:21.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f697259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f697405f9f0 0x7f697414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69740aa750 0x7f697414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69740aa750 0x7f697414ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42226/0 (socket says 172.21.15.41:42226) 2021-10-21T00:03:21.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 -- 172.21.15.41:0/4179821540 learned_addr learned my addr 172.21.15.41:0/4179821540 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:21.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6972d9d700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697414b130 0x7f69741495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 -- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697414b130 msgr2=0x7f69741495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697414b130 0x7f69741495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 -- 172.21.15.41:0/4179821540 >> v2:172.21.15.41:3300/0 conn(0x7f697405f9f0 msgr2=0x7f697414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:21.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 --2- 172.21.15.41:0/4179821540 >> v2:172.21.15.41:3300/0 conn(0x7f697405f9f0 0x7f697414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 -- 172.21.15.41:0/4179821540 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740b1380 con 0x7f69740aa750 2021-10-21T00:03:21.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f696bfff700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69740aa750 0x7f697414ac40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6964002f70 tx=0x7f6964006eb0).ready entity=mon.1 client_cookie=adfd95980edcc599 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6971d9b700 1 -- 172.21.15.41:0/4179821540 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696400d570 con 0x7f69740aa750 2021-10-21T00:03:21.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6971d9b700 1 -- 172.21.15.41:0/4179821540 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964000e90 con 0x7f69740aa750 2021-10-21T00:03:21.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6971d9b700 1 -- 172.21.15.41:0/4179821540 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696400d900 con 0x7f69740aa750 2021-10-21T00:03:21.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69740aa750 msgr2=0x7f697414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69740aa750 0x7f697414ac40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6964002f70 tx=0x7f6964006eb0).stop 2021-10-21T00:03:21.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- 172.21.15.41:0/4179821540 shutdown_connections 2021-10-21T00:03:21.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697414b130 0x7f69741495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- 172.21.15.41:0/4179821540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f69740aa750 0x7f697414ac40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 --2- 172.21.15.41:0/4179821540 >> v2:172.21.15.41:3300/0 conn(0x7f697405f9f0 0x7f697414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- 172.21.15.41:0/4179821540 >> 172.21.15.41:0/4179821540 conn(0x7f697405bca0 msgr2=0x7f697405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:21.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- 172.21.15.41:0/4179821540 shutdown_connections 2021-10-21T00:03:21.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.959+0000 7f6978fa1700 1 -- 172.21.15.41:0/4179821540 wait complete. 2021-10-21T00:03:21.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 Processor -- start 2021-10-21T00:03:21.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- start start 2021-10-21T00:03:21.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697405f9f0 0x7f69740ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697414b130 0x7f69740633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:21.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974145b10 con 0x7f69740aa750 2021-10-21T00:03:21.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740accd0 con 0x7f697414b130 2021-10-21T00:03:21.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6974157000 con 0x7f697405f9f0 2021-10-21T00:03:21.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58548/0 (socket says 172.21.15.41:58548) 2021-10-21T00:03:21.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 -- 172.21.15.41:0/2491516355 learned_addr learned my addr 172.21.15.41:0/2491516355 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:21.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6972d9d700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697414b130 0x7f69740633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f697259c700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697405f9f0 0x7f69740ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:21.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 -- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697405f9f0 msgr2=0x7f69740ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697405f9f0 0x7f69740ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 -- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697414b130 msgr2=0x7f69740633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:21.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697414b130 0x7f69740633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:21.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 -- 172.21.15.41:0/2491516355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696400b1e0 con 0x7f69740aa750 2021-10-21T00:03:21.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696bfff700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f6964002f70 tx=0x7f6964015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:21.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964011860 con 0x7f69740aa750 2021-10-21T00:03:21.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640119c0 con 0x7f69740aa750 2021-10-21T00:03:21.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69741572a0 con 0x7f69740aa750 2021-10-21T00:03:21.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964011d20 con 0x7f69740aa750 2021-10-21T00:03:21.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.963+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6974063a40 con 0x7f69740aa750 2021-10-21T00:03:22.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974157430 con 0x7f69740aa750 2021-10-21T00:03:22.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f696401a040 con 0x7f69740aa750 2021-10-21T00:03:22.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f696b7fe700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 0x7f694c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f696406c810 con 0x7f69740aa750 2021-10-21T00:03:22.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f697259c700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 0x7f694c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.967+0000 7f697259c700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 0x7f694c055a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f695c00b000 tx=0x7f695c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:21.971+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6964043990 con 0x7f69740aa750 2021-10-21T00:03:22.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.103+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697414b550 con 0x7f69740aa750 2021-10-21T00:03:22.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f696b7fe700 1 -- 172.21.15.41:0/2491516355 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f6964023090 con 0x7f69740aa750 2021-10-21T00:03:22.114 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:22.115 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:22.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 msgr2=0x7f694c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 0x7f694c055a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f695c00b000 tx=0x7f695c006df0).stop 2021-10-21T00:03:22.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 msgr2=0x7f6974145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f6964002f70 tx=0x7f6964015000).stop 2021-10-21T00:03:22.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 shutdown_connections 2021-10-21T00:03:22.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f694c053580 0x7f694c055a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697414b130 0x7f69740633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f69740aa750 0x7f6974145620 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 --2- 172.21.15.41:0/2491516355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f697405f9f0 0x7f69740ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 >> 172.21.15.41:0/2491516355 conn(0x7f697405bca0 msgr2=0x7f697405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 shutdown_connections 2021-10-21T00:03:22.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.107+0000 7f6978fa1700 1 -- 172.21.15.41:0/2491516355 wait complete. 2021-10-21T00:03:22.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:22.131 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:22.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 Processor -- start 2021-10-21T00:03:22.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 -- start start 2021-10-21T00:03:22.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 0x7f98a8143e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98a80ae900 0x7f98a8144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a8144800 0x7f98a813f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a80af000 con 0x7f98a80ae900 2021-10-21T00:03:22.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a805cad0 con 0x7f98a805c6f0 2021-10-21T00:03:22.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.231+0000 7f98ac88e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8144c40 con 0x7f98a8144800 2021-10-21T00:03:22.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98a80ae900 0x7f98a8144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f98a80ae900 0x7f98a8144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58554/0 (socket says 172.21.15.41:58554) 2021-10-21T00:03:22.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 -- 172.21.15.41:0/1783414757 learned_addr learned my addr 172.21.15.41:0/1783414757 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:22.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a6d9d700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a8144800 0x7f98a813f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a659c700 1 --2- 172.21.15.41:0/1783414757 >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 0x7f98a8143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 -- 172.21.15.41:0/1783414757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a8144800 msgr2=0x7f98a813f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:22.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a8144800 0x7f98a813f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 -- 172.21.15.41:0/1783414757 >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 msgr2=0x7f98a8143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:22.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 --2- 172.21.15.41:0/1783414757 >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 0x7f98a8143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 -- 172.21.15.41:0/1783414757 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8067a80 con 0x7f98a80ae900 2021-10-21T00:03:22.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a659c700 1 --2- 172.21.15.41:0/1783414757 >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 0x7f98a8143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:22.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f989dd9b700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a80ae900 0x7f98a8144310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f9890002f70 tx=0x7f9890006eb0).ready entity=mon.0 client_cookie=182b9676ca98bdd8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a5d9b700 1 -- 172.21.15.41:0/1783414757 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f989000d570 con 0x7f98a80ae900 2021-10-21T00:03:22.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a5d9b700 1 -- 172.21.15.41:0/1783414757 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890000e90 con 0x7f98a80ae900 2021-10-21T00:03:22.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98a5d9b700 1 -- 172.21.15.41:0/1783414757 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f989000d900 con 0x7f98a80ae900 2021-10-21T00:03:22.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 -- 172.21.15.41:0/1783414757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a80ae900 msgr2=0x7f98a8144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a80ae900 0x7f98a8144310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f9890002f70 tx=0x7f9890006eb0).stop 2021-10-21T00:03:22.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 -- 172.21.15.41:0/1783414757 shutdown_connections 2021-10-21T00:03:22.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a80ae900 0x7f98a8144310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1783414757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a8144800 0x7f98a813f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1783414757 >> v2:172.21.15.62:3300/0 conn(0x7f98a805c6f0 0x7f98a8143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 -- 172.21.15.41:0/1783414757 >> 172.21.15.41:0/1783414757 conn(0x7f98a8063210 msgr2=0x7f98a805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 -- 172.21.15.41:0/1783414757 shutdown_connections 2021-10-21T00:03:22.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.235+0000 7f98ac88e700 1 -- 172.21.15.41:0/1783414757 wait complete. 2021-10-21T00:03:22.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 Processor -- start 2021-10-21T00:03:22.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- start start 2021-10-21T00:03:22.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a805c6f0 0x7f98a8150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a80ae900 0x7f98a809eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8150d00 con 0x7f98a8144800 2021-10-21T00:03:22.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a813e540 con 0x7f98a80ae900 2021-10-21T00:03:22.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a813bae0 con 0x7f98a805c6f0 2021-10-21T00:03:22.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58564/0 (socket says 172.21.15.41:58564) 2021-10-21T00:03:22.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 -- 172.21.15.41:0/1677452381 learned_addr learned my addr 172.21.15.41:0/1677452381 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:22.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f989dd9b700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a80ae900 0x7f98a809eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a659c700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a805c6f0 0x7f98a8150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 -- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a805c6f0 msgr2=0x7f98a8150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a805c6f0 0x7f98a8150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 -- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a80ae900 msgr2=0x7f98a809eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a80ae900 0x7f98a809eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 -- 172.21.15.41:0/1677452381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989000b1e0 con 0x7f98a8144800 2021-10-21T00:03:22.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98a6d9d700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f98a0006e00 tx=0x7f98a00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a0012600 con 0x7f98a8144800 2021-10-21T00:03:22.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a0012760 con 0x7f98a8144800 2021-10-21T00:03:22.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a813bd10 con 0x7f98a8144800 2021-10-21T00:03:22.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a0012ac0 con 0x7f98a8144800 2021-10-21T00:03:22.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.239+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a814f220 con 0x7f98a8144800 2021-10-21T00:03:22.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a80af230 con 0x7f98a8144800 2021-10-21T00:03:22.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98a0012c20 con 0x7f98a8144800 2021-10-21T00:03:22.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f989ffff700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 0x7f988c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98a006bb20 con 0x7f98a8144800 2021-10-21T00:03:22.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f98a659c700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 0x7f988c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.243+0000 7f98a659c700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 0x7f988c055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f989800c000 tx=0x7f9898008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.247+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98a0042be0 con 0x7f98a8144800 2021-10-21T00:03:22.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.375+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f98a8067230 con 0x7f98a8144800 2021-10-21T00:03:22.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.375+0000 7f989ffff700 1 -- 172.21.15.41:0/1677452381 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f98a0016020 con 0x7f98a8144800 2021-10-21T00:03:22.384 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:22.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 msgr2=0x7f988c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 0x7f988c055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f989800c000 tx=0x7f9898008040).stop 2021-10-21T00:03:22.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 msgr2=0x7f98a809f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f98a0006e00 tx=0x7f98a00091d0).stop 2021-10-21T00:03:22.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 shutdown_connections 2021-10-21T00:03:22.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f988c0536a0 0x7f988c055b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f98a8144800 0x7f98a809f070 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a80ae900 0x7f98a809eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 --2- 172.21.15.41:0/1677452381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98a805c6f0 0x7f98a8150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 >> 172.21.15.41:0/1677452381 conn(0x7f98a8063210 msgr2=0x7f98a805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 shutdown_connections 2021-10-21T00:03:22.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.379+0000 7f98ac88e700 1 -- 172.21.15.41:0/1677452381 wait complete. 2021-10-21T00:03:22.397 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:22.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 Processor -- start 2021-10-21T00:03:22.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 -- start start 2021-10-21T00:03:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6140b2170 0x7fb6140ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 0x7fb6140ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140b0b50 con 0x7fb6140abb50 2021-10-21T00:03:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140b2550 con 0x7fb6140b2170 2021-10-21T00:03:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61ae87700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140b0d90 con 0x7fb6140af620 2021-10-21T00:03:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61a686700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb6140abb50 0x7fb61414a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56342/0 (socket says 172.21.15.41:56342) 2021-10-21T00:03:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb61a686700 1 -- 172.21.15.41:0/1115837535 learned_addr learned my addr 172.21.15.41:0/1115837535 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619684700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 0x7fb6140ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 --2- 172.21.15.41:0/1115837535 >> v2:172.21.15.62:3300/0 conn(0x7fb6140b2170 0x7fb6140ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb618e83700 1 -- 172.21.15.41:0/1115837535 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877206387 0 0) 0x7fb60c001490 con 0x7fb6140abb50 2021-10-21T00:03:22.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb618e83700 1 -- 172.21.15.41:0/1115837535 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f8003260 con 0x7fb6140abb50 2021-10-21T00:03:22.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 -- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 msgr2=0x7fb6140ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:22.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 0x7fb6140ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 -- 172.21.15.41:0/1115837535 >> v1:172.21.15.41:6789/0 conn(0x7fb6140abb50 legacy=0x7fb61414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 -- 172.21.15.41:0/1115837535 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140b1030 con 0x7fb6140b2170 2021-10-21T00:03:22.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619684700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 0x7fb6140ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:22.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb619e85700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb6140ab170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604006df0).ready entity=mon.1 client_cookie=b95af3271eba4b3d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb618e83700 1 -- 172.21.15.41:0/1115837535 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60400d4a0 con 0x7fb6140b2170 2021-10-21T00:03:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb618e83700 1 -- 172.21.15.41:0/1115837535 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604000e90 con 0x7fb6140b2170 2021-10-21T00:03:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.495+0000 7fb618e83700 1 -- 172.21.15.41:0/1115837535 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60400d7f0 con 0x7fb6140b2170 2021-10-21T00:03:22.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 msgr2=0x7fb6140ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb6140ab170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604006df0).stop 2021-10-21T00:03:22.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- 172.21.15.41:0/1115837535 shutdown_connections 2021-10-21T00:03:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140af620 0x7fb6140ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1115837535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb6140ab170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- 172.21.15.41:0/1115837535 >> 172.21.15.41:0/1115837535 conn(0x7fb6140b5700 msgr2=0x7fb6140b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- 172.21.15.41:0/1115837535 shutdown_connections 2021-10-21T00:03:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- 172.21.15.41:0/1115837535 wait complete. 2021-10-21T00:03:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 Processor -- start 2021-10-21T00:03:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- start start 2021-10-21T00:03:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 0x7fb6141599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb614147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140aee00 con 0x7fb6140af620 2021-10-21T00:03:22.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61415a240 con 0x7fb6140b2170 2021-10-21T00:03:22.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61ae87700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614159ee0 con 0x7fb6140abb50 2021-10-21T00:03:22.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619684700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 0x7fb6141599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619684700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58576/0 (socket says 172.21.15.41:58576) 2021-10-21T00:03:22.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619684700 1 -- 172.21.15.41:0/1373908545 learned_addr learned my addr 172.21.15.41:0/1373908545 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:22.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb61a686700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb614147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 -- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 msgr2=0x7fb614147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb614147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 -- 172.21.15.41:0/1373908545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 msgr2=0x7fb614146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 -- 172.21.15.41:0/1373908545 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61000b180 con 0x7fb6140abb50 2021-10-21T00:03:22.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619684700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:22.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.499+0000 7fb619e85700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 0x7fb6141599f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb604012930 con 0x7fb6140abb50 2021-10-21T00:03:22.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604012a90 con 0x7fb6140abb50 2021-10-21T00:03:22.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb604012df0 con 0x7fb6140abb50 2021-10-21T00:03:22.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60400b180 con 0x7fb6140abb50 2021-10-21T00:03:22.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140ac2a0 con 0x7fb6140abb50 2021-10-21T00:03:22.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb60401c070 con 0x7fb6140abb50 2021-10-21T00:03:22.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140b12d0 con 0x7fb6140abb50 2021-10-21T00:03:22.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 0x7fb5fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb60406c440 con 0x7fb6140abb50 2021-10-21T00:03:22.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.503+0000 7fb619684700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 0x7fb5fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.507+0000 7fb619684700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 0x7fb5fc055ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb61000b000 tx=0x7fb610006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.515+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6040435b0 con 0x7fb6140abb50 2021-10-21T00:03:22.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.643+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb614057350 con 0x7fb6140abb50 2021-10-21T00:03:22.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.643+0000 7fb60affd700 1 -- 172.21.15.41:0/1373908545 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb604019020 con 0x7fb6140abb50 2021-10-21T00:03:22.653 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:22.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 msgr2=0x7fb5fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 0x7fb5fc055ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb61000b000 tx=0x7fb610006df0).stop 2021-10-21T00:03:22.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 msgr2=0x7fb6141599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 0x7fb6141599f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604014000).stop 2021-10-21T00:03:22.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 shutdown_connections 2021-10-21T00:03:22.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5fc053610 0x7fb5fc055ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6140b2170 0x7fb614147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6140af620 0x7fb614146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 --2- 172.21.15.41:0/1373908545 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6140abb50 0x7fb6141599f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 >> 172.21.15.41:0/1373908545 conn(0x7fb6140b5700 msgr2=0x7fb614149420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 shutdown_connections 2021-10-21T00:03:22.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.647+0000 7fb61ae87700 1 -- 172.21.15.41:0/1373908545 wait complete. 2021-10-21T00:03:22.666 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:22.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 Processor -- start 2021-10-21T00:03:22.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 -- start start 2021-10-21T00:03:22.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79c00b61d0 0x7f79c00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79c00b0120 0x7f79c00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00b1d10 con 0x7f79c00adef0 2021-10-21T00:03:22.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c005d3f0 con 0x7f79c00b0120 2021-10-21T00:03:22.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c5b6f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00b65b0 con 0x7f79c00b61d0 2021-10-21T00:03:22.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79bffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79c00b0120 0x7f79c00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79bffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79c00b0120 0x7f79c00b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58584/0 (socket says 172.21.15.41:58584) 2021-10-21T00:03:22.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79bffff700 1 -- 172.21.15.41:0/2455126270 learned_addr learned my addr 172.21.15.41:0/2455126270 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:22.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.771+0000 7f79c4b6d700 1 --2- 172.21.15.41:0/2455126270 >> v2:172.21.15.62:3300/0 conn(0x7f79c00b61d0 0x7f79c00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bffff700 1 -- 172.21.15.41:0/2455126270 >> v2:172.21.15.62:3300/0 conn(0x7f79c00b61d0 msgr2=0x7f79c00af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:22.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bffff700 1 --2- 172.21.15.41:0/2455126270 >> v2:172.21.15.62:3300/0 conn(0x7f79c00b61d0 0x7f79c00af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bffff700 1 -- 172.21.15.41:0/2455126270 >> v1:172.21.15.41:6789/0 conn(0x7f79c00adef0 legacy=0x7f79c00ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bffff700 1 -- 172.21.15.41:0/2455126270 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b1850 con 0x7f79c00b0120 2021-10-21T00:03:22.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bffff700 1 --2- 172.21.15.41:0/2455126270 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c00b0a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f79a8002f70 tx=0x7f79a8006eb0).ready entity=mon.0 client_cookie=3e5e1bc42f6b9fe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bf7fe700 1 -- 172.21.15.41:0/2455126270 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a800d610 con 0x7f79c00b0120 2021-10-21T00:03:22.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bf7fe700 1 -- 172.21.15.41:0/2455126270 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8000e90 con 0x7f79c00b0120 2021-10-21T00:03:22.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79bf7fe700 1 -- 172.21.15.41:0/2455126270 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a800d9a0 con 0x7f79c00b0120 2021-10-21T00:03:22.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- 172.21.15.41:0/2455126270 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 msgr2=0x7f79c00b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/2455126270 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c00b0a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f79a8002f70 tx=0x7f79a8006eb0).stop 2021-10-21T00:03:22.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- 172.21.15.41:0/2455126270 shutdown_connections 2021-10-21T00:03:22.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/2455126270 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c00b0a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/2455126270 >> v2:172.21.15.62:3300/0 conn(0x7f79c00b61d0 0x7f79c00af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- 172.21.15.41:0/2455126270 >> 172.21.15.41:0/2455126270 conn(0x7f79c0063b80 msgr2=0x7f79c00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- 172.21.15.41:0/2455126270 shutdown_connections 2021-10-21T00:03:22.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- 172.21.15.41:0/2455126270 wait complete. 2021-10-21T00:03:22.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 Processor -- start 2021-10-21T00:03:22.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.775+0000 7f79c5b6f700 1 -- start start 2021-10-21T00:03:22.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79c00adef0 0x7f79c0066da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c00b61d0 0x7f79c0065800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0148080 con 0x7f79c00b0120 2021-10-21T00:03:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0152830 con 0x7f79c00b61d0 2021-10-21T00:03:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0147de0 con 0x7f79c00adef0 2021-10-21T00:03:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58590/0 (socket says 172.21.15.41:58590) 2021-10-21T00:03:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 -- 172.21.15.41:0/1491138847 learned_addr learned my addr 172.21.15.41:0/1491138847 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c4b6d700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79c00adef0 0x7f79c0066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c536e700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c00b61d0 0x7f79c0065800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 -- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79c00adef0 msgr2=0x7f79c0066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79c00adef0 0x7f79c0066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 -- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c00b61d0 msgr2=0x7f79c0065800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c00b61d0 0x7f79c0065800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 -- 172.21.15.41:0/1491138847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a800b1e0 con 0x7f79c00b0120 2021-10-21T00:03:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bffff700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f79c01529c0 tx=0x7f79a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a8011790 con 0x7f79c00b0120 2021-10-21T00:03:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a80118f0 con 0x7f79c00b0120 2021-10-21T00:03:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c0065360 con 0x7f79c00b0120 2021-10-21T00:03:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a8011c50 con 0x7f79c00b0120 2021-10-21T00:03:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c01483e0 con 0x7f79c00b0120 2021-10-21T00:03:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.779+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0147c30 con 0x7f79c00b0120 2021-10-21T00:03:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.783+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79a8025030 con 0x7f79c00b0120 2021-10-21T00:03:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.783+0000 7f79bdffb700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 0x7f79a4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.783+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79a806c970 con 0x7f79c00b0120 2021-10-21T00:03:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.783+0000 7f79c4b6d700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 0x7f79a4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.783+0000 7f79c4b6d700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 0x7f79a4055b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f79b000c000 tx=0x7f79b0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.787+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79a8043ad0 con 0x7f79c00b0120 2021-10-21T00:03:22.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.919+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79c00b1f40 con 0x7f79c00b0120 2021-10-21T00:03:22.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79bdffb700 1 -- 172.21.15.41:0/1491138847 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f79a8023020 con 0x7f79c00b0120 2021-10-21T00:03:22.932 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:22.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 msgr2=0x7f79a4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 0x7f79a4055b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f79b000c000 tx=0x7f79b0008040).stop 2021-10-21T00:03:22.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 msgr2=0x7f79c0152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:22.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f79c01529c0 tx=0x7f79a8015000).stop 2021-10-21T00:03:22.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 shutdown_connections 2021-10-21T00:03:22.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f79a4053640 0x7f79a4055b00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c00b61d0 0x7f79c0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79c00b0120 0x7f79c0152340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 --2- 172.21.15.41:0/1491138847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79c00adef0 0x7f79c0066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:22.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 >> 172.21.15.41:0/1491138847 conn(0x7f79c0063b80 msgr2=0x7f79c00ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:22.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 shutdown_connections 2021-10-21T00:03:22.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:22.923+0000 7f79c5b6f700 1 -- 172.21.15.41:0/1491138847 wait complete. 2021-10-21T00:03:22.943 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:23.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 Processor -- start 2021-10-21T00:03:23.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- start start 2021-10-21T00:03:23.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f137005c6f0 0x7f1370143e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f13700ae900 0x7f1370144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13700af000 con 0x7f1370144800 2021-10-21T00:03:23.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1370144c70 con 0x7f13700ae900 2021-10-21T00:03:23.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137005cad0 con 0x7f137005c6f0 2021-10-21T00:03:23.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f13700ae900 0x7f1370144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f13700ae900 0x7f1370144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58600/0 (socket says 172.21.15.41:58600) 2021-10-21T00:03:23.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 -- 172.21.15.41:0/1035740923 learned_addr learned my addr 172.21.15.41:0/1035740923 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136ffff700 1 --1- 172.21.15.41:0/1035740923 >> v1:172.21.15.41:6789/0 conn(0x7f1370144800 0x7f137013f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56368/0 (socket says 172.21.15.41:56368) 2021-10-21T00:03:23.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136f7fe700 1 --2- 172.21.15.41:0/1035740923 >> v2:172.21.15.62:3300/0 conn(0x7f137005c6f0 0x7f1370143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 -- 172.21.15.41:0/1035740923 >> v2:172.21.15.62:3300/0 conn(0x7f137005c6f0 msgr2=0x7f1370143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:23.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 --2- 172.21.15.41:0/1035740923 >> v2:172.21.15.62:3300/0 conn(0x7f137005c6f0 0x7f1370143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 -- 172.21.15.41:0/1035740923 >> v1:172.21.15.41:6789/0 conn(0x7f1370144800 legacy=0x7f137013f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136e7fc700 1 -- 172.21.15.41:0/1035740923 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709656921 0 0) 0x7f13700af000 con 0x7f1370144800 2021-10-21T00:03:23.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 -- 172.21.15.41:0/1035740923 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370067a80 con 0x7f13700ae900 2021-10-21T00:03:23.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136effd700 1 --2- 172.21.15.41:0/1035740923 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f1370144310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1360002f70 tx=0x7f1360006eb0).ready entity=mon.0 client_cookie=65fe24c308481a3b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136e7fc700 1 -- 172.21.15.41:0/1035740923 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f136000d610 con 0x7f13700ae900 2021-10-21T00:03:23.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136e7fc700 1 -- 172.21.15.41:0/1035740923 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360000e90 con 0x7f13700ae900 2021-10-21T00:03:23.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f136e7fc700 1 -- 172.21.15.41:0/1035740923 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f136000d960 con 0x7f13700ae900 2021-10-21T00:03:23.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- 172.21.15.41:0/1035740923 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 msgr2=0x7f1370144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 --2- 172.21.15.41:0/1035740923 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f1370144310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1360002f70 tx=0x7f1360006eb0).stop 2021-10-21T00:03:23.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.051+0000 7f137612a700 1 -- 172.21.15.41:0/1035740923 shutdown_connections 2021-10-21T00:03:23.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 --2- 172.21.15.41:0/1035740923 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f1370144310 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 --2- 172.21.15.41:0/1035740923 >> v2:172.21.15.62:3300/0 conn(0x7f137005c6f0 0x7f1370143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- 172.21.15.41:0/1035740923 >> 172.21.15.41:0/1035740923 conn(0x7f1370063210 msgr2=0x7f137005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- 172.21.15.41:0/1035740923 shutdown_connections 2021-10-21T00:03:23.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- 172.21.15.41:0/1035740923 wait complete. 2021-10-21T00:03:23.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 Processor -- start 2021-10-21T00:03:23.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- start start 2021-10-21T00:03:23.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f137005c6f0 0x7f137013ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1370144800 0x7f137014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370142cb0 con 0x7f13700ae900 2021-10-21T00:03:23.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370142ee0 con 0x7f1370144800 2021-10-21T00:03:23.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f137612a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1370143180 con 0x7f137005c6f0 2021-10-21T00:03:23.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58604/0 (socket says 172.21.15.41:58604) 2021-10-21T00:03:23.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 -- 172.21.15.41:0/2267677221 learned_addr learned my addr 172.21.15.41:0/2267677221 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136f7fe700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f137005c6f0 0x7f137013ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136ffff700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1370144800 0x7f137014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 -- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f137005c6f0 msgr2=0x7f137013ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f137005c6f0 0x7f137013ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 -- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1370144800 msgr2=0x7f137014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1370144800 0x7f137014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 -- 172.21.15.41:0/2267677221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136000b1e0 con 0x7f13700ae900 2021-10-21T00:03:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136effd700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1360002f70 tx=0x7f1360015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f136000d990 con 0x7f13700ae900 2021-10-21T00:03:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.055+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360011b00 con 0x7f13700ae900 2021-10-21T00:03:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1370143420 con 0x7f13700ae900 2021-10-21T00:03:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1360011e60 con 0x7f13700ae900 2021-10-21T00:03:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137014fb90 con 0x7f13700ae900 2021-10-21T00:03:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1360025030 con 0x7f13700ae900 2021-10-21T00:03:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13700af230 con 0x7f13700ae900 2021-10-21T00:03:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136cff9700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 0x7f1350055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f136006cba0 con 0x7f13700ae900 2021-10-21T00:03:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136f7fe700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 0x7f1350055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.059+0000 7f136f7fe700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 0x7f1350055a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f136400c000 tx=0x7f1364008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.063+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1360043bf0 con 0x7f13700ae900 2021-10-21T00:03:23.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1370057350 con 0x7f13700ae900 2021-10-21T00:03:23.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f136cff9700 1 -- 172.21.15.41:0/2267677221 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1360023020 con 0x7f13700ae900 2021-10-21T00:03:23.203 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:23.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 msgr2=0x7f1350055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 0x7f1350055a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f136400c000 tx=0x7f1364008040).stop 2021-10-21T00:03:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 msgr2=0x7f137014f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1360002f70 tx=0x7f1360015000).stop 2021-10-21T00:03:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 shutdown_connections 2021-10-21T00:03:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1350053580 0x7f1350055a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1370144800 0x7f137014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13700ae900 0x7f137014f1b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 --2- 172.21.15.41:0/2267677221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f137005c6f0 0x7f137013ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 >> 172.21.15.41:0/2267677221 conn(0x7f1370063210 msgr2=0x7f1370065af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 shutdown_connections 2021-10-21T00:03:23.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.195+0000 7f137612a700 1 -- 172.21.15.41:0/2267677221 wait complete. 2021-10-21T00:03:23.220 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:23.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 Processor -- start 2021-10-21T00:03:23.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 -- start start 2021-10-21T00:03:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f145c149240 0x7f145c14b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c0b4760 con 0x7f145c0b4380 2021-10-21T00:03:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c0ad4c0 con 0x7f145c0b1830 2021-10-21T00:03:23.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146330c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c0ad760 con 0x7f145c149240 2021-10-21T00:03:23.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f145c149240 0x7f145c14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f145c149240 0x7f145c14b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58614/0 (socket says 172.21.15.41:58614) 2021-10-21T00:03:23.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 -- 172.21.15.41:0/13927418 learned_addr learned my addr 172.21.15.41:0/13927418 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f146230a700 1 --1- 172.21.15.41:0/13927418 >> v1:172.21.15.41:6789/0 conn(0x7f145c0b4380 0x7f145c05f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56380/0 (socket says 172.21.15.41:56380) 2021-10-21T00:03:23.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1461308700 1 -- 172.21.15.41:0/13927418 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189370366 0 0) 0x7f145c0b4760 con 0x7f145c0b4380 2021-10-21T00:03:23.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1461308700 1 -- 172.21.15.41:0/13927418 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1448003260 con 0x7f145c0b4380 2021-10-21T00:03:23.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 -- 172.21.15.41:0/13927418 >> v1:172.21.15.62:6789/0 conn(0x7f145c0b1830 legacy=0x7f145c05fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 -- 172.21.15.41:0/13927418 >> v1:172.21.15.41:6789/0 conn(0x7f145c0b4380 legacy=0x7f145c05f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 -- 172.21.15.41:0/13927418 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0ada00 con 0x7f145c149240 2021-10-21T00:03:23.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1462b0b700 1 --2- 172.21.15.41:0/13927418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c149240 0x7f145c14b630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f144c002f70 tx=0x7f144c006eb0).ready entity=mon.0 client_cookie=5a42f10cd8b4b7f1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1461308700 1 -- 172.21.15.41:0/13927418 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f144c00d610 con 0x7f145c149240 2021-10-21T00:03:23.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1461308700 1 -- 172.21.15.41:0/13927418 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c000e90 con 0x7f145c149240 2021-10-21T00:03:23.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.319+0000 7f1461308700 1 -- 172.21.15.41:0/13927418 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f144c00d960 con 0x7f145c149240 2021-10-21T00:03:23.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- 172.21.15.41:0/13927418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c149240 msgr2=0x7f145c14b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 --2- 172.21.15.41:0/13927418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c149240 0x7f145c14b630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f144c002f70 tx=0x7f144c006eb0).stop 2021-10-21T00:03:23.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- 172.21.15.41:0/13927418 shutdown_connections 2021-10-21T00:03:23.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 --2- 172.21.15.41:0/13927418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c149240 0x7f145c14b630 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- 172.21.15.41:0/13927418 >> 172.21.15.41:0/13927418 conn(0x7f145c0b7910 msgr2=0x7f145c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- 172.21.15.41:0/13927418 shutdown_connections 2021-10-21T00:03:23.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- 172.21.15.41:0/13927418 wait complete. 2021-10-21T00:03:23.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 Processor -- start 2021-10-21T00:03:23.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- start start 2021-10-21T00:03:23.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 0x7f145c09a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f145c149240 0x7f145c133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c133f90 con 0x7f145c0b4380 2021-10-21T00:03:23.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c140c00 con 0x7f145c0b1830 2021-10-21T00:03:23.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146330c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c140ea0 con 0x7f145c149240 2021-10-21T00:03:23.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58620/0 (socket says 172.21.15.41:58620) 2021-10-21T00:03:23.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 -- 172.21.15.41:0/1751361171 learned_addr learned my addr 172.21.15.41:0/1751361171 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1462b0b700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f145c149240 0x7f145c133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146230a700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 0x7f145c09a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 -- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f145c149240 msgr2=0x7f145c133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f145c149240 0x7f145c133aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 -- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 msgr2=0x7f145c09a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 0x7f145c09a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 -- 172.21.15.41:0/1751361171 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c00b1e0 con 0x7f145c0b4380 2021-10-21T00:03:23.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f146230a700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 0x7f145c09a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:23.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.323+0000 7f1461b09700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f145c0643f0 tx=0x7f1450007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145000ce30 con 0x7f145c0b4380 2021-10-21T00:03:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145000f470 con 0x7f145c0b4380 2021-10-21T00:03:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c141140 con 0x7f145c0b4380 2021-10-21T00:03:23.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145000f7d0 con 0x7f145c0b4380 2021-10-21T00:03:23.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c140700 con 0x7f145c0b4380 2021-10-21T00:03:23.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c140a10 con 0x7f145c0b4380 2021-10-21T00:03:23.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1450019030 con 0x7f145c0b4380 2021-10-21T00:03:23.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 0x7f143c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f145006adc0 con 0x7f145c0b4380 2021-10-21T00:03:23.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.327+0000 7f146230a700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 0x7f143c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.331+0000 7f146230a700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 0x7f143c055b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f145400b000 tx=0x7f1454007cb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.335+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1450041f20 con 0x7f145c0b4380 2021-10-21T00:03:23.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.463+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f145c057350 con 0x7f145c0b4380 2021-10-21T00:03:23.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.463+0000 7f145b7fe700 1 -- 172.21.15.41:0/1751361171 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f1450045540 con 0x7f145c0b4380 2021-10-21T00:03:23.472 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:23.473 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:02:58.793842+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:02:55.845340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-10-21T00:02:56.789866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:23.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 msgr2=0x7f143c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 0x7f143c055b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f145400b000 tx=0x7f1454007cb0).stop 2021-10-21T00:03:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 msgr2=0x7f145c1335b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f145c0643f0 tx=0x7f1450007c20).stop 2021-10-21T00:03:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 shutdown_connections 2021-10-21T00:03:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f143c0536a0 0x7f143c055b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f145c149240 0x7f145c133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f145c0b4380 0x7f145c1335b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 --2- 172.21.15.41:0/1751361171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f145c0b1830 0x7f145c09a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 >> 172.21.15.41:0/1751361171 conn(0x7f145c0b7910 msgr2=0x7f145c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 shutdown_connections 2021-10-21T00:03:23.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.467+0000 7f146330c700 1 -- 172.21.15.41:0/1751361171 wait complete. 2021-10-21T00:03:23.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:02:55.845340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:02:56.789866+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:23.493 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:23.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 Processor -- start 2021-10-21T00:03:23.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 -- start start 2021-10-21T00:03:23.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380b2170 0x7fcf380ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf380af620 0x7fcf380ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf380b0b50 con 0x7fcf380abb50 2021-10-21T00:03:23.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf380b2550 con 0x7fcf380af620 2021-10-21T00:03:23.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3e6de700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380b0d90 con 0x7fcf380b2170 2021-10-21T00:03:23.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3dedd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcf380abb50 0x7fcf3814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56398/0 (socket says 172.21.15.41:56398) 2021-10-21T00:03:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3dedd700 1 -- 172.21.15.41:0/3106310026 learned_addr learned my addr 172.21.15.41:0/3106310026 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 --2- 172.21.15.41:0/3106310026 >> v2:172.21.15.62:3300/0 conn(0x7fcf380af620 0x7fcf380ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3d6dc700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380b2170 0x7fcf380ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521083886 0 0) 0x7fcf30001110 con 0x7fcf380abb50 2021-10-21T00:03:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf24003260 con 0x7fcf380abb50 2021-10-21T00:03:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 -- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380b2170 msgr2=0x7fcf380ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380b2170 0x7fcf380ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 -- 172.21.15.41:0/3106310026 >> v1:172.21.15.41:6789/0 conn(0x7fcf380abb50 legacy=0x7fcf3814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309813579 0 0) 0x7fcf24003260 con 0x7fcf380abb50 2021-10-21T00:03:23.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 -- 172.21.15.41:0/3106310026 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380b1030 con 0x7fcf380af620 2021-10-21T00:03:23.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.599+0000 7fcf3cedb700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380af620 0x7fcf380ab660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcf30001990 tx=0x7fcf280091d0).ready entity=mon.1 client_cookie=615addfe23ded187 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf300017f0 con 0x7fcf380af620 2021-10-21T00:03:23.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800f510 con 0x7fcf380af620 2021-10-21T00:03:23.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf37fff700 1 -- 172.21.15.41:0/3106310026 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf2800f680 con 0x7fcf380af620 2021-10-21T00:03:23.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380af620 msgr2=0x7fcf380ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380af620 0x7fcf380ab660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcf30001990 tx=0x7fcf280091d0).stop 2021-10-21T00:03:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- 172.21.15.41:0/3106310026 shutdown_connections 2021-10-21T00:03:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380af620 0x7fcf380ab660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/3106310026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380b2170 0x7fcf380ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- 172.21.15.41:0/3106310026 >> 172.21.15.41:0/3106310026 conn(0x7fcf380b5700 msgr2=0x7fcf380b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- 172.21.15.41:0/3106310026 shutdown_connections 2021-10-21T00:03:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- 172.21.15.41:0/3106310026 wait complete. 2021-10-21T00:03:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 Processor -- start 2021-10-21T00:03:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.603+0000 7fcf3e6de700 1 -- start start 2021-10-21T00:03:23.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380abb50 0x7fcf380ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 0x7fcf38144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380acd00 con 0x7fcf380b2170 2021-10-21T00:03:23.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380acf30 con 0x7fcf380abb50 2021-10-21T00:03:23.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380ad1d0 con 0x7fcf380af620 2021-10-21T00:03:23.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58634/0 (socket says 172.21.15.41:58634) 2021-10-21T00:03:23.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 -- 172.21.15.41:0/1025077319 learned_addr learned my addr 172.21.15.41:0/1025077319 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3d6dc700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380abb50 0x7fcf380ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3cedb700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 0x7fcf38144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 -- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 msgr2=0x7fcf38144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 0x7fcf38144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 -- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380abb50 msgr2=0x7fcf380ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380abb50 0x7fcf380ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 -- 172.21.15.41:0/1025077319 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28009470 con 0x7fcf380b2170 2021-10-21T00:03:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3cedb700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 0x7fcf38144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3dedd700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fcf30001a50 tx=0x7fcf30000f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf30000fd0 con 0x7fcf380b2170 2021-10-21T00:03:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30007170 con 0x7fcf380b2170 2021-10-21T00:03:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf381487d0 con 0x7fcf380b2170 2021-10-21T00:03:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf30004730 con 0x7fcf380b2170 2021-10-21T00:03:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.607+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf38144f30 con 0x7fcf380b2170 2021-10-21T00:03:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf380ad390 con 0x7fcf380b2170 2021-10-21T00:03:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf30004890 con 0x7fcf380b2170 2021-10-21T00:03:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf367fc700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 0x7fcf18055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf3006b350 con 0x7fcf380b2170 2021-10-21T00:03:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf3d6dc700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 0x7fcf18055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.611+0000 7fcf3d6dc700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 0x7fcf18055b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fcf2c00b000 tx=0x7fcf2c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.615+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf30042410 con 0x7fcf380b2170 2021-10-21T00:03:23.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.739+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf380b0b30 con 0x7fcf380b2170 2021-10-21T00:03:23.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf367fc700 1 -- 172.21.15.41:0/1025077319 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf30045a30 con 0x7fcf380b2170 2021-10-21T00:03:23.750 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 msgr2=0x7fcf18055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 0x7fcf18055b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fcf2c00b000 tx=0x7fcf2c006df0).stop 2021-10-21T00:03:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 msgr2=0x7fcf381456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fcf30001a50 tx=0x7fcf30000f60).stop 2021-10-21T00:03:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 shutdown_connections 2021-10-21T00:03:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf180536d0 0x7fcf18055b90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf380b2170 0x7fcf381456f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf380af620 0x7fcf38144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 --2- 172.21.15.41:0/1025077319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf380abb50 0x7fcf380ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 >> 172.21.15.41:0/1025077319 conn(0x7fcf380b5700 msgr2=0x7fcf38060390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 shutdown_connections 2021-10-21T00:03:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.743+0000 7fcf3e6de700 1 -- 172.21.15.41:0/1025077319 wait complete. 2021-10-21T00:03:23.762 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:23.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.863+0000 7f2250907700 1 Processor -- start 2021-10-21T00:03:23.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.863+0000 7f2250907700 1 -- start start 2021-10-21T00:03:23.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2250907700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f224c0aebb0 0x7f224c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2250907700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 0x7f224c13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2250907700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c0b6350 con 0x7f224c0b5f70 2021-10-21T00:03:23.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2250907700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0b13b0 con 0x7f224c0aebb0 2021-10-21T00:03:23.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2250907700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c05c830 con 0x7f224c1448e0 2021-10-21T00:03:23.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f224c0aebb0 0x7f224c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f224c0b5f70 0x7f224c143ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36232/0 (socket says 172.21.15.41:36232) 2021-10-21T00:03:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224b7fe700 1 -- 172.21.15.41:0/1610708406 learned_addr learned my addr 172.21.15.41:0/1610708406 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224bfff700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 0x7f224c13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224affd700 1 -- 172.21.15.41:0/1610708406 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414168121 0 0) 0x7f224c0b6350 con 0x7f224c0b5f70 2021-10-21T00:03:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224affd700 1 -- 172.21.15.41:0/1610708406 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c003260 con 0x7f224c0b5f70 2021-10-21T00:03:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 -- 172.21.15.41:0/1610708406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 msgr2=0x7f224c13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 0x7f224c13f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 -- 172.21.15.41:0/1610708406 >> v1:172.21.15.62:6789/0 conn(0x7f224c0b5f70 legacy=0x7f224c143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 -- 172.21.15.41:0/1610708406 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c05cad0 con 0x7f224c0aebb0 2021-10-21T00:03:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224bfff700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 0x7f224c13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f2243fff700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0aebb0 0x7f224c1443f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f2234002f70 tx=0x7f2234006df0).ready entity=mon.0 client_cookie=ecde115c1b16ddb2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224affd700 1 -- 172.21.15.41:0/1610708406 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223400d4a0 con 0x7f224c0aebb0 2021-10-21T00:03:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224affd700 1 -- 172.21.15.41:0/1610708406 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234000e90 con 0x7f224c0aebb0 2021-10-21T00:03:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.867+0000 7f224affd700 1 -- 172.21.15.41:0/1610708406 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223400d7f0 con 0x7f224c0aebb0 2021-10-21T00:03:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- 172.21.15.41:0/1610708406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0aebb0 msgr2=0x7f224c1443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0aebb0 0x7f224c1443f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f2234002f70 tx=0x7f2234006df0).stop 2021-10-21T00:03:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- 172.21.15.41:0/1610708406 shutdown_connections 2021-10-21T00:03:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c1448e0 0x7f224c13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- 172.21.15.41:0/1610708406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0aebb0 0x7f224c1443f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- 172.21.15.41:0/1610708406 >> 172.21.15.41:0/1610708406 conn(0x7f224c0639f0 msgr2=0x7f224c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- 172.21.15.41:0/1610708406 shutdown_connections 2021-10-21T00:03:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- 172.21.15.41:0/1610708406 wait complete. 2021-10-21T00:03:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 Processor -- start 2021-10-21T00:03:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- start start 2021-10-21T00:03:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c0aebb0 0x7f224c10e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 0x7f224c14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c150c20 con 0x7f224c0b5f70 2021-10-21T00:03:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c13de30 con 0x7f224c1448e0 2021-10-21T00:03:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2250907700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10f370 con 0x7f224c0aebb0 2021-10-21T00:03:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2243fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2243fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58646/0 (socket says 172.21.15.41:58646) 2021-10-21T00:03:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2243fff700 1 -- 172.21.15.41:0/3219945322 learned_addr learned my addr 172.21.15.41:0/3219945322 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 0x7f224c14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224b7fe700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c0aebb0 0x7f224c10e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 -- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c0aebb0 msgr2=0x7f224c10e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c0aebb0 0x7f224c10e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 -- 172.21.15.41:0/3219945322 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 msgr2=0x7f224c10ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 -- 172.21.15.41:0/3219945322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244009470 con 0x7f224c1448e0 2021-10-21T00:03:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f2243fff700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f224bfff700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 0x7f224c14fdf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f224400c000 tx=0x7f22440091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.871+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224400c610 con 0x7f224c1448e0 2021-10-21T00:03:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400c770 con 0x7f224c1448e0 2021-10-21T00:03:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223400b180 con 0x7f224c1448e0 2021-10-21T00:03:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224400cad0 con 0x7f224c1448e0 2021-10-21T00:03:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c13e5c0 con 0x7f224c1448e0 2021-10-21T00:03:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c13dff0 con 0x7f224c1448e0 2021-10-21T00:03:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2244022070 con 0x7f224c1448e0 2021-10-21T00:03:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f22497fa700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 0x7f2230055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f224406bf10 con 0x7f224c1448e0 2021-10-21T00:03:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.875+0000 7f224b7fe700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 0x7f2230055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.879+0000 7f224b7fe700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 0x7f2230055b90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f223c00d000 tx=0x7f223c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:23.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:23.887+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2244043070 con 0x7f224c1448e0 2021-10-21T00:03:24.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.015+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f224c067810 con 0x7f224c1448e0 2021-10-21T00:03:24.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.015+0000 7f22497fa700 1 -- 172.21.15.41:0/3219945322 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22440160a0 con 0x7f224c1448e0 2021-10-21T00:03:24.022 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:24.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 msgr2=0x7f2230055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 0x7f2230055b90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f223c00d000 tx=0x7f223c009040).stop 2021-10-21T00:03:24.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 msgr2=0x7f224c14fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 0x7f224c14fdf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f224400c000 tx=0x7f22440091d0).stop 2021-10-21T00:03:24.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 shutdown_connections 2021-10-21T00:03:24.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f22300536d0 0x7f2230055b90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f224c1448e0 0x7f224c14fdf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f224c0b5f70 0x7f224c10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 --2- 172.21.15.41:0/3219945322 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f224c0aebb0 0x7f224c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 >> 172.21.15.41:0/3219945322 conn(0x7f224c0639f0 msgr2=0x7f224c13b890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 shutdown_connections 2021-10-21T00:03:24.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.019+0000 7f2250907700 1 -- 172.21.15.41:0/3219945322 wait complete. 2021-10-21T00:03:24.042 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:24.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 Processor -- start 2021-10-21T00:03:24.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 -- start start 2021-10-21T00:03:24.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec200b1d10 0x7fec200b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec200ad280 0x7fec20142c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200afb40 con 0x7fec200b5e90 2021-10-21T00:03:24.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b0e00 con 0x7fec200b1d10 2021-10-21T00:03:24.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec25ad3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b1ab0 con 0x7fec200ad280 2021-10-21T00:03:24.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec200b1d10 0x7fec200b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec24ad1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fec200b5e90 0x7fec200b13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36246/0 (socket says 172.21.15.41:36246) 2021-10-21T00:03:24.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec24ad1700 1 -- 172.21.15.41:0/3396335239 learned_addr learned my addr 172.21.15.41:0/3396335239 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:24.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec252d2700 1 --2- 172.21.15.41:0/3396335239 >> v2:172.21.15.62:3300/0 conn(0x7fec200ad280 0x7fec20142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1f7fe700 1 -- 172.21.15.41:0/3396335239 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833659081 0 0) 0x7fec200afb40 con 0x7fec200b5e90 2021-10-21T00:03:24.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 -- 172.21.15.41:0/3396335239 >> v2:172.21.15.62:3300/0 conn(0x7fec200ad280 msgr2=0x7fec20142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:24.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 --2- 172.21.15.41:0/3396335239 >> v2:172.21.15.62:3300/0 conn(0x7fec200ad280 0x7fec20142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 -- 172.21.15.41:0/3396335239 >> v1:172.21.15.62:6789/0 conn(0x7fec200b5e90 legacy=0x7fec200b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 -- 172.21.15.41:0/3396335239 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200af7a0 con 0x7fec200b1d10 2021-10-21T00:03:24.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.143+0000 7fec1ffff700 1 --2- 172.21.15.41:0/3396335239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b1d10 0x7fec200b6270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fec180032f0 tx=0x7fec180091d0).ready entity=mon.0 client_cookie=aa7ec0802529ee5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec1f7fe700 1 -- 172.21.15.41:0/3396335239 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800b680 con 0x7fec200b1d10 2021-10-21T00:03:24.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec1f7fe700 1 -- 172.21.15.41:0/3396335239 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1800b7e0 con 0x7fec200b1d10 2021-10-21T00:03:24.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec1f7fe700 1 -- 172.21.15.41:0/3396335239 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800b950 con 0x7fec200b1d10 2021-10-21T00:03:24.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- 172.21.15.41:0/3396335239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b1d10 msgr2=0x7fec200b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3396335239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b1d10 0x7fec200b6270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fec180032f0 tx=0x7fec180091d0).stop 2021-10-21T00:03:24.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- 172.21.15.41:0/3396335239 shutdown_connections 2021-10-21T00:03:24.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3396335239 >> v2:172.21.15.62:3300/0 conn(0x7fec200ad280 0x7fec20142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3396335239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b1d10 0x7fec200b6270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- 172.21.15.41:0/3396335239 >> 172.21.15.41:0/3396335239 conn(0x7fec20063b80 msgr2=0x7fec200b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- 172.21.15.41:0/3396335239 shutdown_connections 2021-10-21T00:03:24.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- 172.21.15.41:0/3396335239 wait complete. 2021-10-21T00:03:24.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 Processor -- start 2021-10-21T00:03:24.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.147+0000 7fec25ad3700 1 -- start start 2021-10-21T00:03:24.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec200ad280 0x7fec200b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 0x7fec201525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20113940 con 0x7fec200b5e90 2021-10-21T00:03:24.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20113120 con 0x7fec200b1d10 2021-10-21T00:03:24.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec20066b80 con 0x7fec200ad280 2021-10-21T00:03:24.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 0x7fec201525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec24ad1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec200ad280 0x7fec200b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58662/0 (socket says 172.21.15.41:58662) 2021-10-21T00:03:24.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 0x7fec201525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42346/0 (socket says 172.21.15.41:42346) 2021-10-21T00:03:24.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 -- 172.21.15.41:0/3273879392 learned_addr learned my addr 172.21.15.41:0/3273879392 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:24.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 -- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec200ad280 msgr2=0x7fec200b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec200ad280 0x7fec200b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 -- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 msgr2=0x7fec201525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 0x7fec201525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 -- 172.21.15.41:0/3273879392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18009470 con 0x7fec200b5e90 2021-10-21T00:03:24.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec252d2700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fec2006a320 tx=0x7fec10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec10010780 con 0x7fec200b5e90 2021-10-21T00:03:24.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec100108e0 con 0x7fec200b5e90 2021-10-21T00:03:24.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec20113350 con 0x7fec200b5e90 2021-10-21T00:03:24.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec10010c40 con 0x7fec200b5e90 2021-10-21T00:03:24.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.151+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2006a020 con 0x7fec200b5e90 2021-10-21T00:03:24.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200654e0 con 0x7fec200b5e90 2021-10-21T00:03:24.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec1001c460 con 0x7fec200b5e90 2021-10-21T00:03:24.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec1dffb700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 0x7febf8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec1006bc30 con 0x7fec200b5e90 2021-10-21T00:03:24.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec24ad1700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 0x7febf8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.155+0000 7fec24ad1700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 0x7febf8055b00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fec0800d000 tx=0x7fec08007c20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.159+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec10042c90 con 0x7fec200b5e90 2021-10-21T00:03:24.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.287+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec201428f0 con 0x7fec200b5e90 2021-10-21T00:03:24.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.287+0000 7fec1dffb700 1 -- 172.21.15.41:0/3273879392 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fec100462b0 con 0x7fec200b5e90 2021-10-21T00:03:24.296 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:24.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 msgr2=0x7febf8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 0x7febf8055b00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fec0800d000 tx=0x7fec08007c20).stop 2021-10-21T00:03:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 msgr2=0x7fec201145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fec2006a320 tx=0x7fec10006df0).stop 2021-10-21T00:03:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 shutdown_connections 2021-10-21T00:03:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053640 0x7febf8055b00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec200b5e90 0x7fec201145a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec200b1d10 0x7fec201525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 --2- 172.21.15.41:0/3273879392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec200ad280 0x7fec200b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 >> 172.21.15.41:0/3273879392 conn(0x7fec20063b80 msgr2=0x7fec200b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 shutdown_connections 2021-10-21T00:03:24.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.291+0000 7fec25ad3700 1 -- 172.21.15.41:0/3273879392 wait complete. 2021-10-21T00:03:24.314 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:24.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.419+0000 7f2a5adc2700 1 Processor -- start 2021-10-21T00:03:24.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.419+0000 7f2a5adc2700 1 -- start start 2021-10-21T00:03:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5adc2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 0x7f2a541443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5adc2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2a541448e0 0x7f2a5413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5adc2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540b6350 con 0x7f2a540b5f70 2021-10-21T00:03:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5adc2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540b13b0 con 0x7f2a541448e0 2021-10-21T00:03:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5adc2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5405c830 con 0x7f2a540aebb0 2021-10-21T00:03:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a59dc0700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2a540b5f70 0x7f2a54143ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56436/0 (socket says 172.21.15.41:56436) 2021-10-21T00:03:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a59dc0700 1 -- 172.21.15.41:0/2329306310 learned_addr learned my addr 172.21.15.41:0/2329306310 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 --2- 172.21.15.41:0/2329306310 >> v2:172.21.15.62:3300/0 conn(0x7f2a541448e0 0x7f2a5413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a595bf700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 0x7f2a541443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a58dbe700 1 -- 172.21.15.41:0/2329306310 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873383788 0 0) 0x7f2a540b6350 con 0x7f2a540b5f70 2021-10-21T00:03:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a58dbe700 1 -- 172.21.15.41:0/2329306310 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c003260 con 0x7f2a540b5f70 2021-10-21T00:03:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 -- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 msgr2=0x7f2a541443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 0x7f2a541443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 -- 172.21.15.41:0/2329306310 >> v1:172.21.15.41:6789/0 conn(0x7f2a540b5f70 legacy=0x7f2a54143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 -- 172.21.15.41:0/2329306310 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5405cad0 con 0x7f2a541448e0 2021-10-21T00:03:24.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a595bf700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 0x7f2a541443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:24.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a5a5c1700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a541448e0 0x7f2a5413f6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2a4c0032f0 tx=0x7f2a4c0091d0).ready entity=mon.1 client_cookie=241d72f7025848be server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a58dbe700 1 -- 172.21.15.41:0/2329306310 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a4c00b600 con 0x7f2a541448e0 2021-10-21T00:03:24.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a58dbe700 1 -- 172.21.15.41:0/2329306310 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00b760 con 0x7f2a541448e0 2021-10-21T00:03:24.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.423+0000 7f2a58dbe700 1 -- 172.21.15.41:0/2329306310 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a4c00b8d0 con 0x7f2a541448e0 2021-10-21T00:03:24.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a541448e0 msgr2=0x7f2a5413f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a541448e0 0x7f2a5413f6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2a4c0032f0 tx=0x7f2a4c0091d0).stop 2021-10-21T00:03:24.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2329306310 shutdown_connections 2021-10-21T00:03:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a541448e0 0x7f2a5413f6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2329306310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a540aebb0 0x7f2a541443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2329306310 >> 172.21.15.41:0/2329306310 conn(0x7f2a540639f0 msgr2=0x7f2a540b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2329306310 shutdown_connections 2021-10-21T00:03:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2329306310 wait complete. 2021-10-21T00:03:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 Processor -- start 2021-10-21T00:03:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.427+0000 7f2a5adc2700 1 -- start start 2021-10-21T00:03:24.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a540aebb0 0x7f2a54140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a541448e0 0x7f2a5413a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54150770 con 0x7f2a540b5f70 2021-10-21T00:03:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54150c40 con 0x7f2a540aebb0 2021-10-21T00:03:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541509a0 con 0x7f2a541448e0 2021-10-21T00:03:24.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58674/0 (socket says 172.21.15.41:58674) 2021-10-21T00:03:24.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 -- 172.21.15.41:0/2158208670 learned_addr learned my addr 172.21.15.41:0/2158208670 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:24.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a59dc0700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a540aebb0 0x7f2a54140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5a5c1700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a541448e0 0x7f2a5413a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 -- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a541448e0 msgr2=0x7f2a5413a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a541448e0 0x7f2a5413a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 -- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a540aebb0 msgr2=0x7f2a54140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a540aebb0 0x7f2a54140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 -- 172.21.15.41:0/2158208670 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4400b180 con 0x7f2a540b5f70 2021-10-21T00:03:24.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a595bf700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2a4400c000 tx=0x7f2a44006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a44010780 con 0x7f2a540b5f70 2021-10-21T00:03:24.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440108e0 con 0x7f2a540b5f70 2021-10-21T00:03:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c009470 con 0x7f2a540b5f70 2021-10-21T00:03:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a44010c40 con 0x7f2a540b5f70 2021-10-21T00:03:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.431+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a54066b20 con 0x7f2a540b5f70 2021-10-21T00:03:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5410ea80 con 0x7f2a540b5f70 2021-10-21T00:03:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a4401c460 con 0x7f2a540b5f70 2021-10-21T00:03:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a42ffd700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 0x7f2a34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a4406bfd0 con 0x7f2a540b5f70 2021-10-21T00:03:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a59dc0700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 0x7f2a34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.435+0000 7f2a59dc0700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 0x7f2a34055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2a5000d000 tx=0x7f2a50009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.439+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a5410ea80 con 0x7f2a540b5f70 2021-10-21T00:03:24.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.563+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a5410ea50 con 0x7f2a540b5f70 2021-10-21T00:03:24.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.563+0000 7f2a42ffd700 1 -- 172.21.15.41:0/2158208670 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2a44042f40 con 0x7f2a540b5f70 2021-10-21T00:03:24.573 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:24.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 msgr2=0x7f2a34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 0x7f2a34055ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2a5000d000 tx=0x7f2a50009040).stop 2021-10-21T00:03:24.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 msgr2=0x7f2a5413a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2a4400c000 tx=0x7f2a44006df0).stop 2021-10-21T00:03:24.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 shutdown_connections 2021-10-21T00:03:24.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a34053610 0x7f2a34055ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a541448e0 0x7f2a5413a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2a540b5f70 0x7f2a5413a0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 --2- 172.21.15.41:0/2158208670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a540aebb0 0x7f2a54140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 >> 172.21.15.41:0/2158208670 conn(0x7f2a540639f0 msgr2=0x7f2a5405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 shutdown_connections 2021-10-21T00:03:24.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.567+0000 7f2a5adc2700 1 -- 172.21.15.41:0/2158208670 wait complete. 2021-10-21T00:03:24.601 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-21T00:03:24.603 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-10-21T00:03:24.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 Processor -- start 2021-10-21T00:03:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- start start 2021-10-21T00:03:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 0x7f76e814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e80609d0 con 0x7f76e814b350 2021-10-21T00:03:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e805fdd0 con 0x7f76e805f9f0 2021-10-21T00:03:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80b1620 con 0x7f76e80aa750 2021-10-21T00:03:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eea33700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f76e814b350 0x7f76e80af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56454/0 (socket says 172.21.15.41:56454) 2021-10-21T00:03:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eea33700 1 -- 172.21.15.41:0/3411155899 learned_addr learned my addr 172.21.15.41:0/3411155899 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eda31700 1 --2- 172.21.15.41:0/3411155899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 0x7f76e814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76ed230700 1 -- 172.21.15.41:0/3411155899 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340452936 0 0) 0x7f76e80609d0 con 0x7f76e814b350 2021-10-21T00:03:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76ed230700 1 -- 172.21.15.41:0/3411155899 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d4003260 con 0x7f76e814b350 2021-10-21T00:03:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eda31700 1 -- 172.21.15.41:0/3411155899 >> v1:172.21.15.62:6789/0 conn(0x7f76e805f9f0 legacy=0x7f76e814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eda31700 1 -- 172.21.15.41:0/3411155899 >> v1:172.21.15.41:6789/0 conn(0x7f76e814b350 legacy=0x7f76e80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eda31700 1 -- 172.21.15.41:0/3411155899 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80b1380 con 0x7f76e80aa750 2021-10-21T00:03:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76eda31700 1 --2- 172.21.15.41:0/3411155899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 0x7f76e814ae60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f76e00032f0 tx=0x7f76e00091d0).ready entity=mon.2 client_cookie=7a88b2b85ef9d8c4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76ed230700 1 -- 172.21.15.41:0/3411155899 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e000b6c0 con 0x7f76e80aa750 2021-10-21T00:03:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76ed230700 1 -- 172.21.15.41:0/3411155899 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e000b820 con 0x7f76e80aa750 2021-10-21T00:03:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76ed230700 1 -- 172.21.15.41:0/3411155899 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e000b990 con 0x7f76e80aa750 2021-10-21T00:03:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- 172.21.15.41:0/3411155899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 msgr2=0x7f76e814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 --2- 172.21.15.41:0/3411155899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 0x7f76e814ae60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f76e00032f0 tx=0x7f76e00091d0).stop 2021-10-21T00:03:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- 172.21.15.41:0/3411155899 shutdown_connections 2021-10-21T00:03:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 --2- 172.21.15.41:0/3411155899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e80aa750 0x7f76e814ae60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- 172.21.15.41:0/3411155899 >> 172.21.15.41:0/3411155899 conn(0x7f76e805bca0 msgr2=0x7f76e805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- 172.21.15.41:0/3411155899 shutdown_connections 2021-10-21T00:03:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.699+0000 7f76f0496700 1 -- 172.21.15.41:0/3411155899 wait complete. 2021-10-21T00:03:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 Processor -- start 2021-10-21T00:03:24.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 -- start start 2021-10-21T00:03:24.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76e805f9f0 0x7f76e8062690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e814b350 0x7f76e80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81469d0 con 0x7f76e805f9f0 2021-10-21T00:03:24.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80ac260 con 0x7f76e80aa750 2021-10-21T00:03:24.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76f0496700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80ac490 con 0x7f76e814b350 2021-10-21T00:03:24.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76ee232700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76e805f9f0 0x7f76e8062690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eda31700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eda31700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42374/0 (socket says 172.21.15.41:42374) 2021-10-21T00:03:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eda31700 1 -- 172.21.15.41:0/2790113157 learned_addr learned my addr 172.21.15.41:0/2790113157 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eea33700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e814b350 0x7f76e80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eda31700 1 -- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e814b350 msgr2=0x7f76e80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.703+0000 7f76eda31700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e814b350 0x7f76e80acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76eda31700 1 -- 172.21.15.41:0/2790113157 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76e805f9f0 msgr2=0x7f76e8062690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76eda31700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76e805f9f0 0x7f76e8062690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76eda31700 1 -- 172.21.15.41:0/2790113157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0009470 con 0x7f76e80aa750 2021-10-21T00:03:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76eda31700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f76e8146b10 tx=0x7f76e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e000b6c0 con 0x7f76e80aa750 2021-10-21T00:03:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0021630 con 0x7f76e80aa750 2021-10-21T00:03:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e80acae0 con 0x7f76e80aa750 2021-10-21T00:03:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e0021990 con 0x7f76e80aa750 2021-10-21T00:03:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e8062d20 con 0x7f76e80aa750 2021-10-21T00:03:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80678f0 con 0x7f76e80aa750 2021-10-21T00:03:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f76e0028070 con 0x7f76e80aa750 2021-10-21T00:03:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 0x7f76c8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76e006ca90 con 0x7f76e80aa750 2021-10-21T00:03:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.707+0000 7f76ee232700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 0x7f76c8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.711+0000 7f76ee232700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 0x7f76c8055a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f76dc00d000 tx=0x7f76dc000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.715+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76e0043ae0 con 0x7f76e80aa750 2021-10-21T00:03:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:24.883+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f76e8057350 con 0x7f76e80aa750 2021-10-21T00:03:25.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.223+0000 7f76e77fe700 1 -- 172.21.15.41:0/2790113157 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v42) v1 ==== 142+0+0 (secure 0 0 0) 0x7f76e0015030 con 0x7f76e80aa750 2021-10-21T00:03:25.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 msgr2=0x7f76c8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 0x7f76c8055a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f76dc00d000 tx=0x7f76dc000bc0).stop 2021-10-21T00:03:25.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 msgr2=0x7f76e8145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f76e8146b10 tx=0x7f76e0016000).stop 2021-10-21T00:03:25.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 shutdown_connections 2021-10-21T00:03:25.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76c8053580 0x7f76c8055a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76e814b350 0x7f76e80acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76e80aa750 0x7f76e8145480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 --2- 172.21.15.41:0/2790113157 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76e805f9f0 0x7f76e8062690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 >> 172.21.15.41:0/2790113157 conn(0x7f76e805bca0 msgr2=0x7f76e814c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:25.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 shutdown_connections 2021-10-21T00:03:25.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.227+0000 7f76f0496700 1 -- 172.21.15.41:0/2790113157 wait complete. 2021-10-21T00:03:25.249 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:03:25.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 Processor -- start 2021-10-21T00:03:25.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 -- start start 2021-10-21T00:03:25.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9d0060c60 0x7fe9d005cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9d0142b80 0x7fe9d013f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d0061040 con 0x7fe9d0065190 2021-10-21T00:03:25.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00ac5f0 con 0x7fe9d0142b80 2021-10-21T00:03:25.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9d4e3e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00656a0 con 0x7fe9d0060c60 2021-10-21T00:03:25.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9d0142b80 0x7fe9d013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9cdd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe9d0065190 0x7fe9d0142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56466/0 (socket says 172.21.15.41:56466) 2021-10-21T00:03:25.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9cdd9b700 1 -- 172.21.15.41:0/1301821314 learned_addr learned my addr 172.21.15.41:0/1301821314 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:25.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ce59c700 1 --2- 172.21.15.41:0/1301821314 >> v2:172.21.15.62:3300/0 conn(0x7fe9d0060c60 0x7fe9d005cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 -- 172.21.15.41:0/1301821314 >> v2:172.21.15.62:3300/0 conn(0x7fe9d0060c60 msgr2=0x7fe9d005cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:25.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 --2- 172.21.15.41:0/1301821314 >> v2:172.21.15.62:3300/0 conn(0x7fe9d0060c60 0x7fe9d005cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 -- 172.21.15.41:0/1301821314 >> v1:172.21.15.41:6789/0 conn(0x7fe9d0065190 legacy=0x7fe9d0142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 -- 172.21.15.41:0/1301821314 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0065940 con 0x7fe9d0142b80 2021-10-21T00:03:25.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9ced9d700 1 --2- 172.21.15.41:0/1301821314 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0142b80 0x7fe9d013f220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c80091d0).ready entity=mon.0 client_cookie=552fc99093f6933f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:25.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9cd59a700 1 -- 172.21.15.41:0/1301821314 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c800b870 con 0x7fe9d0142b80 2021-10-21T00:03:25.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9cd59a700 1 -- 172.21.15.41:0/1301821314 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c800b9d0 con 0x7fe9d0142b80 2021-10-21T00:03:25.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.355+0000 7fe9cd59a700 1 -- 172.21.15.41:0/1301821314 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c800bd30 con 0x7fe9d0142b80 2021-10-21T00:03:25.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1301821314 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0142b80 msgr2=0x7fe9d013f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1301821314 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0142b80 0x7fe9d013f220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c80091d0).stop 2021-10-21T00:03:25.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1301821314 shutdown_connections 2021-10-21T00:03:25.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1301821314 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0142b80 0x7fe9d013f220 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1301821314 >> v2:172.21.15.62:3300/0 conn(0x7fe9d0060c60 0x7fe9d005cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1301821314 >> 172.21.15.41:0/1301821314 conn(0x7fe9d0063b70 msgr2=0x7fe9d0060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:25.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1301821314 shutdown_connections 2021-10-21T00:03:25.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1301821314 wait complete. 2021-10-21T00:03:25.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 Processor -- start 2021-10-21T00:03:25.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.359+0000 7fe9d4e3e700 1 -- start start 2021-10-21T00:03:25.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 0x7fe9d0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 0x7fe9d014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0142960 con 0x7fe9d0060c60 2021-10-21T00:03:25.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d013c100 con 0x7fe9d0142b80 2021-10-21T00:03:25.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d013c3a0 con 0x7fe9d0065190 2021-10-21T00:03:25.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58700/0 (socket says 172.21.15.41:58700) 2021-10-21T00:03:25.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 -- 172.21.15.41:0/1823811268 learned_addr learned my addr 172.21.15.41:0/1823811268 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:25.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ced9d700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 0x7fe9d014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9cdd9b700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 0x7fe9d0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 -- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 msgr2=0x7fe9d0141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 0x7fe9d0141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 -- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 msgr2=0x7fe9d014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 0x7fe9d014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 -- 172.21.15.41:0/1823811268 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009470 con 0x7fe9d0060c60 2021-10-21T00:03:25.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9cdd9b700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 0x7fe9d0141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:25.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ced9d700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 0x7fe9d014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:25.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9ce59c700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe9c400c000 tx=0x7fe9c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:25.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4010780 con 0x7fe9d0060c60 2021-10-21T00:03:25.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c40108e0 con 0x7fe9d0060c60 2021-10-21T00:03:25.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d013c640 con 0x7fe9d0060c60 2021-10-21T00:03:25.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4010c40 con 0x7fe9d0060c60 2021-10-21T00:03:25.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d013d550 con 0x7fe9d0060c60 2021-10-21T00:03:25.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.363+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d013c7d0 con 0x7fe9d0060c60 2021-10-21T00:03:25.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.367+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9c401c460 con 0x7fe9d0060c60 2021-10-21T00:03:25.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.367+0000 7fe9bf7fe700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 0x7fe9ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:25.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.367+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9c406bd70 con 0x7fe9d0060c60 2021-10-21T00:03:25.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.367+0000 7fe9cdd9b700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 0x7fe9ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:25.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.367+0000 7fe9cdd9b700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 0x7fe9ac055ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe9c000d000 tx=0x7fe9c0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:25.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.375+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9c4042dd0 con 0x7fe9d0060c60 2021-10-21T00:03:25.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.507+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe9d0065be0 con 0x7fe9d0060c60 2021-10-21T00:03:25.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9bf7fe700 1 -- 172.21.15.41:0/1823811268 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe9c40463f0 con 0x7fe9d0060c60 2021-10-21T00:03:25.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 msgr2=0x7fe9ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 0x7fe9ac055ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe9c000d000 tx=0x7fe9c0009040).stop 2021-10-21T00:03:25.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 msgr2=0x7fe9d00af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:25.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe9c400c000 tx=0x7fe9c4006df0).stop 2021-10-21T00:03:25.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 shutdown_connections 2021-10-21T00:03:25.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9ac053610 0x7fe9ac055ad0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9d0142b80 0x7fe9d014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9d0065190 0x7fe9d0141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 --2- 172.21.15.41:0/1823811268 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9d0060c60 0x7fe9d00af550 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:25.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 >> 172.21.15.41:0/1823811268 conn(0x7fe9d0063b70 msgr2=0x7fe9d013f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:25.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 shutdown_connections 2021-10-21T00:03:25.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:25.515+0000 7fe9d4e3e700 1 -- 172.21.15.41:0/1823811268 wait complete. 2021-10-21T00:03:25.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:03:25.539 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:03:25.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:03:25.581 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:03:25.603 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:03:25.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:03:25.646 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:03:25.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.647 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.648 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.656 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:03:25.657 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:25.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.658 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.658 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.666 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:03:25.667 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:25.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.668 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.668 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.675 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-21T00:03:25.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:03:25.676 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:25.677 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:03:25.677 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:03:25.678 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.702 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.702 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.752 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:03:25.753 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:03:25.753 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:03:25.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:03:25.754 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:25.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.772 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.773 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.781 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:03:25.782 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:03:25.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.783 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.783 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.832 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:03:25.833 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:03:25.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.835 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.835 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.842 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-10-21T00:03:25.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:03:25.844 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-10-21T00:03:25.845 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:03:25.845 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:03:25.845 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.883 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.883 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.931 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:03:25.932 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:03:25.933 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:03:25.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:03:25.935 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:03:25.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.952 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.953 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:25.961 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-10-21T00:03:25.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-10-21T00:03:25.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:25.964 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:25.964 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:26.017 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-10-21T00:03:26.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-10-21T00:03:26.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:26.018 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:26.019 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:26.026 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-10-21T00:03:26.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:03:26.027 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-10-21T00:03:26.028 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-10-21T00:03:26.028 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:03:26.029 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:26.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:26.100 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:26.100 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:26.107 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-10-21T00:03:26.108 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:03:26.109 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:03:26.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:03:26.110 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:03:26.137 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:03:26.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.243+0000 7efc926ea700 1 Processor -- start 2021-10-21T00:03:26.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.243+0000 7efc926ea700 1 -- start start 2021-10-21T00:03:26.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 0x7efc8c05f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c0b4760 con 0x7efc8c0b4380 2021-10-21T00:03:26.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c062e50 con 0x7efc8c05fe30 2021-10-21T00:03:26.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0b1b40 con 0x7efc8c147950 2021-10-21T00:03:26.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc916e8700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7efc8c0b4380 0x7efc8c1464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56480/0 (socket says 172.21.15.41:56480) 2021-10-21T00:03:26.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc916e8700 1 -- 172.21.15.41:0/702746006 learned_addr learned my addr 172.21.15.41:0/702746006 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:26.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc90ee7700 1 --2- 172.21.15.41:0/702746006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 0x7efc8c05f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc8bfff700 1 -- 172.21.15.41:0/702746006 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133327771 0 0) 0x7efc8c0b4760 con 0x7efc8c0b4380 2021-10-21T00:03:26.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc8bfff700 1 -- 172.21.15.41:0/702746006 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc78003260 con 0x7efc8c0b4380 2021-10-21T00:03:26.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc90ee7700 1 -- 172.21.15.41:0/702746006 >> v1:172.21.15.62:6789/0 conn(0x7efc8c05fe30 legacy=0x7efc8c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc90ee7700 1 -- 172.21.15.41:0/702746006 >> v1:172.21.15.41:6789/0 conn(0x7efc8c0b4380 legacy=0x7efc8c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc90ee7700 1 -- 172.21.15.41:0/702746006 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0630f0 con 0x7efc8c147950 2021-10-21T00:03:26.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc90ee7700 1 --2- 172.21.15.41:0/702746006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 0x7efc8c05f940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efc800032f0 tx=0x7efc800091d0).ready entity=mon.2 client_cookie=8d83fe81f3667448 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc8bfff700 1 -- 172.21.15.41:0/702746006 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8000b6c0 con 0x7efc8c147950 2021-10-21T00:03:26.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc8bfff700 1 -- 172.21.15.41:0/702746006 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8000b820 con 0x7efc8c147950 2021-10-21T00:03:26.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc8bfff700 1 -- 172.21.15.41:0/702746006 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8000b990 con 0x7efc8c147950 2021-10-21T00:03:26.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- 172.21.15.41:0/702746006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 msgr2=0x7efc8c05f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 --2- 172.21.15.41:0/702746006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 0x7efc8c05f940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efc800032f0 tx=0x7efc800091d0).stop 2021-10-21T00:03:26.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- 172.21.15.41:0/702746006 shutdown_connections 2021-10-21T00:03:26.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 --2- 172.21.15.41:0/702746006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c147950 0x7efc8c05f940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- 172.21.15.41:0/702746006 >> 172.21.15.41:0/702746006 conn(0x7efc8c0b7910 msgr2=0x7efc8c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:26.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- 172.21.15.41:0/702746006 shutdown_connections 2021-10-21T00:03:26.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- 172.21.15.41:0/702746006 wait complete. 2021-10-21T00:03:26.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 Processor -- start 2021-10-21T00:03:26.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.247+0000 7efc926ea700 1 -- start start 2021-10-21T00:03:26.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c05fe30 0x7efc8c066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc8c0b4380 0x7efc8c0ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0ae2d0 con 0x7efc8c147950 2021-10-21T00:03:26.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c149db0 con 0x7efc8c0b4380 2021-10-21T00:03:26.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c14afa0 con 0x7efc8c05fe30 2021-10-21T00:03:26.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc916e8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c05fe30 0x7efc8c066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58718/0 (socket says 172.21.15.41:58718) 2021-10-21T00:03:26.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 -- 172.21.15.41:0/2186324738 learned_addr learned my addr 172.21.15.41:0/2186324738 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:26.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc90ee7700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc8c0b4380 0x7efc8c0ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 -- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c05fe30 msgr2=0x7efc8c066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c05fe30 0x7efc8c066ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 -- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc8c0b4380 msgr2=0x7efc8c0ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc8c0b4380 0x7efc8c0ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 -- 172.21.15.41:0/2186324738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80009470 con 0x7efc8c147950 2021-10-21T00:03:26.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc91ee9700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efc8c05f820 tx=0x7efc84007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc84012400 con 0x7efc8c147950 2021-10-21T00:03:26.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84012560 con 0x7efc8c147950 2021-10-21T00:03:26.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c0aebf0 con 0x7efc8c147950 2021-10-21T00:03:26.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc840128c0 con 0x7efc8c147950 2021-10-21T00:03:26.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.251+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c099880 con 0x7efc8c147950 2021-10-21T00:03:26.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c0ae440 con 0x7efc8c147950 2021-10-21T00:03:26.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc84019030 con 0x7efc8c147950 2021-10-21T00:03:26.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc8a7fc700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 0x7efc6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc8406ac80 con 0x7efc8c147950 2021-10-21T00:03:26.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc916e8700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 0x7efc6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.255+0000 7efc916e8700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 0x7efc6c055a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc7c00d000 tx=0x7efc7c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.263+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc84041d40 con 0x7efc8c147950 2021-10-21T00:03:26.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.387+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efc8c063390 con 0x7efc8c147950 2021-10-21T00:03:26.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc8a7fc700 1 -- 172.21.15.41:0/2186324738 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v22) v1 ==== 81+0+33645 (secure 0 0 0) 0x7efc84045360 con 0x7efc8c147950 2021-10-21T00:03:26.400 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:26.400 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:03:26.400 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 22, 2021-10-21T00:03:26.400 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:03:26.401 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:03:26.401 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:02:58.793842+0000", 2021-10-21T00:03:26.401 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:03:26.401 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:03:26.401 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:03:26.402 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:03:26.402 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:03:26.402 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:03:26.402 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:03:26.403 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:03:26.403 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:03:26.404 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:03:26.404 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:03:26.405 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:03:26.405 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:03:26.405 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:03:26.405 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:03:26.405 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 4, 2021-10-21T00:03:26.406 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:03:26.406 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:03:26.406 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:03:26.406 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:03:26.407 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:03:26.407 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.407 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:03:26.408 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:03:26.408 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:03:26.408 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:03:26.408 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:03:26.408 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:03:26.409 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:03:26.409 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:03:26.409 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:03:26.410 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:03:26.410 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:03:26.410 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:03:26.410 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:03:26.410 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:03:26.411 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:03:26.411 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:03:26.411 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:03:26.411 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:03:26.412 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:03:26.412 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:03:26.412 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:03:26.412 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:03:26.412 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:03:26.413 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:03:26.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:03:26.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:03:26.414 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:03:26.414 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:03:26.414 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:03:26.414 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:03:26.414 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:03:26.415 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:03:26.415 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:03:26.415 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:03:26.415 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:03:26.416 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:03:26.416 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:03:26.416 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:03:26.416 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:03:26.416 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:03:26.417 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:03:26.417 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:03:26.417 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:03:26.417 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:03:26.418 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:03:26.418 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:03:26.418 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:03:26.418 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:03:26.419 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:03:26.419 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:03:26.419 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.419 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:03:26.420 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:03:26.420 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:03:26.420 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:03:26.420 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:03:26.420 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:03:26.421 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:03:26.421 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:03:26.421 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:03:26.421 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:03:26.422 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:03:26.422 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:03:26.422 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:03:26.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.422 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:03:26.423 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:03:26.423 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.423 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.423 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.424 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:03:26.424 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:03:26.424 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:03:26.424 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:03:26.424 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:03:26.425 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:03:26.425 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:03:26.425 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:03:26.425 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:03:26.426 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:03:26.426 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:03:26.426 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:03:26.426 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:03:26.426 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:03:26.427 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:03:26.427 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:03:26.427 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:03:26.427 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:03:26.428 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:03:26.428 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:03:26.428 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:03:26.428 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:03:26.428 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:03:26.429 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.429 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:03:26.429 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:03:26.429 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:03:26.429 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:03:26.430 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:03:26.430 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:03:26.430 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:03:26.430 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:03:26.431 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:03:26.431 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:03:26.431 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:03:26.432 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:03:26.432 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:03:26.432 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:03:26.433 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:03:26.433 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:03:26.433 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:03:26.433 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:03:26.434 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:03:26.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:03:26.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:03:26.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:03:26.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:03:26.435 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:03:26.435 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:03:26.435 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:03:26.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:03:26.436 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.436 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:03:26.436 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:03:26.436 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:03:26.436 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:03:26.437 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:03:26.437 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:03:26.437 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:03:26.437 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:03:26.437 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:03:26.438 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:03:26.438 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:03:26.438 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:03:26.438 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:03:26.439 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:03:26.439 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.439 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.439 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 3, 2021-10-21T00:03:26.440 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:03:26.440 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:55.845340+0000", 2021-10-21T00:03:26.440 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:03:26.440 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:03:26.441 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:03:26.441 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:03:26.441 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:03:26.441 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:03:26.441 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:03:26.442 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:03:26.442 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:03:26.442 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:03:26.442 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:03:26.443 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:03:26.443 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:03:26.443 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:03:26.443 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:03:26.443 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:03:26.444 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:03:26.444 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:03:26.444 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:03:26.444 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:03:26.445 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.445 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "21", 2021-10-21T00:03:26.445 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:03:26.445 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:03:26.445 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:03:26.446 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:03:26.446 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:03:26.446 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:03:26.446 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:03:26.447 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:03:26.447 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:03:26.447 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:03:26.447 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:03:26.447 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:03:26.448 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:03:26.449 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:03:26.449 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:03:26.450 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:03:26.450 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:03:26.451 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:03:26.451 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:03:26.451 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:03:26.451 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:03:26.451 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:03:26.452 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:03:26.452 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:03:26.452 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:03:26.452 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:03:26.453 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.453 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:03:26.453 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:03:26.453 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:03:26.453 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:03:26.454 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:03:26.454 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:03:26.454 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:03:26.454 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:03:26.455 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:03:26.455 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:03:26.455 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:03:26.455 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:03:26.455 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:03:26.456 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:03:26.456 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:03:26.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.456 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:03:26.457 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:03:26.457 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:03:26.457 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.457 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.458 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.458 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 4, 2021-10-21T00:03:26.458 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:03:26.458 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:56.789866+0000", 2021-10-21T00:03:26.459 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:03:26.459 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:03:26.459 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:03:26.459 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:03:26.460 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:03:26.460 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:03:26.460 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:03:26.460 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:03:26.460 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:03:26.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:03:26.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:03:26.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:03:26.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:03:26.462 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:03:26.462 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:03:26.462 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:03:26.462 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:03:26.462 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:03:26.463 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:03:26.463 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:03:26.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.463 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "22", 2021-10-21T00:03:26.463 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:03:26.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:03:26.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:03:26.464 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:03:26.464 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:03:26.465 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:03:26.465 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:03:26.465 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:03:26.465 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:03:26.465 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:03:26.466 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:03:26.466 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:03:26.466 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:03:26.466 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:03:26.466 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:03:26.467 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:03:26.467 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:03:26.467 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:03:26.467 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:03:26.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:03:26.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:03:26.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:03:26.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:03:26.468 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:03:26.469 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:03:26.469 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:03:26.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.469 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:03:26.469 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:03:26.470 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:03:26.470 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:03:26.470 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:03:26.470 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:03:26.471 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:03:26.471 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:03:26.471 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:03:26.471 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:03:26.471 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:03:26.472 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:03:26.472 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:03:26.472 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:03:26.472 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:03:26.472 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.473 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:03:26.473 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:03:26.474 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.474 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:03:26.474 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:03:26.474 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.474 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.475 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.475 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.475 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.475 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.476 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.476 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 20, 2021-10-21T00:03:26.476 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.476 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.476 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.477 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.477 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.477 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.477 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:03:26.477 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.478 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.478 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.478 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:03:26.479 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.479 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.479 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.479 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.479 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.480 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.480 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.480 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.480 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:03:26.480 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.481 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.481 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.481 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.481 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:03:26.482 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.482 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.482 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.482 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.482 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.483 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.483 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.483 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.483 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:03:26.484 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.485 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.485 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.485 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.485 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:03:26.485 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.486 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.486 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.486 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.487 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.487 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.487 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.487 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:03:26.487 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.488 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.488 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.488 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.489 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:03:26.489 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:03:26.489 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.489 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.489 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.490 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:03:26.490 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:03:26.490 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:03:26.491 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:03:26.491 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.491 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.491 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.491 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.492 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.492 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.492 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:03:26.492 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:03:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.494 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.494 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.494 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 20, 2021-10-21T00:03:26.494 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.494 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.495 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.495 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.495 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.495 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.496 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:03:26.496 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.496 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.496 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.497 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.497 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:03:26.497 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.497 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.498 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.498 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.498 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.498 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.499 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.499 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.499 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:03:26.499 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.499 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.500 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.500 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.500 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:03:26.500 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.501 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.501 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.501 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.501 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.501 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.502 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.502 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.502 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:03:26.502 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.503 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.503 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.503 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.503 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:03:26.503 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.504 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.504 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.504 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.504 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.505 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.505 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.505 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:03:26.505 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.506 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.506 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.506 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.506 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:03:26.506 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:03:26.507 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.507 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.507 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.507 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:03:26.507 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:03:26.508 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:03:26.508 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:03:26.508 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.508 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.509 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.509 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.509 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.509 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.509 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:03:26.510 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:03:26.510 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.510 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.510 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.510 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.511 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.511 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.511 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.511 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 16, 2021-10-21T00:03:26.511 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.512 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.512 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.512 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.512 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.513 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.513 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:03:26.513 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.513 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.514 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.514 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:03:26.514 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.514 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.515 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.515 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.515 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.515 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.516 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.516 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:03:26.516 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.516 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.516 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.517 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.517 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:03:26.517 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.517 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.518 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.518 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.518 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.518 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.518 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.519 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.519 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:03:26.519 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.519 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.520 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.520 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:03:26.520 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.520 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.521 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.521 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.521 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.521 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.521 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.522 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.522 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:03:26.522 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.522 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.522 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.523 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.523 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:03:26.523 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:03:26.523 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.524 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.524 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.524 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:03:26.524 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:03:26.524 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:03:26.525 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:03:26.525 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.525 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.525 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.525 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.526 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.526 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:03:26.527 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:03:26.527 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.527 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.527 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.528 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.528 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.528 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.528 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.528 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 20, 2021-10-21T00:03:26.529 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.529 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.529 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.529 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.529 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.530 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.530 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:03:26.530 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.530 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.531 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.531 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.531 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:03:26.531 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.531 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.532 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.532 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.532 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.532 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.532 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.533 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.533 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:03:26.533 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.533 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.533 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.534 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.534 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:03:26.534 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.534 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.535 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.535 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.535 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.535 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.535 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.536 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.536 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:03:26.536 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.536 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.536 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.537 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.537 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:03:26.537 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.537 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.538 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.538 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.538 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.538 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.538 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.539 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.539 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:03:26.539 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.539 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.540 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.540 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.540 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:03:26.540 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:03:26.540 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.541 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.541 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.541 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:03:26.541 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:03:26.541 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:03:26.542 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:03:26.542 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.542 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.542 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.543 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.543 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.543 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.543 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:03:26.543 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:03:26.544 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.544 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.544 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.544 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.544 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.545 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.545 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.545 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 20, 2021-10-21T00:03:26.545 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.545 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.546 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.546 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.546 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.546 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.547 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:03:26.547 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.547 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.547 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.547 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.548 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:03:26.548 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.548 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.548 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.549 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.549 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.549 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.549 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.549 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.550 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:03:26.550 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.550 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.550 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.551 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.551 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:03:26.551 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.551 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.551 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.552 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.552 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.552 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.552 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.552 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.553 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:03:26.553 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.553 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.554 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.554 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.554 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:03:26.554 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.555 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.555 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.555 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.555 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.555 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.556 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.556 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.556 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:03:26.556 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.556 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.557 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.557 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.557 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:03:26.557 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:03:26.557 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.558 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.558 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.558 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:03:26.558 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:03:26.559 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:03:26.559 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:03:26.559 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.559 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.559 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.560 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.560 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.560 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.560 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:03:26.560 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:03:26.561 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.561 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.561 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.561 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.562 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.562 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.562 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.562 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 19, 2021-10-21T00:03:26.562 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.563 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.563 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.563 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.563 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.563 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.564 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:03:26.564 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.564 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.564 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.564 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.565 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:03:26.565 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.565 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.565 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.566 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.566 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.566 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.566 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.566 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.567 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:03:26.567 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.567 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.567 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.567 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.568 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:03:26.568 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.568 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.568 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.569 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.569 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.569 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.569 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.569 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.570 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:03:26.570 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.570 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.570 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.570 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.571 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:03:26.571 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.571 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.571 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.572 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.572 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.573 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.573 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.573 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.575 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:03:26.575 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.575 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.576 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.576 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.576 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:03:26.577 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:03:26.577 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.577 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.579 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.579 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:03:26.580 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:03:26.580 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:03:26.581 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:03:26.581 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.582 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.582 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.582 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.583 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.583 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.583 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:03:26.583 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:03:26.584 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.584 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.584 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.584 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.585 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.585 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.585 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.586 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 20, 2021-10-21T00:03:26.586 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.586 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.586 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.587 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.587 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.587 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.587 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:03:26.587 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.588 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.588 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.588 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.588 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:03:26.589 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.589 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.589 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.589 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.589 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.590 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.590 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.590 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.591 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:03:26.591 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.591 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.592 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.592 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.592 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:03:26.592 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.592 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.593 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.593 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.593 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.593 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.594 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.594 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.594 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:03:26.595 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.595 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.595 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.595 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.596 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:03:26.596 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.596 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.596 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.597 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.597 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.597 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.597 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.597 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.598 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:03:26.598 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.598 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.598 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.599 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.599 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:03:26.599 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:03:26.600 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.600 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.600 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.600 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:03:26.600 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:03:26.601 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:03:26.601 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:03:26.601 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.601 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.602 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.602 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.602 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.602 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.603 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:03:26.603 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:03:26.603 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:03:26.604 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:03:26.604 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:03:26.604 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:03:26.604 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:03:26.604 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:03:26.605 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:03:26.605 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 16, 2021-10-21T00:03:26.605 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:03:26.605 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:03:26.606 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:03:26.606 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.606 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.606 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.607 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:03:26.607 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.607 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.607 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.607 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.608 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:03:26.608 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.608 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.608 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.609 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.609 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:03:26.609 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.609 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.609 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.610 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:03:26.610 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.610 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.610 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.610 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.611 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:03:26.611 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.611 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.611 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.612 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.612 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:03:26.612 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.613 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.613 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.613 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:03:26.615 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.616 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.616 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.616 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.617 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:03:26.617 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.617 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.618 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.618 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.618 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:03:26.618 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:03:26.619 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.619 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:03:26.619 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:03:26.619 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.620 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.620 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.620 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:03:26.620 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:03:26.620 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:03:26.621 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.621 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.621 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.621 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:03:26.621 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:03:26.622 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:03:26.622 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:03:26.622 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:03:26.622 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:03:26.623 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:03:26.623 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:26.623 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.623 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:03:26.623 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:03:26.624 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.624 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:03:26.624 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.624 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.625 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.625 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.625 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.625 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:03:26.626 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.626 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.626 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.626 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:03:26.626 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.627 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.627 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.627 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.627 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.628 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:03:26.628 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.628 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.629 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.629 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:03:26.629 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.629 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.630 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.630 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.630 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.630 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:03:26.631 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.631 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.631 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.631 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:03:26.632 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.632 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.632 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.632 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.632 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.633 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:03:26.633 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.633 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.633 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.634 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:03:26.634 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.634 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.635 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.635 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.635 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.635 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:03:26.636 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.636 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.636 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.636 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:03:26.637 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.637 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.637 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.637 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.638 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.638 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:03:26.638 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.638 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.638 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.639 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:03:26.639 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.639 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.639 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.640 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.640 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.640 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:03:26.641 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.641 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.641 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:26.641 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:03:26.642 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:03:26.642 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:03:26.642 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:03:26.642 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:03:26.643 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:03:26.643 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:03:26.643 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:03:26.643 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.644 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:03:26.645 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:03:26.646 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:03:26.647 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:03:26.647 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:03:26.648 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:03:26.648 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:03:26.648 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:03:26.649 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:03:26.649 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:03:26.650 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:03:26.650 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:03:26.650 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:03:26.650 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:03:26.651 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:26.651 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:26.651 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:03:26.651 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:03:26.652 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:03:26.652 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:03:26.652 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:03:26.652 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:03:26.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 msgr2=0x7efc6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 0x7efc6c055a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efc7c00d000 tx=0x7efc7c009040).stop 2021-10-21T00:03:26.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 msgr2=0x7efc8c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7efc8c05f820 tx=0x7efc84007c50).stop 2021-10-21T00:03:26.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 shutdown_connections 2021-10-21T00:03:26.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc6c053580 0x7efc6c055a40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc8c147950 0x7efc8c0b00d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc8c0b4380 0x7efc8c0ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 --2- 172.21.15.41:0/2186324738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc8c05fe30 0x7efc8c066ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.391+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 >> 172.21.15.41:0/2186324738 conn(0x7efc8c0b7910 msgr2=0x7efc8c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:26.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.395+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 shutdown_connections 2021-10-21T00:03:26.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.395+0000 7efc926ea700 1 -- 172.21.15.41:0/2186324738 wait complete. 2021-10-21T00:03:26.661 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:26.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 Processor -- start 2021-10-21T00:03:26.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- start start 2021-10-21T00:03:26.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe09c05f9f0 0x7fe09c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0609d0 con 0x7fe09c14b130 2021-10-21T00:03:26.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b1620 con 0x7fe09c05f9f0 2021-10-21T00:03:26.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c05fdd0 con 0x7fe09c0aa750 2021-10-21T00:03:26.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe09c05f9f0 0x7fe09c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a2ae2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe09c14b130 0x7fe09c1495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56496/0 (socket says 172.21.15.41:56496) 2021-10-21T00:03:26.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a2ae2700 1 -- 172.21.15.41:0/2337799164 learned_addr learned my addr 172.21.15.41:0/2337799164 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:26.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a1ae0700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 -- 172.21.15.41:0/2337799164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 msgr2=0x7fe09c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:26.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 -- 172.21.15.41:0/2337799164 >> v1:172.21.15.41:6789/0 conn(0x7fe09c14b130 legacy=0x7fe09c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 -- 172.21.15.41:0/2337799164 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0b1380 con 0x7fe09c05f9f0 2021-10-21T00:03:26.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a12df700 1 -- 172.21.15.41:0/2337799164 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033818189 0 0) 0x7fe09c0609d0 con 0x7fe09c14b130 2021-10-21T00:03:26.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a22e1700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c05f9f0 0x7fe09c14a750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fe0980032f0 tx=0x7fe0980091d0).ready entity=mon.0 client_cookie=4f2aa44d34683d0f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a12df700 1 -- 172.21.15.41:0/2337799164 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09800b6c0 con 0x7fe09c05f9f0 2021-10-21T00:03:26.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a12df700 1 -- 172.21.15.41:0/2337799164 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800b820 con 0x7fe09c05f9f0 2021-10-21T00:03:26.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a12df700 1 -- 172.21.15.41:0/2337799164 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09800b990 con 0x7fe09c05f9f0 2021-10-21T00:03:26.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- 172.21.15.41:0/2337799164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c05f9f0 msgr2=0x7fe09c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c05f9f0 0x7fe09c14a750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fe0980032f0 tx=0x7fe0980091d0).stop 2021-10-21T00:03:26.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- 172.21.15.41:0/2337799164 shutdown_connections 2021-10-21T00:03:26.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 --2- 172.21.15.41:0/2337799164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c05f9f0 0x7fe09c14a750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- 172.21.15.41:0/2337799164 >> 172.21.15.41:0/2337799164 conn(0x7fe09c05bca0 msgr2=0x7fe09c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:26.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- 172.21.15.41:0/2337799164 shutdown_connections 2021-10-21T00:03:26.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.767+0000 7fe0a4545700 1 -- 172.21.15.41:0/2337799164 wait complete. 2021-10-21T00:03:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 Processor -- start 2021-10-21T00:03:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 -- start start 2021-10-21T00:03:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe09c05f9f0 0x7fe09c0ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c0ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c156e40 con 0x7fe09c14b130 2021-10-21T00:03:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1570e0 con 0x7fe09c05f9f0 2021-10-21T00:03:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.771+0000 7fe0a4545700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0ac7f0 con 0x7fe09c0aa750 2021-10-21T00:03:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a2ae2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a2ae2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58732/0 (socket says 172.21.15.41:58732) 2021-10-21T00:03:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a2ae2700 1 -- 172.21.15.41:0/589878030 learned_addr learned my addr 172.21.15.41:0/589878030 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:26.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c0ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a22e1700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe09c05f9f0 0x7fe09c0ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 -- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe09c05f9f0 msgr2=0x7fe09c0ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe09c05f9f0 0x7fe09c0ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 -- 172.21.15.41:0/589878030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 msgr2=0x7fe09c0ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 -- 172.21.15.41:0/589878030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009470 con 0x7fe09c0aa750 2021-10-21T00:03:26.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a2ae2700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:26.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a1ae0700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c0ade90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe08c00c000 tx=0x7fe08c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08c010780 con 0x7fe09c0aa750 2021-10-21T00:03:26.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0108e0 con 0x7fe09c0aa750 2021-10-21T00:03:26.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0ae870 con 0x7fe09c0aa750 2021-10-21T00:03:26.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08c010c40 con 0x7fe09c0aa750 2021-10-21T00:03:26.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c097fd0 con 0x7fe09c0aa750 2021-10-21T00:03:26.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c14b550 con 0x7fe09c0aa750 2021-10-21T00:03:26.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.775+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe08c01b400 con 0x7fe09c0aa750 2021-10-21T00:03:26.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.779+0000 7fe08b7fe700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 0x7fe07c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:26.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.779+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe08c06b930 con 0x7fe09c0aa750 2021-10-21T00:03:26.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.779+0000 7fe0a22e1700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 0x7fe07c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:26.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.779+0000 7fe0a22e1700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 0x7fe07c055b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe09801b000 tx=0x7fe098016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:26.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.787+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe08c042a30 con 0x7fe09c0aa750 2021-10-21T00:03:26.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.951+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe09c157250 con 0x7fe09c0aa750 2021-10-21T00:03:26.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe08b7fe700 1 -- 172.21.15.41:0/589878030 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2131 (secure 0 0 0) 0x7fe08c046050 con 0x7fe09c0aa750 2021-10-21T00:03:26.962 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:26.963 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:00.471696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3079329835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3079329835},{"type":"v1","addr":"172.21.15.41:6833","nonce":3079329835}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:26.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 msgr2=0x7fe07c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 0x7fe07c055b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe09801b000 tx=0x7fe098016000).stop 2021-10-21T00:03:26.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 msgr2=0x7fe09c0ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:26.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c0ade90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe08c00c000 tx=0x7fe08c006df0).stop 2021-10-21T00:03:26.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 shutdown_connections 2021-10-21T00:03:26.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe07c053640 0x7fe07c055b00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe09c14b130 0x7fe09c0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe09c0aa750 0x7fe09c0ade90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 --2- 172.21.15.41:0/589878030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe09c05f9f0 0x7fe09c0ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:26.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 >> 172.21.15.41:0/589878030 conn(0x7fe09c05bca0 msgr2=0x7fe09c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:26.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 shutdown_connections 2021-10-21T00:03:26.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:26.955+0000 7fe0a4545700 1 -- 172.21.15.41:0/589878030 wait complete. 2021-10-21T00:03:26.969 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 5 2021-10-21T00:03:26.974 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:03:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 Processor -- start 2021-10-21T00:03:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- start start 2021-10-21T00:03:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc640b4380 0x7efc6405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc640b1830 0x7efc6405fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc640b4760 con 0x7efc640601a0 2021-10-21T00:03:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640ad4c0 con 0x7efc640b1830 2021-10-21T00:03:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640ad760 con 0x7efc640b4380 2021-10-21T00:03:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc640b1830 0x7efc6405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc640b1830 0x7efc6405fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58736/0 (socket says 172.21.15.41:58736) 2021-10-21T00:03:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 -- 172.21.15.41:0/2331862505 learned_addr learned my addr 172.21.15.41:0/2331862505 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc637fe700 1 --2- 172.21.15.41:0/2331862505 >> v2:172.21.15.62:3300/0 conn(0x7efc640b4380 0x7efc6405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 -- 172.21.15.41:0/2331862505 >> v2:172.21.15.62:3300/0 conn(0x7efc640b4380 msgr2=0x7efc6405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 --2- 172.21.15.41:0/2331862505 >> v2:172.21.15.62:3300/0 conn(0x7efc640b4380 0x7efc6405f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 -- 172.21.15.41:0/2331862505 >> v1:172.21.15.62:6789/0 conn(0x7efc640601a0 legacy=0x7efc64143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 -- 172.21.15.41:0/2331862505 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640ada00 con 0x7efc640b1830 2021-10-21T00:03:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc62ffd700 1 --2- 172.21.15.41:0/2331862505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc6405fcb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7efc58002f70 tx=0x7efc58006eb0).ready entity=mon.0 client_cookie=91eb1df6fe4e6f9e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc627fc700 1 -- 172.21.15.41:0/2331862505 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5800d5c0 con 0x7efc640b1830 2021-10-21T00:03:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc627fc700 1 -- 172.21.15.41:0/2331862505 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58000e90 con 0x7efc640b1830 2021-10-21T00:03:27.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc627fc700 1 -- 172.21.15.41:0/2331862505 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5800d950 con 0x7efc640b1830 2021-10-21T00:03:27.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- 172.21.15.41:0/2331862505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 msgr2=0x7efc6405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:27.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 --2- 172.21.15.41:0/2331862505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc6405fcb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7efc58002f70 tx=0x7efc58006eb0).stop 2021-10-21T00:03:27.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- 172.21.15.41:0/2331862505 shutdown_connections 2021-10-21T00:03:27.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 --2- 172.21.15.41:0/2331862505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc6405fcb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:27.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 --2- 172.21.15.41:0/2331862505 >> v2:172.21.15.62:3300/0 conn(0x7efc640b4380 0x7efc6405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:27.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- 172.21.15.41:0/2331862505 >> 172.21.15.41:0/2331862505 conn(0x7efc640b7910 msgr2=0x7efc640b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:27.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- 172.21.15.41:0/2331862505 shutdown_connections 2021-10-21T00:03:27.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.067+0000 7efc68864700 1 -- 172.21.15.41:0/2331862505 wait complete. 2021-10-21T00:03:27.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 Processor -- start 2021-10-21T00:03:27.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 -- start start 2021-10-21T00:03:27.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640601a0 0x7efc640b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 0x7efc641523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641535f0 con 0x7efc640b1830 2021-10-21T00:03:27.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64061470 con 0x7efc640b4380 2021-10-21T00:03:27.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640616a0 con 0x7efc640601a0 2021-10-21T00:03:27.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58744/0 (socket says 172.21.15.41:58744) 2021-10-21T00:03:27.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 -- 172.21.15.41:0/1919488834 learned_addr learned my addr 172.21.15.41:0/1919488834 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:27.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc637fe700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640601a0 0x7efc640b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc63fff700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 0x7efc641523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 -- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640601a0 msgr2=0x7efc640b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:27.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640601a0 0x7efc640b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:27.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 -- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 msgr2=0x7efc641523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:27.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 0x7efc641523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:27.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 -- 172.21.15.41:0/1919488834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5800b1e0 con 0x7efc640b1830 2021-10-21T00:03:27.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc63fff700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 0x7efc641523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:27.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc62ffd700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7efc58002f70 tx=0x7efc58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:27.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58011860 con 0x7efc640b1830 2021-10-21T00:03:27.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc580119c0 con 0x7efc640b1830 2021-10-21T00:03:27.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc64061940 con 0x7efc640b1830 2021-10-21T00:03:27.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.071+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc58011d20 con 0x7efc640b1830 2021-10-21T00:03:27.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc64062470 con 0x7efc640b1830 2021-10-21T00:03:27.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc58025030 con 0x7efc640b1830 2021-10-21T00:03:27.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc64061ad0 con 0x7efc640b1830 2021-10-21T00:03:27.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc60ff9700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 0x7efc44055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:27.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc5806cbd0 con 0x7efc640b1830 2021-10-21T00:03:27.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc637fe700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 0x7efc44055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:27.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.075+0000 7efc637fe700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 0x7efc44055ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efc5400b000 tx=0x7efc540091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:27.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.079+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc58043c20 con 0x7efc640b1830 2021-10-21T00:03:27.195 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:27.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:27.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:27.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:27.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:27.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:27.243+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc64057350 con 0x7efc640b1830 2021-10-21T00:03:28.238 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:03:28.231+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:03:28.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.243+0000 7efc60ff9700 1 -- 172.21.15.41:0/1919488834 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc58023020 con 0x7efc640b1830 2021-10-21T00:03:28.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 msgr2=0x7efc44055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 0x7efc44055ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efc5400b000 tx=0x7efc540091d0).stop 2021-10-21T00:03:28.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 msgr2=0x7efc64061de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7efc58002f70 tx=0x7efc58015000).stop 2021-10-21T00:03:28.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 shutdown_connections 2021-10-21T00:03:28.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc44053610 0x7efc44055ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640b4380 0x7efc641523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc640b1830 0x7efc64061de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 --2- 172.21.15.41:0/1919488834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640601a0 0x7efc640b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 >> 172.21.15.41:0/1919488834 conn(0x7efc640b7910 msgr2=0x7efc640b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:28.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 shutdown_connections 2021-10-21T00:03:28.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.247+0000 7efc68864700 1 -- 172.21.15.41:0/1919488834 wait complete. 2021-10-21T00:03:28.260 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:03:28.271 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:28.280 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:03:28.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 Processor -- start 2021-10-21T00:03:28.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 -- start start 2021-10-21T00:03:28.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd1e8067a80 0x7fd1e80ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80b0b50 con 0x7fd1e80af620 2021-10-21T00:03:28.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80b2550 con 0x7fd1e80b2170 2021-10-21T00:03:28.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80b0d90 con 0x7fd1e8067a80 2021-10-21T00:03:28.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e5d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd1e80af620 0x7fd1e8149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56534/0 (socket says 172.21.15.41:56534) 2021-10-21T00:03:28.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e5d9b700 1 -- 172.21.15.41:0/2323736476 learned_addr learned my addr 172.21.15.41:0/2323736476 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:28.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/2323736476 >> v2:172.21.15.62:3300/0 conn(0x7fd1e8067a80 0x7fd1e80ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928235576 0 0) 0x7fd1e0001490 con 0x7fd1e80af620 2021-10-21T00:03:28.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003260 con 0x7fd1e80af620 2021-10-21T00:03:28.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158781566 0 0) 0x7fd1e80b2550 con 0x7fd1e80b2170 2021-10-21T00:03:28.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e0001490 con 0x7fd1e80b2170 2021-10-21T00:03:28.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4269284488 0 0) 0x7fd1c8003260 con 0x7fd1e80af620 2021-10-21T00:03:28.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 >> v2:172.21.15.62:3300/0 conn(0x7fd1e8067a80 msgr2=0x7fd1e80ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:28.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 --2- 172.21.15.41:0/2323736476 >> v2:172.21.15.62:3300/0 conn(0x7fd1e8067a80 0x7fd1e80ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 >> v1:172.21.15.62:6789/0 conn(0x7fd1e80b2170 legacy=0x7fd1e80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80b1030 con 0x7fd1e80af620 2021-10-21T00:03:28.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd1e0001b70 con 0x7fd1e80af620 2021-10-21T00:03:28.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 >> v1:172.21.15.41:6789/0 conn(0x7fd1e80af620 legacy=0x7fd1e8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1c8003910 0x7fd1c8003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1c8004500 0x7fd1c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1c800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b0d90 con 0x7fd1c8004e70 2021-10-21T00:03:28.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800bd20 con 0x7fd1c8004500 2021-10-21T00:03:28.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800bee0 con 0x7fd1c8003910 2021-10-21T00:03:28.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1c800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e659c700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1c8003910 0x7fd1c8003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e5d9b700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1c8004500 0x7fd1c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 -- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1c8003910 msgr2=0x7fd1c8003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:28.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1c8003910 0x7fd1c8003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 -- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1c8004500 msgr2=0x7fd1c8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:28.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1c8004500 0x7fd1c8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 -- 172.21.15.41:0/2323736476 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003260 con 0x7fd1c8004e70 2021-10-21T00:03:28.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e659c700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1c8003910 0x7fd1c8003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:28.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.371+0000 7fd1e6d9d700 1 -- 172.21.15.41:0/2323736476 reap_dead start 2021-10-21T00:03:28.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1c800b750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd1d800c000 tx=0x7fd1d8006df0).ready entity=mon.0 client_cookie=c3341a9e96b22609 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:28.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d8016070 con 0x7fd1c8004e70 2021-10-21T00:03:28.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800e5f0 con 0x7fd1c8004e70 2021-10-21T00:03:28.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e559a700 1 -- 172.21.15.41:0/2323736476 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d800e950 con 0x7fd1c8004e70 2021-10-21T00:03:28.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 msgr2=0x7fd1c800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1c800b750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd1d800c000 tx=0x7fd1d8006df0).stop 2021-10-21T00:03:28.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- 172.21.15.41:0/2323736476 shutdown_connections 2021-10-21T00:03:28.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 --2- 172.21.15.41:0/2323736476 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1c800b750 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- 172.21.15.41:0/2323736476 >> 172.21.15.41:0/2323736476 conn(0x7fd1e80b5700 msgr2=0x7fd1e80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:28.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- 172.21.15.41:0/2323736476 shutdown_connections 2021-10-21T00:03:28.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- 172.21.15.41:0/2323736476 wait complete. 2021-10-21T00:03:28.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 Processor -- start 2021-10-21T00:03:28.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.375+0000 7fd1e759e700 1 -- start start 2021-10-21T00:03:28.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 0x7fd1e81429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 0x7fd1e8144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81472f0 con 0x7fd1c8004e70 2021-10-21T00:03:28.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8146160 con 0x7fd1e8146e90 2021-10-21T00:03:28.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80accb0 con 0x7fd1e8142e90 2021-10-21T00:03:28.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58774/0 (socket says 172.21.15.41:58774) 2021-10-21T00:03:28.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 -- 172.21.15.41:0/135374810 learned_addr learned my addr 172.21.15.41:0/135374810 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:28.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e5d9b700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 0x7fd1e81429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 0x7fd1e8144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 -- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 msgr2=0x7fd1e8144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 0x7fd1e8144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 -- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 msgr2=0x7fd1e81429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:28.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 0x7fd1e81429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:28.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 -- 172.21.15.41:0/135374810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80acf50 con 0x7fd1c8004e70 2021-10-21T00:03:28.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e6d9d700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 0x7fd1e8144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:28.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e5d9b700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 0x7fd1e81429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:28.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e659c700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd1d000d000 tx=0x7fd1d0007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:28.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d0011780 con 0x7fd1c8004e70 2021-10-21T00:03:28.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00118e0 con 0x7fd1c8004e70 2021-10-21T00:03:28.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d0011c40 con 0x7fd1c8004e70 2021-10-21T00:03:28.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e80ad620 con 0x7fd1c8004e70 2021-10-21T00:03:28.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.379+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e80aca20 con 0x7fd1c8004e70 2021-10-21T00:03:28.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1d001b030 con 0x7fd1c8004e70 2021-10-21T00:03:28.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e80ad0e0 con 0x7fd1c8004e70 2021-10-21T00:03:28.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1df7fe700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 0x7fd1cc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:28.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd1d006b890 con 0x7fd1c8004e70 2021-10-21T00:03:28.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1e5d9b700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 0x7fd1cc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:28.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.383+0000 7fd1e5d9b700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 0x7fd1cc055b90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd1e0005000 tx=0x7fd1e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:28.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.387+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1d00429a0 con 0x7fd1c8004e70 2021-10-21T00:03:28.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.551+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1e80b12d0 con 0x7fd1c8004e70 2021-10-21T00:03:29.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1df7fe700 1 -- 172.21.15.41:0/135374810 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1771 (secure 0 0 0) 0x7fd1d0045fc0 con 0x7fd1c8004e70 2021-10-21T00:03:29.227 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:29.227 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/596662871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":596662871},{"type":"v1","addr":"172.21.15.62:6835","nonce":596662871}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:02:57.790214+0000","modified":"2021-10-21T00:03:28.236274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-10-21T00:03:29.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 msgr2=0x7fd1cc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 0x7fd1cc055b90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd1e0005000 tx=0x7fd1e0009040).stop 2021-10-21T00:03:29.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 msgr2=0x7fd1e8159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd1d000d000 tx=0x7fd1d0007a00).stop 2021-10-21T00:03:29.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 shutdown_connections 2021-10-21T00:03:29.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1cc0536d0 0x7fd1cc055b90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e8142e90 0x7fd1e8144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e8146e90 0x7fd1e81429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 --2- 172.21.15.41:0/135374810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1c8004e70 0x7fd1e8159920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 >> 172.21.15.41:0/135374810 conn(0x7fd1e80b5700 msgr2=0x7fd1e8060390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:29.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 shutdown_connections 2021-10-21T00:03:29.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:28.555+0000 7fd1e759e700 1 -- 172.21.15.41:0/135374810 wait complete. 2021-10-21T00:03:29.232 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 6 2021-10-21T00:03:29.233 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:03:29.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 Processor -- start 2021-10-21T00:03:29.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 -- start start 2021-10-21T00:03:29.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fba2413cb80 0x7fba2405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fba2405c190 0x7fba240ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba24143dc0 con 0x7fba24142b80 2021-10-21T00:03:29.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba24064190 con 0x7fba2405c190 2021-10-21T00:03:29.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba2a2ed700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba24064430 con 0x7fba2413cb80 2021-10-21T00:03:29.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba237fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fba2405c190 0x7fba240ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba237fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fba2405c190 0x7fba240ad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58784/0 (socket says 172.21.15.41:58784) 2021-10-21T00:03:29.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba237fe700 1 -- 172.21.15.41:0/2316878164 learned_addr learned my addr 172.21.15.41:0/2316878164 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:29.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.343+0000 7fba23fff700 1 --2- 172.21.15.41:0/2316878164 >> v2:172.21.15.62:3300/0 conn(0x7fba2413cb80 0x7fba2405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 -- 172.21.15.41:0/2316878164 >> v2:172.21.15.62:3300/0 conn(0x7fba2413cb80 msgr2=0x7fba2405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:29.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 --2- 172.21.15.41:0/2316878164 >> v2:172.21.15.62:3300/0 conn(0x7fba2413cb80 0x7fba2405bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 -- 172.21.15.41:0/2316878164 >> v1:172.21.15.62:6789/0 conn(0x7fba24142b80 legacy=0x7fba240ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 -- 172.21.15.41:0/2316878164 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2405f6b0 con 0x7fba2405c190 2021-10-21T00:03:29.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 --2- 172.21.15.41:0/2316878164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba2405c190 0x7fba240ad440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18006eb0).ready entity=mon.0 client_cookie=9a7e639dd5850fb0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:29.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba22ffd700 1 -- 172.21.15.41:0/2316878164 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1800d5c0 con 0x7fba2405c190 2021-10-21T00:03:29.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba22ffd700 1 -- 172.21.15.41:0/2316878164 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18000e90 con 0x7fba2405c190 2021-10-21T00:03:29.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba22ffd700 1 -- 172.21.15.41:0/2316878164 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1800d950 con 0x7fba2405c190 2021-10-21T00:03:29.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- 172.21.15.41:0/2316878164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba2405c190 msgr2=0x7fba240ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/2316878164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba2405c190 0x7fba240ad440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18006eb0).stop 2021-10-21T00:03:29.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- 172.21.15.41:0/2316878164 shutdown_connections 2021-10-21T00:03:29.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/2316878164 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba2405c190 0x7fba240ad440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/2316878164 >> v2:172.21.15.62:3300/0 conn(0x7fba2413cb80 0x7fba2405bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- 172.21.15.41:0/2316878164 >> 172.21.15.41:0/2316878164 conn(0x7fba24061d80 msgr2=0x7fba24063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:29.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- 172.21.15.41:0/2316878164 shutdown_connections 2021-10-21T00:03:29.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- 172.21.15.41:0/2316878164 wait complete. 2021-10-21T00:03:29.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 Processor -- start 2021-10-21T00:03:29.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- start start 2021-10-21T00:03:29.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba2413cb80 0x7fba24066780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 0x7fba241555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24067060 con 0x7fba24142b80 2021-10-21T00:03:29.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24066040 con 0x7fba2405c190 2021-10-21T00:03:29.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2a2ed700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240662e0 con 0x7fba2413cb80 2021-10-21T00:03:29.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba23fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2888a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 0x7fba241555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba23fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42474/0 (socket says 172.21.15.41:42474) 2021-10-21T00:03:29.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba23fff700 1 -- 172.21.15.41:0/706610323 learned_addr learned my addr 172.21.15.41:0/706610323 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:29.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba237fe700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba2413cb80 0x7fba24066780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.347+0000 7fba2888a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 0x7fba241555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58792/0 (socket says 172.21.15.41:58792) 2021-10-21T00:03:29.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 -- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba2413cb80 msgr2=0x7fba24066780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba2413cb80 0x7fba24066780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 -- 172.21.15.41:0/706610323 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 msgr2=0x7fba241555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:29.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 0x7fba241555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:29.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 -- 172.21.15.41:0/706610323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1800b1e0 con 0x7fba2405c190 2021-10-21T00:03:29.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba23fff700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fba1400c000 tx=0x7fba14006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:29.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba14010780 con 0x7fba2405c190 2021-10-21T00:03:29.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140108e0 con 0x7fba2405c190 2021-10-21T00:03:29.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24066c70 con 0x7fba2405c190 2021-10-21T00:03:29.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba14010c40 con 0x7fba2405c190 2021-10-21T00:03:29.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba24067490 con 0x7fba2405c190 2021-10-21T00:03:29.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba24057350 con 0x7fba2405c190 2021-10-21T00:03:29.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.351+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba1401c460 con 0x7fba2405c190 2021-10-21T00:03:29.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.355+0000 7fba217fa700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 0x7fba04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:29.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.355+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fba1406bd50 con 0x7fba2405c190 2021-10-21T00:03:29.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.355+0000 7fba237fe700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 0x7fba04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:29.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.355+0000 7fba237fe700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 0x7fba04055a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fba1801c000 tx=0x7fba18015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:29.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.363+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba14042e00 con 0x7fba2405c190 2021-10-21T00:03:29.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:29.531+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fba2405daf0 con 0x7fba2405c190 2021-10-21T00:03:30.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.259+0000 7fba217fa700 1 -- 172.21.15.41:0/706610323 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fba14046420 con 0x7fba2405c190 2021-10-21T00:03:30.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.259+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 msgr2=0x7fba04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.259+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 0x7fba04055a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fba1801c000 tx=0x7fba18015000).stop 2021-10-21T00:03:30.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.259+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 msgr2=0x7fba24148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.259+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fba1400c000 tx=0x7fba14006df0).stop 2021-10-21T00:03:30.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 shutdown_connections 2021-10-21T00:03:30.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba04053580 0x7fba04055a40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fba24142b80 0x7fba241555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba2413cb80 0x7fba24066780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 --2- 172.21.15.41:0/706610323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba2405c190 0x7fba24148e60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 >> 172.21.15.41:0/706610323 conn(0x7fba24061d80 msgr2=0x7fba241418b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:30.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 shutdown_connections 2021-10-21T00:03:30.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.263+0000 7fba2a2ed700 1 -- 172.21.15.41:0/706610323 wait complete. 2021-10-21T00:03:30.286 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:03:30.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 Processor -- start 2021-10-21T00:03:30.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 -- start start 2021-10-21T00:03:30.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0a8062330 0x7fb0a80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0a8143610 0x7fb0a813c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a8142ad0 con 0x7fb0a813c510 2021-10-21T00:03:30.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80b3520 con 0x7fb0a8143610 2021-10-21T00:03:30.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0adf9b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a8143c40 con 0x7fb0a8062330 2021-10-21T00:03:30.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0a8143610 0x7fb0a813c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0a7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb0a813c510 0x7fb0a8142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56568/0 (socket says 172.21.15.41:56568) 2021-10-21T00:03:30.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0a7fff700 1 -- 172.21.15.41:0/650233207 learned_addr learned my addr 172.21.15.41:0/650233207 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:30.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0acf99700 1 --2- 172.21.15.41:0/650233207 >> v2:172.21.15.62:3300/0 conn(0x7fb0a8062330 0x7fb0a80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0a77fe700 1 -- 172.21.15.41:0/650233207 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838489881 0 0) 0x7fb0a8142ad0 con 0x7fb0a813c510 2021-10-21T00:03:30.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0a77fe700 1 -- 172.21.15.41:0/650233207 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb088003260 con 0x7fb0a813c510 2021-10-21T00:03:30.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 -- 172.21.15.41:0/650233207 >> v2:172.21.15.62:3300/0 conn(0x7fb0a8062330 msgr2=0x7fb0a80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:30.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 --2- 172.21.15.41:0/650233207 >> v2:172.21.15.62:3300/0 conn(0x7fb0a8062330 0x7fb0a80b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 -- 172.21.15.41:0/650233207 >> v1:172.21.15.41:6789/0 conn(0x7fb0a813c510 legacy=0x7fb0a8142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 -- 172.21.15.41:0/650233207 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a813ce60 con 0x7fb0a8143610 2021-10-21T00:03:30.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.399+0000 7fb0ad79a700 1 --2- 172.21.15.41:0/650233207 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a813c970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb0a00032f0 tx=0x7fb0a00091d0).ready entity=mon.0 client_cookie=ff4a54f654fa8ac1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:30.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0a77fe700 1 -- 172.21.15.41:0/650233207 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a000b600 con 0x7fb0a8143610 2021-10-21T00:03:30.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0a77fe700 1 -- 172.21.15.41:0/650233207 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000b760 con 0x7fb0a8143610 2021-10-21T00:03:30.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0a77fe700 1 -- 172.21.15.41:0/650233207 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a000b8d0 con 0x7fb0a8143610 2021-10-21T00:03:30.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- 172.21.15.41:0/650233207 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 msgr2=0x7fb0a813c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/650233207 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a813c970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb0a00032f0 tx=0x7fb0a00091d0).stop 2021-10-21T00:03:30.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- 172.21.15.41:0/650233207 shutdown_connections 2021-10-21T00:03:30.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/650233207 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a813c970 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/650233207 >> v2:172.21.15.62:3300/0 conn(0x7fb0a8062330 0x7fb0a80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- 172.21.15.41:0/650233207 >> 172.21.15.41:0/650233207 conn(0x7fb0a80b9080 msgr2=0x7fb0a80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:30.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- 172.21.15.41:0/650233207 shutdown_connections 2021-10-21T00:03:30.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- 172.21.15.41:0/650233207 wait complete. 2021-10-21T00:03:30.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 Processor -- start 2021-10-21T00:03:30.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.403+0000 7fb0adf9b700 1 -- start start 2021-10-21T00:03:30.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 0x7fb0a8148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0a813c510 0x7fb0a8146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a81450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8138690 con 0x7fb0a8143610 2021-10-21T00:03:30.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8138940 con 0x7fb0a8062330 2021-10-21T00:03:30.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8144810 con 0x7fb0a813c510 2021-10-21T00:03:30.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a81450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0acf99700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 0x7fb0a8148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0acf99700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 0x7fb0a8148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42488/0 (socket says 172.21.15.41:42488) 2021-10-21T00:03:30.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0acf99700 1 -- 172.21.15.41:0/2513504518 learned_addr learned my addr 172.21.15.41:0/2513504518 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:30.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0a813c510 0x7fb0a8146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 -- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0a813c510 msgr2=0x7fb0a8146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0a813c510 0x7fb0a8146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 -- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 msgr2=0x7fb0a8148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:30.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 0x7fb0a8148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 -- 172.21.15.41:0/2513504518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a0009470 con 0x7fb0a8143610 2021-10-21T00:03:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0ad79a700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a81450e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb0a81449a0 tx=0x7fb0a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a000b8d0 con 0x7fb0a8143610 2021-10-21T00:03:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a001f3f0 con 0x7fb0a8143610 2021-10-21T00:03:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a8144570 con 0x7fb0a8143610 2021-10-21T00:03:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a000b600 con 0x7fb0a8143610 2021-10-21T00:03:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.407+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a8145770 con 0x7fb0a8143610 2021-10-21T00:03:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0a0026030 con 0x7fb0a8143610 2021-10-21T00:03:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a8057350 con 0x7fb0a8143610 2021-10-21T00:03:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0a5ffb700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 0x7fb08c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb0a006c2e0 con 0x7fb0a8143610 2021-10-21T00:03:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0acf99700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 0x7fb08c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.411+0000 7fb0acf99700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 0x7fb08c055b90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb09800b000 tx=0x7fb098006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:30.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.415+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0a00436b0 con 0x7fb0a8143610 2021-10-21T00:03:30.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:30.539+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0a805ef30 con 0x7fb0a8143610 2021-10-21T00:03:31.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.267+0000 7fb0a5ffb700 1 -- 172.21.15.41:0/2513504518 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb0a00150e0 con 0x7fb0a8143610 2021-10-21T00:03:31.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 msgr2=0x7fb08c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 0x7fb08c055b90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb09800b000 tx=0x7fb098006df0).stop 2021-10-21T00:03:31.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 msgr2=0x7fb0a81450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a81450e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb0a81449a0 tx=0x7fb0a0016000).stop 2021-10-21T00:03:31.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 shutdown_connections 2021-10-21T00:03:31.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb08c0536d0 0x7fb08c055b90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0a8143610 0x7fb0a81450e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0a813c510 0x7fb0a8146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 --2- 172.21.15.41:0/2513504518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0a8062330 0x7fb0a8148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 >> 172.21.15.41:0/2513504518 conn(0x7fb0a80b9080 msgr2=0x7fb0a80b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:31.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 shutdown_connections 2021-10-21T00:03:31.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.275+0000 7fb0adf9b700 1 -- 172.21.15.41:0/2513504518 wait complete. 2021-10-21T00:03:31.285 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:03:31.296 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:03:31.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.407+0000 7f193e2a8700 1 Processor -- start 2021-10-21T00:03:31.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.407+0000 7f193e2a8700 1 -- start start 2021-10-21T00:03:31.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 0x7f19380b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1938143a40 0x7f19381419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19380ba050 con 0x7f19380b0660 2021-10-21T00:03:31.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1938146360 con 0x7f1938143a40 2021-10-21T00:03:31.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1938142bf0 con 0x7f19380b9c70 2021-10-21T00:03:31.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1938143a40 0x7f19381419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1938143a40 0x7f19381419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58814/0 (socket says 172.21.15.41:58814) 2021-10-21T00:03:31.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 -- 172.21.15.41:0/317858719 learned_addr learned my addr 172.21.15.41:0/317858719 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:31.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f1937fff700 1 --2- 172.21.15.41:0/317858719 >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 0x7f19380b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 -- 172.21.15.41:0/317858719 >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 msgr2=0x7f19380b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:31.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 --2- 172.21.15.41:0/317858719 >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 0x7f19380b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 -- 172.21.15.41:0/317858719 >> v1:172.21.15.62:6789/0 conn(0x7f19380b0660 legacy=0x7f1938143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 -- 172.21.15.41:0/317858719 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938142e90 con 0x7f1938143a40 2021-10-21T00:03:31.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f1937fff700 1 --2- 172.21.15.41:0/317858719 >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 0x7f19380b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:31.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193c845700 1 --2- 172.21.15.41:0/317858719 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f19381419c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f19300032f0 tx=0x7f1930009290).ready entity=mon.0 client_cookie=88048f312699ce3a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:31.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f19377fe700 1 -- 172.21.15.41:0/317858719 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193000b870 con 0x7f1938143a40 2021-10-21T00:03:31.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f19377fe700 1 -- 172.21.15.41:0/317858719 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193000b9d0 con 0x7f1938143a40 2021-10-21T00:03:31.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f19377fe700 1 -- 172.21.15.41:0/317858719 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193000bb40 con 0x7f1938143a40 2021-10-21T00:03:31.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- 172.21.15.41:0/317858719 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 msgr2=0x7f19381419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 --2- 172.21.15.41:0/317858719 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f19381419c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f19300032f0 tx=0x7f1930009290).stop 2021-10-21T00:03:31.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- 172.21.15.41:0/317858719 shutdown_connections 2021-10-21T00:03:31.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 --2- 172.21.15.41:0/317858719 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f19381419c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 --2- 172.21.15.41:0/317858719 >> v2:172.21.15.62:3300/0 conn(0x7f19380b9c70 0x7f19380b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- 172.21.15.41:0/317858719 >> 172.21.15.41:0/317858719 conn(0x7f1938062f00 msgr2=0x7f19380b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:31.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- 172.21.15.41:0/317858719 shutdown_connections 2021-10-21T00:03:31.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.411+0000 7f193e2a8700 1 -- 172.21.15.41:0/317858719 wait complete. 2021-10-21T00:03:31.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 Processor -- start 2021-10-21T00:03:31.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- start start 2021-10-21T00:03:31.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19380b0660 0x7f1938135550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19380b9c70 0x7f19381416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19380af260 con 0x7f1938143a40 2021-10-21T00:03:31.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1938137ab0 con 0x7f19380b0660 2021-10-21T00:03:31.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380af500 con 0x7f19380b9c70 2021-10-21T00:03:31.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58820/0 (socket says 172.21.15.41:58820) 2021-10-21T00:03:31.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 -- 172.21.15.41:0/2157080579 learned_addr learned my addr 172.21.15.41:0/2157080579 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:31.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f192f7fe700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19380b9c70 0x7f19381416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f1937fff700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19380b0660 0x7f1938135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 -- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19380b9c70 msgr2=0x7f19381416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19380b9c70 0x7f19381416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 -- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19380b0660 msgr2=0x7f1938135550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:31.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19380b0660 0x7f1938135550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:31.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 -- 172.21.15.41:0/2157080579 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930009530 con 0x7f1938143a40 2021-10-21T00:03:31.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193c845700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f19300032f0 tx=0x7f1930016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:31.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f193000b870 con 0x7f1938143a40 2021-10-21T00:03:31.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930021440 con 0x7f1938143a40 2021-10-21T00:03:31.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1938134760 con 0x7f1938143a40 2021-10-21T00:03:31.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19300217a0 con 0x7f1938143a40 2021-10-21T00:03:31.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.415+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19381380f0 con 0x7f1938143a40 2021-10-21T00:03:31.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1938137c70 con 0x7f1938143a40 2021-10-21T00:03:31.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f193000f070 con 0x7f1938143a40 2021-10-21T00:03:31.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f1935ffb700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 0x7f191c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:31.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f193006cb20 con 0x7f1938143a40 2021-10-21T00:03:31.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f1937fff700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 0x7f191c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:31.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.419+0000 7f1937fff700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 0x7f191c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f192800c000 tx=0x7f1928008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:31.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.427+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1930043cd0 con 0x7f1938143a40 2021-10-21T00:03:31.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:31.559+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1938146050 con 0x7f1938143a40 2021-10-21T00:03:32.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.271+0000 7f1935ffb700 1 -- 172.21.15.41:0/2157080579 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1930015030 con 0x7f1938143a40 2021-10-21T00:03:32.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 msgr2=0x7f191c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 0x7f191c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f192800c000 tx=0x7f1928008040).stop 2021-10-21T00:03:32.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 msgr2=0x7f1938155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f19300032f0 tx=0x7f1930016000).stop 2021-10-21T00:03:32.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 shutdown_connections 2021-10-21T00:03:32.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f191c053610 0x7f191c055ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1938143a40 0x7f1938155740 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19380b9c70 0x7f19381416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 --2- 172.21.15.41:0/2157080579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19380b0660 0x7f1938135550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 >> 172.21.15.41:0/2157080579 conn(0x7f1938062f00 msgr2=0x7f19380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 shutdown_connections 2021-10-21T00:03:32.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.279+0000 7f193e2a8700 1 -- 172.21.15.41:0/2157080579 wait complete. 2021-10-21T00:03:32.291 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:03:32.300 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:03:32.301 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:03:32.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:03:32.302 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:03:32.302 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:03:32.303 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:03:32.304 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:03:32.304 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:03:32.316 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:03:32.317 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:03:32.319 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:03:32.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:03:32.328 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:03:32.329 DEBUG:teuthology.parallel:result is None 2021-10-21T00:03:32.366 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:03:32.369 DEBUG:teuthology.parallel:result is None 2021-10-21T00:03:32.370 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:03:32.402 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:03:32.446 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:03:32.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 Processor -- start 2021-10-21T00:03:32.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 -- start start 2021-10-21T00:03:32.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 0x7f255c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f255c0b3370 0x7f255c138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c05fdd0 con 0x7f255c0b0730 2021-10-21T00:03:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c140400 con 0x7f255c0b3370 2021-10-21T00:03:32.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.475+0000 7f25610ff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b27c0 con 0x7f255c05f9f0 2021-10-21T00:03:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f255c0b3370 0x7f255c138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 0x7f255c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f255c0b3370 0x7f255c138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42522/0 (socket says 172.21.15.41:42522) 2021-10-21T00:03:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 -- 172.21.15.41:0/668144895 learned_addr learned my addr 172.21.15.41:0/668144895 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:32.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255b7fe700 1 --1- 172.21.15.41:0/668144895 >> v1:172.21.15.62:6789/0 conn(0x7f255c0b0730 0x7f255c0b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36434/0 (socket says 172.21.15.41:36434) 2021-10-21T00:03:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 -- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 msgr2=0x7f255c0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 0x7f255c0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 -- 172.21.15.41:0/668144895 >> v1:172.21.15.62:6789/0 conn(0x7f255c0b0730 legacy=0x7f255c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255affd700 1 -- 172.21.15.41:0/668144895 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289777168 0 0) 0x7f255c05fdd0 con 0x7f255c0b0730 2021-10-21T00:03:32.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 -- 172.21.15.41:0/668144895 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c140080 con 0x7f255c0b3370 2021-10-21T00:03:32.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255bfff700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 0x7f255c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:32.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25608fe700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c0b3370 0x7f255c138b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f25540032f0 tx=0x7f255400b530).ready entity=mon.1 client_cookie=8a227add92d935c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:32.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255affd700 1 -- 172.21.15.41:0/668144895 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255400de20 con 0x7f255c0b3370 2021-10-21T00:03:32.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255affd700 1 -- 172.21.15.41:0/668144895 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554010470 con 0x7f255c0b3370 2021-10-21T00:03:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f255affd700 1 -- 172.21.15.41:0/668144895 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25540107d0 con 0x7f255c0b3370 2021-10-21T00:03:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 -- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c0b3370 msgr2=0x7f255c138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c0b3370 0x7f255c138b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f25540032f0 tx=0x7f255400b530).stop 2021-10-21T00:03:32.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 -- 172.21.15.41:0/668144895 shutdown_connections 2021-10-21T00:03:32.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c0b3370 0x7f255c138b60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 --2- 172.21.15.41:0/668144895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c05f9f0 0x7f255c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 -- 172.21.15.41:0/668144895 >> 172.21.15.41:0/668144895 conn(0x7f255c0637b0 msgr2=0x7f255c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:32.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 -- 172.21.15.41:0/668144895 shutdown_connections 2021-10-21T00:03:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.479+0000 7f25610ff700 1 -- 172.21.15.41:0/668144895 wait complete. 2021-10-21T00:03:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 Processor -- start 2021-10-21T00:03:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- start start 2021-10-21T00:03:32.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c05f9f0 0x7f255c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c0b0730 0x7f255c135960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c152c00 con 0x7f255c0b3370 2021-10-21T00:03:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c136670 con 0x7f255c05f9f0 2021-10-21T00:03:32.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c152220 con 0x7f255c0b0730 2021-10-21T00:03:32.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58846/0 (socket says 172.21.15.41:58846) 2021-10-21T00:03:32.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 -- 172.21.15.41:0/507574281 learned_addr learned my addr 172.21.15.41:0/507574281 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:32.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f255b7fe700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c0b0730 0x7f255c135960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f255bfff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c05f9f0 0x7f255c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 -- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c0b0730 msgr2=0x7f255c135960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c0b0730 0x7f255c135960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 -- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c05f9f0 msgr2=0x7f255c151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c05f9f0 0x7f255c151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 -- 172.21.15.41:0/507574281 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c00b120 con 0x7f255c0b3370 2021-10-21T00:03:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25608fe700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f25540032f0 tx=0x7f255400b530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255401d070 con 0x7f255c0b3370 2021-10-21T00:03:32.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554018800 con 0x7f255c0b3370 2021-10-21T00:03:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2554018b60 con 0x7f255c0b3370 2021-10-21T00:03:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255400b7d0 con 0x7f255c0b3370 2021-10-21T00:03:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.483+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c152760 con 0x7f255c0b3370 2021-10-21T00:03:32.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c057350 con 0x7f255c0b3370 2021-10-21T00:03:32.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2554029070 con 0x7f255c0b3370 2021-10-21T00:03:32.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f25597fa700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 0x7f253c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:32.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f255406cdb0 con 0x7f255c0b3370 2021-10-21T00:03:32.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f255bfff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 0x7f253c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:32.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.487+0000 7f255bfff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 0x7f253c055a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f254c008000 tx=0x7f254c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:32.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.495+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25540441f0 con 0x7f255c0b3370 2021-10-21T00:03:32.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:32.631+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f255c152920 con 0x7f255c0b3370 2021-10-21T00:03:33.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.480+0000 7f25597fa700 1 -- 172.21.15.41:0/507574281 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2554047810 con 0x7f255c0b3370 2021-10-21T00:03:33.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 msgr2=0x7f253c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 0x7f253c055a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f254c008000 tx=0x7f254c008040).stop 2021-10-21T00:03:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 msgr2=0x7f255c136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f25540032f0 tx=0x7f255400b530).stop 2021-10-21T00:03:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 shutdown_connections 2021-10-21T00:03:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f253c053580 0x7f253c055a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f255c0b3370 0x7f255c136a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f255c0b0730 0x7f255c135960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 --2- 172.21.15.41:0/507574281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f255c05f9f0 0x7f255c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 >> 172.21.15.41:0/507574281 conn(0x7f255c0637b0 msgr2=0x7f255c0aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:33.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 shutdown_connections 2021-10-21T00:03:33.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.484+0000 7f25610ff700 1 -- 172.21.15.41:0/507574281 wait complete. 2021-10-21T00:03:33.493 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:03:33.506 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:03:33.506 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:03:33.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.608+0000 7f2ce8c28700 1 Processor -- start 2021-10-21T00:03:33.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.608+0000 7f2ce8c28700 1 -- start start 2021-10-21T00:03:33.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2ce405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce405bd40 con 0x7f2ce4062330 2021-10-21T00:03:33.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce405bf70 con 0x7f2ce40b3a20 2021-10-21T00:03:33.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4142cb0 con 0x7f2ce4062f70 2021-10-21T00:03:33.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2ce4062330 0x7f2ce40b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56622/0 (socket says 172.21.15.41:56622) 2021-10-21T00:03:33.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 -- 172.21.15.41:0/2795009841 learned_addr learned my addr 172.21.15.41:0/2795009841 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:33.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce2ffd700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2ce405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825725185 0 0) 0x7f2ce405bd40 con 0x7f2ce4062330 2021-10-21T00:03:33.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd0003260 con 0x7f2ce4062330 2021-10-21T00:03:33.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414811556 0 0) 0x7f2cd0003260 con 0x7f2ce4062330 2021-10-21T00:03:33.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 msgr2=0x7f2ce405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:33.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2ce405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 >> v1:172.21.15.62:6789/0 conn(0x7f2ce40b3a20 legacy=0x7f2ce413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4142950 con 0x7f2ce4062330 2021-10-21T00:03:33.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f2cd4001660 con 0x7f2ce4062330 2021-10-21T00:03:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 >> v1:172.21.15.41:6789/0 conn(0x7f2ce4062330 legacy=0x7f2ce40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2cd0003780 0x7f2cd0003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cd0004500 0x7f2cd0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2cd0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4142cb0 con 0x7f2cd0003780 2021-10-21T00:03:33.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd000b750 con 0x7f2cd0004500 2021-10-21T00:03:33.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd000b8c0 con 0x7f2ce4062f70 2021-10-21T00:03:33.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2cd0003780 0x7f2cd0003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce2ffd700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cd0004500 0x7f2cd0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce3fff700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2cd0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 -- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 msgr2=0x7f2cd0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce4062f70 0x7f2cd0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 -- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cd0004500 msgr2=0x7f2cd0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2cd0004500 0x7f2cd0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 -- 172.21.15.41:0/2795009841 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0003260 con 0x7f2cd0003780 2021-10-21T00:03:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2cd0003780 0x7f2cd0003b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f2cd4001370 tx=0x7f2cd4001e30).ready entity=mon.0 client_cookie=ca45ec62c0301bf1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd40071a0 con 0x7f2cd0003780 2021-10-21T00:03:33.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4007300 con 0x7f2cd0003780 2021-10-21T00:03:33.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce27fc700 1 -- 172.21.15.41:0/2795009841 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd400c890 con 0x7f2cd0003780 2021-10-21T00:03:33.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- 172.21.15.41:0/2795009841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2cd0003780 msgr2=0x7f2cd0003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/2795009841 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2cd0003780 0x7f2cd0003b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f2cd4001370 tx=0x7f2cd4001e30).stop 2021-10-21T00:03:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce3fff700 1 -- 172.21.15.41:0/2795009841 reap_dead start 2021-10-21T00:03:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- 172.21.15.41:0/2795009841 shutdown_connections 2021-10-21T00:03:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- 172.21.15.41:0/2795009841 >> 172.21.15.41:0/2795009841 conn(0x7f2ce40b9080 msgr2=0x7f2ce40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- 172.21.15.41:0/2795009841 shutdown_connections 2021-10-21T00:03:33.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.612+0000 7f2ce8c28700 1 -- 172.21.15.41:0/2795009841 wait complete. 2021-10-21T00:03:33.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 Processor -- start 2021-10-21T00:03:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 -- start start 2021-10-21T00:03:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce40ae5d0 0x7f2ce4140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ce4141220 0x7f2ce4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40ae9b0 con 0x7f2ce40ad640 2021-10-21T00:03:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4113570 con 0x7f2ce4141220 2021-10-21T00:03:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4113810 con 0x7f2ce40ae5d0 2021-10-21T00:03:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58864/0 (socket says 172.21.15.41:58864) 2021-10-21T00:03:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 -- 172.21.15.41:0/3002885225 learned_addr learned my addr 172.21.15.41:0/3002885225 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce40ae5d0 0x7f2ce4140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce3fff700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ce4141220 0x7f2ce4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 -- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce40ae5d0 msgr2=0x7f2ce4140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce40ae5d0 0x7f2ce4140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 -- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ce4141220 msgr2=0x7f2ce4151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ce4141220 0x7f2ce4151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 -- 172.21.15.41:0/3002885225 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4113ab0 con 0x7f2ce40ad640 2021-10-21T00:03:33.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce2ffd700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f2cd800b000 tx=0x7f2cd8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:33.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd800e6c0 con 0x7f2ce40ad640 2021-10-21T00:03:33.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd800e820 con 0x7f2ce40ad640 2021-10-21T00:03:33.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4113d50 con 0x7f2ce40ad640 2021-10-21T00:03:33.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.616+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd800eb80 con 0x7f2ce40ad640 2021-10-21T00:03:33.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40aeeb0 con 0x7f2ce40ad640 2021-10-21T00:03:33.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4113ee0 con 0x7f2ce40ad640 2021-10-21T00:03:33.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2cd8024070 con 0x7f2ce40ad640 2021-10-21T00:03:33.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce0ff9700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 0x7f2cc4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2cd806bdc0 con 0x7f2ce40ad640 2021-10-21T00:03:33.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 0x7f2cc4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.620+0000 7f2ce37fe700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 0x7f2cc4055b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2cd4018000 tx=0x7f2cd4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:33.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.628+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cd8043250 con 0x7f2ce40ad640 2021-10-21T00:03:33.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.792+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2ce4057350 con 0x7f2ce40ad640 2021-10-21T00:03:33.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.796+0000 7f2ce0ff9700 1 -- 172.21.15.41:0/3002885225 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5627 (secure 0 0 0) 0x7f2cd8046870 con 0x7f2ce40ad640 2021-10-21T00:03:33.803 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:33.804 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:03:33.805 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:03:33.806 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.806 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:03:33.806 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:03:33.807 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.808 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:03:33.808 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.808 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.808 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.809 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.809 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.809 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.809 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:03:33.810 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:03:33.810 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.810 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:03:33.811 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.811 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.811 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.813 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.813 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.814 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.816 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:03:33.816 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:03:33.816 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.817 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.817 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.817 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.817 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.817 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.818 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.818 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:03:33.818 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:03:33.818 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.819 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.819 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.819 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.819 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.820 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.820 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.820 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:03:33.820 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:03:33.821 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.821 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.821 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.821 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.821 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.822 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.822 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.822 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:03:33.822 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:03:33.823 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.823 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.823 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.823 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.824 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.824 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.824 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.824 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:03:33.825 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:03:33.825 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.825 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.825 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.826 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.826 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.826 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.826 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.827 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:03:33.827 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:03:33.827 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.827 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.828 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.828 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.828 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.829 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.829 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.829 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:03:33.829 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:03:33.829 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.830 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.830 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.830 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.830 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.831 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.831 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.831 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:03:33.831 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:03:33.831 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.832 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.832 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.832 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.833 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.833 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.833 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.833 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:03:33.833 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:03:33.834 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.834 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:03:33.834 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow r", 2021-10-21T00:03:33.834 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow rw", 2021-10-21T00:03:33.835 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rwx" 2021-10-21T00:03:33.835 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.835 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.835 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.835 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:03:33.836 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:03:33.836 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.836 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:03:33.836 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow r", 2021-10-21T00:03:33.837 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow rw", 2021-10-21T00:03:33.837 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rwx" 2021-10-21T00:03:33.837 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.837 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.837 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.838 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:03:33.838 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:03:33.838 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.838 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:03:33.839 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow r", 2021-10-21T00:03:33.839 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow rw", 2021-10-21T00:03:33.839 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rwx" 2021-10-21T00:03:33.839 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.839 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.840 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.840 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:03:33.840 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:03:33.840 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.841 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:03:33.841 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:03:33.841 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:03:33.841 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.841 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.842 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.842 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.842 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-mds", 2021-10-21T00:03:33.842 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBh4bhfGBAAohN0sAmxiwloEz49Zwb4gA==", 2021-10-21T00:03:33.842 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.843 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-mds" 2021-10-21T00:03:33.843 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.843 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.843 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.844 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-mgr", 2021-10-21T00:03:33.844 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBhV9RfGBAAtZWvRGr6/gm060FlM/4HXQ==", 2021-10-21T00:03:33.844 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.844 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-mgr" 2021-10-21T00:03:33.844 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.845 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.845 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.845 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-osd", 2021-10-21T00:03:33.845 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBhJOtfGBAAizCIoevt0WiQk0s/Qz5kCw==", 2021-10-21T00:03:33.846 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.846 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-osd" 2021-10-21T00:03:33.846 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.846 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.847 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.847 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-rbd", 2021-10-21T00:03:33.847 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBhIgJgGBAAF8zI/MF230V5U3Ii+rYLTA==", 2021-10-21T00:03:33.847 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.848 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-rbd" 2021-10-21T00:03:33.848 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.848 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.848 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.848 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-10-21T00:03:33.849 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBhZBpgGBAA1yJud3QNxDQIfilip2n8jA==", 2021-10-21T00:03:33.849 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.849 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-10-21T00:03:33.849 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.849 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.850 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.850 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.bootstrap-rgw", 2021-10-21T00:03:33.850 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAhrnBhmzdgGBAAQjKwVzYYwxmqy+Q2XEPbLA==", 2021-10-21T00:03:33.850 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.851 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile bootstrap-rgw" 2021-10-21T00:03:33.851 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.851 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.851 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.851 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:03:33.852 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:03:33.852 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.852 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:03:33.852 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:03:33.853 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.853 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.853 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:33.853 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:33.853 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:03:33.854 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:03:33.854 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:03:33.854 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:03:33.854 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:03:33.855 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:03:33.855 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.855 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:33.855 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:03:33.855 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:03:33.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 msgr2=0x7f2cc4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 0x7f2cc4055b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2cd4018000 tx=0x7f2cd4015000).stop 2021-10-21T00:03:33.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 msgr2=0x7f2ce4140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f2cd800b000 tx=0x7f2cd8008040).stop 2021-10-21T00:03:33.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 shutdown_connections 2021-10-21T00:03:33.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2cc4053640 0x7f2cc4055b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ce4141220 0x7f2ce4151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ce40ad640 0x7f2ce4140d30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 --2- 172.21.15.41:0/3002885225 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ce40ae5d0 0x7f2ce4140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 >> 172.21.15.41:0/3002885225 conn(0x7f2ce40b9080 msgr2=0x7f2ce40b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:33.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 shutdown_connections 2021-10-21T00:03:33.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.800+0000 7f2ce8c28700 1 -- 172.21.15.41:0/3002885225 wait complete. 2021-10-21T00:03:33.864 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-10-21T00:03:33.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 Processor -- start 2021-10-21T00:03:33.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 -- start start 2021-10-21T00:03:33.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63ac0aa750 0x7f63ac14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ac14b350 0x7f63ac0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:33.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0609d0 con 0x7f63ac05f9f0 2021-10-21T00:03:33.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac0b1620 con 0x7f63ac14b350 2021-10-21T00:03:33.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b22dc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac05fdd0 con 0x7f63ac0aa750 2021-10-21T00:03:33.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ac14b350 0x7f63ac0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ac14b350 0x7f63ac0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58874/0 (socket says 172.21.15.41:58874) 2021-10-21T00:03:33.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 -- 172.21.15.41:0/1442099026 learned_addr learned my addr 172.21.15.41:0/1442099026 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:33.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63ab7fe700 1 --2- 172.21.15.41:0/1442099026 >> v2:172.21.15.62:3300/0 conn(0x7f63ac0aa750 0x7f63ac14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:33.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 -- 172.21.15.41:0/1442099026 >> v2:172.21.15.62:3300/0 conn(0x7f63ac0aa750 msgr2=0x7f63ac14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:33.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 --2- 172.21.15.41:0/1442099026 >> v2:172.21.15.62:3300/0 conn(0x7f63ac0aa750 0x7f63ac14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 -- 172.21.15.41:0/1442099026 >> v1:172.21.15.41:6789/0 conn(0x7f63ac05f9f0 legacy=0x7f63ac14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.964+0000 7f63b0879700 1 -- 172.21.15.41:0/1442099026 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0b1380 con 0x7f63ac14b350 2021-10-21T00:03:33.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b0879700 1 --2- 172.21.15.41:0/1442099026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac0af7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f63a40032f0 tx=0x7f63a4009290).ready entity=mon.0 client_cookie=deda724d33a627fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:33.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63aaffd700 1 -- 172.21.15.41:0/1442099026 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a400b870 con 0x7f63ac14b350 2021-10-21T00:03:33.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63aaffd700 1 -- 172.21.15.41:0/1442099026 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400b9d0 con 0x7f63ac14b350 2021-10-21T00:03:33.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63aaffd700 1 -- 172.21.15.41:0/1442099026 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a400bb40 con 0x7f63ac14b350 2021-10-21T00:03:33.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- 172.21.15.41:0/1442099026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 msgr2=0x7f63ac0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:33.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 --2- 172.21.15.41:0/1442099026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac0af7c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f63a40032f0 tx=0x7f63a4009290).stop 2021-10-21T00:03:33.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- 172.21.15.41:0/1442099026 shutdown_connections 2021-10-21T00:03:33.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 --2- 172.21.15.41:0/1442099026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac0af7c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:33.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 --2- 172.21.15.41:0/1442099026 >> v2:172.21.15.62:3300/0 conn(0x7f63ac0aa750 0x7f63ac14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- 172.21.15.41:0/1442099026 >> 172.21.15.41:0/1442099026 conn(0x7f63ac05bca0 msgr2=0x7f63ac05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- 172.21.15.41:0/1442099026 shutdown_connections 2021-10-21T00:03:34.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- 172.21.15.41:0/1442099026 wait complete. 2021-10-21T00:03:34.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 Processor -- start 2021-10-21T00:03:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.968+0000 7f63b22dc700 1 -- start start 2021-10-21T00:03:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ac05f9f0 0x7f63ac15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ac0aa750 0x7f63ac14b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac159920 con 0x7f63ac14b350 2021-10-21T00:03:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac159b50 con 0x7f63ac0aa750 2021-10-21T00:03:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac159df0 con 0x7f63ac05f9f0 2021-10-21T00:03:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58882/0 (socket says 172.21.15.41:58882) 2021-10-21T00:03:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 -- 172.21.15.41:0/762366179 learned_addr learned my addr 172.21.15.41:0/762366179 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63ab7fe700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ac0aa750 0x7f63ac14b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63abfff700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ac05f9f0 0x7f63ac15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 -- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ac05f9f0 msgr2=0x7f63ac15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ac05f9f0 0x7f63ac15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 -- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ac0aa750 msgr2=0x7f63ac14b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ac0aa750 0x7f63ac14b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 -- 172.21.15.41:0/762366179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4009530 con 0x7f63ac14b350 2021-10-21T00:03:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b0879700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f63a40032f0 tx=0x7f63a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a4021630 con 0x7f63ac14b350 2021-10-21T00:03:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4021790 con 0x7f63ac14b350 2021-10-21T00:03:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac15a780 con 0x7f63ac14b350 2021-10-21T00:03:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63a4021af0 con 0x7f63ac14b350 2021-10-21T00:03:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac14bca0 con 0x7f63ac14b350 2021-10-21T00:03:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.972+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac159fb0 con 0x7f63ac14b350 2021-10-21T00:03:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.976+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63a400f070 con 0x7f63ac14b350 2021-10-21T00:03:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.976+0000 7f63a97fa700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 0x7f638c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.976+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f63a406ccc0 con 0x7f63ac14b350 2021-10-21T00:03:34.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.976+0000 7f63abfff700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 0x7f638c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.976+0000 7f63abfff700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 0x7f638c055b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f639c00b000 tx=0x7f639c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:33.984+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63a4044150 con 0x7f63ac14b350 2021-10-21T00:03:34.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.152+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f63ac0678f0 con 0x7f63ac14b350 2021-10-21T00:03:34.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63a97fa700 1 -- 172.21.15.41:0/762366179 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f63a4015030 con 0x7f63ac14b350 2021-10-21T00:03:34.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 msgr2=0x7f638c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 0x7f638c055b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f639c00b000 tx=0x7f639c009040).stop 2021-10-21T00:03:34.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 msgr2=0x7f63ac145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f63a40032f0 tx=0x7f63a4016000).stop 2021-10-21T00:03:34.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 shutdown_connections 2021-10-21T00:03:34.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f638c0536d0 0x7f638c055b90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ac14b350 0x7f63ac145480 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ac0aa750 0x7f63ac14b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 --2- 172.21.15.41:0/762366179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ac05f9f0 0x7f63ac15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 >> 172.21.15.41:0/762366179 conn(0x7f63ac05bca0 msgr2=0x7f63ac0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 shutdown_connections 2021-10-21T00:03:34.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.160+0000 7f63b22dc700 1 -- 172.21.15.41:0/762366179 wait complete. 2021-10-21T00:03:34.174 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:34.181 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-10-21T00:03:34.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 Processor -- start 2021-10-21T00:03:34.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 -- start start 2021-10-21T00:03:34.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f198002cfa0 0x7f1980041240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198000f0c0 con 0x7f198000de30 2021-10-21T00:03:34.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198000ee20 con 0x7f19800450a0 2021-10-21T00:03:34.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f198cb02700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198003fa50 con 0x7f198002cfa0 2021-10-21T00:03:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f19877fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f198000de30 0x7f198002c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56656/0 (socket says 172.21.15.41:56656) 2021-10-21T00:03:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f19877fe700 1 -- 172.21.15.41:0/49865486 learned_addr learned my addr 172.21.15.41:0/49865486 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.288+0000 7f1987fff700 1 --2- 172.21.15.41:0/49865486 >> v2:172.21.15.41:3300/0 conn(0x7f198002cfa0 0x7f1980041240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f1987fff700 1 -- 172.21.15.41:0/49865486 >> v1:172.21.15.62:6789/0 conn(0x7f19800450a0 legacy=0x7f1980040b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f1987fff700 1 -- 172.21.15.41:0/49865486 >> v1:172.21.15.41:6789/0 conn(0x7f198000de30 legacy=0x7f198002c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f1987fff700 1 -- 172.21.15.41:0/49865486 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980046150 con 0x7f198002cfa0 2021-10-21T00:03:34.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f1987fff700 1 --2- 172.21.15.41:0/49865486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f198002cfa0 0x7f1980041240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f1988044ee0 tx=0x7f198805f5c0).ready entity=mon.0 client_cookie=e1f9f6e43ba74f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f19867fc700 1 -- 172.21.15.41:0/49865486 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1988061110 con 0x7f198002cfa0 2021-10-21T00:03:34.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f19867fc700 1 -- 172.21.15.41:0/49865486 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198806afe0 con 0x7f198002cfa0 2021-10-21T00:03:34.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f19867fc700 1 -- 172.21.15.41:0/49865486 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f198805f120 con 0x7f198002cfa0 2021-10-21T00:03:34.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- 172.21.15.41:0/49865486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f198002cfa0 msgr2=0x7f1980041240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 --2- 172.21.15.41:0/49865486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f198002cfa0 0x7f1980041240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f1988044ee0 tx=0x7f198805f5c0).stop 2021-10-21T00:03:34.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- 172.21.15.41:0/49865486 shutdown_connections 2021-10-21T00:03:34.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 --2- 172.21.15.41:0/49865486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f198002cfa0 0x7f1980041240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- 172.21.15.41:0/49865486 >> 172.21.15.41:0/49865486 conn(0x7f198004a700 msgr2=0x7f198004aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- 172.21.15.41:0/49865486 shutdown_connections 2021-10-21T00:03:34.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- 172.21.15.41:0/49865486 wait complete. 2021-10-21T00:03:34.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 Processor -- start 2021-10-21T00:03:34.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.292+0000 7f198cb02700 1 -- start start 2021-10-21T00:03:34.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f198000de30 0x7f19800e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f198002cfa0 0x7f19800301d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1980042070 con 0x7f19800450a0 2021-10-21T00:03:34.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800e6bf0 con 0x7f198000de30 2021-10-21T00:03:34.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19800e6e90 con 0x7f198002cfa0 2021-10-21T00:03:34.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f19877fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f198000de30 0x7f19800e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58896/0 (socket says 172.21.15.41:58896) 2021-10-21T00:03:34.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 -- 172.21.15.41:0/2275019913 learned_addr learned my addr 172.21.15.41:0/2275019913 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1986ffd700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f198002cfa0 0x7f19800301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 -- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f198002cfa0 msgr2=0x7f19800301d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f198002cfa0 0x7f19800301d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 -- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f198000de30 msgr2=0x7f19800e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f198000de30 0x7f19800e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 -- 172.21.15.41:0/2275019913 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800e7130 con 0x7f19800450a0 2021-10-21T00:03:34.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1987fff700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1988044ee0 tx=0x7f1988061000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1988068770 con 0x7f19800450a0 2021-10-21T00:03:34.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1980042260 con 0x7f19800450a0 2021-10-21T00:03:34.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988080950 con 0x7f19800450a0 2021-10-21T00:03:34.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1988080cb0 con 0x7f19800450a0 2021-10-21T00:03:34.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19800210d0 con 0x7f19800450a0 2021-10-21T00:03:34.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.296+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19800e72c0 con 0x7f19800450a0 2021-10-21T00:03:34.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.300+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f198805ce20 con 0x7f19800450a0 2021-10-21T00:03:34.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.300+0000 7f1984ff9700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 0x7f1968055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.300+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f19880da050 con 0x7f19800450a0 2021-10-21T00:03:34.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.300+0000 7f19877fe700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 0x7f1968055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.300+0000 7f19877fe700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 0x7f1968055a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f197c00d000 tx=0x7f197c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.304+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19880b13e0 con 0x7f19800450a0 2021-10-21T00:03:34.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.472+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1980029e30 con 0x7f19800450a0 2021-10-21T00:03:34.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f1984ff9700 1 -- 172.21.15.41:0/2275019913 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f19880b4a00 con 0x7f19800450a0 2021-10-21T00:03:34.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 msgr2=0x7f1968055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 0x7f1968055a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f197c00d000 tx=0x7f197c009040).stop 2021-10-21T00:03:34.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 msgr2=0x7f1980040a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1988044ee0 tx=0x7f1988061000).stop 2021-10-21T00:03:34.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 shutdown_connections 2021-10-21T00:03:34.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1968053580 0x7f1968055a40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f19800450a0 0x7f1980040a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f198002cfa0 0x7f19800301d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 --2- 172.21.15.41:0/2275019913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f198000de30 0x7f19800e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 >> 172.21.15.41:0/2275019913 conn(0x7f198004a700 msgr2=0x7f19800d6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 shutdown_connections 2021-10-21T00:03:34.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.480+0000 7f198cb02700 1 -- 172.21.15.41:0/2275019913 wait complete. 2021-10-21T00:03:34.492 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:34.501 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-10-21T00:03:34.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.604+0000 7fd469548700 1 Processor -- start 2021-10-21T00:03:34.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.604+0000 7fd469548700 1 -- start start 2021-10-21T00:03:34.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd464066f50 0x7fd4641407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd464144aa0 0x7fd46413d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd464067330 con 0x7fd4640b2bd0 2021-10-21T00:03:34.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd464140c90 con 0x7fd464144aa0 2021-10-21T00:03:34.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640b2180 con 0x7fd464066f50 2021-10-21T00:03:34.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd464144aa0 0x7fd46413d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd464144aa0 0x7fd46413d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58904/0 (socket says 172.21.15.41:58904) 2021-10-21T00:03:34.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4627fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd4640b2bd0 0x7fd464144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56670/0 (socket says 172.21.15.41:56670) 2021-10-21T00:03:34.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 -- 172.21.15.41:0/2286828388 learned_addr learned my addr 172.21.15.41:0/2286828388 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd462ffd700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd464066f50 0x7fd4641407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 -- 172.21.15.41:0/2286828388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd464066f50 msgr2=0x7fd4641407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:34.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd464066f50 0x7fd4641407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 -- 172.21.15.41:0/2286828388 >> v1:172.21.15.41:6789/0 conn(0x7fd4640b2bd0 legacy=0x7fd464144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd461ffb700 1 -- 172.21.15.41:0/2286828388 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012156188 0 0) 0x7fd464067330 con 0x7fd4640b2bd0 2021-10-21T00:03:34.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 -- 172.21.15.41:0/2286828388 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640b2420 con 0x7fd464144aa0 2021-10-21T00:03:34.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd4637fe700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464144aa0 0x7fd46413d620 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fd45c002f70 tx=0x7fd45c006eb0).ready entity=mon.0 client_cookie=dac5d14b774b9338 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd461ffb700 1 -- 172.21.15.41:0/2286828388 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45c00d570 con 0x7fd464144aa0 2021-10-21T00:03:34.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd461ffb700 1 -- 172.21.15.41:0/2286828388 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c000e90 con 0x7fd464144aa0 2021-10-21T00:03:34.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd461ffb700 1 -- 172.21.15.41:0/2286828388 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd45c00d8c0 con 0x7fd464144aa0 2021-10-21T00:03:34.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- 172.21.15.41:0/2286828388 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464144aa0 msgr2=0x7fd46413d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464144aa0 0x7fd46413d620 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fd45c002f70 tx=0x7fd45c006eb0).stop 2021-10-21T00:03:34.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- 172.21.15.41:0/2286828388 shutdown_connections 2021-10-21T00:03:34.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464144aa0 0x7fd46413d620 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 --2- 172.21.15.41:0/2286828388 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd464066f50 0x7fd4641407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- 172.21.15.41:0/2286828388 >> 172.21.15.41:0/2286828388 conn(0x7fd4640639f0 msgr2=0x7fd464063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- 172.21.15.41:0/2286828388 shutdown_connections 2021-10-21T00:03:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.608+0000 7fd469548700 1 -- 172.21.15.41:0/2286828388 wait complete. 2021-10-21T00:03:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 Processor -- start 2021-10-21T00:03:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- start start 2021-10-21T00:03:34.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 0x7fd464153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 0x7fd4640af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46410f290 con 0x7fd464066f50 2021-10-21T00:03:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641112c0 con 0x7fd464144aa0 2021-10-21T00:03:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464150c60 con 0x7fd4640b2bd0 2021-10-21T00:03:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58906/0 (socket says 172.21.15.41:58906) 2021-10-21T00:03:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 -- 172.21.15.41:0/876769938 learned_addr learned my addr 172.21.15.41:0/876769938 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd4627fc700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 0x7fd464153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd4637fe700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 0x7fd4640af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 -- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 msgr2=0x7fd464153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 0x7fd464153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 -- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 msgr2=0x7fd4640af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 0x7fd4640af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 -- 172.21.15.41:0/876769938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c00b1e0 con 0x7fd464066f50 2021-10-21T00:03:34.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd4627fc700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 0x7fd464153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:34.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd4637fe700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 0x7fd4640af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:34.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd462ffd700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd45400c000 tx=0x7fd454006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd454010780 con 0x7fd464066f50 2021-10-21T00:03:34.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540108e0 con 0x7fd464066f50 2021-10-21T00:03:34.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464153100 con 0x7fd464066f50 2021-10-21T00:03:34.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd454010c40 con 0x7fd464066f50 2021-10-21T00:03:34.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.612+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464153e30 con 0x7fd464066f50 2021-10-21T00:03:34.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464111480 con 0x7fd464066f50 2021-10-21T00:03:34.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd45401c460 con 0x7fd464066f50 2021-10-21T00:03:34.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd45bfff700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 0x7fd448055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd45406bc60 con 0x7fd464066f50 2021-10-21T00:03:34.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd4627fc700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 0x7fd448055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.616+0000 7fd4627fc700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 0x7fd448055b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd44c008000 tx=0x7fd44c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.620+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd454042f80 con 0x7fd464066f50 2021-10-21T00:03:34.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.788+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd464143ef0 con 0x7fd464066f50 2021-10-21T00:03:34.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.796+0000 7fd45bfff700 1 -- 172.21.15.41:0/876769938 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd4540465a0 con 0x7fd464066f50 2021-10-21T00:03:34.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 msgr2=0x7fd448055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 0x7fd448055b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd44c008000 tx=0x7fd44c009040).stop 2021-10-21T00:03:34.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 msgr2=0x7fd464110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd45400c000 tx=0x7fd454006df0).stop 2021-10-21T00:03:34.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 shutdown_connections 2021-10-21T00:03:34.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4480536a0 0x7fd448055b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd464144aa0 0x7fd4640af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4640b2bd0 0x7fd464153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 --2- 172.21.15.41:0/876769938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd464066f50 0x7fd464110230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 >> 172.21.15.41:0/876769938 conn(0x7fd4640639f0 msgr2=0x7fd46413f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 shutdown_connections 2021-10-21T00:03:34.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.800+0000 7fd469548700 1 -- 172.21.15.41:0/876769938 wait complete. 2021-10-21T00:03:34.813 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:34.820 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-10-21T00:03:34.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 Processor -- start 2021-10-21T00:03:34.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- start start 2021-10-21T00:03:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b4062330 0x7f50b40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50b4062f70 0x7f50b405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b405bd40 con 0x7f50b40b3a20 2021-10-21T00:03:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b405bf70 con 0x7f50b4062f70 2021-10-21T00:03:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4142cb0 con 0x7f50b4062330 2021-10-21T00:03:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50b4062f70 0x7f50b405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f50b4062f70 0x7f50b405c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58916/0 (socket says 172.21.15.41:58916) 2021-10-21T00:03:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 -- 172.21.15.41:0/320024502 learned_addr learned my addr 172.21.15.41:0/320024502 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b37fe700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b4062330 0x7f50b40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 -- 172.21.15.41:0/320024502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b4062330 msgr2=0x7f50b40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b4062330 0x7f50b40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 -- 172.21.15.41:0/320024502 >> v1:172.21.15.62:6789/0 conn(0x7f50b40b3a20 legacy=0x7f50b413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 -- 172.21.15.41:0/320024502 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4142950 con 0x7f50b4062f70 2021-10-21T00:03:34.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b2ffd700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b405c410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f509c002f70 tx=0x7f509c006eb0).ready entity=mon.0 client_cookie=7f781082c92999dd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b27fc700 1 -- 172.21.15.41:0/320024502 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c00d5c0 con 0x7f50b4062f70 2021-10-21T00:03:34.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b27fc700 1 -- 172.21.15.41:0/320024502 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c000e90 con 0x7f50b4062f70 2021-10-21T00:03:34.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b27fc700 1 -- 172.21.15.41:0/320024502 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c00d950 con 0x7f50b4062f70 2021-10-21T00:03:34.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- 172.21.15.41:0/320024502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 msgr2=0x7f50b405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b405c410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f509c002f70 tx=0x7f509c006eb0).stop 2021-10-21T00:03:34.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- 172.21.15.41:0/320024502 shutdown_connections 2021-10-21T00:03:34.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b405c410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/320024502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b4062330 0x7f50b40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.936+0000 7f50b8f5b700 1 -- 172.21.15.41:0/320024502 >> 172.21.15.41:0/320024502 conn(0x7f50b40b9080 msgr2=0x7f50b40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:34.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.940+0000 7f50b8f5b700 1 -- 172.21.15.41:0/320024502 shutdown_connections 2021-10-21T00:03:34.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.940+0000 7f50b8f5b700 1 -- 172.21.15.41:0/320024502 wait complete. 2021-10-21T00:03:34.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.940+0000 7f50b8f5b700 1 Processor -- start 2021-10-21T00:03:34.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.940+0000 7f50b8f5b700 1 -- start start 2021-10-21T00:03:34.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4062330 0x7f50b4112d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b40b3a20 0x7f50b4145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b40af4f0 con 0x7f50b4062f70 2021-10-21T00:03:34.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58922/0 (socket says 172.21.15.41:58922) 2021-10-21T00:03:34.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4143e70 con 0x7f50b4062330 2021-10-21T00:03:34.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 -- 172.21.15.41:0/308308120 learned_addr learned my addr 172.21.15.41:0/308308120 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:34.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b41449e0 con 0x7f50b40b3a20 2021-10-21T00:03:34.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b37fe700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4062330 0x7f50b4112d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b3fff700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b40b3a20 0x7f50b4145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 -- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b40b3a20 msgr2=0x7f50b4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b40b3a20 0x7f50b4145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 -- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4062330 msgr2=0x7f50b4112d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:34.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4062330 0x7f50b4112d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:34.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c00b1e0 con 0x7f50b4062f70 2021-10-21T00:03:34.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b2ffd700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f509c002f70 tx=0x7f509c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c006b40 con 0x7f50b4062f70 2021-10-21T00:03:34.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c00d940 con 0x7f50b4062f70 2021-10-21T00:03:34.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4144c80 con 0x7f50b4062f70 2021-10-21T00:03:34.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c011d30 con 0x7f50b4062f70 2021-10-21T00:03:34.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b4144480 con 0x7f50b4062f70 2021-10-21T00:03:34.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b4057350 con 0x7f50b4062f70 2021-10-21T00:03:34.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f509c025030 con 0x7f50b4062f70 2021-10-21T00:03:34.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 0x7f5098055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:34.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.944+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f509c06c7a0 con 0x7f50b4062f70 2021-10-21T00:03:34.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.948+0000 7f50b37fe700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 0x7f5098055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:34.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.948+0000 7f50b37fe700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 0x7f5098055b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f50ac00d000 tx=0x7f50ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:34.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:34.952+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f509c043c30 con 0x7f50b4062f70 2021-10-21T00:03:35.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.124+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f50b405cc50 con 0x7f50b4062f70 2021-10-21T00:03:35.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.128+0000 7f50b0ff9700 1 -- 172.21.15.41:0/308308120 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f509c023020 con 0x7f50b4062f70 2021-10-21T00:03:35.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 msgr2=0x7f5098055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 0x7f5098055b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f50ac00d000 tx=0x7f50ac008040).stop 2021-10-21T00:03:35.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 msgr2=0x7f50b4145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f509c002f70 tx=0x7f509c015000).stop 2021-10-21T00:03:35.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 shutdown_connections 2021-10-21T00:03:35.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5098053640 0x7f5098055b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50b40b3a20 0x7f50b4145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50b4062f70 0x7f50b4145330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 --2- 172.21.15.41:0/308308120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50b4062330 0x7f50b4112d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 >> 172.21.15.41:0/308308120 conn(0x7f50b40b9080 msgr2=0x7f50b4142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 shutdown_connections 2021-10-21T00:03:35.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.132+0000 7f50b8f5b700 1 -- 172.21.15.41:0/308308120 wait complete. 2021-10-21T00:03:35.146 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:35.151 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-10-21T00:03:35.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 Processor -- start 2021-10-21T00:03:35.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 -- start start 2021-10-21T00:03:35.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 0x7f4c540b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 0x7f4c5413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540b6350 con 0x7f4c540b5f70 2021-10-21T00:03:35.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540b0e10 con 0x7f4c541423a0 2021-10-21T00:03:35.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c5aef2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540b10b0 con 0x7f4c54067a00 2021-10-21T00:03:35.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c59ef0700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4c540b5f70 0x7f4c540672f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56698/0 (socket says 172.21.15.41:56698) 2021-10-21T00:03:35.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.272+0000 7f4c59ef0700 1 -- 172.21.15.41:0/527185628 learned_addr learned my addr 172.21.15.41:0/527185628 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:35.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 --2- 172.21.15.41:0/527185628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 0x7f4c540b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5a6f1700 1 --2- 172.21.15.41:0/527185628 >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 0x7f4c5413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c58eee700 1 -- 172.21.15.41:0/527185628 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724372431 0 0) 0x7f4c540b6350 con 0x7f4c540b5f70 2021-10-21T00:03:35.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c58eee700 1 -- 172.21.15.41:0/527185628 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c003260 con 0x7f4c540b5f70 2021-10-21T00:03:35.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 -- 172.21.15.41:0/527185628 >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 msgr2=0x7f4c5413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:35.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 --2- 172.21.15.41:0/527185628 >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 0x7f4c5413ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 -- 172.21.15.41:0/527185628 >> v1:172.21.15.41:6789/0 conn(0x7f4c540b5f70 legacy=0x7f4c540672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 -- 172.21.15.41:0/527185628 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540b1350 con 0x7f4c54067a00 2021-10-21T00:03:35.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5a6f1700 1 --2- 172.21.15.41:0/527185628 >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 0x7f4c5413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:35.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c596ef700 1 --2- 172.21.15.41:0/527185628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 0x7f4c540b1a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4c44002f70 tx=0x7f4c44006df0).ready entity=mon.2 client_cookie=ba49747aefd968d4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c58eee700 1 -- 172.21.15.41:0/527185628 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4400d4a0 con 0x7f4c54067a00 2021-10-21T00:03:35.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c58eee700 1 -- 172.21.15.41:0/527185628 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c44000e90 con 0x7f4c54067a00 2021-10-21T00:03:35.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c58eee700 1 -- 172.21.15.41:0/527185628 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4400d7f0 con 0x7f4c54067a00 2021-10-21T00:03:35.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- 172.21.15.41:0/527185628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 msgr2=0x7f4c540b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/527185628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 0x7f4c540b1a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4c44002f70 tx=0x7f4c44006df0).stop 2021-10-21T00:03:35.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- 172.21.15.41:0/527185628 shutdown_connections 2021-10-21T00:03:35.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/527185628 >> v2:172.21.15.62:3300/0 conn(0x7f4c541423a0 0x7f4c5413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/527185628 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c54067a00 0x7f4c540b1a90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- 172.21.15.41:0/527185628 >> 172.21.15.41:0/527185628 conn(0x7f4c540639f0 msgr2=0x7f4c540b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- 172.21.15.41:0/527185628 shutdown_connections 2021-10-21T00:03:35.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- 172.21.15.41:0/527185628 wait complete. 2021-10-21T00:03:35.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 Processor -- start 2021-10-21T00:03:35.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.276+0000 7f4c5aef2700 1 -- start start 2021-10-21T00:03:35.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c540b5f70 0x7f4c5414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c541423a0 0x7f4c5414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54112790 con 0x7f4c54067a00 2021-10-21T00:03:35.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54112a30 con 0x7f4c541423a0 2021-10-21T00:03:35.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c541124d0 con 0x7f4c540b5f70 2021-10-21T00:03:35.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58934/0 (socket says 172.21.15.41:58934) 2021-10-21T00:03:35.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 -- 172.21.15.41:0/155921690 learned_addr learned my addr 172.21.15.41:0/155921690 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:35.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c596ef700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c540b5f70 0x7f4c5414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5a6f1700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c541423a0 0x7f4c5414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 -- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c540b5f70 msgr2=0x7f4c5414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c540b5f70 0x7f4c5414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 -- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c541423a0 msgr2=0x7f4c5414fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c541423a0 0x7f4c5414fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 -- 172.21.15.41:0/155921690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009470 con 0x7f4c54067a00 2021-10-21T00:03:35.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c59ef0700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f4c50001110 tx=0x7f4c50007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c500070d0 con 0x7f4c54067a00 2021-10-21T00:03:35.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50007230 con 0x7f4c54067a00 2021-10-21T00:03:35.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c50005610 con 0x7f4c54067a00 2021-10-21T00:03:35.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4400b180 con 0x7f4c54067a00 2021-10-21T00:03:35.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.280+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c54111300 con 0x7f4c54067a00 2021-10-21T00:03:35.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540b15f0 con 0x7f4c54067a00 2021-10-21T00:03:35.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c50010070 con 0x7f4c54067a00 2021-10-21T00:03:35.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c42ffd700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 0x7f4c340559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4c5006ad00 con 0x7f4c54067a00 2021-10-21T00:03:35.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c596ef700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 0x7f4c340559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.284+0000 7f4c596ef700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 0x7f4c340559e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f4c4401a000 tx=0x7f4c44014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.288+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c50042080 con 0x7f4c54067a00 2021-10-21T00:03:35.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.464+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4c54057350 con 0x7f4c54067a00 2021-10-21T00:03:35.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c42ffd700 1 -- 172.21.15.41:0/155921690 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c50018030 con 0x7f4c54067a00 2021-10-21T00:03:35.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 msgr2=0x7f4c340559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 0x7f4c340559e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f4c4401a000 tx=0x7f4c44014000).stop 2021-10-21T00:03:35.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 msgr2=0x7f4c54110c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f4c50001110 tx=0x7f4c50007aa0).stop 2021-10-21T00:03:35.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 shutdown_connections 2021-10-21T00:03:35.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c34053520 0x7f4c340559e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c541423a0 0x7f4c5414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4c540b5f70 0x7f4c5414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 --2- 172.21.15.41:0/155921690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4c54067a00 0x7f4c54110c70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 >> 172.21.15.41:0/155921690 conn(0x7f4c540639f0 msgr2=0x7f4c540b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 shutdown_connections 2021-10-21T00:03:35.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.472+0000 7f4c5aef2700 1 -- 172.21.15.41:0/155921690 wait complete. 2021-10-21T00:03:35.483 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:35.496 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-10-21T00:03:35.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 Processor -- start 2021-10-21T00:03:35.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 -- start start 2021-10-21T00:03:35.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40cc097f40 0x7f40cc0983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc13f560 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc13cfd0 con 0x7f40cc0b0b40 2021-10-21T00:03:35.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d2af6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc13f790 con 0x7f40cc097f40 2021-10-21T00:03:35.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d1af4700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f40cc0b1fd0 0x7f40cc13fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56714/0 (socket says 172.21.15.41:56714) 2021-10-21T00:03:35.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.592+0000 7f40d1af4700 1 -- 172.21.15.41:0/711744246 learned_addr learned my addr 172.21.15.41:0/711744246 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:35.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d22f5700 1 --2- 172.21.15.41:0/711744246 >> v2:172.21.15.62:3300/0 conn(0x7f40cc097f40 0x7f40cc0983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632696859 0 0) 0x7f40cc13f560 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b4003260 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d22f5700 1 -- 172.21.15.41:0/711744246 >> v1:172.21.15.62:6789/0 conn(0x7f40cc0b0b40 legacy=0x7f40cc0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d22f5700 1 -- 172.21.15.41:0/711744246 >> v1:172.21.15.41:6789/0 conn(0x7f40cc0b1fd0 legacy=0x7f40cc13fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2800737807 0 0) 0x7f40b4003260 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d22f5700 1 -- 172.21.15.41:0/711744246 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc13fa30 con 0x7f40cc097f40 2021-10-21T00:03:35.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d22f5700 1 --2- 172.21.15.41:0/711744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0983b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f40c8001800 tx=0x7f40c40091d0).ready entity=mon.1 client_cookie=bd67952b4149308c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40c8001660 con 0x7f40cc097f40 2021-10-21T00:03:35.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400b580 con 0x7f40cc097f40 2021-10-21T00:03:35.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d0af2700 1 -- 172.21.15.41:0/711744246 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40c400b6f0 con 0x7f40cc097f40 2021-10-21T00:03:35.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- 172.21.15.41:0/711744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 msgr2=0x7f40cc0983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 --2- 172.21.15.41:0/711744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0983b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f40c8001800 tx=0x7f40c40091d0).stop 2021-10-21T00:03:35.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- 172.21.15.41:0/711744246 shutdown_connections 2021-10-21T00:03:35.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 --2- 172.21.15.41:0/711744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0983b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- 172.21.15.41:0/711744246 >> 172.21.15.41:0/711744246 conn(0x7f40cc0b5700 msgr2=0x7f40cc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- 172.21.15.41:0/711744246 shutdown_connections 2021-10-21T00:03:35.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- 172.21.15.41:0/711744246 wait complete. 2021-10-21T00:03:35.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 Processor -- start 2021-10-21T00:03:35.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.596+0000 7f40d2af6700 1 -- start start 2021-10-21T00:03:35.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40cc0b0b40 0x7f40cc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0ad120 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0ad3c0 con 0x7f40cc097f40 2021-10-21T00:03:35.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0ad660 con 0x7f40cc0b0b40 2021-10-21T00:03:35.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58952/0 (socket says 172.21.15.41:58952) 2021-10-21T00:03:35.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 -- 172.21.15.41:0/3637662951 learned_addr learned my addr 172.21.15.41:0/3637662951 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:35.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d12f3700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40cc0b0b40 0x7f40cc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d1af4700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 -- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40cc0b0b40 msgr2=0x7f40cc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40cc0b0b40 0x7f40cc0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 -- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 msgr2=0x7f40cc0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 -- 172.21.15.41:0/3637662951 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009470 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d1af4700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:35.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d22f5700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f40c8001800 tx=0x7f40c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40c400b6f0 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc13c530 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c40032f0 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40c4021480 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc141d10 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.600+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc0b1130 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.604+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f40c400f070 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.604+0000 7f40beffd700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 0x7f40ac055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.604+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f40c406ca40 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.604+0000 7f40d1af4700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 0x7f40ac055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.604+0000 7f40d1af4700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 0x7f40ac055a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f40c800b000 tx=0x7f40c8000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.608+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40c4043d40 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.776+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f40cc057350 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.780+0000 7f40beffd700 1 -- 172.21.15.41:0/3637662951 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f40c4015020 con 0x7f40cc0b1fd0 2021-10-21T00:03:35.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 msgr2=0x7f40ac055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 0x7f40ac055a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f40c800b000 tx=0x7f40c8000bc0).stop 2021-10-21T00:03:35.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 msgr2=0x7f40cc141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f40c8001800 tx=0x7f40c4016000).stop 2021-10-21T00:03:35.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 shutdown_connections 2021-10-21T00:03:35.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40ac0535b0 0x7f40ac055a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40cc0b1fd0 0x7f40cc141680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40cc0b0b40 0x7f40cc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 --2- 172.21.15.41:0/3637662951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40cc097f40 0x7f40cc0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 >> 172.21.15.41:0/3637662951 conn(0x7f40cc0b5700 msgr2=0x7f40cc099030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 shutdown_connections 2021-10-21T00:03:35.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.784+0000 7f40d2af6700 1 -- 172.21.15.41:0/3637662951 wait complete. 2021-10-21T00:03:35.793 INFO:teuthology.orchestra.run.smithi041.stderr:updated 2021-10-21T00:03:35.801 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:35.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.896+0000 7fdd9ac01700 1 Processor -- start 2021-10-21T00:03:35.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.896+0000 7fdd9ac01700 1 -- start start 2021-10-21T00:03:35.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdd9405f9f0 0x7fdd9414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 0x7fdd9414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940609d0 con 0x7fdd9414b130 2021-10-21T00:03:35.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940b1620 con 0x7fdd9405f9f0 2021-10-21T00:03:35.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9405fdd0 con 0x7fdd940aa750 2021-10-21T00:03:35.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdd9405f9f0 0x7fdd9414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9919e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdd9414b130 0x7fdd941495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56728/0 (socket says 172.21.15.41:56728) 2021-10-21T00:03:35.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9919e700 1 -- 172.21.15.41:0/3554180670 learned_addr learned my addr 172.21.15.41:0/3554180670 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:35.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd93fff700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 0x7fdd9414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd937fe700 1 -- 172.21.15.41:0/3554180670 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666564249 0 0) 0x7fdd940609d0 con 0x7fdd9414b130 2021-10-21T00:03:35.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd937fe700 1 -- 172.21.15.41:0/3554180670 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd74003260 con 0x7fdd9414b130 2021-10-21T00:03:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 -- 172.21.15.41:0/3554180670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 msgr2=0x7fdd9414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 0x7fdd9414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 -- 172.21.15.41:0/3554180670 >> v1:172.21.15.41:6789/0 conn(0x7fdd9414b130 legacy=0x7fdd941495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 -- 172.21.15.41:0/3554180670 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940b1380 con 0x7fdd9405f9f0 2021-10-21T00:03:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd93fff700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 0x7fdd9414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:35.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9899d700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9405f9f0 0x7fdd9414a750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fdd840032f0 tx=0x7fdd840091d0).ready entity=mon.0 client_cookie=4fd0518aabf2ca00 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd937fe700 1 -- 172.21.15.41:0/3554180670 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8400b6c0 con 0x7fdd9405f9f0 2021-10-21T00:03:35.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd937fe700 1 -- 172.21.15.41:0/3554180670 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400b820 con 0x7fdd9405f9f0 2021-10-21T00:03:35.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd937fe700 1 -- 172.21.15.41:0/3554180670 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8400b990 con 0x7fdd9405f9f0 2021-10-21T00:03:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- 172.21.15.41:0/3554180670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9405f9f0 msgr2=0x7fdd9414a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9405f9f0 0x7fdd9414a750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fdd840032f0 tx=0x7fdd840091d0).stop 2021-10-21T00:03:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- 172.21.15.41:0/3554180670 shutdown_connections 2021-10-21T00:03:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd940aa750 0x7fdd9414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/3554180670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9405f9f0 0x7fdd9414a750 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- 172.21.15.41:0/3554180670 >> 172.21.15.41:0/3554180670 conn(0x7fdd9405bca0 msgr2=0x7fdd9405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- 172.21.15.41:0/3554180670 shutdown_connections 2021-10-21T00:03:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.900+0000 7fdd9ac01700 1 -- 172.21.15.41:0/3554180670 wait complete. 2021-10-21T00:03:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 Processor -- start 2021-10-21T00:03:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- start start 2021-10-21T00:03:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 0x7fdd940aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd940aa750 0x7fdd94098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940ae530 con 0x7fdd9414b130 2021-10-21T00:03:35.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940ae760 con 0x7fdd940aa750 2021-10-21T00:03:35.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940992b0 con 0x7fdd9405f9f0 2021-10-21T00:03:35.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58964/0 (socket says 172.21.15.41:58964) 2021-10-21T00:03:35.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 -- 172.21.15.41:0/11750633 learned_addr learned my addr 172.21.15.41:0/11750633 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:35.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd93fff700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd940aa750 0x7fdd94098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9899d700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 0x7fdd940aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 -- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 msgr2=0x7fdd940aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 0x7fdd940aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 -- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd940aa750 msgr2=0x7fdd94098dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:35.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd940aa750 0x7fdd94098dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:35.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 -- 172.21.15.41:0/11750633 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009470 con 0x7fdd9414b130 2021-10-21T00:03:35.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9899d700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 0x7fdd940aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:35.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9919e700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd8c001110 tx=0x7fdd8c007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8c0070d0 con 0x7fdd9414b130 2021-10-21T00:03:35.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c007230 con 0x7fdd9414b130 2021-10-21T00:03:35.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd94156130 con 0x7fdd9414b130 2021-10-21T00:03:35.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8c005610 con 0x7fdd9414b130 2021-10-21T00:03:35.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.904+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd94146b20 con 0x7fdd9414b130 2021-10-21T00:03:35.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd940adcf0 con 0x7fdd9414b130 2021-10-21T00:03:35.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd8c010070 con 0x7fdd9414b130 2021-10-21T00:03:35.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd91ffb700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 0x7fdd78055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:35.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdd8c06ab30 con 0x7fdd9414b130 2021-10-21T00:03:35.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd9899d700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 0x7fdd78055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:35.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.908+0000 7fdd9899d700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 0x7fdd78055a40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fdd8400b000 tx=0x7fdd84016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:35.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:35.912+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd940adcf0 con 0x7fdd9414b130 2021-10-21T00:03:36.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd94099530 con 0x7fdd9414b130 2021-10-21T00:03:36.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd91ffb700 1 -- 172.21.15.41:0/11750633 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+13181 (secure 0 0 0) 0x7fdd8c018030 con 0x7fdd9414b130 2021-10-21T00:03:36.047 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:36.047 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:03:33.474293+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 msgr2=0x7fdd78055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 0x7fdd78055a40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fdd8400b000 tx=0x7fdd84016000).stop 2021-10-21T00:03:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 msgr2=0x7fdd94146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd8c001110 tx=0x7fdd8c007a20).stop 2021-10-21T00:03:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 shutdown_connections 2021-10-21T00:03:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdd78053580 0x7fdd78055a40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdd9414b130 0x7fdd94146490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd940aa750 0x7fdd94098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 --2- 172.21.15.41:0/11750633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd9405f9f0 0x7fdd940aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 >> 172.21.15.41:0/11750633 conn(0x7fdd9405bca0 msgr2=0x7fdd940b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 shutdown_connections 2021-10-21T00:03:36.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.040+0000 7fdd9ac01700 1 -- 172.21.15.41:0/11750633 wait complete. 2021-10-21T00:03:36.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:03:36.061 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:36.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 Processor -- start 2021-10-21T00:03:36.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 -- start start 2021-10-21T00:03:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 0x7f9dc8143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9dc80b2370 0x7f9dc80b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 0x7f9dc813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc80afb00 con 0x7f9dc80b2370 2021-10-21T00:03:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc80afdf0 con 0x7f9dc80af720 2021-10-21T00:03:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.168+0000 7f9dcf0a4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80b0090 con 0x7f9dc805f6b0 2021-10-21T00:03:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9dc80b2370 0x7f9dc80b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dce8a3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 0x7f9dc813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dce0a2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 0x7f9dc8143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dce8a3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 0x7f9dc813d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49236/0 (socket says 172.21.15.41:49236) 2021-10-21T00:03:36.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dce0a2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 0x7f9dc8143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42654/0 (socket says 172.21.15.41:42654) 2021-10-21T00:03:36.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dce8a3700 1 -- 172.21.15.41:0/1222998369 learned_addr learned my addr 172.21.15.41:0/1222998369 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:36.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/1222998369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 msgr2=0x7f9dc813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/1222998369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 0x7f9dc813d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/1222998369 >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 msgr2=0x7f9dc8143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/1222998369 >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 0x7f9dc8143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/1222998369 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80b2bc0 con 0x7f9dc80b2370 2021-10-21T00:03:36.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/1222998369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80b2370 0x7f9dc80b3060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f9dbc002f70 tx=0x7f9dbc006df0).ready entity=mon.0 client_cookie=623801158cbffdb5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd0a0700 1 -- 172.21.15.41:0/1222998369 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc00d4a0 con 0x7f9dc80b2370 2021-10-21T00:03:36.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd0a0700 1 -- 172.21.15.41:0/1222998369 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc000e90 con 0x7f9dc80b2370 2021-10-21T00:03:36.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcd0a0700 1 -- 172.21.15.41:0/1222998369 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc00d7f0 con 0x7f9dc80b2370 2021-10-21T00:03:36.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/1222998369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80b2370 msgr2=0x7f9dc80b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/1222998369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80b2370 0x7f9dc80b3060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f9dbc002f70 tx=0x7f9dbc006df0).stop 2021-10-21T00:03:36.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/1222998369 shutdown_connections 2021-10-21T00:03:36.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/1222998369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80b2370 0x7f9dc80b3060 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/1222998369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc805f6b0 0x7f9dc813d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/1222998369 >> v2:172.21.15.62:3300/0 conn(0x7f9dc80af720 0x7f9dc8143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/1222998369 >> 172.21.15.41:0/1222998369 conn(0x7f9dc80637b0 msgr2=0x7f9dc8063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/1222998369 shutdown_connections 2021-10-21T00:03:36.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.172+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/1222998369 wait complete. 2021-10-21T00:03:36.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 Processor -- start 2021-10-21T00:03:36.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- start start 2021-10-21T00:03:36.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc805f6b0 0x7f9dc80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80b2370 0x7f9dc8140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc813dd30 con 0x7f9dc80af720 2021-10-21T00:03:36.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc813ecb0 con 0x7f9dc805f6b0 2021-10-21T00:03:36.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8150c60 con 0x7f9dc80b2370 2021-10-21T00:03:36.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58974/0 (socket says 172.21.15.41:58974) 2021-10-21T00:03:36.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/2402203576 learned_addr learned my addr 172.21.15.41:0/2402203576 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:36.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dce8a3700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80b2370 0x7f9dc8140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dce0a2700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc805f6b0 0x7f9dc80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80b2370 msgr2=0x7f9dc8140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80b2370 0x7f9dc8140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc805f6b0 msgr2=0x7f9dc80b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc805f6b0 0x7f9dc80b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 -- 172.21.15.41:0/2402203576 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc00b180 con 0x7f9dc80af720 2021-10-21T00:03:36.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcd8a1700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f9dbc002f70 tx=0x7f9dbc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc016070 con 0x7f9dc80af720 2021-10-21T00:03:36.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00de70 con 0x7f9dc80af720 2021-10-21T00:03:36.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dbc01e450 con 0x7f9dc80af720 2021-10-21T00:03:36.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc813d490 con 0x7f9dc80af720 2021-10-21T00:03:36.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc80672d0 con 0x7f9dc80af720 2021-10-21T00:03:36.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9dbc025030 con 0x7f9dc80af720 2021-10-21T00:03:36.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.176+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc813ee70 con 0x7f9dc80af720 2021-10-21T00:03:36.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.180+0000 7f9dc77fe700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 0x7f9da80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.180+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9dbc06c4f0 con 0x7f9dc80af720 2021-10-21T00:03:36.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.180+0000 7f9dce0a2700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 0x7f9da80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.180+0000 7f9dce0a2700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 0x7f9da80559b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9db800f000 tx=0x7f9db800f040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.184+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9dbc043980 con 0x7f9dc80af720 2021-10-21T00:03:36.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.308+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9dc81441e0 con 0x7f9dc80af720 2021-10-21T00:03:36.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dc77fe700 1 -- 172.21.15.41:0/2402203576 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9dbc0230b0 con 0x7f9dc80af720 2021-10-21T00:03:36.317 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:36.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 msgr2=0x7f9da80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 0x7f9da80559b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f9db800f000 tx=0x7f9db800f040).stop 2021-10-21T00:03:36.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 msgr2=0x7f9dc8140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f9dbc002f70 tx=0x7f9dbc014000).stop 2021-10-21T00:03:36.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 shutdown_connections 2021-10-21T00:03:36.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9da80534f0 0x7f9da80559b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9dc80b2370 0x7f9dc8140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9dc80af720 0x7f9dc8140410 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 --2- 172.21.15.41:0/2402203576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dc805f6b0 0x7f9dc80b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 >> 172.21.15.41:0/2402203576 conn(0x7f9dc80637b0 msgr2=0x7f9dc8142d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 shutdown_connections 2021-10-21T00:03:36.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.312+0000 7f9dcf0a4700 1 -- 172.21.15.41:0/2402203576 wait complete. 2021-10-21T00:03:36.333 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:36.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 Processor -- start 2021-10-21T00:03:36.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 -- start start 2021-10-21T00:03:36.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7304062330 0x7f73040b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7304062f70 0x7f730405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730405bd40 con 0x7f73040b3a20 2021-10-21T00:03:36.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730405bf70 con 0x7f7304062330 2021-10-21T00:03:36.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.440+0000 7f73089de700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7304142cb0 con 0x7f7304062f70 2021-10-21T00:03:36.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7304062330 0x7f73040b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f7303fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f73040b3a20 0x7f730413c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56756/0 (socket says 172.21.15.41:56756) 2021-10-21T00:03:36.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f7303fff700 1 -- 172.21.15.41:0/1333324979 learned_addr learned my addr 172.21.15.41:0/1333324979 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:36.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f7302ffd700 1 --2- 172.21.15.41:0/1333324979 >> v2:172.21.15.62:3300/0 conn(0x7f7304062f70 0x7f730405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73027fc700 1 -- 172.21.15.41:0/1333324979 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898937097 0 0) 0x7f730405bd40 con 0x7f73040b3a20 2021-10-21T00:03:36.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73027fc700 1 -- 172.21.15.41:0/1333324979 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f0003260 con 0x7f73040b3a20 2021-10-21T00:03:36.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 -- 172.21.15.41:0/1333324979 >> v2:172.21.15.62:3300/0 conn(0x7f7304062f70 msgr2=0x7f730405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 --2- 172.21.15.41:0/1333324979 >> v2:172.21.15.62:3300/0 conn(0x7f7304062f70 0x7f730405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 -- 172.21.15.41:0/1333324979 >> v1:172.21.15.41:6789/0 conn(0x7f73040b3a20 legacy=0x7f730413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 -- 172.21.15.41:0/1333324979 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304142950 con 0x7f7304062330 2021-10-21T00:03:36.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73037fe700 1 --2- 172.21.15.41:0/1333324979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73040b3f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f72f4002f70 tx=0x7f72f4006df0).ready entity=mon.0 client_cookie=d42fc0fec593b0da server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73027fc700 1 -- 172.21.15.41:0/1333324979 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f400d4f0 con 0x7f7304062330 2021-10-21T00:03:36.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73027fc700 1 -- 172.21.15.41:0/1333324979 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4000e90 con 0x7f7304062330 2021-10-21T00:03:36.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73027fc700 1 -- 172.21.15.41:0/1333324979 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f400d840 con 0x7f7304062330 2021-10-21T00:03:36.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 -- 172.21.15.41:0/1333324979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 msgr2=0x7f73040b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 --2- 172.21.15.41:0/1333324979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73040b3f30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f72f4002f70 tx=0x7f72f4006df0).stop 2021-10-21T00:03:36.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 -- 172.21.15.41:0/1333324979 shutdown_connections 2021-10-21T00:03:36.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 --2- 172.21.15.41:0/1333324979 >> v2:172.21.15.62:3300/0 conn(0x7f7304062f70 0x7f730405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 --2- 172.21.15.41:0/1333324979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73040b3f30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 -- 172.21.15.41:0/1333324979 >> 172.21.15.41:0/1333324979 conn(0x7f73040b9080 msgr2=0x7f73040b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 -- 172.21.15.41:0/1333324979 shutdown_connections 2021-10-21T00:03:36.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.444+0000 7f73089de700 1 -- 172.21.15.41:0/1333324979 wait complete. 2021-10-21T00:03:36.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 Processor -- start 2021-10-21T00:03:36.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- start start 2021-10-21T00:03:36.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 0x7f73040b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 0x7f7304145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73041140d0 con 0x7f7304062330 2021-10-21T00:03:36.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7304144ff0 con 0x7f7304062f70 2021-10-21T00:03:36.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304115840 con 0x7f73040b3a20 2021-10-21T00:03:36.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:58988/0 (socket says 172.21.15.41:58988) 2021-10-21T00:03:36.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 -- 172.21.15.41:0/3896284775 learned_addr learned my addr 172.21.15.41:0/3896284775 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:36.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7303fff700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 0x7f7304145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7302ffd700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 0x7f73040b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 -- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 msgr2=0x7f7304145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 0x7f7304145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 -- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 msgr2=0x7f73040b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 0x7f73040b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 -- 172.21.15.41:0/3896284775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f400b180 con 0x7f7304062330 2021-10-21T00:03:36.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7303fff700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 0x7f7304145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:36.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7302ffd700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 0x7f73040b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:36.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73037fe700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f72f4002f70 tx=0x7f72f4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f400de60 con 0x7f7304062330 2021-10-21T00:03:36.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f401e400 con 0x7f7304062330 2021-10-21T00:03:36.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7304115ae0 con 0x7f7304062330 2021-10-21T00:03:36.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f401e760 con 0x7f7304062330 2021-10-21T00:03:36.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.448+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041460b0 con 0x7f7304062330 2021-10-21T00:03:36.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304057350 con 0x7f7304062330 2021-10-21T00:03:36.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72f401c070 con 0x7f7304062330 2021-10-21T00:03:36.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f7300ff9700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 0x7f72e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f72f406c0d0 con 0x7f7304062330 2021-10-21T00:03:36.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f7302ffd700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 0x7f72e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.452+0000 7f7302ffd700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 0x7f72e4055ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f72f800b000 tx=0x7f72f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.460+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72f40435a0 con 0x7f7304062330 2021-10-21T00:03:36.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.584+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f730405d080 con 0x7f7304062330 2021-10-21T00:03:36.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.584+0000 7f7300ff9700 1 -- 172.21.15.41:0/3896284775 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72f4023070 con 0x7f7304062330 2021-10-21T00:03:36.592 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:36.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.584+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 msgr2=0x7f72e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 0x7f72e4055ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f72f800b000 tx=0x7f72f8008040).stop 2021-10-21T00:03:36.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 msgr2=0x7f73041552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f72f4002f70 tx=0x7f72f4014000).stop 2021-10-21T00:03:36.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 shutdown_connections 2021-10-21T00:03:36.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72e4053610 0x7f72e4055ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73040b3a20 0x7f7304145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7304062f70 0x7f73040b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 --2- 172.21.15.41:0/3896284775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7304062330 0x7f73041552f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 >> 172.21.15.41:0/3896284775 conn(0x7f73040b9080 msgr2=0x7f73041407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 shutdown_connections 2021-10-21T00:03:36.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.588+0000 7f73089de700 1 -- 172.21.15.41:0/3896284775 wait complete. 2021-10-21T00:03:36.604 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:03:36.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.700+0000 7f2697a7c700 1 Processor -- start 2021-10-21T00:03:36.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.700+0000 7f2697a7c700 1 -- start start 2021-10-21T00:03:36.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f26900aa750 0x7f269014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269014b350 0x7f26900af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26900609d0 con 0x7f269005f9f0 2021-10-21T00:03:36.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26900b1620 con 0x7f26900aa750 2021-10-21T00:03:36.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269005fdd0 con 0x7f269014b350 2021-10-21T00:03:36.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695818700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f269005f9f0 0x7f269014a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56766/0 (socket says 172.21.15.41:56766) 2021-10-21T00:03:36.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695818700 1 -- 172.21.15.41:0/835587643 learned_addr learned my addr 172.21.15.41:0/835587643 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:36.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 --2- 172.21.15.41:0/835587643 >> v2:172.21.15.41:3300/0 conn(0x7f26900aa750 0x7f269014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2696019700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269014b350 0x7f26900af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2694816700 1 -- 172.21.15.41:0/835587643 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249690823 0 0) 0x7f26900609d0 con 0x7f269005f9f0 2021-10-21T00:03:36.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2694816700 1 -- 172.21.15.41:0/835587643 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f267c003260 con 0x7f269005f9f0 2021-10-21T00:03:36.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 -- 172.21.15.41:0/835587643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269014b350 msgr2=0x7f26900af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269014b350 0x7f26900af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 -- 172.21.15.41:0/835587643 >> v1:172.21.15.41:6789/0 conn(0x7f269005f9f0 legacy=0x7f269014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 -- 172.21.15.41:0/835587643 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900b1380 con 0x7f26900aa750 2021-10-21T00:03:36.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2695017700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f269014ae60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2684002f70 tx=0x7f2684006df0).ready entity=mon.0 client_cookie=29045ecc97c6b9fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2694816700 1 -- 172.21.15.41:0/835587643 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f268400d4a0 con 0x7f26900aa750 2021-10-21T00:03:36.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2694816700 1 -- 172.21.15.41:0/835587643 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2684000e90 con 0x7f26900aa750 2021-10-21T00:03:36.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2694816700 1 -- 172.21.15.41:0/835587643 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f268400d7f0 con 0x7f26900aa750 2021-10-21T00:03:36.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- 172.21.15.41:0/835587643 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 msgr2=0x7f269014ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f269014ae60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2684002f70 tx=0x7f2684006df0).stop 2021-10-21T00:03:36.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- 172.21.15.41:0/835587643 shutdown_connections 2021-10-21T00:03:36.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269014b350 0x7f26900af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 --2- 172.21.15.41:0/835587643 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f269014ae60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- 172.21.15.41:0/835587643 >> 172.21.15.41:0/835587643 conn(0x7f269005bca0 msgr2=0x7f269005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- 172.21.15.41:0/835587643 shutdown_connections 2021-10-21T00:03:36.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.704+0000 7f2697a7c700 1 -- 172.21.15.41:0/835587643 wait complete. 2021-10-21T00:03:36.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 Processor -- start 2021-10-21T00:03:36.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- start start 2021-10-21T00:03:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269005f9f0 0x7f26900ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f269014b350 0x7f2690098100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26901466c0 con 0x7f26900aa750 2021-10-21T00:03:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690146180 con 0x7f269014b350 2021-10-21T00:03:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2690146420 con 0x7f269005f9f0 2021-10-21T00:03:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59004/0 (socket says 172.21.15.41:59004) 2021-10-21T00:03:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 -- 172.21.15.41:0/3650706651 learned_addr learned my addr 172.21.15.41:0/3650706651 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2696019700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f269014b350 0x7f2690098100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695818700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269005f9f0 0x7f26900ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 -- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269005f9f0 msgr2=0x7f26900ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269005f9f0 0x7f26900ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 -- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f269014b350 msgr2=0x7f2690098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f269014b350 0x7f2690098100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 -- 172.21.15.41:0/3650706651 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268400b180 con 0x7f26900aa750 2021-10-21T00:03:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2695017700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2684002f70 tx=0x7f2684014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2684016070 con 0x7f26900aa750 2021-10-21T00:03:36.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26840138d0 con 0x7f26900aa750 2021-10-21T00:03:36.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26900aed90 con 0x7f26900aa750 2021-10-21T00:03:36.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2684013c30 con 0x7f26900aa750 2021-10-21T00:03:36.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.708+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26901596b0 con 0x7f26900aa750 2021-10-21T00:03:36.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26900678f0 con 0x7f26900aa750 2021-10-21T00:03:36.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f268400f030 con 0x7f26900aa750 2021-10-21T00:03:36.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f268effd700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 0x7f2670055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f268406c470 con 0x7f26900aa750 2021-10-21T00:03:36.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f2695818700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 0x7f2670055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.712+0000 7f2695818700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 0x7f2670055ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f268800d000 tx=0x7f2688009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.720+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2684043770 con 0x7f26900aa750 2021-10-21T00:03:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.844+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2690057350 con 0x7f26900aa750 2021-10-21T00:03:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.844+0000 7f268effd700 1 -- 172.21.15.41:0/3650706651 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2684023090 con 0x7f26900aa750 2021-10-21T00:03:36.853 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:36.853 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:03:36.853 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:36.854 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:03:36.854 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:03:36.854 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:03:36.854 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:03:36.855 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:03:36.855 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:03:36.855 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:03:36.855 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:03:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 msgr2=0x7f2670055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 0x7f2670055ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f268800d000 tx=0x7f2688009040).stop 2021-10-21T00:03:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 msgr2=0x7f2690147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2684002f70 tx=0x7f2684014000).stop 2021-10-21T00:03:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 shutdown_connections 2021-10-21T00:03:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2670053610 0x7f2670055ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f269014b350 0x7f2690098100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26900aa750 0x7f2690147180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 --2- 172.21.15.41:0/3650706651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f269005f9f0 0x7f26900ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 >> 172.21.15.41:0/3650706651 conn(0x7f269005bca0 msgr2=0x7f269005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 shutdown_connections 2021-10-21T00:03:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.848+0000 7f2697a7c700 1 -- 172.21.15.41:0/3650706651 wait complete. 2021-10-21T00:03:36.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:03:36.866 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:03:36.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 Processor -- start 2021-10-21T00:03:36.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 -- start start 2021-10-21T00:03:36.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe5c40b1350 0x7fe5c40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5c4145e90 0x7fe5c4146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40aff30 con 0x7fe5c40b1b40 2021-10-21T00:03:36.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40aca60 con 0x7fe5c40b1350 2021-10-21T00:03:36.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c8a2e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40b0f60 con 0x7fe5c4145e90 2021-10-21T00:03:36.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe5c40b1b40 0x7fe5c40b0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56780/0 (socket says 172.21.15.41:56780) 2021-10-21T00:03:36.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5baffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe5c40b1350 0x7fe5c40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c37fe700 1 -- 172.21.15.41:0/913809972 learned_addr learned my addr 172.21.15.41:0/913809972 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:36.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/913809972 >> v2:172.21.15.62:3300/0 conn(0x7fe5c4145e90 0x7fe5c4146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629730401 0 0) 0x7fe5c40aff30 con 0x7fe5c40b1b40 2021-10-21T00:03:36.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a4003260 con 0x7fe5c40b1b40 2021-10-21T00:03:36.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103176046 0 0) 0x7fe5a4003260 con 0x7fe5c40b1b40 2021-10-21T00:03:36.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 >> v2:172.21.15.62:3300/0 conn(0x7fe5c4145e90 msgr2=0x7fe5c4146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 --2- 172.21.15.41:0/913809972 >> v2:172.21.15.62:3300/0 conn(0x7fe5c4145e90 0x7fe5c4146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 >> v2:172.21.15.41:3300/0 conn(0x7fe5c40b1350 msgr2=0x7fe5c40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 --2- 172.21.15.41:0/913809972 >> v2:172.21.15.41:3300/0 conn(0x7fe5c40b1350 0x7fe5c40b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40b1f20 con 0x7fe5c40b1b40 2021-10-21T00:03:36.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fe5b4001660 con 0x7fe5c40b1b40 2021-10-21T00:03:36.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 >> v1:172.21.15.41:6789/0 conn(0x7fe5c40b1b40 legacy=0x7fe5c40b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a4003750 0x7fe5a4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a4004500 0x7fe5a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40aca60 con 0x7fe5a4004e70 2021-10-21T00:03:36.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40b0f60 con 0x7fe5a4004500 2021-10-21T00:03:36.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a400bc40 con 0x7fe5a4003750 2021-10-21T00:03:36.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5baffd700 1 --2- 172.21.15.41:0/913809972 >> v2:172.21.15.41:3300/0 conn(0x7fe5c40b1350 0x7fe5c40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:36.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c37fe700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a4003750 0x7fe5a4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5baffd700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a4004500 0x7fe5a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 -- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a4003750 msgr2=0x7fe5a4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a4003750 0x7fe5a4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 -- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a4004500 msgr2=0x7fe5a4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:36.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a4004500 0x7fe5a4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 -- 172.21.15.41:0/913809972 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4003260 con 0x7fe5a4004e70 2021-10-21T00:03:36.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 -- 172.21.15.41:0/913809972 reap_dead start 2021-10-21T00:03:36.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.968+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5a400b750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe5bc00c000 tx=0x7fe5bc0091d0).ready entity=mon.0 client_cookie=570ce5fa436b09cd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5bc00e780 con 0x7fe5a4004e70 2021-10-21T00:03:36.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc00e8e0 con 0x7fe5a4004e70 2021-10-21T00:03:36.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c2ffd700 1 -- 172.21.15.41:0/913809972 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5bc00ec40 con 0x7fe5a4004e70 2021-10-21T00:03:36.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 msgr2=0x7fe5a400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5a400b750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe5bc00c000 tx=0x7fe5bc0091d0).stop 2021-10-21T00:03:36.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/913809972 shutdown_connections 2021-10-21T00:03:36.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/913809972 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5a400b750 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/913809972 >> 172.21.15.41:0/913809972 conn(0x7fe5c40627b0 msgr2=0x7fe5c4062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:36.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/913809972 shutdown_connections 2021-10-21T00:03:36.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/913809972 wait complete. 2021-10-21T00:03:36.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 Processor -- start 2021-10-21T00:03:36.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- start start 2021-10-21T00:03:36.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c4111510 0x7fe5c4111990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 0x7fe5c410f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c410f720 con 0x7fe5a4004e70 2021-10-21T00:03:36.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c410e590 con 0x7fe5c410edb0 2021-10-21T00:03:36.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c8a2e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c414d3d0 con 0x7fe5c4111510 2021-10-21T00:03:36.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59022/0 (socket says 172.21.15.41:59022) 2021-10-21T00:03:36.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c37fe700 1 -- 172.21.15.41:0/2161304312 learned_addr learned my addr 172.21.15.41:0/2161304312 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:36.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 0x7fe5c410f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.972+0000 7fe5baffd700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c4111510 0x7fe5c4111990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 -- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c4111510 msgr2=0x7fe5c4111990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c4111510 0x7fe5c4111990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 -- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 msgr2=0x7fe5c410f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:36.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 0x7fe5c410f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:36.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 -- 172.21.15.41:0/2161304312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4156c50 con 0x7fe5a4004e70 2021-10-21T00:03:36.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c3fff700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 0x7fe5c410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:36.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c37fe700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe5c4157270 tx=0x7fe5b4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b4001bb0 con 0x7fe5a4004e70 2021-10-21T00:03:36.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4011780 con 0x7fe5a4004e70 2021-10-21T00:03:36.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4156ef0 con 0x7fe5a4004e70 2021-10-21T00:03:36.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b4011ae0 con 0x7fe5a4004e70 2021-10-21T00:03:36.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c414c570 con 0x7fe5a4004e70 2021-10-21T00:03:36.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5b401b030 con 0x7fe5a4004e70 2021-10-21T00:03:36.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4157080 con 0x7fe5a4004e70 2021-10-21T00:03:36.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 0x7fe5a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:36.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe5b406b240 con 0x7fe5a4004e70 2021-10-21T00:03:36.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.976+0000 7fe5baffd700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 0x7fe5a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:36.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.980+0000 7fe5baffd700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 0x7fe5a8055ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe5ac00b000 tx=0x7fe5ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:36.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:36.988+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5b4042670 con 0x7fe5a4004e70 2021-10-21T00:03:37.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.116+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe5c414a5b0 con 0x7fe5a4004e70 2021-10-21T00:03:37.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.320+0000 7fe5c17fa700 1 -- 172.21.15.41:0/2161304312 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v28) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe5b4045c90 con 0x7fe5a4004e70 2021-10-21T00:03:37.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 msgr2=0x7fe5a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 0x7fe5a8055ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe5ac00b000 tx=0x7fe5ac008040).stop 2021-10-21T00:03:37.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 msgr2=0x7fe5c410e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe5c4157270 tx=0x7fe5b4001e50).stop 2021-10-21T00:03:37.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 shutdown_connections 2021-10-21T00:03:37.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5a8053610 0x7fe5a8055ad0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5c410edb0 0x7fe5c410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5c4111510 0x7fe5c4111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 --2- 172.21.15.41:0/2161304312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5a4004e70 0x7fe5c410e0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 >> 172.21.15.41:0/2161304312 conn(0x7fe5c40627b0 msgr2=0x7fe5c405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:37.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 shutdown_connections 2021-10-21T00:03:37.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.324+0000 7fe5c8a2e700 1 -- 172.21.15.41:0/2161304312 wait complete. 2021-10-21T00:03:37.336 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:03:37.347 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:03:37.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.452+0000 7f5763ba9700 1 Processor -- start 2021-10-21T00:03:37.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.452+0000 7f5763ba9700 1 -- start start 2021-10-21T00:03:37.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5763ba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:37.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5763ba9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c05cad0 con 0x7f575c0b1160 2021-10-21T00:03:37.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5763ba9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c0ae300 con 0x7f575c05c6f0 2021-10-21T00:03:37.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5763ba9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0aece0 con 0x7f575c0aeec0 2021-10-21T00:03:37.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5762146700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f575c0b1160 0x7f575c145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56804/0 (socket says 172.21.15.41:56804) 2021-10-21T00:03:37.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5762146700 1 -- 172.21.15.41:0/3206328430 learned_addr learned my addr 172.21.15.41:0/3206328430 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:37.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5761144700 1 --2- 172.21.15.41:0/3206328430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:37.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698957898 0 0) 0x7f575c05cad0 con 0x7f575c0b1160 2021-10-21T00:03:37.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5748003260 con 0x7f575c0b1160 2021-10-21T00:03:37.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815230403 0 0) 0x7f575c0ae300 con 0x7f575c05c6f0 2021-10-21T00:03:37.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5761144700 1 -- 172.21.15.41:0/3206328430 >> v1:172.21.15.62:6789/0 conn(0x7f575c05c6f0 legacy=0x7f575c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5761144700 1 -- 172.21.15.41:0/3206328430 >> v1:172.21.15.41:6789/0 conn(0x7f575c0b1160 legacy=0x7f575c145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5761144700 1 -- 172.21.15.41:0/3206328430 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0ae5a0 con 0x7f575c0aeec0 2021-10-21T00:03:37.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5761144700 1 --2- 172.21.15.41:0/3206328430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c0b0c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5754001780 tx=0x7f574c0091d0).ready entity=mon.2 client_cookie=d44014ca252cca98 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:37.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57540015e0 con 0x7f575c0aeec0 2021-10-21T00:03:37.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c00b580 con 0x7f575c0aeec0 2021-10-21T00:03:37.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.456+0000 7f5760943700 1 -- 172.21.15.41:0/3206328430 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574c00b6f0 con 0x7f575c0aeec0 2021-10-21T00:03:37.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- 172.21.15.41:0/3206328430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 msgr2=0x7f575c0b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 --2- 172.21.15.41:0/3206328430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c0b0c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5754001780 tx=0x7f574c0091d0).stop 2021-10-21T00:03:37.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- 172.21.15.41:0/3206328430 shutdown_connections 2021-10-21T00:03:37.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 --2- 172.21.15.41:0/3206328430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c0b0c70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- 172.21.15.41:0/3206328430 >> 172.21.15.41:0/3206328430 conn(0x7f575c063210 msgr2=0x7f575c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:37.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- 172.21.15.41:0/3206328430 shutdown_connections 2021-10-21T00:03:37.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- 172.21.15.41:0/3206328430 wait complete. 2021-10-21T00:03:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 Processor -- start 2021-10-21T00:03:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.460+0000 7f5763ba9700 1 -- start start 2021-10-21T00:03:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c05c6f0 0x7f575c0646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:37.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c14a5c0 con 0x7f575c0b1160 2021-10-21T00:03:37.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c063f90 con 0x7f575c05c6f0 2021-10-21T00:03:37.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c064230 con 0x7f575c0aeec0 2021-10-21T00:03:37.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:37.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59040/0 (socket says 172.21.15.41:59040) 2021-10-21T00:03:37.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 -- 172.21.15.41:0/2365638998 learned_addr learned my addr 172.21.15.41:0/2365638998 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:37.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5761144700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:37.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5761945700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c05c6f0 0x7f575c0646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:37.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 -- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 msgr2=0x7f575c145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 -- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c05c6f0 msgr2=0x7f575c0646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:37.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c05c6f0 0x7f575c0646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:37.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 -- 172.21.15.41:0/2365638998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009470 con 0x7f575c0b1160 2021-10-21T00:03:37.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5762146700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5754000bc0 tx=0x7f5754001880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:37.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5754007170 con 0x7f575c0b1160 2021-10-21T00:03:37.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57540072d0 con 0x7f575c0b1160 2021-10-21T00:03:37.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c14abf0 con 0x7f575c0b1160 2021-10-21T00:03:37.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5754004710 con 0x7f575c0b1160 2021-10-21T00:03:37.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c065e60 con 0x7f575c0b1160 2021-10-21T00:03:37.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.464+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c14a740 con 0x7f575c0b1160 2021-10-21T00:03:37.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.468+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5754004870 con 0x7f575c0b1160 2021-10-21T00:03:37.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.468+0000 7f575affd700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 0x7f573c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:37.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.468+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f575406b1b0 con 0x7f575c0b1160 2021-10-21T00:03:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.468+0000 7f5761945700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 0x7f573c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.468+0000 7f5761945700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 0x7f573c055b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f575000d000 tx=0x7f5750009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:37.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.472+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f57540423d0 con 0x7f575c0b1160 2021-10-21T00:03:37.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:37.600+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f575c0643f0 con 0x7f575c0b1160 2021-10-21T00:03:38.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.332+0000 7f575affd700 1 -- 172.21.15.41:0/2365638998 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v29) v1 ==== 125+0+0 (secure 0 0 0) 0x7f57540019a0 con 0x7f575c0b1160 2021-10-21T00:03:38.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 msgr2=0x7f573c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 0x7f573c055b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f575000d000 tx=0x7f5750009040).stop 2021-10-21T00:03:38.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 msgr2=0x7f575c14a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5754000bc0 tx=0x7f5754001880).stop 2021-10-21T00:03:38.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 shutdown_connections 2021-10-21T00:03:38.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f573c0536a0 0x7f573c055b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f575c0b1160 0x7f575c14a0d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f575c0aeec0 0x7f575c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 --2- 172.21.15.41:0/2365638998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f575c05c6f0 0x7f575c0646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 >> 172.21.15.41:0/2365638998 conn(0x7f575c063210 msgr2=0x7f575c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:38.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 shutdown_connections 2021-10-21T00:03:38.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.340+0000 7f5763ba9700 1 -- 172.21.15.41:0/2365638998 wait complete. 2021-10-21T00:03:38.350 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:03:38.360 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:03:38.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.460+0000 7fda6dbca700 1 Processor -- start 2021-10-21T00:03:38.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.460+0000 7fda6dbca700 1 -- start start 2021-10-21T00:03:38.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda68060350 0x7fda6813f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda68097650 0x7fda68142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680b09e0 con 0x7fda68143190 2021-10-21T00:03:38.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda68143590 con 0x7fda68097650 2021-10-21T00:03:38.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda68060730 con 0x7fda68060350 2021-10-21T00:03:38.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda67fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fda68143190 0x7fda680af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56818/0 (socket says 172.21.15.41:56818) 2021-10-21T00:03:38.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda68097650 0x7fda68142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda67fff700 1 -- 172.21.15.41:0/730429502 learned_addr learned my addr 172.21.15.41:0/730429502 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:38.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda677fe700 1 --2- 172.21.15.41:0/730429502 >> v2:172.21.15.62:3300/0 conn(0x7fda68060350 0x7fda6813f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda66ffd700 1 -- 172.21.15.41:0/730429502 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680560477 0 0) 0x7fda680b09e0 con 0x7fda68143190 2021-10-21T00:03:38.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda66ffd700 1 -- 172.21.15.41:0/730429502 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda48003260 con 0x7fda68143190 2021-10-21T00:03:38.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 -- 172.21.15.41:0/730429502 >> v2:172.21.15.62:3300/0 conn(0x7fda68060350 msgr2=0x7fda6813f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:38.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 --2- 172.21.15.41:0/730429502 >> v2:172.21.15.62:3300/0 conn(0x7fda68060350 0x7fda6813f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 -- 172.21.15.41:0/730429502 >> v1:172.21.15.41:6789/0 conn(0x7fda68143190 legacy=0x7fda680af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 -- 172.21.15.41:0/730429502 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680b0c10 con 0x7fda68097650 2021-10-21T00:03:38.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda5effd700 1 --2- 172.21.15.41:0/730429502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68097650 0x7fda68142ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fda50002f70 tx=0x7fda50006df0).ready entity=mon.0 client_cookie=e9fa426eb2598194 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda66ffd700 1 -- 172.21.15.41:0/730429502 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5000d4f0 con 0x7fda68097650 2021-10-21T00:03:38.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda66ffd700 1 -- 172.21.15.41:0/730429502 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50000e90 con 0x7fda68097650 2021-10-21T00:03:38.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda66ffd700 1 -- 172.21.15.41:0/730429502 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5000d840 con 0x7fda68097650 2021-10-21T00:03:38.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- 172.21.15.41:0/730429502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68097650 msgr2=0x7fda68142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 --2- 172.21.15.41:0/730429502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68097650 0x7fda68142ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fda50002f70 tx=0x7fda50006df0).stop 2021-10-21T00:03:38.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- 172.21.15.41:0/730429502 shutdown_connections 2021-10-21T00:03:38.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 --2- 172.21.15.41:0/730429502 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68097650 0x7fda68142ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 --2- 172.21.15.41:0/730429502 >> v2:172.21.15.62:3300/0 conn(0x7fda68060350 0x7fda6813f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- 172.21.15.41:0/730429502 >> 172.21.15.41:0/730429502 conn(0x7fda6805bca0 msgr2=0x7fda6805c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:38.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- 172.21.15.41:0/730429502 shutdown_connections 2021-10-21T00:03:38.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.464+0000 7fda6dbca700 1 -- 172.21.15.41:0/730429502 wait complete. 2021-10-21T00:03:38.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.468+0000 7fda6dbca700 1 Processor -- start 2021-10-21T00:03:38.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.468+0000 7fda6dbca700 1 -- start start 2021-10-21T00:03:38.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda68060350 0x7fda68150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda68097650 0x7fda680ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b4120 con 0x7fda68143190 2021-10-21T00:03:38.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680ad410 con 0x7fda68060350 2021-10-21T00:03:38.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b4aa0 con 0x7fda68097650 2021-10-21T00:03:38.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda5effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda68097650 0x7fda680ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda68060350 0x7fda68150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59054/0 (socket says 172.21.15.41:59054) 2021-10-21T00:03:38.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 -- 172.21.15.41:0/3481056298 learned_addr learned my addr 172.21.15.41:0/3481056298 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:38.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 -- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda68097650 msgr2=0x7fda680ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda68097650 0x7fda680ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 -- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda68060350 msgr2=0x7fda68150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda68060350 0x7fda68150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 -- 172.21.15.41:0/3481056298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5000b180 con 0x7fda68143190 2021-10-21T00:03:38.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda67fff700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fda60001490 tx=0x7fda60007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda60005ba0 con 0x7fda68143190 2021-10-21T00:03:38.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60005d00 con 0x7fda68143190 2021-10-21T00:03:38.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680b3b80 con 0x7fda68143190 2021-10-21T00:03:38.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda600072c0 con 0x7fda68143190 2021-10-21T00:03:38.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6813ca60 con 0x7fda68143190 2021-10-21T00:03:38.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.472+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda680b3f60 con 0x7fda68143190 2021-10-21T00:03:38.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.476+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda6001a060 con 0x7fda68143190 2021-10-21T00:03:38.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.476+0000 7fda657fa700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 0x7fda4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.476+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fda6006b4a0 con 0x7fda68143190 2021-10-21T00:03:38.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.476+0000 7fda677fe700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 0x7fda4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.476+0000 7fda677fe700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 0x7fda4c055a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fda5800b000 tx=0x7fda58006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.484+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda60042560 con 0x7fda68143190 2021-10-21T00:03:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.644+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fda68151050 con 0x7fda68143190 2021-10-21T00:03:38.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.656+0000 7fda657fa700 1 -- 172.21.15.41:0/3481056298 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7fda60018070 con 0x7fda68143190 2021-10-21T00:03:38.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 msgr2=0x7fda4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 0x7fda4c055a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fda5800b000 tx=0x7fda58006df0).stop 2021-10-21T00:03:38.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 msgr2=0x7fda6813cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fda60001490 tx=0x7fda60007e00).stop 2021-10-21T00:03:38.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 shutdown_connections 2021-10-21T00:03:38.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda4c053580 0x7fda4c055a40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda68143190 0x7fda6813cd90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda68097650 0x7fda680ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 --2- 172.21.15.41:0/3481056298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda68060350 0x7fda68150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.660+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 >> 172.21.15.41:0/3481056298 conn(0x7fda6805bca0 msgr2=0x7fda680996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:38.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.664+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 shutdown_connections 2021-10-21T00:03:38.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.664+0000 7fda6dbca700 1 -- 172.21.15.41:0/3481056298 wait complete. 2021-10-21T00:03:38.671 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 5 and data pool 6 2021-10-21T00:03:38.684 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:38.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 Processor -- start 2021-10-21T00:03:38.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- start start 2021-10-21T00:03:38.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5ac05f9f0 0x7fb5ac14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5ac0aa750 0x7fb5ac14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0609d0 con 0x7fb5ac14b130 2021-10-21T00:03:38.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b1620 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac05fdd0 con 0x7fb5ac0aa750 2021-10-21T00:03:38.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5ac05f9f0 0x7fb5ac14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5ac05f9f0 0x7fb5ac14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59070/0 (socket says 172.21.15.41:59070) 2021-10-21T00:03:38.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 -- 172.21.15.41:0/57478723 learned_addr learned my addr 172.21.15.41:0/57478723 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:38.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5abfff700 1 --2- 172.21.15.41:0/57478723 >> v2:172.21.15.62:3300/0 conn(0x7fb5ac0aa750 0x7fb5ac14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 -- 172.21.15.41:0/57478723 >> v2:172.21.15.62:3300/0 conn(0x7fb5ac0aa750 msgr2=0x7fb5ac14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:38.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 --2- 172.21.15.41:0/57478723 >> v2:172.21.15.62:3300/0 conn(0x7fb5ac0aa750 0x7fb5ac14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 -- 172.21.15.41:0/57478723 >> v1:172.21.15.62:6789/0 conn(0x7fb5ac14b130 legacy=0x7fb5ac1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:38.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 -- 172.21.15.41:0/57478723 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac14b580 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b0a41700 1 --2- 172.21.15.41:0/57478723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac14a750 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fb5ac0af680 tx=0x7fb59c006eb0).ready entity=mon.0 client_cookie=879c5d64b6ffc332 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5ab7fe700 1 -- 172.21.15.41:0/57478723 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d5c0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5ab7fe700 1 -- 172.21.15.41:0/57478723 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c000e90 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5ab7fe700 1 -- 172.21.15.41:0/57478723 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d910 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/57478723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 msgr2=0x7fb5ac14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/57478723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac14a750 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fb5ac0af680 tx=0x7fb59c006eb0).stop 2021-10-21T00:03:38.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/57478723 shutdown_connections 2021-10-21T00:03:38.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/57478723 >> v2:172.21.15.62:3300/0 conn(0x7fb5ac0aa750 0x7fb5ac14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/57478723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac14a750 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/57478723 >> 172.21.15.41:0/57478723 conn(0x7fb5ac05bca0 msgr2=0x7fb5ac05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:38.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/57478723 shutdown_connections 2021-10-21T00:03:38.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.772+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/57478723 wait complete. 2021-10-21T00:03:38.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 Processor -- start 2021-10-21T00:03:38.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- start start 2021-10-21T00:03:38.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5ac0aa750 0x7fb5ac0669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5ac14b130 0x7fb5ac066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac062b30 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac062dd0 con 0x7fb5ac0aa750 2021-10-21T00:03:38.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac063070 con 0x7fb5ac14b130 2021-10-21T00:03:38.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59076/0 (socket says 172.21.15.41:59076) 2021-10-21T00:03:38.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 -- 172.21.15.41:0/3300070831 learned_addr learned my addr 172.21.15.41:0/3300070831 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:38.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5abfff700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5ac0aa750 0x7fb5ac0669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b1242700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5ac14b130 0x7fb5ac066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 -- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5ac14b130 msgr2=0x7fb5ac066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5ac14b130 0x7fb5ac066ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 -- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5ac0aa750 msgr2=0x7fb5ac0669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5ac0aa750 0x7fb5ac0669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 -- 172.21.15.41:0/3300070831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c00b1e0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b0a41700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fb5ac0af680 tx=0x7fb59c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c011760 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0118c0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac0ae3d0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c011c20 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.776+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac0673b0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac0b1380 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb59c025030 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5a9ffb700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 0x7fb590055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:38.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb59c06cb10 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5abfff700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 0x7fb590055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:38.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.780+0000 7fb5abfff700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 0x7fb590055b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb5a400c000 tx=0x7fb5a4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:38.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.784+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb59c043ba0 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.912+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5ac063230 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.912+0000 7fb5a9ffb700 1 -- 172.21.15.41:0/3300070831 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fb59c047180 con 0x7fb5ac05f9f0 2021-10-21T00:03:38.921 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:38.921 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":30,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:03:38.650352+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:03:37.173527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-21T00:03:37.661285+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:38.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 msgr2=0x7fb590055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 0x7fb590055b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb5a400c000 tx=0x7fb5a4008040).stop 2021-10-21T00:03:38.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 msgr2=0x7fb5ac0992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:38.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fb5ac0af680 tx=0x7fb59c015000).stop 2021-10-21T00:03:38.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 shutdown_connections 2021-10-21T00:03:38.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb5900536a0 0x7fb590055b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5ac14b130 0x7fb5ac066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5ac0aa750 0x7fb5ac0669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 --2- 172.21.15.41:0/3300070831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5ac05f9f0 0x7fb5ac0992f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 >> 172.21.15.41:0/3300070831 conn(0x7fb5ac05bca0 msgr2=0x7fb5ac05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 shutdown_connections 2021-10-21T00:03:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:38.916+0000 7fb5b2ca5700 1 -- 172.21.15.41:0/3300070831 wait complete. 2021-10-21T00:03:38.939 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:39.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 Processor -- start 2021-10-21T00:03:39.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 -- start start 2021-10-21T00:03:39.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f52900b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52900b0730 0x7f5290138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529005fdd0 con 0x7f529005f9f0 2021-10-21T00:03:39.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5290140400 con 0x7f52900b0730 2021-10-21T00:03:39.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f52948fb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900b27c0 con 0x7f52900b3370 2021-10-21T00:03:39.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f528f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f529005f9f0 0x7f52900b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56856/0 (socket says 172.21.15.41:56856) 2021-10-21T00:03:39.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f528ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52900b0730 0x7f5290138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f528f7fe700 1 -- 172.21.15.41:0/2163931355 learned_addr learned my addr 172.21.15.41:0/2163931355 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:39.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.040+0000 7f528effd700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f52900b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528ffff700 1 -- 172.21.15.41:0/2163931355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 msgr2=0x7f52900b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:39.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528ffff700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f52900b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528ffff700 1 -- 172.21.15.41:0/2163931355 >> v1:172.21.15.41:6789/0 conn(0x7f529005f9f0 legacy=0x7f52900b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528e7fc700 1 -- 172.21.15.41:0/2163931355 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723173175 0 0) 0x7f529005fdd0 con 0x7f529005f9f0 2021-10-21T00:03:39.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528ffff700 1 -- 172.21.15.41:0/2163931355 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290140080 con 0x7f52900b0730 2021-10-21T00:03:39.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528ffff700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52900b0730 0x7f5290138b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5280002f70 tx=0x7f5280006df0).ready entity=mon.0 client_cookie=83445d50ed857cf5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528e7fc700 1 -- 172.21.15.41:0/2163931355 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f528000d570 con 0x7f52900b0730 2021-10-21T00:03:39.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528e7fc700 1 -- 172.21.15.41:0/2163931355 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280000e90 con 0x7f52900b0730 2021-10-21T00:03:39.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f528e7fc700 1 -- 172.21.15.41:0/2163931355 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f528000d8c0 con 0x7f52900b0730 2021-10-21T00:03:39.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 -- 172.21.15.41:0/2163931355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52900b0730 msgr2=0x7f5290138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52900b0730 0x7f5290138b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5280002f70 tx=0x7f5280006df0).stop 2021-10-21T00:03:39.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 -- 172.21.15.41:0/2163931355 shutdown_connections 2021-10-21T00:03:39.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52900b0730 0x7f5290138b60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 --2- 172.21.15.41:0/2163931355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f52900b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 -- 172.21.15.41:0/2163931355 >> 172.21.15.41:0/2163931355 conn(0x7f52900637b0 msgr2=0x7f5290063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 -- 172.21.15.41:0/2163931355 shutdown_connections 2021-10-21T00:03:39.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.044+0000 7f52948fb700 1 -- 172.21.15.41:0/2163931355 wait complete. 2021-10-21T00:03:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 Processor -- start 2021-10-21T00:03:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- start start 2021-10-21T00:03:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52900b0730 0x7f529013c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f529014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529014fbe0 con 0x7f529005f9f0 2021-10-21T00:03:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529013cab0 con 0x7f52900b0730 2021-10-21T00:03:39.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529013d2f0 con 0x7f52900b3370 2021-10-21T00:03:39.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59090/0 (socket says 172.21.15.41:59090) 2021-10-21T00:03:39.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 -- 172.21.15.41:0/314942668 learned_addr learned my addr 172.21.15.41:0/314942668 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:39.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528effd700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52900b0730 0x7f529013c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528ffff700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f529014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 -- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 msgr2=0x7f529014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f529014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 -- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52900b0730 msgr2=0x7f529013c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52900b0730 0x7f529013c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 -- 172.21.15.41:0/314942668 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528000b180 con 0x7f529005f9f0 2021-10-21T00:03:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528f7fe700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5278000f70 tx=0x7f5278001860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52780070d0 con 0x7f529005f9f0 2021-10-21T00:03:39.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278007230 con 0x7f529005f9f0 2021-10-21T00:03:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529013d590 con 0x7f529005f9f0 2021-10-21T00:03:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52780073a0 con 0x7f529005f9f0 2021-10-21T00:03:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.048+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5290141420 con 0x7f529005f9f0 2021-10-21T00:03:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52900ad6a0 con 0x7f529005f9f0 2021-10-21T00:03:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f527801a060 con 0x7f529005f9f0 2021-10-21T00:03:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f528cff9700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 0x7f5274055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f527806b040 con 0x7f529005f9f0 2021-10-21T00:03:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f528effd700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 0x7f5274055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.052+0000 7f528effd700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 0x7f5274055ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f528800b000 tx=0x7f52880091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.060+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52780421a0 con 0x7f529005f9f0 2021-10-21T00:03:39.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.180+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5290057350 con 0x7f529005f9f0 2021-10-21T00:03:39.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f528cff9700 1 -- 172.21.15.41:0/314942668 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f5278018030 con 0x7f529005f9f0 2021-10-21T00:03:39.189 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:39.190 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":30,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:03:38.650352+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:03:37.173527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-21T00:03:37.661285+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:39.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 msgr2=0x7f5274055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 0x7f5274055ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f528800b000 tx=0x7f52880091d0).stop 2021-10-21T00:03:39.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 msgr2=0x7f5290142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5278000f70 tx=0x7f5278001860).stop 2021-10-21T00:03:39.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 shutdown_connections 2021-10-21T00:03:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5274053610 0x7f5274055ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52900b3370 0x7f529014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52900b0730 0x7f529013c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 --2- 172.21.15.41:0/314942668 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f529005f9f0 0x7f5290142770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 >> 172.21.15.41:0/314942668 conn(0x7f52900637b0 msgr2=0x7f52900b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 shutdown_connections 2021-10-21T00:03:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.184+0000 7f52948fb700 1 -- 172.21.15.41:0/314942668 wait complete. 2021-10-21T00:03:39.203 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:03:39.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 Processor -- start 2021-10-21T00:03:39.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- start start 2021-10-21T00:03:39.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fab800b9ca0 0x7fab800b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab800ba080 con 0x7fab800b31e0 2021-10-21T00:03:39.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8005c670 con 0x7fab800b9ca0 2021-10-21T00:03:39.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8005c8e0 con 0x7fab800b26d0 2021-10-21T00:03:39.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fab800b9ca0 0x7fab800b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85068700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fab800b31e0 0x7fab800b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56870/0 (socket says 172.21.15.41:56870) 2021-10-21T00:03:39.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fab800b9ca0 0x7fab800b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59098/0 (socket says 172.21.15.41:59098) 2021-10-21T00:03:39.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85068700 1 -- 172.21.15.41:0/3177189857 learned_addr learned my addr 172.21.15.41:0/3177189857 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:39.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab8606a700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 -- 172.21.15.41:0/3177189857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 msgr2=0x7fab80141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:39.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 -- 172.21.15.41:0/3177189857 >> v1:172.21.15.41:6789/0 conn(0x7fab800b31e0 legacy=0x7fab800b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab84867700 1 -- 172.21.15.41:0/3177189857 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709905093 0 0) 0x7fab800ba080 con 0x7fab800b31e0 2021-10-21T00:03:39.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 -- 172.21.15.41:0/3177189857 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8005cb80 con 0x7fab800b9ca0 2021-10-21T00:03:39.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab8606a700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:39.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab85869700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab800b0690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fab7c002f70 tx=0x7fab7c006df0).ready entity=mon.0 client_cookie=c8307b4c2d1ee5cd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab84867700 1 -- 172.21.15.41:0/3177189857 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c00d570 con 0x7fab800b9ca0 2021-10-21T00:03:39.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab84867700 1 -- 172.21.15.41:0/3177189857 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c000e90 con 0x7fab800b9ca0 2021-10-21T00:03:39.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab84867700 1 -- 172.21.15.41:0/3177189857 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c00d8c0 con 0x7fab800b9ca0 2021-10-21T00:03:39.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- 172.21.15.41:0/3177189857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 msgr2=0x7fab800b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab800b0690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fab7c002f70 tx=0x7fab7c006df0).stop 2021-10-21T00:03:39.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.312+0000 7fab87acd700 1 -- 172.21.15.41:0/3177189857 shutdown_connections 2021-10-21T00:03:39.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 --2- 172.21.15.41:0/3177189857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab800b0690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- 172.21.15.41:0/3177189857 >> 172.21.15.41:0/3177189857 conn(0x7fab80062f00 msgr2=0x7fab800b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- 172.21.15.41:0/3177189857 shutdown_connections 2021-10-21T00:03:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- 172.21.15.41:0/3177189857 wait complete. 2021-10-21T00:03:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 Processor -- start 2021-10-21T00:03:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- start start 2021-10-21T00:03:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab800b31e0 0x7fab801554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801449a0 con 0x7fab800b9ca0 2021-10-21T00:03:39.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80155db0 con 0x7fab800b31e0 2021-10-21T00:03:39.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab87acd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80155b10 con 0x7fab800b26d0 2021-10-21T00:03:39.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab8606a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab8606a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59108/0 (socket says 172.21.15.41:59108) 2021-10-21T00:03:39.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab8606a700 1 -- 172.21.15.41:0/1182952666 learned_addr learned my addr 172.21.15.41:0/1182952666 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:39.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab85068700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab800b31e0 0x7fab801554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab85869700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.316+0000 7fab8606a700 1 -- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 msgr2=0x7fab80145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab8606a700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab8606a700 1 -- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab800b31e0 msgr2=0x7fab801554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab8606a700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab800b31e0 0x7fab801554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab8606a700 1 -- 172.21.15.41:0/1182952666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c00b180 con 0x7fab800b9ca0 2021-10-21T00:03:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab8606a700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fab78006cc0 tx=0x7fab78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab78013620 con 0x7fab800b9ca0 2021-10-21T00:03:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78013780 con 0x7fab800b9ca0 2021-10-21T00:03:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab80144bf0 con 0x7fab800b9ca0 2021-10-21T00:03:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab78013ae0 con 0x7fab800b9ca0 2021-10-21T00:03:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab801445c0 con 0x7fab800b9ca0 2021-10-21T00:03:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8013fe50 con 0x7fab800b9ca0 2021-10-21T00:03:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab78013c40 con 0x7fab800b9ca0 2021-10-21T00:03:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 0x7fab60055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.320+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab7806b740 con 0x7fab800b9ca0 2021-10-21T00:03:39.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.324+0000 7fab85869700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 0x7fab60055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.324+0000 7fab85869700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 0x7fab60055b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fab7c01c000 tx=0x7fab7c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.332+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab780428a0 con 0x7fab800b9ca0 2021-10-21T00:03:39.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.492+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab80057350 con 0x7fab800b9ca0 2021-10-21T00:03:39.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.664+0000 7fab6effd700 1 -- 172.21.15.41:0/1182952666 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab7800f040 con 0x7fab800b9ca0 2021-10-21T00:03:39.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 msgr2=0x7fab60055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 0x7fab60055b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fab7c01c000 tx=0x7fab7c015000).stop 2021-10-21T00:03:39.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 msgr2=0x7fab801400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fab78006cc0 tx=0x7fab78008040).stop 2021-10-21T00:03:39.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 shutdown_connections 2021-10-21T00:03:39.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab600536a0 0x7fab60055b60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab800b9ca0 0x7fab801400b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab800b31e0 0x7fab801554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 --2- 172.21.15.41:0/1182952666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab800b26d0 0x7fab80145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 >> 172.21.15.41:0/1182952666 conn(0x7fab80062f00 msgr2=0x7fab80069600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 shutdown_connections 2021-10-21T00:03:39.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.668+0000 7fab87acd700 1 -- 172.21.15.41:0/1182952666 wait complete. 2021-10-21T00:03:39.688 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:39.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.792+0000 7f43db744700 1 Processor -- start 2021-10-21T00:03:39.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.792+0000 7f43db744700 1 -- start start 2021-10-21T00:03:39.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b5f80 0x7f43d40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f43d405cb10 0x7f43d4143e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4064200 con 0x7f43d40b2cc0 2021-10-21T00:03:39.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d405cfa0 con 0x7f43d405cb10 2021-10-21T00:03:39.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40644a0 con 0x7f43d40b5f80 2021-10-21T00:03:39.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f43d405cb10 0x7f43d4143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d8cdf700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f43d40b2cc0 0x7f43d413dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56884/0 (socket says 172.21.15.41:56884) 2021-10-21T00:03:39.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d8cdf700 1 -- 172.21.15.41:0/3360489154 learned_addr learned my addr 172.21.15.41:0/3360489154 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:39.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d94e0700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b5f80 0x7f43d40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 -- 172.21.15.41:0/3360489154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b5f80 msgr2=0x7f43d40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:39.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b5f80 0x7f43d40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 -- 172.21.15.41:0/3360489154 >> v1:172.21.15.41:6789/0 conn(0x7f43d40b2cc0 legacy=0x7f43d413dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43c3fff700 1 -- 172.21.15.41:0/3360489154 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471901788 0 0) 0x7f43d4064200 con 0x7f43d40b2cc0 2021-10-21T00:03:39.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 -- 172.21.15.41:0/3360489154 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40b17c0 con 0x7f43d405cb10 2021-10-21T00:03:39.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43d9ce1700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d405cb10 0x7f43d4143e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f43cc0032f0 tx=0x7f43cc0091d0).ready entity=mon.0 client_cookie=c4ea7071e351efc8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43c3fff700 1 -- 172.21.15.41:0/3360489154 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00b6c0 con 0x7f43d405cb10 2021-10-21T00:03:39.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43c3fff700 1 -- 172.21.15.41:0/3360489154 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00b820 con 0x7f43d405cb10 2021-10-21T00:03:39.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43c3fff700 1 -- 172.21.15.41:0/3360489154 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00b990 con 0x7f43d405cb10 2021-10-21T00:03:39.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- 172.21.15.41:0/3360489154 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d405cb10 msgr2=0x7f43d4143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d405cb10 0x7f43d4143e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f43cc0032f0 tx=0x7f43cc0091d0).stop 2021-10-21T00:03:39.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- 172.21.15.41:0/3360489154 shutdown_connections 2021-10-21T00:03:39.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d405cb10 0x7f43d4143e90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 --2- 172.21.15.41:0/3360489154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b5f80 0x7f43d40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- 172.21.15.41:0/3360489154 >> 172.21.15.41:0/3360489154 conn(0x7f43d4063ae0 msgr2=0x7f43d40b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- 172.21.15.41:0/3360489154 shutdown_connections 2021-10-21T00:03:39.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.796+0000 7f43db744700 1 -- 172.21.15.41:0/3360489154 wait complete. 2021-10-21T00:03:39.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.800+0000 7f43db744700 1 Processor -- start 2021-10-21T00:03:39.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.800+0000 7f43db744700 1 -- start start 2021-10-21T00:03:39.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 0x7f43d41458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b2cc0 0x7f43d413d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4150a20 con 0x7f43d40b5f80 2021-10-21T00:03:39.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4150c50 con 0x7f43d405cb10 2021-10-21T00:03:39.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4142830 con 0x7f43d40b2cc0 2021-10-21T00:03:39.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59122/0 (socket says 172.21.15.41:59122) 2021-10-21T00:03:39.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 -- 172.21.15.41:0/1828366470 learned_addr learned my addr 172.21.15.41:0/1828366470 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:39.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d8cdf700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b2cc0 0x7f43d413d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d94e0700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 0x7f43d41458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 -- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b2cc0 msgr2=0x7f43d413d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b2cc0 0x7f43d413d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 -- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 msgr2=0x7f43d41458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 0x7f43d41458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 -- 172.21.15.41:0/1828366470 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009470 con 0x7f43d40b5f80 2021-10-21T00:03:39.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d94e0700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 0x7f43d41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:39.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43d9ce1700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f43cc0032f0 tx=0x7f43cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00b6c0 con 0x7f43d40b5f80 2021-10-21T00:03:39.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc021630 con 0x7f43d40b5f80 2021-10-21T00:03:39.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d413dc10 con 0x7f43d40b5f80 2021-10-21T00:03:39.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc021990 con 0x7f43d40b5f80 2021-10-21T00:03:39.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4142360 con 0x7f43d40b5f80 2021-10-21T00:03:39.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4150e10 con 0x7f43d40b5f80 2021-10-21T00:03:39.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43cc027020 con 0x7f43d40b5f80 2021-10-21T00:03:39.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.804+0000 7f43c27fc700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 0x7f43b4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:39.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.808+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43cc06cde0 con 0x7f43d40b5f80 2021-10-21T00:03:39.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.808+0000 7f43d94e0700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 0x7f43b4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:39.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.808+0000 7f43d94e0700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 0x7f43b4055b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f43d000b000 tx=0x7f43d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:39.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.812+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43cc043ec0 con 0x7f43d40b5f80 2021-10-21T00:03:39.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.972+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43d4057350 con 0x7f43d40b5f80 2021-10-21T00:03:39.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.972+0000 7f43c27fc700 1 -- 172.21.15.41:0/1828366470 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f43cc015020 con 0x7f43d40b5f80 2021-10-21T00:03:39.980 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:39.980 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:39.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 msgr2=0x7f43b4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 0x7f43b4055b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f43d000b000 tx=0x7f43d0008040).stop 2021-10-21T00:03:39.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 msgr2=0x7f43d40b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:39.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f43cc0032f0 tx=0x7f43cc016000).stop 2021-10-21T00:03:39.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 shutdown_connections 2021-10-21T00:03:39.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f43b40536d0 0x7f43b4055b90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43d40b5f80 0x7f43d40b3500 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43d40b2cc0 0x7f43d413d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 --2- 172.21.15.41:0/1828366470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d405cb10 0x7f43d41458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:39.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 >> 172.21.15.41:0/1828366470 conn(0x7f43d4063ae0 msgr2=0x7f43d413e510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:39.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 shutdown_connections 2021-10-21T00:03:39.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:39.976+0000 7f43db744700 1 -- 172.21.15.41:0/1828366470 wait complete. 2021-10-21T00:03:39.985 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:39.992 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:40.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 Processor -- start 2021-10-21T00:03:40.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 -- start start 2021-10-21T00:03:40.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb6200af620 0x7fb620140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200b1560 con 0x7fb62009ab50 2021-10-21T00:03:40.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6200b2550 con 0x7fb6200af620 2021-10-21T00:03:40.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb626390700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62009a170 con 0x7fb6200b2170 2021-10-21T00:03:40.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb625b8f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb6200af620 0x7fb620140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb62538e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb62538e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49392/0 (socket says 172.21.15.41:49392) 2021-10-21T00:03:40.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb62538e700 1 -- 172.21.15.41:0/1700975058 learned_addr learned my addr 172.21.15.41:0/1700975058 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:40.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb625b8f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb6200af620 0x7fb620140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59130/0 (socket says 172.21.15.41:59130) 2021-10-21T00:03:40.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.088+0000 7fb624b8d700 1 --1- 172.21.15.41:0/1700975058 >> v1:172.21.15.62:6789/0 conn(0x7fb62009ab50 0x7fb62013fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36722/0 (socket says 172.21.15.41:36722) 2021-10-21T00:03:40.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb625b8f700 1 -- 172.21.15.41:0/1700975058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 msgr2=0x7fb620099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:40.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb625b8f700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb625b8f700 1 -- 172.21.15.41:0/1700975058 >> v1:172.21.15.62:6789/0 conn(0x7fb62009ab50 legacy=0x7fb62013fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb625b8f700 1 -- 172.21.15.41:0/1700975058 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62009a410 con 0x7fb6200af620 2021-10-21T00:03:40.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb62538e700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:40.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb625b8f700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6200af620 0x7fb620140210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb618002f70 tx=0x7fb618006df0).ready entity=mon.0 client_cookie=a6951c6d74a8f837 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb60ffff700 1 -- 172.21.15.41:0/1700975058 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61800d570 con 0x7fb6200af620 2021-10-21T00:03:40.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb60ffff700 1 -- 172.21.15.41:0/1700975058 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618000e90 con 0x7fb6200af620 2021-10-21T00:03:40.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb60ffff700 1 -- 172.21.15.41:0/1700975058 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61800d8c0 con 0x7fb6200af620 2021-10-21T00:03:40.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- 172.21.15.41:0/1700975058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6200af620 msgr2=0x7fb620140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6200af620 0x7fb620140210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb618002f70 tx=0x7fb618006df0).stop 2021-10-21T00:03:40.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- 172.21.15.41:0/1700975058 shutdown_connections 2021-10-21T00:03:40.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6200af620 0x7fb620140210 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 --2- 172.21.15.41:0/1700975058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200b2170 0x7fb620099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- 172.21.15.41:0/1700975058 >> 172.21.15.41:0/1700975058 conn(0x7fb6200b5700 msgr2=0x7fb6200b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- 172.21.15.41:0/1700975058 shutdown_connections 2021-10-21T00:03:40.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- 172.21.15.41:0/1700975058 wait complete. 2021-10-21T00:03:40.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 Processor -- start 2021-10-21T00:03:40.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.092+0000 7fb626390700 1 -- start start 2021-10-21T00:03:40.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6200b2170 0x7fb6200aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb620095280 0x7fb6200ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620152080 con 0x7fb620095280 2021-10-21T00:03:40.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620152320 con 0x7fb6200b2170 2021-10-21T00:03:40.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201525c0 con 0x7fb6200af620 2021-10-21T00:03:40.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb625b8f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb620095280 0x7fb6200ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb624b8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6200b2170 0x7fb6200aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49398/0 (socket says 172.21.15.41:49398) 2021-10-21T00:03:40.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 -- 172.21.15.41:0/884173777 learned_addr learned my addr 172.21.15.41:0/884173777 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:40.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 -- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6200b2170 msgr2=0x7fb6200aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6200b2170 0x7fb6200aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 -- 172.21.15.41:0/884173777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb620095280 msgr2=0x7fb6200ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb620095280 0x7fb6200ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 -- 172.21.15.41:0/884173777 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009530 con 0x7fb6200af620 2021-10-21T00:03:40.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb62538e700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb61c006b60 tx=0x7fb61c009290).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61c00c850 con 0x7fb6200af620 2021-10-21T00:03:40.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00c9b0 con 0x7fb6200af620 2021-10-21T00:03:40.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61c00cd10 con 0x7fb6200af620 2021-10-21T00:03:40.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61800b180 con 0x7fb6200af620 2021-10-21T00:03:40.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6200ad620 con 0x7fb6200af620 2021-10-21T00:03:40.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.096+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb620152780 con 0x7fb6200af620 2021-10-21T00:03:40.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.100+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb61c022070 con 0x7fb6200af620 2021-10-21T00:03:40.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.100+0000 7fb60e7fc700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 0x7fb600055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.100+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb61c06c150 con 0x7fb6200af620 2021-10-21T00:03:40.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.100+0000 7fb624b8d700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 0x7fb600055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.100+0000 7fb624b8d700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 0x7fb600055b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb61000d000 tx=0x7fb610007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.108+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb61c0431a0 con 0x7fb6200af620 2021-10-21T00:03:40.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.236+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb62009a6b0 con 0x7fb6200af620 2021-10-21T00:03:40.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.240+0000 7fb60e7fc700 1 -- 172.21.15.41:0/884173777 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fb61c0467c0 con 0x7fb6200af620 2021-10-21T00:03:40.246 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:40.247 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":31,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:03:39.653229+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:03:37.173527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-21T00:03:37.661285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:40.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 msgr2=0x7fb600055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 0x7fb600055b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb61000d000 tx=0x7fb610007b80).stop 2021-10-21T00:03:40.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 msgr2=0x7fb620093b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb61c006b60 tx=0x7fb61c009290).stop 2021-10-21T00:03:40.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 shutdown_connections 2021-10-21T00:03:40.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb600053640 0x7fb600055b00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb620095280 0x7fb6200ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6200b2170 0x7fb6200aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 --2- 172.21.15.41:0/884173777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6200af620 0x7fb620093b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 >> 172.21.15.41:0/884173777 conn(0x7fb6200b5700 msgr2=0x7fb62013f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 shutdown_connections 2021-10-21T00:03:40.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.244+0000 7fb626390700 1 -- 172.21.15.41:0/884173777 wait complete. 2021-10-21T00:03:40.265 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:03:40.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.363+0000 7fe2b7aa0700 1 Processor -- start 2021-10-21T00:03:40.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.363+0000 7fe2b7aa0700 1 -- start start 2021-10-21T00:03:40.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe2b00b9c70 0x7fe2b0143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2b01418f0 0x7fe2b0141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b0142bc0 con 0x7fe2b00b3bc0 2021-10-21T00:03:40.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b01429a0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00ba050 con 0x7fe2b01418f0 2021-10-21T00:03:40.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe2b00b9c70 0x7fe2b0143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe2b00b9c70 0x7fe2b0143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59140/0 (socket says 172.21.15.41:59140) 2021-10-21T00:03:40.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 -- 172.21.15.41:0/3625672791 learned_addr learned my addr 172.21.15.41:0/3625672791 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:40.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b603d700 1 --2- 172.21.15.41:0/3625672791 >> v2:172.21.15.62:3300/0 conn(0x7fe2b01418f0 0x7fe2b0141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 -- 172.21.15.41:0/3625672791 >> v2:172.21.15.62:3300/0 conn(0x7fe2b01418f0 msgr2=0x7fe2b0141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:40.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 --2- 172.21.15.41:0/3625672791 >> v2:172.21.15.62:3300/0 conn(0x7fe2b01418f0 0x7fe2b0141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 -- 172.21.15.41:0/3625672791 >> v1:172.21.15.62:6789/0 conn(0x7fe2b00b3bc0 legacy=0x7fe2b0143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 -- 172.21.15.41:0/3625672791 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b01463c0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b583c700 1 --2- 172.21.15.41:0/3625672791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0143020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe2a0002f70 tx=0x7fe2a0006eb0).ready entity=mon.0 client_cookie=b7addec191423208 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b483a700 1 -- 172.21.15.41:0/3625672791 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2a000d5c0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b483a700 1 -- 172.21.15.41:0/3625672791 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0000e90 con 0x7fe2b00b9c70 2021-10-21T00:03:40.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b483a700 1 -- 172.21.15.41:0/3625672791 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2a000d950 con 0x7fe2b00b9c70 2021-10-21T00:03:40.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/3625672791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 msgr2=0x7fe2b0143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/3625672791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0143020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe2a0002f70 tx=0x7fe2a0006eb0).stop 2021-10-21T00:03:40.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/3625672791 shutdown_connections 2021-10-21T00:03:40.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/3625672791 >> v2:172.21.15.62:3300/0 conn(0x7fe2b01418f0 0x7fe2b0141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/3625672791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0143020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/3625672791 >> 172.21.15.41:0/3625672791 conn(0x7fe2b0062e80 msgr2=0x7fe2b00b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/3625672791 shutdown_connections 2021-10-21T00:03:40.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.367+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/3625672791 wait complete. 2021-10-21T00:03:40.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 Processor -- start 2021-10-21T00:03:40.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- start start 2021-10-21T00:03:40.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00b3bc0 0x7fe2b01154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b01418f0 0x7fe2b0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00ae7b0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00aea50 con 0x7fe2b01418f0 2021-10-21T00:03:40.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00aecf0 con 0x7fe2b00b3bc0 2021-10-21T00:03:40.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59150/0 (socket says 172.21.15.41:59150) 2021-10-21T00:03:40.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 -- 172.21.15.41:0/275056393 learned_addr learned my addr 172.21.15.41:0/275056393 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:40.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b583c700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00b3bc0 0x7fe2b01154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b603d700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b01418f0 0x7fe2b0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 -- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00b3bc0 msgr2=0x7fe2b01154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00b3bc0 0x7fe2b01154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 -- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b01418f0 msgr2=0x7fe2b0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b01418f0 0x7fe2b0155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 -- 172.21.15.41:0/275056393 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a000b1e0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b503b700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe2b0060220 tx=0x7fe2ac007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac012400 con 0x7fe2b00b9c70 2021-10-21T00:03:40.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac012560 con 0x7fe2b00b9c70 2021-10-21T00:03:40.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00add60 con 0x7fe2b00b9c70 2021-10-21T00:03:40.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac0128c0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.371+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01413c0 con 0x7fe2b00b9c70 2021-10-21T00:03:40.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b0146120 con 0x7fe2b00b9c70 2021-10-21T00:03:40.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2ac019030 con 0x7fe2b00b9c70 2021-10-21T00:03:40.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe29effd700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 0x7fe290055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2ac06ad50 con 0x7fe2b00b9c70 2021-10-21T00:03:40.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe2b583c700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 0x7fe290055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.375+0000 7fe2b583c700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 0x7fe290055a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe2a001c000 tx=0x7fe2a0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.379+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2ac041d40 con 0x7fe2b00b9c70 2021-10-21T00:03:40.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.547+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe2b0057350 con 0x7fe2b00b9c70 2021-10-21T00:03:40.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.555+0000 7fe29effd700 1 -- 172.21.15.41:0/275056393 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe2ac045360 con 0x7fe2b00b9c70 2021-10-21T00:03:40.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 msgr2=0x7fe290055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 0x7fe290055a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe2a001c000 tx=0x7fe2a0015000).stop 2021-10-21T00:03:40.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 msgr2=0x7fe2b0140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe2b0060220 tx=0x7fe2ac007c50).stop 2021-10-21T00:03:40.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 shutdown_connections 2021-10-21T00:03:40.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2900535b0 0x7fe290055a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b01418f0 0x7fe2b0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b9c70 0x7fe2b0140e50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 --2- 172.21.15.41:0/275056393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00b3bc0 0x7fe2b01154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 >> 172.21.15.41:0/275056393 conn(0x7fe2b0062e80 msgr2=0x7fe2b0142d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 shutdown_connections 2021-10-21T00:03:40.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.559+0000 7fe2b7aa0700 1 -- 172.21.15.41:0/275056393 wait complete. 2021-10-21T00:03:40.571 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:03:40.579 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:03:40.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.687+0000 7f9b83fff700 1 Processor -- start 2021-10-21T00:03:40.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.687+0000 7f9b83fff700 1 -- start start 2021-10-21T00:03:40.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 0x7f9b84063070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b840b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840b4760 con 0x7f9b8405f7c0 2021-10-21T00:03:40.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840b24e0 con 0x7f9b840b4380 2021-10-21T00:03:40.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84062930 con 0x7f9b840b1830 2021-10-21T00:03:40.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b837fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9b8405f7c0 0x7f9b8405fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56926/0 (socket says 172.21.15.41:56926) 2021-10-21T00:03:40.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b837fe700 1 -- 172.21.15.41:0/4250757768 learned_addr learned my addr 172.21.15.41:0/4250757768 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:40.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b82ffd700 1 --2- 172.21.15.41:0/4250757768 >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 0x7f9b84063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 --2- 172.21.15.41:0/4250757768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b840b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599896543 0 0) 0x7f9b840b4760 con 0x7f9b8405f7c0 2021-10-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b64003260 con 0x7f9b8405f7c0 2021-10-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1363872936 0 0) 0x7f9b64003260 con 0x7f9b8405f7c0 2021-10-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 -- 172.21.15.41:0/4250757768 >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 msgr2=0x7f9b84063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:40.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 --2- 172.21.15.41:0/4250757768 >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 0x7f9b84063070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 -- 172.21.15.41:0/4250757768 >> v1:172.21.15.41:6789/0 conn(0x7f9b8405f7c0 legacy=0x7f9b8405fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 -- 172.21.15.41:0/4250757768 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84062bd0 con 0x7f9b840b1830 2021-10-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b82ffd700 1 --2- 172.21.15.41:0/4250757768 >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 0x7f9b84063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:40.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b827fc700 1 --2- 172.21.15.41:0/4250757768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b840b3190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9b7c001b80 tx=0x7f9b6c006df0).ready entity=mon.2 client_cookie=d8ad5dfb59384bf2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7c0019e0 con 0x7f9b840b1830 2021-10-21T00:03:40.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c000e90 con 0x7f9b840b1830 2021-10-21T00:03:40.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b81ffb700 1 -- 172.21.15.41:0/4250757768 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b6c012460 con 0x7f9b840b1830 2021-10-21T00:03:40.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- 172.21.15.41:0/4250757768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 msgr2=0x7f9b840b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 --2- 172.21.15.41:0/4250757768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b840b3190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9b7c001b80 tx=0x7f9b6c006df0).stop 2021-10-21T00:03:40.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- 172.21.15.41:0/4250757768 shutdown_connections 2021-10-21T00:03:40.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 --2- 172.21.15.41:0/4250757768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b840b3190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 --2- 172.21.15.41:0/4250757768 >> v2:172.21.15.62:3300/0 conn(0x7f9b840b4380 0x7f9b84063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- 172.21.15.41:0/4250757768 >> 172.21.15.41:0/4250757768 conn(0x7f9b840b7960 msgr2=0x7f9b840b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- 172.21.15.41:0/4250757768 shutdown_connections 2021-10-21T00:03:40.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.691+0000 7f9b83fff700 1 -- 172.21.15.41:0/4250757768 wait complete. 2021-10-21T00:03:40.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 Processor -- start 2021-10-21T00:03:40.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 -- start start 2021-10-21T00:03:40.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b84066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 0x7f9b840aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84144430 con 0x7f9b8405f7c0 2021-10-21T00:03:40.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84145780 con 0x7f9b840b4380 2021-10-21T00:03:40.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b83fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84143f90 con 0x7f9b840b1830 2021-10-21T00:03:40.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59160/0 (socket says 172.21.15.41:59160) 2021-10-21T00:03:40.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.695+0000 7f9b82ffd700 1 -- 172.21.15.41:0/3855627437 learned_addr learned my addr 172.21.15.41:0/3855627437 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:40.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b837fe700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 0x7f9b840aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b827fc700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b84066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 -- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 msgr2=0x7f9b84066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b84066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 -- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 msgr2=0x7f9b840aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 0x7f9b840aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 -- 172.21.15.41:0/3855627437 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7400b180 con 0x7f9b8405f7c0 2021-10-21T00:03:40.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b837fe700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 0x7f9b840aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:40.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b827fc700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b84066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:03:40.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b82ffd700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9b7400c000 tx=0x7f9b74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7400c860 con 0x7f9b8405f7c0 2021-10-21T00:03:40.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400c9c0 con 0x7f9b8405f7c0 2021-10-21T00:03:40.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c00b180 con 0x7f9b8405f7c0 2021-10-21T00:03:40.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7400cd20 con 0x7f9b8405f7c0 2021-10-21T00:03:40.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b84145310 con 0x7f9b8405f7c0 2021-10-21T00:03:40.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b841455c0 con 0x7f9b8405f7c0 2021-10-21T00:03:40.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.699+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b7401c460 con 0x7f9b8405f7c0 2021-10-21T00:03:40.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.703+0000 7f9b7bfff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 0x7f9b68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:40.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.703+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9b7406bfb0 con 0x7f9b8405f7c0 2021-10-21T00:03:40.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.703+0000 7f9b827fc700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 0x7f9b68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:40.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.703+0000 7f9b827fc700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 0x7f9b68055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9b6c015000 tx=0x7f9b6c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:40.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.703+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b740430b0 con 0x7f9b8405f7c0 2021-10-21T00:03:40.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.871+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9b84144150 con 0x7f9b8405f7c0 2021-10-21T00:03:40.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.879+0000 7f9b7bfff700 1 -- 172.21.15.41:0/3855627437 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9b740466d0 con 0x7f9b8405f7c0 2021-10-21T00:03:40.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 msgr2=0x7f9b68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 0x7f9b68055ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9b6c015000 tx=0x7f9b6c014000).stop 2021-10-21T00:03:40.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 msgr2=0x7f9b84066800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:40.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9b7400c000 tx=0x7f9b74006df0).stop 2021-10-21T00:03:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 shutdown_connections 2021-10-21T00:03:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9b68053610 0x7f9b68055ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b840b4380 0x7f9b840aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b840b1830 0x7f9b84066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 --2- 172.21.15.41:0/3855627437 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9b8405f7c0 0x7f9b84066800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 >> 172.21.15.41:0/3855627437 conn(0x7f9b840b7960 msgr2=0x7f9b84148090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 shutdown_connections 2021-10-21T00:03:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:40.883+0000 7f9b83fff700 1 -- 172.21.15.41:0/3855627437 wait complete. 2021-10-21T00:03:40.903 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:03:40.907 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:03:41.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 Processor -- start 2021-10-21T00:03:41.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 -- start start 2021-10-21T00:03:41.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 0x7f99540b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954142ad0 con 0x7f9954142f00 2021-10-21T00:03:41.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954145f90 con 0x7f9954062330 2021-10-21T00:03:41.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a91d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540b3520 con 0x7f995413cc20 2021-10-21T00:03:41.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a11c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9954142f00 0x7f99541433b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56942/0 (socket says 172.21.15.41:56942) 2021-10-21T00:03:41.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995a11c700 1 -- 172.21.15.41:0/1833122086 learned_addr learned my addr 172.21.15.41:0/1833122086 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:41.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995911a700 1 --2- 172.21.15.41:0/1833122086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 0x7f99540b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836502437 0 0) 0x7f9954142ad0 con 0x7f9954142f00 2021-10-21T00:03:41.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9940003260 con 0x7f9954142f00 2021-10-21T00:03:41.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18720003 0 0) 0x7f9954145f90 con 0x7f9954062330 2021-10-21T00:03:41.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9954142ad0 con 0x7f9954062330 2021-10-21T00:03:41.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1683189115 0 0) 0x7f9940003260 con 0x7f9954142f00 2021-10-21T00:03:41.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995911a700 1 -- 172.21.15.41:0/1833122086 >> v1:172.21.15.62:6789/0 conn(0x7f9954062330 legacy=0x7f995413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995911a700 1 -- 172.21.15.41:0/1833122086 >> v1:172.21.15.41:6789/0 conn(0x7f9954142f00 legacy=0x7f99541433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995911a700 1 -- 172.21.15.41:0/1833122086 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954146230 con 0x7f995413cc20 2021-10-21T00:03:41.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f995911a700 1 --2- 172.21.15.41:0/1833122086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 0x7f99540b4140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9944001800 tx=0x7f9948006df0).ready entity=mon.2 client_cookie=35caf4b767e55e05 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9944001660 con 0x7f995413cc20 2021-10-21T00:03:41.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948000e90 con 0x7f995413cc20 2021-10-21T00:03:41.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.011+0000 7f9958919700 1 -- 172.21.15.41:0/1833122086 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9948012460 con 0x7f995413cc20 2021-10-21T00:03:41.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- 172.21.15.41:0/1833122086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 msgr2=0x7f99540b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 --2- 172.21.15.41:0/1833122086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 0x7f99540b4140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9944001800 tx=0x7f9948006df0).stop 2021-10-21T00:03:41.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- 172.21.15.41:0/1833122086 shutdown_connections 2021-10-21T00:03:41.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 --2- 172.21.15.41:0/1833122086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f995413cc20 0x7f99540b4140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- 172.21.15.41:0/1833122086 >> 172.21.15.41:0/1833122086 conn(0x7f99540b9080 msgr2=0x7f99540b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:41.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- 172.21.15.41:0/1833122086 shutdown_connections 2021-10-21T00:03:41.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- 172.21.15.41:0/1833122086 wait complete. 2021-10-21T00:03:41.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 Processor -- start 2021-10-21T00:03:41.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.015+0000 7f995a91d700 1 -- start start 2021-10-21T00:03:41.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 0x7f99541467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9954142f00 0x7f9954148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 0x7f9954136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954140ed0 con 0x7f99541374d0 2021-10-21T00:03:41.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954142200 con 0x7f9954062330 2021-10-21T00:03:41.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99541491a0 con 0x7f9954142f00 2021-10-21T00:03:41.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a11c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 0x7f9954136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 0x7f99541467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a11c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 0x7f9954136420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59178/0 (socket says 172.21.15.41:59178) 2021-10-21T00:03:41.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a11c700 1 -- 172.21.15.41:0/4088058896 learned_addr learned my addr 172.21.15.41:0/4088058896 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:41.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995911a700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9954142f00 0x7f9954148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 -- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9954142f00 msgr2=0x7f9954148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9954142f00 0x7f9954148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 -- 172.21.15.41:0/4088058896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 msgr2=0x7f9954136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 0x7f9954136420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 -- 172.21.15.41:0/4088058896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994800b180 con 0x7f9954062330 2021-10-21T00:03:41.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995991b700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 0x7f99541467c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f994c001490 tx=0x7f994c007da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c002310 con 0x7f9954062330 2021-10-21T00:03:41.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c002470 con 0x7f9954062330 2021-10-21T00:03:41.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9954142460 con 0x7f9954062330 2021-10-21T00:03:41.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c001840 con 0x7f9954062330 2021-10-21T00:03:41.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995413aa50 con 0x7f9954062330 2021-10-21T00:03:41.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.019+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954063020 con 0x7f9954062330 2021-10-21T00:03:41.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.023+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f994c010030 con 0x7f9954062330 2021-10-21T00:03:41.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.023+0000 7f9952ffd700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 0x7f9934055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.023+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f994c06b7d0 con 0x7f9954062330 2021-10-21T00:03:41.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.023+0000 7f995911a700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 0x7f9934055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.023+0000 7f995911a700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 0x7f9934055b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f994801a000 tx=0x7f9948014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.031+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f994c042930 con 0x7f9954062330 2021-10-21T00:03:41.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.195+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9954057350 con 0x7f9954062330 2021-10-21T00:03:41.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f9952ffd700 1 -- 172.21.15.41:0/4088058896 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f994c069e60 con 0x7f9954062330 2021-10-21T00:03:41.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 msgr2=0x7f9934055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 0x7f9934055b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f994801a000 tx=0x7f9948014000).stop 2021-10-21T00:03:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 msgr2=0x7f99541467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 0x7f99541467c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f994c001490 tx=0x7f994c007da0).stop 2021-10-21T00:03:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 shutdown_connections 2021-10-21T00:03:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9934053640 0x7f9934055b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99541374d0 0x7f9954136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9954142f00 0x7f9954148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 --2- 172.21.15.41:0/4088058896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9954062330 0x7f99541467c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 >> 172.21.15.41:0/4088058896 conn(0x7f99540b9080 msgr2=0x7f995413bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:41.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 shutdown_connections 2021-10-21T00:03:41.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.207+0000 7f995a91d700 1 -- 172.21.15.41:0/4088058896 wait complete. 2021-10-21T00:03:41.222 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:03:41.236 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 Processor -- start 2021-10-21T00:03:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 -- start start 2021-10-21T00:03:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 0x7f3c84064a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8405fb50 con 0x7f3c84064ef0 2021-10-21T00:03:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8405c3b0 con 0x7f3c8413c7b0 2021-10-21T00:03:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c8a615700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840609f0 con 0x7f3c8413cb90 2021-10-21T00:03:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c88bb2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3c84064ef0 0x7f3c8414d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56956/0 (socket says 172.21.15.41:56956) 2021-10-21T00:03:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.339+0000 7f3c88bb2700 1 -- 172.21.15.41:0/3969945744 learned_addr learned my addr 172.21.15.41:0/3969945744 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c837fe700 1 --2- 172.21.15.41:0/3969945744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 0x7f3c84064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c82ffd700 1 -- 172.21.15.41:0/3969945744 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325605023 0 0) 0x7f3c8405fb50 con 0x7f3c84064ef0 2021-10-21T00:03:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c82ffd700 1 -- 172.21.15.41:0/3969945744 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c70003260 con 0x7f3c84064ef0 2021-10-21T00:03:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c837fe700 1 -- 172.21.15.41:0/3969945744 >> v1:172.21.15.62:6789/0 conn(0x7f3c8413c7b0 legacy=0x7f3c8405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c837fe700 1 -- 172.21.15.41:0/3969945744 >> v1:172.21.15.41:6789/0 conn(0x7f3c84064ef0 legacy=0x7f3c8414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c837fe700 1 -- 172.21.15.41:0/3969945744 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8405fdc0 con 0x7f3c8413cb90 2021-10-21T00:03:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c837fe700 1 --2- 172.21.15.41:0/3969945744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 0x7f3c84064a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3c78002f70 tx=0x7f3c78006df0).ready entity=mon.2 client_cookie=8ef6dcc1a656bc9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c82ffd700 1 -- 172.21.15.41:0/3969945744 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7800d570 con 0x7f3c8413cb90 2021-10-21T00:03:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c82ffd700 1 -- 172.21.15.41:0/3969945744 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78000e90 con 0x7f3c8413cb90 2021-10-21T00:03:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.343+0000 7f3c82ffd700 1 -- 172.21.15.41:0/3969945744 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7800d8c0 con 0x7f3c8413cb90 2021-10-21T00:03:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- 172.21.15.41:0/3969945744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 msgr2=0x7f3c84064a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 --2- 172.21.15.41:0/3969945744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 0x7f3c84064a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3c78002f70 tx=0x7f3c78006df0).stop 2021-10-21T00:03:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- 172.21.15.41:0/3969945744 shutdown_connections 2021-10-21T00:03:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 --2- 172.21.15.41:0/3969945744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413cb90 0x7f3c84064a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- 172.21.15.41:0/3969945744 >> 172.21.15.41:0/3969945744 conn(0x7f3c840639f0 msgr2=0x7f3c84063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- 172.21.15.41:0/3969945744 shutdown_connections 2021-10-21T00:03:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- 172.21.15.41:0/3969945744 wait complete. 2021-10-21T00:03:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 Processor -- start 2021-10-21T00:03:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- start start 2021-10-21T00:03:41.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84064ef0 0x7f3c8413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413c7b0 0x7f3c8413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840ae990 con 0x7f3c8413cb90 2021-10-21T00:03:41.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840b4f60 con 0x7f3c84064ef0 2021-10-21T00:03:41.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c8a615700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840aebc0 con 0x7f3c8413c7b0 2021-10-21T00:03:41.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c88bb2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c88bb2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59192/0 (socket says 172.21.15.41:59192) 2021-10-21T00:03:41.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c88bb2700 1 -- 172.21.15.41:0/1985685866 learned_addr learned my addr 172.21.15.41:0/1985685866 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:41.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c837fe700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413c7b0 0x7f3c8413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.347+0000 7f3c83fff700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84064ef0 0x7f3c8413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 -- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413c7b0 msgr2=0x7f3c8413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413c7b0 0x7f3c8413ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 -- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84064ef0 msgr2=0x7f3c8413b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84064ef0 0x7f3c8413b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 -- 172.21.15.41:0/1985685866 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7800b180 con 0x7f3c8413cb90 2021-10-21T00:03:41.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c88bb2700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3c7c001490 tx=0x7f3c7c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c005ba0 con 0x7f3c8413cb90 2021-10-21T00:03:41.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c005d00 con 0x7f3c8413cb90 2021-10-21T00:03:41.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c84140560 con 0x7f3c8413cb90 2021-10-21T00:03:41.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c7c0072c0 con 0x7f3c8413cb90 2021-10-21T00:03:41.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c840b5200 con 0x7f3c8413cb90 2021-10-21T00:03:41.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c840aed80 con 0x7f3c8413cb90 2021-10-21T00:03:41.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.351+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c7c010070 con 0x7f3c8413cb90 2021-10-21T00:03:41.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.355+0000 7f3c817fa700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 0x7f3c64055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.355+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c7c06b200 con 0x7f3c8413cb90 2021-10-21T00:03:41.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.355+0000 7f3c83fff700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 0x7f3c64055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.355+0000 7f3c83fff700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 0x7f3c64055b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3c7400d000 tx=0x7f3c74007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.359+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c7c042360 con 0x7f3c8413cb90 2021-10-21T00:03:41.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c84060e10 con 0x7f3c8413cb90 2021-10-21T00:03:41.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c817fa700 1 -- 172.21.15.41:0/1985685866 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f3c7c018070 con 0x7f3c8413cb90 2021-10-21T00:03:41.533 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:41.533 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:41.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 msgr2=0x7f3c64055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 0x7f3c64055b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3c7400d000 tx=0x7f3c74007b90).stop 2021-10-21T00:03:41.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 msgr2=0x7f3c840b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3c7c001490 tx=0x7f3c7c007e00).stop 2021-10-21T00:03:41.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 shutdown_connections 2021-10-21T00:03:41.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c640536a0 0x7f3c64055b60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3c8413cb90 0x7f3c840b6580 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.523+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c8413c7b0 0x7f3c8413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.527+0000 7f3c8a615700 1 --2- 172.21.15.41:0/1985685866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84064ef0 0x7f3c8413b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.527+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 >> 172.21.15.41:0/1985685866 conn(0x7f3c840639f0 msgr2=0x7f3c84141130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:41.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.527+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 shutdown_connections 2021-10-21T00:03:41.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.527+0000 7f3c8a615700 1 -- 172.21.15.41:0/1985685866 wait complete. 2021-10-21T00:03:41.539 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:41.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:03:38.650515+0000', 'modified': '2021-10-21T00:03:39.654379+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4912}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4912': {'gid': 4912, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/1216827791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 1216827791}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 1216827791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:41.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:41.748 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:41.869 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4912,"want_state":"up:active","state":"up:active","rank_uptime":3.20307326,"mdsmap_epoch":10,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":9.4119936410000005} 2021-10-21T00:03:41.870 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4912, "mdsmap_epoch": 10, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 3.20307326, "state": "up:active", "uptime": 9.411993641, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:41.871 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:03:41.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 Processor -- start 2021-10-21T00:03:41.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- start start 2021-10-21T00:03:41.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbd680b2170 0x7fbd680ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680af620 0x7fbd680ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbd680abb50 0x7fbd6814a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd680b0b50 con 0x7fbd680b2170 2021-10-21T00:03:41.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd680b2550 con 0x7fbd680abb50 2021-10-21T00:03:41.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680b0d90 con 0x7fbd680af620 2021-10-21T00:03:41.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbd680b2170 0x7fbd680ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbd680b2170 0x7fbd680ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59198/0 (socket says 172.21.15.41:59198) 2021-10-21T00:03:41.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 -- 172.21.15.41:0/3014092158 learned_addr learned my addr 172.21.15.41:0/3014092158 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:41.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd67fff700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680af620 0x7fbd680ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d03a700 1 --2- 172.21.15.41:0/3014092158 >> v2:172.21.15.62:3300/0 conn(0x7fbd680abb50 0x7fbd6814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 -- 172.21.15.41:0/3014092158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680af620 msgr2=0x7fbd680ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:41.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680af620 0x7fbd680ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 -- 172.21.15.41:0/3014092158 >> v2:172.21.15.62:3300/0 conn(0x7fbd680abb50 msgr2=0x7fbd6814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:41.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 --2- 172.21.15.41:0/3014092158 >> v2:172.21.15.62:3300/0 conn(0x7fbd680abb50 0x7fbd6814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 -- 172.21.15.41:0/3014092158 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680b1030 con 0x7fbd680b2170 2021-10-21T00:03:41.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6c839700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680b2170 0x7fbd680ab170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbd5c002f70 tx=0x7fbd5c006eb0).ready entity=mon.0 client_cookie=2d86d14926118c19 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd677fe700 1 -- 172.21.15.41:0/3014092158 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd5c00d570 con 0x7fbd680b2170 2021-10-21T00:03:41.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd677fe700 1 -- 172.21.15.41:0/3014092158 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c000e90 con 0x7fbd680b2170 2021-10-21T00:03:41.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd677fe700 1 -- 172.21.15.41:0/3014092158 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd5c00d900 con 0x7fbd680b2170 2021-10-21T00:03:41.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- 172.21.15.41:0/3014092158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680b2170 msgr2=0x7fbd680ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680b2170 0x7fbd680ab170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbd5c002f70 tx=0x7fbd5c006eb0).stop 2021-10-21T00:03:41.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- 172.21.15.41:0/3014092158 shutdown_connections 2021-10-21T00:03:41.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/3014092158 >> v2:172.21.15.62:3300/0 conn(0x7fbd680abb50 0x7fbd6814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680af620 0x7fbd680ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/3014092158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680b2170 0x7fbd680ab170 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.967+0000 7fbd6d83b700 1 -- 172.21.15.41:0/3014092158 >> 172.21.15.41:0/3014092158 conn(0x7fbd680b5700 msgr2=0x7fbd680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:41.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- 172.21.15.41:0/3014092158 shutdown_connections 2021-10-21T00:03:41.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- 172.21.15.41:0/3014092158 wait complete. 2021-10-21T00:03:41.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 Processor -- start 2021-10-21T00:03:41.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- start start 2021-10-21T00:03:41.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680abb50 0x7fbd680aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 0x7fbd68066e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680adda0 con 0x7fbd680af620 2021-10-21T00:03:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680ae040 con 0x7fbd68065970 2021-10-21T00:03:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd68066980 con 0x7fbd680abb50 2021-10-21T00:03:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59204/0 (socket says 172.21.15.41:59204) 2021-10-21T00:03:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 -- 172.21.15.41:0/1845664392 learned_addr learned my addr 172.21.15.41:0/1845664392 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d03a700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 0x7fbd68066e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6c839700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680abb50 0x7fbd680aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 -- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680abb50 msgr2=0x7fbd680aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680abb50 0x7fbd680aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 -- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 msgr2=0x7fbd68066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 0x7fbd68066e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 -- 172.21.15.41:0/1845664392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c00b1e0 con 0x7fbd680af620 2021-10-21T00:03:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d03a700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 0x7fbd68066e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:41.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd67fff700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbd5800c000 tx=0x7fbd58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd58010780 con 0x7fbd680af620 2021-10-21T00:03:41.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580108e0 con 0x7fbd680af620 2021-10-21T00:03:41.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd680ada60 con 0x7fbd680af620 2021-10-21T00:03:41.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd58010c40 con 0x7fbd680af620 2021-10-21T00:03:41.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd68067310 con 0x7fbd680af620 2021-10-21T00:03:41.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.971+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68066b40 con 0x7fbd680af620 2021-10-21T00:03:41.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.975+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd5801c460 con 0x7fbd680af620 2021-10-21T00:03:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.975+0000 7fbd65ffb700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 0x7fbd48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.975+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbd5806bd90 con 0x7fbd680af620 2021-10-21T00:03:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.975+0000 7fbd6c839700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 0x7fbd48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.975+0000 7fbd6c839700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 0x7fbd48055ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbd5c01a000 tx=0x7fbd5c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:41.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:41.979+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd58042dc0 con 0x7fbd680af620 2021-10-21T00:03:42.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd680b12d0 con 0x7fbd680af620 2021-10-21T00:03:42.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd65ffb700 1 -- 172.21.15.41:0/1845664392 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fbd580463e0 con 0x7fbd680af620 2021-10-21T00:03:42.115 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:42.116 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":31,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:03:39.653229+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:03:37.173527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-10-21T00:03:37.661285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:03:42.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 msgr2=0x7fbd48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 0x7fbd48055ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbd5c01a000 tx=0x7fbd5c015000).stop 2021-10-21T00:03:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 msgr2=0x7fbd6814cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbd5800c000 tx=0x7fbd58006df0).stop 2021-10-21T00:03:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.107+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 shutdown_connections 2021-10-21T00:03:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbd48053610 0x7fbd48055ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd68065970 0x7fbd68066e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbd680af620 0x7fbd6814cab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 --2- 172.21.15.41:0/1845664392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbd680abb50 0x7fbd680aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 >> 172.21.15.41:0/1845664392 conn(0x7fbd680b5700 msgr2=0x7fbd68097f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 shutdown_connections 2021-10-21T00:03:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.111+0000 7fbd6d83b700 1 -- 172.21.15.41:0/1845664392 wait complete. 2021-10-21T00:03:42.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:03:37.173527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:03:37.661285+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:03:42.131 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:03:42.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 Processor -- start 2021-10-21T00:03:42.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 -- start start 2021-10-21T00:03:42.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fecb40aeec0 0x7fecb40b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb40b1160 0x7fecb4145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb405cad0 con 0x7fecb405c6f0 2021-10-21T00:03:42.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40aece0 con 0x7fecb40aeec0 2021-10-21T00:03:42.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecbb817700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ae300 con 0x7fecb40b1160 2021-10-21T00:03:42.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb8db2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fecb40aeec0 0x7fecb40b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb95b3700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fecb405c6f0 0x7fecb40b0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:56982/0 (socket says 172.21.15.41:56982) 2021-10-21T00:03:42.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb95b3700 1 -- 172.21.15.41:0/948958827 learned_addr learned my addr 172.21.15.41:0/948958827 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:42.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb9db4700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb40b1160 0x7fecb4145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb8db2700 1 -- 172.21.15.41:0/948958827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb40b1160 msgr2=0x7fecb4145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:42.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb8db2700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb40b1160 0x7fecb4145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb8db2700 1 -- 172.21.15.41:0/948958827 >> v1:172.21.15.41:6789/0 conn(0x7fecb405c6f0 legacy=0x7fecb40b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb3fff700 1 -- 172.21.15.41:0/948958827 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514660231 0 0) 0x7fecb405cad0 con 0x7fecb405c6f0 2021-10-21T00:03:42.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.227+0000 7fecb8db2700 1 -- 172.21.15.41:0/948958827 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40ae5a0 con 0x7fecb40aeec0 2021-10-21T00:03:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb8db2700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40aeec0 0x7fecb40b0c70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fecac0032f0 tx=0x7fecac0091d0).ready entity=mon.0 client_cookie=6d55fc1a9adfb18 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb3fff700 1 -- 172.21.15.41:0/948958827 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecac00b6c0 con 0x7fecb40aeec0 2021-10-21T00:03:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb3fff700 1 -- 172.21.15.41:0/948958827 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00b820 con 0x7fecb40aeec0 2021-10-21T00:03:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb3fff700 1 -- 172.21.15.41:0/948958827 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecac00b990 con 0x7fecb40aeec0 2021-10-21T00:03:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- 172.21.15.41:0/948958827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40aeec0 msgr2=0x7fecb40b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40aeec0 0x7fecb40b0c70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fecac0032f0 tx=0x7fecac0091d0).stop 2021-10-21T00:03:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- 172.21.15.41:0/948958827 shutdown_connections 2021-10-21T00:03:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb40b1160 0x7fecb4145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- 172.21.15.41:0/948958827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40aeec0 0x7fecb40b0c70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- 172.21.15.41:0/948958827 >> 172.21.15.41:0/948958827 conn(0x7fecb4063210 msgr2=0x7fecb405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- 172.21.15.41:0/948958827 shutdown_connections 2021-10-21T00:03:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- 172.21.15.41:0/948958827 wait complete. 2021-10-21T00:03:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 Processor -- start 2021-10-21T00:03:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- start start 2021-10-21T00:03:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb405c6f0 0x7fecb40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecb40aeec0 0x7fecb40aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40a7b20 con 0x7fecb40b1160 2021-10-21T00:03:42.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40a7140 con 0x7fecb40aeec0 2021-10-21T00:03:42.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecbb817700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40a73e0 con 0x7fecb405c6f0 2021-10-21T00:03:42.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59220/0 (socket says 172.21.15.41:59220) 2021-10-21T00:03:42.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 -- 172.21.15.41:0/3536221144 learned_addr learned my addr 172.21.15.41:0/3536221144 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:42.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb95b3700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb405c6f0 0x7fecb40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb8db2700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecb40aeec0 0x7fecb40aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 -- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb405c6f0 msgr2=0x7fecb40b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb405c6f0 0x7fecb40b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 -- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecb40aeec0 msgr2=0x7fecb40aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecb40aeec0 0x7fecb40aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.231+0000 7fecb9db4700 1 -- 172.21.15.41:0/3536221144 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009470 con 0x7fecb40b1160 2021-10-21T00:03:42.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb9db4700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7feca400c000 tx=0x7feca4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca4011750 con 0x7fecb40b1160 2021-10-21T00:03:42.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca40118b0 con 0x7fecb40b1160 2021-10-21T00:03:42.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40a7680 con 0x7fecb40b1160 2021-10-21T00:03:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feca4011c10 con 0x7fecb40b1160 2021-10-21T00:03:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40ab9e0 con 0x7fecb40b1160 2021-10-21T00:03:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feca4011d70 con 0x7fecb40b1160 2021-10-21T00:03:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 0x7fec94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40ae840 con 0x7fecb40b1160 2021-10-21T00:03:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feca406bc20 con 0x7fecb40b1160 2021-10-21T00:03:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb95b3700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 0x7fec94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.235+0000 7fecb95b3700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 0x7fec94055ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7feca800d000 tx=0x7feca8007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.243+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feca4042d80 con 0x7fecb40b1160 2021-10-21T00:03:42.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.371+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fecb4057350 con 0x7fecb40b1160 2021-10-21T00:03:42.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecb27fc700 1 -- 172.21.15.41:0/3536221144 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7feca40463a0 con 0x7fecb40b1160 2021-10-21T00:03:42.382 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:03:42.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 msgr2=0x7fec94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 0x7fec94055ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7feca800d000 tx=0x7feca8007a00).stop 2021-10-21T00:03:42.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 msgr2=0x7fecb40ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7feca400c000 tx=0x7feca4006df0).stop 2021-10-21T00:03:42.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 shutdown_connections 2021-10-21T00:03:42.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec94053610 0x7fec94055ad0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fecb40b1160 0x7fecb40ab470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecb40aeec0 0x7fecb40aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 --2- 172.21.15.41:0/3536221144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fecb405c6f0 0x7fecb40b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 >> 172.21.15.41:0/3536221144 conn(0x7fecb4063210 msgr2=0x7fecb4146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 shutdown_connections 2021-10-21T00:03:42.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.375+0000 7fecbb817700 1 -- 172.21.15.41:0/3536221144 wait complete. 2021-10-21T00:03:42.397 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:03:42.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.491+0000 7fe72e7c2700 1 Processor -- start 2021-10-21T00:03:42.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.491+0000 7fe72e7c2700 1 -- start start 2021-10-21T00:03:42.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe7280af620 0x7fe7280ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe728067a80 0x7fe728149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280b0b50 con 0x7fe7280b2170 2021-10-21T00:03:42.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280b2550 con 0x7fe7280af620 2021-10-21T00:03:42.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280b0d90 con 0x7fe728067a80 2021-10-21T00:03:42.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe7280af620 0x7fe7280ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe7280af620 0x7fe7280ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59226/0 (socket says 172.21.15.41:59226) 2021-10-21T00:03:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2301466262 learned_addr learned my addr 172.21.15.41:0/2301466262 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72dfc1700 1 --2- 172.21.15.41:0/2301466262 >> v2:172.21.15.62:3300/0 conn(0x7fe728067a80 0x7fe728149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2301466262 >> v2:172.21.15.62:3300/0 conn(0x7fe728067a80 msgr2=0x7fe728149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 --2- 172.21.15.41:0/2301466262 >> v2:172.21.15.62:3300/0 conn(0x7fe728067a80 0x7fe728149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2301466262 >> v1:172.21.15.62:6789/0 conn(0x7fe7280b2170 legacy=0x7fe7280ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:42.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2301466262 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280b1030 con 0x7fe7280af620 2021-10-21T00:03:42.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72cfbf700 1 --2- 172.21.15.41:0/2301466262 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe7280ab880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe728062470 tx=0x7fe724006eb0).ready entity=mon.0 client_cookie=b5de6ed8e507dd78 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe71ffff700 1 -- 172.21.15.41:0/2301466262 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe72400d5c0 con 0x7fe7280af620 2021-10-21T00:03:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe71ffff700 1 -- 172.21.15.41:0/2301466262 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724000e90 con 0x7fe7280af620 2021-10-21T00:03:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe71ffff700 1 -- 172.21.15.41:0/2301466262 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe72400d950 con 0x7fe7280af620 2021-10-21T00:03:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2301466262 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 msgr2=0x7fe7280ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2301466262 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe7280ab880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe728062470 tx=0x7fe724006eb0).stop 2021-10-21T00:03:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2301466262 shutdown_connections 2021-10-21T00:03:42.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2301466262 >> v2:172.21.15.62:3300/0 conn(0x7fe728067a80 0x7fe728149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2301466262 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe7280ab880 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2301466262 >> 172.21.15.41:0/2301466262 conn(0x7fe7280b5700 msgr2=0x7fe7280b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2301466262 shutdown_connections 2021-10-21T00:03:42.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.495+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2301466262 wait complete. 2021-10-21T00:03:42.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 Processor -- start 2021-10-21T00:03:42.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- start start 2021-10-21T00:03:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe728067a80 0x7fe72814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7280b2170 0x7fe728156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280ae860 con 0x7fe7280af620 2021-10-21T00:03:42.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728066af0 con 0x7fe728067a80 2021-10-21T00:03:42.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe728066d90 con 0x7fe7280b2170 2021-10-21T00:03:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59232/0 (socket says 172.21.15.41:59232) 2021-10-21T00:03:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2475388924 learned_addr learned my addr 172.21.15.41:0/2475388924 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72d7c0700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe728067a80 0x7fe72814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72dfc1700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7280b2170 0x7fe728156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7280b2170 msgr2=0x7fe728156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7280b2170 0x7fe728156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe728067a80 msgr2=0x7fe72814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe728067a80 0x7fe72814ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 -- 172.21.15.41:0/2475388924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72400b1e0 con 0x7fe7280af620 2021-10-21T00:03:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72cfbf700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe728062470 tx=0x7fe724015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe724011760 con 0x7fe7280af620 2021-10-21T00:03:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7240118c0 con 0x7fe7280af620 2021-10-21T00:03:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281570e0 con 0x7fe7280af620 2021-10-21T00:03:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe724011c20 con 0x7fe7280af620 2021-10-21T00:03:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.499+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280ad590 con 0x7fe7280af620 2021-10-21T00:03:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7280aefd0 con 0x7fe7280af620 2021-10-21T00:03:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe724025030 con 0x7fe7280af620 2021-10-21T00:03:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe71e7fc700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 0x7fe710055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe72406c8e0 con 0x7fe7280af620 2021-10-21T00:03:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe72d7c0700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 0x7fe710055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.503+0000 7fe72d7c0700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 0x7fe710055b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe71800c000 tx=0x7fe718008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.511+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe724043a80 con 0x7fe7280af620 2021-10-21T00:03:42.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.635+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7280b0b30 con 0x7fe7280af620 2021-10-21T00:03:42.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.635+0000 7fe71e7fc700 1 -- 172.21.15.41:0/2475388924 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe724047060 con 0x7fe7280af620 2021-10-21T00:03:42.644 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:42.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 msgr2=0x7fe710055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 0x7fe710055b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe71800c000 tx=0x7fe718008040).stop 2021-10-21T00:03:42.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 msgr2=0x7fe728156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe728062470 tx=0x7fe724015000).stop 2021-10-21T00:03:42.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 shutdown_connections 2021-10-21T00:03:42.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe710053640 0x7fe710055b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7280b2170 0x7fe728156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7280af620 0x7fe728156700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 --2- 172.21.15.41:0/2475388924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe728067a80 0x7fe72814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 >> 172.21.15.41:0/2475388924 conn(0x7fe7280b5700 msgr2=0x7fe7280b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 shutdown_connections 2021-10-21T00:03:42.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.639+0000 7fe72e7c2700 1 -- 172.21.15.41:0/2475388924 wait complete. 2021-10-21T00:03:42.657 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:03:42.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 Processor -- start 2021-10-21T00:03:42.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 -- start start 2021-10-21T00:03:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faed80b23b0 0x7faed813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed81419a0 con 0x7faed805c810 2021-10-21T00:03:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80af1c0 con 0x7faed80b23b0 2021-10-21T00:03:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8064e80 con 0x7faed80aede0 2021-10-21T00:03:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed67fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7faed805c810 0x7faed80b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57010/0 (socket says 172.21.15.41:57010) 2021-10-21T00:03:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed67fc700 1 -- 172.21.15.41:0/526793504 learned_addr learned my addr 172.21.15.41:0/526793504 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed77fe700 1 --2- 172.21.15.41:0/526793504 >> v2:172.21.15.41:3300/0 conn(0x7faed80b23b0 0x7faed813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.763+0000 7faed6ffd700 1 --2- 172.21.15.41:0/526793504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed5ffb700 1 -- 172.21.15.41:0/526793504 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259711862 0 0) 0x7faed81419a0 con 0x7faed805c810 2021-10-21T00:03:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed5ffb700 1 -- 172.21.15.41:0/526793504 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb8003260 con 0x7faed805c810 2021-10-21T00:03:42.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 -- 172.21.15.41:0/526793504 >> v2:172.21.15.41:3300/0 conn(0x7faed80b23b0 msgr2=0x7faed813f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:42.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 --2- 172.21.15.41:0/526793504 >> v2:172.21.15.41:3300/0 conn(0x7faed80b23b0 0x7faed813f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 -- 172.21.15.41:0/526793504 >> v1:172.21.15.41:6789/0 conn(0x7faed805c810 legacy=0x7faed80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 -- 172.21.15.41:0/526793504 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8065120 con 0x7faed80aede0 2021-10-21T00:03:42.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 --2- 172.21.15.41:0/526793504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8143d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0006df0).ready entity=mon.2 client_cookie=89d5956ca3360fca server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed5ffb700 1 -- 172.21.15.41:0/526793504 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000d4a0 con 0x7faed80aede0 2021-10-21T00:03:42.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed5ffb700 1 -- 172.21.15.41:0/526793504 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0000e90 con 0x7faed80aede0 2021-10-21T00:03:42.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed5ffb700 1 -- 172.21.15.41:0/526793504 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000d7f0 con 0x7faed80aede0 2021-10-21T00:03:42.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- 172.21.15.41:0/526793504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 msgr2=0x7faed8143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- 172.21.15.41:0/526793504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8143d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0006df0).stop 2021-10-21T00:03:42.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- 172.21.15.41:0/526793504 shutdown_connections 2021-10-21T00:03:42.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- 172.21.15.41:0/526793504 >> v2:172.21.15.41:3300/0 conn(0x7faed80b23b0 0x7faed813f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- 172.21.15.41:0/526793504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8143d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- 172.21.15.41:0/526793504 >> 172.21.15.41:0/526793504 conn(0x7faed80627b0 msgr2=0x7faed8062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- 172.21.15.41:0/526793504 shutdown_connections 2021-10-21T00:03:42.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- 172.21.15.41:0/526793504 wait complete. 2021-10-21T00:03:42.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 Processor -- start 2021-10-21T00:03:42.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- start start 2021-10-21T00:03:42.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8065720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed80b23b0 0x7faed81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81551c0 con 0x7faed805c810 2021-10-21T00:03:42.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8112da0 con 0x7faed80b23b0 2021-10-21T00:03:42.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8113010 con 0x7faed80aede0 2021-10-21T00:03:42.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59244/0 (socket says 172.21.15.41:59244) 2021-10-21T00:03:42.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed6ffd700 1 -- 172.21.15.41:0/1067946498 learned_addr learned my addr 172.21.15.41:0/1067946498 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:42.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed67fc700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8065720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.767+0000 7faed77fe700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed80b23b0 0x7faed81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 -- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 msgr2=0x7faed8065720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8065720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 -- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed80b23b0 msgr2=0x7faed81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed80b23b0 0x7faed81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 -- 172.21.15.41:0/1067946498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec000b180 con 0x7faed805c810 2021-10-21T00:03:42.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed6ffd700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec0016070 con 0x7faed805c810 2021-10-21T00:03:42.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00137d0 con 0x7faed805c810 2021-10-21T00:03:42.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec0013b30 con 0x7faed805c810 2021-10-21T00:03:42.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed8140060 con 0x7faed805c810 2021-10-21T00:03:42.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed80ae4e0 con 0x7faed805c810 2021-10-21T00:03:42.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed80b17d0 con 0x7faed805c810 2021-10-21T00:03:42.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faec000f030 con 0x7faed805c810 2021-10-21T00:03:42.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 0x7faebc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:42.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faec006c510 con 0x7faed805c810 2021-10-21T00:03:42.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.771+0000 7faed67fc700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 0x7faebc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:42.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.775+0000 7faed67fc700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 0x7faebc055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7faec800d000 tx=0x7faec8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:42.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.779+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faec0043670 con 0x7faed805c810 2021-10-21T00:03:42.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.903+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faed8155300 con 0x7faed805c810 2021-10-21T00:03:42.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faecffff700 1 -- 172.21.15.41:0/1067946498 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+10 (secure 0 0 0) 0x7faec0023020 con 0x7faed805c810 2021-10-21T00:03:42.914 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:42.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 msgr2=0x7faebc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 0x7faebc055ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7faec800d000 tx=0x7faec8009040).stop 2021-10-21T00:03:42.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 msgr2=0x7faed8151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:42.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0014000).stop 2021-10-21T00:03:42.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 shutdown_connections 2021-10-21T00:03:42.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faebc053610 0x7faebc055ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed80b23b0 0x7faed81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed80aede0 0x7faed8065720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 --2- 172.21.15.41:0/1067946498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed805c810 0x7faed8151bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:42.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 >> 172.21.15.41:0/1067946498 conn(0x7faed80627b0 msgr2=0x7faed8143c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:42.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 shutdown_connections 2021-10-21T00:03:42.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:42.907+0000 7faed7fff700 1 -- 172.21.15.41:0/1067946498 wait complete. 2021-10-21T00:03:42.934 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:03:43.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 Processor -- start 2021-10-21T00:03:43.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 -- start start 2021-10-21T00:03:43.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f348c0b26d0 0x7f348c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0ba080 con 0x7f348c0b31e0 2021-10-21T00:03:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c05c670 con 0x7f348c0b9ca0 2021-10-21T00:03:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3493acd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c05c8e0 con 0x7f348c0b26d0 2021-10-21T00:03:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3491869700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f349206a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f348c0b26d0 0x7f348c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f349206a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f348c0b26d0 0x7f348c141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:42938/0 (socket says 172.21.15.41:42938) 2021-10-21T00:03:43.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f349206a700 1 -- 172.21.15.41:0/77508048 learned_addr learned my addr 172.21.15.41:0/77508048 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:43.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3491869700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59252/0 (socket says 172.21.15.41:59252) 2021-10-21T00:03:43.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.043+0000 7f3491068700 1 --1- 172.21.15.41:0/77508048 >> v1:172.21.15.62:6789/0 conn(0x7f348c0b31e0 0x7f348c0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36846/0 (socket says 172.21.15.41:36846) 2021-10-21T00:03:43.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f349206a700 1 -- 172.21.15.41:0/77508048 >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 msgr2=0x7f348c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:43.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f349206a700 1 --2- 172.21.15.41:0/77508048 >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f349206a700 1 -- 172.21.15.41:0/77508048 >> v1:172.21.15.62:6789/0 conn(0x7f348c0b31e0 legacy=0x7f348c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f349206a700 1 -- 172.21.15.41:0/77508048 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c05cb80 con 0x7f348c0b26d0 2021-10-21T00:03:43.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3490867700 1 -- 172.21.15.41:0/77508048 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444157292 0 0) 0x7f348c0ba080 con 0x7f348c0b31e0 2021-10-21T00:03:43.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3491869700 1 --2- 172.21.15.41:0/77508048 >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:43.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f349206a700 1 --2- 172.21.15.41:0/77508048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b26d0 0x7f348c141bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f34840032f0 tx=0x7f3484009290).ready entity=mon.1 client_cookie=a89e19e124f45830 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3490867700 1 -- 172.21.15.41:0/77508048 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348400b870 con 0x7f348c0b26d0 2021-10-21T00:03:43.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3490867700 1 -- 172.21.15.41:0/77508048 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400b9d0 con 0x7f348c0b26d0 2021-10-21T00:03:43.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3490867700 1 -- 172.21.15.41:0/77508048 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f348400bb40 con 0x7f348c0b26d0 2021-10-21T00:03:43.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 -- 172.21.15.41:0/77508048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b26d0 msgr2=0x7f348c141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 --2- 172.21.15.41:0/77508048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b26d0 0x7f348c141bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f34840032f0 tx=0x7f3484009290).stop 2021-10-21T00:03:43.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 -- 172.21.15.41:0/77508048 shutdown_connections 2021-10-21T00:03:43.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 --2- 172.21.15.41:0/77508048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b26d0 0x7f348c141bc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 --2- 172.21.15.41:0/77508048 >> v2:172.21.15.41:3300/0 conn(0x7f348c0b9ca0 0x7f348c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 -- 172.21.15.41:0/77508048 >> 172.21.15.41:0/77508048 conn(0x7f348c062f00 msgr2=0x7f348c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 -- 172.21.15.41:0/77508048 shutdown_connections 2021-10-21T00:03:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.047+0000 7f3493acd700 1 -- 172.21.15.41:0/77508048 wait complete. 2021-10-21T00:03:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 Processor -- start 2021-10-21T00:03:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- start start 2021-10-21T00:03:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f348c0b31e0 0x7f348c1420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b9ca0 0x7f348c147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c147d00 con 0x7f348c0b26d0 2021-10-21T00:03:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c147310 con 0x7f348c0b9ca0 2021-10-21T00:03:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c147050 con 0x7f348c0b31e0 2021-10-21T00:03:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59258/0 (socket says 172.21.15.41:59258) 2021-10-21T00:03:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 -- 172.21.15.41:0/1629680069 learned_addr learned my addr 172.21.15.41:0/1629680069 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491068700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f348c0b31e0 0x7f348c1420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f349206a700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b9ca0 0x7f348c147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 -- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f348c0b31e0 msgr2=0x7f348c1420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f348c0b31e0 0x7f348c1420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 -- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b9ca0 msgr2=0x7f348c147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b9ca0 0x7f348c147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 -- 172.21.15.41:0/1629680069 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348800b180 con 0x7f348c0b26d0 2021-10-21T00:03:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3491869700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f348800c000 tx=0x7f3488006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3488010780 con 0x7f348c0b26d0 2021-10-21T00:03:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880108e0 con 0x7f348c0b26d0 2021-10-21T00:03:43.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484009530 con 0x7f348c0b26d0 2021-10-21T00:03:43.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3488010c40 con 0x7f348c0b26d0 2021-10-21T00:03:43.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.051+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c146a40 con 0x7f348c0b26d0 2021-10-21T00:03:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c112440 con 0x7f348c0b26d0 2021-10-21T00:03:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f348801c460 con 0x7f348c0b26d0 2021-10-21T00:03:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f347effd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 0x7f346c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f348806bdf0 con 0x7f348c0b26d0 2021-10-21T00:03:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f3491068700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 0x7f346c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.055+0000 7f3491068700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 0x7f346c055ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f348000d000 tx=0x7f34800079e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.063+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3488042ef0 con 0x7f348c0b26d0 2021-10-21T00:03:43.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f348c067c90 con 0x7f348c0b26d0 2021-10-21T00:03:43.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f347effd700 1 -- 172.21.15.41:0/1629680069 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3488046510 con 0x7f348c0b26d0 2021-10-21T00:03:43.199 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:03:43.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 msgr2=0x7f346c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 0x7f346c055ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f348000d000 tx=0x7f34800079e0).stop 2021-10-21T00:03:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 msgr2=0x7f348c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f348800c000 tx=0x7f3488006df0).stop 2021-10-21T00:03:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 shutdown_connections 2021-10-21T00:03:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f346c053610 0x7f346c055ad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f348c0b9ca0 0x7f348c147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f348c0b31e0 0x7f348c1420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 --2- 172.21.15.41:0/1629680069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f348c0b26d0 0x7f348c155000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.191+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 >> 172.21.15.41:0/1629680069 conn(0x7f348c062f00 msgr2=0x7f348c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:43.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.195+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 shutdown_connections 2021-10-21T00:03:43.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.195+0000 7f3493acd700 1 -- 172.21.15.41:0/1629680069 wait complete. 2021-10-21T00:03:43.212 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:03:43.212 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:43.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 Processor -- start 2021-10-21T00:03:43.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 -- start start 2021-10-21T00:03:43.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 0x7f540c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c05bd40 con 0x7f540c062f70 2021-10-21T00:03:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c05bf70 con 0x7f540c062330 2021-10-21T00:03:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c142cb0 con 0x7f540c0b3a20 2021-10-21T00:03:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 0x7f540c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49536/0 (socket says 172.21.15.41:49536) 2021-10-21T00:03:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 -- 172.21.15.41:0/2503112914 learned_addr learned my addr 172.21.15.41:0/2503112914 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f5409d9b700 1 --1- 172.21.15.41:0/2503112914 >> v1:172.21.15.62:6789/0 conn(0x7f540c062f70 0x7f540c05c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36862/0 (socket says 172.21.15.41:36862) 2021-10-21T00:03:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 -- 172.21.15.41:0/2503112914 >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 msgr2=0x7f540c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 --2- 172.21.15.41:0/2503112914 >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 0x7f540c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 -- 172.21.15.41:0/2503112914 >> v1:172.21.15.62:6789/0 conn(0x7f540c062f70 legacy=0x7f540c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540959a700 1 -- 172.21.15.41:0/2503112914 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458733777 0 0) 0x7f540c05bd40 con 0x7f540c062f70 2021-10-21T00:03:43.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 -- 172.21.15.41:0/2503112914 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c142950 con 0x7f540c0b3a20 2021-10-21T00:03:43.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540a59c700 1 --2- 172.21.15.41:0/2503112914 >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 0x7f540c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:03:43.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540ad9d700 1 --2- 172.21.15.41:0/2503112914 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5404002f70 tx=0x7f5404006eb0).ready entity=mon.2 client_cookie=13a8e6a29cd8284a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540959a700 1 -- 172.21.15.41:0/2503112914 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540400d570 con 0x7f540c0b3a20 2021-10-21T00:03:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540959a700 1 -- 172.21.15.41:0/2503112914 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404000e90 con 0x7f540c0b3a20 2021-10-21T00:03:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.307+0000 7f540959a700 1 -- 172.21.15.41:0/2503112914 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540400d8c0 con 0x7f540c0b3a20 2021-10-21T00:03:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- 172.21.15.41:0/2503112914 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 msgr2=0x7f540c13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- 172.21.15.41:0/2503112914 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5404002f70 tx=0x7f5404006eb0).stop 2021-10-21T00:03:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- 172.21.15.41:0/2503112914 shutdown_connections 2021-10-21T00:03:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- 172.21.15.41:0/2503112914 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13c510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- 172.21.15.41:0/2503112914 >> v2:172.21.15.62:3300/0 conn(0x7f540c062330 0x7f540c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- 172.21.15.41:0/2503112914 >> 172.21.15.41:0/2503112914 conn(0x7f540c0b9080 msgr2=0x7f540c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- 172.21.15.41:0/2503112914 shutdown_connections 2021-10-21T00:03:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- 172.21.15.41:0/2503112914 wait complete. 2021-10-21T00:03:43.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 Processor -- start 2021-10-21T00:03:43.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- start start 2021-10-21T00:03:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f540c062330 0x7f540c0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c112430 con 0x7f540c062f70 2021-10-21T00:03:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1126d0 con 0x7f540c062330 2021-10-21T00:03:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c112b70 con 0x7f540c0b3a20 2021-10-21T00:03:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f5409d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f5409d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59276/0 (socket says 172.21.15.41:59276) 2021-10-21T00:03:43.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f5409d9b700 1 -- 172.21.15.41:0/1988357887 learned_addr learned my addr 172.21.15.41:0/1988357887 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:43.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.311+0000 7f540a59c700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f540c062330 0x7f540c0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 -- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 msgr2=0x7f540c13dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 -- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f540c062330 msgr2=0x7f540c0ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f540c062330 0x7f540c0ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 -- 172.21.15.41:0/1988357887 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009470 con 0x7f540c062f70 2021-10-21T00:03:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f5409d9b700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f53fc000ed0 tx=0x7f53fc007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc0070d0 con 0x7f540c062f70 2021-10-21T00:03:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc007230 con 0x7f540c062f70 2021-10-21T00:03:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540400b1e0 con 0x7f540c062f70 2021-10-21T00:03:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc005740 con 0x7f540c062f70 2021-10-21T00:03:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c146b20 con 0x7f540c062f70 2021-10-21T00:03:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c112270 con 0x7f540c062f70 2021-10-21T00:03:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53fc010070 con 0x7f540c062f70 2021-10-21T00:03:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 0x7f53e4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.315+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53fc06b060 con 0x7f540c062f70 2021-10-21T00:03:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.319+0000 7f540a59c700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 0x7f53e4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.319+0000 7f540a59c700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 0x7f53e4055b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f53f400b000 tx=0x7f53f40091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.323+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53fc0421c0 con 0x7f540c062f70 2021-10-21T00:03:43.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f540c1451c0 con 0x7f540c062f70 2021-10-21T00:03:43.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f54037fe700 1 -- 172.21.15.41:0/1988357887 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f53fc0457e0 con 0x7f540c062f70 2021-10-21T00:03:43.499 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:43.499 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:43.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 msgr2=0x7f53e4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 0x7f53e4055b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f53f400b000 tx=0x7f53f40091d0).stop 2021-10-21T00:03:43.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 msgr2=0x7f540c1454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:43.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f53fc000ed0 tx=0x7f53fc007a90).stop 2021-10-21T00:03:43.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 shutdown_connections 2021-10-21T00:03:43.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53e4053640 0x7f53e4055b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540c0b3a20 0x7f540c13dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f540c062f70 0x7f540c1454f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 --2- 172.21.15.41:0/1988357887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f540c062330 0x7f540c0ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:43.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 >> 172.21.15.41:0/1988357887 conn(0x7f540c0b9080 msgr2=0x7f540c13eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:43.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 shutdown_connections 2021-10-21T00:03:43.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:43.491+0000 7f540b59e700 1 -- 172.21.15.41:0/1988357887 wait complete. 2021-10-21T00:03:43.504 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:43.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:03:38.650515+0000', 'modified': '2021-10-21T00:03:39.654379+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4912}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4912': {'gid': 4912, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/1216827791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 1216827791}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 1216827791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:03:43.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:03:43.716 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:03:43.836 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":4912,"want_state":"up:active","state":"up:active","rank_uptime":5.1698626770000002,"mdsmap_epoch":10,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":11.378785097} 2021-10-21T00:03:43.837 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 4912, "mdsmap_epoch": 10, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 5.169862677, "state": "up:active", "uptime": 11.378785097, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:03:43.837 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:03:43.838 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:03:43.838 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:03:43.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:43.839 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:43.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:03:43.867 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:43.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:43.926 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:43.927 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:43.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:43.928 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:03:43.935 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:03:43.936 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:43.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:03:43.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:44.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:44.012 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:44.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:44.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:44.015 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:03:44.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:03:44.053+0000 7f23620c4080 -1 init, newargv = 0x55c0690a2900 newargc=9ceph-fuse[ 2021-10-21T00:03:44.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:13924]: starting ceph client 2021-10-21T00:03:44.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[13924]: starting fuse 2021-10-21T00:03:45.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:03:45.143 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:03:45.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:03:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:03:45.200 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:03:45.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.202 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:03:45.208 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:03:45.208 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:03:45.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:03:45.210 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:03:45.211 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:03:45.211 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:03:45.212 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:03:45.212 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.213 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:03:45.213 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:03:45.214 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:03:45.214 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.215 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:03:45.215 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:03:45.215 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:03:45.216 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:03:45.216 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.217 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:03:45.217 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:03:45.218 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:03:45.218 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:03:45.219 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:03:45.219 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.219 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:03:45.220 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:03:45.265 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.13924.asok 2021-10-21T00:03:45.267 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13924.asok 2021-10-21T00:03:45.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13924.asok status 2021-10-21T00:03:45.354 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:03:45.354 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:03:45.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:03:45.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:03:45.355 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:03:45.355 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:03:45.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:03:45.356 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "13924", 2021-10-21T00:03:45.356 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:03:45.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:45.356 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:03:45.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:03:45.357 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5139, 2021-10-21T00:03:45.357 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:03:45.357 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:03:45.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:03:45.358 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5139 2021-10-21T00:03:45.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:45.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:03:45.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:03:45.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:03:45.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 5565986 2021-10-21T00:03:45.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:03:45.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:45.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:03:45.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:03:45.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:03:45.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 5565986 2021-10-21T00:03:45.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:03:45.362 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5139 172.21.15.71:0/5565986", 2021-10-21T00:03:45.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/5565986", 2021-10-21T00:03:45.363 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:03:45.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 10, 2021-10-21T00:03:45.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 31, 2021-10-21T00:03:45.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:03:45.364 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:03:45.364 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:03:45.364 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:03:45.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.366 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:45.367 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:45.377 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:03:45.378 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:45.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.380 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:45.402 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-10-21T00:03:45.510 INFO:teuthology.orchestra.run.smithi041.stdout:{"mds_min_caps_per_client":"100"} 2021-10-21T00:03:45.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-10-21T00:03:45.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:03:45.512 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:03:45.513 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:03:45.522 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:03:45.523 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:03:45.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:03:45.524 DEBUG:teuthology.orchestra.run.smithi071:> import sys 2021-10-21T00:03:45.524 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:03:45.525 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:03:45.525 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.526 DEBUG:teuthology.orchestra.run.smithi071:> n = 1000 2021-10-21T00:03:45.526 DEBUG:teuthology.orchestra.run.smithi071:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-21T00:03:45.526 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.527 DEBUG:teuthology.orchestra.run.smithi071:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-21T00:03:45.527 DEBUG:teuthology.orchestra.run.smithi071:> os.makedirs(os.path.dirname(abs_path)) 2021-10-21T00:03:45.528 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:03:45.528 DEBUG:teuthology.orchestra.run.smithi071:> for i in range(0, n): 2021-10-21T00:03:45.528 DEBUG:teuthology.orchestra.run.smithi071:> fname = "{0}_{1}".format(abs_path, i) 2021-10-21T00:03:45.529 DEBUG:teuthology.orchestra.run.smithi071:> with open(fname, '"'"'w'"'"') as f: 2021-10-21T00:03:45.529 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:03:45.530 DEBUG:teuthology.orchestra.run.smithi071:> if True: 2021-10-21T00:03:45.530 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:03:45.530 DEBUG:teuthology.orchestra.run.smithi071:> os.fsync(f.fileno()) 2021-10-21T00:03:45.531 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:03:55.011 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 Processor -- start 2021-10-21T00:03:55.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 -- start start 2021-10-21T00:03:55.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 0x7f4a4c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a4c05cb10 0x7f4a4c143e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c064200 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c05cfa0 con 0x7f4a4c05cb10 2021-10-21T00:03:55.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a544c8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0644a0 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a51a63700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4a4c0b2cc0 0x7f4a4c13dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57054/0 (socket says 172.21.15.41:57054) 2021-10-21T00:03:55.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a51a63700 1 -- 172.21.15.41:0/1527756929 learned_addr learned my addr 172.21.15.41:0/1527756929 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:03:55.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a52264700 1 --2- 172.21.15.41:0/1527756929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 0x7f4a4c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.131+0000 7f4a52a65700 1 --2- 172.21.15.41:0/1527756929 >> v2:172.21.15.62:3300/0 conn(0x7f4a4c05cb10 0x7f4a4c143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a51262700 1 -- 172.21.15.41:0/1527756929 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029134561 0 0) 0x7f4a4c064200 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a51262700 1 -- 172.21.15.41:0/1527756929 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a38003260 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a52264700 1 -- 172.21.15.41:0/1527756929 >> v2:172.21.15.62:3300/0 conn(0x7f4a4c05cb10 msgr2=0x7f4a4c143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:55.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a52264700 1 --2- 172.21.15.41:0/1527756929 >> v2:172.21.15.62:3300/0 conn(0x7f4a4c05cb10 0x7f4a4c143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a52264700 1 -- 172.21.15.41:0/1527756929 >> v1:172.21.15.41:6789/0 conn(0x7f4a4c0b2cc0 legacy=0x7f4a4c13dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a52264700 1 -- 172.21.15.41:0/1527756929 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0b17c0 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a52264700 1 --2- 172.21.15.41:0/1527756929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 0x7f4a4c0b1c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4a3c002f70 tx=0x7f4a3c006df0).ready entity=mon.2 client_cookie=7553a0a635636439 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a51262700 1 -- 172.21.15.41:0/1527756929 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c00d4a0 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a51262700 1 -- 172.21.15.41:0/1527756929 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c000e90 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a51262700 1 -- 172.21.15.41:0/1527756929 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c00d7f0 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- 172.21.15.41:0/1527756929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 msgr2=0x7f4a4c0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 --2- 172.21.15.41:0/1527756929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 0x7f4a4c0b1c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4a3c002f70 tx=0x7f4a3c006df0).stop 2021-10-21T00:03:55.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- 172.21.15.41:0/1527756929 shutdown_connections 2021-10-21T00:03:55.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 --2- 172.21.15.41:0/1527756929 >> v2:172.21.15.62:3300/0 conn(0x7f4a4c05cb10 0x7f4a4c143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 --2- 172.21.15.41:0/1527756929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c0b5f80 0x7f4a4c0b1c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- 172.21.15.41:0/1527756929 >> 172.21.15.41:0/1527756929 conn(0x7f4a4c063ae0 msgr2=0x7f4a4c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:55.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- 172.21.15.41:0/1527756929 shutdown_connections 2021-10-21T00:03:55.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- 172.21.15.41:0/1527756929 wait complete. 2021-10-21T00:03:55.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 Processor -- start 2021-10-21T00:03:55.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.135+0000 7f4a544c8700 1 -- start start 2021-10-21T00:03:55.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c05cb10 0x7f4a4c13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a4c0b5f80 0x7f4a4c13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c13eaf0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c13ed90 con 0x7f4a4c0b5f80 2021-10-21T00:03:55.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c13f030 con 0x7f4a4c05cb10 2021-10-21T00:03:55.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59290/0 (socket says 172.21.15.41:59290) 2021-10-21T00:03:55.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 -- 172.21.15.41:0/3522281098 learned_addr learned my addr 172.21.15.41:0/3522281098 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:55.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a52264700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c05cb10 0x7f4a4c13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a52a65700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a4c0b5f80 0x7f4a4c13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 -- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c05cb10 msgr2=0x7f4a4c13c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c05cb10 0x7f4a4c13c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 -- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a4c0b5f80 msgr2=0x7f4a4c13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a4c0b5f80 0x7f4a4c13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 -- 172.21.15.41:0/3522281098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c00b180 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a51a63700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4a40001110 tx=0x7f4a40007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000ce80 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a400070d0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c150df0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a40007430 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.139+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c1401f0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c150700 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a40010070 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a4b7fe700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 0x7f4a2c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a4006aee0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a52264700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 0x7f4a2c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.143+0000 7f4a52264700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 0x7f4a2c055b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f4a3c01a000 tx=0x7f4a3c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.151+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a40042040 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a4c13e2c0 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a4b7fe700 1 -- 172.21.15.41:0/3522281098 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f4a40018070 con 0x7f4a4c0b2cc0 2021-10-21T00:03:55.323 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:55.324 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 msgr2=0x7f4a2c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 0x7f4a2c055b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f4a3c01a000 tx=0x7f4a3c014000).stop 2021-10-21T00:03:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 msgr2=0x7f4a4c150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4a40001110 tx=0x7f4a40007aa0).stop 2021-10-21T00:03:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 shutdown_connections 2021-10-21T00:03:55.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a2c0536a0 0x7f4a2c055b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a4c0b5f80 0x7f4a4c13fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a4c0b2cc0 0x7f4a4c150900 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 --2- 172.21.15.41:0/3522281098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a4c05cb10 0x7f4a4c13c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 >> 172.21.15.41:0/3522281098 conn(0x7f4a4c063ae0 msgr2=0x7f4a4c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:55.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 shutdown_connections 2021-10-21T00:03:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.315+0000 7f4a544c8700 1 -- 172.21.15.41:0/3522281098 wait complete. 2021-10-21T00:03:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:55.337 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-10-21T00:03:55.439 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-21T00:03:55.439 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-21T00:03:55.440 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 Processor -- start 2021-10-21T00:03:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 -- start start 2021-10-21T00:03:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd2740ab600 0x7fd27405fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740b2550 con 0x7fd2740602d0 2021-10-21T00:03:55.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740aba40 con 0x7fd2740ab600 2021-10-21T00:03:55.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd274142d60 con 0x7fd2740b2170 2021-10-21T00:03:55.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd2740ab600 0x7fd27405fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd2740ab600 0x7fd27405fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59296/0 (socket says 172.21.15.41:59296) 2021-10-21T00:03:55.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 -- 172.21.15.41:0/489644435 learned_addr learned my addr 172.21.15.41:0/489644435 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:55.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27259c700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 -- 172.21.15.41:0/489644435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 msgr2=0x7fd2740b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:55.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 -- 172.21.15.41:0/489644435 >> v1:172.21.15.41:6789/0 conn(0x7fd2740602d0 legacy=0x7fd274145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 -- 172.21.15.41:0/489644435 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740b1350 con 0x7fd2740ab600 2021-10-21T00:03:55.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd27159a700 1 -- 172.21.15.41:0/489644435 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308789797 0 0) 0x7fd2740b2550 con 0x7fd2740602d0 2021-10-21T00:03:55.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.535+0000 7fd271d9b700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd27405fde0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd2640032f0 tx=0x7fd264009290).ready entity=mon.0 client_cookie=68aeeabfc4b4a15 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27159a700 1 -- 172.21.15.41:0/489644435 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26400b8a0 con 0x7fd2740ab600 2021-10-21T00:03:55.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27159a700 1 -- 172.21.15.41:0/489644435 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400ba00 con 0x7fd2740ab600 2021-10-21T00:03:55.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27159a700 1 -- 172.21.15.41:0/489644435 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd26400bb70 con 0x7fd2740ab600 2021-10-21T00:03:55.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- 172.21.15.41:0/489644435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 msgr2=0x7fd27405fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd27405fde0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fd2640032f0 tx=0x7fd264009290).stop 2021-10-21T00:03:55.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- 172.21.15.41:0/489644435 shutdown_connections 2021-10-21T00:03:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd27405fde0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 --2- 172.21.15.41:0/489644435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- 172.21.15.41:0/489644435 >> 172.21.15.41:0/489644435 conn(0x7fd2740b5700 msgr2=0x7fd2740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- 172.21.15.41:0/489644435 shutdown_connections 2021-10-21T00:03:55.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- 172.21.15.41:0/489644435 wait complete. 2021-10-21T00:03:55.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 Processor -- start 2021-10-21T00:03:55.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.539+0000 7fd27359e700 1 -- start start 2021-10-21T00:03:55.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2740602d0 0x7fd27408fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274099360 con 0x7fd2740ab600 2021-10-21T00:03:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274099830 con 0x7fd2740602d0 2021-10-21T00:03:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd274099590 con 0x7fd2740b2170 2021-10-21T00:03:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59304/0 (socket says 172.21.15.41:59304) 2021-10-21T00:03:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 -- 172.21.15.41:0/3201265673 learned_addr learned my addr 172.21.15.41:0/3201265673 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27259c700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2740602d0 0x7fd27408fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd272d9d700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 -- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 msgr2=0x7fd2740ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 -- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2740602d0 msgr2=0x7fd27408fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2740602d0 0x7fd27408fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 -- 172.21.15.41:0/3201265673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264009530 con 0x7fd2740ab600 2021-10-21T00:03:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd271d9b700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd2640032f0 tx=0x7fd264016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd264021630 con 0x7fd2740ab600 2021-10-21T00:03:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2740adbd0 con 0x7fd2740ab600 2021-10-21T00:03:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd264021790 con 0x7fd2740ab600 2021-10-21T00:03:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd264021af0 con 0x7fd2740ab600 2021-10-21T00:03:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.543+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2740aed40 con 0x7fd2740ab600 2021-10-21T00:03:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd274098900 con 0x7fd2740ab600 2021-10-21T00:03:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd26400f070 con 0x7fd2740ab600 2021-10-21T00:03:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd2637fe700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 0x7fd250055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd26406d0d0 con 0x7fd2740ab600 2021-10-21T00:03:55.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd27259c700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 0x7fd250055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.547+0000 7fd27259c700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 0x7fd250055ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd26800c000 tx=0x7fd268008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.551+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd274098900 con 0x7fd2740ab600 2021-10-21T00:03:55.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2740988d0 con 0x7fd2740ab600 2021-10-21T00:03:55.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd2637fe700 1 -- 172.21.15.41:0/3201265673 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fd264015030 con 0x7fd2740ab600 2021-10-21T00:03:55.722 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:55.722 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:55.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 msgr2=0x7fd250055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 0x7fd250055ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd26800c000 tx=0x7fd268008040).stop 2021-10-21T00:03:55.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 msgr2=0x7fd2741478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd2640032f0 tx=0x7fd264016000).stop 2021-10-21T00:03:55.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 shutdown_connections 2021-10-21T00:03:55.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd250053610 0x7fd250055ad0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2740b2170 0x7fd2740ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd2740ab600 0x7fd2741478d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 --2- 172.21.15.41:0/3201265673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2740602d0 0x7fd27408fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 >> 172.21.15.41:0/3201265673 conn(0x7fd2740b5700 msgr2=0x7fd2740b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:55.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 shutdown_connections 2021-10-21T00:03:55.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.715+0000 7fd27359e700 1 -- 172.21.15.41:0/3201265673 wait complete. 2021-10-21T00:03:55.729 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:55.735 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-21T00:03:55.839 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-21T00:03:55.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-21T00:03:55.841 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:03:55.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 Processor -- start 2021-10-21T00:03:55.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 -- start start 2021-10-21T00:03:55.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7680b0d00 0x7fa768142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa7680acbc0 0x7fa768143250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680af2f0 con 0x7fa7680b2570 2021-10-21T00:03:55.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680ad840 con 0x7fa7680acbc0 2021-10-21T00:03:55.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa76dfd8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680b1510 con 0x7fa7680b0d00 2021-10-21T00:03:55.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa7680acbc0 0x7fa768143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa7677fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7680b0d00 0x7fa768142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa7680acbc0 0x7fa768143250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59312/0 (socket says 172.21.15.41:59312) 2021-10-21T00:03:55.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 -- 172.21.15.41:0/708406788 learned_addr learned my addr 172.21.15.41:0/708406788 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:55.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa766ffd700 1 --1- 172.21.15.41:0/708406788 >> v1:172.21.15.62:6789/0 conn(0x7fa7680b2570 0x7fa7680ae3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36904/0 (socket says 172.21.15.41:36904) 2021-10-21T00:03:55.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 -- 172.21.15.41:0/708406788 >> v2:172.21.15.62:3300/0 conn(0x7fa7680b0d00 msgr2=0x7fa768142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:55.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 --2- 172.21.15.41:0/708406788 >> v2:172.21.15.62:3300/0 conn(0x7fa7680b0d00 0x7fa768142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 -- 172.21.15.41:0/708406788 >> v1:172.21.15.62:6789/0 conn(0x7fa7680b2570 legacy=0x7fa7680ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.935+0000 7fa767fff700 1 -- 172.21.15.41:0/708406788 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680b17b0 con 0x7fa7680acbc0 2021-10-21T00:03:55.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa767fff700 1 --2- 172.21.15.41:0/708406788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680acbc0 0x7fa768143250 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa7600032f0 tx=0x7fa760009290).ready entity=mon.0 client_cookie=21b0459df0945de1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa7667fc700 1 -- 172.21.15.41:0/708406788 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa76000b870 con 0x7fa7680acbc0 2021-10-21T00:03:55.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa7667fc700 1 -- 172.21.15.41:0/708406788 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000b9d0 con 0x7fa7680acbc0 2021-10-21T00:03:55.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa7667fc700 1 -- 172.21.15.41:0/708406788 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa76000bb40 con 0x7fa7680acbc0 2021-10-21T00:03:55.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 -- 172.21.15.41:0/708406788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680acbc0 msgr2=0x7fa768143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/708406788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680acbc0 0x7fa768143250 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa7600032f0 tx=0x7fa760009290).stop 2021-10-21T00:03:55.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 -- 172.21.15.41:0/708406788 shutdown_connections 2021-10-21T00:03:55.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/708406788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680acbc0 0x7fa768143250 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/708406788 >> v2:172.21.15.62:3300/0 conn(0x7fa7680b0d00 0x7fa768142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 -- 172.21.15.41:0/708406788 >> 172.21.15.41:0/708406788 conn(0x7fa768063070 msgr2=0x7fa768063450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:55.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 -- 172.21.15.41:0/708406788 shutdown_connections 2021-10-21T00:03:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.939+0000 7fa76dfd8700 1 -- 172.21.15.41:0/708406788 wait complete. 2021-10-21T00:03:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 Processor -- start 2021-10-21T00:03:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 -- start start 2021-10-21T00:03:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7680acbc0 0x7fa7680b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680b2570 0x7fa768153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768137bb0 con 0x7fa7680b0d00 2021-10-21T00:03:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681536a0 con 0x7fa7680b2570 2021-10-21T00:03:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681365f0 con 0x7fa7680acbc0 2021-10-21T00:03:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7680acbc0 0x7fa7680b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa767fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680b2570 0x7fa768153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59316/0 (socket says 172.21.15.41:59316) 2021-10-21T00:03:55.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 -- 172.21.15.41:0/3154695162 learned_addr learned my addr 172.21.15.41:0/3154695162 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:55.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 -- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7680acbc0 msgr2=0x7fa7680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7680acbc0 0x7fa7680b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 -- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680b2570 msgr2=0x7fa768153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:55.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680b2570 0x7fa768153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:55.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 -- 172.21.15.41:0/3154695162 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760009530 con 0x7fa7680b0d00 2021-10-21T00:03:55.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa766ffd700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa7680b2ba0 tx=0x7fa75c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c0070d0 con 0x7fa7680b0d00 2021-10-21T00:03:55.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c007230 con 0x7fa7680b0d00 2021-10-21T00:03:55.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768137830 con 0x7fa7680b0d00 2021-10-21T00:03:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.943+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c005740 con 0x7fa7680b0d00 2021-10-21T00:03:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa768154030 con 0x7fa7680b0d00 2021-10-21T00:03:55.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768137a20 con 0x7fa7680b0d00 2021-10-21T00:03:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa75c010070 con 0x7fa7680b0d00 2021-10-21T00:03:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa764ff9700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 0x7fa748055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa75c06af10 con 0x7fa7680b0d00 2021-10-21T00:03:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.947+0000 7fa7677fe700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 0x7fa748055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:55.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.951+0000 7fa7677fe700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 0x7fa748055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa75800b000 tx=0x7fa758006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:55.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:55.955+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa75c041f60 con 0x7fa7680b0d00 2021-10-21T00:03:56.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.119+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa768057350 con 0x7fa7680b0d00 2021-10-21T00:03:56.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.119+0000 7fa764ff9700 1 -- 172.21.15.41:0/3154695162 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fa75c018030 con 0x7fa7680b0d00 2021-10-21T00:03:56.128 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:03:56.128 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:03:56.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 msgr2=0x7fa748055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 0x7fa748055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa75800b000 tx=0x7fa758006df0).stop 2021-10-21T00:03:56.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 msgr2=0x7fa768136100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa7680b2ba0 tx=0x7fa75c007bd0).stop 2021-10-21T00:03:56.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 shutdown_connections 2021-10-21T00:03:56.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa7480536a0 0x7fa748055b60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680b2570 0x7fa768153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa7680b0d00 0x7fa768136100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 --2- 172.21.15.41:0/3154695162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7680acbc0 0x7fa7680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 >> 172.21.15.41:0/3154695162 conn(0x7fa768063070 msgr2=0x7fa76805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:56.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 shutdown_connections 2021-10-21T00:03:56.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.123+0000 7fa76dfd8700 1 -- 172.21.15.41:0/3154695162 wait complete. 2021-10-21T00:03:56.133 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:03:56.140 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-10-21T00:03:56.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 Processor -- start 2021-10-21T00:03:56.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 -- start start 2021-10-21T00:03:56.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1fc0b2c90 0x7fb1fc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0b3070 con 0x7fb1fc064450 2021-10-21T00:03:56.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b0ce0 con 0x7fb1fc0b2c90 2021-10-21T00:03:56.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb201c94700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0ae550 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.239+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1fc0b2c90 0x7fb1fc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49588/0 (socket says 172.21.15.41:49588) 2021-10-21T00:03:56.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fbfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb1fc064450 0x7fb1fc142e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:36920/0 (socket says 172.21.15.41:36920) 2021-10-21T00:03:56.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 -- 172.21.15.41:0/55818416 learned_addr learned my addr 172.21.15.41:0/55818416 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 -- 172.21.15.41:0/55818416 >> v2:172.21.15.62:3300/0 conn(0x7fb1fc0b2c90 msgr2=0x7fb1fc0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 --2- 172.21.15.41:0/55818416 >> v2:172.21.15.62:3300/0 conn(0x7fb1fc0b2c90 0x7fb1fc0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 -- 172.21.15.41:0/55818416 >> v1:172.21.15.62:6789/0 conn(0x7fb1fc064450 legacy=0x7fb1fc142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fa7fc700 1 -- 172.21.15.41:0/55818416 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27957237 0 0) 0x7fb1fc0b3070 con 0x7fb1fc064450 2021-10-21T00:03:56.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 -- 172.21.15.41:0/55818416 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0ae7f0 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1faffd700 1 --2- 172.21.15.41:0/55818416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb1e4002f70 tx=0x7fb1e4006eb0).ready entity=mon.2 client_cookie=ceb5ec95d8aa89e2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fa7fc700 1 -- 172.21.15.41:0/55818416 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1e400d570 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fa7fc700 1 -- 172.21.15.41:0/55818416 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4000e90 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb1fa7fc700 1 -- 172.21.15.41:0/55818416 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1e400d8c0 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 -- 172.21.15.41:0/55818416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 msgr2=0x7fb1fc13ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 --2- 172.21.15.41:0/55818416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb1e4002f70 tx=0x7fb1e4006eb0).stop 2021-10-21T00:03:56.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 -- 172.21.15.41:0/55818416 shutdown_connections 2021-10-21T00:03:56.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 --2- 172.21.15.41:0/55818416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13ed90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 --2- 172.21.15.41:0/55818416 >> v2:172.21.15.62:3300/0 conn(0x7fb1fc0b2c90 0x7fb1fc0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 -- 172.21.15.41:0/55818416 >> 172.21.15.41:0/55818416 conn(0x7fb1fc061d80 msgr2=0x7fb1fc063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:56.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 -- 172.21.15.41:0/55818416 shutdown_connections 2021-10-21T00:03:56.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.243+0000 7fb201c94700 1 -- 172.21.15.41:0/55818416 wait complete. 2021-10-21T00:03:56.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 Processor -- start 2021-10-21T00:03:56.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 -- start start 2021-10-21T00:03:56.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1fc0b2c90 0x7fb1fc138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc13e550 con 0x7fb1fc064450 2021-10-21T00:03:56.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc13e790 con 0x7fb1fc0b2c90 2021-10-21T00:03:56.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb201c94700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc065240 con 0x7fb1fc0b16f0 2021-10-21T00:03:56.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59328/0 (socket says 172.21.15.41:59328) 2021-10-21T00:03:56.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb1fb7fe700 1 -- 172.21.15.41:0/967422221 learned_addr learned my addr 172.21.15.41:0/967422221 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1fc0b2c90 0x7fb1fc138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.247+0000 7fb1faffd700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 -- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 msgr2=0x7fb1fc13e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 -- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1fc0b2c90 msgr2=0x7fb1fc138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1fc0b2c90 0x7fb1fc138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 -- 172.21.15.41:0/967422221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e400b1e0 con 0x7fb1fc064450 2021-10-21T00:03:56.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1faffd700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:56.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb1ec00c000 tx=0x7fb1ec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 -- 172.21.15.41:0/967422221 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ec010780 con 0x7fb1fc064450 2021-10-21T00:03:56.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 -- 172.21.15.41:0/967422221 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0108e0 con 0x7fb1fc064450 2021-10-21T00:03:56.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc0654e0 con 0x7fb1fc064450 2021-10-21T00:03:56.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 -- 172.21.15.41:0/967422221 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ec010c40 con 0x7fb1fc064450 2021-10-21T00:03:56.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc065ba0 con 0x7fb1fc064450 2021-10-21T00:03:56.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 -- 172.21.15.41:0/967422221 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1ec01c460 con 0x7fb1fc064450 2021-10-21T00:03:56.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 0x7fb1e0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1f8ff9700 1 -- 172.21.15.41:0/967422221 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1ec06be90 con 0x7fb1fc064450 2021-10-21T00:03:56.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.251+0000 7fb1faffd700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 0x7fb1e0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1faffd700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 0x7fb1e0055bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb1e401a000 tx=0x7fb1e4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 Processor -- start 2021-10-21T00:03:56.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 -- start start 2021-10-21T00:03:56.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbc850 0x1dbdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d2b190 con 0x1dbd580 2021-10-21T00:03:56.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d0b820 con 0x1db5ee0 2021-10-21T00:03:56.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1db9730 con 0x1dbc850 2021-10-21T00:03:56.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59338/0 (socket says 172.21.15.41:59338) 2021-10-21T00:03:56.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1387402186 learned_addr learned my addr 172.21.15.41:0/1387402186 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbc850 0x1dbdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.255+0000 7fb1faffd700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbc850 msgr2=0x1dbdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbc850 0x1dbdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 msgr2=0x1dbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1387402186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d636e0 con 0x1dbd580 2021-10-21T00:03:56.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1faffd700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:03:56.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x1d76c60 tx=0x7fb1f4007ce0).ready entity=mon.0 client_cookie=3d096aaaf64f1856 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb201c94700 1 -- 172.21.15.41:0/1387402186 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f4001b00 con 0x1dbd580 2021-10-21T00:03:56.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb201c94700 1 -- 172.21.15.41:0/1387402186 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4001c60 con 0x1dbd580 2021-10-21T00:03:56.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb201c94700 1 -- 172.21.15.41:0/1387402186 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f4001fc0 con 0x1dbd580 2021-10-21T00:03:56.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- 172.21.15.41:0/1387402186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 msgr2=0x1df1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x1d76c60 tx=0x7fb1f4007ce0).stop 2021-10-21T00:03:56.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- 172.21.15.41:0/1387402186 shutdown_connections 2021-10-21T00:03:56.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1df1720 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1387402186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbc850 0x1dbdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- 172.21.15.41:0/1387402186 >> 172.21.15.41:0/1387402186 conn(0x1d43870 msgr2=0x1db9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:56.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- 172.21.15.41:0/1387402186 shutdown_connections 2021-10-21T00:03:56.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- 172.21.15.41:0/1387402186 wait complete. 2021-10-21T00:03:56.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- start start 2021-10-21T00:03:56.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 Processor -- start 2021-10-21T00:03:56.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dfbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbd580 0x1e076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1defc40 con 0x1dbc850 2021-10-21T00:03:56.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de3170 con 0x1db5ee0 2021-10-21T00:03:56.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1de3410 con 0x1dbd580 2021-10-21T00:03:56.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb20bed8740 10 client.0 ll_register_callbacks cb 0x1cf9410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:03:56.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59344/0 (socket says 172.21.15.41:59344) 2021-10-21T00:03:56.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1faffd700 1 -- 172.21.15.41:0/2599679702 learned_addr learned my addr 172.21.15.41:0/2599679702 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dfbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbd580 0x1e076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.259+0000 7fb1faffd700 1 -- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbd580 msgr2=0x1e076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1faffd700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbd580 0x1e076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1faffd700 1 -- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 msgr2=0x1dfbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1faffd700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dfbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1faffd700 1 -- 172.21.15.41:0/2599679702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f4004b50 con 0x1dbc850 2021-10-21T00:03:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1faffd700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb1e4026000 tx=0x7fb1e4020000).ready entity=mon.0 client_cookie=d681b4ab60f56898 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:03:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1e401fe60 con 0x1dbc850 2021-10-21T00:03:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1e4024070 con 0x1dbc850 2021-10-21T00:03:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d21170 con 0x1dbc850 2021-10-21T00:03:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1e4011400 con 0x1dbc850 2021-10-21T00:03:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 10 client.5169 fetch_fsmap learned FSMap version 10 2021-10-21T00:03:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1d1aa50 con 0x1dbc850 2021-10-21T00:03:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d21170 con 0x1dbc850 2021-10-21T00:03:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fb1e401b030 con 0x1dbc850 2021-10-21T00:03:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 10 client.5169 fetch_fsmap finished waiting for FSMap version 10 2021-10-21T00:03:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 10 client.5169 resolve_mds: resolved ID 'a' to GID 4912 2021-10-21T00:03:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 20 client.5169 populate_metadata read hostname 'smithi041' 2021-10-21T00:03:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1dfc6b0 0x1e07bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 4 client.5169 mds_command: new command op to 4912 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-21T00:03:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 --> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1d194e0 con 0x1dfc6b0 2021-10-21T00:03:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1dfc6b0 0x1e07bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 10 client.5169 ms_handle_connect on v2:172.21.15.41:6832/1216827791 2021-10-21T00:03:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1dfc6b0 0x1e07bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7eb24e46dd9abfba server_cookie=245a2300a1f8083b in_seq=0 out_seq=0 2021-10-21T00:03:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 1 -- 172.21.15.41:0/2599679702 <== mds.0 v2:172.21.15.41:6832/1216827791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1d194e0 con 0x1dfc6b0 2021-10-21T00:03:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 10 client.5169 handle_command_reply: tid=0 2021-10-21T00:03:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 client.5169 shutdown 2021-10-21T00:03:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 msgr2=0x1dfc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fb1e4026000 tx=0x7fb1e4020000).stop 2021-10-21T00:03:56.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 shutdown_connections 2021-10-21T00:03:56.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1dfc6b0 0x1e07bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1dbd580 0x1e076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb1da7fc700 0 client.5169 ms_handle_reset on v2:172.21.15.41:6832/1216827791 2021-10-21T00:03:56.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbc850 0x1dfc1c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 --2- 172.21.15.41:0/2599679702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1db5ee0 0x1dfbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 >> 172.21.15.41:0/2599679702 conn(0x1d43870 msgr2=0x1db9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:56.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 shutdown_connections 2021-10-21T00:03:56.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 1 -- 172.21.15.41:0/2599679702 wait complete. 2021-10-21T00:03:56.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.263+0000 7fb20bed8740 20 client.5169 trim_cache size 0 max 16384 2021-10-21T00:03:56.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 Processor -- start 2021-10-21T00:03:56.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- start start 2021-10-21T00:03:56.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1def380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1dbcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df0260 con 0x1dbd580 2021-10-21T00:03:56.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d587b0 con 0x1dbc850 2021-10-21T00:03:56.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d7f060 con 0x1db5ee0 2021-10-21T00:03:56.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59352/0 (socket says 172.21.15.41:59352) 2021-10-21T00:03:56.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 -- 172.21.15.41:0/3364638736 learned_addr learned my addr 172.21.15.41:0/3364638736 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1faffd700 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1dbcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1def380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 -- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 msgr2=0x1def380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1def380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 -- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 msgr2=0x1dbcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1dbcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 -- 172.21.15.41:0/3364638736 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d1fd40 con 0x1dbd580 2021-10-21T00:03:56.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb1f401f000 tx=0x7fb1f4017000).ready entity=mon.0 client_cookie=31dd757abd24aa4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1f0ff9700 1 -- 172.21.15.41:0/3364638736 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f40048e0 con 0x1dbd580 2021-10-21T00:03:56.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1f0ff9700 1 -- 172.21.15.41:0/3364638736 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4025070 con 0x1dbd580 2021-10-21T00:03:56.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb1f0ff9700 1 -- 172.21.15.41:0/3364638736 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f4001b00 con 0x1dbd580 2021-10-21T00:03:56.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- 172.21.15.41:0/3364638736 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 msgr2=0x1dbade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:03:56.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb1f401f000 tx=0x7fb1f4017000).stop 2021-10-21T00:03:56.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- 172.21.15.41:0/3364638736 shutdown_connections 2021-10-21T00:03:56.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dbade0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1dbcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 --2- 172.21.15.41:0/3364638736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1def380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- 172.21.15.41:0/3364638736 >> 172.21.15.41:0/3364638736 conn(0x1d43870 msgr2=0x1db7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:03:56.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- 172.21.15.41:0/3364638736 shutdown_connections 2021-10-21T00:03:56.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- 172.21.15.41:0/3364638736 wait complete. 2021-10-21T00:03:56.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.279+0000 7fb20bed8740 1 -- start start 2021-10-21T00:03:56.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 Processor -- start 2021-10-21T00:03:56.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1e50a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1e50f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e58290 con 0x1dbd580 2021-10-21T00:03:56.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df5990 con 0x1dbc850 2021-10-21T00:03:56.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dbadb0 con 0x1db5ee0 2021-10-21T00:03:56.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 10 client.0 ll_register_callbacks cb 0x1dfba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:03:56.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1e50a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59358/0 (socket says 172.21.15.41:59358) 2021-10-21T00:03:56.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1302867238 learned_addr learned my addr 172.21.15.41:0/1302867238 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:03:56.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1faffd700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1e50f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 msgr2=0x1e50a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1e50a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 msgr2=0x1e50f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:03:56.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1e50f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:03:56.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 -- 172.21.15.41:0/1302867238 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1d636e0 con 0x1dbd580 2021-10-21T00:03:56.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:03:56.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fbfff700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fb1f401f000 tx=0x7fb1f4023070).ready entity=mon.0 client_cookie=6a0e2023e28a307 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:03:56.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f4001fe0 con 0x1dbd580 2021-10-21T00:03:56.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1f4015870 con 0x1dbd580 2021-10-21T00:03:56.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1f4001c60 con 0x1dbd580 2021-10-21T00:03:56.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f4015a30 con 0x1dbd580 2021-10-21T00:03:56.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 10 client.5175 fetch_fsmap learned FSMap version 10 2021-10-21T00:03:56.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1cf53f0 con 0x1dbd580 2021-10-21T00:03:56.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4001c60 con 0x1dbd580 2021-10-21T00:03:56.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fb1f4028030 con 0x1dbd580 2021-10-21T00:03:56.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 10 client.5175 fetch_fsmap finished waiting for FSMap version 10 2021-10-21T00:03:56.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 10 client.5175 resolve_mds: resolved ID 'a' to GID 4912 2021-10-21T00:03:56.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 20 client.5175 populate_metadata read hostname 'smithi041' 2021-10-21T00:03:56.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1def0b0 0x1dee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:03:56.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 4 client.5175 mds_command: new command op to 4912 tid=0[{"prefix": "cache drop"}] 2021-10-21T00:03:56.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 --> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1c0f590 con 0x1def0b0 2021-10-21T00:03:56.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1def0b0 0x1dee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:03:56.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1db7fe700 10 client.5175 ms_handle_connect on v2:172.21.15.41:6832/1216827791 2021-10-21T00:03:56.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:03:56.283+0000 7fb1fb7fe700 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1def0b0 0x1dee380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3bdefd9d6a3da8bd server_cookie=1176f27aea775c1f in_seq=0 out_seq=0 2021-10-21T00:03:57.262 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:57.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:57.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:57.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:03:57.274 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:27.463 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:27.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:27.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:27.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:27.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:40.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb1db7fe700 1 -- 172.21.15.41:0/1302867238 <== mds.0 v2:172.21.15.41:6832/1216827791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x1c0f590 con 0x1def0b0 2021-10-21T00:04:40.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb1db7fe700 10 client.5175 handle_command_reply: tid=0 2021-10-21T00:04:40.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 client.5175 shutdown 2021-10-21T00:04:40.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 msgr2=0x1dede90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:40.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fb1f401f000 tx=0x7fb1f4023070).stop 2021-10-21T00:04:40.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 shutdown_connections 2021-10-21T00:04:40.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:6832/1216827791,v1:172.21.15.41:6833/1216827791] conn(0x1def0b0 0x1dee380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1dbd580 0x1dede90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1dbc850 0x1e50f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 --2- 172.21.15.41:0/1302867238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1db5ee0 0x1e50a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb1db7fe700 0 client.5175 ms_handle_reset on v2:172.21.15.41:6832/1216827791 2021-10-21T00:04:40.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 >> 172.21.15.41:0/1302867238 conn(0x1d43870 msgr2=0x1dfbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:40.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 shutdown_connections 2021-10-21T00:04:40.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 1 -- 172.21.15.41:0/1302867238 wait complete. 2021-10-21T00:04:40.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.623+0000 7fb20bed8740 20 client.5175 trim_cache size 0 max 16384 2021-10-21T00:04:40.637 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:04:40.637 INFO:teuthology.orchestra.run.smithi041.stdout: "client_recall": { 2021-10-21T00:04:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:04:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "(0) Success", 2021-10-21T00:04:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "recalled": 920 2021-10-21T00:04:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "flush_journal": { 2021-10-21T00:04:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:04:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "" 2021-10-21T00:04:40.642 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: "trim_cache": { 2021-10-21T00:04:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: "trimmed": 900 2021-10-21T00:04:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: "cache": { 2021-10-21T00:04:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": { 2021-10-21T00:04:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "items": 2501, 2021-10-21T00:04:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes": 431728 2021-10-21T00:04:40.647 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:40.647 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "duration": 44.338795122000001 2021-10-21T00:04:40.648 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:04:40.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 msgr2=0x7fb1e0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:40.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 0x7fb1e0055bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb1e401a000 tx=0x7fb1e4015000).stop 2021-10-21T00:04:40.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 msgr2=0x7fb1fc05ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:40.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb1ec00c000 tx=0x7fb1ec006df0).stop 2021-10-21T00:04:40.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 shutdown_connections 2021-10-21T00:04:40.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1e00536f0 0x7fb1e0055bb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1fc0b2c90 0x7fb1fc138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1fc0b16f0 0x7fb1fc13e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 --2- 172.21.15.41:0/967422221 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1fc064450 0x7fb1fc05ff70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:40.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 >> 172.21.15.41:0/967422221 conn(0x7fb1fc061d80 msgr2=0x7fb1fc13f570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:40.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 shutdown_connections 2021-10-21T00:04:40.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:40.627+0000 7fb201c94700 1 -- 172.21.15.41:0/967422221 wait complete. 2021-10-21T00:04:40.657 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:04:40.658 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:40.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:40.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:40.734 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:40.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:40.777 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:04:40.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:40.778 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:40.779 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:04:40.788 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:04:40.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:04:40.789 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:04:40.790 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:40.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[13924]: fuse finished with error 0 and tester_r 0 2021-10-21T00:04:40.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:40.808 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:40.809 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:40.859 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:04:40.860 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:04:40.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:04:40.934 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:40.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:40.941 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:40.942 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:04:40.949 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:04:40.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:40.951 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:04:40.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:04:40.952 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:04:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:04:40.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:40.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:40.961 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:40.962 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:04:40.969 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:04:40.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:40.971 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:04:40.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:04:40.972 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:04:40.978 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:04:40.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:40.980 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:04:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.083+0000 7f03ebab3700 1 Processor -- start 2021-10-21T00:04:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.083+0000 7f03ebab3700 1 -- start start 2021-10-21T00:04:41.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03e41426d0 0x7f03e405c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e4146b20 con 0x7f03e40b5f80 2021-10-21T00:04:41.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e4146dc0 con 0x7f03e41426d0 2021-10-21T00:04:41.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40b6360 con 0x7f03e40b04d0 2021-10-21T00:04:41.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03e41426d0 0x7f03e405c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03e41426d0 0x7f03e405c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59368/0 (socket says 172.21.15.41:59368) 2021-10-21T00:04:41.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 -- 172.21.15.41:0/3118175686 learned_addr learned my addr 172.21.15.41:0/3118175686 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03e904e700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 -- 172.21.15.41:0/3118175686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 msgr2=0x7f03e40af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:41.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 -- 172.21.15.41:0/3118175686 >> v1:172.21.15.62:6789/0 conn(0x7f03e40b5f80 legacy=0x7f03e4141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 -- 172.21.15.41:0/3118175686 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40b64d0 con 0x7f03e41426d0 2021-10-21T00:04:41.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ea050700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e41426d0 0x7f03e405c5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f03dc0032f0 tx=0x7f03dc009290).ready entity=mon.0 client_cookie=e2610be71928601e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03e884d700 1 -- 172.21.15.41:0/3118175686 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03dc00b8a0 con 0x7f03e41426d0 2021-10-21T00:04:41.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03e884d700 1 -- 172.21.15.41:0/3118175686 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00ba00 con 0x7f03e41426d0 2021-10-21T00:04:41.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03e884d700 1 -- 172.21.15.41:0/3118175686 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03dc00bb70 con 0x7f03e41426d0 2021-10-21T00:04:41.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- 172.21.15.41:0/3118175686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e41426d0 msgr2=0x7f03e405c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e41426d0 0x7f03e405c5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f03dc0032f0 tx=0x7f03dc009290).stop 2021-10-21T00:04:41.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- 172.21.15.41:0/3118175686 shutdown_connections 2021-10-21T00:04:41.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e41426d0 0x7f03e405c5d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3118175686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- 172.21.15.41:0/3118175686 >> 172.21.15.41:0/3118175686 conn(0x7f03e4063ae0 msgr2=0x7f03e40b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:41.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- 172.21.15.41:0/3118175686 shutdown_connections 2021-10-21T00:04:41.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.087+0000 7f03ebab3700 1 -- 172.21.15.41:0/3118175686 wait complete. 2021-10-21T00:04:41.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 Processor -- start 2021-10-21T00:04:41.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 -- start start 2021-10-21T00:04:41.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e41426d0 0x7f03e4155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4065520 con 0x7f03e40b5f80 2021-10-21T00:04:41.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4065cf0 con 0x7f03e41426d0 2021-10-21T00:04:41.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ebab3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4065f90 con 0x7f03e40b04d0 2021-10-21T00:04:41.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59370/0 (socket says 172.21.15.41:59370) 2021-10-21T00:04:41.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 -- 172.21.15.41:0/3369595588 learned_addr learned my addr 172.21.15.41:0/3369595588 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03ea050700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e41426d0 0x7f03e4155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e984f700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 -- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 msgr2=0x7f03e40656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 -- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e41426d0 msgr2=0x7f03e4155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e41426d0 0x7f03e4155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e904e700 1 -- 172.21.15.41:0/3369595588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009530 con 0x7f03e40b5f80 2021-10-21T00:04:41.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.091+0000 7f03e984f700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:41.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03e904e700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f03d400c000 tx=0x7f03d4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d4010590 con 0x7f03e40b5f80 2021-10-21T00:04:41.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d40106f0 con 0x7f03e40b5f80 2021-10-21T00:04:41.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e4113010 con 0x7f03e40b5f80 2021-10-21T00:04:41.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d4010a50 con 0x7f03e40b5f80 2021-10-21T00:04:41.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e4065030 con 0x7f03e40b5f80 2021-10-21T00:04:41.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e4066150 con 0x7f03e40b5f80 2021-10-21T00:04:41.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03d4010bb0 con 0x7f03e40b5f80 2021-10-21T00:04:41.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 0x7f03c4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03d406ba20 con 0x7f03e40b5f80 2021-10-21T00:04:41.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03e984f700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 0x7f03c4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.095+0000 7f03e984f700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 0x7f03c4055b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f03e000b000 tx=0x7f03e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.099+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03d4042ae0 con 0x7f03e40b5f80 2021-10-21T00:04:41.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.227+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f03e41131a0 con 0x7f03e40b5f80 2021-10-21T00:04:41.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03d2ffd700 1 -- 172.21.15.41:0/3369595588 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v31) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f03d4046100 con 0x7f03e40b5f80 2021-10-21T00:04:41.238 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:41.238 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:04:41.238 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 31, 2021-10-21T00:04:41.239 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:04:41.239 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:04:41.239 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:03:39.653229+0000", 2021-10-21T00:04:41.239 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:04:41.240 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:04:41.240 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:04:41.240 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:04:41.240 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:04:41.240 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:04:41.241 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:04:41.241 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:04:41.241 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:04:41.241 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:41.242 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:04:41.242 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:04:41.242 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:04:41.242 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:04:41.242 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:04:41.243 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 6, 2021-10-21T00:04:41.243 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:04:41.243 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:04:41.243 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:04:41.243 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:04:41.244 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:04:41.244 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.244 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:04:41.244 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:04:41.245 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:04:41.245 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:41.245 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:41.245 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:41.245 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:41.246 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:41.246 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:41.246 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:41.246 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:41.247 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:04:41.247 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:04:41.247 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:04:41.248 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:04:41.249 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:04:41.249 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:41.249 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:41.249 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:41.249 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:41.250 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:41.250 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:41.250 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:41.250 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.251 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:04:41.251 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:41.251 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:41.251 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:41.251 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:41.252 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:41.252 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:41.252 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:41.252 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:41.253 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:41.253 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:41.253 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:41.253 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:41.253 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:41.254 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:41.254 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:41.254 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:41.255 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:41.255 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:41.255 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:41.255 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:41.255 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:41.256 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:41.256 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:41.256 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:41.256 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:41.257 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:41.257 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.257 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:41.257 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:41.258 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:41.258 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:41.258 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:41.258 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:41.259 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:41.259 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:41.259 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:41.259 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:41.259 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:41.260 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:04:41.260 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:04:41.260 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.260 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:41.260 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:04:41.261 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.261 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.261 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:04:41.262 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:04:41.262 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:04:41.262 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:41.262 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:41.262 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:41.263 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:41.263 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:41.263 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:41.263 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:41.265 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:41.265 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:04:41.265 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:04:41.265 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:04:41.265 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:04:41.266 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:04:41.266 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:41.266 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:41.266 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:41.267 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:41.267 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:41.267 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:41.267 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:41.267 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:04:41.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:41.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:41.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:41.269 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:41.269 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:41.269 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:41.269 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:41.269 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:41.270 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:41.270 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:41.270 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:41.270 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:41.271 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:41.271 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:41.271 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:41.271 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:41.271 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:41.272 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:41.272 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:41.272 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:41.272 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:41.272 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:41.273 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:41.273 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:41.273 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:41.273 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:41.273 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.274 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:41.274 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:41.274 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:41.274 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:41.275 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:41.275 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:41.275 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:41.275 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:41.275 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:41.276 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:41.276 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:41.276 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:04:41.276 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:41.276 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:04:41.277 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.277 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.277 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 5, 2021-10-21T00:04:41.277 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:04:41.278 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:03:37.173527+0000", 2021-10-21T00:04:41.278 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:41.278 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:41.278 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:41.279 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:41.279 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:41.279 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:41.279 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:41.279 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:41.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:04:41.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:04:41.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:04:41.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:04:41.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:04:41.281 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:41.281 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:41.281 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:41.281 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:41.281 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:41.282 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:41.282 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:41.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.282 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "30", 2021-10-21T00:04:41.283 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:41.283 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:41.283 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:41.284 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:41.284 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:41.284 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:41.285 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:41.285 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:41.285 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:41.285 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:41.285 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:41.286 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:41.286 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:41.286 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:41.286 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:41.286 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:41.287 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:41.287 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:41.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:41.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:41.288 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:41.288 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:41.288 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:41.288 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:41.288 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:41.289 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:41.289 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.289 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:41.289 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:41.289 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:41.290 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:41.290 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:41.290 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:41.290 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:41.290 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:41.291 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:41.291 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:41.291 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:41.291 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:04:41.292 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:04:41.292 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:04:41.292 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:04:41.292 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.292 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:41.293 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:04:41.293 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:04:41.293 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.293 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.293 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.294 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.294 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 6, 2021-10-21T00:04:41.294 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:04:41.294 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:03:37.661285+0000", 2021-10-21T00:04:41.295 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:41.295 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:41.295 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:41.295 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:41.295 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:41.296 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:41.296 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:41.296 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:41.296 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:04:41.297 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:04:41.297 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:04:41.297 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:04:41.297 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:04:41.297 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:41.298 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:41.298 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:41.298 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:41.298 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:41.299 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:41.299 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:41.299 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.299 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "31", 2021-10-21T00:04:41.299 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:41.300 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:41.300 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:41.300 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:41.300 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:41.300 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:41.301 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:41.301 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:41.301 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:41.301 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:41.301 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:41.302 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:41.302 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:41.303 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:41.303 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:41.303 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:41.303 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:41.304 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:41.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:41.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:41.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:41.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:41.305 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:41.305 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:41.305 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:41.305 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:41.306 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.306 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:41.306 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:41.306 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:41.306 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:41.307 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:41.307 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:41.307 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:41.307 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:41.307 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:41.308 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:41.308 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:41.308 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:04:41.308 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:41.309 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:04:41.309 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:04:41.309 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.309 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.309 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.310 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:41.310 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:04:41.310 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.310 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:04:41.311 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:04:41.311 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.311 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.311 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.311 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.312 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.312 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.312 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.312 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.312 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.313 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.313 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.313 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.313 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.314 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.314 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:04:41.314 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.314 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.314 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.315 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:04:41.315 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.315 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.315 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.316 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.316 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.316 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.317 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:04:41.317 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.317 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.317 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.318 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:04:41.318 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.318 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.318 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.319 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.319 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.319 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.319 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:04:41.320 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.320 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.320 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.320 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.321 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:04:41.321 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.321 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.321 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.322 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.322 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.322 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.322 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.322 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.323 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:04:41.323 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.323 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.323 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.324 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:04:41.324 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:41.324 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.324 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.324 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.325 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:04:41.325 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:04:41.325 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:04:41.325 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:04:41.325 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.326 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.326 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.326 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.326 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.327 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.327 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:04:41.327 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:04:41.327 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.327 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.328 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.328 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.328 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.329 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.329 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.329 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.329 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.329 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.330 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.330 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:04:41.330 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.331 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.331 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.331 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.331 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:04:41.331 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.332 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.332 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.332 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.332 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.333 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.333 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.333 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:04:41.333 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.333 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.334 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.334 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.334 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:04:41.334 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.335 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.335 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.335 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.335 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.336 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.336 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:04:41.336 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.337 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.337 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.337 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:04:41.337 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.338 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.338 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.338 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.338 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.338 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.339 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:04:41.339 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.339 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.340 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.340 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.340 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:04:41.340 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:41.340 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.341 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.341 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.341 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:04:41.341 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:04:41.341 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:04:41.342 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:04:41.342 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.342 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.342 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.343 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.343 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.343 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.343 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:04:41.343 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:04:41.344 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.344 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.344 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.344 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.344 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.345 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.345 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:04:41.345 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.346 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.346 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.346 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.346 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.347 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:04:41.347 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.347 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.347 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.347 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.348 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:04:41.348 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.348 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.348 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.348 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.349 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.349 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.349 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.350 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:04:41.350 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.350 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.350 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.350 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.351 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:04:41.351 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.351 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.351 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.352 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.352 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.352 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:04:41.353 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.353 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.353 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.353 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:04:41.354 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.354 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.354 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.354 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.355 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.355 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.355 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.355 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.355 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:04:41.356 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.356 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.356 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.356 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.357 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:04:41.357 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:41.357 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.357 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.357 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.358 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:04:41.358 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:04:41.358 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:04:41.358 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:04:41.358 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.359 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.359 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.359 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.359 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.360 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.360 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:04:41.360 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:04:41.360 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.360 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.361 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.361 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.361 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.361 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.361 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.362 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.362 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.362 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.362 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.362 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.363 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.363 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.363 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:04:41.363 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.364 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.364 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.364 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:04:41.364 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.365 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.365 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.365 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.365 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.365 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.366 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.366 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:04:41.366 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.367 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.367 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.367 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.367 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:04:41.367 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.368 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.368 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.368 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.368 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.368 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.369 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.369 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.369 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:04:41.369 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.369 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.370 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.370 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:04:41.370 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.371 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.371 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.371 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.371 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.372 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.372 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:04:41.372 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.373 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.373 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.373 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:04:41.373 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:41.374 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.374 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.374 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.374 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:04:41.375 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:04:41.375 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:04:41.375 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:04:41.375 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.375 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.376 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.376 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.376 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.376 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:04:41.377 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:04:41.377 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.377 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.377 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.378 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.378 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.378 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.378 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.378 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.379 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.379 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.379 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.379 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.379 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.380 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.380 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:04:41.380 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.380 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.380 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.381 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.381 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:04:41.381 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.381 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.382 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.382 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.382 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.382 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.382 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.383 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.383 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:04:41.383 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.383 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.383 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.384 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.384 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:04:41.384 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.384 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.385 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.385 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.385 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.385 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.385 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.386 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.386 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:04:41.386 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.386 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.387 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.387 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.387 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:04:41.387 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.387 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.388 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.388 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.388 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.388 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.389 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.389 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:04:41.389 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.389 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.389 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.390 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.390 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:04:41.390 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:41.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.391 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.391 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.391 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:04:41.391 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:04:41.391 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:04:41.392 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:04:41.392 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.392 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.392 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.392 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.393 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.393 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.393 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:04:41.393 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:04:41.393 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.394 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.394 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.394 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.394 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.395 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.395 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.395 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.395 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.395 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.396 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.396 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.396 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.396 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.396 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:04:41.397 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.397 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.397 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.397 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.397 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:04:41.398 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.398 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.398 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.398 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.398 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.399 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.399 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:04:41.400 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.400 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.400 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.400 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:04:41.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.401 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.401 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.401 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.401 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.402 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.402 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:04:41.402 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.403 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.403 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.403 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:04:41.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.404 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.404 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.404 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.404 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.405 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.405 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:04:41.406 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.406 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.406 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:04:41.407 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:41.407 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.407 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.407 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.408 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:04:41.408 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:04:41.408 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:04:41.408 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:04:41.408 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.409 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.409 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.409 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.409 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.410 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.410 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:04:41.410 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:04:41.410 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.410 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.411 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.411 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.411 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.411 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.411 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.412 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:04:41.412 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.412 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.412 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.412 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.413 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.413 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.413 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:04:41.413 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.413 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.414 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.414 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.414 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:04:41.414 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.415 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.415 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.415 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.415 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.415 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.416 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.416 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.416 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:04:41.416 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.416 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.417 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.417 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:04:41.417 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.417 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.418 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.418 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.418 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.419 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.419 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.419 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:04:41.419 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.419 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.420 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.420 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:04:41.420 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.420 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.421 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.421 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.421 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.421 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.421 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.422 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:04:41.422 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.423 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.423 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:04:41.423 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:41.423 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.424 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.424 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.424 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:04:41.424 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:04:41.424 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:04:41.425 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:04:41.425 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.425 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.425 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.426 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.426 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.426 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.426 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:04:41.426 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:04:41.427 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:41.427 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:41.427 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:41.427 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:41.428 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:41.428 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:41.428 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:41.428 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:41.428 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:41.429 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:41.429 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:41.429 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.429 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.429 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.430 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:04:41.430 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.430 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.430 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.430 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.431 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:04:41.431 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.431 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.431 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.432 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.432 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:41.432 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.432 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.432 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.433 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:04:41.433 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.433 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.433 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.433 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.434 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:04:41.434 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.434 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.434 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.435 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.435 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:41.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.435 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:04:41.436 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.436 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.436 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.437 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.437 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:04:41.437 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.437 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.437 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.438 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.438 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:41.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:41.438 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.438 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:41.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:04:41.439 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.439 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.440 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:41.440 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:04:41.440 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:41.440 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.440 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.441 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.441 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:04:41.441 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:04:41.441 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:04:41.441 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:04:41.442 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:41.442 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:41.442 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:41.442 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:41.443 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.443 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:41.443 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:04:41.443 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.443 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:04:41.444 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.444 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.444 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.444 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.444 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.445 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:04:41.445 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.445 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.445 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.446 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:04:41.446 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.446 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.446 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.446 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.447 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.447 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:04:41.447 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.447 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.448 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.448 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:04:41.448 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.448 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.448 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.449 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.449 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.449 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:04:41.449 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.449 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.450 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:04:41.450 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.450 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.451 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.451 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.451 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.451 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:04:41.451 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.452 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.452 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.452 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:04:41.452 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.452 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.453 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.453 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.453 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.453 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:04:41.454 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.454 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.454 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.454 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:04:41.454 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.455 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.455 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.455 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.455 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.455 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:04:41.456 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.456 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.456 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:04:41.457 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.457 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.457 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.457 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.457 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.458 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:04:41.458 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.458 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:41.458 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:04:41.459 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:41.459 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:41.459 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:41.459 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:41.459 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:41.460 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:04:41.460 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:41.460 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.460 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:41.460 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:04:41.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:04:41.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:04:41.461 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:04:41.461 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:04:41.462 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:04:41.462 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:04:41.462 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:04:41.462 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:04:41.462 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:04:41.463 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:04:41.463 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:04:41.463 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:04:41.463 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:41.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:41.464 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:04:41.464 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:04:41.464 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:04:41.464 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:04:41.465 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:04:41.465 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:04:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 msgr2=0x7f03c4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 0x7f03c4055b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f03e000b000 tx=0x7f03e0009040).stop 2021-10-21T00:04:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 msgr2=0x7f03e40643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f03d400c000 tx=0x7f03d4006df0).stop 2021-10-21T00:04:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 shutdown_connections 2021-10-21T00:04:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c40536d0 0x7f03c4055b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03e41426d0 0x7f03e4155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03e40b5f80 0x7f03e40643a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 --2- 172.21.15.41:0/3369595588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03e40b04d0 0x7f03e40656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 >> 172.21.15.41:0/3369595588 conn(0x7f03e4063ae0 msgr2=0x7f03e41487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 shutdown_connections 2021-10-21T00:04:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.231+0000 7f03ebab3700 1 -- 172.21.15.41:0/3369595588 wait complete. 2021-10-21T00:04:41.470 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:41.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.575+0000 7f38d76b0700 1 Processor -- start 2021-10-21T00:04:41.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- start start 2021-10-21T00:04:41.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38d00b5f80 0x7f38d00af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 0x7f38d005c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0146b20 con 0x7f38d00b04d0 2021-10-21T00:04:41.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0146dc0 con 0x7f38d00b5f80 2021-10-21T00:04:41.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0142920 con 0x7f38d0141fc0 2021-10-21T00:04:41.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d4c4b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 0x7f38d005c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d544c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38d00b5f80 0x7f38d00af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49646/0 (socket says 172.21.15.41:49646) 2021-10-21T00:04:41.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 -- 172.21.15.41:0/3789878570 learned_addr learned my addr 172.21.15.41:0/3789878570 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 -- 172.21.15.41:0/3789878570 >> v2:172.21.15.62:3300/0 conn(0x7f38d00b5f80 msgr2=0x7f38d00af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:41.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 --2- 172.21.15.41:0/3789878570 >> v2:172.21.15.62:3300/0 conn(0x7f38d00b5f80 0x7f38d00af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 -- 172.21.15.41:0/3789878570 >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 msgr2=0x7f38d005c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:41.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 --2- 172.21.15.41:0/3789878570 >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 0x7f38d005c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 -- 172.21.15.41:0/3789878570 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0142a90 con 0x7f38d0141fc0 2021-10-21T00:04:41.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d4c4b700 1 --2- 172.21.15.41:0/3789878570 >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 0x7f38d005c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:41.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d5c4d700 1 --2- 172.21.15.41:0/3789878570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f38cc002f70 tx=0x7f38cc006eb0).ready entity=mon.2 client_cookie=85b533f55ff9b883 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38bffff700 1 -- 172.21.15.41:0/3789878570 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38cc00d570 con 0x7f38d0141fc0 2021-10-21T00:04:41.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38bffff700 1 -- 172.21.15.41:0/3789878570 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc000e90 con 0x7f38d0141fc0 2021-10-21T00:04:41.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38bffff700 1 -- 172.21.15.41:0/3789878570 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38cc00d900 con 0x7f38d0141fc0 2021-10-21T00:04:41.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- 172.21.15.41:0/3789878570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 msgr2=0x7f38d0142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3789878570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f38cc002f70 tx=0x7f38cc006eb0).stop 2021-10-21T00:04:41.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- 172.21.15.41:0/3789878570 shutdown_connections 2021-10-21T00:04:41.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3789878570 >> v2:172.21.15.41:3300/0 conn(0x7f38d00b04d0 0x7f38d005c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3789878570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d0141fc0 0x7f38d0142430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3789878570 >> v2:172.21.15.62:3300/0 conn(0x7f38d00b5f80 0x7f38d00af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- 172.21.15.41:0/3789878570 >> 172.21.15.41:0/3789878570 conn(0x7f38d0063ae0 msgr2=0x7f38d00b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- 172.21.15.41:0/3789878570 shutdown_connections 2021-10-21T00:04:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.579+0000 7f38d76b0700 1 -- 172.21.15.41:0/3789878570 wait complete. 2021-10-21T00:04:41.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 Processor -- start 2021-10-21T00:04:41.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 -- start start 2021-10-21T00:04:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 0x7f38d01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d0141fc0 0x7f38d0140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0155150 con 0x7f38d00b5f80 2021-10-21T00:04:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00641e0 con 0x7f38d0141fc0 2021-10-21T00:04:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d76b0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0064480 con 0x7f38d00b04d0 2021-10-21T00:04:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d544c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 0x7f38d01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59388/0 (socket says 172.21.15.41:59388) 2021-10-21T00:04:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d5c4d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d0141fc0 0x7f38d0140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 -- 172.21.15.41:0/3550312839 learned_addr learned my addr 172.21.15.41:0/3550312839 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 -- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 msgr2=0x7f38d01487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 0x7f38d01487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 -- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d0141fc0 msgr2=0x7f38d0140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d0141fc0 0x7f38d0140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d4c4b700 1 -- 172.21.15.41:0/3550312839 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c000b180 con 0x7f38d00b5f80 2021-10-21T00:04:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.583+0000 7f38d544c700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 0x7f38d01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38d4c4b700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f38c000c000 tx=0x7f38c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c000c7e0 con 0x7f38d00b5f80 2021-10-21T00:04:41.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000c940 con 0x7f38d00b5f80 2021-10-21T00:04:41.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc00b1e0 con 0x7f38d00b5f80 2021-10-21T00:04:41.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c000cca0 con 0x7f38d00b5f80 2021-10-21T00:04:41.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d0065af0 con 0x7f38d00b5f80 2021-10-21T00:04:41.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0064640 con 0x7f38d00b5f80 2021-10-21T00:04:41.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38c001c460 con 0x7f38d00b5f80 2021-10-21T00:04:41.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 0x7f38b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f38c006bea0 con 0x7f38d00b5f80 2021-10-21T00:04:41.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.587+0000 7f38d544c700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 0x7f38b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.591+0000 7f38d544c700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 0x7f38b0055a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f38c800b000 tx=0x7f38c80091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.595+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38c0042fa0 con 0x7f38d00b5f80 2021-10-21T00:04:41.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.755+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38d00b6360 con 0x7f38d00b5f80 2021-10-21T00:04:41.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38be7fc700 1 -- 172.21.15.41:0/3550312839 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f38c00465c0 con 0x7f38d00b5f80 2021-10-21T00:04:41.765 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:41.766 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:03:39.654379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1216827791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1216827791},{"type":"v1","addr":"172.21.15.41:6833","nonce":1216827791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:04:41.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 msgr2=0x7f38b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 0x7f38b0055a40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f38c800b000 tx=0x7f38c80091d0).stop 2021-10-21T00:04:41.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 msgr2=0x7f38d0140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f38c000c000 tx=0x7f38c0006df0).stop 2021-10-21T00:04:41.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 shutdown_connections 2021-10-21T00:04:41.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38b0053580 0x7f38b0055a40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d0141fc0 0x7f38d0140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38d00b5f80 0x7f38d0140240 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 --2- 172.21.15.41:0/3550312839 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38d00b04d0 0x7f38d01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 >> 172.21.15.41:0/3550312839 conn(0x7f38d0063ae0 msgr2=0x7f38d01414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:41.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 shutdown_connections 2021-10-21T00:04:41.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.759+0000 7f38d76b0700 1 -- 172.21.15.41:0/3550312839 wait complete. 2021-10-21T00:04:41.770 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 10 2021-10-21T00:04:41.783 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:04:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.879+0000 7f46cdeb3700 1 Processor -- start 2021-10-21T00:04:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.879+0000 7f46cdeb3700 1 -- start start 2021-10-21T00:04:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062330 0x7f46c80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f46c8062f70 0x7f46c805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c805bd40 con 0x7f46c80b3a20 2021-10-21T00:04:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c805bf70 con 0x7f46c8062f70 2021-10-21T00:04:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8142cb0 con 0x7f46c8062330 2021-10-21T00:04:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f46c8062f70 0x7f46c805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f46c8062f70 0x7f46c805c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59392/0 (socket says 172.21.15.41:59392) 2021-10-21T00:04:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 -- 172.21.15.41:0/4265184910 learned_addr learned my addr 172.21.15.41:0/4265184910 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cceb1700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062330 0x7f46c80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 -- 172.21.15.41:0/4265184910 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062330 msgr2=0x7f46c80b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062330 0x7f46c80b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 -- 172.21.15.41:0/4265184910 >> v1:172.21.15.62:6789/0 conn(0x7f46c80b3a20 legacy=0x7f46c813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 -- 172.21.15.41:0/4265184910 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c8142950 con 0x7f46c8062f70 2021-10-21T00:04:41.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c7fff700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c8062f70 0x7f46c805c410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f46b8002f70 tx=0x7f46b8006eb0).ready entity=mon.0 client_cookie=2c2add84b3bf8667 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c77fe700 1 -- 172.21.15.41:0/4265184910 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b800d5c0 con 0x7f46c8062f70 2021-10-21T00:04:41.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c77fe700 1 -- 172.21.15.41:0/4265184910 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b8000e90 con 0x7f46c8062f70 2021-10-21T00:04:41.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46c77fe700 1 -- 172.21.15.41:0/4265184910 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b800d950 con 0x7f46c8062f70 2021-10-21T00:04:41.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- 172.21.15.41:0/4265184910 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c8062f70 msgr2=0x7f46c805c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c8062f70 0x7f46c805c410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f46b8002f70 tx=0x7f46b8006eb0).stop 2021-10-21T00:04:41.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- 172.21.15.41:0/4265184910 shutdown_connections 2021-10-21T00:04:41.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c8062f70 0x7f46c805c410 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/4265184910 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062330 0x7f46c80b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- 172.21.15.41:0/4265184910 >> 172.21.15.41:0/4265184910 conn(0x7f46c80b9080 msgr2=0x7f46c80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:41.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- 172.21.15.41:0/4265184910 shutdown_connections 2021-10-21T00:04:41.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.883+0000 7f46cdeb3700 1 -- 172.21.15.41:0/4265184910 wait complete. 2021-10-21T00:04:41.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 Processor -- start 2021-10-21T00:04:41.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- start start 2021-10-21T00:04:41.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c8062330 0x7f46c81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 0x7f46c80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81468b0 con 0x7f46c80b3a20 2021-10-21T00:04:41.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8112cf0 con 0x7f46c8062330 2021-10-21T00:04:41.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8145850 con 0x7f46c8062f70 2021-10-21T00:04:41.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cd6b2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cd6b2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59402/0 (socket says 172.21.15.41:59402) 2021-10-21T00:04:41.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cd6b2700 1 -- 172.21.15.41:0/1879322712 learned_addr learned my addr 172.21.15.41:0/1879322712 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:41.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 0x7f46c80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cceb1700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c8062330 0x7f46c81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 -- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c8062330 msgr2=0x7f46c81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c8062330 0x7f46c81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 -- 172.21.15.41:0/1879322712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 msgr2=0x7f46c81144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:41.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:41.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 -- 172.21.15.41:0/1879322712 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b800b1e0 con 0x7f46c8062f70 2021-10-21T00:04:41.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cd6b2700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:41.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c7fff700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 0x7f46c80aece0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f46b8002f70 tx=0x7f46b8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b8006b40 con 0x7f46c8062f70 2021-10-21T00:04:41.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800d940 con 0x7f46c8062f70 2021-10-21T00:04:41.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c8145450 con 0x7f46c8062f70 2021-10-21T00:04:41.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b8011d30 con 0x7f46c8062f70 2021-10-21T00:04:41.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.887+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c8146e20 con 0x7f46c8062f70 2021-10-21T00:04:41.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8057350 con 0x7f46c8062f70 2021-10-21T00:04:41.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f46b801a040 con 0x7f46c8062f70 2021-10-21T00:04:41.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46c5ffb700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 0x7f46a8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:41.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f46b806c700 con 0x7f46c8062f70 2021-10-21T00:04:41.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46cceb1700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 0x7f46a8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:41.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.891+0000 7f46cceb1700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 0x7f46a8055a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f46bc00c000 tx=0x7f46bc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:41.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:41.903+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46b8043880 con 0x7f46c8062f70 2021-10-21T00:04:42.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.067+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46c805cc50 con 0x7f46c8062f70 2021-10-21T00:04:42.399 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:04:42.391+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:04:42.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.407+0000 7f46c5ffb700 1 -- 172.21.15.41:0/1879322712 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46b8046de0 con 0x7f46c8062f70 2021-10-21T00:04:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 msgr2=0x7f46a8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 0x7f46a8055a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f46bc00c000 tx=0x7f46bc008040).stop 2021-10-21T00:04:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 msgr2=0x7f46c80aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 0x7f46c80aece0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f46b8002f70 tx=0x7f46b8015000).stop 2021-10-21T00:04:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 shutdown_connections 2021-10-21T00:04:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46a8053580 0x7f46a8055a40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46c80b3a20 0x7f46c81144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46c8062f70 0x7f46c80aece0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 --2- 172.21.15.41:0/1879322712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c8062330 0x7f46c81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 >> 172.21.15.41:0/1879322712 conn(0x7f46c80b9080 msgr2=0x7f46c8142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 shutdown_connections 2021-10-21T00:04:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.411+0000 7f46cdeb3700 1 -- 172.21.15.41:0/1879322712 wait complete. 2021-10-21T00:04:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:04:42.435 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:42.454 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:04:42.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 Processor -- start 2021-10-21T00:04:42.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 -- start start 2021-10-21T00:04:42.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f71f4062330 0x7f71f40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 0x7f71f413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f405bd40 con 0x7f71f4062f70 2021-10-21T00:04:42.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f405bf70 con 0x7f71f4062330 2021-10-21T00:04:42.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f89a2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4142cb0 con 0x7f71f40b3a20 2021-10-21T00:04:42.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f2ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f71f4062f70 0x7f71f405c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57190/0 (socket says 172.21.15.41:57190) 2021-10-21T00:04:42.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f2ffd700 1 -- 172.21.15.41:0/2155558140 learned_addr learned my addr 172.21.15.41:0/2155558140 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:42.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 --2- 172.21.15.41:0/2155558140 >> v2:172.21.15.41:3300/0 conn(0x7f71f4062330 0x7f71f40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f3fff700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 0x7f71f413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f27fc700 1 -- 172.21.15.41:0/2155558140 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701929514 0 0) 0x7f71f405bd40 con 0x7f71f4062f70 2021-10-21T00:04:42.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f27fc700 1 -- 172.21.15.41:0/2155558140 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e0003260 con 0x7f71f4062f70 2021-10-21T00:04:42.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 -- 172.21.15.41:0/2155558140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 msgr2=0x7f71f413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:42.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 0x7f71f413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 -- 172.21.15.41:0/2155558140 >> v1:172.21.15.41:6789/0 conn(0x7f71f4062f70 legacy=0x7f71f405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 -- 172.21.15.41:0/2155558140 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4142950 con 0x7f71f4062330 2021-10-21T00:04:42.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f3fff700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 0x7f71f413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:42.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f37fe700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f4062330 0x7f71f40b3f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f71ec0032f0 tx=0x7f71ec0091d0).ready entity=mon.0 client_cookie=e7e67d707ad49407 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f27fc700 1 -- 172.21.15.41:0/2155558140 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ec00b600 con 0x7f71f4062330 2021-10-21T00:04:42.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f27fc700 1 -- 172.21.15.41:0/2155558140 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00b760 con 0x7f71f4062330 2021-10-21T00:04:42.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.535+0000 7f71f27fc700 1 -- 172.21.15.41:0/2155558140 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ec00b8d0 con 0x7f71f4062330 2021-10-21T00:04:42.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- 172.21.15.41:0/2155558140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f4062330 msgr2=0x7f71f40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f4062330 0x7f71f40b3f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f71ec0032f0 tx=0x7f71ec0091d0).stop 2021-10-21T00:04:42.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- 172.21.15.41:0/2155558140 shutdown_connections 2021-10-21T00:04:42.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f40b3a20 0x7f71f413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 --2- 172.21.15.41:0/2155558140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f4062330 0x7f71f40b3f30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- 172.21.15.41:0/2155558140 >> 172.21.15.41:0/2155558140 conn(0x7f71f40b9080 msgr2=0x7f71f40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:42.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- 172.21.15.41:0/2155558140 shutdown_connections 2021-10-21T00:04:42.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- 172.21.15.41:0/2155558140 wait complete. 2021-10-21T00:04:42.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 Processor -- start 2021-10-21T00:04:42.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.539+0000 7f71f89a2700 1 -- start start 2021-10-21T00:04:42.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f4062330 0x7f71f40adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 0x7f71f40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41552b0 con 0x7f71f40b3a20 2021-10-21T00:04:42.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40af410 con 0x7f71f4062330 2021-10-21T00:04:42.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40af6b0 con 0x7f71f4062f70 2021-10-21T00:04:42.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59428/0 (socket says 172.21.15.41:59428) 2021-10-21T00:04:42.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 -- 172.21.15.41:0/706035330 learned_addr learned my addr 172.21.15.41:0/706035330 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:42.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f37fe700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f4062330 0x7f71f40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f2ffd700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 0x7f71f40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 -- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 msgr2=0x7f71f40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 0x7f71f40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 -- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f4062330 msgr2=0x7f71f40adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f4062330 0x7f71f40adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 -- 172.21.15.41:0/706035330 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e400b180 con 0x7f71f40b3a20 2021-10-21T00:04:42.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f2ffd700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 0x7f71f40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:42.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f3fff700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f71e400c000 tx=0x7f71e4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e4010780 con 0x7f71f40b3a20 2021-10-21T00:04:42.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40108e0 con 0x7f71f40b3a20 2021-10-21T00:04:42.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e4010c40 con 0x7f71f40b3a20 2021-10-21T00:04:42.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec009470 con 0x7f71f40b3a20 2021-10-21T00:04:42.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.543+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40b8a90 con 0x7f71f40b3a20 2021-10-21T00:04:42.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4057350 con 0x7f71f40b3a20 2021-10-21T00:04:42.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71e401c460 con 0x7f71f40b3a20 2021-10-21T00:04:42.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f0ff9700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 0x7f71d40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f71e406bfe0 con 0x7f71f40b3a20 2021-10-21T00:04:42.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f37fe700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 0x7f71d40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.547+0000 7f71f37fe700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 0x7f71d40559b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f71ec01b000 tx=0x7f71ec016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.555+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71e4042f80 con 0x7f71f40b3a20 2021-10-21T00:04:42.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.719+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71f405d080 con 0x7f71f40b3a20 2021-10-21T00:04:42.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.719+0000 7f71f0ff9700 1 -- 172.21.15.41:0/706035330 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f71e40465a0 con 0x7f71f40b3a20 2021-10-21T00:04:42.728 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:42.728 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:03:38.650515+0000","modified":"2021-10-21T00:04:42.397709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-10-21T00:04:42.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 msgr2=0x7f71d40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 0x7f71d40559b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f71ec01b000 tx=0x7f71ec016000).stop 2021-10-21T00:04:42.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 msgr2=0x7f71f4155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f71e400c000 tx=0x7f71e4006df0).stop 2021-10-21T00:04:42.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 shutdown_connections 2021-10-21T00:04:42.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f71d40534f0 0x7f71d40559b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f71f40b3a20 0x7f71f4155a50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71f4062f70 0x7f71f40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 --2- 172.21.15.41:0/706035330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71f4062330 0x7f71f40adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 >> 172.21.15.41:0/706035330 conn(0x7f71f40b9080 msgr2=0x7f71f413f040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:42.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 shutdown_connections 2021-10-21T00:04:42.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.723+0000 7f71f89a2700 1 -- 172.21.15.41:0/706035330 wait complete. 2021-10-21T00:04:42.733 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 11 2021-10-21T00:04:42.741 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:04:42.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 Processor -- start 2021-10-21T00:04:42.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 -- start start 2021-10-21T00:04:42.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae80ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ae80b1e30 0x7f0ae813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae80b2270 0x7f0ae813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae805fee0 con 0x7f0ae80b2270 2021-10-21T00:04:42.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae8060640 con 0x7f0ae80b1e30 2021-10-21T00:04:42.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.839+0000 7f0aedc55700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80aa0a0 con 0x7f0ae805fb00 2021-10-21T00:04:42.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae80b2270 0x7f0ae813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0ae7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ae80b1e30 0x7f0ae813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae80b2270 0x7f0ae813f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59432/0 (socket says 172.21.15.41:59432) 2021-10-21T00:04:42.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aecc53700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae80ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 -- 172.21.15.41:0/3996158068 learned_addr learned my addr 172.21.15.41:0/3996158068 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:42.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 -- 172.21.15.41:0/3996158068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 msgr2=0x7f0ae80ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:42.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 --2- 172.21.15.41:0/3996158068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae80ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 -- 172.21.15.41:0/3996158068 >> v2:172.21.15.62:3300/0 conn(0x7f0ae80b1e30 msgr2=0x7f0ae813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:42.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 --2- 172.21.15.41:0/3996158068 >> v2:172.21.15.62:3300/0 conn(0x7f0ae80b1e30 0x7f0ae813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 -- 172.21.15.41:0/3996158068 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80aa340 con 0x7f0ae80b2270 2021-10-21T00:04:42.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aed454700 1 --2- 172.21.15.41:0/3996158068 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae813f8e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0ae00032f0 tx=0x7f0ae000b530).ready entity=mon.0 client_cookie=5578dd2c0e1ed0fd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0ae77fe700 1 -- 172.21.15.41:0/3996158068 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae000dd40 con 0x7f0ae80b2270 2021-10-21T00:04:42.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0ae77fe700 1 -- 172.21.15.41:0/3996158068 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0010470 con 0x7f0ae80b2270 2021-10-21T00:04:42.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0ae77fe700 1 -- 172.21.15.41:0/3996158068 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae000dea0 con 0x7f0ae80b2270 2021-10-21T00:04:42.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- 172.21.15.41:0/3996158068 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 msgr2=0x7f0ae813f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 --2- 172.21.15.41:0/3996158068 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae813f8e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0ae00032f0 tx=0x7f0ae000b530).stop 2021-10-21T00:04:42.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- 172.21.15.41:0/3996158068 shutdown_connections 2021-10-21T00:04:42.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 --2- 172.21.15.41:0/3996158068 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae813f8e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 --2- 172.21.15.41:0/3996158068 >> v2:172.21.15.62:3300/0 conn(0x7f0ae80b1e30 0x7f0ae813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 --2- 172.21.15.41:0/3996158068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae80ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- 172.21.15.41:0/3996158068 >> 172.21.15.41:0/3996158068 conn(0x7f0ae80b5700 msgr2=0x7f0ae80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:42.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- 172.21.15.41:0/3996158068 shutdown_connections 2021-10-21T00:04:42.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- 172.21.15.41:0/3996158068 wait complete. 2021-10-21T00:04:42.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 Processor -- start 2021-10-21T00:04:42.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.843+0000 7f0aedc55700 1 -- start start 2021-10-21T00:04:42.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae8063920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae80b1e30 0x7f0ae8067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81423f0 con 0x7f0ae80b2270 2021-10-21T00:04:42.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8141360 con 0x7f0ae80b1e30 2021-10-21T00:04:42.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8067ce0 con 0x7f0ae805fb00 2021-10-21T00:04:42.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aed454700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae8063920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aed454700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59442/0 (socket says 172.21.15.41:59442) 2021-10-21T00:04:42.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aed454700 1 -- 172.21.15.41:0/958116226 learned_addr learned my addr 172.21.15.41:0/958116226 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:42.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0ae7fff700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae80b1e30 0x7f0ae8067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 -- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae80b1e30 msgr2=0x7f0ae8067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae80b1e30 0x7f0ae8067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 -- 172.21.15.41:0/958116226 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 msgr2=0x7f0ae80677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:42.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:42.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 -- 172.21.15.41:0/958116226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae000b7d0 con 0x7f0ae805fb00 2021-10-21T00:04:42.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aed454700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:42.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aecc53700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae8063920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0ae813aca0 tx=0x7f0ad0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ad0010780 con 0x7f0ae805fb00 2021-10-21T00:04:42.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad00108e0 con 0x7f0ae805fb00 2021-10-21T00:04:42.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ad0010c40 con 0x7f0ae805fb00 2021-10-21T00:04:42.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae8141a30 con 0x7f0ae805fb00 2021-10-21T00:04:42.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.847+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80ae6d0 con 0x7f0ae805fb00 2021-10-21T00:04:42.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae80602c0 con 0x7f0ae805fb00 2021-10-21T00:04:42.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ad001c460 con 0x7f0ae805fb00 2021-10-21T00:04:42.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0ae5ffb700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 0x7f0acc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:42.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0ad006bfa0 con 0x7f0ae805fb00 2021-10-21T00:04:42.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0ae7fff700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 0x7f0acc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:42.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.851+0000 7f0ae7fff700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 0x7f0acc055ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0ad800b000 tx=0x7f0ad8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:42.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:42.859+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ad0042ec0 con 0x7f0ae805fb00 2021-10-21T00:04:43.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.027+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0ae8141730 con 0x7f0ae805fb00 2021-10-21T00:04:43.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.411+0000 7f0ae5ffb700 1 -- 172.21.15.41:0/958116226 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ad00464e0 con 0x7f0ae805fb00 2021-10-21T00:04:43.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 msgr2=0x7f0acc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 0x7f0acc055ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0ad800b000 tx=0x7f0ad8006df0).stop 2021-10-21T00:04:43.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 msgr2=0x7f0ae8063920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae8063920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0ae813aca0 tx=0x7f0ad0006df0).stop 2021-10-21T00:04:43.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 shutdown_connections 2021-10-21T00:04:43.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0acc053610 0x7f0acc055ad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae80b2270 0x7f0ae80677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae80b1e30 0x7f0ae8067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 --2- 172.21.15.41:0/958116226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae805fb00 0x7f0ae8063920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 >> 172.21.15.41:0/958116226 conn(0x7f0ae80b5700 msgr2=0x7f0ae80b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:43.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 shutdown_connections 2021-10-21T00:04:43.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.415+0000 7f0aedc55700 1 -- 172.21.15.41:0/958116226 wait complete. 2021-10-21T00:04:43.437 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:04:43.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.551+0000 7f5d8ae8e700 1 Processor -- start 2021-10-21T00:04:43.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.551+0000 7f5d8ae8e700 1 -- start start 2021-10-21T00:04:43.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5d840ad1b0 0x7f5d840b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d8405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d841409d0 con 0x7f5d840b4040 2021-10-21T00:04:43.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d84140c70 con 0x7f5d840ad1b0 2021-10-21T00:04:43.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84067c70 con 0x7f5d840b1830 2021-10-21T00:04:43.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5d840ad1b0 0x7f5d840b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d89e8c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5d840b4040 0x7f5d84141110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57216/0 (socket says 172.21.15.41:57216) 2021-10-21T00:04:43.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d89e8c700 1 -- 172.21.15.41:0/2572276943 learned_addr learned my addr 172.21.15.41:0/2572276943 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:43.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 --2- 172.21.15.41:0/2572276943 >> v2:172.21.15.41:3300/0 conn(0x7f5d840ad1b0 0x7f5d840b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59448/0 (socket says 172.21.15.41:59448) 2021-10-21T00:04:43.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8a68d700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d8405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 -- 172.21.15.41:0/2572276943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 msgr2=0x7f5d8405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:43.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d8405f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 -- 172.21.15.41:0/2572276943 >> v1:172.21.15.41:6789/0 conn(0x7f5d840b4040 legacy=0x7f5d84141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 -- 172.21.15.41:0/2572276943 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8405fcb0 con 0x7f5d840ad1b0 2021-10-21T00:04:43.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8a68d700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d8405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:43.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8968b700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840ad1b0 0x7f5d840b4420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5d80002f70 tx=0x7f5d80006df0).ready entity=mon.0 client_cookie=cf6428f5b3ecdcaf server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:43.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d88e8a700 1 -- 172.21.15.41:0/2572276943 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8000d570 con 0x7f5d840ad1b0 2021-10-21T00:04:43.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d88e8a700 1 -- 172.21.15.41:0/2572276943 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80000e90 con 0x7f5d840ad1b0 2021-10-21T00:04:43.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d88e8a700 1 -- 172.21.15.41:0/2572276943 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d8000d8c0 con 0x7f5d840ad1b0 2021-10-21T00:04:43.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/2572276943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840ad1b0 msgr2=0x7f5d840b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840ad1b0 0x7f5d840b4420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5d80002f70 tx=0x7f5d80006df0).stop 2021-10-21T00:04:43.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/2572276943 shutdown_connections 2021-10-21T00:04:43.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d8405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/2572276943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840ad1b0 0x7f5d840b4420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/2572276943 >> 172.21.15.41:0/2572276943 conn(0x7f5d840b7960 msgr2=0x7f5d840b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:43.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/2572276943 shutdown_connections 2021-10-21T00:04:43.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.555+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/2572276943 wait complete. 2021-10-21T00:04:43.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 Processor -- start 2021-10-21T00:04:43.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 -- start start 2021-10-21T00:04:43.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d840ad1b0 0x7f5d84153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d840ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840aece0 con 0x7f5d840b4040 2021-10-21T00:04:43.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84144130 con 0x7f5d840ad1b0 2021-10-21T00:04:43.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8ae8e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d841443d0 con 0x7f5d840b1830 2021-10-21T00:04:43.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59456/0 (socket says 172.21.15.41:59456) 2021-10-21T00:04:43.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 -- 172.21.15.41:0/4249250758 learned_addr learned my addr 172.21.15.41:0/4249250758 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:43.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8968b700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d840ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d89e8c700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d840ad1b0 0x7f5d84153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 -- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 msgr2=0x7f5d840ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d840ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 -- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d840ad1b0 msgr2=0x7f5d84153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:43.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d840ad1b0 0x7f5d84153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 -- 172.21.15.41:0/4249250758 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8000b180 con 0x7f5d840b4040 2021-10-21T00:04:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.559+0000 7f5d8a68d700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5d7c006cc0 tx=0x7f5d7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7c013620 con 0x7f5d840b4040 2021-10-21T00:04:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c013780 con 0x7f5d840b4040 2021-10-21T00:04:43.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d84144670 con 0x7f5d840b4040 2021-10-21T00:04:43.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d7c013ae0 con 0x7f5d840b4040 2021-10-21T00:04:43.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d840b0df0 con 0x7f5d840b4040 2021-10-21T00:04:43.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d84144800 con 0x7f5d840b4040 2021-10-21T00:04:43.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d7c013c40 con 0x7f5d840b4040 2021-10-21T00:04:43.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 0x7f5d64055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:43.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.563+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5d7c06b770 con 0x7f5d840b4040 2021-10-21T00:04:43.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.567+0000 7f5d89e8c700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 0x7f5d64055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:43.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.567+0000 7f5d89e8c700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 0x7f5d64055a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5d7800d000 tx=0x7f5d78007be0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:43.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.571+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d7c042880 con 0x7f5d840b4040 2021-10-21T00:04:43.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:43.699+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d84057350 con 0x7f5d840b4040 2021-10-21T00:04:44.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.419+0000 7f5d76ffd700 1 -- 172.21.15.41:0/4249250758 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5d7c00f040 con 0x7f5d840b4040 2021-10-21T00:04:44.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 msgr2=0x7f5d64055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 0x7f5d64055a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5d7800d000 tx=0x7f5d78007be0).stop 2021-10-21T00:04:44.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 msgr2=0x7f5d8408f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5d7c006cc0 tx=0x7f5d7c008040).stop 2021-10-21T00:04:44.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 shutdown_connections 2021-10-21T00:04:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5d64053580 0x7f5d64055a40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5d840b4040 0x7f5d8408f560 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d840b1830 0x7f5d840ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 --2- 172.21.15.41:0/4249250758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d840ad1b0 0x7f5d84153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 >> 172.21.15.41:0/4249250758 conn(0x7f5d840b7960 msgr2=0x7f5d840b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 shutdown_connections 2021-10-21T00:04:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.427+0000 7f5d8ae8e700 1 -- 172.21.15.41:0/4249250758 wait complete. 2021-10-21T00:04:44.437 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:04:44.447 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:04:44.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.547+0000 7f92fffff700 1 Processor -- start 2021-10-21T00:04:44.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.547+0000 7f92fffff700 1 -- start start 2021-10-21T00:04:44.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93000624d0 0x7f930005bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:44.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93000afef0 con 0x7f930005c8a0 2021-10-21T00:04:44.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93000628b0 con 0x7f93000b3a20 2021-10-21T00:04:44.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9300148090 con 0x7f93000624d0 2021-10-21T00:04:44.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92ff7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f930005c8a0 0x7f9300146dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57234/0 (socket says 172.21.15.41:57234) 2021-10-21T00:04:44.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92ff7fe700 1 -- 172.21.15.41:0/1316938027 learned_addr learned my addr 172.21.15.41:0/1316938027 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:44.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92feffd700 1 --2- 172.21.15.41:0/1316938027 >> v2:172.21.15.62:3300/0 conn(0x7f93000624d0 0x7f930005bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:44.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fdffb700 1 -- 172.21.15.41:0/1316938027 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85541264 0 0) 0x7f93000afef0 con 0x7f930005c8a0 2021-10-21T00:04:44.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fdffb700 1 -- 172.21.15.41:0/1316938027 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e4003260 con 0x7f930005c8a0 2021-10-21T00:04:44.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92feffd700 1 -- 172.21.15.41:0/1316938027 >> v1:172.21.15.62:6789/0 conn(0x7f93000b3a20 legacy=0x7f930005c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92feffd700 1 -- 172.21.15.41:0/1316938027 >> v1:172.21.15.41:6789/0 conn(0x7f930005c8a0 legacy=0x7f9300146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92feffd700 1 -- 172.21.15.41:0/1316938027 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930014b300 con 0x7f93000624d0 2021-10-21T00:04:44.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92feffd700 1 --2- 172.21.15.41:0/1316938027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93000624d0 0x7f930005bca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f92f4002f70 tx=0x7f92f4006df0).ready entity=mon.1 client_cookie=db0cca9a5d631157 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:44.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fdffb700 1 -- 172.21.15.41:0/1316938027 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f400d610 con 0x7f93000624d0 2021-10-21T00:04:44.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fdffb700 1 -- 172.21.15.41:0/1316938027 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4000e90 con 0x7f93000624d0 2021-10-21T00:04:44.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fdffb700 1 -- 172.21.15.41:0/1316938027 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f400d960 con 0x7f93000624d0 2021-10-21T00:04:44.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- 172.21.15.41:0/1316938027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93000624d0 msgr2=0x7f930005bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 --2- 172.21.15.41:0/1316938027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93000624d0 0x7f930005bca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f92f4002f70 tx=0x7f92f4006df0).stop 2021-10-21T00:04:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- 172.21.15.41:0/1316938027 shutdown_connections 2021-10-21T00:04:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 --2- 172.21.15.41:0/1316938027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93000624d0 0x7f930005bca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- 172.21.15.41:0/1316938027 >> 172.21.15.41:0/1316938027 conn(0x7f93000b9080 msgr2=0x7f93000b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- 172.21.15.41:0/1316938027 shutdown_connections 2021-10-21T00:04:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.551+0000 7f92fffff700 1 -- 172.21.15.41:0/1316938027 wait complete. 2021-10-21T00:04:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.555+0000 7f92fffff700 1 Processor -- start 2021-10-21T00:04:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.555+0000 7f92fffff700 1 -- start start 2021-10-21T00:04:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.555+0000 7f92fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930005c8a0 0x7f9300146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.555+0000 7f92fffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93000624d0 0x7f93000669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300159560 con 0x7f93000b3a20 2021-10-21T00:04:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000ae4b0 con 0x7f930005c8a0 2021-10-21T00:04:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000af4c0 con 0x7f93000624d0 2021-10-21T00:04:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92feffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930005c8a0 0x7f9300146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59470/0 (socket says 172.21.15.41:59470) 2021-10-21T00:04:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 -- 172.21.15.41:0/910962042 learned_addr learned my addr 172.21.15.41:0/910962042 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fe7fc700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93000624d0 0x7f93000669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 -- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93000624d0 msgr2=0x7f93000669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93000624d0 0x7f93000669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 -- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930005c8a0 msgr2=0x7f9300146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930005c8a0 0x7f9300146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 -- 172.21.15.41:0/910962042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f400b180 con 0x7f93000b3a20 2021-10-21T00:04:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92ff7fe700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f92f8001490 tx=0x7f92f8007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f8005c70 con 0x7f93000b3a20 2021-10-21T00:04:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93000673c0 con 0x7f93000b3a20 2021-10-21T00:04:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f8005dd0 con 0x7f93000b3a20 2021-10-21T00:04:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92f80072c0 con 0x7f93000b3a20 2021-10-21T00:04:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93000ada60 con 0x7f93000b3a20 2021-10-21T00:04:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000af310 con 0x7f93000b3a20 2021-10-21T00:04:44.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.559+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92f8010070 con 0x7f93000b3a20 2021-10-21T00:04:44.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.563+0000 7f92effff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 0x7f92dc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:44.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.563+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f92f806b130 con 0x7f93000b3a20 2021-10-21T00:04:44.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.563+0000 7f92feffd700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 0x7f92dc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:44.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.563+0000 7f92feffd700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 0x7f92dc055b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f92f401a000 tx=0x7f92f4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:44.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.563+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92f8042350 con 0x7f93000b3a20 2021-10-21T00:04:44.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:44.691+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93000af680 con 0x7f93000b3a20 2021-10-21T00:04:45.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.423+0000 7f92effff700 1 -- 172.21.15.41:0/910962042 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 173+0+0 (secure 0 0 0) 0x7f92f8045970 con 0x7f93000b3a20 2021-10-21T00:04:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 msgr2=0x7f92dc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 0x7f92dc055b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f92f401a000 tx=0x7f92f4014000).stop 2021-10-21T00:04:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 msgr2=0x7f9300066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f92f8001490 tx=0x7f92f8007dc0).stop 2021-10-21T00:04:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 shutdown_connections 2021-10-21T00:04:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92dc0536d0 0x7f92dc055b90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f93000b3a20 0x7f9300066ed0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f93000624d0 0x7f93000669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 --2- 172.21.15.41:0/910962042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f930005c8a0 0x7f9300146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 >> 172.21.15.41:0/910962042 conn(0x7f93000b9080 msgr2=0x7f93000b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 shutdown_connections 2021-10-21T00:04:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.431+0000 7f92fffff700 1 -- 172.21.15.41:0/910962042 wait complete. 2021-10-21T00:04:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:04:45.452 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:04:45.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.551+0000 7f6bb55ca700 1 Processor -- start 2021-10-21T00:04:45.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.551+0000 7f6bb55ca700 1 -- start start 2021-10-21T00:04:45.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 0x7f6bb005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6bb0142880 0x7f6bb0142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb0066490 con 0x7f6bb00b2e00 2021-10-21T00:04:45.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb0146db0 con 0x7f6bb0142880 2021-10-21T00:04:45.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb0145f60 con 0x7f6bb005bca0 2021-10-21T00:04:45.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6bb0142880 0x7f6bb0142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baf7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f6bb00b2e00 0x7f6bb01466a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57244/0 (socket says 172.21.15.41:57244) 2021-10-21T00:04:45.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baf7fe700 1 -- 172.21.15.41:0/490744345 learned_addr learned my addr 172.21.15.41:0/490744345 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:45.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baffff700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 0x7f6bb005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 -- 172.21.15.41:0/490744345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 msgr2=0x7f6bb005c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:45.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 0x7f6bb005c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 -- 172.21.15.41:0/490744345 >> v1:172.21.15.41:6789/0 conn(0x7f6bb00b2e00 legacy=0x7f6bb01466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 -- 172.21.15.41:0/490744345 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0146200 con 0x7f6bb0142880 2021-10-21T00:04:45.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baffff700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 0x7f6bb005c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:45.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb4dc9700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb0142880 0x7f6bb0142cf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6ba80032f0 tx=0x7f6ba80091d0).ready entity=mon.0 client_cookie=637f502268d03e21 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baeffd700 1 -- 172.21.15.41:0/490744345 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba8009ea0 con 0x7f6bb0142880 2021-10-21T00:04:45.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baeffd700 1 -- 172.21.15.41:0/490744345 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba800b8a0 con 0x7f6bb0142880 2021-10-21T00:04:45.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6baeffd700 1 -- 172.21.15.41:0/490744345 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba800ba10 con 0x7f6bb0142880 2021-10-21T00:04:45.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- 172.21.15.41:0/490744345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb0142880 msgr2=0x7f6bb0142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb0142880 0x7f6bb0142cf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6ba80032f0 tx=0x7f6ba80091d0).stop 2021-10-21T00:04:45.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- 172.21.15.41:0/490744345 shutdown_connections 2021-10-21T00:04:45.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb0142880 0x7f6bb0142cf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/490744345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb005bca0 0x7f6bb005c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- 172.21.15.41:0/490744345 >> 172.21.15.41:0/490744345 conn(0x7f6bb0069df0 msgr2=0x7f6bb0063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:45.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- 172.21.15.41:0/490744345 shutdown_connections 2021-10-21T00:04:45.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.555+0000 7f6bb55ca700 1 -- 172.21.15.41:0/490744345 wait complete. 2021-10-21T00:04:45.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 Processor -- start 2021-10-21T00:04:45.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 -- start start 2021-10-21T00:04:45.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bb005bca0 0x7f6bb013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb0142880 0x7f6bb0142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b59a0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb013eb60 con 0x7f6bb005bca0 2021-10-21T00:04:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb55ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb013faf0 con 0x7f6bb0142880 2021-10-21T00:04:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59480/0 (socket says 172.21.15.41:59480) 2021-10-21T00:04:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 -- 172.21.15.41:0/2450469836 learned_addr learned my addr 172.21.15.41:0/2450469836 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baffff700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bb005bca0 0x7f6bb013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6bb4dc9700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb0142880 0x7f6bb0142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 -- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb0142880 msgr2=0x7f6bb0142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb0142880 0x7f6bb0142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 -- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bb005bca0 msgr2=0x7f6bb013f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bb005bca0 0x7f6bb013f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 -- 172.21.15.41:0/2450469836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8009470 con 0x7f6bb00b2e00 2021-10-21T00:04:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.559+0000 7f6baf7fe700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6bb00b5e30 tx=0x7f6ba4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba40070d0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4007230 con 0x7f6bb00b2e00 2021-10-21T00:04:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb013eef0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ba4005610 con 0x7f6bb00b2e00 2021-10-21T00:04:45.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb013e5e0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ba4010070 con 0x7f6bb00b2e00 2021-10-21T00:04:45.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb013fcc0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 0x7f6b900559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6ba406ac70 con 0x7f6bb00b2e00 2021-10-21T00:04:45.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.563+0000 7f6baffff700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 0x7f6b900559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.567+0000 7f6baffff700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 0x7f6b900559b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6ba000c000 tx=0x7f6ba0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.567+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ba4041fa0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.695+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6bb0057350 con 0x7f6bb00b2e00 2021-10-21T00:04:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bad7fa700 1 -- 172.21.15.41:0/2450469836 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ba40455c0 con 0x7f6bb00b2e00 2021-10-21T00:04:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 msgr2=0x7f6b900559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 0x7f6b900559b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6ba000c000 tx=0x7f6ba0008040).stop 2021-10-21T00:04:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 msgr2=0x7f6bb00b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6bb00b5e30 tx=0x7f6ba4007c00).stop 2021-10-21T00:04:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 shutdown_connections 2021-10-21T00:04:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6b900534f0 0x7f6b900559b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bb0142880 0x7f6bb0142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bb00b2e00 0x7f6bb00b50b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 --2- 172.21.15.41:0/2450469836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bb005bca0 0x7f6bb013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 >> 172.21.15.41:0/2450469836 conn(0x7f6bb0069df0 msgr2=0x7f6bb0065640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 shutdown_connections 2021-10-21T00:04:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.703+0000 7f6bb55ca700 1 -- 172.21.15.41:0/2450469836 wait complete. 2021-10-21T00:04:45.723 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-10-21T00:04:45.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 Processor -- start 2021-10-21T00:04:45.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 -- start start 2021-10-21T00:04:45.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 0x7f63b00ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63b00af620 0x7f63b00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00b0b50 con 0x7f63b00abb50 2021-10-21T00:04:45.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00b2550 con 0x7f63b00b2170 2021-10-21T00:04:45.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b6428700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00b0d90 con 0x7f63b00af620 2021-10-21T00:04:45.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b5426700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 0x7f63b00ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63b00af620 0x7f63b00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b5426700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 0x7f63b00ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59490/0 (socket says 172.21.15.41:59490) 2021-10-21T00:04:45.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b5426700 1 -- 172.21.15.41:0/3850575749 learned_addr learned my addr 172.21.15.41:0/3850575749 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:45.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 -- 172.21.15.41:0/3850575749 >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 msgr2=0x7f63b00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:45.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 --2- 172.21.15.41:0/3850575749 >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 0x7f63b00ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 -- 172.21.15.41:0/3850575749 >> v1:172.21.15.62:6789/0 conn(0x7f63b00abb50 legacy=0x7f63b014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 -- 172.21.15.41:0/3850575749 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00b1030 con 0x7f63b00af620 2021-10-21T00:04:45.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63b4c25700 1 --2- 172.21.15.41:0/3850575749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00af620 0x7f63b00ab660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f63ac002f70 tx=0x7f63ac006df0).ready entity=mon.1 client_cookie=48f1e901602a705b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63a7fff700 1 -- 172.21.15.41:0/3850575749 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac00d570 con 0x7f63b00af620 2021-10-21T00:04:45.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63a7fff700 1 -- 172.21.15.41:0/3850575749 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac000e90 con 0x7f63b00af620 2021-10-21T00:04:45.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.819+0000 7f63a7fff700 1 -- 172.21.15.41:0/3850575749 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac00d8c0 con 0x7f63b00af620 2021-10-21T00:04:45.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- 172.21.15.41:0/3850575749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00af620 msgr2=0x7f63b00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 --2- 172.21.15.41:0/3850575749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00af620 0x7f63b00ab660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f63ac002f70 tx=0x7f63ac006df0).stop 2021-10-21T00:04:45.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- 172.21.15.41:0/3850575749 shutdown_connections 2021-10-21T00:04:45.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 --2- 172.21.15.41:0/3850575749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00af620 0x7f63b00ab660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 --2- 172.21.15.41:0/3850575749 >> v2:172.21.15.41:3300/0 conn(0x7f63b00b2170 0x7f63b00ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- 172.21.15.41:0/3850575749 >> 172.21.15.41:0/3850575749 conn(0x7f63b00b5700 msgr2=0x7f63b00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:45.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- 172.21.15.41:0/3850575749 shutdown_connections 2021-10-21T00:04:45.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- 172.21.15.41:0/3850575749 wait complete. 2021-10-21T00:04:45.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 Processor -- start 2021-10-21T00:04:45.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.823+0000 7f63b6428700 1 -- start start 2021-10-21T00:04:45.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b00abb50 0x7f63b0067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00b2170 0x7f63b00ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0065fb0 con 0x7f63b00af620 2021-10-21T00:04:45.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0063c00 con 0x7f63b00b2170 2021-10-21T00:04:45.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00ae410 con 0x7f63b00abb50 2021-10-21T00:04:45.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59496/0 (socket says 172.21.15.41:59496) 2021-10-21T00:04:45.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 -- 172.21.15.41:0/794228016 learned_addr learned my addr 172.21.15.41:0/794228016 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:45.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b5c27700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00b2170 0x7f63b00ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b5426700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b00abb50 0x7f63b0067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 -- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b00abb50 msgr2=0x7f63b0067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b00abb50 0x7f63b0067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 -- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00b2170 msgr2=0x7f63b00ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:45.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00b2170 0x7f63b00ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:45.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 -- 172.21.15.41:0/794228016 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac00b180 con 0x7f63b00af620 2021-10-21T00:04:45.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b4c25700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f63b0063d40 tx=0x7f63ac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac016070 con 0x7f63b00af620 2021-10-21T00:04:45.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac0139c0 con 0x7f63b00af620 2021-10-21T00:04:45.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ac013d20 con 0x7f63b00af620 2021-10-21T00:04:45.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b008f3c0 con 0x7f63b00af620 2021-10-21T00:04:45.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b0063760 con 0x7f63b00af620 2021-10-21T00:04:45.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b008f860 con 0x7f63b00af620 2021-10-21T00:04:45.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.827+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63ac00f030 con 0x7f63b00af620 2021-10-21T00:04:45.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.831+0000 7f63a67fc700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 0x7f6398055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:45.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.831+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f63ac06c320 con 0x7f63b00af620 2021-10-21T00:04:45.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.831+0000 7f63b5426700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 0x7f6398055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:45.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.831+0000 7f63b5426700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 0x7f6398055ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f63a0008000 tx=0x7f63a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:45.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:45.835+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63ac043760 con 0x7f63b00af620 2021-10-21T00:04:46.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.011+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f63b00b12d0 con 0x7f63b00af620 2021-10-21T00:04:46.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.439+0000 7f63a67fc700 1 -- 172.21.15.41:0/794228016 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v96) v1 ==== 139+0+0 (secure 0 0 0) 0x7f63ac023020 con 0x7f63b00af620 2021-10-21T00:04:46.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 msgr2=0x7f6398055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 0x7f6398055ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f63a0008000 tx=0x7f63a0008040).stop 2021-10-21T00:04:46.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 msgr2=0x7f63b00acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f63b0063d40 tx=0x7f63ac014000).stop 2021-10-21T00:04:46.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 shutdown_connections 2021-10-21T00:04:46.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6398053610 0x7f6398055ad0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63b00b2170 0x7f63b00ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63b00af620 0x7f63b00acd00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 --2- 172.21.15.41:0/794228016 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63b00abb50 0x7f63b0067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 >> 172.21.15.41:0/794228016 conn(0x7f63b00b5700 msgr2=0x7f63b00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:46.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 shutdown_connections 2021-10-21T00:04:46.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.443+0000 7f63b6428700 1 -- 172.21.15.41:0/794228016 wait complete. 2021-10-21T00:04:46.467 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-21T00:04:46.467 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-21T00:04:46.468 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-10-21T00:04:46.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 Processor -- start 2021-10-21T00:04:46.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 -- start start 2021-10-21T00:04:46.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f573c067a80 0x7f573c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0b0b50 con 0x7f573c0af620 2021-10-21T00:04:46.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0b2550 con 0x7f573c067a80 2021-10-21T00:04:46.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b0d90 con 0x7f573c0b2170 2021-10-21T00:04:46.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f5739d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f573c0af620 0x7f573c0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57272/0 (socket says 172.21.15.41:57272) 2021-10-21T00:04:46.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f5739d9b700 1 -- 172.21.15.41:0/541883285 learned_addr learned my addr 172.21.15.41:0/541883285 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:46.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573ad9d700 1 --2- 172.21.15.41:0/541883285 >> v2:172.21.15.62:3300/0 conn(0x7f573c067a80 0x7f573c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.567+0000 7f573a59c700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573959a700 1 -- 172.21.15.41:0/541883285 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247685198 0 0) 0x7f572c001490 con 0x7f573c0af620 2021-10-21T00:04:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573959a700 1 -- 172.21.15.41:0/541883285 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5720003260 con 0x7f573c0af620 2021-10-21T00:04:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573ad9d700 1 -- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 msgr2=0x7f573c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573ad9d700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573ad9d700 1 -- 172.21.15.41:0/541883285 >> v1:172.21.15.41:6789/0 conn(0x7f573c0af620 legacy=0x7f573c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573ad9d700 1 -- 172.21.15.41:0/541883285 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0b1030 con 0x7f573c067a80 2021-10-21T00:04:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573ad9d700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c067a80 0x7f573c149320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5734002f70 tx=0x7f5734006df0).ready entity=mon.1 client_cookie=71c333af45e17c2b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573959a700 1 -- 172.21.15.41:0/541883285 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573400d4a0 con 0x7f573c067a80 2021-10-21T00:04:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573959a700 1 -- 172.21.15.41:0/541883285 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734000e90 con 0x7f573c067a80 2021-10-21T00:04:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573959a700 1 -- 172.21.15.41:0/541883285 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573400d7f0 con 0x7f573c067a80 2021-10-21T00:04:46.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 -- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c067a80 msgr2=0x7f573c149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c067a80 0x7f573c149320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5734002f70 tx=0x7f5734006df0).stop 2021-10-21T00:04:46.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 -- 172.21.15.41:0/541883285 shutdown_connections 2021-10-21T00:04:46.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c067a80 0x7f573c149320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 --2- 172.21.15.41:0/541883285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 -- 172.21.15.41:0/541883285 >> 172.21.15.41:0/541883285 conn(0x7f573c0b5700 msgr2=0x7f573c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:46.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 -- 172.21.15.41:0/541883285 shutdown_connections 2021-10-21T00:04:46.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.571+0000 7f573b59e700 1 -- 172.21.15.41:0/541883285 wait complete. 2021-10-21T00:04:46.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 Processor -- start 2021-10-21T00:04:46.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 -- start start 2021-10-21T00:04:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c0af620 0x7f573c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c064b20 con 0x7f573c067a80 2021-10-21T00:04:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c148ca0 con 0x7f573c0af620 2021-10-21T00:04:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0ad9e0 con 0x7f573c0b2170 2021-10-21T00:04:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59508/0 (socket says 172.21.15.41:59508) 2021-10-21T00:04:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 -- 172.21.15.41:0/712231909 learned_addr learned my addr 172.21.15.41:0/712231909 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f5739d9b700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c0af620 0x7f573c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573ad9d700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 -- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 msgr2=0x7f573c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 -- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c0af620 msgr2=0x7f573c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c0af620 0x7f573c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.575+0000 7f573a59c700 1 -- 172.21.15.41:0/712231909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573400b180 con 0x7f573c067a80 2021-10-21T00:04:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f573a59c700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f573000c000 tx=0x7f5730006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5730010780 con 0x7f573c067a80 2021-10-21T00:04:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300108e0 con 0x7f573c067a80 2021-10-21T00:04:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c063650 con 0x7f573c067a80 2021-10-21T00:04:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5730010c40 con 0x7f573c067a80 2021-10-21T00:04:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c146650 con 0x7f573c067a80 2021-10-21T00:04:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c064c90 con 0x7f573c067a80 2021-10-21T00:04:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f573001c460 con 0x7f573c067a80 2021-10-21T00:04:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 0x7f5718055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f573006ba00 con 0x7f573c067a80 2021-10-21T00:04:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.579+0000 7f5739d9b700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 0x7f5718055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:46.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.583+0000 7f5739d9b700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 0x7f5718055b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f572c00d000 tx=0x7f572c000f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:46.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.587+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f573c064c90 con 0x7f573c067a80 2021-10-21T00:04:46.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:46.759+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f573c064c60 con 0x7f573c067a80 2021-10-21T00:04:47.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.443+0000 7f572b7fe700 1 -- 172.21.15.41:0/712231909 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v97) v1 ==== 147+0+0 (secure 0 0 0) 0x7f5730042de0 con 0x7f573c067a80 2021-10-21T00:04:47.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 msgr2=0x7f5718055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 0x7f5718055b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f572c00d000 tx=0x7f572c000f40).stop 2021-10-21T00:04:47.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 msgr2=0x7f573c147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f573000c000 tx=0x7f5730006df0).stop 2021-10-21T00:04:47.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 shutdown_connections 2021-10-21T00:04:47.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f57180536d0 0x7f5718055b90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f573c0b2170 0x7f573c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f573c0af620 0x7f573c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 --2- 172.21.15.41:0/712231909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f573c067a80 0x7f573c147280 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 >> 172.21.15.41:0/712231909 conn(0x7f573c0b5700 msgr2=0x7f573c149040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:47.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 shutdown_connections 2021-10-21T00:04:47.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.447+0000 7f573b59e700 1 -- 172.21.15.41:0/712231909 wait complete. 2021-10-21T00:04:47.470 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:04:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 Processor -- start 2021-10-21T00:04:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 -- start start 2021-10-21T00:04:47.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 0x7f0cc805c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:47.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80ba000 con 0x7f0cc80b41a0 2021-10-21T00:04:47.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc8142ad0 con 0x7f0cc80b9c20 2021-10-21T00:04:47.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.575+0000 7f0ccdad9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8143bc0 con 0x7f0cc80acd30 2021-10-21T00:04:47.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccd2d8700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0cc80b41a0 0x7f0cc8141910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57292/0 (socket says 172.21.15.41:57292) 2021-10-21T00:04:47.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccd2d8700 1 -- 172.21.15.41:0/3250648854 learned_addr learned my addr 172.21.15.41:0/3250648854 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:47.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc7fff700 1 --2- 172.21.15.41:0/3250648854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 0x7f0cc805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:47.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307943536 0 0) 0x7f0cc80ba000 con 0x7f0cc80b41a0 2021-10-21T00:04:47.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca8003260 con 0x7f0cc80b41a0 2021-10-21T00:04:47.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380599621 0 0) 0x7f0cc8142ad0 con 0x7f0cc80b9c20 2021-10-21T00:04:47.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc80ba000 con 0x7f0cc80b9c20 2021-10-21T00:04:47.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc7fff700 1 -- 172.21.15.41:0/3250648854 >> v1:172.21.15.62:6789/0 conn(0x7f0cc80b9c20 legacy=0x7f0cc81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc7fff700 1 -- 172.21.15.41:0/3250648854 >> v1:172.21.15.41:6789/0 conn(0x7f0cc80b41a0 legacy=0x7f0cc8141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc7fff700 1 -- 172.21.15.41:0/3250648854 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8142d70 con 0x7f0cc80acd30 2021-10-21T00:04:47.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc7fff700 1 --2- 172.21.15.41:0/3250648854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 0x7f0cc805c860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0cb0002f70 tx=0x7f0cb0006df0).ready entity=mon.2 client_cookie=2dfbe2812fb82ec1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:47.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000d5c0 con 0x7f0cc80acd30 2021-10-21T00:04:47.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0000e90 con 0x7f0cc80acd30 2021-10-21T00:04:47.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0cc77fe700 1 -- 172.21.15.41:0/3250648854 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000d910 con 0x7f0cc80acd30 2021-10-21T00:04:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 -- 172.21.15.41:0/3250648854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 msgr2=0x7f0cc805c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/3250648854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 0x7f0cc805c860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0cb0002f70 tx=0x7f0cb0006df0).stop 2021-10-21T00:04:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 -- 172.21.15.41:0/3250648854 shutdown_connections 2021-10-21T00:04:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/3250648854 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80acd30 0x7f0cc805c860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 -- 172.21.15.41:0/3250648854 >> 172.21.15.41:0/3250648854 conn(0x7f0cc8062f00 msgr2=0x7f0cc80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 -- 172.21.15.41:0/3250648854 shutdown_connections 2021-10-21T00:04:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.579+0000 7f0ccdad9700 1 -- 172.21.15.41:0/3250648854 wait complete. 2021-10-21T00:04:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 Processor -- start 2021-10-21T00:04:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- start start 2021-10-21T00:04:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80b41a0 0x7f0cc8151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80b9c20 0x7f0cc81127b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81123c0 con 0x7f0cc80acd30 2021-10-21T00:04:47.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8155b30 con 0x7f0cc80b41a0 2021-10-21T00:04:47.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8155dd0 con 0x7f0cc80b9c20 2021-10-21T00:04:47.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:47.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59524/0 (socket says 172.21.15.41:59524) 2021-10-21T00:04:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 -- 172.21.15.41:0/768642346 learned_addr learned my addr 172.21.15.41:0/768642346 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cc7fff700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80b41a0 0x7f0cc8151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccd2d8700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80b9c20 0x7f0cc81127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 -- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80b9c20 msgr2=0x7f0cc81127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80b9c20 0x7f0cc81127b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 -- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80b41a0 msgr2=0x7f0cc8151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80b41a0 0x7f0cc8151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 -- 172.21.15.41:0/768642346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb000b180 con 0x7f0cc80acd30 2021-10-21T00:04:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cccad7700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0cb8001160 tx=0x7f0cb8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb8012400 con 0x7f0cc80acd30 2021-10-21T00:04:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8012560 con 0x7f0cc80acd30 2021-10-21T00:04:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc8151fa0 con 0x7f0cc80acd30 2021-10-21T00:04:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb80128c0 con 0x7f0cc80acd30 2021-10-21T00:04:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.583+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc80af310 con 0x7f0cc80acd30 2021-10-21T00:04:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8112510 con 0x7f0cc80acd30 2021-10-21T00:04:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cb8019030 con 0x7f0cc80acd30 2021-10-21T00:04:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0cc5ffb700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 0x7f0cac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0cb806ab00 con 0x7f0cc80acd30 2021-10-21T00:04:47.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0cc7fff700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 0x7f0cac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:47.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.587+0000 7f0cc7fff700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 0x7f0cac055b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f0cb001a000 tx=0x7f0cb0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:47.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.591+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cc8112510 con 0x7f0cc80acd30 2021-10-21T00:04:47.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.723+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0cc8112510 con 0x7f0cc80acd30 2021-10-21T00:04:47.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0cc5ffb700 1 -- 172.21.15.41:0/768642346 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0cc8112510 con 0x7f0cc80acd30 2021-10-21T00:04:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 msgr2=0x7f0cac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 0x7f0cac055b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f0cb001a000 tx=0x7f0cb0014000).stop 2021-10-21T00:04:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 msgr2=0x7f0cc8145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0cb8001160 tx=0x7f0cb8007ad0).stop 2021-10-21T00:04:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 shutdown_connections 2021-10-21T00:04:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cac053640 0x7f0cac055b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80b9c20 0x7f0cc81127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80b41a0 0x7f0cc8151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 --2- 172.21.15.41:0/768642346 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0cc80acd30 0x7f0cc8145e50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 >> 172.21.15.41:0/768642346 conn(0x7f0cc8062f00 msgr2=0x7f0cc80b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 shutdown_connections 2021-10-21T00:04:47.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:47.731+0000 7f0ccdad9700 1 -- 172.21.15.41:0/768642346 wait complete. 2021-10-21T00:04:47.753 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:04:47.753 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:47.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:47.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:47.812 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:47.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:04:47.864 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:04:47.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:47.865 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:47.865 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:47.873 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:04:47.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:47.874 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:04:47.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:47.876 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:47.876 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:04:47.883 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:04:47.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:47.886 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:04:47.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:47.887 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:04:47.887 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:04:47.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:04:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:04:47.899 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:04:47.900 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:04:48.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.003+0000 7f318f59e700 1 Processor -- start 2021-10-21T00:04:48.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.003+0000 7f318f59e700 1 -- start start 2021-10-21T00:04:48.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 0x7f31900b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31900b3a20 0x7f319013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319005bd40 con 0x7f3190062f70 2021-10-21T00:04:48.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319005bf70 con 0x7f3190062330 2021-10-21T00:04:48.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3190142cb0 con 0x7f31900b3a20 2021-10-21T00:04:48.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 0x7f31900b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31900b3a20 0x7f319013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 0x7f31900b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59532/0 (socket says 172.21.15.41:59532) 2021-10-21T00:04:48.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f3185d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3190062f70 0x7f319005c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37126/0 (socket says 172.21.15.41:37126) 2021-10-21T00:04:48.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 --2- 172.21.15.41:0/593959792 >> v2:172.21.15.62:3300/0 conn(0x7f31900b3a20 0x7f319013c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43222/0 (socket says 172.21.15.41:43222) 2021-10-21T00:04:48.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318e59c700 1 -- 172.21.15.41:0/593959792 learned_addr learned my addr 172.21.15.41:0/593959792 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:48.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 -- 172.21.15.41:0/593959792 >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 msgr2=0x7f31900b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:48.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 --2- 172.21.15.41:0/593959792 >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 0x7f31900b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 -- 172.21.15.41:0/593959792 >> v1:172.21.15.62:6789/0 conn(0x7f3190062f70 legacy=0x7f319005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 -- 172.21.15.41:0/593959792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190142950 con 0x7f31900b3a20 2021-10-21T00:04:48.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318ed9d700 1 --2- 172.21.15.41:0/593959792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f319013c510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f31880032f0 tx=0x7f31880091d0).ready entity=mon.1 client_cookie=173c9d3abbfafd8b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318dd9b700 1 -- 172.21.15.41:0/593959792 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318800b680 con 0x7f31900b3a20 2021-10-21T00:04:48.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318dd9b700 1 -- 172.21.15.41:0/593959792 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800b7e0 con 0x7f31900b3a20 2021-10-21T00:04:48.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318dd9b700 1 -- 172.21.15.41:0/593959792 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318800b950 con 0x7f31900b3a20 2021-10-21T00:04:48.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- 172.21.15.41:0/593959792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 msgr2=0x7f319013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 --2- 172.21.15.41:0/593959792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f319013c510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f31880032f0 tx=0x7f31880091d0).stop 2021-10-21T00:04:48.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- 172.21.15.41:0/593959792 shutdown_connections 2021-10-21T00:04:48.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 --2- 172.21.15.41:0/593959792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f319013c510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 --2- 172.21.15.41:0/593959792 >> v2:172.21.15.41:3300/0 conn(0x7f3190062330 0x7f31900b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- 172.21.15.41:0/593959792 >> 172.21.15.41:0/593959792 conn(0x7f31900b9080 msgr2=0x7f31900b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- 172.21.15.41:0/593959792 shutdown_connections 2021-10-21T00:04:48.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.007+0000 7f318f59e700 1 -- 172.21.15.41:0/593959792 wait complete. 2021-10-21T00:04:48.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 Processor -- start 2021-10-21T00:04:48.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- start start 2021-10-21T00:04:48.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3190062330 0x7f3190113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f31900ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190112cb0 con 0x7f3190062f70 2021-10-21T00:04:48.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190112f50 con 0x7f31900b3a20 2021-10-21T00:04:48.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31901131f0 con 0x7f3190062330 2021-10-21T00:04:48.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59540/0 (socket says 172.21.15.41:59540) 2021-10-21T00:04:48.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 -- 172.21.15.41:0/2532330564 learned_addr learned my addr 172.21.15.41:0/2532330564 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:48.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318e59c700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3190062330 0x7f3190113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318ed9d700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f31900ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 -- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3190062330 msgr2=0x7f3190113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3190062330 0x7f3190113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 -- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 msgr2=0x7f31900ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f31900ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 -- 172.21.15.41:0/2532330564 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009470 con 0x7f3190062f70 2021-10-21T00:04:48.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318ed9d700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f31900ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:48.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3185d9b700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f31900b6d50 tx=0x7f3178007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f317800ce30 con 0x7f3190062f70 2021-10-21T00:04:48.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31780072e0 con 0x7f3190062f70 2021-10-21T00:04:48.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3178005740 con 0x7f3190062f70 2021-10-21T00:04:48.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31900ad2f0 con 0x7f3190062f70 2021-10-21T00:04:48.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.011+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31900acfa0 con 0x7f3190062f70 2021-10-21T00:04:48.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31901133f0 con 0x7f3190062f70 2021-10-21T00:04:48.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3178010070 con 0x7f3190062f70 2021-10-21T00:04:48.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f3187fff700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 0x7f3168055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f317806ab60 con 0x7f3190062f70 2021-10-21T00:04:48.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f318e59c700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 0x7f3168055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.015+0000 7f318e59c700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 0x7f3168055b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3180008000 tx=0x7f3180008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.023+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31901133f0 con 0x7f3190062f70 2021-10-21T00:04:48.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.147+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f31901133f0 con 0x7f3190062f70 2021-10-21T00:04:48.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.151+0000 7f3187fff700 1 -- 172.21.15.41:0/2532330564 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+28827 (secure 0 0 0) 0x7f31901133f0 con 0x7f3190062f70 2021-10-21T00:04:48.158 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:48.158 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:04:48.158 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 34, 2021-10-21T00:04:48.159 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:04:48.159 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:04:48.159 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:04:45.421585+0000", 2021-10-21T00:04:48.159 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:04:48.160 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:04:48.160 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:04:48.160 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:04:48.160 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:04:48.161 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:04:48.161 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:04:48.161 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:04:48.161 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:04:48.162 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:48.162 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:04:48.162 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:04:48.162 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:04:48.163 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:04:48.163 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:04:48.163 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 6, 2021-10-21T00:04:48.163 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:04:48.163 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:04:48.164 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:04:48.164 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:04:48.165 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:04:48.165 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.166 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:04:48.166 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:04:48.166 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:04:48.166 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:48.167 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:48.167 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:48.167 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:48.167 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:48.168 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:48.168 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:48.168 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:48.168 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:04:48.168 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:04:48.169 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:04:48.169 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:04:48.169 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:04:48.169 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:48.170 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:48.170 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:48.170 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:48.170 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:48.170 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:48.171 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:48.171 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.171 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:04:48.171 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:48.172 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:48.172 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:48.172 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:48.172 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:48.172 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:48.173 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:48.173 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:48.173 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:48.173 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:48.174 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:48.174 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:48.174 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:48.174 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:48.174 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:48.175 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:48.175 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:48.175 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:48.175 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:48.176 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:48.176 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:48.176 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:48.177 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:48.177 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:48.177 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:48.177 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:48.178 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.178 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:48.178 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:48.179 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:48.179 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:48.179 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:48.179 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:48.179 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:48.180 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:48.180 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:48.180 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:48.180 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:48.181 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:04:48.181 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:04:48.181 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.181 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:48.181 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:04:48.182 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.182 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.182 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.183 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:04:48.183 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:04:48.183 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:04:48.183 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:04:48.183 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:04:48.184 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:04:48.184 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:04:48.184 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:04:48.184 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:04:48.185 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:04:48.185 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:04:48.185 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:04:48.185 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:04:48.185 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:04:48.186 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:04:48.186 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:04:48.186 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:04:48.187 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:04:48.188 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:04:48.188 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:04:48.188 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:04:48.188 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:04:48.189 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:04:48.189 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.189 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:04:48.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:04:48.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:04:48.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:04:48.190 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:04:48.191 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:04:48.191 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:04:48.191 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:04:48.191 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:04:48.192 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:04:48.192 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:04:48.192 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:04:48.192 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:04:48.192 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:04:48.193 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:04:48.193 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:04:48.193 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:04:48.193 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:04:48.194 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:04:48.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:04:48.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:04:48.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:04:48.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:04:48.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:04:48.195 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:04:48.195 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:04:48.195 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:04:48.196 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.196 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:04:48.196 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:04:48.196 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:04:48.196 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:04:48.197 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:04:48.197 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:04:48.197 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:04:48.197 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:04:48.198 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:04:48.198 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:04:48.198 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:04:48.198 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:04:48.198 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:04:48.199 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:04:48.199 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.199 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.200 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:48.200 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:04:48.201 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.201 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:04:48.201 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:04:48.201 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.202 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.202 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.202 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.202 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.202 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.203 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.203 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.203 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.203 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.204 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.204 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.204 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.204 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.204 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:04:48.205 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.205 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.205 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.205 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.206 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:04:48.206 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.206 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.206 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.207 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.207 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.207 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.207 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.207 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.208 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:04:48.208 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.208 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.208 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.208 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.209 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:04:48.209 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.209 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.209 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.210 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.210 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.210 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.210 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.210 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:04:48.211 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.211 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.211 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.212 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.212 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:04:48.212 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.212 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.212 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.213 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.213 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.213 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.213 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.214 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.214 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:04:48.214 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.214 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.214 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.215 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.215 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:04:48.215 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:04:48.215 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.216 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.216 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.216 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:04:48.216 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:04:48.216 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:04:48.217 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:04:48.217 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.217 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.217 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.218 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.218 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.218 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.218 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:04:48.218 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:04:48.219 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.219 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.219 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.219 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.220 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.220 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.220 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.220 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.220 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.221 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.221 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.222 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.222 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:04:48.222 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.222 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.222 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.223 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.223 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:04:48.223 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.223 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.224 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.224 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.224 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.224 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.224 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.225 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.225 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:04:48.225 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.225 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.226 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.226 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.226 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:04:48.226 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.226 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.227 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.227 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.227 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.228 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.228 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.228 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:04:48.228 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.228 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.229 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.229 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.229 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:04:48.229 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.230 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.230 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.230 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.230 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.231 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.231 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.231 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:04:48.231 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.232 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.232 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.232 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:04:48.233 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:04:48.233 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.233 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.233 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:04:48.234 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:04:48.234 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:04:48.234 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:04:48.234 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.234 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.235 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.235 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.235 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.236 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.236 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:04:48.236 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:04:48.236 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.237 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.237 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.237 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.237 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.237 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.238 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.238 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:04:48.238 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.238 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.239 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.239 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.239 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.239 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.239 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:04:48.240 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.240 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.240 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.240 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.241 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:04:48.241 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.241 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.241 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.242 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.242 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.242 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.242 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.242 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.243 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:04:48.243 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.243 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.243 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.244 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.244 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:04:48.244 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.244 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.244 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.245 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.245 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.245 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.245 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.245 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:04:48.246 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.246 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.246 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.247 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.247 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:04:48.247 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.247 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.247 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.248 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.248 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.248 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.249 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:04:48.249 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.249 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.250 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.250 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.250 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:04:48.250 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:04:48.250 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.251 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.251 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.251 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:04:48.251 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:04:48.252 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:04:48.252 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:04:48.252 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.252 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.252 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.253 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.253 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.253 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.253 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:04:48.254 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:04:48.254 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.254 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.254 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.254 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.255 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.255 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.255 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.255 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.256 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.256 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.256 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.256 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.256 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.257 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.257 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:04:48.257 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.257 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.258 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:04:48.258 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.258 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.259 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.259 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.259 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.259 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.260 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.260 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.260 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:04:48.260 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.261 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.261 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.261 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:04:48.261 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.262 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.262 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.262 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.262 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.263 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.263 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.263 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.263 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:04:48.263 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.264 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.264 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.264 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.264 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:04:48.265 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.265 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.265 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.265 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.266 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.266 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.266 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.266 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.267 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:04:48.267 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.267 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.267 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.267 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.268 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:04:48.268 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:04:48.268 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.268 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.269 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.269 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:04:48.269 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:04:48.269 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:04:48.269 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:04:48.270 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.270 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.270 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.270 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.271 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.271 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.271 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:04:48.271 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:04:48.272 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.272 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.272 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.272 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.272 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.273 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.273 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.273 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.273 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.274 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.274 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.274 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.274 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.275 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.275 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:04:48.275 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.275 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.275 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.276 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.276 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:04:48.276 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.276 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.277 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.277 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.277 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.278 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.278 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:04:48.278 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.278 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.279 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.279 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.279 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:04:48.279 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.280 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.280 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.280 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.280 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.281 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.281 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:04:48.281 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.282 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.282 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.282 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:04:48.283 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.283 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.283 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.283 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.283 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.284 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.284 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.284 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.284 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:04:48.285 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.285 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.285 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.285 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.286 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:04:48.286 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:04:48.286 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.286 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.286 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.287 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:04:48.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:04:48.287 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:04:48.287 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:04:48.288 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.288 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.288 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.288 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.288 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.289 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.289 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:04:48.289 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:04:48.289 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.290 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.290 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.290 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.290 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.291 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.291 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.291 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.291 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.291 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.292 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.292 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.292 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.292 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.292 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:04:48.293 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.293 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.293 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.293 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.294 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:04:48.294 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.294 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.294 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.295 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.295 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.295 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.295 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.296 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.296 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:04:48.296 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.296 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.296 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.297 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.297 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:04:48.297 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.297 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.297 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.298 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.298 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.298 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.299 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.299 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:04:48.299 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.299 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.299 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.300 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.300 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:04:48.300 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.300 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.301 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.301 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.301 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.301 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.301 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.302 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.302 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:04:48.302 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.302 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.303 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.303 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.303 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:04:48.303 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:04:48.303 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.304 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.304 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.304 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:04:48.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:04:48.305 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:04:48.305 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:04:48.305 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.305 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.305 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.306 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.306 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.306 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.306 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:04:48.307 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:04:48.307 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.307 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.307 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.307 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.308 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.308 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.308 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.308 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:04:48.309 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.309 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.309 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.309 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.309 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.310 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.310 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:04:48.310 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.310 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.311 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.311 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.311 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:04:48.311 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.311 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.312 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.312 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.312 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.312 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.313 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.313 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.313 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:04:48.313 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.313 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.314 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.314 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.314 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:04:48.314 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.315 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.315 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.315 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.315 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.316 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:04:48.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.317 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.317 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.317 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.317 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:04:48.317 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.318 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.318 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.318 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.318 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.319 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.319 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:04:48.319 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.320 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.320 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.320 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:04:48.321 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:04:48.321 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.321 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.321 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.321 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:04:48.322 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:04:48.322 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:04:48.322 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:04:48.322 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.323 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.323 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.323 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.323 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.324 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:04:48.324 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:04:48.324 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:04:48.324 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:04:48.325 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:04:48.325 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:04:48.325 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:04:48.325 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:04:48.325 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:04:48.326 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 29, 2021-10-21T00:04:48.326 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:04:48.326 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:04:48.326 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:04:48.327 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.327 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.327 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.327 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:04:48.327 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.328 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.328 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.328 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.328 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:04:48.329 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.329 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.329 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.329 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.330 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:04:48.330 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.330 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.330 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:04:48.331 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.331 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.331 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.331 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:04:48.332 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.332 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.332 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.332 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.333 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:04:48.333 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.333 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.333 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.334 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:04:48.334 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.334 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.334 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.334 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:04:48.335 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.335 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.335 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.336 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:04:48.336 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:04:48.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.337 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:04:48.337 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:04:48.337 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.337 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.337 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.338 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:04:48.338 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:04:48.338 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:04:48.338 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.339 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.339 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.339 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:04:48.339 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:04:48.340 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:04:48.340 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:04:48.340 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:04:48.340 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:04:48.340 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:04:48.341 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:48.341 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.341 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:48.341 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:04:48.341 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.342 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:04:48.342 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.342 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.342 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.343 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.343 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.343 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:04:48.343 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.344 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.344 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.344 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:04:48.344 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.345 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.345 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.345 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.345 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:04:48.346 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.346 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.346 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.346 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:04:48.347 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.347 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.347 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.347 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.348 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.348 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:04:48.348 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.348 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.348 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.349 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:04:48.349 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.349 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.349 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:04:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:04:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:04:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:04:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:04:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:04:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:04:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:04:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:04:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:04:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:04:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:04:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:04:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:04:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:04:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:04:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:04:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:04:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:04:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:04:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:04:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/1216827791": "2021-10-22T00:04:42.075060+0000", 2021-10-21T00:04:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/1216827791": "2021-10-22T00:04:42.075060+0000" 2021-10-21T00:04:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:04:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:04:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:04:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:04:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:04:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:04:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:04:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:04:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:04:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:04:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:04:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:04:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:04:48.365 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:04:48.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.151+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 msgr2=0x7f3168055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.151+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 0x7f3168055b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3180008000 tx=0x7f3180008040).stop 2021-10-21T00:04:48.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.151+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 msgr2=0x7f31900ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.151+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f31900b6d50 tx=0x7f3178007bd0).stop 2021-10-21T00:04:48.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 shutdown_connections 2021-10-21T00:04:48.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31680536d0 0x7f3168055b90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900b3a20 0x7f31900ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3190062f70 0x7f31900ac890 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 --2- 172.21.15.41:0/2532330564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3190062330 0x7f3190113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 >> 172.21.15.41:0/2532330564 conn(0x7f31900b9080 msgr2=0x7f319013de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 shutdown_connections 2021-10-21T00:04:48.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.155+0000 7f318f59e700 1 -- 172.21.15.41:0/2532330564 wait complete. 2021-10-21T00:04:48.371 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:48.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 Processor -- start 2021-10-21T00:04:48.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 -- start start 2021-10-21T00:04:48.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b413f710 con 0x7f60b406a190 2021-10-21T00:04:48.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b40b6350 con 0x7f60b40af700 2021-10-21T00:04:48.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.479+0000 7f60ba784700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40adf10 con 0x7f60b40b5f70 2021-10-21T00:04:48.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b8f81700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f60b406a190 0x7f60b4142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57318/0 (socket says 172.21.15.41:57318) 2021-10-21T00:04:48.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b8f81700 1 -- 172.21.15.41:0/857376304 learned_addr learned my addr 172.21.15.41:0/857376304 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:48.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b9782700 1 --2- 172.21.15.41:0/857376304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580448981 0 0) 0x7f60b413f710 con 0x7f60b406a190 2021-10-21T00:04:48.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f609c003260 con 0x7f60b406a190 2021-10-21T00:04:48.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700473104 0 0) 0x7f60b40b6350 con 0x7f60b40af700 2021-10-21T00:04:48.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b413f710 con 0x7f60b40af700 2021-10-21T00:04:48.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551317491 0 0) 0x7f609c003260 con 0x7f60b406a190 2021-10-21T00:04:48.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b9782700 1 -- 172.21.15.41:0/857376304 >> v1:172.21.15.62:6789/0 conn(0x7f60b40af700 legacy=0x7f60b41432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b9782700 1 -- 172.21.15.41:0/857376304 >> v1:172.21.15.41:6789/0 conn(0x7f60b406a190 legacy=0x7f60b4142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b9782700 1 -- 172.21.15.41:0/857376304 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b41439f0 con 0x7f60b40b5f70 2021-10-21T00:04:48.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60b9782700 1 --2- 172.21.15.41:0/857376304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b413fb40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f60a4001110 tx=0x7f60b0006df0).ready entity=mon.2 client_cookie=9b9c708508cf009b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a4001660 con 0x7f60b40b5f70 2021-10-21T00:04:48.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0000e90 con 0x7f60b40b5f70 2021-10-21T00:04:48.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60a3fff700 1 -- 172.21.15.41:0/857376304 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0012460 con 0x7f60b40b5f70 2021-10-21T00:04:48.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 -- 172.21.15.41:0/857376304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 msgr2=0x7f60b413fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 --2- 172.21.15.41:0/857376304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b413fb40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f60a4001110 tx=0x7f60b0006df0).stop 2021-10-21T00:04:48.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 -- 172.21.15.41:0/857376304 shutdown_connections 2021-10-21T00:04:48.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 --2- 172.21.15.41:0/857376304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b413fb40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 -- 172.21.15.41:0/857376304 >> 172.21.15.41:0/857376304 conn(0x7f60b40639f0 msgr2=0x7f60b40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 -- 172.21.15.41:0/857376304 shutdown_connections 2021-10-21T00:04:48.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 -- 172.21.15.41:0/857376304 wait complete. 2021-10-21T00:04:48.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.483+0000 7f60ba784700 1 Processor -- start 2021-10-21T00:04:48.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- start start 2021-10-21T00:04:48.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 0x7f60b4066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 0x7f60b405bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b4136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4065390 con 0x7f60b406a190 2021-10-21T00:04:48.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4065630 con 0x7f60b40af700 2021-10-21T00:04:48.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4064830 con 0x7f60b40b5f70 2021-10-21T00:04:48.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b9782700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 0x7f60b4066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 0x7f60b405bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b9782700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 0x7f60b4066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59552/0 (socket says 172.21.15.41:59552) 2021-10-21T00:04:48.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b9782700 1 -- 172.21.15.41:0/1392171023 learned_addr learned my addr 172.21.15.41:0/1392171023 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:48.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b9f83700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b4136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 -- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 msgr2=0x7f60b4136d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b4136d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 -- 172.21.15.41:0/1392171023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 msgr2=0x7f60b4066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 0x7f60b4066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 -- 172.21.15.41:0/1392171023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b000b180 con 0x7f60b40af700 2021-10-21T00:04:48.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60b8f81700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 0x7f60b405bfe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f60a4001840 tx=0x7f60a4001580).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a4007110 con 0x7f60b40af700 2021-10-21T00:04:48.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4007270 con 0x7f60b40af700 2021-10-21T00:04:48.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b4065ad0 con 0x7f60b40af700 2021-10-21T00:04:48.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a4005030 con 0x7f60b40af700 2021-10-21T00:04:48.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.487+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b40645d0 con 0x7f60b40af700 2021-10-21T00:04:48.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4064a80 con 0x7f60b40af700 2021-10-21T00:04:48.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60a401b070 con 0x7f60b40af700 2021-10-21T00:04:48.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60a27fc700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 0x7f6094055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f60a406aba0 con 0x7f60b40af700 2021-10-21T00:04:48.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60b9782700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 0x7f6094055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.491+0000 7f60b9782700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 0x7f6094055b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f60b001a000 tx=0x7f60b0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.499+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60a4041e50 con 0x7f60b40af700 2021-10-21T00:04:48.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.667+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b4067600 con 0x7f60b40af700 2021-10-21T00:04:48.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.667+0000 7f60a27fc700 1 -- 172.21.15.41:0/1392171023 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1205 (secure 0 0 0) 0x7f60a4045470 con 0x7f60b40af700 2021-10-21T00:04:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:48.675 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/1723899134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1723899134},{"type":"v1","addr":"172.21.15.41:6833","nonce":1723899134}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[]} 2021-10-21T00:04:48.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 msgr2=0x7f6094055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 0x7f6094055b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f60b001a000 tx=0x7f60b0014000).stop 2021-10-21T00:04:48.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 msgr2=0x7f60b405bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 0x7f60b405bfe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f60a4001840 tx=0x7f60a4001580).stop 2021-10-21T00:04:48.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 shutdown_connections 2021-10-21T00:04:48.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f60940536d0 0x7f6094055b90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60b40b5f70 0x7f60b4136d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60b40af700 0x7f60b405bfe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 --2- 172.21.15.41:0/1392171023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60b406a190 0x7f60b4066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 >> 172.21.15.41:0/1392171023 conn(0x7f60b40639f0 msgr2=0x7f60b41432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 shutdown_connections 2021-10-21T00:04:48.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.671+0000 7f60ba784700 1 -- 172.21.15.41:0/1392171023 wait complete. 2021-10-21T00:04:48.681 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 13 2021-10-21T00:04:48.694 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:48.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 Processor -- start 2021-10-21T00:04:48.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 -- start start 2021-10-21T00:04:48.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33840b1820 0x7f338414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f33840679b0 0x7f33840adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840b6340 con 0x7f33840675d0 2021-10-21T00:04:48.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3384146d10 con 0x7f33840679b0 2021-10-21T00:04:48.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338414a4b0 con 0x7f33840b1820 2021-10-21T00:04:48.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f33840679b0 0x7f33840adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f33840679b0 0x7f33840adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59564/0 (socket says 172.21.15.41:59564) 2021-10-21T00:04:48.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3388fad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33840b1820 0x7f338414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 -- 172.21.15.41:0/2996378461 learned_addr learned my addr 172.21.15.41:0/2996378461 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:48.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 -- 172.21.15.41:0/2996378461 >> v2:172.21.15.62:3300/0 conn(0x7f33840b1820 msgr2=0x7f338414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:48.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 --2- 172.21.15.41:0/2996378461 >> v2:172.21.15.62:3300/0 conn(0x7f33840b1820 0x7f338414ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 -- 172.21.15.41:0/2996378461 >> v1:172.21.15.62:6789/0 conn(0x7f33840675d0 legacy=0x7f33840b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 -- 172.21.15.41:0/2996378461 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338414a750 con 0x7f33840679b0 2021-10-21T00:04:48.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3389faf700 1 --2- 172.21.15.41:0/2996378461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33840adb60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3380002f70 tx=0x7f3380006eb0).ready entity=mon.0 client_cookie=561440f53f19c65c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3377fff700 1 -- 172.21.15.41:0/2996378461 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338000d5c0 con 0x7f33840679b0 2021-10-21T00:04:48.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3377fff700 1 -- 172.21.15.41:0/2996378461 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380000e90 con 0x7f33840679b0 2021-10-21T00:04:48.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f3377fff700 1 -- 172.21.15.41:0/2996378461 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338000d950 con 0x7f33840679b0 2021-10-21T00:04:48.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.791+0000 7f338a7b0700 1 -- 172.21.15.41:0/2996378461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 msgr2=0x7f33840adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- 172.21.15.41:0/2996378461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33840adb60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3380002f70 tx=0x7f3380006eb0).stop 2021-10-21T00:04:48.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- 172.21.15.41:0/2996378461 shutdown_connections 2021-10-21T00:04:48.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- 172.21.15.41:0/2996378461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33840adb60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- 172.21.15.41:0/2996378461 >> v2:172.21.15.62:3300/0 conn(0x7f33840b1820 0x7f338414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- 172.21.15.41:0/2996378461 >> 172.21.15.41:0/2996378461 conn(0x7f33840639f0 msgr2=0x7f33840b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- 172.21.15.41:0/2996378461 shutdown_connections 2021-10-21T00:04:48.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- 172.21.15.41:0/2996378461 wait complete. 2021-10-21T00:04:48.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 Processor -- start 2021-10-21T00:04:48.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- start start 2021-10-21T00:04:48.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33840675d0 0x7f3384144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33840b1820 0x7f3384142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.795+0000 7f338a7b0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338415a690 con 0x7f33840679b0 2021-10-21T00:04:48.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f338a7b0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384149c70 con 0x7f33840675d0 2021-10-21T00:04:48.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f338a7b0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384065920 con 0x7f33840b1820 2021-10-21T00:04:48.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59568/0 (socket says 172.21.15.41:59568) 2021-10-21T00:04:48.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 -- 172.21.15.41:0/328405122 learned_addr learned my addr 172.21.15.41:0/328405122 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:48.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f33897ae700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33840675d0 0x7f3384144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3389faf700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33840b1820 0x7f3384142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 -- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33840b1820 msgr2=0x7f3384142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33840b1820 0x7f3384142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 -- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33840675d0 msgr2=0x7f3384144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33840675d0 0x7f3384144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 -- 172.21.15.41:0/328405122 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338000b1e0 con 0x7f33840679b0 2021-10-21T00:04:48.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3388fad700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f337c006e00 tx=0x7f337c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337c00c610 con 0x7f33840679b0 2021-10-21T00:04:48.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c00c770 con 0x7f33840679b0 2021-10-21T00:04:48.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337c00cad0 con 0x7f33840679b0 2021-10-21T00:04:48.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3384065bc0 con 0x7f33840679b0 2021-10-21T00:04:48.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3384149960 con 0x7f33840679b0 2021-10-21T00:04:48.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338414a9f0 con 0x7f33840679b0 2021-10-21T00:04:48.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.799+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f337c022070 con 0x7f33840679b0 2021-10-21T00:04:48.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.803+0000 7f3376ffd700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 0x7f3360055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:48.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.803+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f337c06bc90 con 0x7f33840679b0 2021-10-21T00:04:48.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.803+0000 7f33897ae700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 0x7f3360055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:48.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.803+0000 7f33897ae700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 0x7f3360055a40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f337800d000 tx=0x7f3378007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:48.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.811+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f337c043030 con 0x7f33840679b0 2021-10-21T00:04:48.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3384057350 con 0x7f33840679b0 2021-10-21T00:04:48.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f3376ffd700 1 -- 172.21.15.41:0/328405122 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1205 (secure 0 0 0) 0x7f337c016070 con 0x7f33840679b0 2021-10-21T00:04:48.982 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:48.982 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/336599552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":336599552},{"type":"v1","addr":"172.21.15.62:6835","nonce":336599552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/1723899134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1723899134},{"type":"v1","addr":"172.21.15.41:6833","nonce":1723899134}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13}],"filesystems":[]} 2021-10-21T00:04:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 msgr2=0x7f3360055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 0x7f3360055a40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f337800d000 tx=0x7f3378007b90).stop 2021-10-21T00:04:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 msgr2=0x7f33841425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f337c006e00 tx=0x7f337c0091d0).stop 2021-10-21T00:04:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 shutdown_connections 2021-10-21T00:04:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3360053580 0x7f3360055a40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33840b1820 0x7f3384142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f33840679b0 0x7f33841425a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 --2- 172.21.15.41:0/328405122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33840675d0 0x7f3384144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:48.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 >> 172.21.15.41:0/328405122 conn(0x7f33840639f0 msgr2=0x7f33841470f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:48.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 shutdown_connections 2021-10-21T00:04:48.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:48.975+0000 7f338a7b0700 1 -- 172.21.15.41:0/328405122 wait complete. 2021-10-21T00:04:48.987 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 13 2021-10-21T00:04:48.994 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:04:48.994 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:04:48.995 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:04:48.995 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:04:48.995 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:04:48.996 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:04:48.996 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:04:48.996 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:04:49.010 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:04:49.011 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:04:49.012 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:04:49.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:04:49.015 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:04:49.016 DEBUG:teuthology.parallel:result is None 2021-10-21T00:04:49.055 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:04:49.056 DEBUG:teuthology.parallel:result is None 2021-10-21T00:04:49.057 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:04:49.086 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:04:49.131 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:04:49.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 Processor -- start 2021-10-21T00:04:49.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 -- start start 2021-10-21T00:04:49.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f54d005f9f0 0x7f54d00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 0x7f54d00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d005fdd0 con 0x7f54d00b3150 2021-10-21T00:04:49.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d0140400 con 0x7f54d005f9f0 2021-10-21T00:04:49.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.147+0000 7f54d5a6d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00b27c0 con 0x7f54d00b0730 2021-10-21T00:04:49.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d526c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f54d00b3150 0x7f54d0142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57366/0 (socket says 172.21.15.41:57366) 2021-10-21T00:04:49.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d526c700 1 -- 172.21.15.41:0/1908314017 learned_addr learned my addr 172.21.15.41:0/1908314017 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:49.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 --2- 172.21.15.41:0/1908314017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 0x7f54d00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d4a6b700 1 --2- 172.21.15.41:0/1908314017 >> v2:172.21.15.62:3300/0 conn(0x7f54d005f9f0 0x7f54d00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cf7fe700 1 -- 172.21.15.41:0/1908314017 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056042653 0 0) 0x7f54d005fdd0 con 0x7f54d00b3150 2021-10-21T00:04:49.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cf7fe700 1 -- 172.21.15.41:0/1908314017 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b4003260 con 0x7f54d00b3150 2021-10-21T00:04:49.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 -- 172.21.15.41:0/1908314017 >> v2:172.21.15.62:3300/0 conn(0x7f54d005f9f0 msgr2=0x7f54d00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:49.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 --2- 172.21.15.41:0/1908314017 >> v2:172.21.15.62:3300/0 conn(0x7f54d005f9f0 0x7f54d00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:49.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 -- 172.21.15.41:0/1908314017 >> v1:172.21.15.41:6789/0 conn(0x7f54d00b3150 legacy=0x7f54d0142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:49.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 -- 172.21.15.41:0/1908314017 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00b35a0 con 0x7f54d00b0730 2021-10-21T00:04:49.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cffff700 1 --2- 172.21.15.41:0/1908314017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 0x7f54d00b2c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f54bc002f70 tx=0x7f54bc006df0).ready entity=mon.2 client_cookie=d6e44eef7266cca5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:49.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cf7fe700 1 -- 172.21.15.41:0/1908314017 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54bc00d4a0 con 0x7f54d00b0730 2021-10-21T00:04:49.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cf7fe700 1 -- 172.21.15.41:0/1908314017 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc000e90 con 0x7f54d00b0730 2021-10-21T00:04:49.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54cf7fe700 1 -- 172.21.15.41:0/1908314017 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54bc00d7f0 con 0x7f54d00b0730 2021-10-21T00:04:49.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 -- 172.21.15.41:0/1908314017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 msgr2=0x7f54d00b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:49.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/1908314017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 0x7f54d00b2c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f54bc002f70 tx=0x7f54bc006df0).stop 2021-10-21T00:04:49.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 -- 172.21.15.41:0/1908314017 shutdown_connections 2021-10-21T00:04:49.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/1908314017 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d00b0730 0x7f54d00b2c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:49.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/1908314017 >> v2:172.21.15.62:3300/0 conn(0x7f54d005f9f0 0x7f54d00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:49.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 -- 172.21.15.41:0/1908314017 >> 172.21.15.41:0/1908314017 conn(0x7f54d00637b0 msgr2=0x7f54d0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:49.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 -- 172.21.15.41:0/1908314017 shutdown_connections 2021-10-21T00:04:49.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.151+0000 7f54d5a6d700 1 -- 172.21.15.41:0/1908314017 wait complete. 2021-10-21T00:04:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 Processor -- start 2021-10-21T00:04:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 -- start start 2021-10-21T00:04:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d005f9f0 0x7f54d00b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d00b0730 0x7f54d0136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d013ce30 con 0x7f54d00b3150 2021-10-21T00:04:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0137c80 con 0x7f54d00b0730 2021-10-21T00:04:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d5a6d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0137f20 con 0x7f54d005f9f0 2021-10-21T00:04:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59602/0 (socket says 172.21.15.41:59602) 2021-10-21T00:04:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 -- 172.21.15.41:0/184916826 learned_addr learned my addr 172.21.15.41:0/184916826 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:49.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d4a6b700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d005f9f0 0x7f54d00b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54cffff700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d00b0730 0x7f54d0136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 -- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d005f9f0 msgr2=0x7f54d00b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:49.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d005f9f0 0x7f54d00b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:49.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 -- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d00b0730 msgr2=0x7f54d0136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:49.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d00b0730 0x7f54d0136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:49.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.155+0000 7f54d526c700 1 -- 172.21.15.41:0/184916826 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc00b180 con 0x7f54d00b3150 2021-10-21T00:04:49.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d526c700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f54c8001490 tx=0x7f54c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:49.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c8005ba0 con 0x7f54d00b3150 2021-10-21T00:04:49.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c8005d00 con 0x7f54d00b3150 2021-10-21T00:04:49.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c80072c0 con 0x7f54d00b3150 2021-10-21T00:04:49.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0138520 con 0x7f54d00b3150 2021-10-21T00:04:49.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d013c9f0 con 0x7f54d00b3150 2021-10-21T00:04:49.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0137ab0 con 0x7f54d00b3150 2021-10-21T00:04:49.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f54c8010070 con 0x7f54d00b3150 2021-10-21T00:04:49.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 0x7f54b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:49.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f54c806afa0 con 0x7f54d00b3150 2021-10-21T00:04:49.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d4a6b700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 0x7f54b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:49.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.159+0000 7f54d4a6b700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 0x7f54b0055ad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f54c4006000 tx=0x7f54c4006d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:49.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.167+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54c8042340 con 0x7f54d00b3150 2021-10-21T00:04:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:49.299+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f54d01354a0 con 0x7f54d00b3150 2021-10-21T00:04:50.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.123+0000 7f54cdffb700 1 -- 172.21.15.41:0/184916826 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54c8045960 con 0x7f54d00b3150 2021-10-21T00:04:50.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 msgr2=0x7f54b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 0x7f54b0055ad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f54c4006000 tx=0x7f54c4006d90).stop 2021-10-21T00:04:50.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 msgr2=0x7f54d01357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f54c8001490 tx=0x7f54c8007e00).stop 2021-10-21T00:04:50.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 shutdown_connections 2021-10-21T00:04:50.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f54b0053610 0x7f54b0055ad0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54d00b3150 0x7f54d01357b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54d00b0730 0x7f54d0136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 --2- 172.21.15.41:0/184916826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54d005f9f0 0x7f54d00b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 >> 172.21.15.41:0/184916826 conn(0x7f54d00637b0 msgr2=0x7f54d00b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 shutdown_connections 2021-10-21T00:04:50.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.127+0000 7f54d5a6d700 1 -- 172.21.15.41:0/184916826 wait complete. 2021-10-21T00:04:50.137 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:04:50.149 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:04:50.149 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:04:50.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 Processor -- start 2021-10-21T00:04:50.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 -- start start 2021-10-21T00:04:50.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 0x7f96a00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f96a00b3370 0x7f96a0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a005fdd0 con 0x7f96a00b0730 2021-10-21T00:04:50.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0140400 con 0x7f96a00b3370 2021-10-21T00:04:50.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5a2a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00b27c0 con 0x7f96a005f9f0 2021-10-21T00:04:50.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a5229700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f96a00b3370 0x7f96a0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a4a28700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 0x7f96a00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a4a28700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 0x7f96a00b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43294/0 (socket says 172.21.15.41:43294) 2021-10-21T00:04:50.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.295+0000 7f96a4a28700 1 -- 172.21.15.41:0/3118458243 learned_addr learned my addr 172.21.15.41:0/3118458243 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:50.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5229700 1 -- 172.21.15.41:0/3118458243 >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 msgr2=0x7f96a00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:50.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5229700 1 --2- 172.21.15.41:0/3118458243 >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 0x7f96a00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5229700 1 -- 172.21.15.41:0/3118458243 >> v1:172.21.15.62:6789/0 conn(0x7f96a00b0730 legacy=0x7f96a00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5229700 1 -- 172.21.15.41:0/3118458243 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0140080 con 0x7f96a00b3370 2021-10-21T00:04:50.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5229700 1 --2- 172.21.15.41:0/3118458243 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a00b3370 0x7f96a0138b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f96a013f630 tx=0x7f9690006df0).ready entity=mon.0 client_cookie=abb725535b0d41f7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f969f7fe700 1 -- 172.21.15.41:0/3118458243 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969000d5c0 con 0x7f96a00b3370 2021-10-21T00:04:50.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f969f7fe700 1 -- 172.21.15.41:0/3118458243 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690000e90 con 0x7f96a00b3370 2021-10-21T00:04:50.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f969f7fe700 1 -- 172.21.15.41:0/3118458243 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969000d910 con 0x7f96a00b3370 2021-10-21T00:04:50.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- 172.21.15.41:0/3118458243 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a00b3370 msgr2=0x7f96a0138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/3118458243 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a00b3370 0x7f96a0138b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f96a013f630 tx=0x7f9690006df0).stop 2021-10-21T00:04:50.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- 172.21.15.41:0/3118458243 shutdown_connections 2021-10-21T00:04:50.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/3118458243 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a00b3370 0x7f96a0138b60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/3118458243 >> v2:172.21.15.62:3300/0 conn(0x7f96a005f9f0 0x7f96a00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- 172.21.15.41:0/3118458243 >> 172.21.15.41:0/3118458243 conn(0x7f96a00637b0 msgr2=0x7f96a0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- 172.21.15.41:0/3118458243 shutdown_connections 2021-10-21T00:04:50.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- 172.21.15.41:0/3118458243 wait complete. 2021-10-21T00:04:50.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 Processor -- start 2021-10-21T00:04:50.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.299+0000 7f96a5a2a700 1 -- start start 2021-10-21T00:04:50.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a00b0730 0x7f96a0136b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 0x7f96a01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0133f70 con 0x7f96a005f9f0 2021-10-21T00:04:50.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0136ff0 con 0x7f96a00b3370 2021-10-21T00:04:50.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0067590 con 0x7f96a00b0730 2021-10-21T00:04:50.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59614/0 (socket says 172.21.15.41:59614) 2021-10-21T00:04:50.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 -- 172.21.15.41:0/4027171169 learned_addr learned my addr 172.21.15.41:0/4027171169 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:50.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5229700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 0x7f96a01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969ffff700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a00b0730 0x7f96a0136b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 -- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a00b0730 msgr2=0x7f96a0136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a00b0730 0x7f96a0136b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 -- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 msgr2=0x7f96a01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 0x7f96a01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 -- 172.21.15.41:0/4027171169 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969000b180 con 0x7f96a005f9f0 2021-10-21T00:04:50.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5229700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 0x7f96a01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:50.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a4a28700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f969800c000 tx=0x7f9698009250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969800c9d0 con 0x7f96a005f9f0 2021-10-21T00:04:50.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969800cb30 con 0x7f96a005f9f0 2021-10-21T00:04:50.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969800ce90 con 0x7f96a005f9f0 2021-10-21T00:04:50.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a00666b0 con 0x7f96a005f9f0 2021-10-21T00:04:50.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a0067190 con 0x7f96a005f9f0 2021-10-21T00:04:50.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0135020 con 0x7f96a005f9f0 2021-10-21T00:04:50.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9698022070 con 0x7f96a005f9f0 2021-10-21T00:04:50.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 0x7f96840559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.303+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f969806c080 con 0x7f96a005f9f0 2021-10-21T00:04:50.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.307+0000 7f969ffff700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 0x7f96840559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.307+0000 7f969ffff700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 0x7f96840559b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f968800b000 tx=0x7f9688009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.311+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9698043410 con 0x7f96a005f9f0 2021-10-21T00:04:50.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.483+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96a0057350 con 0x7f96a005f9f0 2021-10-21T00:04:50.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.483+0000 7f969dffb700 1 -- 172.21.15.41:0/4027171169 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f9698046a30 con 0x7f96a005f9f0 2021-10-21T00:04:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:50.492 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:04:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:04:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:04:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:04:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:04:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:04:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:04:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:04:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:04:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:04:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:04:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:04:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.503 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.503 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.503 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.503 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.504 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.504 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:04:50.504 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:04:50.504 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.506 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.506 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:04:50.506 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:04:50.506 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.507 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.507 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.507 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.507 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.508 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.508 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.508 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:04:50.508 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:04:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:04:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:04:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:04:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:04:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:04:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:04:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.517 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.517 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:04:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:04:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:04:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:04:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:04:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:04:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:04:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:04:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:04:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:04:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:04:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:04:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:04:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:04:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:04:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:04:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:04:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:04:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:04:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:04:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:04:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:04:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:04:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:04:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:04:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:04:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:04:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:04:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:04:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:04:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:04:50.538 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:04:50.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 msgr2=0x7f96840559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 0x7f96840559b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f968800b000 tx=0x7f9688009040).stop 2021-10-21T00:04:50.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 msgr2=0x7f96a0137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f969800c000 tx=0x7f9698009250).stop 2021-10-21T00:04:50.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 shutdown_connections 2021-10-21T00:04:50.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96840534f0 0x7f96840559b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96a00b3370 0x7f96a01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a00b0730 0x7f96a0136b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 --2- 172.21.15.41:0/4027171169 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a005f9f0 0x7f96a0137e50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 >> 172.21.15.41:0/4027171169 conn(0x7f96a00637b0 msgr2=0x7f96a013f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 shutdown_connections 2021-10-21T00:04:50.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.487+0000 7f96a5a2a700 1 -- 172.21.15.41:0/4027171169 wait complete. 2021-10-21T00:04:50.547 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:04:50.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.647+0000 7fc77a919700 1 Processor -- start 2021-10-21T00:04:50.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.647+0000 7fc77a919700 1 -- start start 2021-10-21T00:04:50.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7740b9c70 0x7fc774143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 0x7fc774141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc774142bc0 con 0x7fc7740b3bc0 2021-10-21T00:04:50.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7741429a0 con 0x7fc7740b9c70 2021-10-21T00:04:50.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740ba050 con 0x7fc7741418f0 2021-10-21T00:04:50.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7740b9c70 0x7fc774143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7740b9c70 0x7fc774143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43308/0 (socket says 172.21.15.41:43308) 2021-10-21T00:04:50.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 -- 172.21.15.41:0/2216174907 learned_addr learned my addr 172.21.15.41:0/2216174907 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:50.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc778eb6700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 0x7fc774141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 -- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 msgr2=0x7fc774141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:50.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 0x7fc774141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 -- 172.21.15.41:0/2216174907 >> v1:172.21.15.62:6789/0 conn(0x7fc7740b3bc0 legacy=0x7fc774143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 -- 172.21.15.41:0/2216174907 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7741463c0 con 0x7fc7740b9c70 2021-10-21T00:04:50.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc778eb6700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 0x7fc774141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:50.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc773fff700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7740b9c70 0x7fc774143020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc7640032f0 tx=0x7fc764009290).ready entity=mon.1 client_cookie=5a18f8b4d27e69b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc772ffd700 1 -- 172.21.15.41:0/2216174907 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc76400b8a0 con 0x7fc7740b9c70 2021-10-21T00:04:50.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc772ffd700 1 -- 172.21.15.41:0/2216174907 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400ba00 con 0x7fc7740b9c70 2021-10-21T00:04:50.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc772ffd700 1 -- 172.21.15.41:0/2216174907 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc76400bb70 con 0x7fc7740b9c70 2021-10-21T00:04:50.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7740b9c70 msgr2=0x7fc774143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7740b9c70 0x7fc774143020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc7640032f0 tx=0x7fc764009290).stop 2021-10-21T00:04:50.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- 172.21.15.41:0/2216174907 shutdown_connections 2021-10-21T00:04:50.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7741418f0 0x7fc774141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 --2- 172.21.15.41:0/2216174907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7740b9c70 0x7fc774143020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- 172.21.15.41:0/2216174907 >> 172.21.15.41:0/2216174907 conn(0x7fc774062e80 msgr2=0x7fc7740b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- 172.21.15.41:0/2216174907 shutdown_connections 2021-10-21T00:04:50.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- 172.21.15.41:0/2216174907 wait complete. 2021-10-21T00:04:50.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 Processor -- start 2021-10-21T00:04:50.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.651+0000 7fc77a919700 1 -- start start 2021-10-21T00:04:50.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7740b3bc0 0x7fc774112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 0x7fc7741554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774113b80 con 0x7fc7740b9c70 2021-10-21T00:04:50.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774115d30 con 0x7fc7741418f0 2021-10-21T00:04:50.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc774115a90 con 0x7fc7740b3bc0 2021-10-21T00:04:50.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59630/0 (socket says 172.21.15.41:59630) 2021-10-21T00:04:50.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 -- 172.21.15.41:0/714305155 learned_addr learned my addr 172.21.15.41:0/714305155 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:50.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc778eb6700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 0x7fc7741554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc773fff700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7740b3bc0 0x7fc774112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 -- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7740b3bc0 msgr2=0x7fc774112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7740b3bc0 0x7fc774112dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 -- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 msgr2=0x7fc7741554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 0x7fc7741554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 -- 172.21.15.41:0/714305155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c00b180 con 0x7fc7740b9c70 2021-10-21T00:04:50.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc778eb6700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 0x7fc7741554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:50.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7737fe700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fc774060220 tx=0x7fc75c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75c007030 con 0x7fc7740b9c70 2021-10-21T00:04:50.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c007190 con 0x7fc7740b9c70 2021-10-21T00:04:50.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc764009530 con 0x7fc7740b9c70 2021-10-21T00:04:50.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75c006510 con 0x7fc7740b9c70 2021-10-21T00:04:50.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7741137b0 con 0x7fc7740b9c70 2021-10-21T00:04:50.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.655+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774146120 con 0x7fc7740b9c70 2021-10-21T00:04:50.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.659+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc75c010030 con 0x7fc7740b9c70 2021-10-21T00:04:50.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.659+0000 7fc7717fa700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 0x7fc7580559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.659+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc75c06b1e0 con 0x7fc7740b9c70 2021-10-21T00:04:50.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.659+0000 7fc773fff700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 0x7fc7580559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.659+0000 7fc773fff700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 0x7fc7580559e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fc76401b000 tx=0x7fc764016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.663+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc75c0425d0 con 0x7fc7740b9c70 2021-10-21T00:04:50.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.795+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc774057350 con 0x7fc7740b9c70 2021-10-21T00:04:50.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc7717fa700 1 -- 172.21.15.41:0/714305155 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13181 (secure 0 0 0) 0x7fc75c045bf0 con 0x7fc7740b9c70 2021-10-21T00:04:50.807 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:50.808 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":36,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:50.120839+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:04:50.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 msgr2=0x7fc7580559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 0x7fc7580559e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fc76401b000 tx=0x7fc764016000).stop 2021-10-21T00:04:50.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 msgr2=0x7fc7741132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fc774060220 tx=0x7fc75c007c10).stop 2021-10-21T00:04:50.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 shutdown_connections 2021-10-21T00:04:50.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc758053520 0x7fc7580559e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7741418f0 0x7fc7741554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7740b9c70 0x7fc7741132c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 --2- 172.21.15.41:0/714305155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7740b3bc0 0x7fc774112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 >> 172.21.15.41:0/714305155 conn(0x7fc774062e80 msgr2=0x7fc774140280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 shutdown_connections 2021-10-21T00:04:50.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.799+0000 7fc77a919700 1 -- 172.21.15.41:0/714305155 wait complete. 2021-10-21T00:04:50.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:04:50.821 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:04:50.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.915+0000 7f96a8de8700 1 Processor -- start 2021-10-21T00:04:50.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.915+0000 7f96a8de8700 1 -- start start 2021-10-21T00:04:50.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96a40b2170 0x7f96a40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a40b0b50 con 0x7f96a40af620 2021-10-21T00:04:50.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a40b2550 con 0x7f96a4067a80 2021-10-21T00:04:50.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40b0d90 con 0x7f96a40b2170 2021-10-21T00:04:50.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a2ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f96a40af620 0x7f96a40ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57406/0 (socket says 172.21.15.41:57406) 2021-10-21T00:04:50.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a2ffd700 1 -- 172.21.15.41:0/3668500 learned_addr learned my addr 172.21.15.41:0/3668500 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:50.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 --2- 172.21.15.41:0/3668500 >> v2:172.21.15.62:3300/0 conn(0x7f96a40b2170 0x7f96a40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385166349 0 0) 0x7f9694001110 con 0x7f96a40af620 2021-10-21T00:04:50.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9690003260 con 0x7f96a40af620 2021-10-21T00:04:50.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1840352419 0 0) 0x7f9690003260 con 0x7f96a40af620 2021-10-21T00:04:50.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 >> v2:172.21.15.62:3300/0 conn(0x7f96a40b2170 msgr2=0x7f96a40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:50.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 --2- 172.21.15.41:0/3668500 >> v2:172.21.15.62:3300/0 conn(0x7f96a40b2170 0x7f96a40ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 >> v1:172.21.15.62:6789/0 conn(0x7f96a4067a80 legacy=0x7f96a4149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40b1030 con 0x7f96a40af620 2021-10-21T00:04:50.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f96940017f0 con 0x7f96a40af620 2021-10-21T00:04:50.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 >> v1:172.21.15.41:6789/0 conn(0x7f96a40af620 legacy=0x7f96a40ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 0x7f9690003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690004500 0x7f9690004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9690004ec0 0x7f969000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b0d90 con 0x7f9690003750 2021-10-21T00:04:50.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969000bda0 con 0x7f9690004500 2021-10-21T00:04:50.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969000bf60 con 0x7f9690004ec0 2021-10-21T00:04:50.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 0x7f9690003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a2ffd700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690004500 0x7f9690004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a3fff700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9690004ec0 0x7f969000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 -- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9690004ec0 msgr2=0x7f969000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:50.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9690004ec0 0x7f969000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 -- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690004500 msgr2=0x7f9690004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:50.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690004500 0x7f9690004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a3fff700 1 -- 172.21.15.41:0/3668500 reap_dead start 2021-10-21T00:04:50.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 -- 172.21.15.41:0/3668500 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690003260 con 0x7f9690003750 2021-10-21T00:04:50.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a37fe700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 0x7f9690003b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f969800a000 tx=0x7f9698008040).ready entity=mon.0 client_cookie=c47872afed844f3f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9698013670 con 0x7f9690003750 2021-10-21T00:04:50.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980137d0 con 0x7f9690003750 2021-10-21T00:04:50.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a27fc700 1 -- 172.21.15.41:0/3668500 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9698013b30 con 0x7f9690003750 2021-10-21T00:04:50.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 msgr2=0x7f9690003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 0x7f9690003b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f969800a000 tx=0x7f9698008040).stop 2021-10-21T00:04:50.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- 172.21.15.41:0/3668500 shutdown_connections 2021-10-21T00:04:50.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 --2- 172.21.15.41:0/3668500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9690003750 0x7f9690003b70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.919+0000 7f96a8de8700 1 -- 172.21.15.41:0/3668500 >> 172.21.15.41:0/3668500 conn(0x7f96a40b5700 msgr2=0x7f96a40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:50.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- 172.21.15.41:0/3668500 shutdown_connections 2021-10-21T00:04:50.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- 172.21.15.41:0/3668500 wait complete. 2021-10-21T00:04:50.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 Processor -- start 2021-10-21T00:04:50.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- start start 2021-10-21T00:04:50.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690003750 0x7f96a4099330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a4148be0 0x7f96a4147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4099ef0 con 0x7f96a40ae080 2021-10-21T00:04:50.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40ae9f0 con 0x7f9690003750 2021-10-21T00:04:50.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4147c50 con 0x7f96a4148be0 2021-10-21T00:04:50.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59652/0 (socket says 172.21.15.41:59652) 2021-10-21T00:04:50.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 -- 172.21.15.41:0/607252917 learned_addr learned my addr 172.21.15.41:0/607252917 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:50.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a37fe700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690003750 0x7f96a4099330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a2ffd700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a4148be0 0x7f96a4147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 -- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a4148be0 msgr2=0x7f96a4147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a4148be0 0x7f96a4147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 -- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690003750 msgr2=0x7f96a4099330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:50.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690003750 0x7f96a4099330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:50.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 -- 172.21.15.41:0/607252917 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a41484a0 con 0x7f96a40ae080 2021-10-21T00:04:50.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a3fff700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f969c001210 tx=0x7f969c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c003030 con 0x7f96a40ae080 2021-10-21T00:04:50.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c003190 con 0x7f96a40ae080 2021-10-21T00:04:50.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a4148740 con 0x7f96a40ae080 2021-10-21T00:04:50.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.923+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c001580 con 0x7f96a40ae080 2021-10-21T00:04:50.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a40acad0 con 0x7f96a40ae080 2021-10-21T00:04:50.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a40acc60 con 0x7f96a40ae080 2021-10-21T00:04:50.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f969c01c060 con 0x7f96a40ae080 2021-10-21T00:04:50.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a0ff9700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 0x7f9684055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:50.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f969c06b000 con 0x7f96a40ae080 2021-10-21T00:04:50.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a37fe700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 0x7f9684055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:50.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.927+0000 7f96a37fe700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 0x7f9684055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f969801b000 tx=0x7f9698008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:50.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:50.931+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f969c042490 con 0x7f96a40ae080 2021-10-21T00:04:51.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.059+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f96a41488d0 con 0x7f96a40ae080 2021-10-21T00:04:51.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.059+0000 7f96a0ff9700 1 -- 172.21.15.41:0/607252917 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f969c01a070 con 0x7f96a40ae080 2021-10-21T00:04:51.067 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:04:51.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.059+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 msgr2=0x7f9684055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 0x7f9684055ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f969801b000 tx=0x7f9698008040).stop 2021-10-21T00:04:51.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 msgr2=0x7f96a40ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f969c001210 tx=0x7f969c009040).stop 2021-10-21T00:04:51.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 shutdown_connections 2021-10-21T00:04:51.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9684053610 0x7f9684055ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96a40ae080 0x7f96a40ae500 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96a4148be0 0x7f96a4147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 --2- 172.21.15.41:0/607252917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9690003750 0x7f96a4099330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 >> 172.21.15.41:0/607252917 conn(0x7f96a40b5700 msgr2=0x7f96a41492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 shutdown_connections 2021-10-21T00:04:51.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.063+0000 7f96a8de8700 1 -- 172.21.15.41:0/607252917 wait complete. 2021-10-21T00:04:51.080 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:04:51.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 Processor -- start 2021-10-21T00:04:51.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 -- start start 2021-10-21T00:04:51.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a740b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a740b0290 0x7f5a74142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a740ac610 con 0x7f5a74142ef0 2021-10-21T00:04:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740b6510 con 0x7f5a740b0290 2021-10-21T00:04:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7c178700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740ace50 con 0x7f5a740b6130 2021-10-21T00:04:51.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7a715700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5a74142ef0 0x7f5a741416b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57428/0 (socket says 172.21.15.41:57428) 2021-10-21T00:04:51.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a7a715700 1 -- 172.21.15.41:0/1443178714 learned_addr learned my addr 172.21.15.41:0/1443178714 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79f14700 1 --2- 172.21.15.41:0/1443178714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a740b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79713700 1 --2- 172.21.15.41:0/1443178714 >> v2:172.21.15.62:3300/0 conn(0x7f5a740b0290 0x7f5a74142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a78f12700 1 -- 172.21.15.41:0/1443178714 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862669897 0 0) 0x7f5a740ac610 con 0x7f5a74142ef0 2021-10-21T00:04:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a78f12700 1 -- 172.21.15.41:0/1443178714 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c003260 con 0x7f5a74142ef0 2021-10-21T00:04:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79f14700 1 -- 172.21.15.41:0/1443178714 >> v2:172.21.15.62:3300/0 conn(0x7f5a740b0290 msgr2=0x7f5a74142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79f14700 1 --2- 172.21.15.41:0/1443178714 >> v2:172.21.15.62:3300/0 conn(0x7f5a740b0290 0x7f5a74142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79f14700 1 -- 172.21.15.41:0/1443178714 >> v1:172.21.15.41:6789/0 conn(0x7f5a74142ef0 legacy=0x7f5a741416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.179+0000 7f5a79f14700 1 -- 172.21.15.41:0/1443178714 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740ad0f0 con 0x7f5a740b6130 2021-10-21T00:04:51.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a79f14700 1 --2- 172.21.15.41:0/1443178714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a740b1460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5a70002f70 tx=0x7f5a70006df0).ready entity=mon.2 client_cookie=70fc14f7a79a722e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a78f12700 1 -- 172.21.15.41:0/1443178714 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7000d4a0 con 0x7f5a740b6130 2021-10-21T00:04:51.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a78f12700 1 -- 172.21.15.41:0/1443178714 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70000e90 con 0x7f5a740b6130 2021-10-21T00:04:51.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a78f12700 1 -- 172.21.15.41:0/1443178714 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7000d7f0 con 0x7f5a740b6130 2021-10-21T00:04:51.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- 172.21.15.41:0/1443178714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 msgr2=0x7f5a740b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 --2- 172.21.15.41:0/1443178714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a740b1460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5a70002f70 tx=0x7f5a70006df0).stop 2021-10-21T00:04:51.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- 172.21.15.41:0/1443178714 shutdown_connections 2021-10-21T00:04:51.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 --2- 172.21.15.41:0/1443178714 >> v2:172.21.15.62:3300/0 conn(0x7f5a740b0290 0x7f5a74142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 --2- 172.21.15.41:0/1443178714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a740b1460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- 172.21.15.41:0/1443178714 >> 172.21.15.41:0/1443178714 conn(0x7f5a74063b40 msgr2=0x7f5a740b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- 172.21.15.41:0/1443178714 shutdown_connections 2021-10-21T00:04:51.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- 172.21.15.41:0/1443178714 wait complete. 2021-10-21T00:04:51.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 Processor -- start 2021-10-21T00:04:51.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.183+0000 7f5a7c178700 1 -- start start 2021-10-21T00:04:51.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a74141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a74142ef0 0x7f5a7413df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7409dfb0 con 0x7f5a740b0290 2021-10-21T00:04:51.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7409e250 con 0x7f5a74142ef0 2021-10-21T00:04:51.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7409e6f0 con 0x7f5a740b6130 2021-10-21T00:04:51.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59662/0 (socket says 172.21.15.41:59662) 2021-10-21T00:04:51.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 -- 172.21.15.41:0/3957605942 learned_addr learned my addr 172.21.15.41:0/3957605942 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:51.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7a715700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a74142ef0 0x7f5a7413df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79713700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a74141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 -- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 msgr2=0x7f5a74141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a74141440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 -- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a74142ef0 msgr2=0x7f5a7413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a74142ef0 0x7f5a7413df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 -- 172.21.15.41:0/3957605942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7000b180 con 0x7f5a740b0290 2021-10-21T00:04:51.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a79f14700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f5a70002f70 tx=0x7f5a70014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a70012930 con 0x7f5a740b0290 2021-10-21T00:04:51.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70012a90 con 0x7f5a740b0290 2021-10-21T00:04:51.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a70012df0 con 0x7f5a740b0290 2021-10-21T00:04:51.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a740658b0 con 0x7f5a740b0290 2021-10-21T00:04:51.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.187+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7413e410 con 0x7f5a740b0290 2021-10-21T00:04:51.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a740ad390 con 0x7f5a740b0290 2021-10-21T00:04:51.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a7001c070 con 0x7f5a740b0290 2021-10-21T00:04:51.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a62ffd700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 0x7f5a540559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a7006c2a0 con 0x7f5a740b0290 2021-10-21T00:04:51.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a79713700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 0x7f5a540559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.191+0000 7f5a79713700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 0x7f5a540559b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5a64008000 tx=0x7f5a64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.199+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a70043650 con 0x7f5a740b0290 2021-10-21T00:04:51.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a74057350 con 0x7f5a740b0290 2021-10-21T00:04:51.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a62ffd700 1 -- 172.21.15.41:0/3957605942 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a70019020 con 0x7f5a740b0290 2021-10-21T00:04:51.339 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:04:51.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 msgr2=0x7f5a540559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 0x7f5a540559b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f5a64008000 tx=0x7f5a64008040).stop 2021-10-21T00:04:51.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 msgr2=0x7f5a74066c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f5a70002f70 tx=0x7f5a70014000).stop 2021-10-21T00:04:51.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 shutdown_connections 2021-10-21T00:04:51.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a540534f0 0x7f5a540559b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a74142ef0 0x7f5a7413df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a740b6130 0x7f5a74141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 --2- 172.21.15.41:0/3957605942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a740b0290 0x7f5a74066c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 >> 172.21.15.41:0/3957605942 conn(0x7f5a74063b40 msgr2=0x7f5a740ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 shutdown_connections 2021-10-21T00:04:51.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.331+0000 7f5a7c178700 1 -- 172.21.15.41:0/3957605942 wait complete. 2021-10-21T00:04:51.352 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:04:51.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 Processor -- start 2021-10-21T00:04:51.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- start start 2021-10-21T00:04:51.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 0x7f50a414da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a4142bc0 con 0x7f50a40b9c70 2021-10-21T00:04:51.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40ba050 con 0x7f50a40b3bc0 2021-10-21T00:04:51.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a41429a0 con 0x7f50a414b620 2021-10-21T00:04:51.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f50a40b9c70 0x7f50a4143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57440/0 (socket says 172.21.15.41:57440) 2021-10-21T00:04:51.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a37fe700 1 -- 172.21.15.41:0/345066804 learned_addr learned my addr 172.21.15.41:0/345066804 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:51.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a3fff700 1 --2- 172.21.15.41:0/345066804 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 0x7f50a414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025274734 0 0) 0x7f50a4142bc0 con 0x7f50a40b9c70 2021-10-21T00:04:51.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5088003260 con 0x7f50a40b9c70 2021-10-21T00:04:51.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835609002 0 0) 0x7f50a40ba050 con 0x7f50a40b3bc0 2021-10-21T00:04:51.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a4142bc0 con 0x7f50a40b3bc0 2021-10-21T00:04:51.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a3fff700 1 -- 172.21.15.41:0/345066804 >> v1:172.21.15.62:6789/0 conn(0x7f50a40b3bc0 legacy=0x7f50a4143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a3fff700 1 -- 172.21.15.41:0/345066804 >> v1:172.21.15.41:6789/0 conn(0x7f50a40b9c70 legacy=0x7f50a4143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3763457286 0 0) 0x7f5088003260 con 0x7f50a40b9c70 2021-10-21T00:04:51.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a3fff700 1 -- 172.21.15.41:0/345066804 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a41463c0 con 0x7f50a414b620 2021-10-21T00:04:51.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a3fff700 1 --2- 172.21.15.41:0/345066804 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 0x7f50a414da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f508c001820 tx=0x7f5094006df0).ready entity=mon.2 client_cookie=d21180222da3d7cb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508c001680 con 0x7f50a414b620 2021-10-21T00:04:51.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094000e90 con 0x7f50a414b620 2021-10-21T00:04:51.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a27fc700 1 -- 172.21.15.41:0/345066804 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5094012460 con 0x7f50a414b620 2021-10-21T00:04:51.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- 172.21.15.41:0/345066804 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 msgr2=0x7f50a414da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 --2- 172.21.15.41:0/345066804 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 0x7f50a414da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f508c001820 tx=0x7f5094006df0).stop 2021-10-21T00:04:51.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- 172.21.15.41:0/345066804 shutdown_connections 2021-10-21T00:04:51.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 --2- 172.21.15.41:0/345066804 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a414b620 0x7f50a414da10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- 172.21.15.41:0/345066804 >> 172.21.15.41:0/345066804 conn(0x7f50a4062e80 msgr2=0x7f50a40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- 172.21.15.41:0/345066804 shutdown_connections 2021-10-21T00:04:51.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.455+0000 7f50a9c76700 1 -- 172.21.15.41:0/345066804 wait complete. 2021-10-21T00:04:51.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 Processor -- start 2021-10-21T00:04:51.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- start start 2021-10-21T00:04:51.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a40b3bc0 0x7f50a4140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 0x7f50a413b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a41456e0 con 0x7f50a414b620 2021-10-21T00:04:51.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4144b40 con 0x7f50a40b9c70 2021-10-21T00:04:51.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4145910 con 0x7f50a40b3bc0 2021-10-21T00:04:51.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59680/0 (socket says 172.21.15.41:59680) 2021-10-21T00:04:51.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 -- 172.21.15.41:0/2322714984 learned_addr learned my addr 172.21.15.41:0/2322714984 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:51.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a37fe700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a40b3bc0 0x7f50a4140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a2ffd700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 0x7f50a413b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 -- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a40b3bc0 msgr2=0x7f50a4140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a40b3bc0 0x7f50a4140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 -- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 msgr2=0x7f50a413b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 0x7f50a413b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 -- 172.21.15.41:0/2322714984 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509400b180 con 0x7f50a414b620 2021-10-21T00:04:51.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a2ffd700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 0x7f50a413b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:04:51.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a3fff700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f508c001820 tx=0x7f5094014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5094016070 con 0x7f50a414b620 2021-10-21T00:04:51.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094002f50 con 0x7f50a414b620 2021-10-21T00:04:51.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a4145db0 con 0x7f50a414b620 2021-10-21T00:04:51.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5094012460 con 0x7f50a414b620 2021-10-21T00:04:51.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.459+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a413be30 con 0x7f50a414b620 2021-10-21T00:04:51.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a41449a0 con 0x7f50a414b620 2021-10-21T00:04:51.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5094025030 con 0x7f50a414b620 2021-10-21T00:04:51.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a0ff9700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 0x7f507c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f509406c510 con 0x7f50a414b620 2021-10-21T00:04:51.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a37fe700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 0x7f507c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.463+0000 7f50a37fe700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 0x7f507c055ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f508c00b000 tx=0x7f508c0011c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.471+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50a41449a0 con 0x7f50a414b620 2021-10-21T00:04:51.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.591+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50a41449a0 con 0x7f50a414b620 2021-10-21T00:04:51.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a0ff9700 1 -- 172.21.15.41:0/2322714984 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+143 (secure 0 0 0) 0x7f50a41449a0 con 0x7f50a414b620 2021-10-21T00:04:51.601 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:51.601 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:04:51.601 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:51.601 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:04:51.602 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:04:51.602 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:04:51.602 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:04:51.602 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:04:51.603 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:04:51.603 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:04:51.603 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:04:51.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 msgr2=0x7f507c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 0x7f507c055ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f508c00b000 tx=0x7f508c0011c0).stop 2021-10-21T00:04:51.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 msgr2=0x7f50a413b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f508c001820 tx=0x7f5094014000).stop 2021-10-21T00:04:51.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 shutdown_connections 2021-10-21T00:04:51.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f507c053610 0x7f507c055ad0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50a414b620 0x7f50a413b940 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50a40b9c70 0x7f50a413b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 --2- 172.21.15.41:0/2322714984 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50a40b3bc0 0x7f50a4140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 >> 172.21.15.41:0/2322714984 conn(0x7f50a4062e80 msgr2=0x7f50a4146590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 shutdown_connections 2021-10-21T00:04:51.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.595+0000 7f50a9c76700 1 -- 172.21.15.41:0/2322714984 wait complete. 2021-10-21T00:04:51.614 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:04:51.614 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:04:51.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 Processor -- start 2021-10-21T00:04:51.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 -- start start 2021-10-21T00:04:51.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f90c40aede0 0x7f90c4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40b23b0 0x7f90c413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c41419a0 con 0x7f90c405c810 2021-10-21T00:04:51.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40af1c0 con 0x7f90c40aede0 2021-10-21T00:04:51.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c893d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4064e80 con 0x7f90c40b23b0 2021-10-21T00:04:51.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.719+0000 7f90c37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f90c40aede0 0x7f90c4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f90c405c810 0x7f90c40b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37278/0 (socket says 172.21.15.41:37278) 2021-10-21T00:04:51.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c2ffd700 1 -- 172.21.15.41:0/563306253 learned_addr learned my addr 172.21.15.41:0/563306253 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:51.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c3fff700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40b23b0 0x7f90c413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c27fc700 1 -- 172.21.15.41:0/563306253 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273325148 0 0) 0x7f90c41419a0 con 0x7f90c405c810 2021-10-21T00:04:51.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c27fc700 1 -- 172.21.15.41:0/563306253 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a4003260 con 0x7f90c405c810 2021-10-21T00:04:51.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c37fe700 1 -- 172.21.15.41:0/563306253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40b23b0 msgr2=0x7f90c413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:51.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c37fe700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40b23b0 0x7f90c413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c37fe700 1 -- 172.21.15.41:0/563306253 >> v1:172.21.15.62:6789/0 conn(0x7f90c405c810 legacy=0x7f90c40b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c37fe700 1 -- 172.21.15.41:0/563306253 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4065120 con 0x7f90c40aede0 2021-10-21T00:04:51.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c37fe700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c40aede0 0x7f90c4143d30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f90b4002f70 tx=0x7f90b4006df0).ready entity=mon.0 client_cookie=e29a72b4895b4040 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c27fc700 1 -- 172.21.15.41:0/563306253 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b400d4a0 con 0x7f90c40aede0 2021-10-21T00:04:51.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c27fc700 1 -- 172.21.15.41:0/563306253 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4000e90 con 0x7f90c40aede0 2021-10-21T00:04:51.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c27fc700 1 -- 172.21.15.41:0/563306253 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b400d7f0 con 0x7f90c40aede0 2021-10-21T00:04:51.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- 172.21.15.41:0/563306253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c40aede0 msgr2=0x7f90c4143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c40aede0 0x7f90c4143d30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f90b4002f70 tx=0x7f90b4006df0).stop 2021-10-21T00:04:51.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- 172.21.15.41:0/563306253 shutdown_connections 2021-10-21T00:04:51.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40b23b0 0x7f90c413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 --2- 172.21.15.41:0/563306253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c40aede0 0x7f90c4143d30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- 172.21.15.41:0/563306253 >> 172.21.15.41:0/563306253 conn(0x7f90c40627b0 msgr2=0x7f90c4062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:51.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- 172.21.15.41:0/563306253 shutdown_connections 2021-10-21T00:04:51.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- 172.21.15.41:0/563306253 wait complete. 2021-10-21T00:04:51.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 Processor -- start 2021-10-21T00:04:51.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.723+0000 7f90c893d700 1 -- start start 2021-10-21T00:04:51.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 0x7f90c4143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 0x7f90c414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c410fc30 con 0x7f90c405c810 2021-10-21T00:04:51.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c410fed0 con 0x7f90c40b23b0 2021-10-21T00:04:51.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4144660 con 0x7f90c40aede0 2021-10-21T00:04:51.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59690/0 (socket says 172.21.15.41:59690) 2021-10-21T00:04:51.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 -- 172.21.15.41:0/2655339236 learned_addr learned my addr 172.21.15.41:0/2655339236 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:51.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c3fff700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 0x7f90c414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c2ffd700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 0x7f90c4143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 -- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 msgr2=0x7f90c4143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 0x7f90c4143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 -- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 msgr2=0x7f90c414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:51.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 0x7f90c414f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:51.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 -- 172.21.15.41:0/2655339236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b400b180 con 0x7f90c405c810 2021-10-21T00:04:51.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c3fff700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 0x7f90c414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:04:51.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c2ffd700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 0x7f90c4143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:04:51.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c37fe700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f90b4002f70 tx=0x7f90b4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b4013ac0 con 0x7f90c405c810 2021-10-21T00:04:51.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4013c20 con 0x7f90c405c810 2021-10-21T00:04:51.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c4142b60 con 0x7f90c405c810 2021-10-21T00:04:51.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b401e400 con 0x7f90c405c810 2021-10-21T00:04:51.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c4142200 con 0x7f90c405c810 2021-10-21T00:04:51.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c41438d0 con 0x7f90c405c810 2021-10-21T00:04:51.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.727+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f90b4025030 con 0x7f90c405c810 2021-10-21T00:04:51.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.731+0000 7f90c0ff9700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 0x7f90a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:51.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.731+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f90b406c420 con 0x7f90c405c810 2021-10-21T00:04:51.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.731+0000 7f90c2ffd700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 0x7f90a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:51.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.731+0000 7f90c2ffd700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 0x7f90a8055ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f90ac008000 tx=0x7f90ac009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:51.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.735+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90c41438d0 con 0x7f90c405c810 2021-10-21T00:04:51.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:51.859+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f90c41438d0 con 0x7f90c405c810 2021-10-21T00:04:52.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.755+0000 7f90c0ff9700 1 -- 172.21.15.41:0/2655339236 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v37) v1 ==== 133+0+0 (secure 0 0 0) 0x7f90c41438d0 con 0x7f90c405c810 2021-10-21T00:04:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 msgr2=0x7f90a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 0x7f90a8055ad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f90ac008000 tx=0x7f90ac009040).stop 2021-10-21T00:04:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 msgr2=0x7f90c4142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f90b4002f70 tx=0x7f90b4014000).stop 2021-10-21T00:04:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 shutdown_connections 2021-10-21T00:04:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90a8053610 0x7f90a8055ad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c40b23b0 0x7f90c414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c40aede0 0x7f90c4143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 --2- 172.21.15.41:0/2655339236 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90c405c810 0x7f90c4142670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 >> 172.21.15.41:0/2655339236 conn(0x7f90c40627b0 msgr2=0x7f90c40b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 shutdown_connections 2021-10-21T00:04:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.759+0000 7f90c893d700 1 -- 172.21.15.41:0/2655339236 wait complete. 2021-10-21T00:04:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:04:52.780 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:04:52.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 Processor -- start 2021-10-21T00:04:52.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 -- start start 2021-10-21T00:04:52.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda04062330 0x7fda040b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda0413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0405bd40 con 0x7fda04062f70 2021-10-21T00:04:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0405bf70 con 0x7fda04062330 2021-10-21T00:04:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda09565700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda04142cb0 con 0x7fda040b3a20 2021-10-21T00:04:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda04062330 0x7fda040b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda04062330 0x7fda040b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59698/0 (socket says 172.21.15.41:59698) 2021-10-21T00:04:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 -- 172.21.15.41:0/2397163925 learned_addr learned my addr 172.21.15.41:0/2397163925 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda08d64700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda0413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 -- 172.21.15.41:0/2397163925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 msgr2=0x7fda0413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda0413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 -- 172.21.15.41:0/2397163925 >> v1:172.21.15.62:6789/0 conn(0x7fda04062f70 legacy=0x7fda0405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 -- 172.21.15.41:0/2397163925 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04142950 con 0x7fda04062330 2021-10-21T00:04:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda03fff700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda040b3f30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd9f4002f70 tx=0x7fd9f4006eb0).ready entity=mon.0 client_cookie=44e8e9209aa0522d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda02ffd700 1 -- 172.21.15.41:0/2397163925 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f400d570 con 0x7fda04062330 2021-10-21T00:04:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda02ffd700 1 -- 172.21.15.41:0/2397163925 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4000e90 con 0x7fda04062330 2021-10-21T00:04:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.883+0000 7fda02ffd700 1 -- 172.21.15.41:0/2397163925 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f400d900 con 0x7fda04062330 2021-10-21T00:04:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2397163925 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 msgr2=0x7fda040b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda040b3f30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd9f4002f70 tx=0x7fd9f4006eb0).stop 2021-10-21T00:04:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2397163925 shutdown_connections 2021-10-21T00:04:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda0413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- 172.21.15.41:0/2397163925 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda040b3f30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2397163925 >> 172.21.15.41:0/2397163925 conn(0x7fda040b9080 msgr2=0x7fda040b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2397163925 shutdown_connections 2021-10-21T00:04:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2397163925 wait complete. 2021-10-21T00:04:52.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 Processor -- start 2021-10-21T00:04:52.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- start start 2021-10-21T00:04:52.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda04062f70 0x7fda04146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda04145730 con 0x7fda04062330 2021-10-21T00:04:52.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda041459d0 con 0x7fda04062f70 2021-10-21T00:04:52.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda04145c70 con 0x7fda040b3a20 2021-10-21T00:04:52.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda03fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda03fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59708/0 (socket says 172.21.15.41:59708) 2021-10-21T00:04:52.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:49970/0 (socket says 172.21.15.41:49970) 2021-10-21T00:04:52.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 -- 172.21.15.41:0/2990853790 learned_addr learned my addr 172.21.15.41:0/2990853790 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:52.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda04062f70 0x7fda04146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 -- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda04062f70 msgr2=0x7fda04146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda04062f70 0x7fda04146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 -- 172.21.15.41:0/2990853790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 msgr2=0x7fda04151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:52.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:52.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 -- 172.21.15.41:0/2990853790 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f400b1e0 con 0x7fda040b3a20 2021-10-21T00:04:52.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda03fff700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:52.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda08d64700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd9fc00c000 tx=0x7fd9fc0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:52.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc012600 con 0x7fda040b3a20 2021-10-21T00:04:52.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc012760 con 0x7fda040b3a20 2021-10-21T00:04:52.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda041453b0 con 0x7fda040b3a20 2021-10-21T00:04:52.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9fc012ac0 con 0x7fda040b3a20 2021-10-21T00:04:52.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.887+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda040ae650 con 0x7fda040b3a20 2021-10-21T00:04:52.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda04145e70 con 0x7fda040b3a20 2021-10-21T00:04:52.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd9fc012c20 con 0x7fda040b3a20 2021-10-21T00:04:52.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda017fa700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 0x7fd9e4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:52.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd9fc06ba90 con 0x7fda040b3a20 2021-10-21T00:04:52.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda03fff700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 0x7fd9e4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:52.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.891+0000 7fda03fff700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 0x7fd9e4055ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd9f401c000 tx=0x7fd9f4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:52.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:52.899+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda04145e70 con 0x7fda040b3a20 2021-10-21T00:04:53.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.031+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fda041455a0 con 0x7fda040b3a20 2021-10-21T00:04:53.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.183+0000 7fda017fa700 1 -- 172.21.15.41:0/2990853790 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v38) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd9fc042c30 con 0x7fda040b3a20 2021-10-21T00:04:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 msgr2=0x7fd9e4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 0x7fd9e4055ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd9f401c000 tx=0x7fd9f4015000).stop 2021-10-21T00:04:53.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 msgr2=0x7fda040adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd9fc00c000 tx=0x7fd9fc0091d0).stop 2021-10-21T00:04:53.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 shutdown_connections 2021-10-21T00:04:53.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9e4053610 0x7fd9e4055ad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda040b3a20 0x7fda040adf40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda04062f70 0x7fda04146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 --2- 172.21.15.41:0/2990853790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda04062330 0x7fda04151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 >> 172.21.15.41:0/2990853790 conn(0x7fda040b9080 msgr2=0x7fda0405c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 shutdown_connections 2021-10-21T00:04:53.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.187+0000 7fda09565700 1 -- 172.21.15.41:0/2990853790 wait complete. 2021-10-21T00:04:53.198 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:04:53.207 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:04:53.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.307+0000 7fb7795ac700 1 Processor -- start 2021-10-21T00:04:53.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.307+0000 7fb7795ac700 1 -- start start 2021-10-21T00:04:53.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 0x7fb774144410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb7740af0c0 0x7fb7740afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740b6350 con 0x7fb7740b5f70 2021-10-21T00:04:53.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77413e210 con 0x7fb7740af0c0 2021-10-21T00:04:53.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77405c6b0 con 0x7fb7740aebb0 2021-10-21T00:04:53.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb7740af0c0 0x7fb7740afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb7740af0c0 0x7fb7740afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59716/0 (socket says 172.21.15.41:59716) 2021-10-21T00:04:53.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 -- 172.21.15.41:0/1134402434 learned_addr learned my addr 172.21.15.41:0/1134402434 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:53.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7737fe700 1 --2- 172.21.15.41:0/1134402434 >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 0x7fb774144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 -- 172.21.15.41:0/1134402434 >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 msgr2=0x7fb774144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:53.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 --2- 172.21.15.41:0/1134402434 >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 0x7fb774144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 -- 172.21.15.41:0/1134402434 >> v1:172.21.15.62:6789/0 conn(0x7fb7740b5f70 legacy=0x7fb774143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 -- 172.21.15.41:0/1134402434 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77405c950 con 0x7fb7740af0c0 2021-10-21T00:04:53.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7737fe700 1 --2- 172.21.15.41:0/1134402434 >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 0x7fb774144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:53.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb778dab700 1 --2- 172.21.15.41:0/1134402434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740af0c0 0x7fb7740afec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fb764001110 tx=0x7fb76c009290).ready entity=mon.0 client_cookie=3c039dfe32e5a7ed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb772ffd700 1 -- 172.21.15.41:0/1134402434 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00b730 con 0x7fb7740af0c0 2021-10-21T00:04:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb772ffd700 1 -- 172.21.15.41:0/1134402434 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00b890 con 0x7fb7740af0c0 2021-10-21T00:04:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb772ffd700 1 -- 172.21.15.41:0/1134402434 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00ba00 con 0x7fb7740af0c0 2021-10-21T00:04:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- 172.21.15.41:0/1134402434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740af0c0 msgr2=0x7fb7740afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 --2- 172.21.15.41:0/1134402434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740af0c0 0x7fb7740afec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fb764001110 tx=0x7fb76c009290).stop 2021-10-21T00:04:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- 172.21.15.41:0/1134402434 shutdown_connections 2021-10-21T00:04:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 --2- 172.21.15.41:0/1134402434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740af0c0 0x7fb7740afec0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 --2- 172.21.15.41:0/1134402434 >> v2:172.21.15.62:3300/0 conn(0x7fb7740aebb0 0x7fb774144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- 172.21.15.41:0/1134402434 >> 172.21.15.41:0/1134402434 conn(0x7fb7740639f0 msgr2=0x7fb7740b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- 172.21.15.41:0/1134402434 shutdown_connections 2021-10-21T00:04:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- 172.21.15.41:0/1134402434 wait complete. 2021-10-21T00:04:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 Processor -- start 2021-10-21T00:04:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.311+0000 7fb7795ac700 1 -- start start 2021-10-21T00:04:53.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740aebb0 0x7fb774065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7740af0c0 0x7fb7740643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740671c0 con 0x7fb7740b5f70 2021-10-21T00:04:53.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774141390 con 0x7fb7740aebb0 2021-10-21T00:04:53.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740666d0 con 0x7fb7740af0c0 2021-10-21T00:04:53.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59722/0 (socket says 172.21.15.41:59722) 2021-10-21T00:04:53.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 -- 172.21.15.41:0/2427062985 learned_addr learned my addr 172.21.15.41:0/2427062985 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:53.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7737fe700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7740af0c0 0x7fb7740643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb773fff700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740aebb0 0x7fb774065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 -- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7740af0c0 msgr2=0x7fb7740643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7740af0c0 0x7fb7740643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 -- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740aebb0 msgr2=0x7fb774065320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740aebb0 0x7fb774065320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 -- 172.21.15.41:0/2427062985 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009530 con 0x7fb7740b5f70 2021-10-21T00:04:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb778dab700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fb764001110 tx=0x7fb76c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c011d70 con 0x7fb7740b5f70 2021-10-21T00:04:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c0032d0 con 0x7fb7740b5f70 2021-10-21T00:04:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7741415c0 con 0x7fb7740b5f70 2021-10-21T00:04:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c021630 con 0x7fb7740b5f70 2021-10-21T00:04:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.315+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7740ae330 con 0x7fb7740b5f70 2021-10-21T00:04:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7740648e0 con 0x7fb7740b5f70 2021-10-21T00:04:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb76c029070 con 0x7fb7740b5f70 2021-10-21T00:04:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb7717fa700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 0x7fb754055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fb76c06c610 con 0x7fb7740b5f70 2021-10-21T00:04:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb773fff700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 0x7fb754055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.319+0000 7fb773fff700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 0x7fb754055b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb76400d000 tx=0x7fb764007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.327+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb76c0438a0 con 0x7fb7740b5f70 2021-10-21T00:04:53.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.495+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb774067790 con 0x7fb7740b5f70 2021-10-21T00:04:53.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.507+0000 7fb7717fa700 1 -- 172.21.15.41:0/2427062985 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7fb76c015020 con 0x7fb7740b5f70 2021-10-21T00:04:53.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 msgr2=0x7fb754055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 0x7fb754055b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb76400d000 tx=0x7fb764007b90).stop 2021-10-21T00:04:53.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 msgr2=0x7fb7741360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fb764001110 tx=0x7fb76c016000).stop 2021-10-21T00:04:53.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 shutdown_connections 2021-10-21T00:04:53.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7540536a0 0x7fb754055b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7740b5f70 0x7fb7741360b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7740af0c0 0x7fb7740643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 --2- 172.21.15.41:0/2427062985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740aebb0 0x7fb774065320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 >> 172.21.15.41:0/2427062985 conn(0x7fb7740639f0 msgr2=0x7fb7740b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 shutdown_connections 2021-10-21T00:04:53.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.515+0000 7fb7795ac700 1 -- 172.21.15.41:0/2427062985 wait complete. 2021-10-21T00:04:53.524 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 7 and data pool 8 2021-10-21T00:04:53.535 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:04:53.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 Processor -- start 2021-10-21T00:04:53.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 -- start start 2021-10-21T00:04:53.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13180af720 0x7f1318143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180b3770 con 0x7f131805f6b0 2021-10-21T00:04:53.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180afb00 con 0x7f13180b2370 2021-10-21T00:04:53.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.623+0000 7f131c8d5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180afdf0 con 0x7f13180af720 2021-10-21T00:04:53.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131759e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f131805f6b0 0x7f131813d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57500/0 (socket says 172.21.15.41:57500) 2021-10-21T00:04:53.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131759e700 1 -- 172.21.15.41:0/1100419755 learned_addr learned my addr 172.21.15.41:0/1100419755 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:53.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f1316d9d700 1 --2- 172.21.15.41:0/1100419755 >> v2:172.21.15.62:3300/0 conn(0x7f13180af720 0x7f1318143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569014278 0 0) 0x7f13180b3770 con 0x7f131805f6b0 2021-10-21T00:04:53.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc003260 con 0x7f131805f6b0 2021-10-21T00:04:53.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166577887 0 0) 0x7f13180afb00 con 0x7f13180b2370 2021-10-21T00:04:53.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13180b3770 con 0x7f13180b2370 2021-10-21T00:04:53.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618746398 0 0) 0x7f12fc003260 con 0x7f131805f6b0 2021-10-21T00:04:53.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f1316d9d700 1 -- 172.21.15.41:0/1100419755 >> v1:172.21.15.62:6789/0 conn(0x7f13180b2370 legacy=0x7f13180b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f1316d9d700 1 -- 172.21.15.41:0/1100419755 >> v1:172.21.15.41:6789/0 conn(0x7f131805f6b0 legacy=0x7f131813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f1316d9d700 1 -- 172.21.15.41:0/1100419755 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180b0090 con 0x7f13180af720 2021-10-21T00:04:53.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f1316d9d700 1 --2- 172.21.15.41:0/1100419755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f1318143cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1310001490 tx=0x7f1308006d90).ready entity=mon.1 client_cookie=8ee03a3d0aa06abb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13100019e0 con 0x7f13180af720 2021-10-21T00:04:53.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308000e90 con 0x7f13180af720 2021-10-21T00:04:53.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131659c700 1 -- 172.21.15.41:0/1100419755 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130800beb0 con 0x7f13180af720 2021-10-21T00:04:53.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 -- 172.21.15.41:0/1100419755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 msgr2=0x7f1318143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 --2- 172.21.15.41:0/1100419755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f1318143cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1310001490 tx=0x7f1308006d90).stop 2021-10-21T00:04:53.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 -- 172.21.15.41:0/1100419755 shutdown_connections 2021-10-21T00:04:53.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 --2- 172.21.15.41:0/1100419755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f1318143cf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 -- 172.21.15.41:0/1100419755 >> 172.21.15.41:0/1100419755 conn(0x7f13180637b0 msgr2=0x7f1318063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 -- 172.21.15.41:0/1100419755 shutdown_connections 2021-10-21T00:04:53.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.627+0000 7f131c8d5700 1 -- 172.21.15.41:0/1100419755 wait complete. 2021-10-21T00:04:53.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 Processor -- start 2021-10-21T00:04:53.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- start start 2021-10-21T00:04:53.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 0x7f13181552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f131813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318067690 con 0x7f13180b2370 2021-10-21T00:04:53.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b5bc0 con 0x7f13180af720 2021-10-21T00:04:53.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b5e60 con 0x7f131805f6b0 2021-10-21T00:04:53.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59736/0 (socket says 172.21.15.41:59736) 2021-10-21T00:04:53.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131759e700 1 -- 172.21.15.41:0/2608969257 learned_addr learned my addr 172.21.15.41:0/2608969257 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:53.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f131813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f1316d9d700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 0x7f13181552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 -- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 msgr2=0x7f13181552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 0x7f13181552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 -- 172.21.15.41:0/2608969257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 msgr2=0x7f1318064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 -- 172.21.15.41:0/2608969257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130800b120 con 0x7f13180af720 2021-10-21T00:04:53.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f1316d9d700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 0x7f13181552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:53.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131759e700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:53.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f130ffff700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f131813f520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1300001110 tx=0x7f1300007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f130000cd60 con 0x7f13180af720 2021-10-21T00:04:53.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300012400 con 0x7f13180af720 2021-10-21T00:04:53.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1300012760 con 0x7f13180af720 2021-10-21T00:04:53.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180b6100 con 0x7f13180af720 2021-10-21T00:04:53.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.631+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1318141d90 con 0x7f13180af720 2021-10-21T00:04:53.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318140270 con 0x7f13180af720 2021-10-21T00:04:53.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1300019030 con 0x7f13180af720 2021-10-21T00:04:53.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f1314d99700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 0x7f12f00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f130006ab40 con 0x7f13180af720 2021-10-21T00:04:53.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f1316d9d700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 0x7f12f00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.635+0000 7f1316d9d700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 0x7f12f00559b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f130801a000 tx=0x7f1308014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.643+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1318140270 con 0x7f13180af720 2021-10-21T00:04:53.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.775+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1318140270 con 0x7f13180af720 2021-10-21T00:04:53.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.775+0000 7f1314d99700 1 -- 172.21.15.41:0/2608969257 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f1318140270 con 0x7f13180af720 2021-10-21T00:04:53.783 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:53.784 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:53.503055+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:04:51.918069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-21T00:04:53.087464+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:04:53.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 msgr2=0x7f12f00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 0x7f12f00559b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f130801a000 tx=0x7f1308014000).stop 2021-10-21T00:04:53.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 msgr2=0x7f131813f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f131813f520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1300001110 tx=0x7f1300007a20).stop 2021-10-21T00:04:53.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 shutdown_connections 2021-10-21T00:04:53.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f12f00534f0 0x7f12f00559b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13180b2370 0x7f1318064b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13180af720 0x7f131813f520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 --2- 172.21.15.41:0/2608969257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f131805f6b0 0x7f13181552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 >> 172.21.15.41:0/2608969257 conn(0x7f13180637b0 msgr2=0x7f1318140790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 shutdown_connections 2021-10-21T00:04:53.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.779+0000 7f131c8d5700 1 -- 172.21.15.41:0/2608969257 wait complete. 2021-10-21T00:04:53.799 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:04:53.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 Processor -- start 2021-10-21T00:04:53.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 -- start start 2021-10-21T00:04:53.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a40af620 0x7fe6a40ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6a4067a80 0x7fe6a4149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40b0b50 con 0x7fe6a40b2170 2021-10-21T00:04:53.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40b2550 con 0x7fe6a4067a80 2021-10-21T00:04:53.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6aa43e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40b0d90 con 0x7fe6a40af620 2021-10-21T00:04:53.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6a4067a80 0x7fe6a4149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6a4067a80 0x7fe6a4149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59744/0 (socket says 172.21.15.41:59744) 2021-10-21T00:04:53.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a943c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe6a40b2170 0x7fe6a40ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37334/0 (socket says 172.21.15.41:37334) 2021-10-21T00:04:53.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 -- 172.21.15.41:0/3368566973 learned_addr learned my addr 172.21.15.41:0/3368566973 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:53.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a8c3b700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a40af620 0x7fe6a40ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 -- 172.21.15.41:0/3368566973 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a40af620 msgr2=0x7fe6a40ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:53.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a40af620 0x7fe6a40ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 -- 172.21.15.41:0/3368566973 >> v1:172.21.15.62:6789/0 conn(0x7fe6a40b2170 legacy=0x7fe6a40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe69bfff700 1 -- 172.21.15.41:0/3368566973 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925947693 0 0) 0x7fe694001110 con 0x7fe6a40b2170 2021-10-21T00:04:53.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.899+0000 7fe6a9c3d700 1 -- 172.21.15.41:0/3368566973 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40b1030 con 0x7fe6a4067a80 2021-10-21T00:04:53.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a9c3d700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a4067a80 0x7fe6a4149320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe69c002f70 tx=0x7fe69c006eb0).ready entity=mon.0 client_cookie=f341ee5d0e0c498a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe69bfff700 1 -- 172.21.15.41:0/3368566973 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69c00d570 con 0x7fe6a4067a80 2021-10-21T00:04:53.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe69bfff700 1 -- 172.21.15.41:0/3368566973 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c000e90 con 0x7fe6a4067a80 2021-10-21T00:04:53.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe69bfff700 1 -- 172.21.15.41:0/3368566973 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69c00d8c0 con 0x7fe6a4067a80 2021-10-21T00:04:53.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- 172.21.15.41:0/3368566973 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a4067a80 msgr2=0x7fe6a4149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a4067a80 0x7fe6a4149320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe69c002f70 tx=0x7fe69c006eb0).stop 2021-10-21T00:04:53.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- 172.21.15.41:0/3368566973 shutdown_connections 2021-10-21T00:04:53.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a4067a80 0x7fe6a4149320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/3368566973 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a40af620 0x7fe6a40ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- 172.21.15.41:0/3368566973 >> 172.21.15.41:0/3368566973 conn(0x7fe6a40b5700 msgr2=0x7fe6a40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:53.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- 172.21.15.41:0/3368566973 shutdown_connections 2021-10-21T00:04:53.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- 172.21.15.41:0/3368566973 wait complete. 2021-10-21T00:04:53.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 Processor -- start 2021-10-21T00:04:53.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- start start 2021-10-21T00:04:53.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a4067a80 0x7fe6a4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a40b2170 0x7fe6a40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4157030 con 0x7fe6a40af620 2021-10-21T00:04:53.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40ac5a0 con 0x7fe6a40b2170 2021-10-21T00:04:53.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6aa43e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40ac7d0 con 0x7fe6a4067a80 2021-10-21T00:04:53.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59748/0 (socket says 172.21.15.41:59748) 2021-10-21T00:04:53.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 -- 172.21.15.41:0/1985069934 learned_addr learned my addr 172.21.15.41:0/1985069934 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:53.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a9c3d700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a40b2170 0x7fe6a40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a943c700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a4067a80 0x7fe6a4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 -- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a4067a80 msgr2=0x7fe6a4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a4067a80 0x7fe6a4156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 -- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a40b2170 msgr2=0x7fe6a40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:53.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a40b2170 0x7fe6a40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:53.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.903+0000 7fe6a8c3b700 1 -- 172.21.15.41:0/1985069934 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c00b1e0 con 0x7fe6a40af620 2021-10-21T00:04:53.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe6a8c3b700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe6a4148c40 tx=0x7fe6a00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a000c6a0 con 0x7fe6a40af620 2021-10-21T00:04:53.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000c800 con 0x7fe6a40af620 2021-10-21T00:04:53.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40aca70 con 0x7fe6a40af620 2021-10-21T00:04:53.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a000cb60 con 0x7fe6a40af620 2021-10-21T00:04:53.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a41447a0 con 0x7fe6a40af620 2021-10-21T00:04:53.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a40acc00 con 0x7fe6a40af620 2021-10-21T00:04:53.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6a0022070 con 0x7fe6a40af620 2021-10-21T00:04:53.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 0x7fe68c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:53.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6a006bf40 con 0x7fe6a40af620 2021-10-21T00:04:53.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.907+0000 7fe6a943c700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 0x7fe68c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:53.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.911+0000 7fe6a943c700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 0x7fe68c055b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe69400d000 tx=0x7fe694007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:53.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:53.915+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6a00430a0 con 0x7fe6a40af620 2021-10-21T00:04:54.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.039+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6a40b12d0 con 0x7fe6a40af620 2021-10-21T00:04:54.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.039+0000 7fe69a7fc700 1 -- 172.21.15.41:0/1985069934 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe6a00466c0 con 0x7fe6a40af620 2021-10-21T00:04:54.048 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:54.048 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:53.503055+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:04:51.918069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-21T00:04:53.087464+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:04:54.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 msgr2=0x7fe68c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 0x7fe68c055b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe69400d000 tx=0x7fe694007860).stop 2021-10-21T00:04:54.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 msgr2=0x7fe6a40ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe6a4148c40 tx=0x7fe6a00091d0).stop 2021-10-21T00:04:54.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 shutdown_connections 2021-10-21T00:04:54.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe68c0536d0 0x7fe68c055b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6a40b2170 0x7fe6a40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6a40af620 0x7fe6a40ae360 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 --2- 172.21.15.41:0/1985069934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6a4067a80 0x7fe6a4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 >> 172.21.15.41:0/1985069934 conn(0x7fe6a40b5700 msgr2=0x7fe6a414c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 shutdown_connections 2021-10-21T00:04:54.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.043+0000 7fe6aa43e700 1 -- 172.21.15.41:0/1985069934 wait complete. 2021-10-21T00:04:54.062 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:04:54.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.167+0000 7f8b067b9700 1 Processor -- start 2021-10-21T00:04:54.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.167+0000 7f8b067b9700 1 -- start start 2021-10-21T00:04:54.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b00062330 0x7f8b000b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b00062f70 0x7f8b0005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 0x7f8b0013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0005bd40 con 0x7f8b00062f70 2021-10-21T00:04:54.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0005bf70 con 0x7f8b000b3a20 2021-10-21T00:04:54.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00142cb0 con 0x7f8b00062330 2021-10-21T00:04:54.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b00062f70 0x7f8b0005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8b00062f70 0x7f8b0005c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59754/0 (socket says 172.21.15.41:59754) 2021-10-21T00:04:54.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 -- 172.21.15.41:0/594013040 learned_addr learned my addr 172.21.15.41:0/594013040 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:54.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b05fb8700 1 --2- 172.21.15.41:0/594013040 >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 0x7f8b0013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b057b7700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b00062330 0x7f8b000b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 -- 172.21.15.41:0/594013040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b00062330 msgr2=0x7f8b000b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:54.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b00062330 0x7f8b000b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 -- 172.21.15.41:0/594013040 >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 msgr2=0x7f8b0013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:54.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/594013040 >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 0x7f8b0013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 -- 172.21.15.41:0/594013040 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00142950 con 0x7f8b00062f70 2021-10-21T00:04:54.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b05fb8700 1 --2- 172.21.15.41:0/594013040 >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 0x7f8b0013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:54.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062f70 0x7f8b0005c410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f8af0002f70 tx=0x7f8af0006eb0).ready entity=mon.0 client_cookie=9a2070ef272d9d5f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8af7fff700 1 -- 172.21.15.41:0/594013040 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af000d570 con 0x7f8b00062f70 2021-10-21T00:04:54.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8af7fff700 1 -- 172.21.15.41:0/594013040 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0000e90 con 0x7f8b00062f70 2021-10-21T00:04:54.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8af7fff700 1 -- 172.21.15.41:0/594013040 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af000d900 con 0x7f8b00062f70 2021-10-21T00:04:54.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- 172.21.15.41:0/594013040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062f70 msgr2=0x7f8b0005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062f70 0x7f8b0005c410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f8af0002f70 tx=0x7f8af0006eb0).stop 2021-10-21T00:04:54.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- 172.21.15.41:0/594013040 shutdown_connections 2021-10-21T00:04:54.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062f70 0x7f8b0005c410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- 172.21.15.41:0/594013040 >> v2:172.21.15.62:3300/0 conn(0x7f8b000b3a20 0x7f8b0013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 --2- 172.21.15.41:0/594013040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b00062330 0x7f8b000b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- 172.21.15.41:0/594013040 >> 172.21.15.41:0/594013040 conn(0x7f8b000b9080 msgr2=0x7f8b000b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- 172.21.15.41:0/594013040 shutdown_connections 2021-10-21T00:04:54.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.171+0000 7f8b067b9700 1 -- 172.21.15.41:0/594013040 wait complete. 2021-10-21T00:04:54.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 Processor -- start 2021-10-21T00:04:54.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 -- start start 2021-10-21T00:04:54.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b00062f70 0x7f8b000b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 0x7f8b00155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000ada40 con 0x7f8b00062330 2021-10-21T00:04:54.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b1a00 con 0x7f8b00062f70 2021-10-21T00:04:54.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b067b9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b1ca0 con 0x7f8b000b3a20 2021-10-21T00:04:54.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59760/0 (socket says 172.21.15.41:59760) 2021-10-21T00:04:54.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 -- 172.21.15.41:0/1978257510 learned_addr learned my addr 172.21.15.41:0/1978257510 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:54.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b00062f70 0x7f8b000b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b05fb8700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 0x7f8b00155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 -- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 msgr2=0x7f8b00155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 0x7f8b00155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 -- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b00062f70 msgr2=0x7f8b000b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b00062f70 0x7f8b000b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 -- 172.21.15.41:0/1978257510 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8009470 con 0x7f8b00062330 2021-10-21T00:04:54.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b05fb8700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 0x7f8b00155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:54.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8b057b7700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f8afc00c000 tx=0x7f8afc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.175+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8afc010780 con 0x7f8b00062330 2021-10-21T00:04:54.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc0108e0 con 0x7f8b00062330 2021-10-21T00:04:54.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af000b1e0 con 0x7f8b00062330 2021-10-21T00:04:54.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8afc010c40 con 0x7f8b00062330 2021-10-21T00:04:54.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b000b16a0 con 0x7f8b00062330 2021-10-21T00:04:54.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000ad670 con 0x7f8b00062330 2021-10-21T00:04:54.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8afc01c460 con 0x7f8b00062330 2021-10-21T00:04:54.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8af67fc700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 0x7f8ae8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8afc06bcd0 con 0x7f8b00062330 2021-10-21T00:04:54.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 0x7f8ae8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.179+0000 7f8b04fb6700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 0x7f8ae8055b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f8af001c000 tx=0x7f8af0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.183+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b000ad670 con 0x7f8b00062330 2021-10-21T00:04:54.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.347+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8b000ad670 con 0x7f8b00062330 2021-10-21T00:04:54.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.507+0000 7f8af67fc700 1 -- 172.21.15.41:0/1978257510 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8b000ad670 con 0x7f8b00062330 2021-10-21T00:04:54.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 msgr2=0x7f8ae8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 0x7f8ae8055b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f8af001c000 tx=0x7f8af0015000).stop 2021-10-21T00:04:54.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 msgr2=0x7f8b00151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f8afc00c000 tx=0x7f8afc006df0).stop 2021-10-21T00:04:54.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 shutdown_connections 2021-10-21T00:04:54.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8ae8053640 0x7f8ae8055b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b000b3a20 0x7f8b00155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b00062f70 0x7f8b000b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 --2- 172.21.15.41:0/1978257510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8b00062330 0x7f8b00151e40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 >> 172.21.15.41:0/1978257510 conn(0x7f8b000b9080 msgr2=0x7f8b00141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 shutdown_connections 2021-10-21T00:04:54.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.511+0000 7f8b067b9700 1 -- 172.21.15.41:0/1978257510 wait complete. 2021-10-21T00:04:54.536 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:54.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 Processor -- start 2021-10-21T00:04:54.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 -- start start 2021-10-21T00:04:54.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe4440b2170 0x7fe4440ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440b0b50 con 0x7fe4440af620 2021-10-21T00:04:54.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440b2550 con 0x7fe444067a80 2021-10-21T00:04:54.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe44addd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440b0d90 con 0x7fe4440b2170 2021-10-21T00:04:54.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe4495da700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe4440af620 0x7fe4440ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57538/0 (socket says 172.21.15.41:57538) 2021-10-21T00:04:54.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe4495da700 1 -- 172.21.15.41:0/3253226498 learned_addr learned my addr 172.21.15.41:0/3253226498 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:54.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe449ddb700 1 --2- 172.21.15.41:0/3253226498 >> v2:172.21.15.41:3300/0 conn(0x7fe4440b2170 0x7fe4440ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe448dd9700 1 -- 172.21.15.41:0/3253226498 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063016370 0 0) 0x7fe440001110 con 0x7fe4440af620 2021-10-21T00:04:54.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe448dd9700 1 -- 172.21.15.41:0/3253226498 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe42c003260 con 0x7fe4440af620 2021-10-21T00:04:54.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe449ddb700 1 -- 172.21.15.41:0/3253226498 >> v1:172.21.15.62:6789/0 conn(0x7fe444067a80 legacy=0x7fe444149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe449ddb700 1 -- 172.21.15.41:0/3253226498 >> v1:172.21.15.41:6789/0 conn(0x7fe4440af620 legacy=0x7fe4440ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe449ddb700 1 -- 172.21.15.41:0/3253226498 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440b1030 con 0x7fe4440b2170 2021-10-21T00:04:54.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe449ddb700 1 --2- 172.21.15.41:0/3253226498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4440ab170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe4440aafa0 tx=0x7fe434006df0).ready entity=mon.0 client_cookie=8fc437e2f753afa1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe448dd9700 1 -- 172.21.15.41:0/3253226498 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43400d610 con 0x7fe4440b2170 2021-10-21T00:04:54.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe448dd9700 1 -- 172.21.15.41:0/3253226498 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434000e90 con 0x7fe4440b2170 2021-10-21T00:04:54.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.639+0000 7fe448dd9700 1 -- 172.21.15.41:0/3253226498 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43400d960 con 0x7fe4440b2170 2021-10-21T00:04:54.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- 172.21.15.41:0/3253226498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 msgr2=0x7fe4440ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 --2- 172.21.15.41:0/3253226498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4440ab170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe4440aafa0 tx=0x7fe434006df0).stop 2021-10-21T00:04:54.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- 172.21.15.41:0/3253226498 shutdown_connections 2021-10-21T00:04:54.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 --2- 172.21.15.41:0/3253226498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4440ab170 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- 172.21.15.41:0/3253226498 >> 172.21.15.41:0/3253226498 conn(0x7fe4440b5700 msgr2=0x7fe4440b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- 172.21.15.41:0/3253226498 shutdown_connections 2021-10-21T00:04:54.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- 172.21.15.41:0/3253226498 wait complete. 2021-10-21T00:04:54.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 Processor -- start 2021-10-21T00:04:54.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.643+0000 7fe44addd700 1 -- start start 2021-10-21T00:04:54.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 0x7fe4440acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 0x7fe4440646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4441462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444156c60 con 0x7fe4440b2170 2021-10-21T00:04:54.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444065360 con 0x7fe444067a80 2021-10-21T00:04:54.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440650c0 con 0x7fe4440af620 2021-10-21T00:04:54.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44a5dc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4441462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44a5dc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4441462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59778/0 (socket says 172.21.15.41:59778) 2021-10-21T00:04:54.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44a5dc700 1 -- 172.21.15.41:0/2469320678 learned_addr learned my addr 172.21.15.41:0/2469320678 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:54.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe449ddb700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 0x7fe4440acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 0x7fe4440646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 -- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 msgr2=0x7fe4440acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 0x7fe4440acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 -- 172.21.15.41:0/2469320678 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 msgr2=0x7fe4441462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4441462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 -- 172.21.15.41:0/2469320678 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43400b180 con 0x7fe4440af620 2021-10-21T00:04:54.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe449ddb700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 0x7fe4440acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe4495da700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 0x7fe4440646a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe4440643d0 tx=0x7fe4400078a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe44000ce10 con 0x7fe4440af620 2021-10-21T00:04:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400070d0 con 0x7fe4440af620 2021-10-21T00:04:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe444156ed0 con 0x7fe4440af620 2021-10-21T00:04:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe440007430 con 0x7fe4440af620 2021-10-21T00:04:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.647+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe444064b90 con 0x7fe4440af620 2021-10-21T00:04:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444157060 con 0x7fe4440af620 2021-10-21T00:04:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe44001a060 con 0x7fe4440af620 2021-10-21T00:04:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe432ffd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 0x7fe424055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe44006aea0 con 0x7fe4440af620 2021-10-21T00:04:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe449ddb700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 0x7fe424055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.651+0000 7fe449ddb700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 0x7fe424055ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe43401a000 tx=0x7fe434014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.663+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe440041ef0 con 0x7fe4440af620 2021-10-21T00:04:54.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.827+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4440b0b50 con 0x7fe4440af620 2021-10-21T00:04:54.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.827+0000 7fe432ffd700 1 -- 172.21.15.41:0/2469320678 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fe4440b0b50 con 0x7fe4440af620 2021-10-21T00:04:54.834 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:54.835 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:04:54.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 msgr2=0x7fe424055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 0x7fe424055ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe43401a000 tx=0x7fe434014000).stop 2021-10-21T00:04:54.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 msgr2=0x7fe4440646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 0x7fe4440646a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe4440643d0 tx=0x7fe4400078a0).stop 2021-10-21T00:04:54.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 shutdown_connections 2021-10-21T00:04:54.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe424053610 0x7fe424055ad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4440b2170 0x7fe4441462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4440af620 0x7fe4440646a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 --2- 172.21.15.41:0/2469320678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444067a80 0x7fe4440acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 >> 172.21.15.41:0/2469320678 conn(0x7fe4440b5700 msgr2=0x7fe444097f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 shutdown_connections 2021-10-21T00:04:54.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.835+0000 7fe44addd700 1 -- 172.21.15.41:0/2469320678 wait complete. 2021-10-21T00:04:54.841 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:04:54.854 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:04:54.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 Processor -- start 2021-10-21T00:04:54.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 -- start start 2021-10-21T00:04:54.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcad805bfe0 0x7fcad81461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad805c3c0 con 0x7fcad8067a00 2021-10-21T00:04:54.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80b27a0 con 0x7fcad805c6b0 2021-10-21T00:04:54.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcadcd7e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80b1920 con 0x7fcad805bfe0 2021-10-21T00:04:54.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad6ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcad8067a00 0x7fcad81466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57554/0 (socket says 172.21.15.41:57554) 2021-10-21T00:04:54.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad6ffd700 1 -- 172.21.15.41:0/1505719746 learned_addr learned my addr 172.21.15.41:0/1505719746 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:54.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad77fe700 1 --2- 172.21.15.41:0/1505719746 >> v2:172.21.15.62:3300/0 conn(0x7fcad805bfe0 0x7fcad81461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346482448 0 0) 0x7fcad805c3c0 con 0x7fcad8067a00 2021-10-21T00:04:54.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac4003260 con 0x7fcad8067a00 2021-10-21T00:04:54.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14812502 0 0) 0x7fcad80b27a0 con 0x7fcad805c6b0 2021-10-21T00:04:54.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad805c3c0 con 0x7fcad805c6b0 2021-10-21T00:04:54.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad77fe700 1 -- 172.21.15.41:0/1505719746 >> v1:172.21.15.62:6789/0 conn(0x7fcad805c6b0 legacy=0x7fcad8141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad77fe700 1 -- 172.21.15.41:0/1505719746 >> v1:172.21.15.41:6789/0 conn(0x7fcad8067a00 legacy=0x7fcad81466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad77fe700 1 -- 172.21.15.41:0/1505719746 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80b2a40 con 0x7fcad805bfe0 2021-10-21T00:04:54.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad77fe700 1 --2- 172.21.15.41:0/1505719746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad805bfe0 0x7fcad81461c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fcac8002f70 tx=0x7fcac8006d90).ready entity=mon.1 client_cookie=ac1753fa2eb9f1fa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac800e630 con 0x7fcad805bfe0 2021-10-21T00:04:54.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8000e90 con 0x7fcad805bfe0 2021-10-21T00:04:54.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.947+0000 7fcad67fc700 1 -- 172.21.15.41:0/1505719746 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac800e980 con 0x7fcad805bfe0 2021-10-21T00:04:54.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/1505719746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad805bfe0 msgr2=0x7fcad81461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/1505719746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad805bfe0 0x7fcad81461c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fcac8002f70 tx=0x7fcac8006d90).stop 2021-10-21T00:04:54.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/1505719746 shutdown_connections 2021-10-21T00:04:54.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/1505719746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad805bfe0 0x7fcad81461c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/1505719746 >> 172.21.15.41:0/1505719746 conn(0x7fcad80637b0 msgr2=0x7fcad8063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:54.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/1505719746 shutdown_connections 2021-10-21T00:04:54.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/1505719746 wait complete. 2021-10-21T00:04:54.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 Processor -- start 2021-10-21T00:04:54.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- start start 2021-10-21T00:04:54.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcad805c6b0 0x7fcad81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad8067a00 0x7fcad80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80af950 con 0x7fcad805bfe0 2021-10-21T00:04:54.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80afbf0 con 0x7fcad8067a00 2021-10-21T00:04:54.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8152970 con 0x7fcad805c6b0 2021-10-21T00:04:54.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59792/0 (socket says 172.21.15.41:59792) 2021-10-21T00:04:54.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 -- 172.21.15.41:0/597261726 learned_addr learned my addr 172.21.15.41:0/597261726 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:54.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad6ffd700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcad805c6b0 0x7fcad81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad7fff700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad8067a00 0x7fcad80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 -- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcad805c6b0 msgr2=0x7fcad81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcad805c6b0 0x7fcad81519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 -- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad8067a00 msgr2=0x7fcad80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:54.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad8067a00 0x7fcad80b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:54.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 -- 172.21.15.41:0/597261726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac800b120 con 0x7fcad805bfe0 2021-10-21T00:04:54.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad77fe700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fcac8002f70 tx=0x7fcac8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac80116c0 con 0x7fcad805bfe0 2021-10-21T00:04:54.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8011820 con 0x7fcad805bfe0 2021-10-21T00:04:54.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad8113e80 con 0x7fcad805bfe0 2021-10-21T00:04:54.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8011b80 con 0x7fcad805bfe0 2021-10-21T00:04:54.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad80b4250 con 0x7fcad805bfe0 2021-10-21T00:04:54.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad8114a90 con 0x7fcad805bfe0 2021-10-21T00:04:54.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcac800f070 con 0x7fcad805bfe0 2021-10-21T00:04:54.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 0x7fcab8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:54.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcac806cbb0 con 0x7fcad805bfe0 2021-10-21T00:04:54.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.955+0000 7fcad6ffd700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 0x7fcab8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:54.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.959+0000 7fcad6ffd700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 0x7fcab8055b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fcacc00d000 tx=0x7fcacc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:54.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:54.963+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcad8114a90 con 0x7fcad805bfe0 2021-10-21T00:04:55.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.091+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcad8114a90 con 0x7fcad805bfe0 2021-10-21T00:04:55.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcad4ff9700 1 -- 172.21.15.41:0/597261726 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fcad8114a90 con 0x7fcad805bfe0 2021-10-21T00:04:55.102 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:55.102 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":40,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:54.507266+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:04:51.918069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-21T00:04:53.087464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:04:55.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 msgr2=0x7fcab8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 0x7fcab8055b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fcacc00d000 tx=0x7fcacc009040).stop 2021-10-21T00:04:55.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 msgr2=0x7fcad80ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fcac8002f70 tx=0x7fcac8014000).stop 2021-10-21T00:04:55.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 shutdown_connections 2021-10-21T00:04:55.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcab8053640 0x7fcab8055b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcad8067a00 0x7fcad80b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcad805c6b0 0x7fcad81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 --2- 172.21.15.41:0/597261726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcad805bfe0 0x7fcad80ae5e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 >> 172.21.15.41:0/597261726 conn(0x7fcad80637b0 msgr2=0x7fcad8145890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 shutdown_connections 2021-10-21T00:04:55.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.095+0000 7fcadcd7e700 1 -- 172.21.15.41:0/597261726 wait complete. 2021-10-21T00:04:55.116 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:04:55.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.227+0000 7f4b44e64700 1 Processor -- start 2021-10-21T00:04:55.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.227+0000 7f4b44e64700 1 -- start start 2021-10-21T00:04:55.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.227+0000 7f4b44e64700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b400b9c70 0x7f4b40143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.227+0000 7f4b44e64700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 0x7f4b40143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b40142bc0 con 0x7f4b40143a00 2021-10-21T00:04:55.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b401429a0 con 0x7f4b400b9c70 2021-10-21T00:04:55.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400ba050 con 0x7f4b400b3bc0 2021-10-21T00:04:55.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b400b9c70 0x7f4b40143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b400b9c70 0x7f4b40143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59798/0 (socket says 172.21.15.41:59798) 2021-10-21T00:04:55.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 0x7f4b40143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 -- 172.21.15.41:0/565232682 learned_addr learned my addr 172.21.15.41:0/565232682 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:55.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 -- 172.21.15.41:0/565232682 >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 msgr2=0x7f4b40143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:55.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 --2- 172.21.15.41:0/565232682 >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 0x7f4b40143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 -- 172.21.15.41:0/565232682 >> v1:172.21.15.62:6789/0 conn(0x7f4b40143a00 legacy=0x7f4b4005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 -- 172.21.15.41:0/565232682 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b401463c0 con 0x7f4b400b9c70 2021-10-21T00:04:55.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3dd9b700 1 --2- 172.21.15.41:0/565232682 >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 0x7f4b40143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:55.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3e59c700 1 --2- 172.21.15.41:0/565232682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b9c70 0x7f4b40143020 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4b34002f70 tx=0x7f4b34006eb0).ready entity=mon.0 client_cookie=f83ba0c0c4830b8d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3d59a700 1 -- 172.21.15.41:0/565232682 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b3400d5c0 con 0x7f4b400b9c70 2021-10-21T00:04:55.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3d59a700 1 -- 172.21.15.41:0/565232682 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b34000e90 con 0x7f4b400b9c70 2021-10-21T00:04:55.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b3d59a700 1 -- 172.21.15.41:0/565232682 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b3400d950 con 0x7f4b400b9c70 2021-10-21T00:04:55.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- 172.21.15.41:0/565232682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b9c70 msgr2=0x7f4b40143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 --2- 172.21.15.41:0/565232682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b9c70 0x7f4b40143020 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4b34002f70 tx=0x7f4b34006eb0).stop 2021-10-21T00:04:55.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- 172.21.15.41:0/565232682 shutdown_connections 2021-10-21T00:04:55.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 --2- 172.21.15.41:0/565232682 >> v2:172.21.15.62:3300/0 conn(0x7f4b400b3bc0 0x7f4b40143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 --2- 172.21.15.41:0/565232682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b9c70 0x7f4b40143020 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- 172.21.15.41:0/565232682 >> 172.21.15.41:0/565232682 conn(0x7f4b40062e80 msgr2=0x7f4b400b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- 172.21.15.41:0/565232682 shutdown_connections 2021-10-21T00:04:55.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.231+0000 7f4b44e64700 1 -- 172.21.15.41:0/565232682 wait complete. 2021-10-21T00:04:55.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 Processor -- start 2021-10-21T00:04:55.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- start start 2021-10-21T00:04:55.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b400b9c70 0x7f4b40112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b40143a00 0x7f4b4005c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40114d20 con 0x7f4b400b3bc0 2021-10-21T00:04:55.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40114fc0 con 0x7f4b400b9c70 2021-10-21T00:04:55.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40115260 con 0x7f4b40143a00 2021-10-21T00:04:55.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59802/0 (socket says 172.21.15.41:59802) 2021-10-21T00:04:55.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 -- 172.21.15.41:0/3287704690 learned_addr learned my addr 172.21.15.41:0/3287704690 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:55.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3dd9b700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b400b9c70 0x7f4b40112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3ed9d700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b40143a00 0x7f4b4005c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 -- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b40143a00 msgr2=0x7f4b4005c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b40143a00 0x7f4b4005c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 -- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b400b9c70 msgr2=0x7f4b40112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b400b9c70 0x7f4b40112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 -- 172.21.15.41:0/3287704690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3000b180 con 0x7f4b400b3bc0 2021-10-21T00:04:55.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3e59c700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f4b34002f70 tx=0x7f4b34015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b34011760 con 0x7f4b400b3bc0 2021-10-21T00:04:55.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b340118c0 con 0x7f4b400b3bc0 2021-10-21T00:04:55.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3400b1e0 con 0x7f4b400b3bc0 2021-10-21T00:04:55.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b34011c20 con 0x7f4b400b3bc0 2021-10-21T00:04:55.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b400af410 con 0x7f4b400b3bc0 2021-10-21T00:04:55.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40115420 con 0x7f4b400b3bc0 2021-10-21T00:04:55.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b34025030 con 0x7f4b400b3bc0 2021-10-21T00:04:55.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 0x7f4b1c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b3406c930 con 0x7f4b400b3bc0 2021-10-21T00:04:55.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3dd9b700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 0x7f4b1c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.235+0000 7f4b3dd9b700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 0x7f4b1c0559b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4b3000b000 tx=0x7f4b30006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.239+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b34043a90 con 0x7f4b400b3bc0 2021-10-21T00:04:55.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.411+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4b40057350 con 0x7f4b400b3bc0 2021-10-21T00:04:55.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.423+0000 7f4b2f7fe700 1 -- 172.21.15.41:0/3287704690 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4b340230e0 con 0x7f4b400b3bc0 2021-10-21T00:04:55.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.423+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 msgr2=0x7f4b1c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.423+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 0x7f4b1c0559b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4b3000b000 tx=0x7f4b30006df0).stop 2021-10-21T00:04:55.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.423+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 msgr2=0x7f4b40115700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.423+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f4b34002f70 tx=0x7f4b34015000).stop 2021-10-21T00:04:55.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 shutdown_connections 2021-10-21T00:04:55.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b1c0534f0 0x7f4b1c0559b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b40143a00 0x7f4b4005c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b400b9c70 0x7f4b40112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 --2- 172.21.15.41:0/3287704690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b400b3bc0 0x7f4b40115700 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 >> 172.21.15.41:0/3287704690 conn(0x7f4b40062e80 msgr2=0x7f4b40140e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 shutdown_connections 2021-10-21T00:04:55.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.427+0000 7f4b44e64700 1 -- 172.21.15.41:0/3287704690 wait complete. 2021-10-21T00:04:55.432 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:04:55.441 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:04:55.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 Processor -- start 2021-10-21T00:04:55.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 -- start start 2021-10-21T00:04:55.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1950062330 0x7f19500b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f195013c510 0x7f195013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950142ad0 con 0x7f1950142f00 2021-10-21T00:04:55.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500b3520 con 0x7f1950062330 2021-10-21T00:04:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.551+0000 7f19549c6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1950143c40 con 0x7f195013c510 2021-10-21T00:04:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1950142f00 0x7f1950143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57582/0 (socket says 172.21.15.41:57582) 2021-10-21T00:04:55.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194ffff700 1 -- 172.21.15.41:0/2223051812 learned_addr learned my addr 172.21.15.41:0/2223051812 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 --2- 172.21.15.41:0/2223051812 >> v2:172.21.15.62:3300/0 conn(0x7f1950062330 0x7f19500b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f1947fff700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f195013c510 0x7f195013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 -- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f195013c510 msgr2=0x7f195013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f195013c510 0x7f195013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 -- 172.21.15.41:0/2223051812 >> v1:172.21.15.41:6789/0 conn(0x7f1950142f00 legacy=0x7f1950143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 -- 172.21.15.41:0/2223051812 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195013ce60 con 0x7f1950062330 2021-10-21T00:04:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194f7fe700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1950062330 0x7f19500b4140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1940002f70 tx=0x7f1940006df0).ready entity=mon.1 client_cookie=809642b28f92ee8a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194effd700 1 -- 172.21.15.41:0/2223051812 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194000d570 con 0x7f1950062330 2021-10-21T00:04:55.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194effd700 1 -- 172.21.15.41:0/2223051812 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940000e90 con 0x7f1950062330 2021-10-21T00:04:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f194effd700 1 -- 172.21.15.41:0/2223051812 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194000d8c0 con 0x7f1950062330 2021-10-21T00:04:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 -- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1950062330 msgr2=0x7f19500b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1950062330 0x7f19500b4140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1940002f70 tx=0x7f1940006df0).stop 2021-10-21T00:04:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 -- 172.21.15.41:0/2223051812 shutdown_connections 2021-10-21T00:04:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f195013c510 0x7f195013c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 --2- 172.21.15.41:0/2223051812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1950062330 0x7f19500b4140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 -- 172.21.15.41:0/2223051812 >> 172.21.15.41:0/2223051812 conn(0x7f19500b9080 msgr2=0x7f19500b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 -- 172.21.15.41:0/2223051812 shutdown_connections 2021-10-21T00:04:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 -- 172.21.15.41:0/2223051812 wait complete. 2021-10-21T00:04:55.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.555+0000 7f19549c6700 1 Processor -- start 2021-10-21T00:04:55.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- start start 2021-10-21T00:04:55.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 0x7f1950147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1950142f00 0x7f1950147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195013ac20 con 0x7f1950062330 2021-10-21T00:04:55.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19501552e0 con 0x7f195013c510 2021-10-21T00:04:55.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1950155580 con 0x7f1950142f00 2021-10-21T00:04:55.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59816/0 (socket says 172.21.15.41:59816) 2021-10-21T00:04:55.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 -- 172.21.15.41:0/1380654541 learned_addr learned my addr 172.21.15.41:0/1380654541 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:55.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f1947fff700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 0x7f1950147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194ffff700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1950142f00 0x7f1950147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 -- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1950142f00 msgr2=0x7f1950147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1950142f00 0x7f1950147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 -- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 msgr2=0x7f1950147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 0x7f1950147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 -- 172.21.15.41:0/1380654541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194000b180 con 0x7f1950062330 2021-10-21T00:04:55.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f1947fff700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 0x7f1950147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:55.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194f7fe700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f1940002f70 tx=0x7f1940014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1940016070 con 0x7f1950062330 2021-10-21T00:04:55.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000d8f0 con 0x7f1950062330 2021-10-21T00:04:55.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1950155820 con 0x7f1950062330 2021-10-21T00:04:55.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194001e450 con 0x7f1950062330 2021-10-21T00:04:55.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1950148180 con 0x7f1950062330 2021-10-21T00:04:55.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.559+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1950145f90 con 0x7f1950062330 2021-10-21T00:04:55.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.563+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f194000f030 con 0x7f1950062330 2021-10-21T00:04:55.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.563+0000 7f194d7fa700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 0x7f1934055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.563+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f194006c680 con 0x7f1950062330 2021-10-21T00:04:55.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.563+0000 7f1947fff700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 0x7f1934055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.563+0000 7f1947fff700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 0x7f1934055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f193800b000 tx=0x7f1938008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.567+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f19400437c0 con 0x7f1950062330 2021-10-21T00:04:55.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.735+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1950057350 con 0x7f1950062330 2021-10-21T00:04:55.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f194d7fa700 1 -- 172.21.15.41:0/1380654541 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1940023020 con 0x7f1950062330 2021-10-21T00:04:55.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 msgr2=0x7f1934055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 0x7f1934055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f193800b000 tx=0x7f1938008040).stop 2021-10-21T00:04:55.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 msgr2=0x7f1950155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f1940002f70 tx=0x7f1940014000).stop 2021-10-21T00:04:55.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 shutdown_connections 2021-10-21T00:04:55.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f19340536a0 0x7f1934055b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1950142f00 0x7f1950147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f195013c510 0x7f1950147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 --2- 172.21.15.41:0/1380654541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1950062330 0x7f1950155cc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 >> 172.21.15.41:0/1380654541 conn(0x7f19500b9080 msgr2=0x7f19500b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 shutdown_connections 2021-10-21T00:04:55.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.743+0000 7f19549c6700 1 -- 172.21.15.41:0/1380654541 wait complete. 2021-10-21T00:04:55.753 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:04:55.761 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:04:55.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 Processor -- start 2021-10-21T00:04:55.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 -- start start 2021-10-21T00:04:55.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b900af690 0x7f4b900b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90147100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900ab280 con 0x7f4b900b1fd0 2021-10-21T00:04:55.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b90067d70 con 0x7f4b900af690 2021-10-21T00:04:55.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9744d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900ab520 con 0x7f4b90146cc0 2021-10-21T00:04:55.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9644b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4b900b1fd0 0x7f4b900afd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57594/0 (socket says 172.21.15.41:57594) 2021-10-21T00:04:55.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b9644b700 1 -- 172.21.15.41:0/1104593200 learned_addr learned my addr 172.21.15.41:0/1104593200 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:55.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/1104593200 >> v2:172.21.15.62:3300/0 conn(0x7f4b900af690 0x7f4b900b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b96c4c700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95449700 1 -- 172.21.15.41:0/1104593200 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090496708 0 0) 0x7f4b900ab280 con 0x7f4b900b1fd0 2021-10-21T00:04:55.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95449700 1 -- 172.21.15.41:0/1104593200 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003260 con 0x7f4b900b1fd0 2021-10-21T00:04:55.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 -- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 msgr2=0x7f4b90147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:55.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 -- 172.21.15.41:0/1104593200 >> v1:172.21.15.41:6789/0 conn(0x7f4b900b1fd0 legacy=0x7f4b900afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 -- 172.21.15.41:0/1104593200 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900ab7c0 con 0x7f4b900af690 2021-10-21T00:04:55.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900b0450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80006df0).ready entity=mon.1 client_cookie=5c5758dce3ba2c33 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.871+0000 7f4b95449700 1 -- 172.21.15.41:0/1104593200 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d4a0 con 0x7f4b900af690 2021-10-21T00:04:55.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b95449700 1 -- 172.21.15.41:0/1104593200 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80000e90 con 0x7f4b900af690 2021-10-21T00:04:55.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b95449700 1 -- 172.21.15.41:0/1104593200 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d7f0 con 0x7f4b900af690 2021-10-21T00:04:55.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 msgr2=0x7f4b900b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900b0450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80006df0).stop 2021-10-21T00:04:55.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- 172.21.15.41:0/1104593200 shutdown_connections 2021-10-21T00:04:55.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- 172.21.15.41:0/1104593200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900b0450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- 172.21.15.41:0/1104593200 >> 172.21.15.41:0/1104593200 conn(0x7f4b900b5700 msgr2=0x7f4b900b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:55.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- 172.21.15.41:0/1104593200 shutdown_connections 2021-10-21T00:04:55.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- 172.21.15.41:0/1104593200 wait complete. 2021-10-21T00:04:55.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 Processor -- start 2021-10-21T00:04:55.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- start start 2021-10-21T00:04:55.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90099cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9014ad40 con 0x7f4b900b1fd0 2021-10-21T00:04:55.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900ad4a0 con 0x7f4b900af690 2021-10-21T00:04:55.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9744d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900ad200 con 0x7f4b90146cc0 2021-10-21T00:04:55.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b95c4a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b95c4a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59832/0 (socket says 172.21.15.41:59832) 2021-10-21T00:04:55.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b95c4a700 1 -- 172.21.15.41:0/3340520567 learned_addr learned my addr 172.21.15.41:0/3340520567 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:55.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.875+0000 7f4b9644b700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b96c4c700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90099cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 -- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 msgr2=0x7f4b90099cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90099cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 -- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 msgr2=0x7f4b900ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:55.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:55.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 -- 172.21.15.41:0/3340520567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8000b180 con 0x7f4b900b1fd0 2021-10-21T00:04:55.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b95c4a700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b800139c0 con 0x7f4b900b1fd0 2021-10-21T00:04:55.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80013b20 con 0x7f4b900b1fd0 2021-10-21T00:04:55.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b80013e80 con 0x7f4b900b1fd0 2021-10-21T00:04:55.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9009abf0 con 0x7f4b900b1fd0 2021-10-21T00:04:55.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900aec60 con 0x7f4b900b1fd0 2021-10-21T00:04:55.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900ad070 con 0x7f4b900b1fd0 2021-10-21T00:04:55.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.879+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b80025030 con 0x7f4b900b1fd0 2021-10-21T00:04:55.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.883+0000 7f4b7f7fe700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 0x7f4b70055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:55.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.883+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b8006c7c0 con 0x7f4b900b1fd0 2021-10-21T00:04:55.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.883+0000 7f4b9644b700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 0x7f4b70055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:55.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.883+0000 7f4b9644b700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 0x7f4b70055ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f4b8c00d000 tx=0x7f4b8c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:55.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:55.891+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b80043790 con 0x7f4b900b1fd0 2021-10-21T00:04:56.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.059+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4b900b0940 con 0x7f4b900b1fd0 2021-10-21T00:04:56.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b7f7fe700 1 -- 172.21.15.41:0/3340520567 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4b80046db0 con 0x7f4b900b1fd0 2021-10-21T00:04:56.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 msgr2=0x7f4b70055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 0x7f4b70055ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f4b8c00d000 tx=0x7f4b8c009040).stop 2021-10-21T00:04:56.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 msgr2=0x7f4b900ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80014000).stop 2021-10-21T00:04:56.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 shutdown_connections 2021-10-21T00:04:56.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b70053610 0x7f4b70055ad0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b90146cc0 0x7f4b90099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b900b1fd0 0x7f4b900ac960 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 --2- 172.21.15.41:0/3340520567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b900af690 0x7f4b900ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 >> 172.21.15.41:0/3340520567 conn(0x7f4b900b5700 msgr2=0x7f4b9014b350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:56.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 shutdown_connections 2021-10-21T00:04:56.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.067+0000 7f4b9744d700 1 -- 172.21.15.41:0/3340520567 wait complete. 2021-10-21T00:04:56.074 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:04:56.082 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:56.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 Processor -- start 2021-10-21T00:04:56.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 -- start start 2021-10-21T00:04:56.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a64062330 0x7f0a640b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 0x7f0a6405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a640b3a20 0x7f0a6413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6405bd40 con 0x7f0a64062330 2021-10-21T00:04:56.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6405bf70 con 0x7f0a640b3a20 2021-10-21T00:04:56.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6ae3e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64142cb0 con 0x7f0a64062f70 2021-10-21T00:04:56.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a69e3c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a64062330 0x7f0a640b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a69e3c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a64062330 0x7f0a640b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59838/0 (socket says 172.21.15.41:59838) 2021-10-21T00:04:56.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a69e3c700 1 -- 172.21.15.41:0/53541986 learned_addr learned my addr 172.21.15.41:0/53541986 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:56.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6963b700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 0x7f0a6405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.183+0000 7f0a6a63d700 1 --2- 172.21.15.41:0/53541986 >> v2:172.21.15.62:3300/0 conn(0x7f0a640b3a20 0x7f0a6413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 -- 172.21.15.41:0/53541986 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 msgr2=0x7f0a6405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:56.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 0x7f0a6405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 -- 172.21.15.41:0/53541986 >> v2:172.21.15.62:3300/0 conn(0x7f0a640b3a20 msgr2=0x7f0a6413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:56.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/53541986 >> v2:172.21.15.62:3300/0 conn(0x7f0a640b3a20 0x7f0a6413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 -- 172.21.15.41:0/53541986 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64142950 con 0x7f0a64062330 2021-10-21T00:04:56.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6963b700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 0x7f0a6405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:56.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062330 0x7f0a640b3f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54006eb0).ready entity=mon.0 client_cookie=8ec7c515ff9b985c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a68e3a700 1 -- 172.21.15.41:0/53541986 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5400d570 con 0x7f0a64062330 2021-10-21T00:04:56.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a68e3a700 1 -- 172.21.15.41:0/53541986 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54000e90 con 0x7f0a64062330 2021-10-21T00:04:56.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a68e3a700 1 -- 172.21.15.41:0/53541986 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5400d900 con 0x7f0a64062330 2021-10-21T00:04:56.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/53541986 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062330 msgr2=0x7f0a640b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062330 0x7f0a640b3f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f0a54002f70 tx=0x7f0a54006eb0).stop 2021-10-21T00:04:56.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/53541986 shutdown_connections 2021-10-21T00:04:56.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/53541986 >> v2:172.21.15.62:3300/0 conn(0x7f0a640b3a20 0x7f0a6413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a64062f70 0x7f0a6405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/53541986 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062330 0x7f0a640b3f30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/53541986 >> 172.21.15.41:0/53541986 conn(0x7f0a640b9080 msgr2=0x7f0a640b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:56.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/53541986 shutdown_connections 2021-10-21T00:04:56.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.187+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/53541986 wait complete. 2021-10-21T00:04:56.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 Processor -- start 2021-10-21T00:04:56.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 -- start start 2021-10-21T00:04:56.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a64062330 0x7f0a64112840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 0x7f0a640b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64145500 con 0x7f0a64062f70 2021-10-21T00:04:56.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64152690 con 0x7f0a64062330 2021-10-21T00:04:56.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6ae3e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64152930 con 0x7f0a640b3a20 2021-10-21T00:04:56.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59846/0 (socket says 172.21.15.41:59846) 2021-10-21T00:04:56.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 -- 172.21.15.41:0/3778761129 learned_addr learned my addr 172.21.15.41:0/3778761129 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:56.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a64062330 0x7f0a64112840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6a63d700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 0x7f0a640b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 -- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 msgr2=0x7f0a640b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 0x7f0a640b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 -- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a64062330 msgr2=0x7f0a64112840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a64062330 0x7f0a64112840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 -- 172.21.15.41:0/3778761129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6000b180 con 0x7f0a64062f70 2021-10-21T00:04:56.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6a63d700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 0x7f0a640b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:04:56.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.191+0000 7f0a6963b700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f0a6000c000 tx=0x7f0a60006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a6000ca40 con 0x7f0a64062f70 2021-10-21T00:04:56.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000cba0 con 0x7f0a64062f70 2021-10-21T00:04:56.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5400b1e0 con 0x7f0a64062f70 2021-10-21T00:04:56.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a600123f0 con 0x7f0a64062f70 2021-10-21T00:04:56.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a64145f00 con 0x7f0a64062f70 2021-10-21T00:04:56.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a64057350 con 0x7f0a64062f70 2021-10-21T00:04:56.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.195+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a60012550 con 0x7f0a64062f70 2021-10-21T00:04:56.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.199+0000 7f0a52ffd700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 0x7f0a44055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.199+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a6006c000 con 0x7f0a64062f70 2021-10-21T00:04:56.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.199+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 0x7f0a44055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.199+0000 7f0a69e3c700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 0x7f0a44055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f0a5401a000 tx=0x7f0a54015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.203+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a60043100 con 0x7f0a64062f70 2021-10-21T00:04:56.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.363+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a6405d080 con 0x7f0a64062f70 2021-10-21T00:04:56.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.363+0000 7f0a52ffd700 1 -- 172.21.15.41:0/3778761129 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f0a60046720 con 0x7f0a64062f70 2021-10-21T00:04:56.369 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:56.369 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:04:56.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 msgr2=0x7f0a44055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 0x7f0a44055ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f0a5401a000 tx=0x7f0a54015000).stop 2021-10-21T00:04:56.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 msgr2=0x7f0a64145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f0a6000c000 tx=0x7f0a60006df0).stop 2021-10-21T00:04:56.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 shutdown_connections 2021-10-21T00:04:56.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a44053610 0x7f0a44055ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a640b3a20 0x7f0a640b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a64062f70 0x7f0a64145010 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 --2- 172.21.15.41:0/3778761129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a64062330 0x7f0a64112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 >> 172.21.15.41:0/3778761129 conn(0x7f0a640b9080 msgr2=0x7f0a6413f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:56.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 shutdown_connections 2021-10-21T00:04:56.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.367+0000 7f0a6ae3e700 1 -- 172.21.15.41:0/3778761129 wait complete. 2021-10-21T00:04:56.373 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:04:56.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:04:53.503441+0000', 'modified': '2021-10-21T00:04:54.506494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'b', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/4294881740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 4294881740}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 4294881740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:04:56.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:04:56.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:04:56.708 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5283,"want_state":"up:active","state":"up:active","rank_uptime":3.1818322719999999,"mdsmap_epoch":16,"osdmap_epoch":40,"osdmap_epoch_barrier":39,"uptime":7.5575692170000002} 2021-10-21T00:04:56.709 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5283, "mdsmap_epoch": 16, "osdmap_epoch": 40, "osdmap_epoch_barrier": 39, "rank_uptime": 3.181832272, "state": "up:active", "uptime": 7.557569217, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:04:56.710 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:04:56.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 Processor -- start 2021-10-21T00:04:56.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 -- start start 2021-10-21T00:04:56.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f45f80b3370 0x7f45f80b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f8138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f805fdd0 con 0x7f45f805f9f0 2021-10-21T00:04:56.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8140400 con 0x7f45f80b3370 2021-10-21T00:04:56.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.819+0000 7f45f7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80b27c0 con 0x7f45f80b0730 2021-10-21T00:04:56.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f45f80b3370 0x7f45f80b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f45f80b3370 0x7f45f80b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59852/0 (socket says 172.21.15.41:59852) 2021-10-21T00:04:56.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 -- 172.21.15.41:0/1430514104 learned_addr learned my addr 172.21.15.41:0/1430514104 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:56.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f77fe700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f8138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 -- 172.21.15.41:0/1430514104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 msgr2=0x7f45f8138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:56.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f8138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 -- 172.21.15.41:0/1430514104 >> v1:172.21.15.41:6789/0 conn(0x7f45f805f9f0 legacy=0x7f45f80b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 -- 172.21.15.41:0/1430514104 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8140080 con 0x7f45f80b3370 2021-10-21T00:04:56.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f67fc700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f80b0e50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f45f813f630 tx=0x7f45e0006eb0).ready entity=mon.0 client_cookie=199ecd01aacfa483 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f5ffb700 1 -- 172.21.15.41:0/1430514104 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e000d5c0 con 0x7f45f80b3370 2021-10-21T00:04:56.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f5ffb700 1 -- 172.21.15.41:0/1430514104 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0000e90 con 0x7f45f80b3370 2021-10-21T00:04:56.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f5ffb700 1 -- 172.21.15.41:0/1430514104 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e000d950 con 0x7f45f80b3370 2021-10-21T00:04:56.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 -- 172.21.15.41:0/1430514104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 msgr2=0x7f45f80b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f80b0e50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f45f813f630 tx=0x7f45e0006eb0).stop 2021-10-21T00:04:56.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 -- 172.21.15.41:0/1430514104 shutdown_connections 2021-10-21T00:04:56.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f8138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1430514104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f80b0e50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 -- 172.21.15.41:0/1430514104 >> 172.21.15.41:0/1430514104 conn(0x7f45f80637b0 msgr2=0x7f45f8063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:56.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 -- 172.21.15.41:0/1430514104 shutdown_connections 2021-10-21T00:04:56.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.823+0000 7f45f7fff700 1 -- 172.21.15.41:0/1430514104 wait complete. 2021-10-21T00:04:56.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 Processor -- start 2021-10-21T00:04:56.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- start start 2021-10-21T00:04:56.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f805f9f0 0x7f45f8065990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81303a0 con 0x7f45f80b3370 2021-10-21T00:04:56.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8141c40 con 0x7f45f805f9f0 2021-10-21T00:04:56.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8065fe0 con 0x7f45f80b0730 2021-10-21T00:04:56.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59860/0 (socket says 172.21.15.41:59860) 2021-10-21T00:04:56.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 -- 172.21.15.41:0/1887605400 learned_addr learned my addr 172.21.15.41:0/1887605400 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:56.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f67fc700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f6ffd700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f805f9f0 0x7f45f8065990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 -- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 msgr2=0x7f45f813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f813dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 -- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f805f9f0 msgr2=0x7f45f8065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f805f9f0 0x7f45f8065990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 -- 172.21.15.41:0/1887605400 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e000b1e0 con 0x7f45f80b3370 2021-10-21T00:04:56.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f77fe700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f45f8064730 tx=0x7f45f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f0013620 con 0x7f45f80b3370 2021-10-21T00:04:56.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0013780 con 0x7f45f80b3370 2021-10-21T00:04:56.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80662e0 con 0x7f45f80b3370 2021-10-21T00:04:56.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f0013ae0 con 0x7f45f80b3370 2021-10-21T00:04:56.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f8141890 con 0x7f45f80b3370 2021-10-21T00:04:56.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.827+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f8057350 con 0x7f45f80b3370 2021-10-21T00:04:56.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.831+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45f0013c40 con 0x7f45f80b3370 2021-10-21T00:04:56.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.831+0000 7f45effff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 0x7f45dc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:56.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.831+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45f006b5d0 con 0x7f45f80b3370 2021-10-21T00:04:56.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.831+0000 7f45f6ffd700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 0x7f45dc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:56.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.831+0000 7f45f6ffd700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 0x7f45dc0559b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f45e800d000 tx=0x7f45e8007b10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:56.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.835+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45f0042600 con 0x7f45f80b3370 2021-10-21T00:04:56.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.963+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45f805f100 con 0x7f45f80b3370 2021-10-21T00:04:56.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.963+0000 7f45effff700 1 -- 172.21.15.41:0/1887605400 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f45f0045c20 con 0x7f45f80b3370 2021-10-21T00:04:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:56.968 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":40,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:54.507266+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:04:51.918069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-21T00:04:53.087464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:04:56.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 msgr2=0x7f45dc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 0x7f45dc0559b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f45e800d000 tx=0x7f45e8007b10).stop 2021-10-21T00:04:56.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 msgr2=0x7f45f813e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:56.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f45f8064730 tx=0x7f45f0008040).stop 2021-10-21T00:04:56.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 shutdown_connections 2021-10-21T00:04:56.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45dc0534f0 0x7f45dc0559b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45f80b3370 0x7f45f813e230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45f80b0730 0x7f45f813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 --2- 172.21.15.41:0/1887605400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f805f9f0 0x7f45f8065990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:56.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 >> 172.21.15.41:0/1887605400 conn(0x7f45f80637b0 msgr2=0x7f45f8138ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:56.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 shutdown_connections 2021-10-21T00:04:56.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:56.967+0000 7f45f7fff700 1 -- 172.21.15.41:0/1887605400 wait complete. 2021-10-21T00:04:56.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:04:51.918069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:04:53.087464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:04:56.983 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:04:57.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 Processor -- start 2021-10-21T00:04:57.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 -- start start 2021-10-21T00:04:57.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa0340ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340b0b50 con 0x7fa034067a80 2021-10-21T00:04:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340b2550 con 0x7fa0340b2170 2021-10-21T00:04:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa033fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340b0d90 con 0x7fa0340af620 2021-10-21T00:04:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0337fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa034067a80 0x7fa034149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57638/0 (socket says 172.21.15.41:57638) 2021-10-21T00:04:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0337fe700 1 -- 172.21.15.41:0/2298097179 learned_addr learned my addr 172.21.15.41:0/2298097179 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa0340ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381770040 0 0) 0x7fa02c001490 con 0x7fa034067a80 2021-10-21T00:04:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa018003260 con 0x7fa034067a80 2021-10-21T00:04:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063090235 0 0) 0x7fa0340b2550 con 0x7fa0340b2170 2021-10-21T00:04:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c001490 con 0x7fa0340b2170 2021-10-21T00:04:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3628516958 0 0) 0x7fa018003260 con 0x7fa034067a80 2021-10-21T00:04:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 msgr2=0x7fa0340ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa0340ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 >> v1:172.21.15.62:6789/0 conn(0x7fa0340b2170 legacy=0x7fa0340ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340b1030 con 0x7fa034067a80 2021-10-21T00:04:57.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fa02c001b70 con 0x7fa034067a80 2021-10-21T00:04:57.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 >> v1:172.21.15.41:6789/0 conn(0x7fa034067a80 legacy=0x7fa034149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa018003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa018003e20 0x7fa018004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0180049f0 0x7fa018004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340b0d90 con 0x7fa018003e20 2021-10-21T00:04:57.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800b800 con 0x7fa0180049f0 2021-10-21T00:04:57.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800b9c0 con 0x7fa0340af620 2021-10-21T00:04:57.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa018003e20 0x7fa018004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa032ffd700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa018003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0337fe700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0180049f0 0x7fa018004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 -- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 msgr2=0x7fa018003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa0340af620 0x7fa018003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 -- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0180049f0 msgr2=0x7fa018004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0180049f0 0x7fa018004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 -- 172.21.15.41:0/2298097179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018003260 con 0x7fa018003e20 2021-10-21T00:04:57.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa0327fc700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa018003e20 0x7fa018004500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fa02800c000 tx=0x7fa028006df0).ready entity=mon.0 client_cookie=3045bba0232bd110 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02800e800 con 0x7fa018003e20 2021-10-21T00:04:57.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800e960 con 0x7fa018003e20 2021-10-21T00:04:57.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.091+0000 7fa031ffb700 1 -- 172.21.15.41:0/2298097179 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02800ecc0 con 0x7fa018003e20 2021-10-21T00:04:57.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- 172.21.15.41:0/2298097179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa018003e20 msgr2=0x7fa018004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 --2- 172.21.15.41:0/2298097179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa018003e20 0x7fa018004500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fa02800c000 tx=0x7fa028006df0).stop 2021-10-21T00:04:57.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa0337fe700 1 -- 172.21.15.41:0/2298097179 reap_dead start 2021-10-21T00:04:57.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- 172.21.15.41:0/2298097179 shutdown_connections 2021-10-21T00:04:57.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- 172.21.15.41:0/2298097179 >> 172.21.15.41:0/2298097179 conn(0x7fa0340b5700 msgr2=0x7fa0340b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- 172.21.15.41:0/2298097179 shutdown_connections 2021-10-21T00:04:57.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- 172.21.15.41:0/2298097179 wait complete. 2021-10-21T00:04:57.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 Processor -- start 2021-10-21T00:04:57.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- start start 2021-10-21T00:04:57.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 0x7fa0340b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa034148770 0x7fa034066810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340ae860 con 0x7fa034064080 2021-10-21T00:04:57.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340aeb00 con 0x7fa018003e20 2021-10-21T00:04:57.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa033fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340aeda0 con 0x7fa034148770 2021-10-21T00:04:57.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59882/0 (socket says 172.21.15.41:59882) 2021-10-21T00:04:57.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa0337fe700 1 -- 172.21.15.41:0/3999862893 learned_addr learned my addr 172.21.15.41:0/3999862893 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa0327fc700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa034148770 0x7fa034066810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.095+0000 7fa032ffd700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 0x7fa0340b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 -- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa034148770 msgr2=0x7fa034066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa034148770 0x7fa034066810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 -- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 msgr2=0x7fa0340b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 0x7fa0340b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 -- 172.21.15.41:0/3999862893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340b3550 con 0x7fa034064080 2021-10-21T00:04:57.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa032ffd700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 0x7fa0340b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:57.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa0337fe700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fa02c000b60 tx=0x7fa034061f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c00fa90 con 0x7fa034064080 2021-10-21T00:04:57.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00fbf0 con 0x7fa034064080 2021-10-21T00:04:57.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03408f3c0 con 0x7fa034064080 2021-10-21T00:04:57.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c0077d0 con 0x7fa034064080 2021-10-21T00:04:57.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa034067410 con 0x7fa034064080 2021-10-21T00:04:57.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0340aef60 con 0x7fa034064080 2021-10-21T00:04:57.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa02c01b030 con 0x7fa034064080 2021-10-21T00:04:57.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.099+0000 7fa023fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 0x7fa010055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.103+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa02c06b3c0 con 0x7fa034064080 2021-10-21T00:04:57.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.103+0000 7fa032ffd700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 0x7fa010055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.103+0000 7fa032ffd700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 0x7fa010055b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa024003000 tx=0x7fa024009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.107+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa02c042410 con 0x7fa034064080 2021-10-21T00:04:57.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.227+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa0340b0b50 con 0x7fa034064080 2021-10-21T00:04:57.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa023fff700 1 -- 172.21.15.41:0/3999862893 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v40) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa0340b0b50 con 0x7fa034064080 2021-10-21T00:04:57.233 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:04:57.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 msgr2=0x7fa010055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 0x7fa010055b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa024003000 tx=0x7fa024009040).stop 2021-10-21T00:04:57.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 msgr2=0x7fa034066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fa02c000b60 tx=0x7fa034061f20).stop 2021-10-21T00:04:57.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 shutdown_connections 2021-10-21T00:04:57.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa0100536a0 0x7fa010055b60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa034064080 0x7fa034066d00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa034148770 0x7fa034066810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 --2- 172.21.15.41:0/3999862893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018003e20 0x7fa0340b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 >> 172.21.15.41:0/3999862893 conn(0x7fa0340b5700 msgr2=0x7fa0340603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 shutdown_connections 2021-10-21T00:04:57.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.231+0000 7fa033fff700 1 -- 172.21.15.41:0/3999862893 wait complete. 2021-10-21T00:04:57.247 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:04:57.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 Processor -- start 2021-10-21T00:04:57.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 -- start start 2021-10-21T00:04:57.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7aa40b0690 0x7f7aa40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b26d0 0x7f7aa4141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40ba080 con 0x7f7aa40b9ca0 2021-10-21T00:04:57.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa405c670 con 0x7f7aa40b0690 2021-10-21T00:04:57.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa405c8e0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7aa40b0690 0x7f7aa40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7aa40b0690 0x7f7aa40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59888/0 (socket says 172.21.15.41:59888) 2021-10-21T00:04:57.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 -- 172.21.15.41:0/1030209249 learned_addr learned my addr 172.21.15.41:0/1030209249 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9d04700 1 --1- 172.21.15.41:0/1030209249 >> v1:172.21.15.41:6789/0 conn(0x7f7aa40b9ca0 0x7f7aa40b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57656/0 (socket says 172.21.15.41:57656) 2021-10-21T00:04:57.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aaa505700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b26d0 0x7f7aa4141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 -- 172.21.15.41:0/1030209249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b26d0 msgr2=0x7f7aa4141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b26d0 0x7f7aa4141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 -- 172.21.15.41:0/1030209249 >> v1:172.21.15.41:6789/0 conn(0x7f7aa40b9ca0 legacy=0x7f7aa40b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 -- 172.21.15.41:0/1030209249 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa405cb80 con 0x7f7aa40b0690 2021-10-21T00:04:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa9503700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b0690 0x7f7aa40b31e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7aa0002f70 tx=0x7f7aa0006eb0).ready entity=mon.0 client_cookie=2d32cd840fdaa5d1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa8d02700 1 -- 172.21.15.41:0/1030209249 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa000d5c0 con 0x7f7aa40b0690 2021-10-21T00:04:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa8d02700 1 -- 172.21.15.41:0/1030209249 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0000e90 con 0x7f7aa40b0690 2021-10-21T00:04:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aa8d02700 1 -- 172.21.15.41:0/1030209249 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa000d950 con 0x7f7aa40b0690 2021-10-21T00:04:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 -- 172.21.15.41:0/1030209249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b0690 msgr2=0x7f7aa40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.355+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b0690 0x7f7aa40b31e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7aa0002f70 tx=0x7f7aa0006eb0).stop 2021-10-21T00:04:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- 172.21.15.41:0/1030209249 shutdown_connections 2021-10-21T00:04:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b26d0 0x7f7aa4141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1030209249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b0690 0x7f7aa40b31e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- 172.21.15.41:0/1030209249 >> 172.21.15.41:0/1030209249 conn(0x7f7aa4062f00 msgr2=0x7f7aa40b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- 172.21.15.41:0/1030209249 shutdown_connections 2021-10-21T00:04:57.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- 172.21.15.41:0/1030209249 wait complete. 2021-10-21T00:04:57.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 Processor -- start 2021-10-21T00:04:57.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- start start 2021-10-21T00:04:57.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 0x7f7aa4147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 0x7f7aa41524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40acd80 con 0x7f7aa40b26d0 2021-10-21T00:04:57.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40ae4c0 con 0x7f7aa40b0690 2021-10-21T00:04:57.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aabf68700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4114570 con 0x7f7aa40b9ca0 2021-10-21T00:04:57.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59894/0 (socket says 172.21.15.41:59894) 2021-10-21T00:04:57.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 -- 172.21.15.41:0/1591117030 learned_addr learned my addr 172.21.15.41:0/1591117030 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aaa505700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 0x7f7aa41524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9d04700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 0x7f7aa4147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 -- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 msgr2=0x7f7aa41524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 0x7f7aa41524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 -- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 msgr2=0x7f7aa4147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 0x7f7aa4147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 -- 172.21.15.41:0/1591117030 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa000b1e0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aaa505700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 0x7f7aa41524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:57.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9d04700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 0x7f7aa4147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:04:57.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.359+0000 7f7aa9503700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7aa0002f70 tx=0x7f7aa0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa0011950 con 0x7f7aa40b26d0 2021-10-21T00:04:57.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0011ab0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa41142d0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa0011e10 con 0x7f7aa40b26d0 2021-10-21T00:04:57.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40adaa0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7aa0025030 con 0x7f7aa40b26d0 2021-10-21T00:04:57.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa40ae1a0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 0x7f7a84055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7aa006cd10 con 0x7f7aa40b26d0 2021-10-21T00:04:57.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7aa9d04700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 0x7f7a84055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.363+0000 7f7aa9d04700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 0x7f7a84055b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f7a9800b000 tx=0x7f7a980070e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.367+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7aa40ae1a0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.495+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7aa40ae1a0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.495+0000 7f7a96ffd700 1 -- 172.21.15.41:0/1591117030 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7aa40ae1a0 con 0x7f7aa40b26d0 2021-10-21T00:04:57.499 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:04:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 msgr2=0x7f7a84055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 0x7f7a84055b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f7a9800b000 tx=0x7f7a980070e0).stop 2021-10-21T00:04:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 msgr2=0x7f7aa40ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7aa0002f70 tx=0x7f7aa0015000).stop 2021-10-21T00:04:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 shutdown_connections 2021-10-21T00:04:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a840536a0 0x7f7a84055b60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7aa40b9ca0 0x7f7aa41524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7aa40b26d0 0x7f7aa40ac890 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 --2- 172.21.15.41:0/1591117030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7aa40b0690 0x7f7aa4147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 >> 172.21.15.41:0/1591117030 conn(0x7f7aa4062f00 msgr2=0x7f7aa4141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 shutdown_connections 2021-10-21T00:04:57.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.499+0000 7f7aabf68700 1 -- 172.21.15.41:0/1591117030 wait complete. 2021-10-21T00:04:57.512 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:04:57.532 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:57.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:57.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:57.539 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:57.542 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:04:57.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 Processor -- start 2021-10-21T00:04:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- start start 2021-10-21T00:04:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6af00b2e00 0x7f6af00672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af014b140 con 0x7f6af005bca0 2021-10-21T00:04:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af014aea0 con 0x7f6af00b2e00 2021-10-21T00:04:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00ac9a0 con 0x7f6af00b2730 2021-10-21T00:04:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aee7fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6af00b2e00 0x7f6af00672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aee7fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50166/0 (socket says 172.21.15.41:50166) 2021-10-21T00:04:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aee7fc700 1 -- 172.21.15.41:0/1784005006 learned_addr learned my addr 172.21.15.41:0/1784005006 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 -- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 msgr2=0x7f6af005c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 -- 172.21.15.41:0/1784005006 >> v1:172.21.15.62:6789/0 conn(0x7f6af005bca0 legacy=0x7f6af0146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 -- 172.21.15.41:0/1784005006 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00677b0 con 0x7f6af00b2e00 2021-10-21T00:04:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aee7fc700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aef7fe700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af00672c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f6ae80032f0 tx=0x7f6ae80091d0).ready entity=mon.1 client_cookie=e8fec582b8baa05a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aedffb700 1 -- 172.21.15.41:0/1784005006 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae800b6c0 con 0x7f6af00b2e00 2021-10-21T00:04:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aedffb700 1 -- 172.21.15.41:0/1784005006 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae800b820 con 0x7f6af00b2e00 2021-10-21T00:04:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aedffb700 1 -- 172.21.15.41:0/1784005006 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae800b990 con 0x7f6af00b2e00 2021-10-21T00:04:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 msgr2=0x7f6af00672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af00672c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f6ae80032f0 tx=0x7f6ae80091d0).stop 2021-10-21T00:04:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- 172.21.15.41:0/1784005006 shutdown_connections 2021-10-21T00:04:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af00672c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 --2- 172.21.15.41:0/1784005006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af005c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- 172.21.15.41:0/1784005006 >> 172.21.15.41:0/1784005006 conn(0x7f6af0069df0 msgr2=0x7f6af0063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- 172.21.15.41:0/1784005006 shutdown_connections 2021-10-21T00:04:57.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.619+0000 7f6aeffff700 1 -- 172.21.15.41:0/1784005006 wait complete. 2021-10-21T00:04:57.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 Processor -- start 2021-10-21T00:04:57.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 -- start start 2021-10-21T00:04:57.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af0149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af015a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af013fd20 con 0x7f6af005bca0 2021-10-21T00:04:57.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af015a590 con 0x7f6af00b2e00 2021-10-21T00:04:57.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01561d0 con 0x7f6af00b2730 2021-10-21T00:04:57.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59906/0 (socket says 172.21.15.41:59906) 2021-10-21T00:04:57.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 -- 172.21.15.41:0/95613801 learned_addr learned my addr 172.21.15.41:0/95613801 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aee7fc700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af0149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aef7fe700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af015a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 -- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 msgr2=0x7f6af0149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af0149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 -- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 msgr2=0x7f6af015a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af015a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 -- 172.21.15.41:0/95613801 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae000b1e0 con 0x7f6af005bca0 2021-10-21T00:04:57.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeeffd700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f6af015a6d0 tx=0x7f6ae4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae4007030 con 0x7f6af005bca0 2021-10-21T00:04:57.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4007190 con 0x7f6af005bca0 2021-10-21T00:04:57.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8009470 con 0x7f6af005bca0 2021-10-21T00:04:57.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.623+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ae4006510 con 0x7f6af005bca0 2021-10-21T00:04:57.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af0144080 con 0x7f6af005bca0 2021-10-21T00:04:57.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af0143c00 con 0x7f6af005bca0 2021-10-21T00:04:57.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ae4010030 con 0x7f6af005bca0 2021-10-21T00:04:57.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6adffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 0x7f6acc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6ae406b530 con 0x7f6af005bca0 2021-10-21T00:04:57.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.627+0000 7f6aee7fc700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 0x7f6acc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.631+0000 7f6aee7fc700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 0x7f6acc0559b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ae000b000 tx=0x7f6ae0006eb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.635+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ae4042690 con 0x7f6af005bca0 2021-10-21T00:04:57.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.759+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6af0156340 con 0x7f6af005bca0 2021-10-21T00:04:57.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.759+0000 7f6adffff700 1 -- 172.21.15.41:0/95613801 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6ae4045cb0 con 0x7f6af005bca0 2021-10-21T00:04:57.765 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:04:57.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 msgr2=0x7f6acc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 0x7f6acc0559b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6ae000b000 tx=0x7f6ae0006eb0).stop 2021-10-21T00:04:57.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 msgr2=0x7f6af00ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f6af015a6d0 tx=0x7f6ae4007c10).stop 2021-10-21T00:04:57.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 shutdown_connections 2021-10-21T00:04:57.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6acc0534f0 0x7f6acc0559b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6af00b2e00 0x7f6af015a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6af00b2730 0x7f6af0149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 --2- 172.21.15.41:0/95613801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6af005bca0 0x7f6af00ad4a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 >> 172.21.15.41:0/95613801 conn(0x7f6af0069df0 msgr2=0x7f6af00652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 shutdown_connections 2021-10-21T00:04:57.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.763+0000 7f6aeffff700 1 -- 172.21.15.41:0/95613801 wait complete. 2021-10-21T00:04:57.778 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:04:57.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 Processor -- start 2021-10-21T00:04:57.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 -- start start 2021-10-21T00:04:57.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b9ca0 0x7f58480b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f58480b26d0 0x7f5848141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480ba080 con 0x7f58480b31e0 2021-10-21T00:04:57.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584805c670 con 0x7f58480b26d0 2021-10-21T00:04:57.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f584de65700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584805c8e0 con 0x7f58480b9ca0 2021-10-21T00:04:57.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f58480b26d0 0x7f5848141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f58480b26d0 0x7f5848141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59918/0 (socket says 172.21.15.41:59918) 2021-10-21T00:04:57.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 -- 172.21.15.41:0/1998272638 learned_addr learned my addr 172.21.15.41:0/1998272638 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f58477fe700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b9ca0 0x7f58480b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f58467fc700 1 -- 172.21.15.41:0/1998272638 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110198231 0 0) 0x7f58480ba080 con 0x7f58480b31e0 2021-10-21T00:04:57.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 -- 172.21.15.41:0/1998272638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b9ca0 msgr2=0x7f58480b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:04:57.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b9ca0 0x7f58480b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 -- 172.21.15.41:0/1998272638 >> v1:172.21.15.62:6789/0 conn(0x7f58480b31e0 legacy=0x7f58480b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 -- 172.21.15.41:0/1998272638 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584805cb80 con 0x7f58480b26d0 2021-10-21T00:04:57.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.887+0000 7f5847fff700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f5848141bc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f58400032f0 tx=0x7f5840009290).ready entity=mon.0 client_cookie=2158abeb839bda14 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f58467fc700 1 -- 172.21.15.41:0/1998272638 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584000b8a0 con 0x7f58480b26d0 2021-10-21T00:04:57.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f58467fc700 1 -- 172.21.15.41:0/1998272638 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584000ba00 con 0x7f58480b26d0 2021-10-21T00:04:57.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f58467fc700 1 -- 172.21.15.41:0/1998272638 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584000bb70 con 0x7f58480b26d0 2021-10-21T00:04:57.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- 172.21.15.41:0/1998272638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 msgr2=0x7f5848141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f5848141bc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f58400032f0 tx=0x7f5840009290).stop 2021-10-21T00:04:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- 172.21.15.41:0/1998272638 shutdown_connections 2021-10-21T00:04:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f5848141bc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 --2- 172.21.15.41:0/1998272638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b9ca0 0x7f58480b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- 172.21.15.41:0/1998272638 >> 172.21.15.41:0/1998272638 conn(0x7f5848062f00 msgr2=0x7f58480b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- 172.21.15.41:0/1998272638 shutdown_connections 2021-10-21T00:04:57.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- 172.21.15.41:0/1998272638 wait complete. 2021-10-21T00:04:57.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 Processor -- start 2021-10-21T00:04:57.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.891+0000 7f584de65700 1 -- start start 2021-10-21T00:04:57.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b31e0 0x7f58481475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58480b9ca0 0x7f5848155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5848114160 con 0x7f58480b26d0 2021-10-21T00:04:57.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480ae1e0 con 0x7f58480b9ca0 2021-10-21T00:04:57.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5848155200 con 0x7f58480b31e0 2021-10-21T00:04:57.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59920/0 (socket says 172.21.15.41:59920) 2021-10-21T00:04:57.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 -- 172.21.15.41:0/4109114999 learned_addr learned my addr 172.21.15.41:0/4109114999 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:57.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f5847fff700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58480b9ca0 0x7f5848155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f5846ffd700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b31e0 0x7f58481475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 -- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b31e0 msgr2=0x7f58481475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b31e0 0x7f58481475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 -- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58480b9ca0 msgr2=0x7f5848155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:57.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58480b9ca0 0x7f5848155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:57.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 -- 172.21.15.41:0/4109114999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840009530 con 0x7f58480b26d0 2021-10-21T00:04:57.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f58477fe700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f583c00c000 tx=0x7f583c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c010780 con 0x7f58480b26d0 2021-10-21T00:04:57.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0108e0 con 0x7f58480b26d0 2021-10-21T00:04:57.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58481554a0 con 0x7f58480b26d0 2021-10-21T00:04:57.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c010c40 con 0x7f58480b26d0 2021-10-21T00:04:57.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.895+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5848155fd0 con 0x7f58480b26d0 2021-10-21T00:04:57.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5848155630 con 0x7f58480b26d0 2021-10-21T00:04:57.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f583c01c460 con 0x7f58480b26d0 2021-10-21T00:04:57.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f5844ff9700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 0x7f5828055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:57.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f583c06bda0 con 0x7f58480b26d0 2021-10-21T00:04:57.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f5846ffd700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 0x7f5828055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:57.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.899+0000 7f5846ffd700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 0x7f5828055ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f583800b000 tx=0x7f5838009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:57.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:57.907+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f583c042ea0 con 0x7f58480b26d0 2021-10-21T00:04:58.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.035+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5848057350 con 0x7f58480b26d0 2021-10-21T00:04:58.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f5844ff9700 1 -- 172.21.15.41:0/4109114999 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+10 (secure 0 0 0) 0x7f583c0464c0 con 0x7f58480b26d0 2021-10-21T00:04:58.041 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:04:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 msgr2=0x7f5828055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 0x7f5828055ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f583800b000 tx=0x7f5838009040).stop 2021-10-21T00:04:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 msgr2=0x7f58480aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f583c00c000 tx=0x7f583c006df0).stop 2021-10-21T00:04:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 shutdown_connections 2021-10-21T00:04:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5828053610 0x7f5828055ad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58480b9ca0 0x7f5848155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480b31e0 0x7f58481475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 --2- 172.21.15.41:0/4109114999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58480b26d0 0x7f58480aec20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 >> 172.21.15.41:0/4109114999 conn(0x7f5848062f00 msgr2=0x7f5848069600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:58.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 shutdown_connections 2021-10-21T00:04:58.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.039+0000 7f584de65700 1 -- 172.21.15.41:0/4109114999 wait complete. 2021-10-21T00:04:58.055 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:04:58.055 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:04:58.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.155+0000 7f95196b3700 1 Processor -- start 2021-10-21T00:04:58.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.155+0000 7f95196b3700 1 -- start start 2021-10-21T00:04:58.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f951405f9f0 0x7f951414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:58.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140609d0 con 0x7f95140aa750 2021-10-21T00:04:58.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951405fdd0 con 0x7f951414b350 2021-10-21T00:04:58.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95140b1620 con 0x7f951405f9f0 2021-10-21T00:04:58.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95127fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f95140aa750 0x7f951414ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57698/0 (socket says 172.21.15.41:57698) 2021-10-21T00:04:58.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95127fc700 1 -- 172.21.15.41:0/4180054108 learned_addr learned my addr 172.21.15.41:0/4180054108 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:04:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9512ffd700 1 --2- 172.21.15.41:0/4180054108 >> v2:172.21.15.62:3300/0 conn(0x7f951405f9f0 0x7f951414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9511ffb700 1 -- 172.21.15.41:0/4180054108 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698498490 0 0) 0x7f95140609d0 con 0x7f95140aa750 2021-10-21T00:04:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9511ffb700 1 -- 172.21.15.41:0/4180054108 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f8003260 con 0x7f95140aa750 2021-10-21T00:04:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9512ffd700 1 -- 172.21.15.41:0/4180054108 >> v1:172.21.15.62:6789/0 conn(0x7f951414b350 legacy=0x7f95140af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9512ffd700 1 -- 172.21.15.41:0/4180054108 >> v1:172.21.15.41:6789/0 conn(0x7f95140aa750 legacy=0x7f951414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9512ffd700 1 -- 172.21.15.41:0/4180054108 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140b1380 con 0x7f951405f9f0 2021-10-21T00:04:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9512ffd700 1 --2- 172.21.15.41:0/4180054108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951405f9f0 0x7f951414a750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9508002f70 tx=0x7f9508006df0).ready entity=mon.1 client_cookie=57bd74854f655fb0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9511ffb700 1 -- 172.21.15.41:0/4180054108 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950800d610 con 0x7f951405f9f0 2021-10-21T00:04:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9511ffb700 1 -- 172.21.15.41:0/4180054108 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508000e90 con 0x7f951405f9f0 2021-10-21T00:04:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f9511ffb700 1 -- 172.21.15.41:0/4180054108 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950800d960 con 0x7f951405f9f0 2021-10-21T00:04:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- 172.21.15.41:0/4180054108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951405f9f0 msgr2=0x7f951414a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 --2- 172.21.15.41:0/4180054108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951405f9f0 0x7f951414a750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f9508002f70 tx=0x7f9508006df0).stop 2021-10-21T00:04:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- 172.21.15.41:0/4180054108 shutdown_connections 2021-10-21T00:04:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 --2- 172.21.15.41:0/4180054108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951405f9f0 0x7f951414a750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- 172.21.15.41:0/4180054108 >> 172.21.15.41:0/4180054108 conn(0x7f951405bca0 msgr2=0x7f951405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- 172.21.15.41:0/4180054108 shutdown_connections 2021-10-21T00:04:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.159+0000 7f95196b3700 1 -- 172.21.15.41:0/4180054108 wait complete. 2021-10-21T00:04:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 Processor -- start 2021-10-21T00:04:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- start start 2021-10-21T00:04:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 0x7f951415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140ac700 con 0x7f951414b350 2021-10-21T00:04:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140ac9a0 con 0x7f95140aa750 2021-10-21T00:04:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140acc40 con 0x7f951405f9f0 2021-10-21T00:04:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f9512ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 0x7f951415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95127fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95127fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43622/0 (socket says 172.21.15.41:43622) 2021-10-21T00:04:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f9512ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 0x7f951415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50200/0 (socket says 172.21.15.41:50200) 2021-10-21T00:04:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95127fc700 1 -- 172.21.15.41:0/1607080 learned_addr learned my addr 172.21.15.41:0/1607080 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:04:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59938/0 (socket says 172.21.15.41:59938) 2021-10-21T00:04:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 -- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 msgr2=0x7f951415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 0x7f951415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 -- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 msgr2=0x7f95140982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 -- 172.21.15.41:0/1607080 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950800b180 con 0x7f951414b350 2021-10-21T00:04:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95127fc700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:04:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95137fe700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f951405ced0 tx=0x7f950c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c00ce10 con 0x7f951414b350 2021-10-21T00:04:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c006aa0 con 0x7f951414b350 2021-10-21T00:04:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95141467d0 con 0x7f951414b350 2021-10-21T00:04:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c006e00 con 0x7f951414b350 2021-10-21T00:04:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.163+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95140996b0 con 0x7f951414b350 2021-10-21T00:04:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95140678f0 con 0x7f951414b350 2021-10-21T00:04:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f950c010030 con 0x7f951414b350 2021-10-21T00:04:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f9503fff700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 0x7f94f0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:04:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f950c06b6b0 con 0x7f951414b350 2021-10-21T00:04:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f9512ffd700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 0x7f94f0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:04:58.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.167+0000 7f9512ffd700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 0x7f94f0055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f950801a000 tx=0x7f9508014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:04:58.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.175+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f950c042730 con 0x7f951414b350 2021-10-21T00:04:58.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.339+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9514057350 con 0x7f951414b350 2021-10-21T00:04:58.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.339+0000 7f9503fff700 1 -- 172.21.15.41:0/1607080 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f950c045d50 con 0x7f951414b350 2021-10-21T00:04:58.344 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:04:58.345 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:04:58.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 msgr2=0x7f94f0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 0x7f94f0055b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f950801a000 tx=0x7f9508014000).stop 2021-10-21T00:04:58.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 msgr2=0x7f95140991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:04:58.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f951405ced0 tx=0x7f950c007f10).stop 2021-10-21T00:04:58.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 shutdown_connections 2021-10-21T00:04:58.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94f00536d0 0x7f94f0055b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f951414b350 0x7f95140991c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95140aa750 0x7f95140982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 --2- 172.21.15.41:0/1607080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f951405f9f0 0x7f951415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:04:58.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 >> 172.21.15.41:0/1607080 conn(0x7f951405bca0 msgr2=0x7f951405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:04:58.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 shutdown_connections 2021-10-21T00:04:58.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:04:58.343+0000 7f95196b3700 1 -- 172.21.15.41:0/1607080 wait complete. 2021-10-21T00:04:58.351 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:04:58.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:04:53.503441+0000', 'modified': '2021-10-21T00:04:54.506494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'b', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/4294881740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 4294881740}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 4294881740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:04:58.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:04:58.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:04:58.673 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5283,"want_state":"up:active","state":"up:active","rank_uptime":5.1553386259999998,"mdsmap_epoch":16,"osdmap_epoch":40,"osdmap_epoch_barrier":39,"uptime":9.5310657770000002} 2021-10-21T00:04:58.673 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5283, "mdsmap_epoch": 16, "osdmap_epoch": 40, "osdmap_epoch_barrier": 39, "rank_uptime": 5.155338626, "state": "up:active", "uptime": 9.531065777, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:04:58.674 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:04:58.675 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:04:58.675 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:04:58.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:58.677 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:58.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:04:58.746 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:04:58.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:04:58.759 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:04:58.760 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:04:58.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:58.762 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:04:58.767 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:04:58.768 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:04:58.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:04:58.831 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:04:58.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:04:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:04:58.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:04:58.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:04:58.848 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:04:58.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14025]: starting ceph client 2021-10-21T00:04:58.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:04:58.884+0000 7f893a7db080 -1 init, newargv = 0x55a57605ea20 newargc=9 2021-10-21T00:04:58.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14025]: starting fuse 2021-10-21T00:04:59.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:05:00.015 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:05:00.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:05:00.026 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:05:00.027 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:05:00.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.029 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:05:00.078 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:05:00.079 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:05:00.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:05:00.080 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:05:00.080 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:05:00.081 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:05:00.081 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:05:00.082 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.082 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:05:00.083 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:05:00.083 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:05:00.083 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.084 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:05:00.084 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:05:00.085 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:05:00.086 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:05:00.086 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.086 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:05:00.087 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:05:00.087 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:05:00.088 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:05:00.088 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:05:00.088 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.089 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:05:00.089 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:05:00.134 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14025.asok 2021-10-21T00:05:00.139 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14025.asok 2021-10-21T00:05:00.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14025.asok status 2021-10-21T00:05:00.227 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:05:00.227 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:05:00.227 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:05:00.228 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:05:00.228 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:05:00.228 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:05:00.228 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:05:00.228 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14025", 2021-10-21T00:05:00.229 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:05:00.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:00.229 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:05:00.229 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:05:00.229 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5389, 2021-10-21T00:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:05:00.230 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5389 2021-10-21T00:05:00.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:00.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:05:00.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:05:00.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:05:00.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2160351327 2021-10-21T00:05:00.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:05:00.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:00.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:05:00.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:05:00.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:05:00.233 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2160351327 2021-10-21T00:05:00.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:00.234 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5389 172.21.15.71:0/2160351327", 2021-10-21T00:05:00.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/2160351327", 2021-10-21T00:05:00.234 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:05:00.234 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 16, 2021-10-21T00:05:00.235 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 40, 2021-10-21T00:05:00.235 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:05:00.235 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:05:00.236 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:05:00.237 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:05:00.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.239 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:05:00.240 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:00.246 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:05:00.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:05:00.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.248 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:00.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:00.264 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:05:00.264 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:00.314 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:05:00.315 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:05:00.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:05:00.317 DEBUG:teuthology.orchestra.run.smithi071:> import sys 2021-10-21T00:05:00.317 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:05:00.318 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:05:00.318 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.318 DEBUG:teuthology.orchestra.run.smithi071:> n = 1000 2021-10-21T00:05:00.319 DEBUG:teuthology.orchestra.run.smithi071:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-21T00:05:00.320 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.320 DEBUG:teuthology.orchestra.run.smithi071:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-21T00:05:00.321 DEBUG:teuthology.orchestra.run.smithi071:> os.makedirs(os.path.dirname(abs_path)) 2021-10-21T00:05:00.321 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:00.321 DEBUG:teuthology.orchestra.run.smithi071:> for i in range(0, n): 2021-10-21T00:05:00.322 DEBUG:teuthology.orchestra.run.smithi071:> fname = "{0}_{1}".format(abs_path, i) 2021-10-21T00:05:00.322 DEBUG:teuthology.orchestra.run.smithi071:> with open(fname, '"'"'w'"'"') as f: 2021-10-21T00:05:00.323 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:05:00.323 DEBUG:teuthology.orchestra.run.smithi071:> if True: 2021-10-21T00:05:00.323 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:05:00.324 DEBUG:teuthology.orchestra.run.smithi071:> os.fsync(f.fileno()) 2021-10-21T00:05:00.324 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:05:10.201 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:05:10.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 Processor -- start 2021-10-21T00:05:10.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 -- start start 2021-10-21T00:05:10.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 0x7fe010143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe0100b3bc0 0x7fe010143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe010142bc0 con 0x7fe010143a00 2021-10-21T00:05:10.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0101429a0 con 0x7fe0100b3bc0 2021-10-21T00:05:10.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.307+0000 7fe017479700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ba050 con 0x7fe0100b9c70 2021-10-21T00:05:10.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe0100b3bc0 0x7fe010143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe0100b3bc0 0x7fe010143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59942/0 (socket says 172.21.15.41:59942) 2021-10-21T00:05:10.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 -- 172.21.15.41:0/1394352122 learned_addr learned my addr 172.21.15.41:0/1394352122 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:10.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe015215700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 0x7fe010143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 -- 172.21.15.41:0/1394352122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 msgr2=0x7fe010143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:10.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 0x7fe010143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 -- 172.21.15.41:0/1394352122 >> v1:172.21.15.62:6789/0 conn(0x7fe010143a00 legacy=0x7fe01005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:10.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 -- 172.21.15.41:0/1394352122 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0101463c0 con 0x7fe0100b3bc0 2021-10-21T00:05:10.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe015215700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 0x7fe010143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:05:10.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe014a14700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b3bc0 0x7fe010143510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe0100b1ab0 tx=0x7fe00c006eb0).ready entity=mon.0 client_cookie=60b1cfef70cf1383 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe007fff700 1 -- 172.21.15.41:0/1394352122 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c00d5c0 con 0x7fe0100b3bc0 2021-10-21T00:05:10.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe007fff700 1 -- 172.21.15.41:0/1394352122 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c000e90 con 0x7fe0100b3bc0 2021-10-21T00:05:10.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe007fff700 1 -- 172.21.15.41:0/1394352122 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c00d950 con 0x7fe0100b3bc0 2021-10-21T00:05:10.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 -- 172.21.15.41:0/1394352122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b3bc0 msgr2=0x7fe010143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b3bc0 0x7fe010143510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe0100b1ab0 tx=0x7fe00c006eb0).stop 2021-10-21T00:05:10.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 -- 172.21.15.41:0/1394352122 shutdown_connections 2021-10-21T00:05:10.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b3bc0 0x7fe010143510 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 --2- 172.21.15.41:0/1394352122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b9c70 0x7fe010143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 -- 172.21.15.41:0/1394352122 >> 172.21.15.41:0/1394352122 conn(0x7fe010062e80 msgr2=0x7fe0100b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:10.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 -- 172.21.15.41:0/1394352122 shutdown_connections 2021-10-21T00:05:10.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.311+0000 7fe017479700 1 -- 172.21.15.41:0/1394352122 wait complete. 2021-10-21T00:05:10.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 Processor -- start 2021-10-21T00:05:10.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 -- start start 2021-10-21T00:05:10.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b3bc0 0x7fe010149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 0x7fe010140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ad3d0 con 0x7fe0100b9c70 2021-10-21T00:05:10.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ad570 con 0x7fe010143a00 2021-10-21T00:05:10.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe017479700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100accd0 con 0x7fe0100b3bc0 2021-10-21T00:05:10.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59950/0 (socket says 172.21.15.41:59950) 2021-10-21T00:05:10.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 -- 172.21.15.41:0/1281382836 learned_addr learned my addr 172.21.15.41:0/1281382836 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:10.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe015a16700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 0x7fe010140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe015215700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b3bc0 0x7fe010149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 -- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b3bc0 msgr2=0x7fe010149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b3bc0 0x7fe010149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 -- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 msgr2=0x7fe010140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 0x7fe010140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe014a14700 1 -- 172.21.15.41:0/1281382836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c00b1e0 con 0x7fe0100b9c70 2021-10-21T00:05:10.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.315+0000 7fe015a16700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 0x7fe010140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:05:10.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe014a14700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe0100ad510 tx=0x7fe00c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c011860 con 0x7fe0100b9c70 2021-10-21T00:05:10.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0119c0 con 0x7fe0100b9c70 2021-10-21T00:05:10.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0100ad7a0 con 0x7fe0100b9c70 2021-10-21T00:05:10.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00c011d20 con 0x7fe0100b9c70 2021-10-21T00:05:10.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe010140570 con 0x7fe0100b9c70 2021-10-21T00:05:10.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe010057350 con 0x7fe0100b9c70 2021-10-21T00:05:10.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe00c025030 con 0x7fe0100b9c70 2021-10-21T00:05:10.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 0x7fdff8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe00c06cbd0 con 0x7fe0100b9c70 2021-10-21T00:05:10.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe015215700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 0x7fdff8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.319+0000 7fe015215700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 0x7fdff8055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe00000d000 tx=0x7fe000008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.327+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe00c043d30 con 0x7fe0100b9c70 2021-10-21T00:05:10.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.491+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe010141620 con 0x7fe0100b9c70 2021-10-21T00:05:10.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.491+0000 7fe0067fc700 1 -- 172.21.15.41:0/1281382836 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fe00c023070 con 0x7fe0100b9c70 2021-10-21T00:05:10.495 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:05:10.495 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:05:10.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 msgr2=0x7fdff8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 0x7fdff8055ad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe00000d000 tx=0x7fe000008040).stop 2021-10-21T00:05:10.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 msgr2=0x7fe01013fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe0100ad510 tx=0x7fe00c015000).stop 2021-10-21T00:05:10.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 shutdown_connections 2021-10-21T00:05:10.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdff8053610 0x7fdff8055ad0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe010143a00 0x7fe010140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe0100b9c70 0x7fe01013fb90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 --2- 172.21.15.41:0/1281382836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0100b3bc0 0x7fe010149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 >> 172.21.15.41:0/1281382836 conn(0x7fe010062e80 msgr2=0x7fe010142d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:10.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 shutdown_connections 2021-10-21T00:05:10.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.495+0000 7fe017479700 1 -- 172.21.15.41:0/1281382836 wait complete. 2021-10-21T00:05:10.500 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:05:10.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2021-10-21T00:05:10.619 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-21T00:05:10.620 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-21T00:05:10.621 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:05:10.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 Processor -- start 2021-10-21T00:05:10.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 -- start start 2021-10-21T00:05:10.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd924152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240609d0 con 0x7fd92405f9f0 2021-10-21T00:05:10.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92405fdd0 con 0x7fd9240aa750 2021-10-21T00:05:10.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd92b365700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240b1620 con 0x7fd92414fc90 2021-10-21T00:05:10.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929101700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd92405f9f0 0x7fd92414a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57726/0 (socket says 172.21.15.41:57726) 2021-10-21T00:05:10.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929101700 1 -- 172.21.15.41:0/2162446706 learned_addr learned my addr 172.21.15.41:0/2162446706 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:05:10.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd924152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606259504 0 0) 0x7fd9240609d0 con 0x7fd92405f9f0 2021-10-21T00:05:10.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908003260 con 0x7fd92405f9f0 2021-10-21T00:05:10.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443417277 0 0) 0x7fd92405fdd0 con 0x7fd9240aa750 2021-10-21T00:05:10.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9240609d0 con 0x7fd9240aa750 2021-10-21T00:05:10.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592499053 0 0) 0x7fd908003260 con 0x7fd92405f9f0 2021-10-21T00:05:10.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 msgr2=0x7fd924152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:10.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd924152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 >> v1:172.21.15.62:6789/0 conn(0x7fd9240aa750 legacy=0x7fd92414ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92414b570 con 0x7fd92405f9f0 2021-10-21T00:05:10.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd914001680 con 0x7fd92405f9f0 2021-10-21T00:05:10.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 >> v1:172.21.15.41:6789/0 conn(0x7fd92405f9f0 legacy=0x7fd92414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd908003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd908003e20 0x7fd908004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd908004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240b1620 con 0x7fd9080049f0 2021-10-21T00:05:10.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90800b800 con 0x7fd908003e20 2021-10-21T00:05:10.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90800b9c0 con 0x7fd92414fc90 2021-10-21T00:05:10.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd908004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929101700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd908003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd928900700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd908003e20 0x7fd908004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 -- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 msgr2=0x7fd908003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:10.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd92414fc90 0x7fd908003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 -- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd908003e20 msgr2=0x7fd908004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:10.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd908003e20 0x7fd908004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 -- 172.21.15.41:0/2162446706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908003260 con 0x7fd9080049f0 2021-10-21T00:05:10.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd928900700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd908003e20 0x7fd908004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:10.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.731+0000 7fd929902700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd908004e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fd91c00c000 tx=0x7fd91c0091d0).ready entity=mon.0 client_cookie=4205fd24a646245f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91c00e6e0 con 0x7fd9080049f0 2021-10-21T00:05:10.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c00e840 con 0x7fd9080049f0 2021-10-21T00:05:10.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd91bfff700 1 -- 172.21.15.41:0/2162446706 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91c00eba0 con 0x7fd9080049f0 2021-10-21T00:05:10.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- 172.21.15.41:0/2162446706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 msgr2=0x7fd908004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 --2- 172.21.15.41:0/2162446706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd908004e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fd91c00c000 tx=0x7fd91c0091d0).stop 2021-10-21T00:05:10.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd929902700 1 -- 172.21.15.41:0/2162446706 reap_dead start 2021-10-21T00:05:10.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- 172.21.15.41:0/2162446706 shutdown_connections 2021-10-21T00:05:10.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- 172.21.15.41:0/2162446706 >> 172.21.15.41:0/2162446706 conn(0x7fd92405bca0 msgr2=0x7fd92405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:10.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- 172.21.15.41:0/2162446706 shutdown_connections 2021-10-21T00:05:10.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- 172.21.15.41:0/2162446706 wait complete. 2021-10-21T00:05:10.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 Processor -- start 2021-10-21T00:05:10.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- start start 2021-10-21T00:05:10.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 0x7fd924159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd924159e60 0x7fd92415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92415a800 con 0x7fd9080049f0 2021-10-21T00:05:10.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92409a2d0 con 0x7fd924159e60 2021-10-21T00:05:10.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd92b365700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240aedf0 con 0x7fd924098a70 2021-10-21T00:05:10.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd929101700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd929101700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59968/0 (socket says 172.21.15.41:59968) 2021-10-21T00:05:10.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd929101700 1 -- 172.21.15.41:0/3233053061 learned_addr learned my addr 172.21.15.41:0/3233053061 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:10.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd929902700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd924159e60 0x7fd92415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.735+0000 7fd928900700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 0x7fd924159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 -- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 msgr2=0x7fd924159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 0x7fd924159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 -- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd924159e60 msgr2=0x7fd92415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd924159e60 0x7fd92415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 -- 172.21.15.41:0/3233053061 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240af090 con 0x7fd9080049f0 2021-10-21T00:05:10.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd928900700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 0x7fd924159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:10.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd929101700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd92415a940 tx=0x7fd9240b1270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd914012540 con 0x7fd9080049f0 2021-10-21T00:05:10.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9140126a0 con 0x7fd9080049f0 2021-10-21T00:05:10.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd924099200 con 0x7fd9080049f0 2021-10-21T00:05:10.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd914012a00 con 0x7fd9080049f0 2021-10-21T00:05:10.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92413d400 con 0x7fd9080049f0 2021-10-21T00:05:10.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9240b1380 con 0x7fd9080049f0 2021-10-21T00:05:10.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd91401b030 con 0x7fd9080049f0 2021-10-21T00:05:10.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 0x7fd90c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:10.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.739+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd91406b070 con 0x7fd9080049f0 2021-10-21T00:05:10.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.743+0000 7fd928900700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 0x7fd90c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:10.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.743+0000 7fd928900700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 0x7fd90c0559e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd92000d000 tx=0x7fd920009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:10.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.747+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9140421d0 con 0x7fd9080049f0 2021-10-21T00:05:10.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.911+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd924057350 con 0x7fd9080049f0 2021-10-21T00:05:10.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd91a7fc700 1 -- 172.21.15.41:0/3233053061 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fd914019030 con 0x7fd9080049f0 2021-10-21T00:05:10.918 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:05:10.919 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:05:10.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 msgr2=0x7fd90c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 0x7fd90c0559e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd92000d000 tx=0x7fd920009040).stop 2021-10-21T00:05:10.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 msgr2=0x7fd9240ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:10.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd92415a940 tx=0x7fd9240b1270).stop 2021-10-21T00:05:10.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 shutdown_connections 2021-10-21T00:05:10.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd90c053520 0x7fd90c0559e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd924159e60 0x7fd92415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd924098a70 0x7fd924159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 --2- 172.21.15.41:0/3233053061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9080049f0 0x7fd9240ac5a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:10.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 >> 172.21.15.41:0/3233053061 conn(0x7fd92405bca0 msgr2=0x7fd9240b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:10.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 shutdown_connections 2021-10-21T00:05:10.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:10.915+0000 7fd92b365700 1 -- 172.21.15.41:0/3233053061 wait complete. 2021-10-21T00:05:10.924 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:05:10.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-21T00:05:11.035 INFO:teuthology.orchestra.run.smithi062.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-21T00:05:11.035 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-21T00:05:11.036 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:05:11.054 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:05:11.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.159+0000 7fa47a188700 1 Processor -- start 2021-10-21T00:05:11.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.159+0000 7fa47a188700 1 -- start start 2021-10-21T00:05:11.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4740af620 0x7fa4740ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa474149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740b0b50 con 0x7fa4740b2170 2021-10-21T00:05:11.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4740b2550 con 0x7fa4740af620 2021-10-21T00:05:11.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740b0d90 con 0x7fa474067a80 2021-10-21T00:05:11.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4740af620 0x7fa4740ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa479987700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa474149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4740af620 0x7fa4740ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43664/0 (socket says 172.21.15.41:43664) 2021-10-21T00:05:11.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa479186700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa4740b2170 0x7fa4740ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37570/0 (socket says 172.21.15.41:37570) 2021-10-21T00:05:11.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 -- 172.21.15.41:0/26190826 learned_addr learned my addr 172.21.15.41:0/26190826 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 -- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 msgr2=0x7fa474149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 --2- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa474149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 -- 172.21.15.41:0/26190826 >> v1:172.21.15.62:6789/0 conn(0x7fa4740b2170 legacy=0x7fa4740ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 -- 172.21.15.41:0/26190826 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740b1030 con 0x7fa4740af620 2021-10-21T00:05:11.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa478985700 1 --2- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740af620 0x7fa4740ab880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa46c0032f0 tx=0x7fa46c009290).ready entity=mon.1 client_cookie=16478026073ed57d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa473fff700 1 -- 172.21.15.41:0/26190826 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa46c00b8a0 con 0x7fa4740af620 2021-10-21T00:05:11.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa473fff700 1 -- 172.21.15.41:0/26190826 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00ba00 con 0x7fa4740af620 2021-10-21T00:05:11.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa473fff700 1 -- 172.21.15.41:0/26190826 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa46c00bb70 con 0x7fa4740af620 2021-10-21T00:05:11.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740af620 msgr2=0x7fa4740ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 --2- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740af620 0x7fa4740ab880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa46c0032f0 tx=0x7fa46c009290).stop 2021-10-21T00:05:11.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- 172.21.15.41:0/26190826 shutdown_connections 2021-10-21T00:05:11.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 --2- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa474149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 --2- 172.21.15.41:0/26190826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740af620 0x7fa4740ab880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- 172.21.15.41:0/26190826 >> 172.21.15.41:0/26190826 conn(0x7fa4740b5700 msgr2=0x7fa4740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- 172.21.15.41:0/26190826 shutdown_connections 2021-10-21T00:05:11.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.163+0000 7fa47a188700 1 -- 172.21.15.41:0/26190826 wait complete. 2021-10-21T00:05:11.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 Processor -- start 2021-10-21T00:05:11.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- start start 2021-10-21T00:05:11.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa4740aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 0x7fa474065ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 0x7fa4740663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740647d0 con 0x7fa4740af620 2021-10-21T00:05:11.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740657c0 con 0x7fa4740b2170 2021-10-21T00:05:11.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa474146ff0 con 0x7fa474067a80 2021-10-21T00:05:11.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa478985700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 0x7fa474065ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 0x7fa4740663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa478985700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 0x7fa474065ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59984/0 (socket says 172.21.15.41:59984) 2021-10-21T00:05:11.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa478985700 1 -- 172.21.15.41:0/1493392064 learned_addr learned my addr 172.21.15.41:0/1493392064 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479186700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa4740aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 -- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 msgr2=0x7fa4740aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa4740aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 -- 172.21.15.41:0/1493392064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 msgr2=0x7fa474065ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 0x7fa474065ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 -- 172.21.15.41:0/1493392064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009530 con 0x7fa4740b2170 2021-10-21T00:05:11.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa479987700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 0x7fa4740663d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa46800c000 tx=0x7fa468006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa468011750 con 0x7fa4740b2170 2021-10-21T00:05:11.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680118b0 con 0x7fa4740b2170 2021-10-21T00:05:11.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa474064a00 con 0x7fa4740b2170 2021-10-21T00:05:11.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa468011c10 con 0x7fa4740b2170 2021-10-21T00:05:11.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.167+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa474148e70 con 0x7fa4740b2170 2021-10-21T00:05:11.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4740b12d0 con 0x7fa4740b2170 2021-10-21T00:05:11.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa468011d70 con 0x7fa4740b2170 2021-10-21T00:05:11.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa4727fc700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 0x7fa454055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa46806bc90 con 0x7fa4740b2170 2021-10-21T00:05:11.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa479186700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 0x7fa454055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.171+0000 7fa479186700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 0x7fa454055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa46400d000 tx=0x7fa464000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.179+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa468042cf0 con 0x7fa4740b2170 2021-10-21T00:05:11.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.343+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa474057350 con 0x7fa4740b2170 2021-10-21T00:05:11.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa4727fc700 1 -- 172.21.15.41:0/1493392064 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fa468046310 con 0x7fa4740b2170 2021-10-21T00:05:11.351 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:05:11.351 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:05:11.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 msgr2=0x7fa454055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 0x7fa454055b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa46400d000 tx=0x7fa464000bc0).stop 2021-10-21T00:05:11.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 msgr2=0x7fa4740663d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 0x7fa4740663d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa46800c000 tx=0x7fa468006df0).stop 2021-10-21T00:05:11.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 shutdown_connections 2021-10-21T00:05:11.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa454053640 0x7fa454055b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4740b2170 0x7fa4740663d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4740af620 0x7fa474065ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 --2- 172.21.15.41:0/1493392064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa474067a80 0x7fa4740aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 >> 172.21.15.41:0/1493392064 conn(0x7fa4740b5700 msgr2=0x7fa4741490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 shutdown_connections 2021-10-21T00:05:11.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.347+0000 7fa47a188700 1 -- 172.21.15.41:0/1493392064 wait complete. 2021-10-21T00:05:11.355 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:05:11.362 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 2021-10-21T00:05:11.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 Processor -- start 2021-10-21T00:05:11.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 -- start start 2021-10-21T00:05:11.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3eac062330 0x7f3eac0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac05bd40 con 0x7f3eac062f70 2021-10-21T00:05:11.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac05bf70 con 0x7f3eac062330 2021-10-21T00:05:11.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb1750700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac142cb0 con 0x7f3eac0b3a20 2021-10-21T00:05:11.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eabfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3eac062330 0x7f3eac0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.471+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50260/0 (socket says 172.21.15.41:50260) 2021-10-21T00:05:11.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1305502487 learned_addr learned my addr 172.21.15.41:0/1305502487 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eab7fe700 1 --1- 172.21.15.41:0/1305502487 >> v1:172.21.15.62:6789/0 conn(0x7f3eac062f70 0x7f3eac05c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37586/0 (socket says 172.21.15.41:37586) 2021-10-21T00:05:11.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eaaffd700 1 -- 172.21.15.41:0/1305502487 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326712067 0 0) 0x7f3eac05bd40 con 0x7f3eac062f70 2021-10-21T00:05:11.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1305502487 >> v2:172.21.15.62:3300/0 conn(0x7f3eac062330 msgr2=0x7f3eac0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1305502487 >> v2:172.21.15.62:3300/0 conn(0x7f3eac062330 0x7f3eac0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1305502487 >> v1:172.21.15.62:6789/0 conn(0x7f3eac062f70 legacy=0x7f3eac05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1305502487 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac142950 con 0x7f3eac0b3a20 2021-10-21T00:05:11.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1305502487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3ea40032f0 tx=0x7f3ea4009290).ready entity=mon.2 client_cookie=3bf2b8e508c761fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eaaffd700 1 -- 172.21.15.41:0/1305502487 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea400b8a0 con 0x7f3eac0b3a20 2021-10-21T00:05:11.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eaaffd700 1 -- 172.21.15.41:0/1305502487 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400ba00 con 0x7f3eac0b3a20 2021-10-21T00:05:11.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eaaffd700 1 -- 172.21.15.41:0/1305502487 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea400bb70 con 0x7f3eac0b3a20 2021-10-21T00:05:11.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- 172.21.15.41:0/1305502487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 msgr2=0x7f3eac13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1305502487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3ea40032f0 tx=0x7f3ea4009290).stop 2021-10-21T00:05:11.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- 172.21.15.41:0/1305502487 shutdown_connections 2021-10-21T00:05:11.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1305502487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac13c510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1305502487 >> v2:172.21.15.62:3300/0 conn(0x7f3eac062330 0x7f3eac0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- 172.21.15.41:0/1305502487 >> 172.21.15.41:0/1305502487 conn(0x7f3eac0b9080 msgr2=0x7f3eac0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- 172.21.15.41:0/1305502487 shutdown_connections 2021-10-21T00:05:11.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- 172.21.15.41:0/1305502487 wait complete. 2021-10-21T00:05:11.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 Processor -- start 2021-10-21T00:05:11.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.475+0000 7f3eb1750700 1 -- start start 2021-10-21T00:05:11.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 0x7f3eac1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac145190 con 0x7f3eac062330 2021-10-21T00:05:11.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac145430 con 0x7f3eac062f70 2021-10-21T00:05:11.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac146790 con 0x7f3eac0b3a20 2021-10-21T00:05:11.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 0x7f3eac1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 0x7f3eac1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43684/0 (socket says 172.21.15.41:43684) 2021-10-21T00:05:11.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50266/0 (socket says 172.21.15.41:50266) 2021-10-21T00:05:11.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eab7fe700 1 -- 172.21.15.41:0/1203550466 learned_addr learned my addr 172.21.15.41:0/1203550466 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:59996/0 (socket says 172.21.15.41:59996) 2021-10-21T00:05:11.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 msgr2=0x7f3eac1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 0x7f3eac1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1203550466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 msgr2=0x7f3eac0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1203550466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009530 con 0x7f3eac0b3a20 2021-10-21T00:05:11.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eabfff700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:05:11.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3ea40032f0 tx=0x7f3ea4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3ea97fa700 1 -- 172.21.15.41:0/1203550466 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea400bb70 con 0x7f3eac0b3a20 2021-10-21T00:05:11.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3ea97fa700 1 -- 172.21.15.41:0/1203550466 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4021630 con 0x7f3eac0b3a20 2021-10-21T00:05:11.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0ae420 con 0x7f3eac0b3a20 2021-10-21T00:05:11.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3ea97fa700 1 -- 172.21.15.41:0/1203550466 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea400b8a0 con 0x7f3eac0b3a20 2021-10-21T00:05:11.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.479+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac112740 con 0x7f3eac0b3a20 2021-10-21T00:05:11.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3ea97fa700 1 -- 172.21.15.41:0/1203550466 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ea4028070 con 0x7f3eac0b3a20 2021-10-21T00:05:11.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3ea97fa700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 0x7f3e84055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3ea97fa700 1 -- 172.21.15.41:0/1203550466 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ea406c940 con 0x7f3eac0b3a20 2021-10-21T00:05:11.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3eabfff700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 0x7f3e84055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3ebcbf6740 1 Processor -- start 2021-10-21T00:05:11.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3ebcbf6740 1 -- start start 2021-10-21T00:05:11.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.483+0000 7f3eabfff700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 0x7f3e84055ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3e9c00b000 tx=0x7f3e9c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f5100 0x24f4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x25284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x2462190 con 0x24f1b00 2021-10-21T00:05:11.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x2442820 con 0x24f4760 2021-10-21T00:05:11.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f3de0 con 0x24f5100 2021-10-21T00:05:11.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60004/0 (socket says 172.21.15.41:60004) 2021-10-21T00:05:11.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 -- 172.21.15.41:0/2393514358 learned_addr learned my addr 172.21.15.41:0/2393514358 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eab7fe700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f5100 0x24f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x25284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 -- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f5100 msgr2=0x24f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f5100 0x24f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 -- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 msgr2=0x25284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x25284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 -- 172.21.15.41:0/2393514358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x249a6e0 con 0x24f1b00 2021-10-21T00:05:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x25284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:11.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eabfff700 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3e9c013000 tx=0x7f3e9c016000).ready entity=mon.0 client_cookie=bce2c7e425da847e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eb1750700 1 -- 172.21.15.41:0/2393514358 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9c01f400 con 0x24f1b00 2021-10-21T00:05:11.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eb1750700 1 -- 172.21.15.41:0/2393514358 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c01f560 con 0x24f1b00 2021-10-21T00:05:11.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3eb1750700 1 -- 172.21.15.41:0/2393514358 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9c01f6d0 con 0x24f1b00 2021-10-21T00:05:11.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2393514358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 msgr2=0x24f0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3e9c013000 tx=0x7f3e9c016000).stop 2021-10-21T00:05:11.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2393514358 shutdown_connections 2021-10-21T00:05:11.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x25284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f5100 0x24f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2393514358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f1b00 0x24f0600 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2393514358 >> 172.21.15.41:0/2393514358 conn(0x247a870 msgr2=0x24f0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2393514358 shutdown_connections 2021-10-21T00:05:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.487+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2393514358 wait complete. 2021-10-21T00:05:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- start start 2021-10-21T00:05:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 Processor -- start 2021-10-21T00:05:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x2537590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x25246d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x2524bc0 con 0x24f5100 2021-10-21T00:05:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x24f67b0 con 0x24f1b00 2021-10-21T00:05:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f6a50 con 0x24f4760 2021-10-21T00:05:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 10 client.0 ll_register_callbacks cb 0x2430410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:05:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60014/0 (socket says 172.21.15.41:60014) 2021-10-21T00:05:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/3196853968 learned_addr learned my addr 172.21.15.41:0/3196853968 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x2537590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eab7fe700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x25246d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 msgr2=0x25246d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x25246d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 msgr2=0x2537590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x2537590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/3196853968 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c011c40 con 0x24f5100 2021-10-21T00:05:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4012000).ready entity=mon.0 client_cookie=6f839757127cfec7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:05:11.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4021d90 con 0x24f5100 2021-10-21T00:05:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ea4047570 con 0x24f5100 2021-10-21T00:05:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2458170 con 0x24f5100 2021-10-21T00:05:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea406c120 con 0x24f5100 2021-10-21T00:05:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 10 client.5463 fetch_fsmap learned FSMap version 16 2021-10-21T00:05:11.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x2451a50 con 0x24f5100 2021-10-21T00:05:11.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2458170 con 0x24f5100 2021-10-21T00:05:11.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f3ea4045c30 con 0x24f5100 2021-10-21T00:05:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 10 client.5463 fetch_fsmap finished waiting for FSMap version 16 2021-10-21T00:05:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 10 client.5463 resolve_mds: resolved ID 'b' to GID 5283 2021-10-21T00:05:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 20 client.5463 populate_metadata read hostname 'smithi041' 2021-10-21T00:05:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x24f5e70 0x24ec940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 4 client.5463 mds_command: new command op to 5283 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-21T00:05:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 --> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x24504e0 con 0x24f5e70 2021-10-21T00:05:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.491+0000 7f3eabfff700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x24f5e70 0x24ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3eabfff700 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x24f5e70 0x24ec940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f636e3d24276610a server_cookie=d73a1f37f4ca1b72 in_seq=0 out_seq=0 2021-10-21T00:05:11.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3e9affd700 10 client.5463 ms_handle_connect on v2:172.21.15.62:6834/4294881740 2021-10-21T00:05:11.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3e9affd700 1 -- 172.21.15.41:0/3196853968 <== mds.0 v2:172.21.15.62:6834/4294881740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x24504e0 con 0x24f5e70 2021-10-21T00:05:11.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3e9affd700 10 client.5463 handle_command_reply: tid=0 2021-10-21T00:05:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 client.5463 shutdown 2021-10-21T00:05:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 msgr2=0x24f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4012000).stop 2021-10-21T00:05:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 shutdown_connections 2021-10-21T00:05:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x24f5e70 0x24ec940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24f7190 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x25246d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/3196853968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x2537590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3e9affd700 0 client.5463 ms_handle_reset on v2:172.21.15.62:6834/4294881740 2021-10-21T00:05:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 >> 172.21.15.41:0/3196853968 conn(0x247a870 msgr2=0x252c640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 shutdown_connections 2021-10-21T00:05:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/3196853968 wait complete. 2021-10-21T00:05:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.495+0000 7f3ebcbf6740 20 client.5463 trim_cache size 0 max 16384 2021-10-21T00:05:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 Processor -- start 2021-10-21T00:05:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- start start 2021-10-21T00:05:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 0x24ec940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x24ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x24ed810 con 0x24f5100 2021-10-21T00:05:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x24eeee0 con 0x24f4760 2021-10-21T00:05:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x248f7b0 con 0x24f1b00 2021-10-21T00:05:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 0x24ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 0x24ec940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50284/0 (socket says 172.21.15.41:50284) 2021-10-21T00:05:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eabfff700 1 -- 172.21.15.41:0/2602477853 learned_addr learned my addr 172.21.15.41:0/2602477853 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60022/0 (socket says 172.21.15.41:60022) 2021-10-21T00:05:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eab7fe700 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x24ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 msgr2=0x24ec940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 0x24ec940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 msgr2=0x24ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x24ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/2602477853 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2456d40 con 0x24f5100 2021-10-21T00:05:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eab7fe700 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x24ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4047470).ready entity=mon.0 client_cookie=c4a5c418ab4692c8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ea17fa700 1 -- 172.21.15.41:0/2602477853 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4047570 con 0x24f5100 2021-10-21T00:05:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ea17fa700 1 -- 172.21.15.41:0/2602477853 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4006ce0 con 0x24f5100 2021-10-21T00:05:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ea17fa700 1 -- 172.21.15.41:0/2602477853 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4046810 con 0x24f5100 2021-10-21T00:05:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2602477853 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 msgr2=0x24ed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4047470).stop 2021-10-21T00:05:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2602477853 shutdown_connections 2021-10-21T00:05:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x24ed320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f4760 0x24ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/2602477853 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f1b00 0x24ec940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2602477853 >> 172.21.15.41:0/2602477853 conn(0x247a870 msgr2=0x24f2450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2602477853 shutdown_connections 2021-10-21T00:05:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.511+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/2602477853 wait complete. 2021-10-21T00:05:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- start start 2021-10-21T00:05:11.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 Processor -- start 2021-10-21T00:05:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x258d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x2589570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x258ccf0 con 0x24f5100 2021-10-21T00:05:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x258cf90 con 0x24f1b00 2021-10-21T00:05:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x258d920 con 0x24f4760 2021-10-21T00:05:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 10 client.0 ll_register_callbacks cb 0x24f8d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:05:11.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x258d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60028/0 (socket says 172.21.15.41:60028) 2021-10-21T00:05:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1518261521 learned_addr learned my addr 172.21.15.41:0/1518261521 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:11.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eab7fe700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x2589570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 msgr2=0x2589570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x2589570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 msgr2=0x258d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x258d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:11.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 -- 172.21.15.41:0/1518261521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2451a50 con 0x24f5100 2021-10-21T00:05:11.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:05:11.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eb0f4f700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4039000).ready entity=mon.0 client_cookie=884220d139eac6b9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:11.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea4046810 con 0x24f5100 2021-10-21T00:05:11.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ea4047570 con 0x24f5100 2021-10-21T00:05:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e9c01f560 con 0x24f5100 2021-10-21T00:05:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea4021ba0 con 0x24f5100 2021-10-21T00:05:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 10 client.5469 fetch_fsmap learned FSMap version 16 2021-10-21T00:05:11.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x242c3f0 con 0x24f5100 2021-10-21T00:05:11.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c01f560 con 0x24f5100 2021-10-21T00:05:11.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f3ea4021d00 con 0x24f5100 2021-10-21T00:05:11.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 10 client.5469 fetch_fsmap finished waiting for FSMap version 16 2021-10-21T00:05:11.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 10 client.5469 resolve_mds: resolved ID 'b' to GID 5283 2021-10-21T00:05:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 20 client.5469 populate_metadata read hostname 'smithi041' 2021-10-21T00:05:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x252cf90 0x2582e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 4 client.5469 mds_command: new command op to 5283 tid=0[{"prefix": "cache drop"}] 2021-10-21T00:05:11.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 --> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x2346590 con 0x252cf90 2021-10-21T00:05:11.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.515+0000 7f3eabfff700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x252cf90 0x2582e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:11.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.519+0000 7f3eabfff700 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x252cf90 0x2582e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d2dc026788d71132 server_cookie=547ce5dcd5bbe625 in_seq=0 out_seq=0 2021-10-21T00:05:11.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:11.519+0000 7f3e9bfff700 10 client.5469 ms_handle_connect on v2:172.21.15.62:6834/4294881740 2021-10-21T00:05:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3e9bfff700 1 -- 172.21.15.41:0/1518261521 <== mds.0 v2:172.21.15.62:6834/4294881740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x2346590 con 0x252cf90 2021-10-21T00:05:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3e9bfff700 10 client.5469 handle_command_reply: tid=0 2021-10-21T00:05:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 client.5469 shutdown 2021-10-21T00:05:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 msgr2=0x2589a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f3ea4023000 tx=0x7f3ea4039000).stop 2021-10-21T00:05:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 shutdown_connections 2021-10-21T00:05:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:6834/4294881740,v1:172.21.15.62:6835/4294881740] conn(0x252cf90 0x2582e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x24f5100 0x2589a60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x24f4760 0x2589570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3ebcbf6740 1 --2- 172.21.15.41:0/1518261521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x24f1b00 0x258d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.679+0000 7f3e9bfff700 0 client.5469 ms_handle_reset on v2:172.21.15.62:6834/4294881740 2021-10-21T00:05:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 >> 172.21.15.41:0/1518261521 conn(0x247a870 msgr2=0x24f2450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 shutdown_connections 2021-10-21T00:05:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3ebcbf6740 1 -- 172.21.15.41:0/1518261521 wait complete. 2021-10-21T00:05:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3ebcbf6740 20 client.5469 trim_cache size 0 max 16384 2021-10-21T00:05:22.689 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:05:22.689 INFO:teuthology.orchestra.run.smithi041.stdout: "client_recall": { 2021-10-21T00:05:22.689 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:05:22.690 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "(0) Success", 2021-10-21T00:05:22.690 INFO:teuthology.orchestra.run.smithi041.stdout: "recalled": 220 2021-10-21T00:05:22.690 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:05:22.690 INFO:teuthology.orchestra.run.smithi041.stdout: "flush_journal": { 2021-10-21T00:05:22.691 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:05:22.691 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "" 2021-10-21T00:05:22.691 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:05:22.691 INFO:teuthology.orchestra.run.smithi041.stdout: "trim_cache": { 2021-10-21T00:05:22.692 INFO:teuthology.orchestra.run.smithi041.stdout: "trimmed": 0 2021-10-21T00:05:22.692 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:05:22.693 INFO:teuthology.orchestra.run.smithi041.stdout: "cache": { 2021-10-21T00:05:22.693 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": { 2021-10-21T00:05:22.693 INFO:teuthology.orchestra.run.smithi041.stdout: "items": 19992, 2021-10-21T00:05:22.693 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes": 3099808 2021-10-21T00:05:22.693 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:05:22.694 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:05:22.694 INFO:teuthology.orchestra.run.smithi041.stdout: "duration": 11.162491504 2021-10-21T00:05:22.694 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:05:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 msgr2=0x7f3e84055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 0x7f3e84055ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3e9c00b000 tx=0x7f3e9c006df0).stop 2021-10-21T00:05:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 msgr2=0x7f3eac1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3ea40032f0 tx=0x7f3ea4016000).stop 2021-10-21T00:05:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 shutdown_connections 2021-10-21T00:05:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e84053610 0x7f3e84055ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3eac0b3a20 0x7f3eac1529e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3eac062f70 0x7f3eac1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 --2- 172.21.15.41:0/1203550466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3eac062330 0x7f3eac0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 >> 172.21.15.41:0/1203550466 conn(0x7f3eac0b9080 msgr2=0x7f3eac13ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 shutdown_connections 2021-10-21T00:05:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.683+0000 7f3eb1750700 1 -- 172.21.15.41:0/1203550466 wait complete. 2021-10-21T00:05:22.700 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-21T00:05:22.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:22.701 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:05:22.701 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:22.709 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-21T00:05:22.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:05:22.711 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-21T00:05:22.711 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:05:22.711 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:05:22.712 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:22.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:22.734 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:05:22.734 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:22.782 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:05:22.783 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:05:22.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:05:22.784 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:22.792 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:05:22.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 Processor -- start 2021-10-21T00:05:22.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- start start 2021-10-21T00:05:22.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 0x7f5ad414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ad40aa750 0x7f5ad414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40609d0 con 0x7f5ad414b130 2021-10-21T00:05:22.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40b1620 con 0x7f5ad40aa750 2021-10-21T00:05:22.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad405fdd0 con 0x7f5ad405f9f0 2021-10-21T00:05:22.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ad40aa750 0x7f5ad414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ad40aa750 0x7f5ad414ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60032/0 (socket says 172.21.15.41:60032) 2021-10-21T00:05:22.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 -- 172.21.15.41:0/3986281160 learned_addr learned my addr 172.21.15.41:0/3986281160 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:22.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad259c700 1 --2- 172.21.15.41:0/3986281160 >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 0x7f5ad414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 -- 172.21.15.41:0/3986281160 >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 msgr2=0x7f5ad414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:22.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 --2- 172.21.15.41:0/3986281160 >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 0x7f5ad414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 -- 172.21.15.41:0/3986281160 >> v1:172.21.15.62:6789/0 conn(0x7f5ad414b130 legacy=0x7f5ad41495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:22.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 -- 172.21.15.41:0/3986281160 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad414b580 con 0x7f5ad40aa750 2021-10-21T00:05:22.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad259c700 1 --2- 172.21.15.41:0/3986281160 >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 0x7f5ad414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:05:22.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad1d9b700 1 --2- 172.21.15.41:0/3986281160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad40aa750 0x7f5ad414ac40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f5ad40af680 tx=0x7f5acc009290).ready entity=mon.0 client_cookie=57c0806f5f5f8f57 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:22.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad159a700 1 -- 172.21.15.41:0/3986281160 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc00b830 con 0x7f5ad40aa750 2021-10-21T00:05:22.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad159a700 1 -- 172.21.15.41:0/3986281160 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00b990 con 0x7f5ad40aa750 2021-10-21T00:05:22.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad159a700 1 -- 172.21.15.41:0/3986281160 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5acc00bb40 con 0x7f5ad40aa750 2021-10-21T00:05:22.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/3986281160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad40aa750 msgr2=0x7f5ad414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/3986281160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad40aa750 0x7f5ad414ac40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f5ad40af680 tx=0x7f5acc009290).stop 2021-10-21T00:05:22.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/3986281160 shutdown_connections 2021-10-21T00:05:22.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/3986281160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad40aa750 0x7f5ad414ac40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/3986281160 >> v2:172.21.15.62:3300/0 conn(0x7f5ad405f9f0 0x7f5ad414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/3986281160 >> 172.21.15.41:0/3986281160 conn(0x7f5ad405bca0 msgr2=0x7f5ad405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:22.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/3986281160 shutdown_connections 2021-10-21T00:05:22.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.899+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/3986281160 wait complete. 2021-10-21T00:05:22.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.903+0000 7f5ad8e4c700 1 Processor -- start 2021-10-21T00:05:22.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.903+0000 7f5ad8e4c700 1 -- start start 2021-10-21T00:05:22.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ad40aa750 0x7f5ad4098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ad414b130 0x7f5ad4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415a600 con 0x7f5ad405f9f0 2021-10-21T00:05:22.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415a8a0 con 0x7f5ad40aa750 2021-10-21T00:05:22.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40638a0 con 0x7f5ad414b130 2021-10-21T00:05:22.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60038/0 (socket says 172.21.15.41:60038) 2021-10-21T00:05:22.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 -- 172.21.15.41:0/1508899315 learned_addr learned my addr 172.21.15.41:0/1508899315 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:22.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad1d9b700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ad40aa750 0x7f5ad4098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad2d9d700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ad414b130 0x7f5ad4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 -- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ad414b130 msgr2=0x7f5ad4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ad414b130 0x7f5ad4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 -- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ad40aa750 msgr2=0x7f5ad4098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:22.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ad40aa750 0x7f5ad4098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:22.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 -- 172.21.15.41:0/1508899315 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009530 con 0x7f5ad405f9f0 2021-10-21T00:05:22.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad259c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5abc007000 tx=0x7f5abc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:22.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5abc00ce80 con 0x7f5ad405f9f0 2021-10-21T00:05:22.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc010580 con 0x7f5ad405f9f0 2021-10-21T00:05:22.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad408fbc0 con 0x7f5ad405f9f0 2021-10-21T00:05:22.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5abc0108e0 con 0x7f5ad405f9f0 2021-10-21T00:05:22.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40990f0 con 0x7f5ad405f9f0 2021-10-21T00:05:22.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad408fd50 con 0x7f5ad405f9f0 2021-10-21T00:05:22.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.907+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5abc010a40 con 0x7f5ad405f9f0 2021-10-21T00:05:22.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.911+0000 7f5acb7fe700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 0x7f5ab80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:22.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.911+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5abc06b7d0 con 0x7f5ad405f9f0 2021-10-21T00:05:22.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.911+0000 7f5ad1d9b700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 0x7f5ab80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:22.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.911+0000 7f5ad1d9b700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 0x7f5ab80559b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5acc01b000 tx=0x7f5acc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:22.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:22.919+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5abc042820 con 0x7f5ad405f9f0 2021-10-21T00:05:23.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ad40b1380 con 0x7f5ad405f9f0 2021-10-21T00:05:23.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5acb7fe700 1 -- 172.21.15.41:0/1508899315 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f5abc045e40 con 0x7f5ad405f9f0 2021-10-21T00:05:23.047 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:05:23.047 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":40,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:04:54.507266+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:04:51.918069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-10-21T00:04:53.087464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:05:23.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 msgr2=0x7f5ab80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 0x7f5ab80559b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5acc01b000 tx=0x7f5acc016000).stop 2021-10-21T00:05:23.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 msgr2=0x7f5ad408f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5abc007000 tx=0x7f5abc008040).stop 2021-10-21T00:05:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 shutdown_connections 2021-10-21T00:05:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ab80534f0 0x7f5ab80559b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ad414b130 0x7f5ad4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ad40aa750 0x7f5ad4098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 --2- 172.21.15.41:0/1508899315 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ad405f9f0 0x7f5ad408f6d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 >> 172.21.15.41:0/1508899315 conn(0x7f5ad405bca0 msgr2=0x7f5ad4147fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 shutdown_connections 2021-10-21T00:05:23.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.043+0000 7f5ad8e4c700 1 -- 172.21.15.41:0/1508899315 wait complete. 2021-10-21T00:05:23.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:04:51.918069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:04:53.087464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:05:23.065 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:05:23.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.167+0000 7fbeef700700 1 Processor -- start 2021-10-21T00:05:23.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.167+0000 7fbeef700700 1 -- start start 2021-10-21T00:05:23.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbee805c6f0 0x7fbee8143e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbee8144a20 0x7fbee8140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80af000 con 0x7fbee80ae900 2021-10-21T00:05:23.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee805cad0 con 0x7fbee8144a20 2021-10-21T00:05:23.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee8067a80 con 0x7fbee805c6f0 2021-10-21T00:05:23.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbee8144a20 0x7fbee8140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeecc9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fbee80ae900 0x7fbee8144310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57820/0 (socket says 172.21.15.41:57820) 2021-10-21T00:05:23.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeecc9b700 1 -- 172.21.15.41:0/3427019516 learned_addr learned my addr 172.21.15.41:0/3427019516 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:05:23.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeed49c700 1 --2- 172.21.15.41:0/3427019516 >> v2:172.21.15.62:3300/0 conn(0x7fbee805c6f0 0x7fbee8143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbed7fff700 1 -- 172.21.15.41:0/3427019516 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825268350 0 0) 0x7fbee80af000 con 0x7fbee80ae900 2021-10-21T00:05:23.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbed7fff700 1 -- 172.21.15.41:0/3427019516 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed0003260 con 0x7fbee80ae900 2021-10-21T00:05:23.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 -- 172.21.15.41:0/3427019516 >> v2:172.21.15.62:3300/0 conn(0x7fbee805c6f0 msgr2=0x7fbee8143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:23.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 --2- 172.21.15.41:0/3427019516 >> v2:172.21.15.62:3300/0 conn(0x7fbee805c6f0 0x7fbee8143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 -- 172.21.15.41:0/3427019516 >> v1:172.21.15.41:6789/0 conn(0x7fbee80ae900 legacy=0x7fbee8144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 -- 172.21.15.41:0/3427019516 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80af230 con 0x7fbee8144a20 2021-10-21T00:05:23.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeedc9d700 1 --2- 172.21.15.41:0/3427019516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee8144a20 0x7fbee8140930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fbee00032f0 tx=0x7fbee00091d0).ready entity=mon.0 client_cookie=850c07d51d7e9696 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbed7fff700 1 -- 172.21.15.41:0/3427019516 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbee000b600 con 0x7fbee8144a20 2021-10-21T00:05:23.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbed7fff700 1 -- 172.21.15.41:0/3427019516 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000b760 con 0x7fbee8144a20 2021-10-21T00:05:23.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbed7fff700 1 -- 172.21.15.41:0/3427019516 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbee000b8d0 con 0x7fbee8144a20 2021-10-21T00:05:23.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- 172.21.15.41:0/3427019516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee8144a20 msgr2=0x7fbee8140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 --2- 172.21.15.41:0/3427019516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee8144a20 0x7fbee8140930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fbee00032f0 tx=0x7fbee00091d0).stop 2021-10-21T00:05:23.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- 172.21.15.41:0/3427019516 shutdown_connections 2021-10-21T00:05:23.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 --2- 172.21.15.41:0/3427019516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee8144a20 0x7fbee8140930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 --2- 172.21.15.41:0/3427019516 >> v2:172.21.15.62:3300/0 conn(0x7fbee805c6f0 0x7fbee8143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- 172.21.15.41:0/3427019516 >> 172.21.15.41:0/3427019516 conn(0x7fbee8063210 msgr2=0x7fbee805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- 172.21.15.41:0/3427019516 shutdown_connections 2021-10-21T00:05:23.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.171+0000 7fbeef700700 1 -- 172.21.15.41:0/3427019516 wait complete. 2021-10-21T00:05:23.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 Processor -- start 2021-10-21T00:05:23.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- start start 2021-10-21T00:05:23.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 0x7fbee813d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbee8144a20 0x7fbee8142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee81431a0 con 0x7fbee80ae900 2021-10-21T00:05:23.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee809ec60 con 0x7fbee805c6f0 2021-10-21T00:05:23.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee813dbb0 con 0x7fbee8144a20 2021-10-21T00:05:23.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60054/0 (socket says 172.21.15.41:60054) 2021-10-21T00:05:23.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 -- 172.21.15.41:0/4294524081 learned_addr learned my addr 172.21.15.41:0/4294524081 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:23.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeed49c700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 0x7fbee813d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeedc9d700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbee8144a20 0x7fbee8142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 -- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbee8144a20 msgr2=0x7fbee8142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbee8144a20 0x7fbee8142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 -- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 msgr2=0x7fbee813d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 0x7fbee813d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 -- 172.21.15.41:0/4294524081 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0009470 con 0x7fbee80ae900 2021-10-21T00:05:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeed49c700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 0x7fbee813d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeecc9b700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fbed8001110 tx=0x7fbed8007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed80070d0 con 0x7fbee80ae900 2021-10-21T00:05:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8007230 con 0x7fbee80ae900 2021-10-21T00:05:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee813de50 con 0x7fbee80ae900 2021-10-21T00:05:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed8005610 con 0x7fbee80ae900 2021-10-21T00:05:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.175+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee813d000 con 0x7fbee80ae900 2021-10-21T00:05:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee8067700 con 0x7fbee80ae900 2021-10-21T00:05:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbed8010070 con 0x7fbee80ae900 2021-10-21T00:05:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbed67fc700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 0x7fbec80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbed806aff0 con 0x7fbee80ae900 2021-10-21T00:05:23.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbeed49c700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 0x7fbec80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.179+0000 7fbeed49c700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 0x7fbec80559b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbee400b000 tx=0x7fbee4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.187+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbed8042150 con 0x7fbee80ae900 2021-10-21T00:05:23.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.303+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbee8057350 con 0x7fbee80ae900 2021-10-21T00:05:23.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.303+0000 7fbed67fc700 1 -- 172.21.15.41:0/4294524081 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v40) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbed8045770 con 0x7fbee80ae900 2021-10-21T00:05:23.310 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:05:23.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 msgr2=0x7fbec80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 0x7fbec80559b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fbee400b000 tx=0x7fbee4008040).stop 2021-10-21T00:05:23.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 msgr2=0x7fbee813a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fbed8001110 tx=0x7fbed8007aa0).stop 2021-10-21T00:05:23.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 shutdown_connections 2021-10-21T00:05:23.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbec80534f0 0x7fbec80559b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbee8144a20 0x7fbee8142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbee80ae900 0x7fbee813a790 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 --2- 172.21.15.41:0/4294524081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbee805c6f0 0x7fbee813d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 >> 172.21.15.41:0/4294524081 conn(0x7fbee8063210 msgr2=0x7fbee813ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 shutdown_connections 2021-10-21T00:05:23.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.307+0000 7fbeef700700 1 -- 172.21.15.41:0/4294524081 wait complete. 2021-10-21T00:05:23.321 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:05:23.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 Processor -- start 2021-10-21T00:05:23.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 -- start start 2021-10-21T00:05:23.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39080b5f70 0x7f390805c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39080b1a50 0x7f3908141e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080b6350 con 0x7f3908142300 2021-10-21T00:05:23.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3908067d00 con 0x7f39080b1a50 2021-10-21T00:05:23.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f390cca4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390805cee0 con 0x7f39080b5f70 2021-10-21T00:05:23.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39080b1a50 0x7f3908141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39080b1a50 0x7f3908141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60062/0 (socket says 172.21.15.41:60062) 2021-10-21T00:05:23.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 -- 172.21.15.41:0/2406109027 learned_addr learned my addr 172.21.15.41:0/2406109027 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:23.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f39077fe700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39080b5f70 0x7f390805c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 -- 172.21.15.41:0/2406109027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39080b5f70 msgr2=0x7f390805c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:23.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39080b5f70 0x7f390805c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 -- 172.21.15.41:0/2406109027 >> v1:172.21.15.62:6789/0 conn(0x7f3908142300 legacy=0x7f3908145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.427+0000 7f3906ffd700 1 -- 172.21.15.41:0/2406109027 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390805d180 con 0x7f39080b1a50 2021-10-21T00:05:23.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b1a50 0x7f3908141e10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f38fc002f70 tx=0x7f38fc006eb0).ready entity=mon.0 client_cookie=d3a212041c14aaba server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f39067fc700 1 -- 172.21.15.41:0/2406109027 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38fc00d570 con 0x7f39080b1a50 2021-10-21T00:05:23.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f39067fc700 1 -- 172.21.15.41:0/2406109027 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc000e90 con 0x7f39080b1a50 2021-10-21T00:05:23.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f39067fc700 1 -- 172.21.15.41:0/2406109027 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38fc00d900 con 0x7f39080b1a50 2021-10-21T00:05:23.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/2406109027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b1a50 msgr2=0x7f3908141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b1a50 0x7f3908141e10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f38fc002f70 tx=0x7f38fc006eb0).stop 2021-10-21T00:05:23.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/2406109027 shutdown_connections 2021-10-21T00:05:23.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b1a50 0x7f3908141e10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- 172.21.15.41:0/2406109027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39080b5f70 0x7f390805c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/2406109027 >> 172.21.15.41:0/2406109027 conn(0x7f39080639f0 msgr2=0x7f39080b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/2406109027 shutdown_connections 2021-10-21T00:05:23.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/2406109027 wait complete. 2021-10-21T00:05:23.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 Processor -- start 2021-10-21T00:05:23.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- start start 2021-10-21T00:05:23.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39080b1a50 0x7f3908145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3908142300 0x7f390813f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3908145d50 con 0x7f39080b5f70 2021-10-21T00:05:23.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3908064550 con 0x7f39080b1a50 2021-10-21T00:05:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39081467f0 con 0x7f3908142300 2021-10-21T00:05:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60066/0 (socket says 172.21.15.41:60066) 2021-10-21T00:05:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 -- 172.21.15.41:0/678383505 learned_addr learned my addr 172.21.15.41:0/678383505 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f39077fe700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39080b1a50 0x7f3908145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3907fff700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3908142300 0x7f390813f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 -- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3908142300 msgr2=0x7f390813f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3908142300 0x7f390813f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 -- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39080b1a50 msgr2=0x7f3908145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39080b1a50 0x7f3908145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 -- 172.21.15.41:0/678383505 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc00b1e0 con 0x7f39080b5f70 2021-10-21T00:05:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3906ffd700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f38fc002f70 tx=0x7f38fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38fc011760 con 0x7f39080b5f70 2021-10-21T00:05:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc0118c0 con 0x7f39080b5f70 2021-10-21T00:05:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3908146a90 con 0x7f39080b5f70 2021-10-21T00:05:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38fc011c20 con 0x7f39080b5f70 2021-10-21T00:05:23.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.431+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39080642c0 con 0x7f39080b5f70 2021-10-21T00:05:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3908146c20 con 0x7f39080b5f70 2021-10-21T00:05:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38fc025030 con 0x7f39080b5f70 2021-10-21T00:05:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f3904ff9700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 0x7f38e8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f38fc06c950 con 0x7f39080b5f70 2021-10-21T00:05:23.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f39077fe700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 0x7f38e8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.435+0000 7f39077fe700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 0x7f38e8055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f38f800b000 tx=0x7f38f80091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.439+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38fc043ab0 con 0x7f39080b5f70 2021-10-21T00:05:23.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3908057350 con 0x7f39080b5f70 2021-10-21T00:05:23.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f3904ff9700 1 -- 172.21.15.41:0/678383505 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38fc023020 con 0x7f39080b5f70 2021-10-21T00:05:23.571 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:05:23.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 msgr2=0x7f38e8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 0x7f38e8055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f38f800b000 tx=0x7f38f80091d0).stop 2021-10-21T00:05:23.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 msgr2=0x7f3908141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f38fc002f70 tx=0x7f38fc015000).stop 2021-10-21T00:05:23.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 shutdown_connections 2021-10-21T00:05:23.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f38e8053610 0x7f38e8055ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3908142300 0x7f390813f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39080b5f70 0x7f3908141850 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 --2- 172.21.15.41:0/678383505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39080b1a50 0x7f3908145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 >> 172.21.15.41:0/678383505 conn(0x7f39080639f0 msgr2=0x7f39080b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 shutdown_connections 2021-10-21T00:05:23.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.567+0000 7f390cca4700 1 -- 172.21.15.41:0/678383505 wait complete. 2021-10-21T00:05:23.588 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:05:23.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.691+0000 7fadf45f6700 1 Processor -- start 2021-10-21T00:05:23.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.691+0000 7fadf45f6700 1 -- start start 2021-10-21T00:05:23.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fadec0b0ac0 0x7fadec146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec143130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0b4120 con 0x7fadec0b9b10 2021-10-21T00:05:23.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0b46e0 con 0x7fadec0b0ac0 2021-10-21T00:05:23.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0b4980 con 0x7fadec142ce0 2021-10-21T00:05:23.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2392700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fadec0b9b10 0x7fadec0b4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57844/0 (socket says 172.21.15.41:57844) 2021-10-21T00:05:23.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2392700 1 -- 172.21.15.41:0/3418436775 learned_addr learned my addr 172.21.15.41:0/3418436775 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:05:23.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 --2- 172.21.15.41:0/3418436775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1b91700 1 --2- 172.21.15.41:0/3418436775 >> v2:172.21.15.62:3300/0 conn(0x7fadec0b0ac0 0x7fadec146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1390700 1 -- 172.21.15.41:0/3418436775 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105761406 0 0) 0x7fadec0b4120 con 0x7fadec0b9b10 2021-10-21T00:05:23.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1390700 1 -- 172.21.15.41:0/3418436775 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4003260 con 0x7fadec0b9b10 2021-10-21T00:05:23.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 -- 172.21.15.41:0/3418436775 >> v2:172.21.15.62:3300/0 conn(0x7fadec0b0ac0 msgr2=0x7fadec146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:23.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 --2- 172.21.15.41:0/3418436775 >> v2:172.21.15.62:3300/0 conn(0x7fadec0b0ac0 0x7fadec146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 -- 172.21.15.41:0/3418436775 >> v1:172.21.15.41:6789/0 conn(0x7fadec0b9b10 legacy=0x7fadec0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 -- 172.21.15.41:0/3418436775 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0b5530 con 0x7fadec142ce0 2021-10-21T00:05:23.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf2b93700 1 --2- 172.21.15.41:0/3418436775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec143130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fade40032f0 tx=0x7fade40091d0).ready entity=mon.2 client_cookie=db894e45b8c1e3ea server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1390700 1 -- 172.21.15.41:0/3418436775 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade400b600 con 0x7fadec142ce0 2021-10-21T00:05:23.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1390700 1 -- 172.21.15.41:0/3418436775 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade400b760 con 0x7fadec142ce0 2021-10-21T00:05:23.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf1390700 1 -- 172.21.15.41:0/3418436775 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade400b8d0 con 0x7fadec142ce0 2021-10-21T00:05:23.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- 172.21.15.41:0/3418436775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 msgr2=0x7fadec143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3418436775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec143130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fade40032f0 tx=0x7fade40091d0).stop 2021-10-21T00:05:23.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- 172.21.15.41:0/3418436775 shutdown_connections 2021-10-21T00:05:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3418436775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec143130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3418436775 >> v2:172.21.15.62:3300/0 conn(0x7fadec0b0ac0 0x7fadec146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- 172.21.15.41:0/3418436775 >> 172.21.15.41:0/3418436775 conn(0x7fadec062ec0 msgr2=0x7fadec0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.695+0000 7fadf45f6700 1 -- 172.21.15.41:0/3418436775 shutdown_connections 2021-10-21T00:05:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 -- 172.21.15.41:0/3418436775 wait complete. 2021-10-21T00:05:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 Processor -- start 2021-10-21T00:05:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 -- start start 2021-10-21T00:05:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 0x7fadec05c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec115470 con 0x7fadec0b9b10 2021-10-21T00:05:23.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec1567e0 con 0x7fadec0b0ac0 2021-10-21T00:05:23.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf45f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec1559a0 con 0x7fadec142ce0 2021-10-21T00:05:23.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60082/0 (socket says 172.21.15.41:60082) 2021-10-21T00:05:23.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 -- 172.21.15.41:0/3768412935 learned_addr learned my addr 172.21.15.41:0/3768412935 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:23.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf2392700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 0x7fadec05c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf2b93700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 -- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 msgr2=0x7fadec1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 -- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 msgr2=0x7fadec05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 0x7fadec05c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 -- 172.21.15.41:0/3768412935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4009470 con 0x7fadec0b9b10 2021-10-21T00:05:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf2392700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 0x7fadec05c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:05:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7fadf1b91700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fadec0b8470 tx=0x7fade8006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.699+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade80104c0 con 0x7fadec0b9b10 2021-10-21T00:05:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8010620 con 0x7fadec0b9b10 2021-10-21T00:05:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec1151d0 con 0x7fadec0b9b10 2021-10-21T00:05:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade8010980 con 0x7fadec0b9b10 2021-10-21T00:05:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec05c980 con 0x7fadec0b9b10 2021-10-21T00:05:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec057350 con 0x7fadec0b9b10 2021-10-21T00:05:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fade801a030 con 0x7fadec0b9b10 2021-10-21T00:05:23.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7faddb7fe700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 0x7fadcc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.703+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fade806b520 con 0x7fadec0b9b10 2021-10-21T00:05:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.707+0000 7fadf2392700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 0x7fadcc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.707+0000 7fadf2392700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 0x7fadcc055a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faddc00b000 tx=0x7faddc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.715+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fade80426d0 con 0x7fadec0b9b10 2021-10-21T00:05:23.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fadec061080 con 0x7fadec0b9b10 2021-10-21T00:05:23.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7faddb7fe700 1 -- 172.21.15.41:0/3768412935 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+10 (secure 0 0 0) 0x7fade8045cf0 con 0x7fadec0b9b10 2021-10-21T00:05:23.842 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:05:23.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 msgr2=0x7fadcc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 0x7fadcc055a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faddc00b000 tx=0x7faddc009040).stop 2021-10-21T00:05:23.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 msgr2=0x7fadec155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fadec0b8470 tx=0x7fade8006d90).stop 2021-10-21T00:05:23.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 shutdown_connections 2021-10-21T00:05:23.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fadcc0535b0 0x7fadcc055a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fadec142ce0 0x7fadec1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fadec0b9b10 0x7fadec155e00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 --2- 172.21.15.41:0/3768412935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fadec0b0ac0 0x7fadec05c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 >> 172.21.15.41:0/3768412935 conn(0x7fadec062ec0 msgr2=0x7fadec13fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 shutdown_connections 2021-10-21T00:05:23.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.839+0000 7fadf45f6700 1 -- 172.21.15.41:0/3768412935 wait complete. 2021-10-21T00:05:23.855 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:05:23.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 Processor -- start 2021-10-21T00:05:23.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 -- start start 2021-10-21T00:05:23.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee8c0b9ca0 0x7fee8c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fee8c0b26d0 0x7fee8c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0ba080 con 0x7fee8c0b31e0 2021-10-21T00:05:23.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c05c670 con 0x7fee8c0b26d0 2021-10-21T00:05:23.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.959+0000 7fee928e9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c05c8e0 con 0x7fee8c0b9ca0 2021-10-21T00:05:23.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fee8c0b26d0 0x7fee8c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fee8c0b31e0 0x7fee8c0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57858/0 (socket says 172.21.15.41:57858) 2021-10-21T00:05:23.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8b7fe700 1 -- 172.21.15.41:0/2831920085 learned_addr learned my addr 172.21.15.41:0/2831920085 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:05:23.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8bfff700 1 --2- 172.21.15.41:0/2831920085 >> v2:172.21.15.62:3300/0 conn(0x7fee8c0b9ca0 0x7fee8c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 -- 172.21.15.41:0/2831920085 >> v2:172.21.15.62:3300/0 conn(0x7fee8c0b9ca0 msgr2=0x7fee8c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:23.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 --2- 172.21.15.41:0/2831920085 >> v2:172.21.15.62:3300/0 conn(0x7fee8c0b9ca0 0x7fee8c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 -- 172.21.15.41:0/2831920085 >> v1:172.21.15.41:6789/0 conn(0x7fee8c0b31e0 legacy=0x7fee8c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 -- 172.21.15.41:0/2831920085 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c05cb80 con 0x7fee8c0b26d0 2021-10-21T00:05:23.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee90e86700 1 --2- 172.21.15.41:0/2831920085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b26d0 0x7fee8c141bc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fee840032f0 tx=0x7fee840091d0).ready entity=mon.0 client_cookie=1bbe5c376e376ca7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8affd700 1 -- 172.21.15.41:0/2831920085 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee84009ea0 con 0x7fee8c0b26d0 2021-10-21T00:05:23.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8affd700 1 -- 172.21.15.41:0/2831920085 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400b870 con 0x7fee8c0b26d0 2021-10-21T00:05:23.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee8affd700 1 -- 172.21.15.41:0/2831920085 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8400b9e0 con 0x7fee8c0b26d0 2021-10-21T00:05:23.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- 172.21.15.41:0/2831920085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b26d0 msgr2=0x7fee8c141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 --2- 172.21.15.41:0/2831920085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b26d0 0x7fee8c141bc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fee840032f0 tx=0x7fee840091d0).stop 2021-10-21T00:05:23.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- 172.21.15.41:0/2831920085 shutdown_connections 2021-10-21T00:05:23.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 --2- 172.21.15.41:0/2831920085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b26d0 0x7fee8c141bc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 --2- 172.21.15.41:0/2831920085 >> v2:172.21.15.62:3300/0 conn(0x7fee8c0b9ca0 0x7fee8c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- 172.21.15.41:0/2831920085 >> 172.21.15.41:0/2831920085 conn(0x7fee8c062f00 msgr2=0x7fee8c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:23.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- 172.21.15.41:0/2831920085 shutdown_connections 2021-10-21T00:05:23.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- 172.21.15.41:0/2831920085 wait complete. 2021-10-21T00:05:23.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 Processor -- start 2021-10-21T00:05:23.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.963+0000 7fee928e9700 1 -- start start 2021-10-21T00:05:23.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee8c0b26d0 0x7fee8c0b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee8c0b9ca0 0x7fee8c13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0ae1e0 con 0x7fee8c0b31e0 2021-10-21T00:05:23.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c1454e0 con 0x7fee8c0b26d0 2021-10-21T00:05:23.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0ad410 con 0x7fee8c0b9ca0 2021-10-21T00:05:23.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60096/0 (socket says 172.21.15.41:60096) 2021-10-21T00:05:23.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 -- 172.21.15.41:0/503777320 learned_addr learned my addr 172.21.15.41:0/503777320 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:23.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8bfff700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee8c0b26d0 0x7fee8c0b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee90e86700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee8c0b9ca0 0x7fee8c13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 -- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee8c0b9ca0 msgr2=0x7fee8c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee8c0b9ca0 0x7fee8c13ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 -- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee8c0b26d0 msgr2=0x7fee8c0b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:23.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee8c0b26d0 0x7fee8c0b8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:23.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 -- 172.21.15.41:0/503777320 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009470 con 0x7fee8c0b31e0 2021-10-21T00:05:23.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee8b7fe700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fee8c0633e0 tx=0x7fee7c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7c0070d0 con 0x7fee8c0b31e0 2021-10-21T00:05:23.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c007230 con 0x7fee8c0b31e0 2021-10-21T00:05:23.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0ad6b0 con 0x7fee8c0b31e0 2021-10-21T00:05:23.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee7c005610 con 0x7fee8c0b31e0 2021-10-21T00:05:23.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.967+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c1469c0 con 0x7fee8c0b31e0 2021-10-21T00:05:23.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c057350 con 0x7fee8c0b31e0 2021-10-21T00:05:23.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee7c010070 con 0x7fee8c0b31e0 2021-10-21T00:05:23.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee897fa700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 0x7fee6c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:23.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee7c06af40 con 0x7fee8c0b31e0 2021-10-21T00:05:23.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee8bfff700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 0x7fee6c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:23.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.971+0000 7fee8bfff700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 0x7fee6c055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fee8000c000 tx=0x7fee80008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:23.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:23.975+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee7c042000 con 0x7fee8c0b31e0 2021-10-21T00:05:24.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee8c067c90 con 0x7fee8c0b31e0 2021-10-21T00:05:24.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee897fa700 1 -- 172.21.15.41:0/503777320 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+10 (secure 0 0 0) 0x7fee7c018030 con 0x7fee8c0b31e0 2021-10-21T00:05:24.102 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:05:24.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 msgr2=0x7fee6c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 0x7fee6c055b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fee8000c000 tx=0x7fee80008040).stop 2021-10-21T00:05:24.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 msgr2=0x7fee8c0acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fee8c0633e0 tx=0x7fee7c007c00).stop 2021-10-21T00:05:24.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 shutdown_connections 2021-10-21T00:05:24.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fee6c0536a0 0x7fee6c055b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee8c0b9ca0 0x7fee8c13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fee8c0b31e0 0x7fee8c0acd70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 --2- 172.21.15.41:0/503777320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee8c0b26d0 0x7fee8c0b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.099+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 >> 172.21.15.41:0/503777320 conn(0x7fee8c062f00 msgr2=0x7fee8c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:24.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.103+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 shutdown_connections 2021-10-21T00:05:24.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.103+0000 7fee928e9700 1 -- 172.21.15.41:0/503777320 wait complete. 2021-10-21T00:05:24.115 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:05:24.116 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:05:24.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 Processor -- start 2021-10-21T00:05:24.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 -- start start 2021-10-21T00:05:24.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85c40b2170 0x7f85c40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c40ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40b0b50 con 0x7f85c40abb50 2021-10-21T00:05:24.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40b2550 con 0x7f85c40b2170 2021-10-21T00:05:24.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cb45b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40b0d90 con 0x7f85c40af620 2021-10-21T00:05:24.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85c9c58700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c40ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85c40b2170 0x7f85c40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85c40b2170 0x7f85c40ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43788/0 (socket says 172.21.15.41:43788) 2021-10-21T00:05:24.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 -- 172.21.15.41:0/1714469374 learned_addr learned my addr 172.21.15.41:0/1714469374 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:24.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85cac5a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f85c40abb50 0x7f85c414a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37700/0 (socket says 172.21.15.41:37700) 2021-10-21T00:05:24.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 -- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 msgr2=0x7f85c40ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:05:24.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 --2- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c40ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 -- 172.21.15.41:0/1714469374 >> v1:172.21.15.62:6789/0 conn(0x7f85c40abb50 legacy=0x7f85c414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 -- 172.21.15.41:0/1714469374 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40b1030 con 0x7f85c40b2170 2021-10-21T00:05:24.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.215+0000 7f85ca459700 1 --2- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40b2170 0x7f85c40ab170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f85bc0032f0 tx=0x7f85bc009290).ready entity=mon.1 client_cookie=95e9e9ee0854ce1d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:24.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85c9457700 1 -- 172.21.15.41:0/1714469374 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc00b8a0 con 0x7f85c40b2170 2021-10-21T00:05:24.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85c9457700 1 -- 172.21.15.41:0/1714469374 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00ba00 con 0x7f85c40b2170 2021-10-21T00:05:24.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85c9457700 1 -- 172.21.15.41:0/1714469374 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc00bb70 con 0x7f85c40b2170 2021-10-21T00:05:24.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40b2170 msgr2=0x7f85c40ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40b2170 0x7f85c40ab170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f85bc0032f0 tx=0x7f85bc009290).stop 2021-10-21T00:05:24.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- 172.21.15.41:0/1714469374 shutdown_connections 2021-10-21T00:05:24.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c40ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- 172.21.15.41:0/1714469374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40b2170 0x7f85c40ab170 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- 172.21.15.41:0/1714469374 >> 172.21.15.41:0/1714469374 conn(0x7f85c40b5700 msgr2=0x7f85c40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:24.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- 172.21.15.41:0/1714469374 shutdown_connections 2021-10-21T00:05:24.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- 172.21.15.41:0/1714469374 wait complete. 2021-10-21T00:05:24.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 Processor -- start 2021-10-21T00:05:24.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- start start 2021-10-21T00:05:24.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 0x7f85c4144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c41450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4157120 con 0x7f85c40b2170 2021-10-21T00:05:24.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40ac960 con 0x7f85c40abb50 2021-10-21T00:05:24.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cb45b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4097730 con 0x7f85c40af620 2021-10-21T00:05:24.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85ca459700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 0x7f85c4144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85ca459700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 0x7f85c4144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43794/0 (socket says 172.21.15.41:43794) 2021-10-21T00:05:24.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85ca459700 1 -- 172.21.15.41:0/751436649 learned_addr learned my addr 172.21.15.41:0/751436649 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:05:24.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60112/0 (socket says 172.21.15.41:60112) 2021-10-21T00:05:24.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85c9c58700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c41450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 -- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 msgr2=0x7f85c41450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c41450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 -- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 msgr2=0x7f85c4144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 0x7f85c4144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 -- 172.21.15.41:0/751436649 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc009530 con 0x7f85c40b2170 2021-10-21T00:05:24.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.219+0000 7f85cac5a700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f85c40aab80 tx=0x7f85c0007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:24.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c000ccd0 con 0x7f85c40b2170 2021-10-21T00:05:24.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000ce30 con 0x7f85c40b2170 2021-10-21T00:05:24.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4156c20 con 0x7f85c40b2170 2021-10-21T00:05:24.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c00072c0 con 0x7f85c40b2170 2021-10-21T00:05:24.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c40aebb0 con 0x7f85c40b2170 2021-10-21T00:05:24.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c40acb20 con 0x7f85c40b2170 2021-10-21T00:05:24.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85c0010070 con 0x7f85c40b2170 2021-10-21T00:05:24.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 0x7f85a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:05:24.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f85c006ac70 con 0x7f85c40b2170 2021-10-21T00:05:24.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85ca459700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 0x7f85a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:05:24.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.223+0000 7f85ca459700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 0x7f85a4055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f85bc01b000 tx=0x7f85bc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:05:24.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.231+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85c0041d30 con 0x7f85c40b2170 2021-10-21T00:05:24.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85c40b0b50 con 0x7f85c40b2170 2021-10-21T00:05:24.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85b37fe700 1 -- 172.21.15.41:0/751436649 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f85c40b0b50 con 0x7f85c40b2170 2021-10-21T00:05:24.403 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:05:24.404 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:05:24.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 msgr2=0x7f85a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 0x7f85a4055b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f85bc01b000 tx=0x7f85bc016000).stop 2021-10-21T00:05:24.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 msgr2=0x7f85c40ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:05:24.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f85c40aab80 tx=0x7f85c0007b60).stop 2021-10-21T00:05:24.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 shutdown_connections 2021-10-21T00:05:24.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85a40536a0 0x7f85a4055b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85c40b2170 0x7f85c40ae520 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85c40af620 0x7f85c41450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 --2- 172.21.15.41:0/751436649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85c40abb50 0x7f85c4144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:05:24.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 >> 172.21.15.41:0/751436649 conn(0x7f85c40b5700 msgr2=0x7f85c40b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:05:24.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 shutdown_connections 2021-10-21T00:05:24.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:05:24.399+0000 7f85cb45b700 1 -- 172.21.15.41:0/751436649 wait complete. 2021-10-21T00:05:24.408 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:05:24.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:04:53.503441+0000', 'modified': '2021-10-21T00:04:54.506494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'b', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/4294881740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 4294881740}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 4294881740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:05:24.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:05:24.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:05:24.733 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5283,"want_state":"up:active","state":"up:active","rank_uptime":31.215066475,"mdsmap_epoch":16,"osdmap_epoch":40,"osdmap_epoch_barrier":39,"uptime":35.590804083999998} 2021-10-21T00:05:24.734 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5283, "mdsmap_epoch": 16, "osdmap_epoch": 40, "osdmap_epoch_barrier": 39, "rank_uptime": 31.215066475, "state": "up:active", "uptime": 35.590804084, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:05:24.735 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:05:24.735 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:05:24.736 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:05:24.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:24.736 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:24.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:05:24.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:05:24.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:05:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:05:24.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:05:24.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:24.823 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:05:24.829 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:05:24.829 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:24.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:05:24.890 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:05:24.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:05:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:05:24.901 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:05:24.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:24.903 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:05:24.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:05:24.944+0000 7f8f7d98a080 -1 init, newargv = 0x55a8a51dd900 newargc=9 2021-10-21T00:05:24.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14107]: starting ceph client 2021-10-21T00:05:24.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14107]: starting fuse 2021-10-21T00:05:26.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:05:26.074 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:05:26.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:05:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:05:26.086 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:05:26.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:26.088 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:05:26.137 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:05:26.138 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:05:26.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:26.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:05:26.139 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:05:26.140 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:05:26.140 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:05:26.140 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:05:26.141 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:26.141 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:05:26.142 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:05:26.142 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:05:26.142 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:26.143 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:05:26.143 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:05:26.144 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:05:26.144 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:05:26.144 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:26.145 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:05:26.145 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:05:26.145 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:05:26.146 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:05:26.146 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:05:26.147 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:05:26.147 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:05:26.147 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:05:26.191 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14107.asok 2021-10-21T00:05:26.196 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14107.asok 2021-10-21T00:05:26.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:26.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14107.asok status 2021-10-21T00:05:26.286 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:05:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:05:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:05:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:05:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:05:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:05:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:05:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14107", 2021-10-21T00:05:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:05:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:05:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:05:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5470, 2021-10-21T00:05:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:05:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:05:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:05:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5470 2021-10-21T00:05:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:05:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:05:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:05:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1450337607 2021-10-21T00:05:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:05:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:05:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:05:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:05:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1450337607 2021-10-21T00:05:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:05:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5470 172.21.15.71:0/1450337607", 2021-10-21T00:05:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/1450337607", 2021-10-21T00:05:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:05:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 16, 2021-10-21T00:05:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 40, 2021-10-21T00:05:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:05:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:05:26.297 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:05:26.297 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:05:26.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:26.300 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:05:26.300 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:26.307 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:05:26.308 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:05:26.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:05:26.309 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:05:27.595 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:27.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:27.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:27.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:27.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:57.667 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:57.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:57.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:57.675 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:05:57.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:14.141 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:06:14.143 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:14.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:14.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:14.207 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:14.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:14.253 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:06:14.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:14.255 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:14.255 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:14.264 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:06:14.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:14.266 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:06:14.266 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:06:14.266 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:14.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14107]: fuse finished with error 0 and tester_r 0 2021-10-21T00:06:14.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:14.325 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:14.326 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:14.332 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:06:14.333 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:06:14.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:06:14.415 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:14.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:14.422 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:14.422 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:06:14.431 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:06:14.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:14.433 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:06:14.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:06:14.434 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:06:14.440 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:06:14.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:14.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:14.442 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:14.443 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:06:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:06:14.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:14.452 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:06:14.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:06:14.453 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:06:14.499 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:06:14.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:14.501 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:06:14.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.606+0000 7f106dd8a700 1 Processor -- start 2021-10-21T00:06:14.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.606+0000 7f106dd8a700 1 -- start start 2021-10-21T00:06:14.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f10680b2170 0x7f10680ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680af620 0x7f10680ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10680abb50 0x7f106814a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10680b0b50 con 0x7f10680b2170 2021-10-21T00:06:14.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10680b2550 con 0x7f10680abb50 2021-10-21T00:06:14.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10680b0d90 con 0x7f10680af620 2021-10-21T00:06:14.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f10680b2170 0x7f10680ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f10680b2170 0x7f10680ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60116/0 (socket says 172.21.15.41:60116) 2021-10-21T00:06:14.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 -- 172.21.15.41:0/1828052774 learned_addr learned my addr 172.21.15.41:0/1828052774 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:14.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106d589700 1 --2- 172.21.15.41:0/1828052774 >> v2:172.21.15.62:3300/0 conn(0x7f10680abb50 0x7f106814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f1067fff700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680af620 0x7f10680ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 -- 172.21.15.41:0/1828052774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680af620 msgr2=0x7f10680ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:14.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680af620 0x7f10680ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 -- 172.21.15.41:0/1828052774 >> v2:172.21.15.62:3300/0 conn(0x7f10680abb50 msgr2=0x7f106814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:14.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 --2- 172.21.15.41:0/1828052774 >> v2:172.21.15.62:3300/0 conn(0x7f10680abb50 0x7f106814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 -- 172.21.15.41:0/1828052774 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10680b1030 con 0x7f10680b2170 2021-10-21T00:06:14.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106cd88700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680b2170 0x7f10680ab170 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f10600032f0 tx=0x7f1060009290).ready entity=mon.0 client_cookie=26dd2e5d6aa9eab1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:14.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f10677fe700 1 -- 172.21.15.41:0/1828052774 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106000b680 con 0x7f10680b2170 2021-10-21T00:06:14.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f10677fe700 1 -- 172.21.15.41:0/1828052774 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000b7e0 con 0x7f10680b2170 2021-10-21T00:06:14.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f10677fe700 1 -- 172.21.15.41:0/1828052774 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f106000b950 con 0x7f10680b2170 2021-10-21T00:06:14.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- 172.21.15.41:0/1828052774 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680b2170 msgr2=0x7f10680ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:14.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680b2170 0x7f10680ab170 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f10600032f0 tx=0x7f1060009290).stop 2021-10-21T00:06:14.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- 172.21.15.41:0/1828052774 shutdown_connections 2021-10-21T00:06:14.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- 172.21.15.41:0/1828052774 >> v2:172.21.15.62:3300/0 conn(0x7f10680abb50 0x7f106814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680af620 0x7f10680ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 --2- 172.21.15.41:0/1828052774 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680b2170 0x7f10680ab170 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- 172.21.15.41:0/1828052774 >> 172.21.15.41:0/1828052774 conn(0x7f10680b5700 msgr2=0x7f10680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- 172.21.15.41:0/1828052774 shutdown_connections 2021-10-21T00:06:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.610+0000 7f106dd8a700 1 -- 172.21.15.41:0/1828052774 wait complete. 2021-10-21T00:06:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 Processor -- start 2021-10-21T00:06:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- start start 2021-10-21T00:06:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10680abb50 0x7f1068064600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 0x7f1068066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068063ca0 con 0x7f10680af620 2021-10-21T00:06:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068063760 con 0x7f10680abb50 2021-10-21T00:06:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1068063a00 con 0x7f10680b2170 2021-10-21T00:06:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60124/0 (socket says 172.21.15.41:60124) 2021-10-21T00:06:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 -- 172.21.15.41:0/4195569799 learned_addr learned my addr 172.21.15.41:0/4195569799 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106cd88700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10680abb50 0x7f1068064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106d589700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 0x7f1068066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 -- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 msgr2=0x7f1068066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 0x7f1068066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 -- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10680abb50 msgr2=0x7f1068064600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10680abb50 0x7f1068064600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 -- 172.21.15.41:0/4195569799 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009530 con 0x7f10680af620 2021-10-21T00:06:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106d589700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 0x7f1068066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1067fff700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f105c00c000 tx=0x7f105c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c010780 con 0x7f10680af620 2021-10-21T00:06:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0108e0 con 0x7f10680af620 2021-10-21T00:06:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106808f3c0 con 0x7f10680af620 2021-10-21T00:06:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105c010c40 con 0x7f10680af620 2021-10-21T00:06:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.614+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10680aecb0 con 0x7f10680af620 2021-10-21T00:06:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f105c01c460 con 0x7f10680af620 2021-10-21T00:06:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10680642f0 con 0x7f10680af620 2021-10-21T00:06:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f1065ffb700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 0x7f1048055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f105c06be50 con 0x7f10680af620 2021-10-21T00:06:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f106cd88700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 0x7f1048055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.618+0000 7f106cd88700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 0x7f1048055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1060019000 tx=0x7f1060017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.626+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f105c042eb0 con 0x7f10680af620 2021-10-21T00:06:14.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.754+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f10680b12d0 con 0x7f10680af620 2021-10-21T00:06:14.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.754+0000 7f1065ffb700 1 -- 172.21.15.41:0/4195569799 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v40) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f105c0464d0 con 0x7f10680af620 2021-10-21T00:06:14.761 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:14.761 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:06:14.761 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 40, 2021-10-21T00:06:14.762 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:06:14.762 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:06:14.762 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:04:54.507266+0000", 2021-10-21T00:06:14.762 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:06:14.763 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:06:14.763 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:06:14.764 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:06:14.764 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:06:14.764 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:06:14.764 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:06:14.765 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:06:14.765 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:06:14.765 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:14.765 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:06:14.765 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:06:14.766 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:06:14.766 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:06:14.766 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:06:14.767 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 8, 2021-10-21T00:06:14.767 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:06:14.768 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:06:14.769 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:06:14.769 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:06:14.769 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:06:14.770 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.770 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:06:14.770 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:06:14.771 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:06:14.771 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:14.771 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:14.772 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:14.772 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:14.772 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:14.772 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:14.773 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:14.773 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:14.773 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:06:14.774 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:06:14.774 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:06:14.774 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:06:14.774 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:06:14.775 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:14.775 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:14.775 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:14.775 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:14.776 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:14.776 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:14.777 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:14.777 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.777 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:06:14.777 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:14.778 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:14.778 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:14.780 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:14.780 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:14.781 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:14.781 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:14.781 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:14.782 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:14.782 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:14.783 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:14.783 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:14.784 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:14.784 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:14.785 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:14.785 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:14.785 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:14.786 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:14.786 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:14.787 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:14.787 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:14.788 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:14.788 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:14.788 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:14.789 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:14.789 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:14.790 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.790 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:14.791 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:14.791 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:14.791 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:14.792 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:14.792 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:14.794 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:14.794 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:14.795 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:14.796 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:14.796 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:14.797 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:06:14.797 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:06:14.797 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.797 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:14.798 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:06:14.798 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.798 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.798 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.799 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:06:14.799 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:06:14.799 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:06:14.800 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:14.800 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:14.800 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:14.801 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:14.801 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:14.801 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:14.801 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:14.802 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:14.802 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:06:14.802 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:06:14.802 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:06:14.803 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:06:14.803 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:06:14.803 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:14.803 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:14.803 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:14.804 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:14.804 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:14.804 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:14.804 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:14.805 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.805 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:06:14.805 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:14.805 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:14.805 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:14.806 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:14.806 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:14.806 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:14.807 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:14.807 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:14.808 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:14.808 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:14.809 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:14.810 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:14.810 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:14.811 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:14.811 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:14.811 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:14.812 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:14.812 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:14.813 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:14.813 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:14.814 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:14.814 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:14.814 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:14.815 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:14.815 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:14.816 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:14.816 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.816 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:14.817 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:14.818 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:14.818 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:14.819 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:14.819 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:14.820 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:14.820 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:14.821 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:14.821 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:14.822 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:14.822 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:06:14.822 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:14.823 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:06:14.823 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.824 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.824 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.825 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 7, 2021-10-21T00:06:14.825 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:06:14.825 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:04:51.918069+0000", 2021-10-21T00:06:14.826 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:14.827 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:14.827 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:14.827 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:14.828 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:14.828 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:14.829 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:14.829 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:14.830 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:06:14.830 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:06:14.830 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:06:14.831 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:06:14.831 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:06:14.832 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:14.832 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:14.833 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:14.833 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:14.833 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:14.834 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:14.834 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:14.835 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.835 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "39", 2021-10-21T00:06:14.836 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:14.836 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:14.836 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:14.837 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:14.837 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:14.838 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:14.838 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:14.839 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:14.839 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:14.840 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:14.840 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:14.840 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:14.841 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:14.841 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:14.841 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:14.841 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:14.842 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:14.842 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:14.842 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:14.842 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:14.842 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:14.843 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:14.843 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:14.843 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:14.843 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:14.844 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:14.844 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.844 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:14.844 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:14.845 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:14.845 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:14.845 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:14.845 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:14.846 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:14.846 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:14.846 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:14.847 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:14.847 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:14.847 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:06:14.847 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:06:14.848 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:06:14.848 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:06:14.848 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.850 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:14.851 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:06:14.851 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:06:14.851 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.851 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.851 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.852 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.852 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 8, 2021-10-21T00:06:14.852 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:06:14.852 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:04:53.087464+0000", 2021-10-21T00:06:14.853 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:14.853 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:14.853 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:14.853 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:14.853 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:14.854 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:14.854 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:14.855 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:14.855 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:06:14.855 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:06:14.856 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:06:14.856 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:06:14.856 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:06:14.856 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:14.857 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:14.857 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:14.857 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:14.857 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:14.857 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:14.858 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:14.858 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.858 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "40", 2021-10-21T00:06:14.858 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:14.859 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:14.859 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:14.859 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:14.860 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:14.860 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:14.860 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:14.860 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:14.860 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:14.861 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:14.861 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:14.861 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:14.861 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:14.862 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:14.862 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:14.862 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:14.862 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:14.863 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:14.863 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:14.863 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:14.864 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:14.864 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:14.864 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:14.864 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:14.864 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:14.865 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:14.865 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.865 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:14.866 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:14.866 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:14.866 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:14.866 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:14.867 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:14.867 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:14.867 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:14.867 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:14.868 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:14.868 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:14.868 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:06:14.868 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:14.869 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:06:14.869 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:06:14.869 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.869 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.869 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.870 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:14.870 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:06:14.870 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.870 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:06:14.871 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:06:14.871 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.871 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.871 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.871 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.872 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.872 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.872 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.872 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.873 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.873 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.873 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.873 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.873 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.874 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.874 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:06:14.874 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.874 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.875 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.875 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.875 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:06:14.875 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.875 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.876 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.876 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.876 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.876 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.877 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.877 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.877 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:06:14.877 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.877 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.878 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.878 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.878 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:06:14.878 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.878 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.879 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.879 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.879 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.879 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.879 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.880 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.880 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:06:14.880 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.880 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.881 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.881 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.881 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:06:14.881 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.881 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.882 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.882 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.882 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.882 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.883 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.883 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.883 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:06:14.883 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.884 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.884 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.884 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.884 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:06:14.885 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:14.885 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.885 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.885 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.886 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:06:14.886 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:06:14.886 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:06:14.886 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:06:14.887 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.887 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.887 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.887 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.888 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.888 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.888 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:06:14.888 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:06:14.889 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.889 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.889 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.889 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.889 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.890 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.890 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.890 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.890 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.891 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.891 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.891 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.891 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.891 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.892 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:06:14.892 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.892 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.892 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.892 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.893 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:06:14.893 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.893 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.893 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.894 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.894 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.894 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.894 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.895 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.895 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:06:14.895 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.895 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.895 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.896 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.896 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:06:14.896 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.896 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.896 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.897 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.897 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.897 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.897 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.898 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.898 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:06:14.898 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.898 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.898 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.899 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.899 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:06:14.899 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.899 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.899 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.900 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.900 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.900 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.900 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.900 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.901 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:06:14.901 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.901 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.901 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.902 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.902 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:06:14.902 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:14.902 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.902 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.903 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.903 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:06:14.903 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:06:14.903 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:06:14.903 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:06:14.904 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.904 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.904 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.904 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.905 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.905 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.905 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:06:14.905 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:06:14.905 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.906 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.906 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.906 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.906 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.907 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.907 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.907 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:06:14.907 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.907 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.908 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.908 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.908 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.908 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.909 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:06:14.909 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.909 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.909 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.909 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.910 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:06:14.910 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.910 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.910 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.911 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.911 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.911 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.911 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.912 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.912 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:06:14.912 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.912 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.912 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.913 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.913 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:06:14.913 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.913 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.913 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.914 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.914 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.914 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.914 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.915 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.915 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:06:14.915 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.915 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.915 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.916 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.916 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:06:14.916 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.916 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.916 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.917 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.917 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.917 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.917 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.918 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.918 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:06:14.918 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.918 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.918 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.919 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.919 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:06:14.919 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:14.919 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.919 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.920 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.920 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:06:14.920 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:06:14.920 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:06:14.921 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:06:14.921 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.921 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.921 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.921 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.922 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.922 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.922 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:06:14.922 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:06:14.923 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.923 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.923 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.923 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.923 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.924 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.924 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.924 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.924 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.925 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.925 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.925 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.925 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.925 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.926 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:06:14.926 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.926 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.926 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.926 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.927 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:06:14.927 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.927 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.927 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.928 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.928 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.928 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.928 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.928 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.929 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:06:14.929 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.929 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.929 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.929 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.930 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:06:14.930 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.930 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.930 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.930 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.931 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.931 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.931 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.931 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.932 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:06:14.932 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.932 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.932 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.932 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.933 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:06:14.933 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.933 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.933 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.933 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.934 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.934 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.934 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.934 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.934 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:06:14.935 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.935 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.935 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.935 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.935 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:06:14.936 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:14.936 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.936 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.936 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.937 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:06:14.937 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:06:14.937 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:06:14.937 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:06:14.937 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.938 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.938 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.938 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.938 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.938 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.939 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:06:14.939 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:06:14.939 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.939 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.940 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.940 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.940 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.940 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.940 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.941 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.941 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.941 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.941 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.941 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.942 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.942 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.942 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:06:14.942 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.942 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.943 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.943 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.943 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:06:14.943 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.944 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.944 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.944 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.944 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.944 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.945 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.945 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.945 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:06:14.945 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.945 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.946 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.946 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.946 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:06:14.946 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.946 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.947 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.947 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.947 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.947 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.948 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.948 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.948 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:06:14.948 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.948 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.949 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.949 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.949 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:06:14.949 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.949 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.950 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.950 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.950 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.950 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.950 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.951 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.951 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:06:14.951 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.951 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.951 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.952 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.952 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:06:14.952 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:14.952 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.953 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.953 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.953 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:06:14.953 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:06:14.953 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:06:14.954 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:06:14.954 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.954 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.954 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.955 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.955 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.955 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.955 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:06:14.955 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:06:14.956 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.956 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.956 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.956 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.956 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.957 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.957 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.957 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.957 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.957 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.958 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.958 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.958 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.958 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.959 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:06:14.959 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.959 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.959 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.959 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.960 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:06:14.960 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.960 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.960 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.960 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.961 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.961 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.961 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.961 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.962 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:06:14.962 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.962 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.962 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.963 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.963 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:06:14.963 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.963 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.963 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.964 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.964 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.964 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.964 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.964 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.965 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:06:14.965 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.965 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.965 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.966 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.966 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:06:14.966 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.966 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.966 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.967 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.967 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.967 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.967 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.967 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.968 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:06:14.968 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.968 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.968 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.968 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.969 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:06:14.969 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:14.969 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.969 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.970 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.970 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:06:14.970 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:06:14.970 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:06:14.970 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:06:14.971 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.971 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.971 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.971 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.972 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.972 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.972 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:06:14.972 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:06:14.972 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.973 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.973 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.973 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.973 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.973 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.974 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.974 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:14.974 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.974 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.975 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.975 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.975 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.975 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.975 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:06:14.976 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.976 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.976 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.976 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.976 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:06:14.977 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.977 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.977 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.977 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.978 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.978 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.978 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.978 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.978 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:06:14.979 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.979 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.979 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.979 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.979 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:06:14.980 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.980 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.980 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.980 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.980 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.981 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.981 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.981 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.982 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:06:14.982 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.982 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.982 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.983 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.983 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:06:14.983 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.983 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.983 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.984 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.984 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:14.984 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.984 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.985 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.985 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:06:14.985 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.985 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.985 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.986 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.986 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:06:14.986 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:14.986 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.986 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.987 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.987 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:06:14.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:06:14.987 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:06:14.987 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:06:14.988 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:14.988 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:14.988 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:14.988 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.989 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.989 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.989 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:06:14.989 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:06:14.989 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:14.990 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:14.990 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:14.990 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:14.990 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:14.990 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:14.991 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:14.991 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 37, 2021-10-21T00:06:14.991 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:14.991 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:14.992 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:14.992 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.992 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.992 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.992 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:06:14.993 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:14.993 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.993 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.993 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.993 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:06:14.994 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:14.994 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.994 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.994 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.995 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:14.995 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.995 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.995 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.995 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:06:14.996 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:14.996 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.996 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.996 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:14.996 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:06:14.997 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:14.997 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:14.997 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:14.997 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.998 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:14.998 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:14.998 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.998 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:14.998 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:06:14.999 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:14.999 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:14.999 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:14.999 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:15.000 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:06:15.002 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:15.003 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:15.003 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:15.003 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.003 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:15.004 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:15.004 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.004 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:15.004 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:06:15.004 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:15.005 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.005 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.005 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:15.005 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:06:15.006 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:15.006 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:15.006 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:15.006 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.006 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:06:15.007 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:06:15.007 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:06:15.007 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:06:15.007 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:15.008 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:15.008 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:15.008 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:15.008 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:15.008 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:15.009 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:06:15.009 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.009 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:06:15.009 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.010 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.010 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.010 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.010 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.010 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:06:15.011 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.011 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.011 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.011 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:06:15.012 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.012 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.012 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.012 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.012 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.013 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:06:15.013 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.013 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.013 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.014 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:06:15.014 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.014 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.014 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.014 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.015 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.015 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:06:15.015 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.015 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.015 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.016 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:06:15.016 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.016 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.016 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.017 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.017 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.017 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:06:15.017 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.017 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.018 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.018 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:06:15.018 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.018 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.019 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.019 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.019 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.019 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:06:15.019 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.020 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.020 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.020 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:06:15.020 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.020 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.021 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.021 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.021 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.021 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:06:15.022 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.022 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.022 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.022 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:06:15.022 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.023 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.023 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.023 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.023 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.024 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:06:15.024 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.024 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.024 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:15.024 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:06:15.025 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:15.025 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:15.025 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:15.025 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:15.025 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:15.026 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:06:15.026 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:15.026 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:15.026 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:15.027 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:06:15.027 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:06:15.027 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:06:15.027 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:06:15.027 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:06:15.028 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:06:15.028 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:06:15.028 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:06:15.028 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:06:15.029 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:06:15.029 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:06:15.029 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:06:15.029 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:06:15.029 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:15.030 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:15.030 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:06:15.030 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:06:15.030 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:06:15.031 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:06:15.031 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:06:15.031 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:06:15.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 msgr2=0x7f1048055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 0x7f1048055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1060019000 tx=0x7f1060017000).stop 2021-10-21T00:06:15.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 msgr2=0x7f10680ac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f105c00c000 tx=0x7f105c006df0).stop 2021-10-21T00:06:15.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 shutdown_connections 2021-10-21T00:06:15.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10480536a0 0x7f1048055b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10680b2170 0x7f1068066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10680af620 0x7f10680ac400 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 --2- 172.21.15.41:0/4195569799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10680abb50 0x7f1068064600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 >> 172.21.15.41:0/4195569799 conn(0x7f10680b5700 msgr2=0x7f106805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:15.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 shutdown_connections 2021-10-21T00:06:15.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:14.758+0000 7f106dd8a700 1 -- 172.21.15.41:0/4195569799 wait complete. 2021-10-21T00:06:15.037 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:15.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 Processor -- start 2021-10-21T00:06:15.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 -- start start 2021-10-21T00:06:15.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1784062f70 0x7f178405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17840b3a20 0x7f178413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178405bd40 con 0x7f1784062330 2021-10-21T00:06:15.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178405bf70 con 0x7f1784062f70 2021-10-21T00:06:15.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1783fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1784142cb0 con 0x7f17840b3a20 2021-10-21T00:06:15.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1782ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1784062330 0x7f17840b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57900/0 (socket says 172.21.15.41:57900) 2021-10-21T00:06:15.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1784062f70 0x7f178405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1782ffd700 1 -- 172.21.15.41:0/2119243265 learned_addr learned my addr 172.21.15.41:0/2119243265 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:15.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17837fe700 1 --2- 172.21.15.41:0/2119243265 >> v2:172.21.15.62:3300/0 conn(0x7f17840b3a20 0x7f178413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 -- 172.21.15.41:0/2119243265 >> v2:172.21.15.62:3300/0 conn(0x7f17840b3a20 msgr2=0x7f178413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:15.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 --2- 172.21.15.41:0/2119243265 >> v2:172.21.15.62:3300/0 conn(0x7f17840b3a20 0x7f178413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 -- 172.21.15.41:0/2119243265 >> v1:172.21.15.41:6789/0 conn(0x7f1784062330 legacy=0x7f17840b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 -- 172.21.15.41:0/2119243265 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784142950 con 0x7f1784062f70 2021-10-21T00:06:15.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f17827fc700 1 --2- 172.21.15.41:0/2119243265 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f178405c410 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f176c002f70 tx=0x7f176c006df0).ready entity=mon.0 client_cookie=f5ba4ddcddb66713 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1781ffb700 1 -- 172.21.15.41:0/2119243265 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c00d570 con 0x7f1784062f70 2021-10-21T00:06:15.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1781ffb700 1 -- 172.21.15.41:0/2119243265 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c000e90 con 0x7f1784062f70 2021-10-21T00:06:15.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.146+0000 7f1781ffb700 1 -- 172.21.15.41:0/2119243265 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c00d8c0 con 0x7f1784062f70 2021-10-21T00:06:15.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- 172.21.15.41:0/2119243265 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 msgr2=0x7f178405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 --2- 172.21.15.41:0/2119243265 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f178405c410 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f176c002f70 tx=0x7f176c006df0).stop 2021-10-21T00:06:15.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- 172.21.15.41:0/2119243265 shutdown_connections 2021-10-21T00:06:15.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 --2- 172.21.15.41:0/2119243265 >> v2:172.21.15.62:3300/0 conn(0x7f17840b3a20 0x7f178413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 --2- 172.21.15.41:0/2119243265 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f178405c410 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- 172.21.15.41:0/2119243265 >> 172.21.15.41:0/2119243265 conn(0x7f17840b9080 msgr2=0x7f17840b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:15.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- 172.21.15.41:0/2119243265 shutdown_connections 2021-10-21T00:06:15.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- 172.21.15.41:0/2119243265 wait complete. 2021-10-21T00:06:15.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 Processor -- start 2021-10-21T00:06:15.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.150+0000 7f1783fff700 1 -- start start 2021-10-21T00:06:15.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784062330 0x7f17840aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17840b3a20 0x7f1784145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178413d640 con 0x7f1784062f70 2021-10-21T00:06:15.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841137f0 con 0x7f1784062330 2021-10-21T00:06:15.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1784113a50 con 0x7f17840b3a20 2021-10-21T00:06:15.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60138/0 (socket says 172.21.15.41:60138) 2021-10-21T00:06:15.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 -- 172.21.15.41:0/3665512118 learned_addr learned my addr 172.21.15.41:0/3665512118 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:15.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1782ffd700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784062330 0x7f17840aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17837fe700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17840b3a20 0x7f1784145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 -- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17840b3a20 msgr2=0x7f1784145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17840b3a20 0x7f1784145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 -- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784062330 msgr2=0x7f17840aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784062330 0x7f17840aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 -- 172.21.15.41:0/3665512118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c00b180 con 0x7f1784062f70 2021-10-21T00:06:15.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f17827fc700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f176c002f70 tx=0x7f176c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c016070 con 0x7f1784062f70 2021-10-21T00:06:15.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c00d8f0 con 0x7f1784062f70 2021-10-21T00:06:15.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784144190 con 0x7f1784062f70 2021-10-21T00:06:15.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c013e50 con 0x7f1784062f70 2021-10-21T00:06:15.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.154+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784144ac0 con 0x7f1784062f70 2021-10-21T00:06:15.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784057350 con 0x7f1784062f70 2021-10-21T00:06:15.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f176c025030 con 0x7f1784062f70 2021-10-21T00:06:15.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f177bfff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 0x7f1768055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f176c06c940 con 0x7f1784062f70 2021-10-21T00:06:15.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f1782ffd700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 0x7f1768055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.158+0000 7f1782ffd700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 0x7f1768055b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f177400d000 tx=0x7f1774009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.166+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f176c043a20 con 0x7f1784062f70 2021-10-21T00:06:15.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f178405d080 con 0x7f1784062f70 2021-10-21T00:06:15.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f177bfff700 1 -- 172.21.15.41:0/3665512118 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f176c023020 con 0x7f1784062f70 2021-10-21T00:06:15.336 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:15.336 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:04:54.506494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/4294881740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4294881740},{"type":"v1","addr":"172.21.15.62:6835","nonce":4294881740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:06:15.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 msgr2=0x7f1768055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 0x7f1768055b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f177400d000 tx=0x7f1774009040).stop 2021-10-21T00:06:15.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 msgr2=0x7f17840aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f176c002f70 tx=0x7f176c014000).stop 2021-10-21T00:06:15.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 shutdown_connections 2021-10-21T00:06:15.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f17680536a0 0x7f1768055b60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17840b3a20 0x7f1784145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1784062f70 0x7f17840aefc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 --2- 172.21.15.41:0/3665512118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1784062330 0x7f17840aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.330+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 >> 172.21.15.41:0/3665512118 conn(0x7f17840b9080 msgr2=0x7f17840b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:15.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.334+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 shutdown_connections 2021-10-21T00:06:15.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.334+0000 7f1783fff700 1 -- 172.21.15.41:0/3665512118 wait complete. 2021-10-21T00:06:15.341 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 16 2021-10-21T00:06:15.349 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:06:15.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 Processor -- start 2021-10-21T00:06:15.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 -- start start 2021-10-21T00:06:15.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 0x7f094c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f094c14b350 0x7f094c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0609d0 con 0x7f094c0aa750 2021-10-21T00:06:15.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0b1620 con 0x7f094c05f9f0 2021-10-21T00:06:15.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0951695700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c05fdd0 con 0x7f094c14b350 2021-10-21T00:06:15.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 0x7f094c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 0x7f094c14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60144/0 (socket says 172.21.15.41:60144) 2021-10-21T00:06:15.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094affd700 1 -- 172.21.15.41:0/3758728057 learned_addr learned my addr 172.21.15.41:0/3758728057 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:15.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 --2- 172.21.15.41:0/3758728057 >> v2:172.21.15.62:3300/0 conn(0x7f094c14b350 0x7f094c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 -- 172.21.15.41:0/3758728057 >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 msgr2=0x7f094c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:15.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 --2- 172.21.15.41:0/3758728057 >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 0x7f094c14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 -- 172.21.15.41:0/3758728057 >> v1:172.21.15.62:6789/0 conn(0x7f094c0aa750 legacy=0x7f094c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f0949ffb700 1 -- 172.21.15.41:0/3758728057 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149400822 0 0) 0x7f094c0609d0 con 0x7f094c0aa750 2021-10-21T00:06:15.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 -- 172.21.15.41:0/3758728057 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0b1380 con 0x7f094c14b350 2021-10-21T00:06:15.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.446+0000 7f094b7fe700 1 --2- 172.21.15.41:0/3758728057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c14b350 0x7f094c0af7c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f093c002f70 tx=0x7f093c006df0).ready entity=mon.1 client_cookie=bdbadd37f73a69fe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0949ffb700 1 -- 172.21.15.41:0/3758728057 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093c00d570 con 0x7f094c14b350 2021-10-21T00:06:15.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0949ffb700 1 -- 172.21.15.41:0/3758728057 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c000e90 con 0x7f094c14b350 2021-10-21T00:06:15.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0949ffb700 1 -- 172.21.15.41:0/3758728057 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f093c00d8c0 con 0x7f094c14b350 2021-10-21T00:06:15.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 -- 172.21.15.41:0/3758728057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c14b350 msgr2=0x7f094c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 --2- 172.21.15.41:0/3758728057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c14b350 0x7f094c0af7c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f093c002f70 tx=0x7f093c006df0).stop 2021-10-21T00:06:15.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 -- 172.21.15.41:0/3758728057 shutdown_connections 2021-10-21T00:06:15.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 --2- 172.21.15.41:0/3758728057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c14b350 0x7f094c0af7c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 --2- 172.21.15.41:0/3758728057 >> v2:172.21.15.41:3300/0 conn(0x7f094c05f9f0 0x7f094c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 -- 172.21.15.41:0/3758728057 >> 172.21.15.41:0/3758728057 conn(0x7f094c05bca0 msgr2=0x7f094c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:15.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 -- 172.21.15.41:0/3758728057 shutdown_connections 2021-10-21T00:06:15.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.450+0000 7f0951695700 1 -- 172.21.15.41:0/3758728057 wait complete. 2021-10-21T00:06:15.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 Processor -- start 2021-10-21T00:06:15.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- start start 2021-10-21T00:06:15.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c05f9f0 0x7f094c0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 0x7f094c067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0674f0 con 0x7f094c0aa750 2021-10-21T00:06:15.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c156530 con 0x7f094c05f9f0 2021-10-21T00:06:15.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1567d0 con 0x7f094c14b350 2021-10-21T00:06:15.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c05f9f0 0x7f094c0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60152/0 (socket says 172.21.15.41:60152) 2021-10-21T00:06:15.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 -- 172.21.15.41:0/2713901706 learned_addr learned my addr 172.21.15.41:0/2713901706 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:15.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094b7fe700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 0x7f094c067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 -- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 msgr2=0x7f094c067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 0x7f094c067000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 -- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c05f9f0 msgr2=0x7f094c0ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:15.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c05f9f0 0x7f094c0ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:15.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 -- 172.21.15.41:0/2713901706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c00b180 con 0x7f094c0aa750 2021-10-21T00:06:15.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094b7fe700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 0x7f094c067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:15.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f094a7fc700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0944001250 tx=0x7f0944007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0944010510 con 0x7f094c0aa750 2021-10-21T00:06:15.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944010670 con 0x7f094c0aa750 2021-10-21T00:06:15.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0944010820 con 0x7f094c0aa750 2021-10-21T00:06:15.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c156a70 con 0x7f094c0aa750 2021-10-21T00:06:15.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.454+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c155fd0 con 0x7f094c0aa750 2021-10-21T00:06:15.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0944010070 con 0x7f094c0aa750 2021-10-21T00:06:15.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c156c00 con 0x7f094c0aa750 2021-10-21T00:06:15.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f093bfff700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 0x7f0928055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:15.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f094406b830 con 0x7f094c0aa750 2021-10-21T00:06:15.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f094affd700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 0x7f0928055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:15.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.458+0000 7f094affd700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 0x7f0928055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0940008000 tx=0x7f0940008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:15.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.462+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0944042880 con 0x7f094c0aa750 2021-10-21T00:06:15.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:15.626+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f094c067630 con 0x7f094c0aa750 2021-10-21T00:06:16.438 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:06:16.433+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:06:16.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.449+0000 7f093bfff700 1 -- 172.21.15.41:0/2713901706 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0944045ea0 con 0x7f094c0aa750 2021-10-21T00:06:16.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.449+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 msgr2=0x7f0928055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.449+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 0x7f0928055ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0940008000 tx=0x7f0940008040).stop 2021-10-21T00:06:16.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.449+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 msgr2=0x7f094c066b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.449+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0944001250 tx=0x7f0944007e40).stop 2021-10-21T00:06:16.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 shutdown_connections 2021-10-21T00:06:16.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0928053610 0x7f0928055ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f094c14b350 0x7f094c067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f094c0aa750 0x7f094c066b10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 --2- 172.21.15.41:0/2713901706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c05f9f0 0x7f094c0ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 >> 172.21.15.41:0/2713901706 conn(0x7f094c05bca0 msgr2=0x7f094c146d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:16.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 shutdown_connections 2021-10-21T00:06:16.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.453+0000 7f0951695700 1 -- 172.21.15.41:0/2713901706 wait complete. 2021-10-21T00:06:16.460 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:06:16.471 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:16.490 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:06:16.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.573+0000 7f2f254c9700 1 Processor -- start 2021-10-21T00:06:16.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.573+0000 7f2f254c9700 1 -- start start 2021-10-21T00:06:16.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f2005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f2005fba0 0x7f2f20146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f201407e0 con 0x7f2f200adf70 2021-10-21T00:06:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200ad450 con 0x7f2f2005fba0 2021-10-21T00:06:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200aca70 con 0x7f2f20140400 2021-10-21T00:06:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2f200adf70 0x7f2f20146800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57932/0 (socket says 172.21.15.41:57932) 2021-10-21T00:06:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/2532926292 learned_addr learned my addr 172.21.15.41:0/2532926292 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1e7fc700 1 --2- 172.21.15.41:0/2532926292 >> v2:172.21.15.62:3300/0 conn(0x7f2f2005fba0 0x7f2f20146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1effd700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f2005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648036836 0 0) 0x7f2f201407e0 con 0x7f2f200adf70 2021-10-21T00:06:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f00003260 con 0x7f2f200adf70 2021-10-21T00:06:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 303186395 0 0) 0x7f2f00003260 con 0x7f2f200adf70 2021-10-21T00:06:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 msgr2=0x7f2f2005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f2005f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 >> v2:172.21.15.62:3300/0 conn(0x7f2f2005fba0 msgr2=0x7f2f20146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 --2- 172.21.15.41:0/2532926292 >> v2:172.21.15.62:3300/0 conn(0x7f2f2005fba0 0x7f2f20146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200acd10 con 0x7f2f200adf70 2021-10-21T00:06:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f2f180019e0 con 0x7f2f200adf70 2021-10-21T00:06:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1effd700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f2005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1e7fc700 1 --2- 172.21.15.41:0/2532926292 >> v2:172.21.15.62:3300/0 conn(0x7f2f2005fba0 0x7f2f20146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 >> v1:172.21.15.41:6789/0 conn(0x7f2f200adf70 legacy=0x7f2f20146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f00003750 0x7f2f00003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f00004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f000049f0 0x7f2f00004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200ad450 con 0x7f2f000049f0 2021-10-21T00:06:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200aca70 con 0x7f2f00003750 2021-10-21T00:06:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0000b750 con 0x7f2f20140400 2021-10-21T00:06:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f000049f0 0x7f2f00004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1e7fc700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f00004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1effd700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f00003750 0x7f2f00003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 msgr2=0x7f2f00004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f20140400 0x7f2f00004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f00003750 msgr2=0x7f2f00003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f00003750 0x7f2f00003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/2532926292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0800b180 con 0x7f2f000049f0 2021-10-21T00:06:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f000049f0 0x7f2f00004e70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f2f180016f0 tx=0x7f2f20063170).ready entity=mon.0 client_cookie=20f16ce1908182c6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1800cc20 con 0x7f2f000049f0 2021-10-21T00:06:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800cd80 con 0x7f2f000049f0 2021-10-21T00:06:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1dffb700 1 -- 172.21.15.41:0/2532926292 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f18005b80 con 0x7f2f000049f0 2021-10-21T00:06:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- 172.21.15.41:0/2532926292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f000049f0 msgr2=0x7f2f00004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 --2- 172.21.15.41:0/2532926292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f000049f0 0x7f2f00004e70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f2f180016f0 tx=0x7f2f20063170).stop 2021-10-21T00:06:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/2532926292 reap_dead start 2021-10-21T00:06:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- 172.21.15.41:0/2532926292 shutdown_connections 2021-10-21T00:06:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.577+0000 7f2f254c9700 1 -- 172.21.15.41:0/2532926292 >> 172.21.15.41:0/2532926292 conn(0x7f2f200b7030 msgr2=0x7f2f200b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- 172.21.15.41:0/2532926292 shutdown_connections 2021-10-21T00:06:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- 172.21.15.41:0/2532926292 wait complete. 2021-10-21T00:06:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 Processor -- start 2021-10-21T00:06:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- start start 2021-10-21T00:06:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f000049f0 0x7f2f20147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f20141f00 0x7f2f2013f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2009b8a0 con 0x7f2f20142650 2021-10-21T00:06:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201564c0 con 0x7f2f20141f00 2021-10-21T00:06:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20156220 con 0x7f2f000049f0 2021-10-21T00:06:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60174/0 (socket says 172.21.15.41:60174) 2021-10-21T00:06:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/970061681 learned_addr learned my addr 172.21.15.41:0/970061681 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1e7fc700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f20141f00 0x7f2f2013f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1effd700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f000049f0 0x7f2f20147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f000049f0 msgr2=0x7f2f20147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f000049f0 0x7f2f20147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f20141f00 msgr2=0x7f2f2013f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f20141f00 0x7f2f2013f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 -- 172.21.15.41:0/970061681 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2009c9c0 con 0x7f2f20142650 2021-10-21T00:06:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f1f7fe700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f2f20060c10 tx=0x7f2f18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f18001f90 con 0x7f2f20142650 2021-10-21T00:06:16.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180072c0 con 0x7f2f20142650 2021-10-21T00:06:16.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20155f40 con 0x7f2f20142650 2021-10-21T00:06:16.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.581+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f18007620 con 0x7f2f20142650 2021-10-21T00:06:16.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2013fbc0 con 0x7f2f20142650 2021-10-21T00:06:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2009cb50 con 0x7f2f20142650 2021-10-21T00:06:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f18010070 con 0x7f2f20142650 2021-10-21T00:06:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f17fff700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 0x7f2f04055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2f18019030 con 0x7f2f20142650 2021-10-21T00:06:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f1effd700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 0x7f2f04055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.585+0000 7f2f1effd700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 0x7f2f04055ad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f0800b000 tx=0x7f2f08006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.593+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f180439c0 con 0x7f2f20142650 2021-10-21T00:06:16.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.757+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f200acfb0 con 0x7f2f20142650 2021-10-21T00:06:16.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.757+0000 7f2f17fff700 1 -- 172.21.15.41:0/970061681 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f2f18046fe0 con 0x7f2f20142650 2021-10-21T00:06:16.764 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:16.764 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:04:53.503441+0000","modified":"2021-10-21T00:06:16.436334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-10-21T00:06:16.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 msgr2=0x7f2f04055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 0x7f2f04055ad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f0800b000 tx=0x7f2f08006df0).stop 2021-10-21T00:06:16.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 msgr2=0x7f2f2013f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f2f20060c10 tx=0x7f2f18015000).stop 2021-10-21T00:06:16.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 shutdown_connections 2021-10-21T00:06:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f04053610 0x7f2f04055ad0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f20142650 0x7f2f2013f6d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f20141f00 0x7f2f2013f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 --2- 172.21.15.41:0/970061681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f000049f0 0x7f2f20147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 >> 172.21.15.41:0/970061681 conn(0x7f2f200b7030 msgr2=0x7f2f200b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 shutdown_connections 2021-10-21T00:06:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.761+0000 7f2f254c9700 1 -- 172.21.15.41:0/970061681 wait complete. 2021-10-21T00:06:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 17 2021-10-21T00:06:16.776 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:06:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 Processor -- start 2021-10-21T00:06:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 -- start start 2021-10-21T00:06:16.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3940b3a20 0x7fe39413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39405bd40 con 0x7fe394062330 2021-10-21T00:06:16.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39405bf70 con 0x7fe394062f70 2021-10-21T00:06:16.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe39a779700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe394142cb0 con 0x7fe3940b3a20 2021-10-21T00:06:16.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe399777700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe394062330 0x7fe3940b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:57948/0 (socket says 172.21.15.41:57948) 2021-10-21T00:06:16.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe399777700 1 -- 172.21.15.41:0/911835628 learned_addr learned my addr 172.21.15.41:0/911835628 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:16.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.877+0000 7fe399f78700 1 --2- 172.21.15.41:0/911835628 >> v2:172.21.15.62:3300/0 conn(0x7fe3940b3a20 0x7fe39413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe387fff700 1 -- 172.21.15.41:0/911835628 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609291338 0 0) 0x7fe39405bd40 con 0x7fe394062330 2021-10-21T00:06:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe387fff700 1 -- 172.21.15.41:0/911835628 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe378003260 con 0x7fe394062330 2021-10-21T00:06:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe399f78700 1 -- 172.21.15.41:0/911835628 >> v1:172.21.15.62:6789/0 conn(0x7fe394062f70 legacy=0x7fe39405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe399f78700 1 -- 172.21.15.41:0/911835628 >> v1:172.21.15.41:6789/0 conn(0x7fe394062330 legacy=0x7fe3940b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe399f78700 1 -- 172.21.15.41:0/911835628 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394142950 con 0x7fe3940b3a20 2021-10-21T00:06:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe399f78700 1 --2- 172.21.15.41:0/911835628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3940b3a20 0x7fe39413c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe38c0032f0 tx=0x7fe38c0091d0).ready entity=mon.1 client_cookie=1d840e6b1b8f9ac server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe387fff700 1 -- 172.21.15.41:0/911835628 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c00b6c0 con 0x7fe3940b3a20 2021-10-21T00:06:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe387fff700 1 -- 172.21.15.41:0/911835628 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00b820 con 0x7fe3940b3a20 2021-10-21T00:06:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe387fff700 1 -- 172.21.15.41:0/911835628 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c00b990 con 0x7fe3940b3a20 2021-10-21T00:06:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- 172.21.15.41:0/911835628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3940b3a20 msgr2=0x7fe39413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 --2- 172.21.15.41:0/911835628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3940b3a20 0x7fe39413c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe38c0032f0 tx=0x7fe38c0091d0).stop 2021-10-21T00:06:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- 172.21.15.41:0/911835628 shutdown_connections 2021-10-21T00:06:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 --2- 172.21.15.41:0/911835628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3940b3a20 0x7fe39413c510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- 172.21.15.41:0/911835628 >> 172.21.15.41:0/911835628 conn(0x7fe3940b9080 msgr2=0x7fe3940b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- 172.21.15.41:0/911835628 shutdown_connections 2021-10-21T00:06:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- 172.21.15.41:0/911835628 wait complete. 2021-10-21T00:06:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 Processor -- start 2021-10-21T00:06:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.881+0000 7fe39a779700 1 -- start start 2021-10-21T00:06:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe394062330 0x7fe394145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe394062f70 0x7fe394145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394114650 con 0x7fe3940b3a20 2021-10-21T00:06:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3941126e0 con 0x7fe394062f70 2021-10-21T00:06:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe394114880 con 0x7fe394062330 2021-10-21T00:06:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60188/0 (socket says 172.21.15.41:60188) 2021-10-21T00:06:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 -- 172.21.15.41:0/4188062404 learned_addr learned my addr 172.21.15.41:0/4188062404 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe398f76700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe394062f70 0x7fe394145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399777700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe394062330 0x7fe394145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 -- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe394062330 msgr2=0x7fe394145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe394062330 0x7fe394145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 -- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe394062f70 msgr2=0x7fe394145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe394062f70 0x7fe394145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 -- 172.21.15.41:0/4188062404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009470 con 0x7fe3940b3a20 2021-10-21T00:06:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe399f78700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe38c0032f0 tx=0x7fe38c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c00b6c0 con 0x7fe3940b3a20 2021-10-21T00:06:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c021630 con 0x7fe3940b3a20 2021-10-21T00:06:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38c021990 con 0x7fe3940b3a20 2021-10-21T00:06:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe394146630 con 0x7fe3940b3a20 2021-10-21T00:06:16.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.885+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe394144e80 con 0x7fe3940b3a20 2021-10-21T00:06:16.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394057350 con 0x7fe3940b3a20 2021-10-21T00:06:16.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe38c027020 con 0x7fe3940b3a20 2021-10-21T00:06:16.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe3867fc700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 0x7fe37c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe38c06ce20 con 0x7fe3940b3a20 2021-10-21T00:06:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe399777700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 0x7fe37c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.889+0000 7fe399777700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 0x7fe37c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe39000d000 tx=0x7fe390009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:16.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:16.893+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe38c043e60 con 0x7fe3940b3a20 2021-10-21T00:06:17.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.061+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe39405d080 con 0x7fe3940b3a20 2021-10-21T00:06:17.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe3867fc700 1 -- 172.21.15.41:0/4188062404 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe38c0150a0 con 0x7fe3940b3a20 2021-10-21T00:06:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 msgr2=0x7fe37c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:17.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 0x7fe37c055a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe39000d000 tx=0x7fe390009040).stop 2021-10-21T00:06:17.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 msgr2=0x7fe394113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:17.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe38c0032f0 tx=0x7fe38c016000).stop 2021-10-21T00:06:17.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 shutdown_connections 2021-10-21T00:06:17.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe37c053580 0x7fe37c055a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3940b3a20 0x7fe394113c00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe394062f70 0x7fe394145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 --2- 172.21.15.41:0/4188062404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe394062330 0x7fe394145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 >> 172.21.15.41:0/4188062404 conn(0x7fe3940b9080 msgr2=0x7fe39413ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:17.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 shutdown_connections 2021-10-21T00:06:17.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.453+0000 7fe39a779700 1 -- 172.21.15.41:0/4188062404 wait complete. 2021-10-21T00:06:17.477 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:06:17.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.593+0000 7f83f97b7700 1 Processor -- start 2021-10-21T00:06:17.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.593+0000 7f83f97b7700 1 -- start start 2021-10-21T00:06:17.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 0x7f83f40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f83f4142f00 0x7f83f4143340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40b3520 con 0x7f83f4142f00 2021-10-21T00:06:17.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4143c40 con 0x7f83f4062330 2021-10-21T00:06:17.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4142ad0 con 0x7f83f413c510 2021-10-21T00:06:17.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f83f4142f00 0x7f83f4143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f83f4142f00 0x7f83f4143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60196/0 (socket says 172.21.15.41:60196) 2021-10-21T00:06:17.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 -- 172.21.15.41:0/3758013287 learned_addr learned my addr 172.21.15.41:0/3758013287 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:17.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f37fe700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f3fff700 1 --2- 172.21.15.41:0/3758013287 >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 0x7f83f40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 -- 172.21.15.41:0/3758013287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 msgr2=0x7f83f413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:17.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 -- 172.21.15.41:0/3758013287 >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 msgr2=0x7f83f40b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:17.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 --2- 172.21.15.41:0/3758013287 >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 0x7f83f40b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 -- 172.21.15.41:0/3758013287 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f413ce60 con 0x7f83f4142f00 2021-10-21T00:06:17.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f37fe700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:17.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f3fff700 1 --2- 172.21.15.41:0/3758013287 >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 0x7f83f40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:17.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f8fb6700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4142f00 0x7f83f4143340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f83f405ce70 tx=0x7f83ec009290).ready entity=mon.0 client_cookie=5bdfb70b0956ef04 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:17.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f2ffd700 1 -- 172.21.15.41:0/3758013287 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ec00b830 con 0x7f83f4142f00 2021-10-21T00:06:17.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f2ffd700 1 -- 172.21.15.41:0/3758013287 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00b990 con 0x7f83f4142f00 2021-10-21T00:06:17.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f2ffd700 1 -- 172.21.15.41:0/3758013287 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ec00bb00 con 0x7f83f4142f00 2021-10-21T00:06:17.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- 172.21.15.41:0/3758013287 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4142f00 msgr2=0x7f83f4143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:17.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4142f00 0x7f83f4143340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f83f405ce70 tx=0x7f83ec009290).stop 2021-10-21T00:06:17.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- 172.21.15.41:0/3758013287 shutdown_connections 2021-10-21T00:06:17.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4142f00 0x7f83f4143340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- 172.21.15.41:0/3758013287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 --2- 172.21.15.41:0/3758013287 >> v2:172.21.15.62:3300/0 conn(0x7f83f4062330 0x7f83f40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- 172.21.15.41:0/3758013287 >> 172.21.15.41:0/3758013287 conn(0x7f83f40b9080 msgr2=0x7f83f40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:17.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- 172.21.15.41:0/3758013287 shutdown_connections 2021-10-21T00:06:17.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.597+0000 7f83f97b7700 1 -- 172.21.15.41:0/3758013287 wait complete. 2021-10-21T00:06:17.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 Processor -- start 2021-10-21T00:06:17.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- start start 2021-10-21T00:06:17.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 0x7f83f413bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f413e6e0 con 0x7f83f4062330 2021-10-21T00:06:17.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40b8360 con 0x7f83f4142f00 2021-10-21T00:06:17.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4155650 con 0x7f83f413c510 2021-10-21T00:06:17.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60198/0 (socket says 172.21.15.41:60198) 2021-10-21T00:06:17.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 -- 172.21.15.41:0/579895556 learned_addr learned my addr 172.21.15.41:0/579895556 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:17.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f37fe700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f8fb6700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 0x7f83f413bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 -- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 msgr2=0x7f83f413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:17.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 -- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 msgr2=0x7f83f413bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:17.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 0x7f83f413bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:17.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 -- 172.21.15.41:0/579895556 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009530 con 0x7f83f4062330 2021-10-21T00:06:17.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f8fb6700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 0x7f83f413bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:06:17.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f3fff700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f83e8006940 tx=0x7f83e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:17.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e8011780 con 0x7f83f4062330 2021-10-21T00:06:17.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e80118e0 con 0x7f83f4062330 2021-10-21T00:06:17.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f41558f0 con 0x7f83f4062330 2021-10-21T00:06:17.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e8011c40 con 0x7f83f4062330 2021-10-21T00:06:17.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.601+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f413cff0 con 0x7f83f4062330 2021-10-21T00:06:17.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f4057350 con 0x7f83f4062330 2021-10-21T00:06:17.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83e8012420 con 0x7f83f4062330 2021-10-21T00:06:17.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f17fa700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 0x7f83d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:17.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f83e806b900 con 0x7f83f4062330 2021-10-21T00:06:17.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f37fe700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 0x7f83d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:17.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.605+0000 7f83f37fe700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 0x7f83d4055b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f83e400c000 tx=0x7f83e4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:17.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.609+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83e80429b0 con 0x7f83f4062330 2021-10-21T00:06:17.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:17.733+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83f4145f70 con 0x7f83f4062330 2021-10-21T00:06:18.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.461+0000 7f83f17fa700 1 -- 172.21.15.41:0/579895556 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 185+0+0 (secure 0 0 0) 0x7f83e8045fd0 con 0x7f83f4062330 2021-10-21T00:06:18.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.465+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 msgr2=0x7f83d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.465+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 0x7f83d4055b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f83e400c000 tx=0x7f83e4008040).stop 2021-10-21T00:06:18.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.465+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 msgr2=0x7f83f40b7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.465+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f83e8006940 tx=0x7f83e8008040).stop 2021-10-21T00:06:18.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 shutdown_connections 2021-10-21T00:06:18.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83d40536a0 0x7f83d4055b60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83f4142f00 0x7f83f413bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83f413c510 0x7f83f413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 --2- 172.21.15.41:0/579895556 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f83f4062330 0x7f83f40b7b10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.469+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 >> 172.21.15.41:0/579895556 conn(0x7f83f40b9080 msgr2=0x7f83f40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:18.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.473+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 shutdown_connections 2021-10-21T00:06:18.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.473+0000 7f83f97b7700 1 -- 172.21.15.41:0/579895556 wait complete. 2021-10-21T00:06:18.478 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:06:18.493 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:06:18.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.601+0000 7f7a361a2700 1 Processor -- start 2021-10-21T00:06:18.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.601+0000 7f7a361a2700 1 -- start start 2021-10-21T00:06:18.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a300af8b0 0x7f7a30144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300afc90 con 0x7f7a30141060 2021-10-21T00:06:18.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a30144210 con 0x7f7a300af8b0 2021-10-21T00:06:18.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301444b0 con 0x7f7a300642c0 2021-10-21T00:06:18.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a300af8b0 0x7f7a30144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7a30141060 0x7f7a3013a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:37802/0 (socket says 172.21.15.41:37802) 2021-10-21T00:06:18.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2ffff700 1 -- 172.21.15.41:0/3025866080 learned_addr learned my addr 172.21.15.41:0/3025866080 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:18.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50476/0 (socket says 172.21.15.41:50476) 2021-10-21T00:06:18.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2e7fc700 1 -- 172.21.15.41:0/3025866080 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942383230 0 0) 0x7f7a300afc90 con 0x7f7a30141060 2021-10-21T00:06:18.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 -- 172.21.15.41:0/3025866080 >> v2:172.21.15.62:3300/0 conn(0x7f7a300af8b0 msgr2=0x7f7a30144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:18.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 --2- 172.21.15.41:0/3025866080 >> v2:172.21.15.62:3300/0 conn(0x7f7a300af8b0 0x7f7a30144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 -- 172.21.15.41:0/3025866080 >> v1:172.21.15.62:6789/0 conn(0x7f7a30141060 legacy=0x7f7a3013a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 -- 172.21.15.41:0/3025866080 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30144750 con 0x7f7a300642c0 2021-10-21T00:06:18.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2effd700 1 --2- 172.21.15.41:0/3025866080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7a20002f70 tx=0x7f7a20006d90).ready entity=mon.2 client_cookie=3ddcdf2568097418 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:18.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2e7fc700 1 -- 172.21.15.41:0/3025866080 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2000d4a0 con 0x7f7a300642c0 2021-10-21T00:06:18.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2e7fc700 1 -- 172.21.15.41:0/3025866080 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20000e90 con 0x7f7a300642c0 2021-10-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a2e7fc700 1 -- 172.21.15.41:0/3025866080 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2000d7f0 con 0x7f7a300642c0 2021-10-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- 172.21.15.41:0/3025866080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 msgr2=0x7f7a30140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 --2- 172.21.15.41:0/3025866080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7a20002f70 tx=0x7f7a20006d90).stop 2021-10-21T00:06:18.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- 172.21.15.41:0/3025866080 shutdown_connections 2021-10-21T00:06:18.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 --2- 172.21.15.41:0/3025866080 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300642c0 0x7f7a30140b70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 --2- 172.21.15.41:0/3025866080 >> v2:172.21.15.62:3300/0 conn(0x7f7a300af8b0 0x7f7a30144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- 172.21.15.41:0/3025866080 >> 172.21.15.41:0/3025866080 conn(0x7f7a30061d80 msgr2=0x7f7a30063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:18.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- 172.21.15.41:0/3025866080 shutdown_connections 2021-10-21T00:06:18.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.605+0000 7f7a361a2700 1 -- 172.21.15.41:0/3025866080 wait complete. 2021-10-21T00:06:18.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 Processor -- start 2021-10-21T00:06:18.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 -- start start 2021-10-21T00:06:18.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a300642c0 0x7f7a301563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300af8b0 0x7f7a30066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300aeda0 con 0x7f7a30141060 2021-10-21T00:06:18.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30113630 con 0x7f7a300642c0 2021-10-21T00:06:18.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300ae7b0 con 0x7f7a300af8b0 2021-10-21T00:06:18.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60216/0 (socket says 172.21.15.41:60216) 2021-10-21T00:06:18.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 -- 172.21.15.41:0/1543928383 learned_addr learned my addr 172.21.15.41:0/1543928383 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:18.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2effd700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300af8b0 0x7f7a30066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2f7fe700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a300642c0 0x7f7a301563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 -- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300af8b0 msgr2=0x7f7a30066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300af8b0 0x7f7a30066e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 -- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a300642c0 msgr2=0x7f7a301563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:18.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a300642c0 0x7f7a301563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:18.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 -- 172.21.15.41:0/1543928383 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2000b120 con 0x7f7a30141060 2021-10-21T00:06:18.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2ffff700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f7a28001250 tx=0x7f7a28001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a28005c70 con 0x7f7a30141060 2021-10-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28005dd0 con 0x7f7a30141060 2021-10-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.609+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a301568b0 con 0x7f7a30141060 2021-10-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a28004a90 con 0x7f7a30141060 2021-10-21T00:06:18.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a300ad520 con 0x7f7a30141060 2021-10-21T00:06:18.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a300ae210 con 0x7f7a30141060 2021-10-21T00:06:18.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a28004bf0 con 0x7f7a30141060 2021-10-21T00:06:18.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a2cff9700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 0x7f7a10055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:18.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f7a2806b480 con 0x7f7a30141060 2021-10-21T00:06:18.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.613+0000 7f7a2f7fe700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 0x7f7a10055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:18.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.617+0000 7f7a2f7fe700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 0x7f7a10055b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7a2400b000 tx=0x7f7a24006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:18.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.621+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a28042740 con 0x7f7a30141060 2021-10-21T00:06:18.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:18.749+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a301137a0 con 0x7f7a30141060 2021-10-21T00:06:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.477+0000 7f7a2cff9700 1 -- 172.21.15.41:0/1543928383 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7a28045d60 con 0x7f7a30141060 2021-10-21T00:06:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 msgr2=0x7f7a10055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 0x7f7a10055b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7a2400b000 tx=0x7f7a24006df0).stop 2021-10-21T00:06:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 msgr2=0x7f7a3013dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f7a28001250 tx=0x7f7a28001360).stop 2021-10-21T00:06:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 shutdown_connections 2021-10-21T00:06:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7a100536d0 0x7f7a10055b90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7a30141060 0x7f7a3013dd20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a300af8b0 0x7f7a30066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 --2- 172.21.15.41:0/1543928383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a300642c0 0x7f7a301563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 >> 172.21.15.41:0/1543928383 conn(0x7f7a30061d80 msgr2=0x7f7a300b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 shutdown_connections 2021-10-21T00:06:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.481+0000 7f7a361a2700 1 -- 172.21.15.41:0/1543928383 wait complete. 2021-10-21T00:06:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:06:19.502 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:06:19.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 Processor -- start 2021-10-21T00:06:19.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 -- start start 2021-10-21T00:06:19.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1640b9b10 0x7fc164146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc1640b0ac0 0x7fc1640b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640b4120 con 0x7fc1640b5310 2021-10-21T00:06:19.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1640b5740 con 0x7fc1640b0ac0 2021-10-21T00:06:19.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc168a83700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1640b46e0 con 0x7fc1640b9b10 2021-10-21T00:06:19.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc161d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc1640b0ac0 0x7fc1640b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc161d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc1640b0ac0 0x7fc1640b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60220/0 (socket says 172.21.15.41:60220) 2021-10-21T00:06:19.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.605+0000 7fc161d9b700 1 -- 172.21.15.41:0/1044419801 learned_addr learned my addr 172.21.15.41:0/1044419801 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:19.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc16259c700 1 --2- 172.21.15.41:0/1044419801 >> v2:172.21.15.62:3300/0 conn(0x7fc1640b9b10 0x7fc164146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc161d9b700 1 -- 172.21.15.41:0/1044419801 >> v2:172.21.15.62:3300/0 conn(0x7fc1640b9b10 msgr2=0x7fc164146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:19.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc161d9b700 1 --2- 172.21.15.41:0/1044419801 >> v2:172.21.15.62:3300/0 conn(0x7fc1640b9b10 0x7fc164146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc161d9b700 1 -- 172.21.15.41:0/1044419801 >> v1:172.21.15.62:6789/0 conn(0x7fc1640b5310 legacy=0x7fc16405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc161d9b700 1 -- 172.21.15.41:0/1044419801 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640b4980 con 0x7fc1640b0ac0 2021-10-21T00:06:19.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc161d9b700 1 --2- 172.21.15.41:0/1044419801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b0ac0 0x7fc1640b4e20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fc1640b5c80 tx=0x7fc154006e50).ready entity=mon.0 client_cookie=b13cdb6f5fe43fb9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc16159a700 1 -- 172.21.15.41:0/1044419801 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc15400d5c0 con 0x7fc1640b0ac0 2021-10-21T00:06:19.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc16159a700 1 -- 172.21.15.41:0/1044419801 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154000e90 con 0x7fc1640b0ac0 2021-10-21T00:06:19.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc16159a700 1 -- 172.21.15.41:0/1044419801 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc15400d950 con 0x7fc1640b0ac0 2021-10-21T00:06:19.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 -- 172.21.15.41:0/1044419801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b0ac0 msgr2=0x7fc1640b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 --2- 172.21.15.41:0/1044419801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b0ac0 0x7fc1640b4e20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fc1640b5c80 tx=0x7fc154006e50).stop 2021-10-21T00:06:19.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 -- 172.21.15.41:0/1044419801 shutdown_connections 2021-10-21T00:06:19.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 --2- 172.21.15.41:0/1044419801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b0ac0 0x7fc1640b4e20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 --2- 172.21.15.41:0/1044419801 >> v2:172.21.15.62:3300/0 conn(0x7fc1640b9b10 0x7fc164146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 -- 172.21.15.41:0/1044419801 >> 172.21.15.41:0/1044419801 conn(0x7fc164062ec0 msgr2=0x7fc1640b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:19.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 -- 172.21.15.41:0/1044419801 shutdown_connections 2021-10-21T00:06:19.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.609+0000 7fc168a83700 1 -- 172.21.15.41:0/1044419801 wait complete. 2021-10-21T00:06:19.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 Processor -- start 2021-10-21T00:06:19.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 -- start start 2021-10-21T00:06:19.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 0x7fc164152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1640b9b10 0x7fc164112450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640af880 con 0x7fc1640b5310 2021-10-21T00:06:19.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641525b0 con 0x7fc1640b0ac0 2021-10-21T00:06:19.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc168a83700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc164152850 con 0x7fc1640b9b10 2021-10-21T00:06:19.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc16259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 0x7fc164152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc16259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 0x7fc164152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:43912/0 (socket says 172.21.15.41:43912) 2021-10-21T00:06:19.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60228/0 (socket says 172.21.15.41:60228) 2021-10-21T00:06:19.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc16259c700 1 -- 172.21.15.41:0/1996770980 learned_addr learned my addr 172.21.15.41:0/1996770980 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:19.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc162d9d700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1640b9b10 0x7fc164112450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 -- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1640b9b10 msgr2=0x7fc164112450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1640b9b10 0x7fc164112450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 -- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 msgr2=0x7fc164152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 0x7fc164152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 -- 172.21.15.41:0/1996770980 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15400b1e0 con 0x7fc1640b5310 2021-10-21T00:06:19.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.613+0000 7fc161d9b700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fc1640b5c80 tx=0x7fc154013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc154006310 con 0x7fc1640b5310 2021-10-21T00:06:19.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154006470 con 0x7fc1640b5310 2021-10-21T00:06:19.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1641531e0 con 0x7fc1640b5310 2021-10-21T00:06:19.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1540058e0 con 0x7fc1640b5310 2021-10-21T00:06:19.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1640b8bb0 con 0x7fc1640b5310 2021-10-21T00:06:19.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc164152400 con 0x7fc1640b5310 2021-10-21T00:06:19.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc15401a040 con 0x7fc1640b5310 2021-10-21T00:06:19.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 0x7fc148055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc15406c2a0 con 0x7fc1640b5310 2021-10-21T00:06:19.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.617+0000 7fc16259c700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 0x7fc148055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.621+0000 7fc16259c700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 0x7fc148055b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fc14c008000 tx=0x7fc14c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.625+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1540436e0 con 0x7fc1640b5310 2021-10-21T00:06:19.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.753+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc164152a10 con 0x7fc1640b5310 2021-10-21T00:06:19.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.757+0000 7fc15b7fe700 1 -- 172.21.15.41:0/1996770980 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc154046d00 con 0x7fc1640b5310 2021-10-21T00:06:19.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 msgr2=0x7fc148055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 0x7fc148055b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fc14c008000 tx=0x7fc14c008040).stop 2021-10-21T00:06:19.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 msgr2=0x7fc1640b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fc1640b5c80 tx=0x7fc154013000).stop 2021-10-21T00:06:19.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 shutdown_connections 2021-10-21T00:06:19.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1480536a0 0x7fc148055b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1640b9b10 0x7fc164112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1640b5310 0x7fc1640b86c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 --2- 172.21.15.41:0/1996770980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1640b0ac0 0x7fc164152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 >> 172.21.15.41:0/1996770980 conn(0x7fc164062ec0 msgr2=0x7fc1640b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:19.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 shutdown_connections 2021-10-21T00:06:19.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.761+0000 7fc168a83700 1 -- 172.21.15.41:0/1996770980 wait complete. 2021-10-21T00:06:19.782 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-10-21T00:06:19.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.873+0000 7f76bbde9700 1 Processor -- start 2021-10-21T00:06:19.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.873+0000 7f76bbde9700 1 -- start start 2021-10-21T00:06:19.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409cc90 0x7f76b413fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76b409b220 0x7f76b4140380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f76b4140870 0x7f76b4144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b405f6b0 con 0x7f76b4140870 2021-10-21T00:06:19.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b409d070 con 0x7f76b409b220 2021-10-21T00:06:19.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4099b70 con 0x7f76b409cc90 2021-10-21T00:06:19.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f76b4140870 0x7f76b4144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f76b4140870 0x7f76b4144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60238/0 (socket says 172.21.15.41:60238) 2021-10-21T00:06:19.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 -- 172.21.15.41:0/3932137060 learned_addr learned my addr 172.21.15.41:0/3932137060 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:19.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76b9384700 1 --2- 172.21.15.41:0/3932137060 >> v2:172.21.15.62:3300/0 conn(0x7f76b409b220 0x7f76b4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76b9b85700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409cc90 0x7f76b413fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 -- 172.21.15.41:0/3932137060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409cc90 msgr2=0x7f76b413fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:19.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409cc90 0x7f76b413fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 -- 172.21.15.41:0/3932137060 >> v2:172.21.15.62:3300/0 conn(0x7f76b409b220 msgr2=0x7f76b4140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:19.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 --2- 172.21.15.41:0/3932137060 >> v2:172.21.15.62:3300/0 conn(0x7f76b409b220 0x7f76b4140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 -- 172.21.15.41:0/3932137060 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b405f910 con 0x7f76b4140870 2021-10-21T00:06:19.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76ba386700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b4144180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f76b409a510 tx=0x7f76ac009290).ready entity=mon.0 client_cookie=b82a939e85db916a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76b8b83700 1 -- 172.21.15.41:0/3932137060 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac00b860 con 0x7f76b4140870 2021-10-21T00:06:19.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76b8b83700 1 -- 172.21.15.41:0/3932137060 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00b9c0 con 0x7f76b4140870 2021-10-21T00:06:19.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76b8b83700 1 -- 172.21.15.41:0/3932137060 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac00bb30 con 0x7f76b4140870 2021-10-21T00:06:19.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- 172.21.15.41:0/3932137060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 msgr2=0x7f76b4144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b4144180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f76b409a510 tx=0x7f76ac009290).stop 2021-10-21T00:06:19.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- 172.21.15.41:0/3932137060 shutdown_connections 2021-10-21T00:06:19.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b4144180 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- 172.21.15.41:0/3932137060 >> v2:172.21.15.62:3300/0 conn(0x7f76b409b220 0x7f76b4140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 --2- 172.21.15.41:0/3932137060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409cc90 0x7f76b413fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- 172.21.15.41:0/3932137060 >> 172.21.15.41:0/3932137060 conn(0x7f76b40b7030 msgr2=0x7f76b40b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:19.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- 172.21.15.41:0/3932137060 shutdown_connections 2021-10-21T00:06:19.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- 172.21.15.41:0/3932137060 wait complete. 2021-10-21T00:06:19.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 Processor -- start 2021-10-21T00:06:19.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.877+0000 7f76bbde9700 1 -- start start 2021-10-21T00:06:19.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409b220 0x7f76b40accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76b409cc90 0x7f76b4067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4065810 con 0x7f76b4140870 2021-10-21T00:06:19.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4065a40 con 0x7f76b409cc90 2021-10-21T00:06:19.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4066990 con 0x7f76b409b220 2021-10-21T00:06:19.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60242/0 (socket says 172.21.15.41:60242) 2021-10-21T00:06:19.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 -- 172.21.15.41:0/2392102253 learned_addr learned my addr 172.21.15.41:0/2392102253 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:19.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76b9384700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76b409cc90 0x7f76b4067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76b9b85700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409b220 0x7f76b40accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 -- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409b220 msgr2=0x7f76b40accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409b220 0x7f76b40accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 -- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76b409cc90 msgr2=0x7f76b4067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:19.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76b409cc90 0x7f76b4067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:19.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 -- 172.21.15.41:0/2392102253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac009530 con 0x7f76b4140870 2021-10-21T00:06:19.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76ba386700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f76b409a510 tx=0x7f76ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac00b860 con 0x7f76b4140870 2021-10-21T00:06:19.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac021630 con 0x7f76b4140870 2021-10-21T00:06:19.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b4066c30 con 0x7f76b4140870 2021-10-21T00:06:19.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac021990 con 0x7f76b4140870 2021-10-21T00:06:19.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b40678a0 con 0x7f76b4140870 2021-10-21T00:06:19.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f76ac027020 con 0x7f76b4140870 2021-10-21T00:06:19.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.881+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4066dc0 con 0x7f76b4140870 2021-10-21T00:06:19.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.885+0000 7f76a6ffd700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 0x7f7694055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:19.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.885+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f76ac06ca50 con 0x7f76b4140870 2021-10-21T00:06:19.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.885+0000 7f76b9b85700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 0x7f7694055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:19.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.885+0000 7f76b9b85700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 0x7f7694055b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f76b000c000 tx=0x7f76b0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:19.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:19.889+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76ac043e30 con 0x7f76b4140870 2021-10-21T00:06:20.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.057+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f76b4099860 con 0x7f76b4140870 2021-10-21T00:06:20.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.477+0000 7f76a6ffd700 1 -- 172.21.15.41:0/2392102253 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v153) v1 ==== 144+0+0 (secure 0 0 0) 0x7f76ac015020 con 0x7f76b4140870 2021-10-21T00:06:20.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 msgr2=0x7f7694055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 0x7f7694055b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f76b000c000 tx=0x7f76b0008040).stop 2021-10-21T00:06:20.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 msgr2=0x7f76b40af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f76b409a510 tx=0x7f76ac016000).stop 2021-10-21T00:06:20.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 shutdown_connections 2021-10-21T00:06:20.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76940536a0 0x7f7694055b60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76b4140870 0x7f76b40af940 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76b409cc90 0x7f76b4067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 --2- 172.21.15.41:0/2392102253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76b409b220 0x7f76b40accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 >> 172.21.15.41:0/2392102253 conn(0x7f76b40b7030 msgr2=0x7f76b40b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:20.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 shutdown_connections 2021-10-21T00:06:20.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.481+0000 7f76bbde9700 1 -- 172.21.15.41:0/2392102253 wait complete. 2021-10-21T00:06:20.507 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-21T00:06:20.507 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-21T00:06:20.508 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-10-21T00:06:20.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 Processor -- start 2021-10-21T00:06:20.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 -- start start 2021-10-21T00:06:20.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35c80af620 0x7f35c80ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:20.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80b0b50 con 0x7f35c8067a80 2021-10-21T00:06:20.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80b2550 con 0x7f35c80b2170 2021-10-21T00:06:20.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35ce264700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80b0d90 con 0x7f35c80af620 2021-10-21T00:06:20.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cda63700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f35c8067a80 0x7f35c8149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58022/0 (socket says 172.21.15.41:58022) 2021-10-21T00:06:20.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cca61700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35c80af620 0x7f35c80ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:20.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cda63700 1 -- 172.21.15.41:0/2899209345 learned_addr learned my addr 172.21.15.41:0/2899209345 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:20.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cca61700 1 -- 172.21.15.41:0/2899209345 >> v1:172.21.15.62:6789/0 conn(0x7f35c80b2170 legacy=0x7f35c80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cca61700 1 -- 172.21.15.41:0/2899209345 >> v1:172.21.15.41:6789/0 conn(0x7f35c8067a80 legacy=0x7f35c8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cca61700 1 -- 172.21.15.41:0/2899209345 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80b1030 con 0x7f35c80af620 2021-10-21T00:06:20.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35cca61700 1 --2- 172.21.15.41:0/2899209345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c80af620 0x7f35c80ab880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f35c80aafa0 tx=0x7f35b80091d0).ready entity=mon.1 client_cookie=e1e83db9a4bb7dfb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35c7fff700 1 -- 172.21.15.41:0/2899209345 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b800b860 con 0x7f35c80af620 2021-10-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35c7fff700 1 -- 172.21.15.41:0/2899209345 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800b9c0 con 0x7f35c80af620 2021-10-21T00:06:20.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.609+0000 7f35c7fff700 1 -- 172.21.15.41:0/2899209345 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b800bb30 con 0x7f35c80af620 2021-10-21T00:06:20.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- 172.21.15.41:0/2899209345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c80af620 msgr2=0x7f35c80ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 --2- 172.21.15.41:0/2899209345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c80af620 0x7f35c80ab880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f35c80aafa0 tx=0x7f35b80091d0).stop 2021-10-21T00:06:20.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- 172.21.15.41:0/2899209345 shutdown_connections 2021-10-21T00:06:20.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 --2- 172.21.15.41:0/2899209345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c80af620 0x7f35c80ab880 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- 172.21.15.41:0/2899209345 >> 172.21.15.41:0/2899209345 conn(0x7f35c80b5700 msgr2=0x7f35c80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:20.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- 172.21.15.41:0/2899209345 shutdown_connections 2021-10-21T00:06:20.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- 172.21.15.41:0/2899209345 wait complete. 2021-10-21T00:06:20.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 Processor -- start 2021-10-21T00:06:20.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- start start 2021-10-21T00:06:20.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8067a80 0x7f35c8064020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:20.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:20.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35c80b2170 0x7f35c80adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:20.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81570b0 con 0x7f35c80af620 2021-10-21T00:06:20.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8064b40 con 0x7f35c8067a80 2021-10-21T00:06:20.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35ce264700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ac130 con 0x7f35c80b2170 2021-10-21T00:06:20.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35cca61700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:20.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35cca61700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60256/0 (socket says 172.21.15.41:60256) 2021-10-21T00:06:20.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35cca61700 1 -- 172.21.15.41:0/1992688098 learned_addr learned my addr 172.21.15.41:0/1992688098 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:20.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35cda63700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35c80b2170 0x7f35c80adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:20.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.613+0000 7f35cd262700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8067a80 0x7f35c8064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:20.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 -- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35c80b2170 msgr2=0x7f35c80adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35c80b2170 0x7f35c80adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 -- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8067a80 msgr2=0x7f35c8064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:20.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8067a80 0x7f35c8064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:20.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 -- 172.21.15.41:0/1992688098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8009470 con 0x7f35c80af620 2021-10-21T00:06:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35cca61700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f35c80aafa0 tx=0x7f35b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b80032f0 con 0x7f35c80af620 2021-10-21T00:06:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b801f3f0 con 0x7f35c80af620 2021-10-21T00:06:20.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8156bf0 con 0x7f35c80af620 2021-10-21T00:06:20.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b801f750 con 0x7f35c80af620 2021-10-21T00:06:20.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c80ac750 con 0x7f35c80af620 2021-10-21T00:06:20.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80b12d0 con 0x7f35c80af620 2021-10-21T00:06:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35b8026030 con 0x7f35c80af620 2021-10-21T00:06:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.617+0000 7f35c67fc700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.621+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f35b806c120 con 0x7f35c80af620 2021-10-21T00:06:20.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.621+0000 7f35cd262700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:20.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.621+0000 7f35cd262700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 0x7f35a8055a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f35bc00d000 tx=0x7f35bc003040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:20.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.625+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35b8043560 con 0x7f35c80af620 2021-10-21T00:06:20.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:20.789+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f35c8057350 con 0x7f35c80af620 2021-10-21T00:06:21.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.481+0000 7f35c67fc700 1 -- 172.21.15.41:0/1992688098 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v154) v1 ==== 155+0+0 (secure 0 0 0) 0x7f35b80240e0 con 0x7f35c80af620 2021-10-21T00:06:21.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 msgr2=0x7f35a8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 0x7f35a8055a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f35bc00d000 tx=0x7f35bc003040).stop 2021-10-21T00:06:21.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 msgr2=0x7f35c8064510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f35c80aafa0 tx=0x7f35b8016000).stop 2021-10-21T00:06:21.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 shutdown_connections 2021-10-21T00:06:21.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a80535b0 0x7f35a8055a70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35c80b2170 0x7f35c80adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35c80af620 0x7f35c8064510 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 --2- 172.21.15.41:0/1992688098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8067a80 0x7f35c8064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 >> 172.21.15.41:0/1992688098 conn(0x7f35c80b5700 msgr2=0x7f35c80b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:21.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 shutdown_connections 2021-10-21T00:06:21.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.485+0000 7f35ce264700 1 -- 172.21.15.41:0/1992688098 wait complete. 2021-10-21T00:06:21.506 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:06:21.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.605+0000 7f96e5aea700 1 Processor -- start 2021-10-21T00:06:21.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.605+0000 7f96e5aea700 1 -- start start 2021-10-21T00:06:21.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f96e00b0ac0 0x7f96e0146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e0142ce0 0x7f96e0143130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00b4120 con 0x7f96e00b9b10 2021-10-21T00:06:21.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00b46e0 con 0x7f96e00b0ac0 2021-10-21T00:06:21.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00b4980 con 0x7f96e0142ce0 2021-10-21T00:06:21.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f96e00b0ac0 0x7f96e0146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96df7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f96e00b9b10 0x7f96e00b4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58032/0 (socket says 172.21.15.41:58032) 2021-10-21T00:06:21.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96df7fe700 1 -- 172.21.15.41:0/2963218255 learned_addr learned my addr 172.21.15.41:0/2963218255 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:21.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96dffff700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e0142ce0 0x7f96e0143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 -- 172.21.15.41:0/2963218255 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e0142ce0 msgr2=0x7f96e0143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:21.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e0142ce0 0x7f96e0143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 -- 172.21.15.41:0/2963218255 >> v1:172.21.15.41:6789/0 conn(0x7f96e00b9b10 legacy=0x7f96e00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96deffd700 1 -- 172.21.15.41:0/2963218255 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756612279 0 0) 0x7f96e00b4120 con 0x7f96e00b9b10 2021-10-21T00:06:21.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 -- 172.21.15.41:0/2963218255 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00b5530 con 0x7f96e00b0ac0 2021-10-21T00:06:21.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96d6ffd700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e00b0ac0 0x7f96e0146d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f96c8002f70 tx=0x7f96c8006d90).ready entity=mon.0 client_cookie=67b9949d72b340ab server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:21.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96deffd700 1 -- 172.21.15.41:0/2963218255 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c800d4a0 con 0x7f96e00b0ac0 2021-10-21T00:06:21.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96deffd700 1 -- 172.21.15.41:0/2963218255 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8000e90 con 0x7f96e00b0ac0 2021-10-21T00:06:21.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96deffd700 1 -- 172.21.15.41:0/2963218255 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c800d7f0 con 0x7f96e00b0ac0 2021-10-21T00:06:21.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- 172.21.15.41:0/2963218255 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e00b0ac0 msgr2=0x7f96e0146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e00b0ac0 0x7f96e0146d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f96c8002f70 tx=0x7f96c8006d90).stop 2021-10-21T00:06:21.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- 172.21.15.41:0/2963218255 shutdown_connections 2021-10-21T00:06:21.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e0142ce0 0x7f96e0143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 --2- 172.21.15.41:0/2963218255 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e00b0ac0 0x7f96e0146d30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- 172.21.15.41:0/2963218255 >> 172.21.15.41:0/2963218255 conn(0x7f96e0062ec0 msgr2=0x7f96e00b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:21.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- 172.21.15.41:0/2963218255 shutdown_connections 2021-10-21T00:06:21.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- 172.21.15.41:0/2963218255 wait complete. 2021-10-21T00:06:21.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 Processor -- start 2021-10-21T00:06:21.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.609+0000 7f96e5aea700 1 -- start start 2021-10-21T00:06:21.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 0x7f96e01168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 0x7f96e00b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01124f0 con 0x7f96e0142ce0 2021-10-21T00:06:21.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0112790 con 0x7f96e00b0ac0 2021-10-21T00:06:21.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0112a30 con 0x7f96e00b9b10 2021-10-21T00:06:21.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60268/0 (socket says 172.21.15.41:60268) 2021-10-21T00:06:21.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 -- 172.21.15.41:0/3752568567 learned_addr learned my addr 172.21.15.41:0/3752568567 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:21.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96df7fe700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 0x7f96e01168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96d6ffd700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 0x7f96e00b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 -- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 msgr2=0x7f96e00b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 0x7f96e00b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 -- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 msgr2=0x7f96e01168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 0x7f96e01168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 -- 172.21.15.41:0/3752568567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c800b120 con 0x7f96e0142ce0 2021-10-21T00:06:21.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96d6ffd700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 0x7f96e00b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:06:21.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96df7fe700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 0x7f96e01168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:06:21.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dffff700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f96d8006e00 tx=0x7f96d80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:21.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800c7f0 con 0x7f96e0142ce0 2021-10-21T00:06:21.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800c950 con 0x7f96e0142ce0 2021-10-21T00:06:21.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01557d0 con 0x7f96e0142ce0 2021-10-21T00:06:21.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800ccb0 con 0x7f96e0142ce0 2021-10-21T00:06:21.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e00b2a00 con 0x7f96e0142ce0 2021-10-21T00:06:21.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0113060 con 0x7f96e0142ce0 2021-10-21T00:06:21.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.613+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96d80123f0 con 0x7f96e0142ce0 2021-10-21T00:06:21.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.617+0000 7f96dd7fa700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 0x7f96c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:21.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.617+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f96d806b940 con 0x7f96e0142ce0 2021-10-21T00:06:21.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.617+0000 7f96df7fe700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 0x7f96c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:21.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.617+0000 7f96df7fe700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 0x7f96c4055a40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f96d0008000 tx=0x7f96d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:21.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.621+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96e0113060 con 0x7f96e0142ce0 2021-10-21T00:06:21.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.749+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f96e0113060 con 0x7f96e0142ce0 2021-10-21T00:06:21.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96dd7fa700 1 -- 172.21.15.41:0/3752568567 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f96e0113060 con 0x7f96e0142ce0 2021-10-21T00:06:21.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 msgr2=0x7f96c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 0x7f96c4055a40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f96d0008000 tx=0x7f96d0009040).stop 2021-10-21T00:06:21.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 msgr2=0x7f96e0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:21.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f96d8006e00 tx=0x7f96d80091d0).stop 2021-10-21T00:06:21.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 shutdown_connections 2021-10-21T00:06:21.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c4053580 0x7f96c4055a40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e0142ce0 0x7f96e0155de0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e00b9b10 0x7f96e00b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 --2- 172.21.15.41:0/3752568567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e00b0ac0 0x7f96e01168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:21.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 >> 172.21.15.41:0/3752568567 conn(0x7f96e0062ec0 msgr2=0x7f96e0141100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:21.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 shutdown_connections 2021-10-21T00:06:21.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:21.757+0000 7f96e5aea700 1 -- 172.21.15.41:0/3752568567 wait complete. 2021-10-21T00:06:21.777 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:06:21.777 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:21.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:21.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:21.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:21.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:06:21.887 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:06:21.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:21.888 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:21.888 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:06:21.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:21.897 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:21.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:21.898 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:21.898 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:06:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:06:21.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:21.907 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:06:21.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:21.908 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:21.908 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:06:21.916 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:06:21.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:21.917 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:06:21.918 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:06:22.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 Processor -- start 2021-10-21T00:06:22.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 -- start start 2021-10-21T00:06:22.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f35bc14b620 0x7f35bc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc142bc0 con 0x7f35bc0b3bc0 2021-10-21T00:06:22.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0ba050 con 0x7f35bc0b9c70 2021-10-21T00:06:22.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c3875700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc1429a0 con 0x7f35bc14b620 2021-10-21T00:06:22.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c0e10700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f35bc0b3bc0 0x7f35bc143730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58046/0 (socket says 172.21.15.41:58046) 2021-10-21T00:06:22.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c0e10700 1 -- 172.21.15.41:0/3511181152 learned_addr learned my addr 172.21.15.41:0/3511181152 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:22.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c1e12700 1 --2- 172.21.15.41:0/3511181152 >> v2:172.21.15.41:3300/0 conn(0x7f35bc14b620 0x7f35bc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35b3fff700 1 -- 172.21.15.41:0/3511181152 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167857041 0 0) 0x7f35bc142bc0 con 0x7f35bc0b3bc0 2021-10-21T00:06:22.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35b3fff700 1 -- 172.21.15.41:0/3511181152 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a0003260 con 0x7f35bc0b3bc0 2021-10-21T00:06:22.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c1e12700 1 -- 172.21.15.41:0/3511181152 >> v1:172.21.15.62:6789/0 conn(0x7f35bc0b9c70 legacy=0x7f35bc143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c1e12700 1 -- 172.21.15.41:0/3511181152 >> v1:172.21.15.41:6789/0 conn(0x7f35bc0b3bc0 legacy=0x7f35bc143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.021+0000 7f35c1e12700 1 -- 172.21.15.41:0/3511181152 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc1463c0 con 0x7f35bc14b620 2021-10-21T00:06:22.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c1e12700 1 --2- 172.21.15.41:0/3511181152 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc14b620 0x7f35bc14da10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f35b40032f0 tx=0x7f35b40091d0).ready entity=mon.0 client_cookie=c5a99dd56ecf3b75 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35b3fff700 1 -- 172.21.15.41:0/3511181152 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b400b6c0 con 0x7f35bc14b620 2021-10-21T00:06:22.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35b3fff700 1 -- 172.21.15.41:0/3511181152 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b820 con 0x7f35bc14b620 2021-10-21T00:06:22.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35b3fff700 1 -- 172.21.15.41:0/3511181152 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b400b990 con 0x7f35bc14b620 2021-10-21T00:06:22.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- 172.21.15.41:0/3511181152 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc14b620 msgr2=0x7f35bc14da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 --2- 172.21.15.41:0/3511181152 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc14b620 0x7f35bc14da10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f35b40032f0 tx=0x7f35b40091d0).stop 2021-10-21T00:06:22.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- 172.21.15.41:0/3511181152 shutdown_connections 2021-10-21T00:06:22.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 --2- 172.21.15.41:0/3511181152 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc14b620 0x7f35bc14da10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- 172.21.15.41:0/3511181152 >> 172.21.15.41:0/3511181152 conn(0x7f35bc062e80 msgr2=0x7f35bc0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- 172.21.15.41:0/3511181152 shutdown_connections 2021-10-21T00:06:22.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- 172.21.15.41:0/3511181152 wait complete. 2021-10-21T00:06:22.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 Processor -- start 2021-10-21T00:06:22.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.025+0000 7f35c3875700 1 -- start start 2021-10-21T00:06:22.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35bc0b3bc0 0x7f35bc05bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35bc14b620 0x7f35bc135b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc136720 con 0x7f35bc0b9c70 2021-10-21T00:06:22.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc137f30 con 0x7f35bc0b3bc0 2021-10-21T00:06:22.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1381d0 con 0x7f35bc14b620 2021-10-21T00:06:22.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60284/0 (socket says 172.21.15.41:60284) 2021-10-21T00:06:22.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 -- 172.21.15.41:0/1234425299 learned_addr learned my addr 172.21.15.41:0/1234425299 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:22.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c1611700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35bc0b3bc0 0x7f35bc05bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c1e12700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35bc14b620 0x7f35bc135b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 -- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35bc14b620 msgr2=0x7f35bc135b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35bc14b620 0x7f35bc135b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 -- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35bc0b3bc0 msgr2=0x7f35bc05bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35bc0b3bc0 0x7f35bc05bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 -- 172.21.15.41:0/1234425299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009470 con 0x7f35bc0b9c70 2021-10-21T00:06:22.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c0e10700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f35b8001110 tx=0x7f35b8007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b80070d0 con 0x7f35bc0b9c70 2021-10-21T00:06:22.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8007230 con 0x7f35bc0b9c70 2021-10-21T00:06:22.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc138470 con 0x7f35bc0b9c70 2021-10-21T00:06:22.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b8005610 con 0x7f35bc0b9c70 2021-10-21T00:06:22.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc0b94a0 con 0x7f35bc0b9c70 2021-10-21T00:06:22.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.029+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc138600 con 0x7f35bc0b9c70 2021-10-21T00:06:22.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.033+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35b801a060 con 0x7f35bc0b9c70 2021-10-21T00:06:22.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.033+0000 7f35b27fc700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 0x7f35a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.033+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f35b806a990 con 0x7f35bc0b9c70 2021-10-21T00:06:22.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.033+0000 7f35c1611700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 0x7f35a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.033+0000 7f35c1611700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 0x7f35a4055b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f35ac00d000 tx=0x7f35ac007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.041+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35b8041dd0 con 0x7f35bc0b9c70 2021-10-21T00:06:22.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.169+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f35bc057350 con 0x7f35bc0b9c70 2021-10-21T00:06:22.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.169+0000 7f35b27fc700 1 -- 172.21.15.41:0/1234425299 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v43) v1 ==== 81+0+28827 (secure 0 0 0) 0x7f35b8018070 con 0x7f35bc0b9c70 2021-10-21T00:06:22.175 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:22.176 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:06:22.176 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 43, 2021-10-21T00:06:22.176 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:06:22.177 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:06:22.177 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:06:19.464337+0000", 2021-10-21T00:06:22.177 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:06:22.177 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:06:22.178 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:06:22.178 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:06:22.178 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:06:22.178 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:06:22.179 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:06:22.179 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:06:22.179 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:06:22.179 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:22.180 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:06:22.181 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:06:22.181 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:06:22.182 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:06:22.182 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:06:22.182 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 8, 2021-10-21T00:06:22.182 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:06:22.182 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:06:22.183 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:06:22.183 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:06:22.183 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:06:22.184 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.184 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:06:22.184 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:06:22.184 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:06:22.185 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:22.185 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:22.185 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:22.185 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:22.186 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:22.186 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:22.186 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:22.186 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:22.187 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:06:22.187 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:06:22.187 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:06:22.188 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:06:22.188 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:06:22.188 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:22.188 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:22.189 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:22.189 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:22.189 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:22.189 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:22.190 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:22.190 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:06:22.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:22.190 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:22.191 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:22.191 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:22.191 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:22.191 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:22.192 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:22.192 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:22.192 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:22.192 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:22.192 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:22.193 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:22.193 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:22.193 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:22.193 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:22.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:22.194 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:22.194 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:22.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:22.194 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:22.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:22.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:22.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:22.195 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:22.195 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:22.196 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:22.196 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.196 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:22.197 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:22.197 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:22.197 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:22.198 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:22.198 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:22.198 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:22.198 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:22.199 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:22.199 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:22.199 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:22.199 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:06:22.200 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:06:22.200 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.200 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:22.200 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:06:22.200 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.201 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.201 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.201 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:06:22.201 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:06:22.202 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:06:22.202 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:06:22.202 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:06:22.202 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:06:22.203 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:06:22.203 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:06:22.203 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:06:22.203 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:06:22.203 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:06:22.204 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:06:22.204 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:06:22.204 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:06:22.204 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:06:22.204 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:06:22.205 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:06:22.205 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:06:22.205 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:06:22.205 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:06:22.206 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:06:22.206 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:06:22.206 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:06:22.206 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.206 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:06:22.207 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:06:22.207 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:06:22.207 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:06:22.207 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:06:22.208 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:06:22.208 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:06:22.208 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:06:22.208 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:06:22.209 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:06:22.209 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:06:22.209 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:06:22.209 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:06:22.209 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:06:22.210 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:06:22.210 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:06:22.210 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:06:22.210 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:06:22.211 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:06:22.211 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:06:22.211 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:06:22.211 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:06:22.212 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:06:22.212 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:06:22.212 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:06:22.212 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:06:22.213 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:06:22.213 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.213 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:06:22.213 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:06:22.213 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:06:22.214 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:06:22.214 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:06:22.214 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:06:22.215 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:06:22.215 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:06:22.215 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:06:22.215 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:06:22.215 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:06:22.216 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:06:22.216 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:06:22.216 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:06:22.217 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.217 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.217 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:22.217 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:06:22.218 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.218 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:06:22.218 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:06:22.218 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.218 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.219 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.219 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.219 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.219 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.220 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.220 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.220 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.220 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.220 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.221 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:06:22.221 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.222 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.222 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.222 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.222 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:06:22.223 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.223 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.223 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.223 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.223 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.224 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.224 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.224 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.224 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:06:22.224 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.225 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.225 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.225 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.225 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:06:22.226 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.226 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.226 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.226 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.226 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.227 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.227 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:06:22.228 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.228 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.228 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.228 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.228 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:06:22.229 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.229 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.229 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.229 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.230 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.230 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.230 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.231 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:06:22.231 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.231 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.231 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.232 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:06:22.232 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:06:22.232 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.232 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.233 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:06:22.233 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:06:22.233 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:06:22.234 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:06:22.234 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.234 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.234 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.234 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.235 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.235 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.235 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:06:22.235 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:06:22.236 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.236 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.236 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.236 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.236 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.237 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.237 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.237 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.237 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.238 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.238 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.238 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.238 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.239 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.239 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:06:22.239 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.239 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.240 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.240 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.240 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:06:22.240 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.240 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.241 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.241 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.241 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.241 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.242 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.242 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.242 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:06:22.242 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.242 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.243 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.243 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.243 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:06:22.243 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.244 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.244 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.244 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.244 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.244 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.245 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.245 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.245 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:06:22.245 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.246 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.246 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.246 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:06:22.246 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.247 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.247 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.247 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.247 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.248 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.248 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:06:22.248 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.249 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.249 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.249 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:06:22.250 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:06:22.250 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.250 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.250 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.250 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:06:22.251 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:06:22.251 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:06:22.251 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:06:22.251 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.252 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.252 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.252 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.252 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.252 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.253 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:06:22.253 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:06:22.253 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.253 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.254 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.254 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.254 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.254 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.254 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.255 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 28, 2021-10-21T00:06:22.255 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.255 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.255 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.256 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.256 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.256 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.256 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:06:22.257 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.257 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.257 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.257 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.257 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:06:22.258 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.258 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.258 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.258 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.258 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.259 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.259 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.259 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.259 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:06:22.260 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.260 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.260 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.260 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.260 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:06:22.261 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.261 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.261 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.261 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.262 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.262 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.262 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.262 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:06:22.263 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.263 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.263 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.263 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.263 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:06:22.264 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.264 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.264 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.264 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.265 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.265 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.265 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.265 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.265 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:06:22.266 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.266 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.266 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.266 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.267 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:06:22.267 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:06:22.267 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.267 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.267 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.268 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:06:22.268 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:06:22.268 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:06:22.268 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:06:22.269 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.269 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.269 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.269 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.269 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.270 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.270 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:06:22.270 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:06:22.270 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.271 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.271 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.271 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.271 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.271 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.272 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.272 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.272 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.272 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.273 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.273 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.273 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.273 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.273 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:06:22.274 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.274 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.274 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.274 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.275 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:06:22.275 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.275 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.275 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.275 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.276 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.276 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.276 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.276 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.277 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:06:22.277 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.277 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.277 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:06:22.278 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.278 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.278 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.279 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.279 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.279 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.280 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.280 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.280 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:06:22.280 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.281 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.281 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:06:22.281 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.282 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.282 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.282 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.282 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.283 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.283 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.283 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:06:22.283 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.284 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.284 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.284 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.284 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:06:22.284 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:06:22.285 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.285 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.285 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.285 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:06:22.285 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:06:22.286 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:06:22.286 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:06:22.286 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.286 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.287 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.287 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.287 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.287 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.288 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:06:22.288 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:06:22.288 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.288 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.289 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.289 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.289 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.289 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.289 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.290 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.290 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.290 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.290 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.291 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.291 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.291 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.291 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:06:22.292 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.292 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.292 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.292 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.292 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:06:22.293 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.293 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.293 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.293 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.294 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.294 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.294 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.294 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.294 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:06:22.295 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.295 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.295 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.295 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.296 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:06:22.296 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.296 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.296 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.297 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.297 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.297 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.297 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.297 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.298 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:06:22.298 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.298 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.299 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.299 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:06:22.299 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.299 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.299 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.300 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.300 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.300 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.300 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.301 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.301 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:06:22.301 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.301 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.301 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.302 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.302 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:06:22.302 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:06:22.302 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.303 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.303 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.303 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:06:22.303 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:06:22.303 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:06:22.304 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:06:22.304 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.304 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.304 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.305 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.305 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.305 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.305 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:06:22.305 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:06:22.306 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.306 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.306 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.306 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.307 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.307 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.307 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.307 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.307 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.308 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.308 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.308 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.308 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.309 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.309 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:06:22.309 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.309 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.309 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.310 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.310 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:06:22.310 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.310 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.311 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.311 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.311 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.311 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.311 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.312 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.312 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:06:22.312 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.312 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.313 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.313 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.313 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:06:22.313 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.313 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.314 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.314 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.314 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.314 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.315 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.315 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:06:22.315 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.316 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.316 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:06:22.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.317 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.317 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.317 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.317 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.318 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.318 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:06:22.318 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.319 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.319 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.319 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:06:22.319 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:06:22.320 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.320 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.320 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.320 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:06:22.321 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:06:22.321 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:06:22.321 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:06:22.321 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.321 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.322 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.322 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.322 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.322 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.323 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:06:22.323 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:06:22.323 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.323 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.323 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.324 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.324 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.325 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 38, 2021-10-21T00:06:22.325 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.325 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.325 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.325 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.326 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.326 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.326 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:06:22.326 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.326 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.327 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.327 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.327 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:06:22.327 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.328 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.328 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.328 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.328 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.328 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.329 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.329 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.329 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:06:22.329 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.330 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.330 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.330 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:06:22.330 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.331 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.331 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.331 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.331 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.332 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.332 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:06:22.333 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.333 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.333 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.333 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.333 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:06:22.334 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.334 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.334 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.334 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.335 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.335 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.335 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:06:22.336 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.336 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.337 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:06:22.337 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:06:22.337 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.337 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.337 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.338 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:06:22.338 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:06:22.338 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:06:22.338 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:06:22.339 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.339 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.339 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.339 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.339 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.340 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.340 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:06:22.340 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:06:22.340 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:06:22.340 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:06:22.341 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:06:22.341 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:06:22.341 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:06:22.341 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:06:22.342 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:06:22.342 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 37, 2021-10-21T00:06:22.342 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:06:22.342 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:06:22.342 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:06:22.343 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.343 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.343 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.343 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:06:22.344 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.344 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.344 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.344 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.344 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:06:22.345 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.345 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.345 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.345 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.345 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:06:22.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.346 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.346 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:06:22.347 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.347 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.347 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.347 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.347 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:06:22.348 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.348 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.348 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.348 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.348 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:06:22.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.349 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.349 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:06:22.349 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.350 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.350 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.350 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.350 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:06:22.351 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.351 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.351 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.352 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:06:22.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:06:22.352 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.352 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:06:22.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:06:22.353 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.353 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.353 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:06:22.353 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:06:22.354 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:06:22.354 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.354 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.354 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.355 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:06:22.355 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:06:22.355 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:06:22.355 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:06:22.356 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:06:22.356 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:06:22.356 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:06:22.356 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:22.356 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.357 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:22.357 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:06:22.357 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.357 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:06:22.358 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.358 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.358 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.358 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.358 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.359 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:06:22.359 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.359 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.359 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.360 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:06:22.360 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.360 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.360 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.360 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.361 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.361 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:06:22.361 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.362 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.362 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:06:22.362 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.362 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.362 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.363 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.363 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:06:22.363 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.364 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.364 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:06:22.364 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.364 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.365 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.365 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.365 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.365 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:06:22.365 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.366 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.366 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:06:22.366 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.367 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.367 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.367 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.367 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.367 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:06:22.368 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.368 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.368 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.368 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:06:22.368 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.369 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.369 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.369 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.369 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.370 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:06:22.370 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.370 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.370 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:06:22.371 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.371 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.371 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.371 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.372 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.372 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:06:22.372 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.372 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.372 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:22.373 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:06:22.373 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:06:22.373 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:06:22.373 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:06:22.373 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:06:22.374 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:06:22.374 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:06:22.374 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:06:22.374 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.375 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:06:22.375 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:06:22.375 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:06:22.375 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:06:22.376 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:06:22.376 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:06:22.376 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/4294881740": "2021-10-22T00:06:15.631478+0000", 2021-10-21T00:06:22.376 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/4294881740": "2021-10-22T00:06:15.631478+0000" 2021-10-21T00:06:22.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.377 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:06:22.377 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:06:22.377 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:06:22.377 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:06:22.378 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:06:22.378 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:06:22.378 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:06:22.378 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:06:22.378 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:22.379 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:22.379 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:06:22.379 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:06:22.379 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:06:22.380 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:06:22.380 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:06:22.380 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:06:22.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 msgr2=0x7f35a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 0x7f35a4055b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f35ac00d000 tx=0x7f35ac007b90).stop 2021-10-21T00:06:22.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 msgr2=0x7f35bc140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f35b8001110 tx=0x7f35b8007aa0).stop 2021-10-21T00:06:22.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 shutdown_connections 2021-10-21T00:06:22.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35a40536a0 0x7f35a4055b60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35bc14b620 0x7f35bc135b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35bc0b9c70 0x7f35bc140d10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 --2- 172.21.15.41:0/1234425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35bc0b3bc0 0x7f35bc05bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 >> 172.21.15.41:0/1234425299 conn(0x7f35bc062e80 msgr2=0x7f35bc13e890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 shutdown_connections 2021-10-21T00:06:22.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.173+0000 7f35c3875700 1 -- 172.21.15.41:0/1234425299 wait complete. 2021-10-21T00:06:22.386 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:22.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 Processor -- start 2021-10-21T00:06:22.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 -- start start 2021-10-21T00:06:22.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2d280aa520 0x7f2d28098280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280b07d0 con 0x7f2d2805ce00 2021-10-21T00:06:22.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280988b0 con 0x7f2d280a9d80 2021-10-21T00:06:22.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2fcf4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d28098b50 con 0x7f2d280aa520 2021-10-21T00:06:22.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2e291700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2d2805ce00 0x7f2d280b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58064/0 (socket says 172.21.15.41:58064) 2021-10-21T00:06:22.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2e291700 1 -- 172.21.15.41:0/4207564739 learned_addr learned my addr 172.21.15.41:0/4207564739 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:22.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2da90700 1 --2- 172.21.15.41:0/4207564739 >> v2:172.21.15.62:3300/0 conn(0x7f2d280aa520 0x7f2d28098280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2ca8e700 1 -- 172.21.15.41:0/4207564739 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797157813 0 0) 0x7f2d280b07d0 con 0x7f2d2805ce00 2021-10-21T00:06:22.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2ca8e700 1 -- 172.21.15.41:0/4207564739 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d10003260 con 0x7f2d2805ce00 2021-10-21T00:06:22.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2da90700 1 -- 172.21.15.41:0/4207564739 >> v1:172.21.15.62:6789/0 conn(0x7f2d280a9d80 legacy=0x7f2d2809a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2da90700 1 -- 172.21.15.41:0/4207564739 >> v1:172.21.15.41:6789/0 conn(0x7f2d2805ce00 legacy=0x7f2d280b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.493+0000 7f2d2da90700 1 -- 172.21.15.41:0/4207564739 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28098df0 con 0x7f2d280aa520 2021-10-21T00:06:22.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2da90700 1 --2- 172.21.15.41:0/4207564739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280aa520 0x7f2d28098280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f2d24002f70 tx=0x7f2d24006e80).ready entity=mon.1 client_cookie=16fa2c15a8e05995 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2ca8e700 1 -- 172.21.15.41:0/4207564739 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d24014070 con 0x7f2d280aa520 2021-10-21T00:06:22.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2ca8e700 1 -- 172.21.15.41:0/4207564739 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24000e90 con 0x7f2d280aa520 2021-10-21T00:06:22.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2ca8e700 1 -- 172.21.15.41:0/4207564739 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d240107f0 con 0x7f2d280aa520 2021-10-21T00:06:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/4207564739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280aa520 msgr2=0x7f2d28098280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/4207564739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280aa520 0x7f2d28098280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f2d24002f70 tx=0x7f2d24006e80).stop 2021-10-21T00:06:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/4207564739 shutdown_connections 2021-10-21T00:06:22.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/4207564739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280aa520 0x7f2d28098280 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/4207564739 >> 172.21.15.41:0/4207564739 conn(0x7f2d2805bca0 msgr2=0x7f2d2805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/4207564739 shutdown_connections 2021-10-21T00:06:22.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.497+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/4207564739 wait complete. 2021-10-21T00:06:22.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 Processor -- start 2021-10-21T00:06:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- start start 2021-10-21T00:06:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280a9d80 0x7f2d28153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 0x7f2d28062690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28065220 con 0x7f2d2805ce00 2021-10-21T00:06:22.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280654c0 con 0x7f2d280a9d80 2021-10-21T00:06:22.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28066910 con 0x7f2d280aa520 2021-10-21T00:06:22.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2e291700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 0x7f2d28062690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60296/0 (socket says 172.21.15.41:60296) 2021-10-21T00:06:22.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 -- 172.21.15.41:0/2054921399 learned_addr learned my addr 172.21.15.41:0/2054921399 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:22.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 -- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 msgr2=0x7f2d28062690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 0x7f2d28062690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 -- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280a9d80 msgr2=0x7f2d28153990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-10-21T00:06:22.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280a9d80 0x7f2d28153990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-10-21T00:06:22.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 -- 172.21.15.41:0/2054921399 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2400c310 con 0x7f2d2805ce00 2021-10-21T00:06:22.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2e291700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 0x7f2d28062690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:22.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2da90700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f2d24002f70 tx=0x7f2d28060310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d24010e00 con 0x7f2d2805ce00 2021-10-21T00:06:22.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400ac30 con 0x7f2d2805ce00 2021-10-21T00:06:22.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28064ea0 con 0x7f2d2805ce00 2021-10-21T00:06:22.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2401b430 con 0x7f2d2805ce00 2021-10-21T00:06:22.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.501+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28064ae0 con 0x7f2d2805ce00 2021-10-21T00:06:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28066ad0 con 0x7f2d2805ce00 2021-10-21T00:06:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d24021020 con 0x7f2d2805ce00 2021-10-21T00:06:22.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d16ffd700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 0x7f2d08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2d2406cc40 con 0x7f2d2805ce00 2021-10-21T00:06:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d2d28f700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 0x7f2d08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.505+0000 7f2d2d28f700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 0x7f2d08055ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2d2805c8a0 tx=0x7f2d18007770).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.509+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d24044130 con 0x7f2d2805ce00 2021-10-21T00:06:22.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d280aa900 con 0x7f2d2805ce00 2021-10-21T00:06:22.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d16ffd700 1 -- 172.21.15.41:0/2054921399 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f2d24047750 con 0x7f2d2805ce00 2021-10-21T00:06:22.679 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:22.680 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/4074038011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4074038011},{"type":"v1","addr":"172.21.15.62:6835","nonce":4074038011}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[]} 2021-10-21T00:06:22.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 msgr2=0x7f2d08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 0x7f2d08055ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2d2805c8a0 tx=0x7f2d18007770).stop 2021-10-21T00:06:22.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 msgr2=0x7f2d281534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.673+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f2d24002f70 tx=0x7f2d28060310).stop 2021-10-21T00:06:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 shutdown_connections 2021-10-21T00:06:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2d08053610 0x7f2d08055ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2d280aa520 0x7f2d28062690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d280a9d80 0x7f2d28153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-10-21T00:06:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 --2- 172.21.15.41:0/2054921399 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2d2805ce00 0x7f2d281534a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 >> 172.21.15.41:0/2054921399 conn(0x7f2d2805bca0 msgr2=0x7f2d280ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 shutdown_connections 2021-10-21T00:06:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.677+0000 7f2d2fcf4700 1 -- 172.21.15.41:0/2054921399 wait complete. 2021-10-21T00:06:22.694 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 18 2021-10-21T00:06:22.694 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.789+0000 7f364318e700 1 Processor -- start 2021-10-21T00:06:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.789+0000 7f364318e700 1 -- start start 2021-10-21T00:06:22.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 0x7f363c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f363c067a80 0x7f363c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0b0b50 con 0x7f363c0af620 2021-10-21T00:06:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0b2550 con 0x7f363c067a80 2021-10-21T00:06:22.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0b0d90 con 0x7f363c0b2170 2021-10-21T00:06:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f363c0af620 0x7f363c0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58072/0 (socket says 172.21.15.41:58072) 2021-10-21T00:06:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 -- 172.21.15.41:0/1682234250 learned_addr learned my addr 172.21.15.41:0/1682234250 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364218c700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 0x7f363c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192270959 0 0) 0x7f3638001110 con 0x7f363c0af620 2021-10-21T00:06:22.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364298d700 1 --2- 172.21.15.41:0/1682234250 >> v2:172.21.15.62:3300/0 conn(0x7f363c067a80 0x7f363c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3624003260 con 0x7f363c0af620 2021-10-21T00:06:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902649647 0 0) 0x7f3624003260 con 0x7f363c0af620 2021-10-21T00:06:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 msgr2=0x7f363c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:22.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 0x7f363c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 >> v2:172.21.15.62:3300/0 conn(0x7f363c067a80 msgr2=0x7f363c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 --2- 172.21.15.41:0/1682234250 >> v2:172.21.15.62:3300/0 conn(0x7f363c067a80 0x7f363c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0b1030 con 0x7f363c0af620 2021-10-21T00:06:22.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f36380017f0 con 0x7f363c0af620 2021-10-21T00:06:22.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 >> v1:172.21.15.41:6789/0 conn(0x7f363c0af620 legacy=0x7f363c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3624003750 0x7f3624003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f3624004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 0x7f3624004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0b2550 con 0x7f3624004500 2021-10-21T00:06:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0b0d90 con 0x7f3624003750 2021-10-21T00:06:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362400b7a0 con 0x7f363c0b2170 2021-10-21T00:06:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f3624004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364218c700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3624003750 0x7f3624003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 -- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 msgr2=0x7f3624004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:22.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c0b2170 0x7f3624004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-10-21T00:06:22.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 -- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3624003750 msgr2=0x7f3624003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:22.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3624003750 0x7f3624003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 -- 172.21.15.41:0/1682234250 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624003260 con 0x7f3624004500 2021-10-21T00:06:22.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364198b700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f3624004980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3638001500 tx=0x7f363c061f20).ready entity=mon.0 client_cookie=fd10002bd6ba666f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f363800cac0 con 0x7f3624004500 2021-10-21T00:06:22.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800cc20 con 0x7f3624004500 2021-10-21T00:06:22.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364118a700 1 -- 172.21.15.41:0/1682234250 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36380070d0 con 0x7f3624004500 2021-10-21T00:06:22.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- 172.21.15.41:0/1682234250 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 msgr2=0x7f3624004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 --2- 172.21.15.41:0/1682234250 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f3624004980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3638001500 tx=0x7f363c061f20).stop 2021-10-21T00:06:22.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364298d700 1 -- 172.21.15.41:0/1682234250 reap_dead start 2021-10-21T00:06:22.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- 172.21.15.41:0/1682234250 shutdown_connections 2021-10-21T00:06:22.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- 172.21.15.41:0/1682234250 >> 172.21.15.41:0/1682234250 conn(0x7f363c0b5700 msgr2=0x7f363c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- 172.21.15.41:0/1682234250 shutdown_connections 2021-10-21T00:06:22.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.793+0000 7f364318e700 1 -- 172.21.15.41:0/1682234250 wait complete. 2021-10-21T00:06:22.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 Processor -- start 2021-10-21T00:06:22.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 -- start start 2021-10-21T00:06:22.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c064a40 0x7f363c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c064ea0 con 0x7f3624004500 2021-10-21T00:06:22.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c0aca00 con 0x7f363c1565f0 2021-10-21T00:06:22.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364318e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c156f30 con 0x7f363c064a40 2021-10-21T00:06:22.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364298d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60316/0 (socket says 172.21.15.41:60316) 2021-10-21T00:06:22.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364298d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44000/0 (socket says 172.21.15.41:44000) 2021-10-21T00:06:22.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 -- 172.21.15.41:0/2029668706 learned_addr learned my addr 172.21.15.41:0/2029668706 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:22.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364198b700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c064a40 0x7f363c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 -- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c064a40 msgr2=0x7f363c156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c064a40 0x7f363c156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 -- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 msgr2=0x7f363c1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364218c700 1 -- 172.21.15.41:0/2029668706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0ac560 con 0x7f3624004500 2021-10-21T00:06:22.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.797+0000 7f364298d700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:22.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f364218c700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f363c0acb40 tx=0x7f362c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362c0135f0 con 0x7f3624004500 2021-10-21T00:06:22.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c000e90 con 0x7f3624004500 2021-10-21T00:06:22.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c097650 con 0x7f3624004500 2021-10-21T00:06:22.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362c013940 con 0x7f3624004500 2021-10-21T00:06:22.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c156c10 con 0x7f3624004500 2021-10-21T00:06:22.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c0ac6f0 con 0x7f3624004500 2021-10-21T00:06:22.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f362c013aa0 con 0x7f3624004500 2021-10-21T00:06:22.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 0x7f361c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:22.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f362c06b5b0 con 0x7f3624004500 2021-10-21T00:06:22.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.801+0000 7f364198b700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 0x7f361c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:22.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.805+0000 7f364198b700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 0x7f361c055b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f363801a000 tx=0x7f3638010000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:22.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.809+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f362c0429f0 con 0x7f3624004500 2021-10-21T00:06:22.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.973+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f363c0b12d0 con 0x7f3624004500 2021-10-21T00:06:22.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f362b7fe700 1 -- 172.21.15.41:0/2029668706 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f362c017020 con 0x7f3624004500 2021-10-21T00:06:22.982 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:22.982 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3606318736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3606318736},{"type":"v1","addr":"172.21.15.41:6833","nonce":3606318736}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/4074038011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":4074038011},{"type":"v1","addr":"172.21.15.62:6835","nonce":4074038011}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[]} 2021-10-21T00:06:22.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 msgr2=0x7f361c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 0x7f361c055b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f363801a000 tx=0x7f3638010000).stop 2021-10-21T00:06:22.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 msgr2=0x7f363c064550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:22.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f363c0acb40 tx=0x7f362c008040).stop 2021-10-21T00:06:22.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 shutdown_connections 2021-10-21T00:06:22.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f361c053640 0x7f361c055b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f363c1565f0 0x7f363c1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f363c064a40 0x7f363c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 --2- 172.21.15.41:0/2029668706 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3624004500 0x7f363c064550 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:22.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.977+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 >> 172.21.15.41:0/2029668706 conn(0x7f363c0b5700 msgr2=0x7f363c148e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:22.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.981+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 shutdown_connections 2021-10-21T00:06:22.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:22.981+0000 7f364318e700 1 -- 172.21.15.41:0/2029668706 wait complete. 2021-10-21T00:06:22.993 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 18 2021-10-21T00:06:23.000 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:06:23.000 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:06:23.001 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:06:23.001 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:06:23.002 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:06:23.003 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:06:23.003 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:06:23.003 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:06:23.014 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:06:23.014 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:06:23.017 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:06:23.017 DEBUG:teuthology.parallel:result is None 2021-10-21T00:06:23.020 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:06:23.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:06:23.022 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:06:23.023 DEBUG:teuthology.parallel:result is None 2021-10-21T00:06:23.023 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:06:23.089 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:06:23.097 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:06:23.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.117+0000 7fdc9a8b2700 1 Processor -- start 2021-10-21T00:06:23.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.117+0000 7fdc9a8b2700 1 -- start start 2021-10-21T00:06:23.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc940b5f70 0x7fdc94143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940aebb0 0x7fdc941441d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc9405cd60 0x7fdc941446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940b13b0 con 0x7fdc9405cd60 2021-10-21T00:06:23.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc94144bb0 con 0x7fdc940b5f70 2021-10-21T00:06:23.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940b6350 con 0x7fdc940aebb0 2021-10-21T00:06:23.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc940b5f70 0x7fdc94143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc940b5f70 0x7fdc94143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44020/0 (socket says 172.21.15.41:44020) 2021-10-21T00:06:23.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 -- 172.21.15.41:0/3405960688 learned_addr learned my addr 172.21.15.41:0/3405960688 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:23.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a0b1700 1 --2- 172.21.15.41:0/3405960688 >> v2:172.21.15.41:3300/0 conn(0x7fdc9405cd60 0x7fdc941446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc990af700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940aebb0 0x7fdc941441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 -- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940aebb0 msgr2=0x7fdc941441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:23.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940aebb0 0x7fdc941441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 -- 172.21.15.41:0/3405960688 >> v2:172.21.15.41:3300/0 conn(0x7fdc9405cd60 msgr2=0x7fdc941446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:23.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 --2- 172.21.15.41:0/3405960688 >> v2:172.21.15.41:3300/0 conn(0x7fdc9405cd60 0x7fdc941446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 -- 172.21.15.41:0/3405960688 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9405c830 con 0x7fdc940b5f70 2021-10-21T00:06:23.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc998b0700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc940b5f70 0x7fdc94143ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fdc90002f70 tx=0x7fdc90006eb0).ready entity=mon.1 client_cookie=d82b103285bff452 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:23.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc988ae700 1 -- 172.21.15.41:0/3405960688 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9000d570 con 0x7fdc940b5f70 2021-10-21T00:06:23.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc988ae700 1 -- 172.21.15.41:0/3405960688 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90000e90 con 0x7fdc940b5f70 2021-10-21T00:06:23.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc988ae700 1 -- 172.21.15.41:0/3405960688 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9000d900 con 0x7fdc940b5f70 2021-10-21T00:06:23.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc940b5f70 msgr2=0x7fdc94143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:23.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc940b5f70 0x7fdc94143ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fdc90002f70 tx=0x7fdc90006eb0).stop 2021-10-21T00:06:23.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/3405960688 shutdown_connections 2021-10-21T00:06:23.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/3405960688 >> v2:172.21.15.41:3300/0 conn(0x7fdc9405cd60 0x7fdc941446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940aebb0 0x7fdc941441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/3405960688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc940b5f70 0x7fdc94143ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/3405960688 >> 172.21.15.41:0/3405960688 conn(0x7fdc940639f0 msgr2=0x7fdc940b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:23.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/3405960688 shutdown_connections 2021-10-21T00:06:23.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/3405960688 wait complete. 2021-10-21T00:06:23.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 Processor -- start 2021-10-21T00:06:23.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.121+0000 7fdc9a8b2700 1 -- start start 2021-10-21T00:06:23.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc9405cd60 0x7fdc94066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940b5f70 0x7fdc9410e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94138c60 con 0x7fdc940aebb0 2021-10-21T00:06:23.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94150a30 con 0x7fdc9405cd60 2021-10-21T00:06:23.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9413daa0 con 0x7fdc940b5f70 2021-10-21T00:06:23.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60342/0 (socket says 172.21.15.41:60342) 2021-10-21T00:06:23.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc998b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc9405cd60 0x7fdc94066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 -- 172.21.15.41:0/1611943717 learned_addr learned my addr 172.21.15.41:0/1611943717 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:23.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a0b1700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940b5f70 0x7fdc9410e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 -- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940b5f70 msgr2=0x7fdc9410e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:23.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940b5f70 0x7fdc9410e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 -- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc9405cd60 msgr2=0x7fdc94066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:23.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc9405cd60 0x7fdc94066380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:23.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 -- 172.21.15.41:0/1611943717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9000b1e0 con 0x7fdc940aebb0 2021-10-21T00:06:23.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc990af700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdc8400c000 tx=0x7fdc84006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:23.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc84010590 con 0x7fdc940aebb0 2021-10-21T00:06:23.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc840106f0 con 0x7fdc940aebb0 2021-10-21T00:06:23.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9413df40 con 0x7fdc940aebb0 2021-10-21T00:06:23.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc84010a50 con 0x7fdc940aebb0 2021-10-21T00:06:23.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9413e230 con 0x7fdc940aebb0 2021-10-21T00:06:23.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9413e510 con 0x7fdc940aebb0 2021-10-21T00:06:23.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.125+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc84010bb0 con 0x7fdc940aebb0 2021-10-21T00:06:23.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.129+0000 7fdc82ffd700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 0x7fdc74055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:23.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.129+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdc8406b600 con 0x7fdc940aebb0 2021-10-21T00:06:23.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.129+0000 7fdc998b0700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 0x7fdc74055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:23.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.129+0000 7fdc998b0700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 0x7fdc74055b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fdc9001c000 tx=0x7fdc90015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:23.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.133+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc84042a40 con 0x7fdc940aebb0 2021-10-21T00:06:23.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:23.273+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fdc94150bf0 con 0x7fdc940aebb0 2021-10-21T00:06:24.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.117+0000 7fdc82ffd700 1 -- 172.21.15.41:0/1611943717 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdc84046060 con 0x7fdc940aebb0 2021-10-21T00:06:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 msgr2=0x7fdc74055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 0x7fdc74055b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fdc9001c000 tx=0x7fdc90015000).stop 2021-10-21T00:06:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 msgr2=0x7fdc94066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdc8400c000 tx=0x7fdc84006df0).stop 2021-10-21T00:06:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 shutdown_connections 2021-10-21T00:06:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc740536d0 0x7fdc74055b90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc940b5f70 0x7fdc9410e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc940aebb0 0x7fdc94066870 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 --2- 172.21.15.41:0/1611943717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc9405cd60 0x7fdc94066380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 >> 172.21.15.41:0/1611943717 conn(0x7fdc940639f0 msgr2=0x7fdc94139640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 shutdown_connections 2021-10-21T00:06:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.121+0000 7fdc9a8b2700 1 -- 172.21.15.41:0/1611943717 wait complete. 2021-10-21T00:06:24.131 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:06:24.145 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:06:24.145 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:06:24.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 Processor -- start 2021-10-21T00:06:24.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- start start 2021-10-21T00:06:24.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9840ac560 0x7fe9840ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9840968b0 0x7fe98405c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9840ace30 con 0x7fe984097920 2021-10-21T00:06:24.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984097e00 con 0x7fe9840968b0 2021-10-21T00:06:24.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840ad5b0 con 0x7fe9840ac560 2021-10-21T00:06:24.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe989163700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe984097920 0x7fe98405bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58120/0 (socket says 172.21.15.41:58120) 2021-10-21T00:06:24.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9840968b0 0x7fe98405c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe989163700 1 -- 172.21.15.41:0/1468808761 learned_addr learned my addr 172.21.15.41:0/1468808761 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:24.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe989964700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9840ac560 0x7fe9840ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702834382 0 0) 0x7fe9840ace30 con 0x7fe984097920 2021-10-21T00:06:24.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe96c003260 con 0x7fe984097920 2021-10-21T00:06:24.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600463362 0 0) 0x7fe96c003260 con 0x7fe984097920 2021-10-21T00:06:24.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 -- 172.21.15.41:0/1468808761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9840ac560 msgr2=0x7fe9840ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:24.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9840ac560 0x7fe9840ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 -- 172.21.15.41:0/1468808761 >> v1:172.21.15.41:6789/0 conn(0x7fe984097920 legacy=0x7fe98405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 -- 172.21.15.41:0/1468808761 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840b2ba0 con 0x7fe9840968b0 2021-10-21T00:06:24.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98a165700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840968b0 0x7fe98405c3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe974001820 tx=0x7fe97c0091d0).ready entity=mon.0 client_cookie=78d8e61c6c74ddf1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe974001680 con 0x7fe9840968b0 2021-10-21T00:06:24.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00f510 con 0x7fe9840968b0 2021-10-21T00:06:24.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe988962700 1 -- 172.21.15.41:0/1468808761 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97c00f680 con 0x7fe9840968b0 2021-10-21T00:06:24.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- 172.21.15.41:0/1468808761 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840968b0 msgr2=0x7fe98405c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840968b0 0x7fe98405c3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fe974001820 tx=0x7fe97c0091d0).stop 2021-10-21T00:06:24.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- 172.21.15.41:0/1468808761 shutdown_connections 2021-10-21T00:06:24.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840968b0 0x7fe98405c3b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/1468808761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9840ac560 0x7fe9840ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- 172.21.15.41:0/1468808761 >> 172.21.15.41:0/1468808761 conn(0x7fe9840b45c0 msgr2=0x7fe98405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- 172.21.15.41:0/1468808761 shutdown_connections 2021-10-21T00:06:24.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.249+0000 7fe98bbc8700 1 -- 172.21.15.41:0/1468808761 wait complete. 2021-10-21T00:06:24.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 Processor -- start 2021-10-21T00:06:24.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 -- start start 2021-10-21T00:06:24.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9840968b0 0x7fe984065170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 0x7fe98409ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98409bd70 con 0x7fe9840ac560 2021-10-21T00:06:24.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840aee90 con 0x7fe9840968b0 2021-10-21T00:06:24.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98bbc8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840af130 con 0x7fe984097920 2021-10-21T00:06:24.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98a165700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98a165700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60360/0 (socket says 172.21.15.41:60360) 2021-10-21T00:06:24.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe98a165700 1 -- 172.21.15.41:0/3263784410 learned_addr learned my addr 172.21.15.41:0/3263784410 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:24.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe989163700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 0x7fe98409ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.253+0000 7fe989964700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9840968b0 0x7fe984065170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 -- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9840968b0 msgr2=0x7fe984065170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9840968b0 0x7fe984065170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 -- 172.21.15.41:0/3263784410 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 msgr2=0x7fe9840af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 -- 172.21.15.41:0/3263784410 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c009470 con 0x7fe984097920 2021-10-21T00:06:24.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe98a165700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:24.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe989163700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 0x7fe98409ca10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe9740018e0 tx=0x7fe974001aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe974007170 con 0x7fe984097920 2021-10-21T00:06:24.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9740072d0 con 0x7fe984097920 2021-10-21T00:06:24.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9840af3d0 con 0x7fe984097920 2021-10-21T00:06:24.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe974004920 con 0x7fe984097920 2021-10-21T00:06:24.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9840ae890 con 0x7fe984097920 2021-10-21T00:06:24.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98409c770 con 0x7fe984097920 2021-10-21T00:06:24.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.257+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe974004a80 con 0x7fe984097920 2021-10-21T00:06:24.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.261+0000 7fe972ffd700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 0x7fe964055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.261+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe97406b0e0 con 0x7fe984097920 2021-10-21T00:06:24.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.261+0000 7fe989964700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 0x7fe964055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.261+0000 7fe989964700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 0x7fe964055b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe98000b000 tx=0x7fe980006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.269+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe98409c770 con 0x7fe984097920 2021-10-21T00:06:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe98409c770 con 0x7fe984097920 2021-10-21T00:06:24.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe972ffd700 1 -- 172.21.15.41:0/3263784410 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fe98409c770 con 0x7fe984097920 2021-10-21T00:06:24.447 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:24.447 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:06:24.447 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:06:24.447 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.448 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:06:24.448 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:06:24.448 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.448 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:06:24.449 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.449 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.449 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.449 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.450 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.450 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:06:24.450 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:06:24.451 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.451 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:06:24.451 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.451 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.452 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.452 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.452 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.452 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.453 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:06:24.453 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:06:24.453 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.453 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.454 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.454 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.454 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.454 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.455 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:06:24.455 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:06:24.455 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.456 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.456 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.457 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:06:24.457 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:06:24.457 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.458 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.459 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.459 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.459 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:06:24.460 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:06:24.460 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.460 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.460 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.460 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.461 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.461 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.461 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:06:24.462 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:06:24.462 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.462 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.462 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.462 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.463 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.463 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.463 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:06:24.464 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:06:24.464 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.464 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.464 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.464 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.465 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.465 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:06:24.466 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:06:24.466 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.466 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.466 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.466 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.467 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.467 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.467 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.467 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:06:24.468 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:06:24.468 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.468 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.468 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.469 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.469 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.469 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.469 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:06:24.470 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:06:24.470 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.470 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:06:24.470 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:06:24.471 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:06:24.471 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.471 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.471 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.471 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:06:24.472 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:06:24.472 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.472 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:06:24.472 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:06:24.473 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:06:24.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.473 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.474 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:06:24.474 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:06:24.474 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.474 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:06:24.475 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:06:24.475 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:06:24.475 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.475 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.475 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.476 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:06:24.476 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:06:24.477 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.477 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:06:24.477 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:06:24.477 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:06:24.477 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.478 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.478 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.478 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.478 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:06:24.479 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:06:24.479 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.479 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:06:24.479 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:06:24.479 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.480 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.480 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:24.480 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:24.480 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:06:24.481 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:06:24.481 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:06:24.481 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:06:24.481 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:06:24.481 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:06:24.482 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.482 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:24.482 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:06:24.482 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:06:24.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 msgr2=0x7fe964055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 0x7fe964055b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe98000b000 tx=0x7fe980006df0).stop 2021-10-21T00:06:24.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 msgr2=0x7fe98409ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.441+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 0x7fe98409ca10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe9740018e0 tx=0x7fe974001aa0).stop 2021-10-21T00:06:24.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 shutdown_connections 2021-10-21T00:06:24.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe964053640 0x7fe964055b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9840ac560 0x7fe9840af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe984097920 0x7fe98409ca10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 --2- 172.21.15.41:0/3263784410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9840968b0 0x7fe984065170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 >> 172.21.15.41:0/3263784410 conn(0x7fe9840b45c0 msgr2=0x7fe9841462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 shutdown_connections 2021-10-21T00:06:24.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.445+0000 7fe98bbc8700 1 -- 172.21.15.41:0/3263784410 wait complete. 2021-10-21T00:06:24.487 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:24.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.589+0000 7f5dcb17f700 1 Processor -- start 2021-10-21T00:06:24.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.589+0000 7f5dcb17f700 1 -- start start 2021-10-21T00:06:24.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dcb17f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 0x7f5dc40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dcb17f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 0x7f5dc40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dcb17f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc405fdd0 con 0x7f5dc40b3150 2021-10-21T00:06:24.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dcb17f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc4140400 con 0x7f5dc405f9f0 2021-10-21T00:06:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dcb17f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b27c0 con 0x7f5dc40b0730 2021-10-21T00:06:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dca97e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5dc40b3150 0x7f5dc4142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58138/0 (socket says 172.21.15.41:58138) 2021-10-21T00:06:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dca97e700 1 -- 172.21.15.41:0/264794814 learned_addr learned my addr 172.21.15.41:0/264794814 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dca17d700 1 --2- 172.21.15.41:0/264794814 >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 0x7f5dc40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 --2- 172.21.15.41:0/264794814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 0x7f5dc40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233165545 0 0) 0x7f5dc405fdd0 con 0x7f5dc40b3150 2021-10-21T00:06:24.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dac003260 con 0x7f5dc40b3150 2021-10-21T00:06:24.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186822928 0 0) 0x7f5dac003260 con 0x7f5dc40b3150 2021-10-21T00:06:24.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 -- 172.21.15.41:0/264794814 >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 msgr2=0x7f5dc40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 --2- 172.21.15.41:0/264794814 >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 0x7f5dc40b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 -- 172.21.15.41:0/264794814 >> v1:172.21.15.41:6789/0 conn(0x7f5dc40b3150 legacy=0x7f5dc4142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 -- 172.21.15.41:0/264794814 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40b35a0 con 0x7f5dc40b0730 2021-10-21T00:06:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dca17d700 1 --2- 172.21.15.41:0/264794814 >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 0x7f5dc40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc997c700 1 --2- 172.21.15.41:0/264794814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 0x7f5dc40b2c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5dbc001800 tx=0x7f5db4006df0).ready entity=mon.2 client_cookie=8b42558d32f63c25 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc001660 con 0x7f5dc40b0730 2021-10-21T00:06:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4000e90 con 0x7f5dc40b0730 2021-10-21T00:06:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.593+0000 7f5dc917b700 1 -- 172.21.15.41:0/264794814 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db4012460 con 0x7f5dc40b0730 2021-10-21T00:06:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- 172.21.15.41:0/264794814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 msgr2=0x7f5dc40b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/264794814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 0x7f5dc40b2c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5dbc001800 tx=0x7f5db4006df0).stop 2021-10-21T00:06:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- 172.21.15.41:0/264794814 shutdown_connections 2021-10-21T00:06:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/264794814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc40b0730 0x7f5dc40b2c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/264794814 >> v2:172.21.15.62:3300/0 conn(0x7f5dc405f9f0 0x7f5dc40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- 172.21.15.41:0/264794814 >> 172.21.15.41:0/264794814 conn(0x7f5dc40637b0 msgr2=0x7f5dc4063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- 172.21.15.41:0/264794814 shutdown_connections 2021-10-21T00:06:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- 172.21.15.41:0/264794814 wait complete. 2021-10-21T00:06:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 Processor -- start 2021-10-21T00:06:24.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.597+0000 7f5dcb17f700 1 -- start start 2021-10-21T00:06:24.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc405f9f0 0x7f5dc4143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 0x7f5dc4133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4143850 con 0x7f5dc40b3150 2021-10-21T00:06:24.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4065840 con 0x7f5dc40b0730 2021-10-21T00:06:24.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4065ae0 con 0x7f5dc405f9f0 2021-10-21T00:06:24.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60374/0 (socket says 172.21.15.41:60374) 2021-10-21T00:06:24.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 -- 172.21.15.41:0/2131245613 learned_addr learned my addr 172.21.15.41:0/2131245613 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:24.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca17d700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc405f9f0 0x7f5dc4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dc997c700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 0x7f5dc4133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 -- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc405f9f0 msgr2=0x7f5dc4143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc405f9f0 0x7f5dc4143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 -- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 msgr2=0x7f5dc4133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 0x7f5dc4133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 -- 172.21.15.41:0/2131245613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0009420 con 0x7f5dc40b3150 2021-10-21T00:06:24.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dc997c700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 0x7f5dc4133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:24.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dca97e700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5dbc0018c0 tx=0x7f5dbc001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc007170 con 0x7f5dc40b3150 2021-10-21T00:06:24.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0072d0 con 0x7f5dc40b3150 2021-10-21T00:06:24.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db400b180 con 0x7f5dc40b3150 2021-10-21T00:06:24.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc004710 con 0x7f5dc40b3150 2021-10-21T00:06:24.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc4134060 con 0x7f5dc40b3150 2021-10-21T00:06:24.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4140080 con 0x7f5dc40b3150 2021-10-21T00:06:24.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.601+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5dbc004870 con 0x7f5dc40b3150 2021-10-21T00:06:24.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.605+0000 7f5db37fe700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 0x7f5da4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.605+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5dbc06b0e0 con 0x7f5dc40b3150 2021-10-21T00:06:24.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.605+0000 7f5dca17d700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 0x7f5da4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.605+0000 7f5dca17d700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 0x7f5da4055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f5dc000b000 tx=0x7f5dc00091a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.609+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5dbc042460 con 0x7f5dc40b3150 2021-10-21T00:06:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.733+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dc4057350 con 0x7f5dc40b3150 2021-10-21T00:06:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.737+0000 7f5db37fe700 1 -- 172.21.15.41:0/2131245613 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f5dbc045a80 con 0x7f5dc40b3150 2021-10-21T00:06:24.741 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:24.742 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":46,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:24.114771+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 msgr2=0x7f5da4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 0x7f5da4055b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f5dc000b000 tx=0x7f5dc00091a0).stop 2021-10-21T00:06:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 msgr2=0x7f5dc4133b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5dbc0018c0 tx=0x7f5dbc001d80).stop 2021-10-21T00:06:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 shutdown_connections 2021-10-21T00:06:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5da40536a0 0x7f5da4055b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5dc40b3150 0x7f5dc4133b70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dc40b0730 0x7f5dc4133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 --2- 172.21.15.41:0/2131245613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5dc405f9f0 0x7f5dc4143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 >> 172.21.15.41:0/2131245613 conn(0x7f5dc40637b0 msgr2=0x7f5dc4144d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 shutdown_connections 2021-10-21T00:06:24.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.741+0000 7f5dcb17f700 1 -- 172.21.15.41:0/2131245613 wait complete. 2021-10-21T00:06:24.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:06:24.761 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:06:24.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 Processor -- start 2021-10-21T00:06:24.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 -- start start 2021-10-21T00:06:24.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f404405f9f0 0x7f40440b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40440b0730 0x7f40440b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404405fdd0 con 0x7f40440b3150 2021-10-21T00:06:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4044140400 con 0x7f40440b0730 2021-10-21T00:06:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4049571700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440b27c0 con 0x7f404405f9f0 2021-10-21T00:06:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4048d70700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4048d70700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60382/0 (socket says 172.21.15.41:60382) 2021-10-21T00:06:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f403bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40440b0730 0x7f40440b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4048d70700 1 -- 172.21.15.41:0/3941185039 learned_addr learned my addr 172.21.15.41:0/3941185039 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.869+0000 7f4043fff700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f404405f9f0 0x7f40440b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 -- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f404405f9f0 msgr2=0x7f40440b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f404405f9f0 0x7f40440b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 -- 172.21.15.41:0/3941185039 >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 msgr2=0x7f4044142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:24.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 --2- 172.21.15.41:0/3941185039 >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 -- 172.21.15.41:0/3941185039 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440b35a0 con 0x7f40440b0730 2021-10-21T00:06:24.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4048d70700 1 --2- 172.21.15.41:0/3941185039 >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:24.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f403bfff700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b0730 0x7f40440b2c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f402c002f70 tx=0x7f402c006df0).ready entity=mon.1 client_cookie=a83e18ec68b6f3a1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f40437fe700 1 -- 172.21.15.41:0/3941185039 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f402c00d4a0 con 0x7f40440b0730 2021-10-21T00:06:24.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f40437fe700 1 -- 172.21.15.41:0/3941185039 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c000e90 con 0x7f40440b0730 2021-10-21T00:06:24.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f40437fe700 1 -- 172.21.15.41:0/3941185039 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f402c00d7f0 con 0x7f40440b0730 2021-10-21T00:06:24.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 -- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b0730 msgr2=0x7f40440b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b0730 0x7f40440b2c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f402c002f70 tx=0x7f402c006df0).stop 2021-10-21T00:06:24.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 -- 172.21.15.41:0/3941185039 shutdown_connections 2021-10-21T00:06:24.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 --2- 172.21.15.41:0/3941185039 >> v2:172.21.15.41:3300/0 conn(0x7f40440b3150 0x7f4044142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b0730 0x7f40440b2c60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 --2- 172.21.15.41:0/3941185039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f404405f9f0 0x7f40440b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 -- 172.21.15.41:0/3941185039 >> 172.21.15.41:0/3941185039 conn(0x7f40440637b0 msgr2=0x7f4044063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:24.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 -- 172.21.15.41:0/3941185039 shutdown_connections 2021-10-21T00:06:24.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.873+0000 7f4049571700 1 -- 172.21.15.41:0/3941185039 wait complete. 2021-10-21T00:06:24.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 Processor -- start 2021-10-21T00:06:24.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 -- start start 2021-10-21T00:06:24.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40440b0730 0x7f4044137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b3150 0x7f404413e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440af540 con 0x7f404405f9f0 2021-10-21T00:06:24.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404413ce50 con 0x7f40440b3150 2021-10-21T00:06:24.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4049571700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440af780 con 0x7f40440b0730 2021-10-21T00:06:24.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60384/0 (socket says 172.21.15.41:60384) 2021-10-21T00:06:24.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 -- 172.21.15.41:0/2483727466 learned_addr learned my addr 172.21.15.41:0/2483727466 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:24.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4048d70700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b3150 0x7f404413e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f403bfff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40440b0730 0x7f4044137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 -- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40440b0730 msgr2=0x7f4044137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40440b0730 0x7f4044137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 -- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b3150 msgr2=0x7f404413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:24.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b3150 0x7f404413e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:24.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 -- 172.21.15.41:0/2483727466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c009530 con 0x7f404405f9f0 2021-10-21T00:06:24.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.877+0000 7f4043fff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f403400c000 tx=0x7f4034006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403400be70 con 0x7f404405f9f0 2021-10-21T00:06:24.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340104c0 con 0x7f404405f9f0 2021-10-21T00:06:24.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c00b180 con 0x7f404405f9f0 2021-10-21T00:06:24.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4034010820 con 0x7f404405f9f0 2021-10-21T00:06:24.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4044138100 con 0x7f404405f9f0 2021-10-21T00:06:24.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4044140080 con 0x7f404405f9f0 2021-10-21T00:06:24.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f403401a030 con 0x7f404405f9f0 2021-10-21T00:06:24.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 0x7f4028055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:24.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f403406b2f0 con 0x7f404405f9f0 2021-10-21T00:06:24.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.881+0000 7f403bfff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 0x7f4028055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:24.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.885+0000 7f403bfff700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 0x7f4028055a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f402c01a000 tx=0x7f402c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:24.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:24.893+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40340426e0 con 0x7f404405f9f0 2021-10-21T00:06:25.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.013+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4044057350 con 0x7f404405f9f0 2021-10-21T00:06:25.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4041ffb700 1 -- 172.21.15.41:0/2483727466 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4034045d00 con 0x7f404405f9f0 2021-10-21T00:06:25.023 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:06:25.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 msgr2=0x7f4028055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 0x7f4028055a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f402c01a000 tx=0x7f402c014000).stop 2021-10-21T00:06:25.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 msgr2=0x7f40440af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f403400c000 tx=0x7f4034006d90).stop 2021-10-21T00:06:25.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 shutdown_connections 2021-10-21T00:06:25.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4028053580 0x7f4028055a40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40440b3150 0x7f404413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40440b0730 0x7f4044137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 --2- 172.21.15.41:0/2483727466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f404405f9f0 0x7f40440af050 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 >> 172.21.15.41:0/2483727466 conn(0x7f40440637b0 msgr2=0x7f40440b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 shutdown_connections 2021-10-21T00:06:25.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.017+0000 7f4049571700 1 -- 172.21.15.41:0/2483727466 wait complete. 2021-10-21T00:06:25.035 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:06:25.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.133+0000 7f54a573b700 1 Processor -- start 2021-10-21T00:06:25.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.133+0000 7f54a573b700 1 -- start start 2021-10-21T00:06:25.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a005fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f54a0143ae0 0x7f54a00ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a0060430 con 0x7f54a0143680 2021-10-21T00:06:25.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a0142f40 con 0x7f54a0143ae0 2021-10-21T00:06:25.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01431e0 con 0x7f54a00639e0 2021-10-21T00:06:25.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549e7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f54a0143680 0x7f54a013f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58164/0 (socket says 172.21.15.41:58164) 2021-10-21T00:06:25.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549e7fc700 1 -- 172.21.15.41:0/1480285769 learned_addr learned my addr 172.21.15.41:0/1480285769 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:25.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 --2- 172.21.15.41:0/1480285769 >> v2:172.21.15.62:3300/0 conn(0x7f54a0143ae0 0x7f54a00ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549effd700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549dffb700 1 -- 172.21.15.41:0/1480285769 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024236888 0 0) 0x7f54a0060430 con 0x7f54a0143680 2021-10-21T00:06:25.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549dffb700 1 -- 172.21.15.41:0/1480285769 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5484003260 con 0x7f54a0143680 2021-10-21T00:06:25.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 -- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 msgr2=0x7f54a005fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:25.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a005fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 -- 172.21.15.41:0/1480285769 >> v1:172.21.15.41:6789/0 conn(0x7f54a0143680 legacy=0x7f54a013f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 -- 172.21.15.41:0/1480285769 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a013ffe0 con 0x7f54a0143ae0 2021-10-21T00:06:25.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549f7fe700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a00ae120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5498002f70 tx=0x7f5498006df0).ready entity=mon.1 client_cookie=19d7091f01d3dc1e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549dffb700 1 -- 172.21.15.41:0/1480285769 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f549800d4a0 con 0x7f54a0143ae0 2021-10-21T00:06:25.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549dffb700 1 -- 172.21.15.41:0/1480285769 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498000e90 con 0x7f54a0143ae0 2021-10-21T00:06:25.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f549dffb700 1 -- 172.21.15.41:0/1480285769 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f549800d7f0 con 0x7f54a0143ae0 2021-10-21T00:06:25.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 msgr2=0x7f54a00ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a00ae120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5498002f70 tx=0x7f5498006df0).stop 2021-10-21T00:06:25.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- 172.21.15.41:0/1480285769 shutdown_connections 2021-10-21T00:06:25.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a00ae120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 --2- 172.21.15.41:0/1480285769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a005fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- 172.21.15.41:0/1480285769 >> 172.21.15.41:0/1480285769 conn(0x7f54a0061e00 msgr2=0x7f54a0069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- 172.21.15.41:0/1480285769 shutdown_connections 2021-10-21T00:06:25.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.137+0000 7f54a573b700 1 -- 172.21.15.41:0/1480285769 wait complete. 2021-10-21T00:06:25.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 Processor -- start 2021-10-21T00:06:25.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- start start 2021-10-21T00:06:25.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a0138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00b6740 con 0x7f54a0143680 2021-10-21T00:06:25.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a013ac70 con 0x7f54a0143ae0 2021-10-21T00:06:25.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a013af10 con 0x7f54a00639e0 2021-10-21T00:06:25.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60400/0 (socket says 172.21.15.41:60400) 2021-10-21T00:06:25.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 -- 172.21.15.41:0/1819977411 learned_addr learned my addr 172.21.15.41:0/1819977411 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:25.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549effd700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549f7fe700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a0138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 -- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 msgr2=0x7f54a00b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a00b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 -- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 msgr2=0x7f54a0138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a0138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 -- 172.21.15.41:0/1819977411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549800b180 con 0x7f54a0143680 2021-10-21T00:06:25.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f549e7fc700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f5494001110 tx=0x7f5494007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f549400ce80 con 0x7f54a0143680 2021-10-21T00:06:25.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54940070d0 con 0x7f54a0143680 2021-10-21T00:06:25.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a00b45e0 con 0x7f54a0143680 2021-10-21T00:06:25.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5494007430 con 0x7f54a0143680 2021-10-21T00:06:25.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.141+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a00b4280 con 0x7f54a0143680 2021-10-21T00:06:25.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a013aac0 con 0x7f54a0143680 2021-10-21T00:06:25.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5494010070 con 0x7f54a0143680 2021-10-21T00:06:25.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f548ffff700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 0x7f547c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f549406ab70 con 0x7f54a0143680 2021-10-21T00:06:25.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f549effd700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 0x7f547c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.145+0000 7f549effd700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 0x7f547c055b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f549000b760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.153+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5494041fa0 con 0x7f54a0143680 2021-10-21T00:06:25.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.277+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54a0057350 con 0x7f54a0143680 2021-10-21T00:06:25.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.277+0000 7f548ffff700 1 -- 172.21.15.41:0/1819977411 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54940455c0 con 0x7f54a0143680 2021-10-21T00:06:25.286 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:25.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 msgr2=0x7f547c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 0x7f547c055b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f549000b760).stop 2021-10-21T00:06:25.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 msgr2=0x7f54a00b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f5494001110 tx=0x7f5494007aa0).stop 2021-10-21T00:06:25.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 shutdown_connections 2021-10-21T00:06:25.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f547c0536a0 0x7f547c055b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54a0143ae0 0x7f54a0138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f54a0143680 0x7f54a00b5150 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 --2- 172.21.15.41:0/1819977411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54a00639e0 0x7f54a00b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 >> 172.21.15.41:0/1819977411 conn(0x7f54a0061e00 msgr2=0x7f54a00b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 shutdown_connections 2021-10-21T00:06:25.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.281+0000 7f54a573b700 1 -- 172.21.15.41:0/1819977411 wait complete. 2021-10-21T00:06:25.298 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:06:25.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 Processor -- start 2021-10-21T00:06:25.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- start start 2021-10-21T00:06:25.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f00a40b3460 0x7f00a40631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 0x7f00a4061780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a40ac220 con 0x7f00a4061c70 2021-10-21T00:06:25.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a40b3840 con 0x7f00a40b3460 2021-10-21T00:06:25.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40ac450 con 0x7f00a40b2a20 2021-10-21T00:06:25.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f00a40b3460 0x7f00a40631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f00a40b3460 0x7f00a40631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60406/0 (socket says 172.21.15.41:60406) 2021-10-21T00:06:25.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 -- 172.21.15.41:0/3402853195 learned_addr learned my addr 172.21.15.41:0/3402853195 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:25.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a1d9b700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 0x7f00a4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 -- 172.21.15.41:0/3402853195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 msgr2=0x7f00a4061780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:25.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 0x7f00a4061780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 -- 172.21.15.41:0/3402853195 >> v1:172.21.15.62:6789/0 conn(0x7f00a4061c70 legacy=0x7f00a4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 -- 172.21.15.41:0/3402853195 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40ac6f0 con 0x7f00a40b3460 2021-10-21T00:06:25.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a1d9b700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 0x7f00a4061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:25.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a259c700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a40631d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f00940032f0 tx=0x7f0094009290).ready entity=mon.0 client_cookie=6f198810ae038079 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a159a700 1 -- 172.21.15.41:0/3402853195 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009400b8a0 con 0x7f00a40b3460 2021-10-21T00:06:25.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a159a700 1 -- 172.21.15.41:0/3402853195 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009400ba00 con 0x7f00a40b3460 2021-10-21T00:06:25.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a159a700 1 -- 172.21.15.41:0/3402853195 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009400bb70 con 0x7f00a40b3460 2021-10-21T00:06:25.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- 172.21.15.41:0/3402853195 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 msgr2=0x7f00a40631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a40631d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f00940032f0 tx=0x7f0094009290).stop 2021-10-21T00:06:25.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- 172.21.15.41:0/3402853195 shutdown_connections 2021-10-21T00:06:25.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a40b2a20 0x7f00a4061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3402853195 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a40631d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- 172.21.15.41:0/3402853195 >> 172.21.15.41:0/3402853195 conn(0x7f00a40b45c0 msgr2=0x7f00a405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- 172.21.15.41:0/3402853195 shutdown_connections 2021-10-21T00:06:25.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.393+0000 7f00a8baa700 1 -- 172.21.15.41:0/3402853195 wait complete. 2021-10-21T00:06:25.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.397+0000 7f00a8baa700 1 Processor -- start 2021-10-21T00:06:25.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.397+0000 7f00a8baa700 1 -- start start 2021-10-21T00:06:25.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.397+0000 7f00a8baa700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a4061c70 0x7f00a40948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 0x7f00a409a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4152350 con 0x7f00a40b3460 2021-10-21T00:06:25.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4095560 con 0x7f00a40b2a20 2021-10-21T00:06:25.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a409bb80 con 0x7f00a4061c70 2021-10-21T00:06:25.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 0x7f00a409a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a4061c70 0x7f00a40948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60416/0 (socket says 172.21.15.41:60416) 2021-10-21T00:06:25.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 -- 172.21.15.41:0/3700349196 learned_addr learned my addr 172.21.15.41:0/3700349196 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:25.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 -- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a4061c70 msgr2=0x7f00a40948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a4061c70 0x7f00a40948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 -- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 msgr2=0x7f00a409a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 0x7f00a409a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 -- 172.21.15.41:0/3700349196 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009800b180 con 0x7f00a40b3460 2021-10-21T00:06:25.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a1d9b700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 0x7f00a409a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:25.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a2d9d700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f00a40640a0 tx=0x7f009c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009c012400 con 0x7f00a40b3460 2021-10-21T00:06:25.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c012560 con 0x7f00a40b3460 2021-10-21T00:06:25.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094009530 con 0x7f00a40b3460 2021-10-21T00:06:25.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009c0128c0 con 0x7f00a40b3460 2021-10-21T00:06:25.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a409b5e0 con 0x7f00a40b3460 2021-10-21T00:06:25.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.401+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a409cec0 con 0x7f00a40b3460 2021-10-21T00:06:25.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.405+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f009c010070 con 0x7f00a40b3460 2021-10-21T00:06:25.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.405+0000 7f00937fe700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 0x7f0080055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.405+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f009c06a580 con 0x7f00a40b3460 2021-10-21T00:06:25.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.405+0000 7f00a259c700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 0x7f0080055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.405+0000 7f00a259c700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 0x7f0080055bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f009401b000 tx=0x7f0094016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.409+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f009c041a10 con 0x7f00a40b3460 2021-10-21T00:06:25.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.537+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f00a40ac990 con 0x7f00a40b3460 2021-10-21T00:06:25.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00937fe700 1 -- 172.21.15.41:0/3700349196 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+143 (secure 0 0 0) 0x7f009c045030 con 0x7f00a40b3460 2021-10-21T00:06:25.545 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:25.546 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:06:25.546 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:25.546 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:06:25.546 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:06:25.547 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:25.547 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:06:25.547 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:06:25.547 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:06:25.548 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:25.548 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:06:25.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 msgr2=0x7f0080055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 0x7f0080055bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f009401b000 tx=0x7f0094016000).stop 2021-10-21T00:06:25.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 msgr2=0x7f00a4152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f00a40640a0 tx=0x7f009c007bc0).stop 2021-10-21T00:06:25.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 shutdown_connections 2021-10-21T00:06:25.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00800536f0 0x7f0080055bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00a40b3460 0x7f00a4152a20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00a40b2a20 0x7f00a409a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 --2- 172.21.15.41:0/3700349196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00a4061c70 0x7f00a40948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 >> 172.21.15.41:0/3700349196 conn(0x7f00a40b45c0 msgr2=0x7f00a41498d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 shutdown_connections 2021-10-21T00:06:25.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.541+0000 7f00a8baa700 1 -- 172.21.15.41:0/3700349196 wait complete. 2021-10-21T00:06:25.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:06:25.558 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:06:25.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 Processor -- start 2021-10-21T00:06:25.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 -- start start 2021-10-21T00:06:25.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec180b1350 0x7fec180b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 0x7fec18146320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec180aff30 con 0x7fec180b1b40 2021-10-21T00:06:25.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec180aca60 con 0x7fec180b1350 2021-10-21T00:06:25.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1ec66700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec180b0f60 con 0x7fec18145e90 2021-10-21T00:06:25.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec180b1350 0x7fec180b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1e465700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 0x7fec18146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fec180b1350 0x7fec180b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60422/0 (socket says 172.21.15.41:60422) 2021-10-21T00:06:25.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 -- 172.21.15.41:0/3334084211 learned_addr learned my addr 172.21.15.41:0/3334084211 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:25.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 -- 172.21.15.41:0/3334084211 >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 msgr2=0x7fec18146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:25.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 --2- 172.21.15.41:0/3334084211 >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 0x7fec18146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 -- 172.21.15.41:0/3334084211 >> v1:172.21.15.62:6789/0 conn(0x7fec180b1b40 legacy=0x7fec180b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1cc62700 1 -- 172.21.15.41:0/3334084211 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865196942 0 0) 0x7fec180aff30 con 0x7fec180b1b40 2021-10-21T00:06:25.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 -- 172.21.15.41:0/3334084211 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180b1f20 con 0x7fec180b1350 2021-10-21T00:06:25.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1e465700 1 --2- 172.21.15.41:0/3334084211 >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 0x7fec18146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:25.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1d463700 1 --2- 172.21.15.41:0/3334084211 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec180b0a70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fec0c002f70 tx=0x7fec0c006eb0).ready entity=mon.0 client_cookie=a37501379f747566 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1cc62700 1 -- 172.21.15.41:0/3334084211 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0c00d5c0 con 0x7fec180b1350 2021-10-21T00:06:25.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1cc62700 1 -- 172.21.15.41:0/3334084211 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c000e90 con 0x7fec180b1350 2021-10-21T00:06:25.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.661+0000 7fec1cc62700 1 -- 172.21.15.41:0/3334084211 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0c00d910 con 0x7fec180b1350 2021-10-21T00:06:25.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- 172.21.15.41:0/3334084211 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 msgr2=0x7fec180b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- 172.21.15.41:0/3334084211 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec180b0a70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fec0c002f70 tx=0x7fec0c006eb0).stop 2021-10-21T00:06:25.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- 172.21.15.41:0/3334084211 shutdown_connections 2021-10-21T00:06:25.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- 172.21.15.41:0/3334084211 >> v2:172.21.15.62:3300/0 conn(0x7fec18145e90 0x7fec18146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- 172.21.15.41:0/3334084211 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec180b0a70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- 172.21.15.41:0/3334084211 >> 172.21.15.41:0/3334084211 conn(0x7fec180627b0 msgr2=0x7fec18062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:25.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- 172.21.15.41:0/3334084211 shutdown_connections 2021-10-21T00:06:25.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- 172.21.15.41:0/3334084211 wait complete. 2021-10-21T00:06:25.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 Processor -- start 2021-10-21T00:06:25.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- start start 2021-10-21T00:06:25.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 0x7fec18144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec18145e90 0x7fec18111410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1814b2a0 con 0x7fec180b1350 2021-10-21T00:06:25.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1814a7b0 con 0x7fec18145e90 2021-10-21T00:06:25.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1ec66700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1814a920 con 0x7fec180b1b40 2021-10-21T00:06:25.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60426/0 (socket says 172.21.15.41:60426) 2021-10-21T00:06:25.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 -- 172.21.15.41:0/2601058362 learned_addr learned my addr 172.21.15.41:0/2601058362 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:25.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1e465700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec18145e90 0x7fec18111410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1d463700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 0x7fec18144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 -- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 msgr2=0x7fec18144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 0x7fec18144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 -- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec18145e90 msgr2=0x7fec18111410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:25.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec18145e90 0x7fec18111410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:25.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 -- 172.21.15.41:0/2601058362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10009470 con 0x7fec180b1350 2021-10-21T00:06:25.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1d463700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 0x7fec18144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:06:25.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.665+0000 7fec1dc64700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fec08000ed0 tx=0x7fec08007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800ce20 con 0x7fec180b1350 2021-10-21T00:06:25.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c00b1e0 con 0x7fec180b1350 2021-10-21T00:06:25.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800f470 con 0x7fec180b1350 2021-10-21T00:06:25.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0800f7d0 con 0x7fec180b1350 2021-10-21T00:06:25.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1814c4d0 con 0x7fec180b1350 2021-10-21T00:06:25.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec08019030 con 0x7fec180b1350 2021-10-21T00:06:25.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:25.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1814a5b0 con 0x7fec180b1350 2021-10-21T00:06:25.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fec0806aac0 con 0x7fec180b1350 2021-10-21T00:06:25.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec1d463700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:25.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.669+0000 7fec1d463700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 0x7febf8055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fec0c017000 tx=0x7fec0c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:25.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.673+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec08021080 con 0x7fec180b1350 2021-10-21T00:06:25.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:25.801+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fec18057350 con 0x7fec180b1350 2021-10-21T00:06:26.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.777+0000 7fec16ffd700 1 -- 172.21.15.41:0/2601058362 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v47) v1 ==== 133+0+0 (secure 0 0 0) 0x7fec080240a0 con 0x7fec180b1350 2021-10-21T00:06:26.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 msgr2=0x7febf8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 0x7febf8055ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fec0c017000 tx=0x7fec0c015000).stop 2021-10-21T00:06:26.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 msgr2=0x7fec181594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fec08000ed0 tx=0x7fec08007ac0).stop 2021-10-21T00:06:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 shutdown_connections 2021-10-21T00:06:26.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febf8053610 0x7febf8055ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec18145e90 0x7fec18111410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec180b1b40 0x7fec18144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 --2- 172.21.15.41:0/2601058362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec180b1350 0x7fec181594d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 >> 172.21.15.41:0/2601058362 conn(0x7fec180627b0 msgr2=0x7fec180b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 shutdown_connections 2021-10-21T00:06:26.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.781+0000 7fec1ec66700 1 -- 172.21.15.41:0/2601058362 wait complete. 2021-10-21T00:06:26.792 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:06:26.802 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:06:26.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.905+0000 7f8418fc2700 1 Processor -- start 2021-10-21T00:06:26.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.905+0000 7f8418fc2700 1 -- start start 2021-10-21T00:06:26.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f84140ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84140b2550 con 0x7f84140604f0 2021-10-21T00:06:26.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84140b1350 con 0x7f84140b2170 2021-10-21T00:06:26.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841405f940 con 0x7f84140b0d20 2021-10-21T00:06:26.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f84140604f0 0x7f8414141d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58206/0 (socket says 172.21.15.41:58206) 2021-10-21T00:06:26.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 -- 172.21.15.41:0/1354957935 learned_addr learned my addr 172.21.15.41:0/1354957935 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:26.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8413fff700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f84140ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168398032 0 0) 0x7f84140b2550 con 0x7f84140604f0 2021-10-21T00:06:26.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8400003260 con 0x7f84140604f0 2021-10-21T00:06:26.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1092015803 0 0) 0x7f8400003260 con 0x7f84140604f0 2021-10-21T00:06:26.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 msgr2=0x7f84140ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:26.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f84140ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 >> v1:172.21.15.62:6789/0 conn(0x7f84140b2170 legacy=0x7f841405fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414142460 con 0x7f84140604f0 2021-10-21T00:06:26.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f84040019e0 con 0x7f84140604f0 2021-10-21T00:06:26.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 >> v1:172.21.15.41:6789/0 conn(0x7f84140604f0 legacy=0x7f8414141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400003780 0x7f8400003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8400004500 0x7f8400004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f8400004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841405f940 con 0x7f8400003780 2021-10-21T00:06:26.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840000b780 con 0x7f8400004500 2021-10-21T00:06:26.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840000b940 con 0x7f84140b0d20 2021-10-21T00:06:26.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84137fe700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400003780 0x7f8400003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8400004500 0x7f8400004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8413fff700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f8400004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 -- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 msgr2=0x7f8400004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:26.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140b0d20 0x7f8400004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 -- 172.21.15.41:0/1354957935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400003780 msgr2=0x7f8400003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:26.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400003780 0x7f8400003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 -- 172.21.15.41:0/1354957935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400003260 con 0x7f8400004500 2021-10-21T00:06:26.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8412ffd700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8400004500 0x7f8400004980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f84040016f0 tx=0x7f8404002190).ready entity=mon.1 client_cookie=b02789b0a6e5e066 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:26.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840400cd10 con 0x7f8400004500 2021-10-21T00:06:26.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840400ce70 con 0x7f8400004500 2021-10-21T00:06:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f84127fc700 1 -- 172.21.15.41:0/1354957935 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8404005b80 con 0x7f8400004500 2021-10-21T00:06:26.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8400004500 msgr2=0x7f8400004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 --2- 172.21.15.41:0/1354957935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8400004500 0x7f8400004980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f84040016f0 tx=0x7f8404002190).stop 2021-10-21T00:06:26.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8413fff700 1 -- 172.21.15.41:0/1354957935 reap_dead start 2021-10-21T00:06:26.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- 172.21.15.41:0/1354957935 shutdown_connections 2021-10-21T00:06:26.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.909+0000 7f8418fc2700 1 -- 172.21.15.41:0/1354957935 >> 172.21.15.41:0/1354957935 conn(0x7f84140b5700 msgr2=0x7f84140b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:26.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- 172.21.15.41:0/1354957935 shutdown_connections 2021-10-21T00:06:26.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- 172.21.15.41:0/1354957935 wait complete. 2021-10-21T00:06:26.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 Processor -- start 2021-10-21T00:06:26.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- start start 2021-10-21T00:06:26.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 0x7f8414098290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8414141bc0 0x7f8414098780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84140ae320 con 0x7f8400004500 2021-10-21T00:06:26.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84140acff0 con 0x7f8414141bc0 2021-10-21T00:06:26.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8418fc2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84140ad290 con 0x7f84140ac0c0 2021-10-21T00:06:26.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60448/0 (socket says 172.21.15.41:60448) 2021-10-21T00:06:26.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 -- 172.21.15.41:0/3800135371 learned_addr learned my addr 172.21.15.41:0/3800135371 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:26.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8413fff700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8414141bc0 0x7f8414098780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8412ffd700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 0x7f8414098290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 -- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 msgr2=0x7f8414098290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 0x7f8414098290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 -- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8414141bc0 msgr2=0x7f8414098780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:26.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8414141bc0 0x7f8414098780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:26.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 -- 172.21.15.41:0/3800135371 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140adfe0 con 0x7f8400004500 2021-10-21T00:06:26.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f8412ffd700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 0x7f8414098290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:26.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.913+0000 7f84137fe700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8408000f50 tx=0x7f8408007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:26.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408011660 con 0x7f8400004500 2021-10-21T00:06:26.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080117c0 con 0x7f8400004500 2021-10-21T00:06:26.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841409ac30 con 0x7f8400004500 2021-10-21T00:06:26.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408011b20 con 0x7f8400004500 2021-10-21T00:06:26.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8414098e10 con 0x7f8400004500 2021-10-21T00:06:26.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841409a990 con 0x7f8400004500 2021-10-21T00:06:26.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f840801a030 con 0x7f8400004500 2021-10-21T00:06:26.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 0x7f83f4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:26.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.917+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f840806b1e0 con 0x7f8400004500 2021-10-21T00:06:26.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.921+0000 7f8412ffd700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 0x7f83f4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:26.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.921+0000 7f8412ffd700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 0x7f83f4055b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f8404019000 tx=0x7f8404015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:26.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:26.925+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f841409a990 con 0x7f8400004500 2021-10-21T00:06:27.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.057+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f841409a990 con 0x7f8400004500 2021-10-21T00:06:27.773 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:27.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:27.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:27.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:27.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:27.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.789+0000 7f8410ff9700 1 -- 172.21.15.41:0/3800135371 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v48) v1 ==== 125+0+0 (secure 0 0 0) 0x7f841409a990 con 0x7f8400004500 2021-10-21T00:06:27.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 msgr2=0x7f83f4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:27.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 0x7f83f4055b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f8404019000 tx=0x7f8404015000).stop 2021-10-21T00:06:27.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 msgr2=0x7f84141475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:27.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8408000f50 tx=0x7f8408007a00).stop 2021-10-21T00:06:27.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 shutdown_connections 2021-10-21T00:06:27.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83f4053640 0x7f83f4055b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:27.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8414141bc0 0x7f8414098780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:27.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84140ac0c0 0x7f8414098290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:27.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 --2- 172.21.15.41:0/3800135371 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8400004500 0x7f84141475e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:27.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 >> 172.21.15.41:0/3800135371 conn(0x7f84140b5700 msgr2=0x7f84140aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:27.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 shutdown_connections 2021-10-21T00:06:27.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.793+0000 7f8418fc2700 1 -- 172.21.15.41:0/3800135371 wait complete. 2021-10-21T00:06:27.802 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:06:27.812 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:06:27.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 Processor -- start 2021-10-21T00:06:27.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 -- start start 2021-10-21T00:06:27.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4254143a40 0x7f42540b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 0x7f42541419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540ba050 con 0x7f42540b9c70 2021-10-21T00:06:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4254146360 con 0x7f4254143a40 2021-10-21T00:06:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.981+0000 7f4259934700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4254142bf0 con 0x7f42540b0660 2021-10-21T00:06:27.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4254143a40 0x7f42540b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:27.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4254143a40 0x7f42540b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60458/0 (socket says 172.21.15.41:60458) 2021-10-21T00:06:27.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 -- 172.21.15.41:0/2484120836 learned_addr learned my addr 172.21.15.41:0/2484120836 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42537fe700 1 --2- 172.21.15.41:0/2484120836 >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 0x7f42541419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:27.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 -- 172.21.15.41:0/2484120836 >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 msgr2=0x7f42541419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:27.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 --2- 172.21.15.41:0/2484120836 >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 0x7f42541419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:27.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 -- 172.21.15.41:0/2484120836 >> v1:172.21.15.62:6789/0 conn(0x7f42540b9c70 legacy=0x7f4254143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:27.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 -- 172.21.15.41:0/2484120836 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254142e90 con 0x7f4254143a40 2021-10-21T00:06:27.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42537fe700 1 --2- 172.21.15.41:0/2484120836 >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 0x7f42541419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f42527fc700 1 --2- 172.21.15.41:0/2484120836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4254143a40 0x7f42540b3bc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f42540b5640 tx=0x7f423c006eb0).ready entity=mon.0 client_cookie=1ea4cd90b0d50000 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4251ffb700 1 -- 172.21.15.41:0/2484120836 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c00d610 con 0x7f4254143a40 2021-10-21T00:06:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4251ffb700 1 -- 172.21.15.41:0/2484120836 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c000e90 con 0x7f4254143a40 2021-10-21T00:06:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4251ffb700 1 -- 172.21.15.41:0/2484120836 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c00d9a0 con 0x7f4254143a40 2021-10-21T00:06:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 -- 172.21.15.41:0/2484120836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4254143a40 msgr2=0x7f42540b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 --2- 172.21.15.41:0/2484120836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4254143a40 0x7f42540b3bc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f42540b5640 tx=0x7f423c006eb0).stop 2021-10-21T00:06:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 -- 172.21.15.41:0/2484120836 shutdown_connections 2021-10-21T00:06:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 --2- 172.21.15.41:0/2484120836 >> v2:172.21.15.62:3300/0 conn(0x7f42540b0660 0x7f42541419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 --2- 172.21.15.41:0/2484120836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4254143a40 0x7f42540b3bc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 -- 172.21.15.41:0/2484120836 >> 172.21.15.41:0/2484120836 conn(0x7f4254062f00 msgr2=0x7f42540b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 -- 172.21.15.41:0/2484120836 shutdown_connections 2021-10-21T00:06:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.985+0000 7f4259934700 1 -- 172.21.15.41:0/2484120836 wait complete. 2021-10-21T00:06:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 Processor -- start 2021-10-21T00:06:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 -- start start 2021-10-21T00:06:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 0x7f42540b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4254143a40 0x7f42540ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540ace50 con 0x7f42540b9c70 2021-10-21T00:06:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540ad0f0 con 0x7f4254143a40 2021-10-21T00:06:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.989+0000 7f4259934700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254113360 con 0x7f42540b0660 2021-10-21T00:06:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 0x7f42540b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4254143a40 0x7f42540ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4252ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50726/0 (socket says 172.21.15.41:50726) 2021-10-21T00:06:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4252ffd700 1 -- 172.21.15.41:0/1266825161 learned_addr learned my addr 172.21.15.41:0/1266825161 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 -- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 msgr2=0x7f42540ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 -- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4254143a40 msgr2=0x7f42540ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4254143a40 0x7f42540ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 -- 172.21.15.41:0/1266825161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009470 con 0x7f42540b9c70 2021-10-21T00:06:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4252ffd700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:28.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f42527fc700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 0x7f42540b75c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f42540b5640 tx=0x7f423c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c011860 con 0x7f42540b9c70 2021-10-21T00:06:28.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0119c0 con 0x7f42540b9c70 2021-10-21T00:06:28.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c00b1e0 con 0x7f42540b9c70 2021-10-21T00:06:28.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423c011d20 con 0x7f42540b9c70 2021-10-21T00:06:28.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42541559e0 con 0x7f42540b9c70 2021-10-21T00:06:28.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.993+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4254146050 con 0x7f42540b9c70 2021-10-21T00:06:28.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.997+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f423c025030 con 0x7f42540b9c70 2021-10-21T00:06:28.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.997+0000 7f424bfff700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 0x7f4238055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.997+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f423c06ca70 con 0x7f42540b9c70 2021-10-21T00:06:28.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.997+0000 7f4252ffd700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 0x7f4238055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:27.997+0000 7f4252ffd700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 0x7f4238055ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f424400d000 tx=0x7f4244009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.005+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f423c043c40 con 0x7f42540b9c70 2021-10-21T00:06:28.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.173+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4254057350 con 0x7f42540b9c70 2021-10-21T00:06:28.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.181+0000 7f424bfff700 1 -- 172.21.15.41:0/1266825161 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7f423c0230d0 con 0x7f42540b9c70 2021-10-21T00:06:28.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 msgr2=0x7f4238055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 0x7f4238055ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f424400d000 tx=0x7f4244009040).stop 2021-10-21T00:06:28.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 msgr2=0x7f42540b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 0x7f42540b75c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f42540b5640 tx=0x7f423c015000).stop 2021-10-21T00:06:28.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 shutdown_connections 2021-10-21T00:06:28.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4238053610 0x7f4238055ad0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4254143a40 0x7f42540ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f42540b9c70 0x7f42540b75c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 --2- 172.21.15.41:0/1266825161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42540b0660 0x7f42540ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 >> 172.21.15.41:0/1266825161 conn(0x7f4254062f00 msgr2=0x7f42540b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 shutdown_connections 2021-10-21T00:06:28.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.189+0000 7f4259934700 1 -- 172.21.15.41:0/1266825161 wait complete. 2021-10-21T00:06:28.199 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 9 and data pool 10 2021-10-21T00:06:28.210 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:28.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 Processor -- start 2021-10-21T00:06:28.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 -- start start 2021-10-21T00:06:28.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff5a80b2170 0x7ff5a80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5a8067a80 0x7ff5a8149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a80b0b50 con 0x7ff5a80af620 2021-10-21T00:06:28.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a80b2550 con 0x7ff5a80b2170 2021-10-21T00:06:28.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5acc4b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a80b0d90 con 0x7ff5a8067a80 2021-10-21T00:06:28.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5a77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff5a80b2170 0x7ff5a80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5a6ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff5a80af620 0x7ff5a80ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58250/0 (socket says 172.21.15.41:58250) 2021-10-21T00:06:28.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5a6ffd700 1 -- 172.21.15.41:0/3057360546 learned_addr learned my addr 172.21.15.41:0/3057360546 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:28.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.297+0000 7ff5a7fff700 1 --2- 172.21.15.41:0/3057360546 >> v2:172.21.15.62:3300/0 conn(0x7ff5a8067a80 0x7ff5a8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a77fe700 1 -- 172.21.15.41:0/3057360546 >> v2:172.21.15.62:3300/0 conn(0x7ff5a8067a80 msgr2=0x7ff5a8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:28.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a77fe700 1 --2- 172.21.15.41:0/3057360546 >> v2:172.21.15.62:3300/0 conn(0x7ff5a8067a80 0x7ff5a8149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a77fe700 1 -- 172.21.15.41:0/3057360546 >> v1:172.21.15.41:6789/0 conn(0x7ff5a80af620 legacy=0x7ff5a80ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a77fe700 1 -- 172.21.15.41:0/3057360546 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80b1030 con 0x7ff5a80b2170 2021-10-21T00:06:28.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a77fe700 1 --2- 172.21.15.41:0/3057360546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a80b2170 0x7ff5a80ab170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff5a80aafa0 tx=0x7ff5a00091d0).ready entity=mon.0 client_cookie=b0050d7a775e56a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a67fc700 1 -- 172.21.15.41:0/3057360546 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a000b680 con 0x7ff5a80b2170 2021-10-21T00:06:28.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a67fc700 1 -- 172.21.15.41:0/3057360546 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000b7e0 con 0x7ff5a80b2170 2021-10-21T00:06:28.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5a67fc700 1 -- 172.21.15.41:0/3057360546 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a000b950 con 0x7ff5a80b2170 2021-10-21T00:06:28.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- 172.21.15.41:0/3057360546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a80b2170 msgr2=0x7ff5a80ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/3057360546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a80b2170 0x7ff5a80ab170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff5a80aafa0 tx=0x7ff5a00091d0).stop 2021-10-21T00:06:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- 172.21.15.41:0/3057360546 shutdown_connections 2021-10-21T00:06:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/3057360546 >> v2:172.21.15.62:3300/0 conn(0x7ff5a8067a80 0x7ff5a8149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/3057360546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a80b2170 0x7ff5a80ab170 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- 172.21.15.41:0/3057360546 >> 172.21.15.41:0/3057360546 conn(0x7ff5a80b5700 msgr2=0x7ff5a80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- 172.21.15.41:0/3057360546 shutdown_connections 2021-10-21T00:06:28.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- 172.21.15.41:0/3057360546 wait complete. 2021-10-21T00:06:28.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 Processor -- start 2021-10-21T00:06:28.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.301+0000 7ff5acc4b700 1 -- start start 2021-10-21T00:06:28.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a80af620 0x7ff5a8147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 0x7ff5a81484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ad6a0 con 0x7ff5a8067a80 2021-10-21T00:06:28.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ad400 con 0x7ff5a80af620 2021-10-21T00:06:28.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ac160 con 0x7ff5a80b2170 2021-10-21T00:06:28.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60484/0 (socket says 172.21.15.41:60484) 2021-10-21T00:06:28.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 -- 172.21.15.41:0/2439564312 learned_addr learned my addr 172.21.15.41:0/2439564312 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:28.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a6ffd700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a80af620 0x7ff5a8147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a7fff700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 0x7ff5a81484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 -- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 msgr2=0x7ff5a81484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 0x7ff5a81484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 -- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a80af620 msgr2=0x7ff5a8147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a80af620 0x7ff5a8147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 -- 172.21.15.41:0/2439564312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009470 con 0x7ff5a8067a80 2021-10-21T00:06:28.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a7fff700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 0x7ff5a81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:06:28.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a77fe700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff5a80aafa0 tx=0x7ff5a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a0011e90 con 0x7ff5a8067a80 2021-10-21T00:06:28.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0021440 con 0x7ff5a8067a80 2021-10-21T00:06:28.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a80ac600 con 0x7ff5a8067a80 2021-10-21T00:06:28.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5a00217a0 con 0x7ff5a8067a80 2021-10-21T00:06:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.305+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a80add80 con 0x7ff5a8067a80 2021-10-21T00:06:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80b12d0 con 0x7ff5a8067a80 2021-10-21T00:06:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff5a000f070 con 0x7ff5a8067a80 2021-10-21T00:06:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5a4ff9700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 0x7ff588055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff5a006cd90 con 0x7ff5a8067a80 2021-10-21T00:06:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5a6ffd700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 0x7ff588055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.309+0000 7ff5a6ffd700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 0x7ff588055b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff59c00b000 tx=0x7ff59c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.317+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5a0043ef0 con 0x7ff5a8067a80 2021-10-21T00:06:28.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.441+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a8057350 con 0x7ff5a8067a80 2021-10-21T00:06:28.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5a4ff9700 1 -- 172.21.15.41:0/2439564312 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16053 (secure 0 0 0) 0x7ff5a0015070 con 0x7ff5a8067a80 2021-10-21T00:06:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:28.450 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":49,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:28.177037+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:06:25.860491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-21T00:06:27.113771+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 msgr2=0x7ff588055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 0x7ff588055b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7ff59c00b000 tx=0x7ff59c009040).stop 2021-10-21T00:06:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 msgr2=0x7ff5a8144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff5a80aafa0 tx=0x7ff5a0016000).stop 2021-10-21T00:06:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 shutdown_connections 2021-10-21T00:06:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff5880536a0 0x7ff588055b60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5a80b2170 0x7ff5a81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5a80af620 0x7ff5a8147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 --2- 172.21.15.41:0/2439564312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff5a8067a80 0x7ff5a8144be0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 >> 172.21.15.41:0/2439564312 conn(0x7ff5a80b5700 msgr2=0x7ff5a805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 shutdown_connections 2021-10-21T00:06:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.445+0000 7ff5acc4b700 1 -- 172.21.15.41:0/2439564312 wait complete. 2021-10-21T00:06:28.469 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:28.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 Processor -- start 2021-10-21T00:06:28.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 -- start start 2021-10-21T00:06:28.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b4380 0x7f96e805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96e8140890 0x7f96e8140d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80b4760 con 0x7f96e80b1830 2021-10-21T00:06:28.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80ad4c0 con 0x7f96e8140890 2021-10-21T00:06:28.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80ad760 con 0x7f96e80b4380 2021-10-21T00:06:28.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96e8140890 0x7f96e8140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e6ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b4380 0x7f96e805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e67fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f96e80b1830 0x7f96e805fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38086/0 (socket says 172.21.15.41:38086) 2021-10-21T00:06:28.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.569+0000 7f96e67fc700 1 -- 172.21.15.41:0/2438184466 learned_addr learned my addr 172.21.15.41:0/2438184466 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:28.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e77fe700 1 -- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b4380 msgr2=0x7f96e805f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e77fe700 1 --2- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b4380 0x7f96e805f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e77fe700 1 -- 172.21.15.41:0/2438184466 >> v1:172.21.15.62:6789/0 conn(0x7f96e80b1830 legacy=0x7f96e805fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e77fe700 1 -- 172.21.15.41:0/2438184466 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80ada00 con 0x7f96e8140890 2021-10-21T00:06:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e77fe700 1 --2- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e8140890 0x7f96e8140d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f96e00032f0 tx=0x7f96e00091d0).ready entity=mon.1 client_cookie=6b0d2fbdb13f7b54 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e5ffb700 1 -- 172.21.15.41:0/2438184466 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e000b6c0 con 0x7f96e8140890 2021-10-21T00:06:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e5ffb700 1 -- 172.21.15.41:0/2438184466 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000b820 con 0x7f96e8140890 2021-10-21T00:06:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e5ffb700 1 -- 172.21.15.41:0/2438184466 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e000b990 con 0x7f96e8140890 2021-10-21T00:06:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e8140890 msgr2=0x7f96e8140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 --2- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e8140890 0x7f96e8140d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f96e00032f0 tx=0x7f96e00091d0).stop 2021-10-21T00:06:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- 172.21.15.41:0/2438184466 shutdown_connections 2021-10-21T00:06:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 --2- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e8140890 0x7f96e8140d20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 --2- 172.21.15.41:0/2438184466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b4380 0x7f96e805f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- 172.21.15.41:0/2438184466 >> 172.21.15.41:0/2438184466 conn(0x7f96e80b7910 msgr2=0x7f96e80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- 172.21.15.41:0/2438184466 shutdown_connections 2021-10-21T00:06:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- 172.21.15.41:0/2438184466 wait complete. 2021-10-21T00:06:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 Processor -- start 2021-10-21T00:06:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.573+0000 7f96e7fff700 1 -- start start 2021-10-21T00:06:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b1830 0x7f96e80b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 0x7f96e8153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81433e0 con 0x7f96e8140890 2021-10-21T00:06:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e809b3a0 con 0x7f96e80b4380 2021-10-21T00:06:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e813b360 con 0x7f96e80b1830 2021-10-21T00:06:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60502/0 (socket says 172.21.15.41:60502) 2021-10-21T00:06:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 0x7f96e8153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 -- 172.21.15.41:0/3106983249 learned_addr learned my addr 172.21.15.41:0/3106983249 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e6ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b1830 0x7f96e80b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 -- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b1830 msgr2=0x7f96e80b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b1830 0x7f96e80b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 -- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 msgr2=0x7f96e8153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 0x7f96e8153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 -- 172.21.15.41:0/3106983249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009470 con 0x7f96e8140890 2021-10-21T00:06:28.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e67fc700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 0x7f96e8153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:28.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e77fe700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f96e00032f0 tx=0x7f96e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e000b990 con 0x7f96e8140890 2021-10-21T00:06:28.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e0021630 con 0x7f96e8140890 2021-10-21T00:06:28.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8144700 con 0x7f96e8140890 2021-10-21T00:06:28.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e000b6c0 con 0x7f96e8140890 2021-10-21T00:06:28.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e8153e30 con 0x7f96e8140890 2021-10-21T00:06:28.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.577+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8057350 con 0x7f96e8140890 2021-10-21T00:06:28.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.581+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f96e0027020 con 0x7f96e8140890 2021-10-21T00:06:28.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.581+0000 7f96dffff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 0x7f96c00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.581+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96e006cd30 con 0x7f96e8140890 2021-10-21T00:06:28.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.581+0000 7f96e6ffd700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 0x7f96c00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.581+0000 7f96e6ffd700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 0x7f96c00559b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f96d800b000 tx=0x7f96d8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.585+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96e0043d80 con 0x7f96e8140890 2021-10-21T00:06:28.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.713+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e805cec0 con 0x7f96e8140890 2021-10-21T00:06:28.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96dffff700 1 -- 172.21.15.41:0/3106983249 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f96e0015020 con 0x7f96e8140890 2021-10-21T00:06:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:28.721 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":49,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:28.177037+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:06:25.860491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-21T00:06:27.113771+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:28.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 msgr2=0x7f96c00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 0x7f96c00559b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f96d800b000 tx=0x7f96d8006df0).stop 2021-10-21T00:06:28.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 msgr2=0x7f96e809be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f96e00032f0 tx=0x7f96e0016000).stop 2021-10-21T00:06:28.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 shutdown_connections 2021-10-21T00:06:28.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96c00534f0 0x7f96c00559b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f96e8140890 0x7f96e809be40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96e80b4380 0x7f96e8153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 --2- 172.21.15.41:0/3106983249 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f96e80b1830 0x7f96e80b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 >> 172.21.15.41:0/3106983249 conn(0x7f96e80b7910 msgr2=0x7f96e80b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 shutdown_connections 2021-10-21T00:06:28.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.717+0000 7f96e7fff700 1 -- 172.21.15.41:0/3106983249 wait complete. 2021-10-21T00:06:28.735 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:06:28.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 Processor -- start 2021-10-21T00:06:28.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 -- start start 2021-10-21T00:06:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07bc0604f0 0x7f07bc0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc0b2550 con 0x7f07bc0b2170 2021-10-21T00:06:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc0b1350 con 0x7f07bc0604f0 2021-10-21T00:06:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c2132700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc05f940 con 0x7f07bc0ab600 2021-10-21T00:06:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c1931700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c092f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07bc0604f0 0x7f07bc0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c1130700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f07bc0b2170 0x7f07bc05fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38100/0 (socket says 172.21.15.41:38100) 2021-10-21T00:06:28.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.841+0000 7f07c1130700 1 -- 172.21.15.41:0/583832992 learned_addr learned my addr 172.21.15.41:0/583832992 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:28.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c092f700 1 -- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 msgr2=0x7f07bc141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:28.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c092f700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c092f700 1 -- 172.21.15.41:0/583832992 >> v1:172.21.15.62:6789/0 conn(0x7f07bc0b2170 legacy=0x7f07bc05fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c092f700 1 -- 172.21.15.41:0/583832992 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc142240 con 0x7f07bc0604f0 2021-10-21T00:06:28.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c1931700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:28.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07abfff700 1 -- 172.21.15.41:0/583832992 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018735891 0 0) 0x7f07bc0b2550 con 0x7f07bc0b2170 2021-10-21T00:06:28.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c092f700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0604f0 0x7f07bc0b0d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f07b8002f70 tx=0x7f07b8006df0).ready entity=mon.1 client_cookie=b052eaf86637d763 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07abfff700 1 -- 172.21.15.41:0/583832992 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07b800d570 con 0x7f07bc0604f0 2021-10-21T00:06:28.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07abfff700 1 -- 172.21.15.41:0/583832992 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8000e90 con 0x7f07bc0604f0 2021-10-21T00:06:28.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07abfff700 1 -- 172.21.15.41:0/583832992 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07b800d8c0 con 0x7f07bc0604f0 2021-10-21T00:06:28.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0604f0 msgr2=0x7f07bc0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0604f0 0x7f07bc0b0d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f07b8002f70 tx=0x7f07b8006df0).stop 2021-10-21T00:06:28.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- 172.21.15.41:0/583832992 shutdown_connections 2021-10-21T00:06:28.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 --2- 172.21.15.41:0/583832992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0604f0 0x7f07bc0b0d20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- 172.21.15.41:0/583832992 >> 172.21.15.41:0/583832992 conn(0x7f07bc0b5700 msgr2=0x7f07bc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:28.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- 172.21.15.41:0/583832992 shutdown_connections 2021-10-21T00:06:28.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- 172.21.15.41:0/583832992 wait complete. 2021-10-21T00:06:28.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 Processor -- start 2021-10-21T00:06:28.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.845+0000 7f07c2132700 1 -- start start 2021-10-21T00:06:28.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 0x7f07bc13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0b2170 0x7f07bc1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0acb40 con 0x7f07bc0604f0 2021-10-21T00:06:28.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0ac160 con 0x7f07bc0b2170 2021-10-21T00:06:28.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc0ac400 con 0x7f07bc0ab600 2021-10-21T00:06:28.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c1130700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 0x7f07bc13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c1130700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 0x7f07bc13f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60514/0 (socket says 172.21.15.41:60514) 2021-10-21T00:06:28.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c1931700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0b2170 0x7f07bc1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c1130700 1 -- 172.21.15.41:0/3423271279 learned_addr learned my addr 172.21.15.41:0/3423271279 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:28.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 -- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0b2170 msgr2=0x7f07bc1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0b2170 0x7f07bc1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 -- 172.21.15.41:0/3423271279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 msgr2=0x7f07bc13f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:28.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 0x7f07bc13f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:28.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 -- 172.21.15.41:0/3423271279 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4009470 con 0x7f07bc0ab600 2021-10-21T00:06:28.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c092f700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc13fbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f07bc1519a0 tx=0x7f07b8014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07b8016070 con 0x7f07bc0ab600 2021-10-21T00:06:28.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8013980 con 0x7f07bc0ab600 2021-10-21T00:06:28.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b800b180 con 0x7f07bc0ab600 2021-10-21T00:06:28.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07b8013ce0 con 0x7f07bc0ab600 2021-10-21T00:06:28.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.849+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc1400d0 con 0x7f07bc0ab600 2021-10-21T00:06:28.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc141780 con 0x7f07bc0ab600 2021-10-21T00:06:28.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07b8025030 con 0x7f07bc0ab600 2021-10-21T00:06:28.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07aa7fc700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 0x7f079c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:28.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07b806c7c0 con 0x7f07bc0ab600 2021-10-21T00:06:28.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07c1130700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 0x7f079c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:28.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.853+0000 7f07c1130700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 0x7f079c055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f07ac00d000 tx=0x7f07ac007ce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:28.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:28.861+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07bc141780 con 0x7f07bc0ab600 2021-10-21T00:06:29.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.025+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07bc141780 con 0x7f07bc0ab600 2021-10-21T00:06:29.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.193+0000 7f07aa7fc700 1 -- 172.21.15.41:0/3423271279 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f07bc141780 con 0x7f07bc0ab600 2021-10-21T00:06:29.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 msgr2=0x7f079c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 0x7f079c055ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f07ac00d000 tx=0x7f07ac007ce0).stop 2021-10-21T00:06:29.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 msgr2=0x7f07bc13fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc13fbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f07bc1519a0 tx=0x7f07b8014000).stop 2021-10-21T00:06:29.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 shutdown_connections 2021-10-21T00:06:29.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f079c053610 0x7f079c055ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07bc0b2170 0x7f07bc1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07bc0ab600 0x7f07bc13fbe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 --2- 172.21.15.41:0/3423271279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07bc0604f0 0x7f07bc13f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 >> 172.21.15.41:0/3423271279 conn(0x7f07bc0b5700 msgr2=0x7f07bc142890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 shutdown_connections 2021-10-21T00:06:29.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.197+0000 7f07c2132700 1 -- 172.21.15.41:0/3423271279 wait complete. 2021-10-21T00:06:29.220 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:29.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 Processor -- start 2021-10-21T00:06:29.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 -- start start 2021-10-21T00:06:29.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf1c062330 0x7faf1c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 0x7faf1c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c05bd40 con 0x7faf1c062f70 2021-10-21T00:06:29.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c05bf70 con 0x7faf1c062330 2021-10-21T00:06:29.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.321+0000 7faf215eb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c142cb0 con 0x7faf1c0b3a20 2021-10-21T00:06:29.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf1c062330 0x7faf1c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf1c062330 0x7faf1c0b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60520/0 (socket says 172.21.15.41:60520) 2021-10-21T00:06:29.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf20dea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 0x7faf1c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faf1c062f70 0x7faf1c05c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38114/0 (socket says 172.21.15.41:38114) 2021-10-21T00:06:29.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 -- 172.21.15.41:0/3556207079 learned_addr learned my addr 172.21.15.41:0/3556207079 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1affd700 1 -- 172.21.15.41:0/3556207079 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438338552 0 0) 0x7faf1c05bd40 con 0x7faf1c062f70 2021-10-21T00:06:29.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1affd700 1 -- 172.21.15.41:0/3556207079 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf08003260 con 0x7faf1c062f70 2021-10-21T00:06:29.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 -- 172.21.15.41:0/3556207079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 msgr2=0x7faf1c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:29.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 0x7faf1c13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 -- 172.21.15.41:0/3556207079 >> v1:172.21.15.62:6789/0 conn(0x7faf1c062f70 legacy=0x7faf1c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 -- 172.21.15.41:0/3556207079 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c142950 con 0x7faf1c062330 2021-10-21T00:06:29.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf20dea700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 0x7faf1c13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:29.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1bfff700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c062330 0x7faf1c0b3f30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7faf10002f70 tx=0x7faf10006eb0).ready entity=mon.0 client_cookie=7b98d5dfefa139c6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1affd700 1 -- 172.21.15.41:0/3556207079 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1000d5c0 con 0x7faf1c062330 2021-10-21T00:06:29.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1affd700 1 -- 172.21.15.41:0/3556207079 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf10000e90 con 0x7faf1c062330 2021-10-21T00:06:29.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf1affd700 1 -- 172.21.15.41:0/3556207079 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1000d950 con 0x7faf1c062330 2021-10-21T00:06:29.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 -- 172.21.15.41:0/3556207079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c062330 msgr2=0x7faf1c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c062330 0x7faf1c0b3f30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7faf10002f70 tx=0x7faf10006eb0).stop 2021-10-21T00:06:29.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 -- 172.21.15.41:0/3556207079 shutdown_connections 2021-10-21T00:06:29.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c0b3a20 0x7faf1c13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 --2- 172.21.15.41:0/3556207079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c062330 0x7faf1c0b3f30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 -- 172.21.15.41:0/3556207079 >> 172.21.15.41:0/3556207079 conn(0x7faf1c0b9080 msgr2=0x7faf1c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 -- 172.21.15.41:0/3556207079 shutdown_connections 2021-10-21T00:06:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.325+0000 7faf215eb700 1 -- 172.21.15.41:0/3556207079 wait complete. 2021-10-21T00:06:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 Processor -- start 2021-10-21T00:06:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- start start 2021-10-21T00:06:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c062330 0x7faf1c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 0x7faf1c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c0af5b0 con 0x7faf1c0b3a20 2021-10-21T00:06:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c13f460 con 0x7faf1c062f70 2021-10-21T00:06:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c146d00 con 0x7faf1c062330 2021-10-21T00:06:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf1bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c062330 0x7faf1c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60530/0 (socket says 172.21.15.41:60530) 2021-10-21T00:06:29.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 -- 172.21.15.41:0/2499670458 learned_addr learned my addr 172.21.15.41:0/2499670458 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf1b7fe700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 0x7faf1c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 -- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c062330 msgr2=0x7faf1c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c062330 0x7faf1c1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 -- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 msgr2=0x7faf1c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 0x7faf1c13ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 -- 172.21.15.41:0/2499670458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14009470 con 0x7faf1c0b3a20 2021-10-21T00:06:29.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf1b7fe700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 0x7faf1c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:29.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf20dea700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7faf1400c000 tx=0x7faf140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1400c850 con 0x7faf1c0b3a20 2021-10-21T00:06:29.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1400c9b0 con 0x7faf1c0b3a20 2021-10-21T00:06:29.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1000b1e0 con 0x7faf1c0b3a20 2021-10-21T00:06:29.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1400cd10 con 0x7faf1c0b3a20 2021-10-21T00:06:29.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.329+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c144010 con 0x7faf1c0b3a20 2021-10-21T00:06:29.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c057350 con 0x7faf1c0b3a20 2021-10-21T00:06:29.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf14022070 con 0x7faf1c0b3a20 2021-10-21T00:06:29.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf197fa700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 0x7faefc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf1406c020 con 0x7faf1c0b3a20 2021-10-21T00:06:29.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf1bfff700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 0x7faefc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.333+0000 7faf1bfff700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 0x7faefc055ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7faf1001c000 tx=0x7faf10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.341+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf14043180 con 0x7faf1c0b3a20 2021-10-21T00:06:29.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.505+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf1c0ae6f0 con 0x7faf1c0b3a20 2021-10-21T00:06:29.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf197fa700 1 -- 172.21.15.41:0/2499670458 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7faf14016020 con 0x7faf1c0b3a20 2021-10-21T00:06:29.513 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:29.513 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:29.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 msgr2=0x7faefc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 0x7faefc055ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7faf1001c000 tx=0x7faf10015000).stop 2021-10-21T00:06:29.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 msgr2=0x7faf1c13ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7faf1400c000 tx=0x7faf140091d0).stop 2021-10-21T00:06:29.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 shutdown_connections 2021-10-21T00:06:29.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faefc053610 0x7faefc055ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf1c0b3a20 0x7faf1c13ef70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c062f70 0x7faf1c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 --2- 172.21.15.41:0/2499670458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf1c062330 0x7faf1c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 >> 172.21.15.41:0/2499670458 conn(0x7faf1c0b9080 msgr2=0x7faf1c0b7440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 shutdown_connections 2021-10-21T00:06:29.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.509+0000 7faf215eb700 1 -- 172.21.15.41:0/2499670458 wait complete. 2021-10-21T00:06:29.519 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:29.526 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:29.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 Processor -- start 2021-10-21T00:06:29.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 -- start start 2021-10-21T00:06:29.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 0x7fe7f00ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f00b0b50 con 0x7fe7f00abb50 2021-10-21T00:06:29.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00b2550 con 0x7fe7f00b2170 2021-10-21T00:06:29.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f659d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b0d90 con 0x7fe7f00af620 2021-10-21T00:06:29.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50800/0 (socket says 172.21.15.41:50800) 2021-10-21T00:06:29.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 -- 172.21.15.41:0/1229142500 learned_addr learned my addr 172.21.15.41:0/1229142500 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f559b700 1 --2- 172.21.15.41:0/1229142500 >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 0x7fe7f00ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7e7fff700 1 -- 172.21.15.41:0/1229142500 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621267435 0 0) 0x7fe7e8001490 con 0x7fe7f00abb50 2021-10-21T00:06:29.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7e7fff700 1 -- 172.21.15.41:0/1229142500 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d4003260 con 0x7fe7f00abb50 2021-10-21T00:06:29.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 -- 172.21.15.41:0/1229142500 >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 msgr2=0x7fe7f00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:29.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 --2- 172.21.15.41:0/1229142500 >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 0x7fe7f00ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 -- 172.21.15.41:0/1229142500 >> v1:172.21.15.62:6789/0 conn(0x7fe7f00abb50 legacy=0x7fe7f014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 -- 172.21.15.41:0/1229142500 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00b1030 con 0x7fe7f00af620 2021-10-21T00:06:29.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f559b700 1 --2- 172.21.15.41:0/1229142500 >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 0x7fe7f00ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:29.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7f4d9a700 1 --2- 172.21.15.41:0/1229142500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe7ec002f70 tx=0x7fe7ec006eb0).ready entity=mon.2 client_cookie=987cd587755c77a0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7e7fff700 1 -- 172.21.15.41:0/1229142500 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ec00d5c0 con 0x7fe7f00af620 2021-10-21T00:06:29.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7e7fff700 1 -- 172.21.15.41:0/1229142500 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec000e90 con 0x7fe7f00af620 2021-10-21T00:06:29.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.629+0000 7fe7e7fff700 1 -- 172.21.15.41:0/1229142500 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ec00d950 con 0x7fe7f00af620 2021-10-21T00:06:29.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/1229142500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 msgr2=0x7fe7f00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- 172.21.15.41:0/1229142500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe7ec002f70 tx=0x7fe7ec006eb0).stop 2021-10-21T00:06:29.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/1229142500 shutdown_connections 2021-10-21T00:06:29.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- 172.21.15.41:0/1229142500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00af620 0x7fe7f00ab660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- 172.21.15.41:0/1229142500 >> v2:172.21.15.62:3300/0 conn(0x7fe7f00b2170 0x7fe7f00ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/1229142500 >> 172.21.15.41:0/1229142500 conn(0x7fe7f00b5700 msgr2=0x7fe7f00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/1229142500 shutdown_connections 2021-10-21T00:06:29.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/1229142500 wait complete. 2021-10-21T00:06:29.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 Processor -- start 2021-10-21T00:06:29.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- start start 2021-10-21T00:06:29.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00abb50 0x7fe7f00ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7f00af620 0x7fe7f00add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0067060 con 0x7fe7f00b2170 2021-10-21T00:06:29.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00ae740 con 0x7fe7f00af620 2021-10-21T00:06:29.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00ae2e0 con 0x7fe7f00abb50 2021-10-21T00:06:29.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60540/0 (socket says 172.21.15.41:60540) 2021-10-21T00:06:29.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 -- 172.21.15.41:0/4204949120 learned_addr learned my addr 172.21.15.41:0/4204949120 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f4d9a700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7f00af620 0x7fe7f00add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f559b700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00abb50 0x7fe7f00ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 -- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00abb50 msgr2=0x7fe7f00ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00abb50 0x7fe7f00ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 -- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7f00af620 msgr2=0x7fe7f00add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7f00af620 0x7fe7f00add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 -- 172.21.15.41:0/4204949120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e000b180 con 0x7fe7f00b2170 2021-10-21T00:06:29.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f5d9c700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe7e8001620 tx=0x7fe7e8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7e800e4a0 con 0x7fe7f00b2170 2021-10-21T00:06:29.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800e600 con 0x7fe7f00b2170 2021-10-21T00:06:29.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec00b1e0 con 0x7fe7f00b2170 2021-10-21T00:06:29.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7e800e960 con 0x7fe7f00b2170 2021-10-21T00:06:29.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.633+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0067290 con 0x7fe7f00b2170 2021-10-21T00:06:29.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe7e8019030 con 0x7fe7f00b2170 2021-10-21T00:06:29.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00ae450 con 0x7fe7f00b2170 2021-10-21T00:06:29.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7e67fc700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 0x7fe7d8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7e806aec0 con 0x7fe7f00b2170 2021-10-21T00:06:29.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7f559b700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 0x7fe7d8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.637+0000 7fe7f559b700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 0x7fe7d8055b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe7e000b000 tx=0x7fe7e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.641+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7e8042020 con 0x7fe7f00b2170 2021-10-21T00:06:29.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.769+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7f00b0b50 con 0x7fe7f00b2170 2021-10-21T00:06:29.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7e67fc700 1 -- 172.21.15.41:0/4204949120 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fe7f00b0b50 con 0x7fe7f00b2170 2021-10-21T00:06:29.778 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:29.778 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":50,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:29.180913+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:06:25.860491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-21T00:06:27.113771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:29.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 msgr2=0x7fe7d8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 0x7fe7d8055b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe7e000b000 tx=0x7fe7e0008040).stop 2021-10-21T00:06:29.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 msgr2=0x7fe7f00ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fe7e8001620 tx=0x7fe7e8007c50).stop 2021-10-21T00:06:29.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 shutdown_connections 2021-10-21T00:06:29.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe7d80536d0 0x7fe7d8055b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe7f00b2170 0x7fe7f00ac9e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7f00af620 0x7fe7f00add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 --2- 172.21.15.41:0/4204949120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7f00abb50 0x7fe7f00ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 >> 172.21.15.41:0/4204949120 conn(0x7fe7f00b5700 msgr2=0x7fe7f005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 shutdown_connections 2021-10-21T00:06:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.773+0000 7fe7f659d700 1 -- 172.21.15.41:0/4204949120 wait complete. 2021-10-21T00:06:29.797 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:06:29.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 Processor -- start 2021-10-21T00:06:29.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 -- start start 2021-10-21T00:06:29.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efeb40b9c70 0x7efeb4143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb4142bc0 con 0x7efeb41418f0 2021-10-21T00:06:29.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb40ba050 con 0x7efeb40b3bc0 2021-10-21T00:06:29.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb96ca700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb41429a0 con 0x7efeb40b9c70 2021-10-21T00:06:29.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efeb40b9c70 0x7efeb4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efeb40b9c70 0x7efeb4143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60548/0 (socket says 172.21.15.41:60548) 2021-10-21T00:06:29.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 -- 172.21.15.41:0/2049803449 learned_addr learned my addr 172.21.15.41:0/2049803449 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb37fe700 1 --1- 172.21.15.41:0/2049803449 >> v1:172.21.15.41:6789/0 conn(0x7efeb41418f0 0x7efeb4141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58322/0 (socket says 172.21.15.41:58322) 2021-10-21T00:06:29.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 -- 172.21.15.41:0/2049803449 >> v1:172.21.15.62:6789/0 conn(0x7efeb40b3bc0 legacy=0x7efeb4143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 -- 172.21.15.41:0/2049803449 >> v1:172.21.15.41:6789/0 conn(0x7efeb41418f0 legacy=0x7efeb4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:29.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 -- 172.21.15.41:0/2049803449 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb41463c0 con 0x7efeb40b9c70 2021-10-21T00:06:29.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb2ffd700 1 --2- 172.21.15.41:0/2049803449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb40b9c70 0x7efeb4143020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7efea4002f70 tx=0x7efea4006eb0).ready entity=mon.0 client_cookie=7dc31819afbc0ec3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb27fc700 1 -- 172.21.15.41:0/2049803449 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea400d660 con 0x7efeb40b9c70 2021-10-21T00:06:29.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb27fc700 1 -- 172.21.15.41:0/2049803449 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4000e90 con 0x7efeb40b9c70 2021-10-21T00:06:29.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.901+0000 7efeb27fc700 1 -- 172.21.15.41:0/2049803449 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea400d9f0 con 0x7efeb40b9c70 2021-10-21T00:06:29.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- 172.21.15.41:0/2049803449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb40b9c70 msgr2=0x7efeb4143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 --2- 172.21.15.41:0/2049803449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb40b9c70 0x7efeb4143020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7efea4002f70 tx=0x7efea4006eb0).stop 2021-10-21T00:06:29.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- 172.21.15.41:0/2049803449 shutdown_connections 2021-10-21T00:06:29.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 --2- 172.21.15.41:0/2049803449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb40b9c70 0x7efeb4143020 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- 172.21.15.41:0/2049803449 >> 172.21.15.41:0/2049803449 conn(0x7efeb4062e80 msgr2=0x7efeb40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:29.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- 172.21.15.41:0/2049803449 shutdown_connections 2021-10-21T00:06:29.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- 172.21.15.41:0/2049803449 wait complete. 2021-10-21T00:06:29.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 Processor -- start 2021-10-21T00:06:29.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.905+0000 7efeb96ca700 1 -- start start 2021-10-21T00:06:29.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb40b3bc0 0x7efeb4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb40b9c70 0x7efeb40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b84f0 con 0x7efeb41418f0 2021-10-21T00:06:29.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40ad4a0 con 0x7efeb40b9c70 2021-10-21T00:06:29.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b9280 con 0x7efeb40b3bc0 2021-10-21T00:06:29.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60558/0 (socket says 172.21.15.41:60558) 2021-10-21T00:06:29.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 -- 172.21.15.41:0/14870715 learned_addr learned my addr 172.21.15.41:0/14870715 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:29.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb2ffd700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb40b3bc0 0x7efeb4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeaa7fc700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb40b9c70 0x7efeb40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 -- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb40b3bc0 msgr2=0x7efeb4155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb40b3bc0 0x7efeb4155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 -- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb40b9c70 msgr2=0x7efeb40ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:29.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb40b9c70 0x7efeb40ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:29.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 -- 172.21.15.41:0/14870715 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea400b1e0 con 0x7efeb41418f0 2021-10-21T00:06:29.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb37fe700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efeb4060220 tx=0x7efeac0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeac005ae0 con 0x7efeb41418f0 2021-10-21T00:06:29.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac005c40 con 0x7efeb41418f0 2021-10-21T00:06:29.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40b8e80 con 0x7efeb41418f0 2021-10-21T00:06:29.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeac0070d0 con 0x7efeb41418f0 2021-10-21T00:06:29.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41129a0 con 0x7efeb41418f0 2021-10-21T00:06:29.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.909+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb4143c20 con 0x7efeb41418f0 2021-10-21T00:06:29.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.913+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efeac01a060 con 0x7efeb41418f0 2021-10-21T00:06:29.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.913+0000 7efeb0ff9700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 0x7efe98055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:29.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.913+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efeac06b200 con 0x7efeb41418f0 2021-10-21T00:06:29.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.913+0000 7efeb2ffd700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 0x7efe98055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:29.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.913+0000 7efeb2ffd700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 0x7efe98055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efea401c000 tx=0x7efea4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:29.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:29.917+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efeac042360 con 0x7efeb41418f0 2021-10-21T00:06:30.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.093+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efeb4057350 con 0x7efeb41418f0 2021-10-21T00:06:30.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.097+0000 7efeb0ff9700 1 -- 172.21.15.41:0/14870715 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7efeac018070 con 0x7efeb41418f0 2021-10-21T00:06:30.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 msgr2=0x7efe98055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 0x7efe98055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efea401c000 tx=0x7efea4015000).stop 2021-10-21T00:06:30.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 msgr2=0x7efeb4145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7efeb4060220 tx=0x7efeac0013a0).stop 2021-10-21T00:06:30.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 shutdown_connections 2021-10-21T00:06:30.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe98053640 0x7efe98055b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb41418f0 0x7efeb4145710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb40b9c70 0x7efeb40ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 --2- 172.21.15.41:0/14870715 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb40b3bc0 0x7efeb4155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 >> 172.21.15.41:0/14870715 conn(0x7efeb4062e80 msgr2=0x7efeb40b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 shutdown_connections 2021-10-21T00:06:30.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.101+0000 7efeb96ca700 1 -- 172.21.15.41:0/14870715 wait complete. 2021-10-21T00:06:30.109 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:06:30.120 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:06:30.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 Processor -- start 2021-10-21T00:06:30.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 -- start start 2021-10-21T00:06:30.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b9c70 0x7f73ec143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f73ec0b3bc0 0x7f73ec143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec142bc0 con 0x7f73ec143a00 2021-10-21T00:06:30.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec1429a0 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f2fc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ba050 con 0x7f73ec0b9c70 2021-10-21T00:06:30.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f73ec0b3bc0 0x7f73ec143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f73ec0b3bc0 0x7f73ec143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60564/0 (socket says 172.21.15.41:60564) 2021-10-21T00:06:30.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 -- 172.21.15.41:0/793690510 learned_addr learned my addr 172.21.15.41:0/793690510 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:30.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73f0d65700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b9c70 0x7f73ec143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 -- 172.21.15.41:0/793690510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b9c70 msgr2=0x7f73ec143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:30.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b9c70 0x7f73ec143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 -- 172.21.15.41:0/793690510 >> v1:172.21.15.62:6789/0 conn(0x7f73ec143a00 legacy=0x7f73ec05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 -- 172.21.15.41:0/793690510 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec1463c0 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.229+0000 7f73ebfff700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec0b3bc0 0x7f73ec143510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f73ec0b1ab0 tx=0x7f73dc006eb0).ready entity=mon.0 client_cookie=678e628e4b98d983 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73eb7fe700 1 -- 172.21.15.41:0/793690510 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00d5c0 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73eb7fe700 1 -- 172.21.15.41:0/793690510 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc000e90 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73eb7fe700 1 -- 172.21.15.41:0/793690510 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00d950 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- 172.21.15.41:0/793690510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec0b3bc0 msgr2=0x7f73ec143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec0b3bc0 0x7f73ec143510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f73ec0b1ab0 tx=0x7f73dc006eb0).stop 2021-10-21T00:06:30.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- 172.21.15.41:0/793690510 shutdown_connections 2021-10-21T00:06:30.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec0b3bc0 0x7f73ec143510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/793690510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b9c70 0x7f73ec143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- 172.21.15.41:0/793690510 >> 172.21.15.41:0/793690510 conn(0x7f73ec062e80 msgr2=0x7f73ec0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- 172.21.15.41:0/793690510 shutdown_connections 2021-10-21T00:06:30.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- 172.21.15.41:0/793690510 wait complete. 2021-10-21T00:06:30.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 Processor -- start 2021-10-21T00:06:30.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- start start 2021-10-21T00:06:30.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b3bc0 0x7f73ec113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ec0b9c70 0x7f73ec13ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec113dd0 con 0x7f73ec143a00 2021-10-21T00:06:30.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec112860 con 0x7f73ec0b9c70 2021-10-21T00:06:30.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f2fc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec112b00 con 0x7f73ec0b3bc0 2021-10-21T00:06:30.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60570/0 (socket says 172.21.15.41:60570) 2021-10-21T00:06:30.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 -- 172.21.15.41:0/4194498849 learned_addr learned my addr 172.21.15.41:0/4194498849 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:30.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f0d65700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b3bc0 0x7f73ec113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73ebfff700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ec0b9c70 0x7f73ec13ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 -- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b3bc0 msgr2=0x7f73ec113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b3bc0 0x7f73ec113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 -- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ec0b9c70 msgr2=0x7f73ec13ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ec0b9c70 0x7f73ec13ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 -- 172.21.15.41:0/4194498849 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc00b1e0 con 0x7f73ec143a00 2021-10-21T00:06:30.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.233+0000 7f73f1566700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f73ec05d460 tx=0x7f73e4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4002490 con 0x7f73ec143a00 2021-10-21T00:06:30.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e40025f0 con 0x7f73ec143a00 2021-10-21T00:06:30.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec112da0 con 0x7f73ec143a00 2021-10-21T00:06:30.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4002950 con 0x7f73ec143a00 2021-10-21T00:06:30.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec0af2e0 con 0x7f73ec143a00 2021-10-21T00:06:30.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73e4010030 con 0x7f73ec143a00 2021-10-21T00:06:30.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec0b4660 con 0x7f73ec143a00 2021-10-21T00:06:30.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 0x7f73d00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73e406b9e0 con 0x7f73ec143a00 2021-10-21T00:06:30.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.237+0000 7f73f0d65700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 0x7f73d00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.241+0000 7f73f0d65700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 0x7f73d00559e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f73d400c000 tx=0x7f73d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.241+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73e4042b40 con 0x7f73ec143a00 2021-10-21T00:06:30.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.409+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f73ec112f30 con 0x7f73ec143a00 2021-10-21T00:06:30.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.417+0000 7f73e9ffb700 1 -- 172.21.15.41:0/4194498849 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f73e4046160 con 0x7f73ec143a00 2021-10-21T00:06:30.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.417+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 msgr2=0x7f73d00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.417+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 0x7f73d00559e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f73d400c000 tx=0x7f73d4008040).stop 2021-10-21T00:06:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.417+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 msgr2=0x7f73ec1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.417+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f73ec05d460 tx=0x7f73e4007f40).stop 2021-10-21T00:06:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 shutdown_connections 2021-10-21T00:06:30.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73d0053520 0x7f73d00559e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f73ec143a00 0x7f73ec1553b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ec0b9c70 0x7f73ec13ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 --2- 172.21.15.41:0/4194498849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73ec0b3bc0 0x7f73ec113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 >> 172.21.15.41:0/4194498849 conn(0x7f73ec062e80 msgr2=0x7f73ec13f640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 shutdown_connections 2021-10-21T00:06:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.421+0000 7f73f2fc9700 1 -- 172.21.15.41:0/4194498849 wait complete. 2021-10-21T00:06:30.428 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:06:30.439 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:06:30.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 Processor -- start 2021-10-21T00:06:30.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 -- start start 2021-10-21T00:06:30.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc3240b3bc0 0x7fc324143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3241418f0 0x7fc324141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc324142bc0 con 0x7fc3240b9c70 2021-10-21T00:06:30.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3241429a0 con 0x7fc3240b3bc0 2021-10-21T00:06:30.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc32ad6c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240ba050 con 0x7fc3241418f0 2021-10-21T00:06:30.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc328b08700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc3240b9c70 0x7fc324143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58346/0 (socket says 172.21.15.41:58346) 2021-10-21T00:06:30.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc328b08700 1 -- 172.21.15.41:0/3812517592 learned_addr learned my addr 172.21.15.41:0/3812517592 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:30.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 --2- 172.21.15.41:0/3812517592 >> v2:172.21.15.62:3300/0 conn(0x7fc3240b3bc0 0x7fc324143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc329309700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3241418f0 0x7fc324141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231537437 0 0) 0x7fc324142bc0 con 0x7fc3240b9c70 2021-10-21T00:06:30.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003260 con 0x7fc3240b9c70 2021-10-21T00:06:30.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641358385 0 0) 0x7fc310003260 con 0x7fc3240b9c70 2021-10-21T00:06:30.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 -- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3241418f0 msgr2=0x7fc324141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:30.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3241418f0 0x7fc324141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 -- 172.21.15.41:0/3812517592 >> v1:172.21.15.41:6789/0 conn(0x7fc3240b9c70 legacy=0x7fc324143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 -- 172.21.15.41:0/3812517592 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3241463c0 con 0x7fc3240b3bc0 2021-10-21T00:06:30.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31bfff700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc324143730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc320001800 tx=0x7fc314006df0).ready entity=mon.1 client_cookie=2a496195c6266463 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc320001660 con 0x7fc3240b3bc0 2021-10-21T00:06:30.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314000e90 con 0x7fc3240b3bc0 2021-10-21T00:06:30.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.549+0000 7fc31b7fe700 1 -- 172.21.15.41:0/3812517592 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc314012460 con 0x7fc3240b3bc0 2021-10-21T00:06:30.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 msgr2=0x7fc324143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc324143730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc320001800 tx=0x7fc314006df0).stop 2021-10-21T00:06:30.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- 172.21.15.41:0/3812517592 shutdown_connections 2021-10-21T00:06:30.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3241418f0 0x7fc324141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/3812517592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc324143730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- 172.21.15.41:0/3812517592 >> 172.21.15.41:0/3812517592 conn(0x7fc324062e80 msgr2=0x7fc3240b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- 172.21.15.41:0/3812517592 shutdown_connections 2021-10-21T00:06:30.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- 172.21.15.41:0/3812517592 wait complete. 2021-10-21T00:06:30.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 Processor -- start 2021-10-21T00:06:30.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.553+0000 7fc32ad6c700 1 -- start start 2021-10-21T00:06:30.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc3240b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3240b9c70 0x7fc3240af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240ae0a0 con 0x7fc3241418f0 2021-10-21T00:06:30.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324112560 con 0x7fc3240b3bc0 2021-10-21T00:06:30.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241455f0 con 0x7fc3240b9c70 2021-10-21T00:06:30.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60586/0 (socket says 172.21.15.41:60586) 2021-10-21T00:06:30.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc328b08700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc3240b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 -- 172.21.15.41:0/832594621 learned_addr learned my addr 172.21.15.41:0/832594621 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:30.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc31bfff700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3240b9c70 0x7fc3240af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 -- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3240b9c70 msgr2=0x7fc3240af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3240b9c70 0x7fc3240af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 -- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 msgr2=0x7fc3240b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc3240b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 -- 172.21.15.41:0/832594621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31400b180 con 0x7fc3241418f0 2021-10-21T00:06:30.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc329309700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fc31c006e00 tx=0x7fc31c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc31c012600 con 0x7fc3241418f0 2021-10-21T00:06:30.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c012760 con 0x7fc3241418f0 2021-10-21T00:06:30.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3240aef80 con 0x7fc3241418f0 2021-10-21T00:06:30.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc31c012ac0 con 0x7fc3241418f0 2021-10-21T00:06:30.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3240ad7f0 con 0x7fc3241418f0 2021-10-21T00:06:30.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3240aedd0 con 0x7fc3241418f0 2021-10-21T00:06:30.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.557+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc31c022070 con 0x7fc3241418f0 2021-10-21T00:06:30.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.561+0000 7fc319ffb700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 0x7fc304055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.561+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc31c06bf30 con 0x7fc3241418f0 2021-10-21T00:06:30.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.561+0000 7fc328b08700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 0x7fc304055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.561+0000 7fc328b08700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 0x7fc304055ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc32000d000 tx=0x7fc320001de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.565+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc31c042ff0 con 0x7fc3241418f0 2021-10-21T00:06:30.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.733+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc324146120 con 0x7fc3241418f0 2021-10-21T00:06:30.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc319ffb700 1 -- 172.21.15.41:0/832594621 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc31c016020 con 0x7fc3241418f0 2021-10-21T00:06:30.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 msgr2=0x7fc304055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 0x7fc304055ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc32000d000 tx=0x7fc320001de0).stop 2021-10-21T00:06:30.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 msgr2=0x7fc324151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fc31c006e00 tx=0x7fc31c0091d0).stop 2021-10-21T00:06:30.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 shutdown_connections 2021-10-21T00:06:30.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc304053610 0x7fc304055ad0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3241418f0 0x7fc324151fb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3240b9c70 0x7fc3240af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 --2- 172.21.15.41:0/832594621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3240b3bc0 0x7fc3240b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.741+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 >> 172.21.15.41:0/832594621 conn(0x7fc324062e80 msgr2=0x7fc324140d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.745+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 shutdown_connections 2021-10-21T00:06:30.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.745+0000 7fc32ad6c700 1 -- 172.21.15.41:0/832594621 wait complete. 2021-10-21T00:06:30.752 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:06:30.765 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:30.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 Processor -- start 2021-10-21T00:06:30.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 -- start start 2021-10-21T00:06:30.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b78142bc0 con 0x7f4b781418f0 2021-10-21T00:06:30.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780ba050 con 0x7f4b780b3bc0 2021-10-21T00:06:30.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b7d905700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b781429a0 con 0x7f4b780b9c70 2021-10-21T00:06:30.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b777fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4b781418f0 0x7f4b78141da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58364/0 (socket says 172.21.15.41:58364) 2021-10-21T00:06:30.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b767fc700 1 --1- 172.21.15.41:0/3309756468 >> v1:172.21.15.62:6789/0 conn(0x7f4b780b3bc0 0x7f4b78143510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38186/0 (socket says 172.21.15.41:38186) 2021-10-21T00:06:30.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b777fe700 1 -- 172.21.15.41:0/3309756468 learned_addr learned my addr 172.21.15.41:0/3309756468 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:30.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b76ffd700 1 --2- 172.21.15.41:0/3309756468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575190996 0 0) 0x7f4b78142bc0 con 0x7f4b781418f0 2021-10-21T00:06:30.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c003260 con 0x7f4b781418f0 2021-10-21T00:06:30.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93862708 0 0) 0x7f4b780ba050 con 0x7f4b780b3bc0 2021-10-21T00:06:30.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78142bc0 con 0x7f4b780b3bc0 2021-10-21T00:06:30.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b76ffd700 1 -- 172.21.15.41:0/3309756468 >> v1:172.21.15.62:6789/0 conn(0x7f4b780b3bc0 legacy=0x7f4b78143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b76ffd700 1 -- 172.21.15.41:0/3309756468 >> v1:172.21.15.41:6789/0 conn(0x7f4b781418f0 legacy=0x7f4b78141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b76ffd700 1 -- 172.21.15.41:0/3309756468 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b781463c0 con 0x7f4b780b9c70 2021-10-21T00:06:30.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b76ffd700 1 --2- 172.21.15.41:0/3309756468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78143020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4b780b1ab0 tx=0x7f4b60006df0).ready entity=mon.2 client_cookie=6b376c25da5e6b35 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6000d5c0 con 0x7f4b780b9c70 2021-10-21T00:06:30.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b60000e90 con 0x7f4b780b9c70 2021-10-21T00:06:30.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.861+0000 7f4b75ffb700 1 -- 172.21.15.41:0/3309756468 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6000d910 con 0x7f4b780b9c70 2021-10-21T00:06:30.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- 172.21.15.41:0/3309756468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 msgr2=0x7f4b78143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 --2- 172.21.15.41:0/3309756468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78143020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4b780b1ab0 tx=0x7f4b60006df0).stop 2021-10-21T00:06:30.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- 172.21.15.41:0/3309756468 shutdown_connections 2021-10-21T00:06:30.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 --2- 172.21.15.41:0/3309756468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78143020 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- 172.21.15.41:0/3309756468 >> 172.21.15.41:0/3309756468 conn(0x7f4b78062e80 msgr2=0x7f4b780b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:30.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- 172.21.15.41:0/3309756468 shutdown_connections 2021-10-21T00:06:30.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- 172.21.15.41:0/3309756468 wait complete. 2021-10-21T00:06:30.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 Processor -- start 2021-10-21T00:06:30.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- start start 2021-10-21T00:06:30.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b780b3bc0 0x7f4b78115680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780aeb90 con 0x7f4b781418f0 2021-10-21T00:06:30.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780aee10 con 0x7f4b780b3bc0 2021-10-21T00:06:30.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b7d905700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780af070 con 0x7f4b780b9c70 2021-10-21T00:06:30.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60600/0 (socket says 172.21.15.41:60600) 2021-10-21T00:06:30.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 -- 172.21.15.41:0/2889208617 learned_addr learned my addr 172.21.15.41:0/2889208617 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:30.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b76ffd700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b780b3bc0 0x7f4b78115680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b767fc700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 -- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 msgr2=0x7f4b78112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78112620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 -- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b780b3bc0 msgr2=0x7f4b78115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:30.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b780b3bc0 0x7f4b78115680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:30.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 -- 172.21.15.41:0/2889208617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6000b180 con 0x7f4b781418f0 2021-10-21T00:06:30.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b767fc700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:30.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.865+0000 7f4b777fe700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f4b68001110 tx=0x7f4b68007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6800ce60 con 0x7f4b781418f0 2021-10-21T00:06:30.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680070d0 con 0x7f4b781418f0 2021-10-21T00:06:30.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b781134f0 con 0x7f4b781418f0 2021-10-21T00:06:30.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b68007430 con 0x7f4b781418f0 2021-10-21T00:06:30.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b781131a0 con 0x7f4b781418f0 2021-10-21T00:06:30.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78113680 con 0x7f4b781418f0 2021-10-21T00:06:30.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b6801a060 con 0x7f4b781418f0 2021-10-21T00:06:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 0x7f4b50055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b6806ac50 con 0x7f4b781418f0 2021-10-21T00:06:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.869+0000 7f4b76ffd700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 0x7f4b50055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.873+0000 7f4b76ffd700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 0x7f4b50055a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f4b60018000 tx=0x7f4b60014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:30.877+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b68041db0 con 0x7f4b781418f0 2021-10-21T00:06:31.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.037+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b78146120 con 0x7f4b781418f0 2021-10-21T00:06:31.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.037+0000 7f4b6ffff700 1 -- 172.21.15.41:0/2889208617 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f4b68018070 con 0x7f4b781418f0 2021-10-21T00:06:31.043 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:31.043 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:31.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 msgr2=0x7f4b50055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 0x7f4b50055a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f4b60018000 tx=0x7f4b60014000).stop 2021-10-21T00:06:31.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 msgr2=0x7f4b78112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f4b68001110 tx=0x7f4b68007a80).stop 2021-10-21T00:06:31.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 shutdown_connections 2021-10-21T00:06:31.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053570 0x7f4b50055a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b781418f0 0x7f4b78112b10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b780b9c70 0x7f4b78112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 --2- 172.21.15.41:0/2889208617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b780b3bc0 0x7f4b78115680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 >> 172.21.15.41:0/2889208617 conn(0x7f4b78062e80 msgr2=0x7f4b780b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:31.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 shutdown_connections 2021-10-21T00:06:31.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.041+0000 7f4b7d905700 1 -- 172.21.15.41:0/2889208617 wait complete. 2021-10-21T00:06:31.048 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:31.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:06:28.177510+0000', 'modified': '2021-10-21T00:06:29.181089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5619': {'gid': 5619, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3050633316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3050633316}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3050633316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:06:31.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:06:31.301 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:06:31.422 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5619,"want_state":"up:active","state":"up:active","rank_uptime":3.230649176,"mdsmap_epoch":21,"osdmap_epoch":50,"osdmap_epoch_barrier":49,"uptime":8.3214891229999992} 2021-10-21T00:06:31.422 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5619, "mdsmap_epoch": 21, "osdmap_epoch": 50, "osdmap_epoch_barrier": 49, "rank_uptime": 3.230649176, "state": "up:active", "uptime": 8.321489123, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:06:31.423 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:31.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 Processor -- start 2021-10-21T00:06:31.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 -- start start 2021-10-21T00:06:31.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f27b00b1820 0x7f27b014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f27b00679b0 0x7f27b00adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b00b6340 con 0x7f27b00675d0 2021-10-21T00:06:31.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b0146d10 con 0x7f27b00679b0 2021-10-21T00:06:31.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b6785700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b014a4b0 con 0x7f27b00b1820 2021-10-21T00:06:31.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b5f84700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f27b00679b0 0x7f27b00adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b5f84700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f27b00679b0 0x7f27b00adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60608/0 (socket says 172.21.15.41:60608) 2021-10-21T00:06:31.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b5783700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f27b00675d0 0x7f27b00b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58374/0 (socket says 172.21.15.41:58374) 2021-10-21T00:06:31.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b5f84700 1 -- 172.21.15.41:0/3375255275 learned_addr learned my addr 172.21.15.41:0/3375255275 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:31.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.525+0000 7f27b4f82700 1 --2- 172.21.15.41:0/3375255275 >> v2:172.21.15.62:3300/0 conn(0x7f27b00b1820 0x7f27b014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b5f84700 1 -- 172.21.15.41:0/3375255275 >> v2:172.21.15.62:3300/0 conn(0x7f27b00b1820 msgr2=0x7f27b014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:31.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b5f84700 1 --2- 172.21.15.41:0/3375255275 >> v2:172.21.15.62:3300/0 conn(0x7f27b00b1820 0x7f27b014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b5f84700 1 -- 172.21.15.41:0/3375255275 >> v1:172.21.15.41:6789/0 conn(0x7f27b00675d0 legacy=0x7f27b00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b5f84700 1 -- 172.21.15.41:0/3375255275 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b014a750 con 0x7f27b00679b0 2021-10-21T00:06:31.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b5f84700 1 --2- 172.21.15.41:0/3375255275 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00679b0 0x7f27b00adb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f27a80032f0 tx=0x7f27a8009290).ready entity=mon.0 client_cookie=fd2d7cbbf5fe182d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f279ffff700 1 -- 172.21.15.41:0/3375255275 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27a800b870 con 0x7f27b00679b0 2021-10-21T00:06:31.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f279ffff700 1 -- 172.21.15.41:0/3375255275 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800b9d0 con 0x7f27b00679b0 2021-10-21T00:06:31.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f279ffff700 1 -- 172.21.15.41:0/3375255275 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27a800bb40 con 0x7f27b00679b0 2021-10-21T00:06:31.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- 172.21.15.41:0/3375255275 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00679b0 msgr2=0x7f27b00adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- 172.21.15.41:0/3375255275 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00679b0 0x7f27b00adb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f27a80032f0 tx=0x7f27a8009290).stop 2021-10-21T00:06:31.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- 172.21.15.41:0/3375255275 shutdown_connections 2021-10-21T00:06:31.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- 172.21.15.41:0/3375255275 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00679b0 0x7f27b00adb60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- 172.21.15.41:0/3375255275 >> v2:172.21.15.62:3300/0 conn(0x7f27b00b1820 0x7f27b014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- 172.21.15.41:0/3375255275 >> 172.21.15.41:0/3375255275 conn(0x7f27b00639f0 msgr2=0x7f27b00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:31.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- 172.21.15.41:0/3375255275 shutdown_connections 2021-10-21T00:06:31.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- 172.21.15.41:0/3375255275 wait complete. 2021-10-21T00:06:31.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 Processor -- start 2021-10-21T00:06:31.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- start start 2021-10-21T00:06:31.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b00679b0 0x7f27b00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 0x7f27b0111b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0110670 con 0x7f27b00675d0 2021-10-21T00:06:31.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0144780 con 0x7f27b00679b0 2021-10-21T00:06:31.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.529+0000 7f27b6785700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0065f30 con 0x7f27b00b1820 2021-10-21T00:06:31.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60610/0 (socket says 172.21.15.41:60610) 2021-10-21T00:06:31.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 -- 172.21.15.41:0/478417808 learned_addr learned my addr 172.21.15.41:0/478417808 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:31.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b4f82700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b00679b0 0x7f27b00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5f84700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 0x7f27b0111b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 -- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 msgr2=0x7f27b0111b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 0x7f27b0111b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 -- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b00679b0 msgr2=0x7f27b00ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b00679b0 0x7f27b00ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 -- 172.21.15.41:0/478417808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009530 con 0x7f27b00675d0 2021-10-21T00:06:31.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5f84700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 0x7f27b0111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:31.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b5783700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f27b00ad880 tx=0x7f27ac007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27ac0070d0 con 0x7f27b00675d0 2021-10-21T00:06:31.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac007230 con 0x7f27b00675d0 2021-10-21T00:06:31.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b00661d0 con 0x7f27b00675d0 2021-10-21T00:06:31.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27ac005740 con 0x7f27b00675d0 2021-10-21T00:06:31.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b0156000 con 0x7f27b00675d0 2021-10-21T00:06:31.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b014a9f0 con 0x7f27b00675d0 2021-10-21T00:06:31.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.533+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27ac010070 con 0x7f27b00675d0 2021-10-21T00:06:31.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.537+0000 7f279e7fc700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.537+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f27ac06ae90 con 0x7f27b00675d0 2021-10-21T00:06:31.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.537+0000 7f27b4f82700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.537+0000 7f27b4f82700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 0x7f2790055a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f27a000b000 tx=0x7f27a0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.541+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27ac041ff0 con 0x7f27b00675d0 2021-10-21T00:06:31.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.665+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27b005d8f0 con 0x7f27b00675d0 2021-10-21T00:06:31.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f279e7fc700 1 -- 172.21.15.41:0/478417808 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f27ac018070 con 0x7f27b00675d0 2021-10-21T00:06:31.674 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:31.674 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":50,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:29.180913+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:06:25.860491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-21T00:06:27.113771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:31.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 msgr2=0x7f2790055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 0x7f2790055a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f27a000b000 tx=0x7f27a0006df0).stop 2021-10-21T00:06:31.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 msgr2=0x7f27b0112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f27b00ad880 tx=0x7f27ac007c00).stop 2021-10-21T00:06:31.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 shutdown_connections 2021-10-21T00:06:31.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b00b1820 0x7f27b0111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b00679b0 0x7f27b00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 --2- 172.21.15.41:0/478417808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f27b00675d0 0x7f27b0112110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 >> 172.21.15.41:0/478417808 conn(0x7f27b00639f0 msgr2=0x7f27b0145bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:31.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 shutdown_connections 2021-10-21T00:06:31.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.669+0000 7f27b6785700 1 -- 172.21.15.41:0/478417808 wait complete. 2021-10-21T00:06:31.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:06:25.860491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:06:27.113771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:06:31.688 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:06:31.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.793+0000 7fe6053ed700 1 Processor -- start 2021-10-21T00:06:31.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.793+0000 7fe6053ed700 1 -- start start 2021-10-21T00:06:31.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b9ca0 0x7fe6000b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 0x7fe6000b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6000b24b0 0x7fe6000b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000ba080 con 0x7fe6000b24b0 2021-10-21T00:06:31.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60005c670 con 0x7fe6000b31e0 2021-10-21T00:06:31.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe6053ed700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60005c8e0 con 0x7fe6000b9ca0 2021-10-21T00:06:31.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6000b24b0 0x7fe6000b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6000b24b0 0x7fe6000b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60622/0 (socket says 172.21.15.41:60622) 2021-10-21T00:06:31.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 -- 172.21.15.41:0/182012790 learned_addr learned my addr 172.21.15.41:0/182012790 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:31.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5fe7fc700 1 --2- 172.21.15.41:0/182012790 >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 0x7fe6000b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5feffd700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b9ca0 0x7fe6000b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 -- 172.21.15.41:0/182012790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b9ca0 msgr2=0x7fe6000b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:31.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b9ca0 0x7fe6000b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 -- 172.21.15.41:0/182012790 >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 msgr2=0x7fe6000b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:31.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 --2- 172.21.15.41:0/182012790 >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 0x7fe6000b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 -- 172.21.15.41:0/182012790 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60005cb80 con 0x7fe6000b24b0 2021-10-21T00:06:31.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5fe7fc700 1 --2- 172.21.15.41:0/182012790 >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 0x7fe6000b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:31.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5ff7fe700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b24b0 0x7fe6000b2900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fe5f80032f0 tx=0x7fe5f8009290).ready entity=mon.0 client_cookie=65d7000af52d54e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5fdffb700 1 -- 172.21.15.41:0/182012790 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f800b680 con 0x7fe6000b24b0 2021-10-21T00:06:31.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5fdffb700 1 -- 172.21.15.41:0/182012790 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800b7e0 con 0x7fe6000b24b0 2021-10-21T00:06:31.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.797+0000 7fe5fdffb700 1 -- 172.21.15.41:0/182012790 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f800b950 con 0x7fe6000b24b0 2021-10-21T00:06:31.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- 172.21.15.41:0/182012790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b24b0 msgr2=0x7fe6000b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b24b0 0x7fe6000b2900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fe5f80032f0 tx=0x7fe5f8009290).stop 2021-10-21T00:06:31.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- 172.21.15.41:0/182012790 shutdown_connections 2021-10-21T00:06:31.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b24b0 0x7fe6000b2900 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- 172.21.15.41:0/182012790 >> v2:172.21.15.62:3300/0 conn(0x7fe6000b31e0 0x7fe6000b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- 172.21.15.41:0/182012790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b9ca0 0x7fe6000b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- 172.21.15.41:0/182012790 >> 172.21.15.41:0/182012790 conn(0x7fe600062f00 msgr2=0x7fe6000b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:31.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- 172.21.15.41:0/182012790 shutdown_connections 2021-10-21T00:06:31.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- 172.21.15.41:0/182012790 wait complete. 2021-10-21T00:06:31.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 Processor -- start 2021-10-21T00:06:31.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- start start 2021-10-21T00:06:31.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 0x7fe6000b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b31e0 0x7fe600151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000aeb20 con 0x7fe6000b9ca0 2021-10-21T00:06:31.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000aedc0 con 0x7fe6000b24b0 2021-10-21T00:06:31.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe6053ed700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600155080 con 0x7fe6000b31e0 2021-10-21T00:06:31.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe5fe7fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b31e0 0x7fe600151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60628/0 (socket says 172.21.15.41:60628) 2021-10-21T00:06:31.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 0x7fe6000b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.801+0000 7fe5ff7fe700 1 -- 172.21.15.41:0/2166161897 learned_addr learned my addr 172.21.15.41:0/2166161897 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:31.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 -- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b31e0 msgr2=0x7fe600151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b31e0 0x7fe600151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 -- 172.21.15.41:0/2166161897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 msgr2=0x7fe600155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 -- 172.21.15.41:0/2166161897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f400b180 con 0x7fe6000b24b0 2021-10-21T00:06:31.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5ff7fe700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:31.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5feffd700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 0x7fe6000b8530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fe5f000c000 tx=0x7fe5f0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f0011750 con 0x7fe6000b24b0 2021-10-21T00:06:31.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00118b0 con 0x7fe6000b24b0 2021-10-21T00:06:31.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f0011c10 con 0x7fe6000b24b0 2021-10-21T00:06:31.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8009530 con 0x7fe6000b24b0 2021-10-21T00:06:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6000ade40 con 0x7fe6000b24b0 2021-10-21T00:06:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600155240 con 0x7fe6000b24b0 2021-10-21T00:06:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5f0011d70 con 0x7fe6000b24b0 2021-10-21T00:06:31.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.805+0000 7fe5effff700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 0x7fe5dc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:31.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.809+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe5f006bcd0 con 0x7fe6000b24b0 2021-10-21T00:06:31.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.809+0000 7fe5fe7fc700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 0x7fe5dc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:31.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.809+0000 7fe5fe7fc700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 0x7fe5dc055b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe5f400b000 tx=0x7fe5f4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:31.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.813+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5f0042d30 con 0x7fe6000b24b0 2021-10-21T00:06:31.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.941+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe600057350 con 0x7fe6000b24b0 2021-10-21T00:06:31.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe5effff700 1 -- 172.21.15.41:0/2166161897 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v50) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5f0046350 con 0x7fe6000b24b0 2021-10-21T00:06:31.949 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:06:31.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 msgr2=0x7fe5dc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 0x7fe5dc055b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe5f400b000 tx=0x7fe5f4006df0).stop 2021-10-21T00:06:31.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 msgr2=0x7fe6000b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:31.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 0x7fe6000b8530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fe5f000c000 tx=0x7fe5f0006df0).stop 2021-10-21T00:06:31.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 shutdown_connections 2021-10-21T00:06:31.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5dc0536a0 0x7fe5dc055b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6000b9ca0 0x7fe600155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6000b31e0 0x7fe600151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 --2- 172.21.15.41:0/2166161897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6000b24b0 0x7fe6000b8530 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:31.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 >> 172.21.15.41:0/2166161897 conn(0x7fe600062f00 msgr2=0x7fe600141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:31.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 shutdown_connections 2021-10-21T00:06:31.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:31.945+0000 7fe6053ed700 1 -- 172.21.15.41:0/2166161897 wait complete. 2021-10-21T00:06:31.969 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:06:32.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.077+0000 7ff6e3429700 1 Processor -- start 2021-10-21T00:06:32.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.077+0000 7ff6e3429700 1 -- start start 2021-10-21T00:06:32.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e3429700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e3429700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc13ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e3429700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0b6350 con 0x7ff6dc1423a0 2021-10-21T00:06:32.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e3429700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0b0e10 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e3429700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0b10b0 con 0x7ff6dc067a00 2021-10-21T00:06:32.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2c28700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc13ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44318/0 (socket says 172.21.15.41:44318) 2021-10-21T00:06:32.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 -- 172.21.15.41:0/2947113692 learned_addr learned my addr 172.21.15.41:0/2947113692 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 -- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 msgr2=0x7ff6dc13ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:32.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 --2- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc13ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 -- 172.21.15.41:0/2947113692 >> v1:172.21.15.62:6789/0 conn(0x7ff6dc1423a0 legacy=0x7ff6dc0672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 -- 172.21.15.41:0/2947113692 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0b1350 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e2427700 1 --2- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff6d8002f70 tx=0x7ff6d8006e40).ready entity=mon.1 client_cookie=6691a45cad3689b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e1425700 1 -- 172.21.15.41:0/2947113692 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d800bc90 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e1425700 1 -- 172.21.15.41:0/2947113692 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8000e90 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.081+0000 7ff6e1425700 1 -- 172.21.15.41:0/2947113692 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d80153f0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc0b5f70 msgr2=0x7ff6dc0b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 --2- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff6d8002f70 tx=0x7ff6d8006e40).stop 2021-10-21T00:06:32.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- 172.21.15.41:0/2947113692 shutdown_connections 2021-10-21T00:06:32.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 --2- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc13ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 --2- 172.21.15.41:0/2947113692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc0b1a90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- 172.21.15.41:0/2947113692 >> 172.21.15.41:0/2947113692 conn(0x7ff6dc0639f0 msgr2=0x7ff6dc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- 172.21.15.41:0/2947113692 shutdown_connections 2021-10-21T00:06:32.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- 172.21.15.41:0/2947113692 wait complete. 2021-10-21T00:06:32.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 Processor -- start 2021-10-21T00:06:32.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.085+0000 7ff6e3429700 1 -- start start 2021-10-21T00:06:32.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc0666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc1423a0 0x7ff6dc113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60640/0 (socket says 172.21.15.41:60640) 2021-10-21T00:06:32.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 -- 172.21.15.41:0/3929498082 learned_addr learned my addr 172.21.15.41:0/3929498082 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc111cf0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1103b0 con 0x7ff6dc1423a0 2021-10-21T00:06:32.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc10fe70 con 0x7ff6dc067a00 2021-10-21T00:06:32.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e2427700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc0666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e2c28700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc1423a0 0x7ff6dc113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 -- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 msgr2=0x7ff6dc0666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc0666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 -- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc1423a0 msgr2=0x7ff6dc113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc1423a0 0x7ff6dc113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d800d4d0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e1c26700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ff6dc110540 tx=0x7ff6cc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6cc012400 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc012560 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6cc0128c0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc110110 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.089+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc110600 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc113810 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff6cc019030 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6cb7fe700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 0x7ff6bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff6cc06acb0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6e2427700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 0x7ff6bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.093+0000 7ff6e2427700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 0x7ff6bc055a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff6d801b000 tx=0x7ff6d8018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.101+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff6cc041d00 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.229+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6dc0b15f0 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6cb7fe700 1 -- 172.21.15.41:0/3929498082 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6cc045320 con 0x7ff6dc0b5f70 2021-10-21T00:06:32.237 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:32.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 msgr2=0x7ff6bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 0x7ff6bc055a40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff6d801b000 tx=0x7ff6d8018000).stop 2021-10-21T00:06:32.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 msgr2=0x7ff6dc113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7ff6dc110540 tx=0x7ff6cc007c50).stop 2021-10-21T00:06:32.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 shutdown_connections 2021-10-21T00:06:32.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6bc053580 0x7ff6bc055a40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6dc1423a0 0x7ff6dc113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6dc0b5f70 0x7ff6dc113a70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 --2- 172.21.15.41:0/3929498082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6dc067a00 0x7ff6dc0666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 >> 172.21.15.41:0/3929498082 conn(0x7ff6dc0639f0 msgr2=0x7ff6dc0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 shutdown_connections 2021-10-21T00:06:32.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.233+0000 7ff6e3429700 1 -- 172.21.15.41:0/3929498082 wait complete. 2021-10-21T00:06:32.250 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:06:32.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 Processor -- start 2021-10-21T00:06:32.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 -- start start 2021-10-21T00:06:32.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf8005bca0 0x7faf8005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf800b2e00 0x7faf801466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf80142880 0x7faf80142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf80066490 con 0x7faf80142880 2021-10-21T00:06:32.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf80145f60 con 0x7faf800b2e00 2021-10-21T00:06:32.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf863d0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf80146200 con 0x7faf8005bca0 2021-10-21T00:06:32.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf80142880 0x7faf80142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf80142880 0x7faf80142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60650/0 (socket says 172.21.15.41:60650) 2021-10-21T00:06:32.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 -- 172.21.15.41:0/450135435 learned_addr learned my addr 172.21.15.41:0/450135435 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf84bcd700 1 --2- 172.21.15.41:0/450135435 >> v2:172.21.15.62:3300/0 conn(0x7faf800b2e00 0x7faf801466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf853ce700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf8005bca0 0x7faf8005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 -- 172.21.15.41:0/450135435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf8005bca0 msgr2=0x7faf8005c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:32.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf8005bca0 0x7faf8005c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 -- 172.21.15.41:0/450135435 >> v2:172.21.15.62:3300/0 conn(0x7faf800b2e00 msgr2=0x7faf801466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:32.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 --2- 172.21.15.41:0/450135435 >> v2:172.21.15.62:3300/0 conn(0x7faf800b2e00 0x7faf801466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.353+0000 7faf85bcf700 1 -- 172.21.15.41:0/450135435 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800b27f0 con 0x7faf80142880 2021-10-21T00:06:32.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf85bcf700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf80142cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7faf780032f0 tx=0x7faf78009290).ready entity=mon.0 client_cookie=84f630d6ea2a356e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf73fff700 1 -- 172.21.15.41:0/450135435 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7800b870 con 0x7faf80142880 2021-10-21T00:06:32.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf73fff700 1 -- 172.21.15.41:0/450135435 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800b9d0 con 0x7faf80142880 2021-10-21T00:06:32.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf73fff700 1 -- 172.21.15.41:0/450135435 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7800bb40 con 0x7faf80142880 2021-10-21T00:06:32.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- 172.21.15.41:0/450135435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 msgr2=0x7faf80142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf80142cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7faf780032f0 tx=0x7faf78009290).stop 2021-10-21T00:06:32.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- 172.21.15.41:0/450135435 shutdown_connections 2021-10-21T00:06:32.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf80142cf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 --2- 172.21.15.41:0/450135435 >> v2:172.21.15.62:3300/0 conn(0x7faf800b2e00 0x7faf801466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 --2- 172.21.15.41:0/450135435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf8005bca0 0x7faf8005c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- 172.21.15.41:0/450135435 >> 172.21.15.41:0/450135435 conn(0x7faf80069df0 msgr2=0x7faf80063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- 172.21.15.41:0/450135435 shutdown_connections 2021-10-21T00:06:32.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- 172.21.15.41:0/450135435 wait complete. 2021-10-21T00:06:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 Processor -- start 2021-10-21T00:06:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.357+0000 7faf863d0700 1 -- start start 2021-10-21T00:06:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf8005bca0 0x7faf8013fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf800b2e00 0x7faf80141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80156000 con 0x7faf80142880 2021-10-21T00:06:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80145590 con 0x7faf8005bca0 2021-10-21T00:06:32.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf80145830 con 0x7faf800b2e00 2021-10-21T00:06:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60656/0 (socket says 172.21.15.41:60656) 2021-10-21T00:06:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 -- 172.21.15.41:0/274363521 learned_addr learned my addr 172.21.15.41:0/274363521 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf853ce700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf8005bca0 0x7faf8013fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf84bcd700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf800b2e00 0x7faf80141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 -- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf800b2e00 msgr2=0x7faf80141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf800b2e00 0x7faf80141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 -- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf8005bca0 msgr2=0x7faf8013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf8005bca0 0x7faf8013fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 -- 172.21.15.41:0/274363521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009530 con 0x7faf80142880 2021-10-21T00:06:32.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf85bcf700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7faf780032f0 tx=0x7faf78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7800b870 con 0x7faf80142880 2021-10-21T00:06:32.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78021630 con 0x7faf80142880 2021-10-21T00:06:32.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf80141a70 con 0x7faf80142880 2021-10-21T00:06:32.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf78021990 con 0x7faf80142880 2021-10-21T00:06:32.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.361+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf80155b90 con 0x7faf80142880 2021-10-21T00:06:32.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf801459f0 con 0x7faf80142880 2021-10-21T00:06:32.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf78027020 con 0x7faf80142880 2021-10-21T00:06:32.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf727fc700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 0x7faf60055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf7806cbb0 con 0x7faf80142880 2021-10-21T00:06:32.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf853ce700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 0x7faf60055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.365+0000 7faf853ce700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 0x7faf60055a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7faf7c00c000 tx=0x7faf7c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.373+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf78073080 con 0x7faf80142880 2021-10-21T00:06:32.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.497+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf80143770 con 0x7faf80142880 2021-10-21T00:06:32.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.497+0000 7faf727fc700 1 -- 172.21.15.41:0/274363521 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+10 (secure 0 0 0) 0x7faf78015020 con 0x7faf80142880 2021-10-21T00:06:32.504 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 msgr2=0x7faf60055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 0x7faf60055a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7faf7c00c000 tx=0x7faf7c008040).stop 2021-10-21T00:06:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 msgr2=0x7faf8013b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7faf780032f0 tx=0x7faf78016000).stop 2021-10-21T00:06:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 shutdown_connections 2021-10-21T00:06:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf600535b0 0x7faf60055a70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf80142880 0x7faf8013b7d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf800b2e00 0x7faf80141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 --2- 172.21.15.41:0/274363521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf8005bca0 0x7faf8013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 >> 172.21.15.41:0/274363521 conn(0x7faf80069df0 msgr2=0x7faf80129b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 shutdown_connections 2021-10-21T00:06:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.501+0000 7faf863d0700 1 -- 172.21.15.41:0/274363521 wait complete. 2021-10-21T00:06:32.523 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:06:32.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.625+0000 7f4240e35700 1 Processor -- start 2021-10-21T00:06:32.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.625+0000 7f4240e35700 1 -- start start 2021-10-21T00:06:32.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f423c0b9ca0 0x7f423c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 0x7f423c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0ba080 con 0x7f423c0b31e0 2021-10-21T00:06:32.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c05c670 con 0x7f423c0b9ca0 2021-10-21T00:06:32.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c05c8e0 con 0x7f423c0b26d0 2021-10-21T00:06:32.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4239d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f423c0b31e0 0x7f423c0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58430/0 (socket says 172.21.15.41:58430) 2021-10-21T00:06:32.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4239d9b700 1 -- 172.21.15.41:0/2288043557 learned_addr learned my addr 172.21.15.41:0/2288043557 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:32.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 --2- 172.21.15.41:0/2288043557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 0x7f423c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423a59c700 1 --2- 172.21.15.41:0/2288043557 >> v2:172.21.15.62:3300/0 conn(0x7f423c0b9ca0 0x7f423c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265176708 0 0) 0x7f423c0ba080 con 0x7f423c0b31e0 2021-10-21T00:06:32.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4220003260 con 0x7f423c0b31e0 2021-10-21T00:06:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 -- 172.21.15.41:0/2288043557 >> v2:172.21.15.62:3300/0 conn(0x7f423c0b9ca0 msgr2=0x7f423c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 --2- 172.21.15.41:0/2288043557 >> v2:172.21.15.62:3300/0 conn(0x7f423c0b9ca0 0x7f423c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443652726 0 0) 0x7f4220003260 con 0x7f423c0b31e0 2021-10-21T00:06:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 -- 172.21.15.41:0/2288043557 >> v1:172.21.15.41:6789/0 conn(0x7f423c0b31e0 legacy=0x7f423c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 -- 172.21.15.41:0/2288043557 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c05cb80 con 0x7f423c0b26d0 2021-10-21T00:06:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423ad9d700 1 --2- 172.21.15.41:0/2288043557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 0x7f423c141bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f422c001800 tx=0x7f42340091d0).ready entity=mon.2 client_cookie=21d30e98c77ae793 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f422c001660 con 0x7f423c0b26d0 2021-10-21T00:06:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423400f510 con 0x7f423c0b26d0 2021-10-21T00:06:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f423959a700 1 -- 172.21.15.41:0/2288043557 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f423400f680 con 0x7f423c0b26d0 2021-10-21T00:06:32.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- 172.21.15.41:0/2288043557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 msgr2=0x7f423c141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 --2- 172.21.15.41:0/2288043557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 0x7f423c141bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f422c001800 tx=0x7f42340091d0).stop 2021-10-21T00:06:32.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- 172.21.15.41:0/2288043557 shutdown_connections 2021-10-21T00:06:32.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 --2- 172.21.15.41:0/2288043557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b26d0 0x7f423c141bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 --2- 172.21.15.41:0/2288043557 >> v2:172.21.15.62:3300/0 conn(0x7f423c0b9ca0 0x7f423c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- 172.21.15.41:0/2288043557 >> 172.21.15.41:0/2288043557 conn(0x7f423c062f00 msgr2=0x7f423c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- 172.21.15.41:0/2288043557 shutdown_connections 2021-10-21T00:06:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.629+0000 7f4240e35700 1 -- 172.21.15.41:0/2288043557 wait complete. 2021-10-21T00:06:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 Processor -- start 2021-10-21T00:06:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- start start 2021-10-21T00:06:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f423c0b26d0 0x7f423c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 0x7f423c0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0adae0 con 0x7f423c0b31e0 2021-10-21T00:06:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0add70 con 0x7f423c0b26d0 2021-10-21T00:06:32.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0ae010 con 0x7f423c0b9ca0 2021-10-21T00:06:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60666/0 (socket says 172.21.15.41:60666) 2021-10-21T00:06:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 -- 172.21.15.41:0/3900772855 learned_addr learned my addr 172.21.15.41:0/3900772855 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f423ad9d700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 0x7f423c0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f423a59c700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f423c0b26d0 0x7f423c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 -- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 msgr2=0x7f423c0b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 0x7f423c0b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 -- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f423c0b26d0 msgr2=0x7f423c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f423c0b26d0 0x7f423c155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 -- 172.21.15.41:0/3900772855 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009470 con 0x7f423c0b31e0 2021-10-21T00:06:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f423ad9d700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 0x7f423c0b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4239d9b700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f422c0018c0 tx=0x7f422c001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f422c007170 con 0x7f423c0b31e0 2021-10-21T00:06:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0072d0 con 0x7f423c0b31e0 2021-10-21T00:06:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0ae460 con 0x7f423c0b31e0 2021-10-21T00:06:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f422c004920 con 0x7f423c0b31e0 2021-10-21T00:06:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.633+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c113e20 con 0x7f423c0b31e0 2021-10-21T00:06:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c057350 con 0x7f423c0b31e0 2021-10-21T00:06:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f422c004a80 con 0x7f423c0b31e0 2021-10-21T00:06:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f422b7fe700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 0x7f4218055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f422c06b810 con 0x7f423c0b31e0 2021-10-21T00:06:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f423a59c700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 0x7f4218055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.637+0000 7f423a59c700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 0x7f4218055b00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f423000b000 tx=0x7f4230008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.645+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f422c042890 con 0x7f423c0b31e0 2021-10-21T00:06:32.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f423c0ae5f0 con 0x7f423c0b31e0 2021-10-21T00:06:32.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f422b7fe700 1 -- 172.21.15.41:0/3900772855 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+10 (secure 0 0 0) 0x7f422c045eb0 con 0x7f423c0b31e0 2021-10-21T00:06:32.775 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:32.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 msgr2=0x7f4218055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 0x7f4218055b00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f423000b000 tx=0x7f4230008040).stop 2021-10-21T00:06:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 msgr2=0x7f423c0ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f422c0018c0 tx=0x7f422c001b30).stop 2021-10-21T00:06:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 shutdown_connections 2021-10-21T00:06:32.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4218053640 0x7f4218055b00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f423c0b9ca0 0x7f423c0b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f423c0b31e0 0x7f423c0ad5f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 --2- 172.21.15.41:0/3900772855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f423c0b26d0 0x7f423c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.769+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 >> 172.21.15.41:0/3900772855 conn(0x7f423c062f00 msgr2=0x7f423c142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.773+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 shutdown_connections 2021-10-21T00:06:32.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.773+0000 7f4240e35700 1 -- 172.21.15.41:0/3900772855 wait complete. 2021-10-21T00:06:32.787 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:06:32.788 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:32.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.881+0000 7f940751e700 1 Processor -- start 2021-10-21T00:06:32.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.881+0000 7f940751e700 1 -- start start 2021-10-21T00:06:32.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940751e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 0x7f940005c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940751e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9400142520 0x7f9400145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940751e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94000b6350 con 0x7f94000b1a50 2021-10-21T00:06:32.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940751e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9400067d00 con 0x7f9400142520 2021-10-21T00:06:32.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940751e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940005cee0 con 0x7f94000b5f70 2021-10-21T00:06:32.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940651c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 0x7f940005c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9400142520 0x7f9400145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940651c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 0x7f940005c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50940/0 (socket says 172.21.15.41:50940) 2021-10-21T00:06:32.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940651c700 1 -- 172.21.15.41:0/1134627380 learned_addr learned my addr 172.21.15.41:0/1134627380 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 -- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 msgr2=0x7f940005c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:32.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 --2- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 0x7f940005c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 -- 172.21.15.41:0/1134627380 >> v1:172.21.15.62:6789/0 conn(0x7f94000b1a50 legacy=0x7f9400141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 -- 172.21.15.41:0/1134627380 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940005d180 con 0x7f9400142520 2021-10-21T00:06:32.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f9406d1d700 1 --2- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9400142520 0x7f9400145ef0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f93f80032f0 tx=0x7f93f80091d0).ready entity=mon.1 client_cookie=e425194feeb0bba2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940551a700 1 -- 172.21.15.41:0/1134627380 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f800b6c0 con 0x7f9400142520 2021-10-21T00:06:32.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940551a700 1 -- 172.21.15.41:0/1134627380 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800b820 con 0x7f9400142520 2021-10-21T00:06:32.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.885+0000 7f940551a700 1 -- 172.21.15.41:0/1134627380 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f800b990 con 0x7f9400142520 2021-10-21T00:06:32.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9400142520 msgr2=0x7f9400145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9400142520 0x7f9400145ef0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f93f80032f0 tx=0x7f93f80091d0).stop 2021-10-21T00:06:32.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- 172.21.15.41:0/1134627380 shutdown_connections 2021-10-21T00:06:32.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9400142520 0x7f9400145ef0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- 172.21.15.41:0/1134627380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b5f70 0x7f940005c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- 172.21.15.41:0/1134627380 >> 172.21.15.41:0/1134627380 conn(0x7f94000639f0 msgr2=0x7f94000b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:32.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- 172.21.15.41:0/1134627380 shutdown_connections 2021-10-21T00:06:32.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- 172.21.15.41:0/1134627380 wait complete. 2021-10-21T00:06:32.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 Processor -- start 2021-10-21T00:06:32.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- start start 2021-10-21T00:06:32.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b1a50 0x7f94000b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94000b5f70 0x7f940013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400067290 con 0x7f9400142520 2021-10-21T00:06:32.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400144180 con 0x7f94000b5f70 2021-10-21T00:06:32.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940751e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400144420 con 0x7f94000b1a50 2021-10-21T00:06:32.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f9406d1d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f9406d1d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60682/0 (socket says 172.21.15.41:60682) 2021-10-21T00:06:32.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f9406d1d700 1 -- 172.21.15.41:0/2018425050 learned_addr learned my addr 172.21.15.41:0/2018425050 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:32.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f940651c700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b1a50 0x7f94000b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.889+0000 7f9405d1b700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94000b5f70 0x7f940013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 -- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b1a50 msgr2=0x7f94000b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b1a50 0x7f94000b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 -- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94000b5f70 msgr2=0x7f940013ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:32.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94000b5f70 0x7f940013ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:32.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 -- 172.21.15.41:0/2018425050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009470 con 0x7f9400142520 2021-10-21T00:06:32.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f9406d1d700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f93f80032f0 tx=0x7f93f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f8011e20 con 0x7f9400142520 2021-10-21T00:06:32.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f8020400 con 0x7f9400142520 2021-10-21T00:06:32.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94001446c0 con 0x7f9400142520 2021-10-21T00:06:32.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93f8020760 con 0x7f9400142520 2021-10-21T00:06:32.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94000b4db0 con 0x7f9400142520 2021-10-21T00:06:32.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9400057350 con 0x7f9400142520 2021-10-21T00:06:32.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f93f801e070 con 0x7f9400142520 2021-10-21T00:06:32.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 0x7f93e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:32.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93f806c950 con 0x7f9400142520 2021-10-21T00:06:32.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.893+0000 7f940651c700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 0x7f93e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:32.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.897+0000 7f940651c700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 0x7f93e0055b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f93fc008000 tx=0x7f93fc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:32.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:32.901+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93f80439e0 con 0x7f9400142520 2021-10-21T00:06:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.065+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f940005f050 con 0x7f9400142520 2021-10-21T00:06:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f93ef7fe700 1 -- 172.21.15.41:0/2018425050 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f93f8015020 con 0x7f9400142520 2021-10-21T00:06:33.074 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:33.075 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:33.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 msgr2=0x7f93e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:33.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 0x7f93e0055b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f93fc008000 tx=0x7f93fc008040).stop 2021-10-21T00:06:33.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 msgr2=0x7f940013e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:33.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f93f80032f0 tx=0x7f93f8016000).stop 2021-10-21T00:06:33.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 shutdown_connections 2021-10-21T00:06:33.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f93e00536d0 0x7f93e0055b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:33.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9400142520 0x7f940013e2c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:33.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94000b5f70 0x7f940013ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:33.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 --2- 172.21.15.41:0/2018425050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94000b1a50 0x7f94000b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:33.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 >> 172.21.15.41:0/2018425050 conn(0x7f94000639f0 msgr2=0x7f94000b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:33.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 shutdown_connections 2021-10-21T00:06:33.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:33.069+0000 7f940751e700 1 -- 172.21.15.41:0/2018425050 wait complete. 2021-10-21T00:06:33.079 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:33.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:06:28.177510+0000', 'modified': '2021-10-21T00:06:29.181089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5619': {'gid': 5619, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3050633316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3050633316}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3050633316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:06:33.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:06:33.289 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:06:33.407 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5619,"want_state":"up:active","state":"up:active","rank_uptime":5.2154919230000001,"mdsmap_epoch":21,"osdmap_epoch":50,"osdmap_epoch_barrier":49,"uptime":10.306332437} 2021-10-21T00:06:33.407 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5619, "mdsmap_epoch": 21, "osdmap_epoch": 50, "osdmap_epoch_barrier": 49, "rank_uptime": 5.215491923, "state": "up:active", "uptime": 10.306332437, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:06:33.408 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:06:33.408 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:06:33.409 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:06:33.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:33.410 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:33.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:33.436 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:33.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:33.493 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:33.494 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:33.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:33.496 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:33.501 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:06:33.502 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:33.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:33.522 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:33.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:33.578 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:33.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:06:33.574+0000 7f6a16ebc080 -1 init, newargv = 0x55f248f49150 newargc=9 2021-10-21T00:06:33.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14196]: starting ceph client 2021-10-21T00:06:33.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:33.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:33.582 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:33.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14196]: starting fuse 2021-10-21T00:06:34.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:34.707 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:34.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:34.767 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:34.768 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:34.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:34.770 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:34.777 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:06:34.777 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:06:34.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:34.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:06:34.779 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:06:34.779 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:06:34.780 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:06:34.780 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:06:34.781 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:34.781 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:06:34.782 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:06:34.782 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:06:34.782 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:34.783 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:06:34.783 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:06:34.784 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:06:34.784 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:06:34.785 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:34.785 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:06:34.786 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:06:34.786 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:06:34.787 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:06:34.787 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:06:34.787 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:34.788 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:06:34.788 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:06:34.834 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14196.asok 2021-10-21T00:06:34.839 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14196.asok 2021-10-21T00:06:34.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:34.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14196.asok status 2021-10-21T00:06:34.970 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:06:34.971 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:06:34.971 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:06:34.971 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:06:34.972 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:06:34.972 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:06:34.972 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:06:34.972 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14196", 2021-10-21T00:06:34.972 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:06:34.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:34.973 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:06:34.973 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:06:34.973 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5743, 2021-10-21T00:06:34.974 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:06:34.974 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:06:34.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:06:34.974 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5743 2021-10-21T00:06:34.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:34.975 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:06:34.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:06:34.975 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:06:34.975 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2363418844 2021-10-21T00:06:34.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:06:34.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:34.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:06:34.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:06:34.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:06:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2363418844 2021-10-21T00:06:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5743 172.21.15.71:0/2363418844", 2021-10-21T00:06:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/2363418844", 2021-10-21T00:06:34.977 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:06:34.978 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 21, 2021-10-21T00:06:34.978 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 50, 2021-10-21T00:06:34.978 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:06:34.978 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:06:34.978 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:06:34.979 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:06:34.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:34.981 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:34.981 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:34.991 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:06:34.993 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:34.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:34.995 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:35.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:35.057 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:35.058 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:35.066 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:06:35.068 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:35.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:06:35.069 DEBUG:teuthology.orchestra.run.smithi071:> import sys 2021-10-21T00:06:35.069 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:06:35.070 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:06:35.071 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:35.071 DEBUG:teuthology.orchestra.run.smithi071:> n = 1000 2021-10-21T00:06:35.072 DEBUG:teuthology.orchestra.run.smithi071:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-21T00:06:35.072 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:35.072 DEBUG:teuthology.orchestra.run.smithi071:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-21T00:06:35.073 DEBUG:teuthology.orchestra.run.smithi071:> os.makedirs(os.path.dirname(abs_path)) 2021-10-21T00:06:35.073 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:35.074 DEBUG:teuthology.orchestra.run.smithi071:> for i in range(0, n): 2021-10-21T00:06:35.074 DEBUG:teuthology.orchestra.run.smithi071:> fname = "{0}_{1}".format(abs_path, i) 2021-10-21T00:06:35.075 DEBUG:teuthology.orchestra.run.smithi071:> with open(fname, '"'"'w'"'"') as f: 2021-10-21T00:06:35.075 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:06:35.075 DEBUG:teuthology.orchestra.run.smithi071:> if True: 2021-10-21T00:06:35.076 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:06:35.076 DEBUG:teuthology.orchestra.run.smithi071:> os.fsync(f.fileno()) 2021-10-21T00:06:35.077 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:06:44.391 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:44.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 Processor -- start 2021-10-21T00:06:44.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 -- start start 2021-10-21T00:06:44.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062330 0x7efd800b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd80062f70 0x7efd8005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efd800b3a20 0x7efd8013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8005bd40 con 0x7efd800b3a20 2021-10-21T00:06:44.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8005bf70 con 0x7efd80062f70 2021-10-21T00:06:44.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd86031700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80142cb0 con 0x7efd80062330 2021-10-21T00:06:44.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efd800b3a20 0x7efd8013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd8482e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd80062f70 0x7efd8005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efd800b3a20 0x7efd8013c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60692/0 (socket says 172.21.15.41:60692) 2021-10-21T00:06:44.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd8502f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062330 0x7efd800b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 -- 172.21.15.41:0/3710284727 learned_addr learned my addr 172.21.15.41:0/3710284727 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:44.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 -- 172.21.15.41:0/3710284727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062330 msgr2=0x7efd800b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:44.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 --2- 172.21.15.41:0/3710284727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062330 0x7efd800b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 -- 172.21.15.41:0/3710284727 >> v2:172.21.15.62:3300/0 conn(0x7efd80062f70 msgr2=0x7efd8005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:44.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 --2- 172.21.15.41:0/3710284727 >> v2:172.21.15.62:3300/0 conn(0x7efd80062f70 0x7efd8005c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 -- 172.21.15.41:0/3710284727 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80142950 con 0x7efd800b3a20 2021-10-21T00:06:44.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd85830700 1 --2- 172.21.15.41:0/3710284727 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd800b3a20 0x7efd8013c510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efd780032f0 tx=0x7efd78009290).ready entity=mon.0 client_cookie=4401106d33b7d2dc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd6bfff700 1 -- 172.21.15.41:0/3710284727 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7800b680 con 0x7efd800b3a20 2021-10-21T00:06:44.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd6bfff700 1 -- 172.21.15.41:0/3710284727 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800b7e0 con 0x7efd800b3a20 2021-10-21T00:06:44.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.497+0000 7efd6bfff700 1 -- 172.21.15.41:0/3710284727 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7800b950 con 0x7efd800b3a20 2021-10-21T00:06:44.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- 172.21.15.41:0/3710284727 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd800b3a20 msgr2=0x7efd8013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 --2- 172.21.15.41:0/3710284727 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd800b3a20 0x7efd8013c510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efd780032f0 tx=0x7efd78009290).stop 2021-10-21T00:06:44.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- 172.21.15.41:0/3710284727 shutdown_connections 2021-10-21T00:06:44.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 --2- 172.21.15.41:0/3710284727 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd800b3a20 0x7efd8013c510 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 --2- 172.21.15.41:0/3710284727 >> v2:172.21.15.62:3300/0 conn(0x7efd80062f70 0x7efd8005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 --2- 172.21.15.41:0/3710284727 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062330 0x7efd800b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- 172.21.15.41:0/3710284727 >> 172.21.15.41:0/3710284727 conn(0x7efd800b9080 msgr2=0x7efd800b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:44.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- 172.21.15.41:0/3710284727 shutdown_connections 2021-10-21T00:06:44.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- 172.21.15.41:0/3710284727 wait complete. 2021-10-21T00:06:44.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 Processor -- start 2021-10-21T00:06:44.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.501+0000 7efd86031700 1 -- start start 2021-10-21T00:06:44.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062f70 0x7efd8013c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd800b3a20 0x7efd801520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80151ca0 con 0x7efd80062330 2021-10-21T00:06:44.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8013e320 con 0x7efd800b3a20 2021-10-21T00:06:44.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd801441f0 con 0x7efd80062f70 2021-10-21T00:06:44.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60694/0 (socket says 172.21.15.41:60694) 2021-10-21T00:06:44.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 -- 172.21.15.41:0/3345188132 learned_addr learned my addr 172.21.15.41:0/3345188132 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:44.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd85830700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd800b3a20 0x7efd801520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8482e700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062f70 0x7efd8013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 -- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062f70 msgr2=0x7efd8013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062f70 0x7efd8013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 -- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd800b3a20 msgr2=0x7efd801520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd800b3a20 0x7efd801520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 -- 172.21.15.41:0/3345188132 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009530 con 0x7efd80062330 2021-10-21T00:06:44.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd8502f700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7efd7c00c000 tx=0x7efd7c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7c010780 con 0x7efd80062330 2021-10-21T00:06:44.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c00b3b0 con 0x7efd80062330 2021-10-21T00:06:44.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd80144490 con 0x7efd80062330 2021-10-21T00:06:44.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7c010ad0 con 0x7efd80062330 2021-10-21T00:06:44.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.505+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80143e70 con 0x7efd80062330 2021-10-21T00:06:44.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80057350 con 0x7efd80062330 2021-10-21T00:06:44.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd7c010c30 con 0x7efd80062330 2021-10-21T00:06:44.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd72ffd700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 0x7efd5c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd7c06bdb0 con 0x7efd80062330 2021-10-21T00:06:44.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd8482e700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 0x7efd5c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.509+0000 7efd8482e700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 0x7efd5c055b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efd7400b000 tx=0x7efd74006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.517+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd7c070070 con 0x7efd80062330 2021-10-21T00:06:44.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.681+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd8005d080 con 0x7efd80062330 2021-10-21T00:06:44.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd72ffd700 1 -- 172.21.15.41:0/3345188132 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7efd7c042d80 con 0x7efd80062330 2021-10-21T00:06:44.689 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:44.689 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:44.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 msgr2=0x7efd5c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 0x7efd5c055b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efd7400b000 tx=0x7efd74006df0).stop 2021-10-21T00:06:44.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 msgr2=0x7efd801418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7efd7c00c000 tx=0x7efd7c006df0).stop 2021-10-21T00:06:44.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 shutdown_connections 2021-10-21T00:06:44.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efd5c0536a0 0x7efd5c055b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd800b3a20 0x7efd801520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efd80062f70 0x7efd8013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 --2- 172.21.15.41:0/3345188132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efd80062330 0x7efd801418c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 >> 172.21.15.41:0/3345188132 conn(0x7efd800b9080 msgr2=0x7efd800b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:44.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 shutdown_connections 2021-10-21T00:06:44.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.685+0000 7efd86031700 1 -- 172.21.15.41:0/3345188132 wait complete. 2021-10-21T00:06:44.695 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:44.704 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-10-21T00:06:44.805 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-21T00:06:44.806 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-21T00:06:44.806 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:44.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 Processor -- start 2021-10-21T00:06:44.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 -- start start 2021-10-21T00:06:44.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f796c0aa750 0x7f796c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0609d0 con 0x7f796c05f9f0 2021-10-21T00:06:44.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0b1620 con 0x7f796c0aa750 2021-10-21T00:06:44.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.901+0000 7f7970938700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c05fdd0 con 0x7f796c14b350 2021-10-21T00:06:44.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f796c0aa750 0x7f796c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796ad9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:50970/0 (socket says 172.21.15.41:50970) 2021-10-21T00:06:44.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f796c05f9f0 0x7f796c14a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38300/0 (socket says 172.21.15.41:38300) 2021-10-21T00:06:44.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796ad9d700 1 -- 172.21.15.41:0/4201380620 learned_addr learned my addr 172.21.15.41:0/4201380620 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:44.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796959a700 1 -- 172.21.15.41:0/4201380620 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686569703 0 0) 0x7f796c0609d0 con 0x7f796c05f9f0 2021-10-21T00:06:44.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796959a700 1 -- 172.21.15.41:0/4201380620 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7950003260 con 0x7f796c05f9f0 2021-10-21T00:06:44.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 -- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 msgr2=0x7f796c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:44.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 -- 172.21.15.41:0/4201380620 >> v1:172.21.15.62:6789/0 conn(0x7f796c05f9f0 legacy=0x7f796c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 -- 172.21.15.41:0/4201380620 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b1380 con 0x7f796c0aa750 2021-10-21T00:06:44.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796ad9d700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:06:44.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7969d9b700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0aa750 0x7f796c14ae60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f795c0032f0 tx=0x7f795c0091d0).ready entity=mon.1 client_cookie=7075c406c55bfaa0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796959a700 1 -- 172.21.15.41:0/4201380620 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795c00b600 con 0x7f796c0aa750 2021-10-21T00:06:44.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796959a700 1 -- 172.21.15.41:0/4201380620 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00b760 con 0x7f796c0aa750 2021-10-21T00:06:44.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f796959a700 1 -- 172.21.15.41:0/4201380620 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795c00b8d0 con 0x7f796c0aa750 2021-10-21T00:06:44.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 -- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0aa750 msgr2=0x7f796c14ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0aa750 0x7f796c14ae60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f795c0032f0 tx=0x7f795c0091d0).stop 2021-10-21T00:06:44.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 -- 172.21.15.41:0/4201380620 shutdown_connections 2021-10-21T00:06:44.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c14b350 0x7f796c0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 --2- 172.21.15.41:0/4201380620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0aa750 0x7f796c14ae60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 -- 172.21.15.41:0/4201380620 >> 172.21.15.41:0/4201380620 conn(0x7f796c05bca0 msgr2=0x7f796c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:44.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 -- 172.21.15.41:0/4201380620 shutdown_connections 2021-10-21T00:06:44.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.905+0000 7f7970938700 1 -- 172.21.15.41:0/4201380620 wait complete. 2021-10-21T00:06:44.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 Processor -- start 2021-10-21T00:06:44.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 -- start start 2021-10-21T00:06:44.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c05f9f0 0x7f796c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c0aa750 0x7f796c099260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ad6b0 con 0x7f796c14b350 2021-10-21T00:06:44.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ad8e0 con 0x7f796c05f9f0 2021-10-21T00:06:44.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7970938700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0adb80 con 0x7f796c0aa750 2021-10-21T00:06:44.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60712/0 (socket says 172.21.15.41:60712) 2021-10-21T00:06:44.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f7969d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c0aa750 0x7f796c099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 -- 172.21.15.41:0/3805883258 learned_addr learned my addr 172.21.15.41:0/3805883258 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:44.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c05f9f0 0x7f796c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 -- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c0aa750 msgr2=0x7f796c099260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c0aa750 0x7f796c099260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 -- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c05f9f0 msgr2=0x7f796c156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:44.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c05f9f0 0x7f796c156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:44.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.909+0000 7f796ad9d700 1 -- 172.21.15.41:0/3805883258 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796400b1e0 con 0x7f796c14b350 2021-10-21T00:06:44.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f796ad9d700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f796400c000 tx=0x7f7964006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964012600 con 0x7f796c14b350 2021-10-21T00:06:44.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964012760 con 0x7f796c14b350 2021-10-21T00:06:44.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c009470 con 0x7f796c14b350 2021-10-21T00:06:44.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964012ac0 con 0x7f796c14b350 2021-10-21T00:06:44.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0aef40 con 0x7f796c14b350 2021-10-21T00:06:44.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c0ac250 con 0x7f796c14b350 2021-10-21T00:06:44.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7964022070 con 0x7f796c14b350 2021-10-21T00:06:44.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 0x7f7948055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:44.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f796406bd50 con 0x7f796c14b350 2021-10-21T00:06:44.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.913+0000 7f796a59c700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 0x7f7948055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:44.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.917+0000 7f796a59c700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 0x7f7948055b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f796000d000 tx=0x7f7960009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:44.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:44.921+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f796c0ac250 con 0x7f796c14b350 2021-10-21T00:06:45.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.085+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f796c0ac220 con 0x7f796c14b350 2021-10-21T00:06:45.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.085+0000 7f795b7fe700 1 -- 172.21.15.41:0/3805883258 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f7964016090 con 0x7f796c14b350 2021-10-21T00:06:45.092 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:45.092 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:45.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 msgr2=0x7f7948055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 0x7f7948055b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f796000d000 tx=0x7f7960009040).stop 2021-10-21T00:06:45.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 msgr2=0x7f796c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f796400c000 tx=0x7f7964006eb0).stop 2021-10-21T00:06:45.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 shutdown_connections 2021-10-21T00:06:45.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7948053640 0x7f7948055b00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f796c14b350 0x7f796c146490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f796c0aa750 0x7f796c099260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 --2- 172.21.15.41:0/3805883258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c05f9f0 0x7f796c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 >> 172.21.15.41:0/3805883258 conn(0x7f796c05bca0 msgr2=0x7f796c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 shutdown_connections 2021-10-21T00:06:45.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.089+0000 7f7970938700 1 -- 172.21.15.41:0/3805883258 wait complete. 2021-10-21T00:06:45.098 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:45.106 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-21T00:06:45.208 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-21T00:06:45.209 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-21T00:06:45.209 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:06:45.228 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:45.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 Processor -- start 2021-10-21T00:06:45.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- start start 2021-10-21T00:06:45.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f4c067a80 0x7f1f4c0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0b0b50 con 0x7f1f4c0b2170 2021-10-21T00:06:45.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0b2550 con 0x7f1f4c0af620 2021-10-21T00:06:45.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0b0d90 con 0x7f1f4c067a80 2021-10-21T00:06:45.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1f4c0b2170 0x7f1f4c0ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58486/0 (socket says 172.21.15.41:58486) 2021-10-21T00:06:45.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4bfff700 1 -- 172.21.15.41:0/3288787446 learned_addr learned my addr 172.21.15.41:0/3288787446 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:45.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f50cea700 1 --2- 172.21.15.41:0/3288787446 >> v2:172.21.15.62:3300/0 conn(0x7f1f4c067a80 0x7f1f4c0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234085317 0 0) 0x7f1f3c001110 con 0x7f1f4c0b2170 2021-10-21T00:06:45.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f2c003260 con 0x7f1f4c0b2170 2021-10-21T00:06:45.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895712026 0 0) 0x7f1f4c0b2550 con 0x7f1f4c0af620 2021-10-21T00:06:45.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c001110 con 0x7f1f4c0af620 2021-10-21T00:06:45.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210396080 0 0) 0x7f1f2c003260 con 0x7f1f4c0b2170 2021-10-21T00:06:45.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f50cea700 1 -- 172.21.15.41:0/3288787446 >> v1:172.21.15.62:6789/0 conn(0x7f1f4c0af620 legacy=0x7f1f4c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f50cea700 1 -- 172.21.15.41:0/3288787446 >> v1:172.21.15.41:6789/0 conn(0x7f1f4c0b2170 legacy=0x7f1f4c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f50cea700 1 -- 172.21.15.41:0/3288787446 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0b1030 con 0x7f1f4c067a80 2021-10-21T00:06:45.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f50cea700 1 --2- 172.21.15.41:0/3288787446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c067a80 0x7f1f4c0ab880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f1f3c0012a0 tx=0x7f1f440091d0).ready entity=mon.1 client_cookie=831b400257a3d89a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3c0017f0 con 0x7f1f4c067a80 2021-10-21T00:06:45.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4400f510 con 0x7f1f4c067a80 2021-10-21T00:06:45.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f4b7fe700 1 -- 172.21.15.41:0/3288787446 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4400f680 con 0x7f1f4c067a80 2021-10-21T00:06:45.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- 172.21.15.41:0/3288787446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c067a80 msgr2=0x7f1f4c0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3288787446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c067a80 0x7f1f4c0ab880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f1f3c0012a0 tx=0x7f1f440091d0).stop 2021-10-21T00:06:45.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- 172.21.15.41:0/3288787446 shutdown_connections 2021-10-21T00:06:45.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3288787446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c067a80 0x7f1f4c0ab880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- 172.21.15.41:0/3288787446 >> 172.21.15.41:0/3288787446 conn(0x7f1f4c0b5700 msgr2=0x7f1f4c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- 172.21.15.41:0/3288787446 shutdown_connections 2021-10-21T00:06:45.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.329+0000 7f1f514eb700 1 -- 172.21.15.41:0/3288787446 wait complete. 2021-10-21T00:06:45.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 Processor -- start 2021-10-21T00:06:45.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- start start 2021-10-21T00:06:45.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f4c067a80 0x7f1f4c08f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c0b2170 0x7f1f4c065030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c08f8b0 con 0x7f1f4c0af620 2021-10-21T00:06:45.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0646a0 con 0x7f1f4c0b2170 2021-10-21T00:06:45.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c064b00 con 0x7f1f4c067a80 2021-10-21T00:06:45.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60722/0 (socket says 172.21.15.41:60722) 2021-10-21T00:06:45.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 -- 172.21.15.41:0/3219066128 learned_addr learned my addr 172.21.15.41:0/3219066128 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f50cea700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c0b2170 0x7f1f4c065030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f4bfff700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f4c067a80 0x7f1f4c08f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 -- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f4c067a80 msgr2=0x7f1f4c08f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f4c067a80 0x7f1f4c08f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 -- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c0b2170 msgr2=0x7f1f4c065030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c0b2170 0x7f1f4c065030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 -- 172.21.15.41:0/3219066128 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009470 con 0x7f1f4c0af620 2021-10-21T00:06:45.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f437fe700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f1f4c064c90 tx=0x7f1f34007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f34012400 con 0x7f1f4c0af620 2021-10-21T00:06:45.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34012560 con 0x7f1f4c0af620 2021-10-21T00:06:45.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c063680 con 0x7f1f4c0af620 2021-10-21T00:06:45.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f340128c0 con 0x7f1f4c0af620 2021-10-21T00:06:45.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.333+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c0ae3f0 con 0x7f1f4c0af620 2021-10-21T00:06:45.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c064840 con 0x7f1f4c0af620 2021-10-21T00:06:45.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f34019030 con 0x7f1f4c0af620 2021-10-21T00:06:45.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f49ffb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 0x7f1f30055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1f3406ad00 con 0x7f1f4c0af620 2021-10-21T00:06:45.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f4bfff700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 0x7f1f30055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.337+0000 7f1f4bfff700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 0x7f1f30055b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1f3c00d000 tx=0x7f1f3c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.341+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f4c064840 con 0x7f1f4c0af620 2021-10-21T00:06:45.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.505+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f4c064840 con 0x7f1f4c0af620 2021-10-21T00:06:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.505+0000 7f1f49ffb700 1 -- 172.21.15.41:0/3219066128 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f1f4c064840 con 0x7f1f4c0af620 2021-10-21T00:06:45.512 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:45.512 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:45.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 msgr2=0x7f1f30055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 0x7f1f30055b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1f3c00d000 tx=0x7f1f3c000bc0).stop 2021-10-21T00:06:45.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 msgr2=0x7f1f4c066dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f1f4c064c90 tx=0x7f1f34007ab0).stop 2021-10-21T00:06:45.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 shutdown_connections 2021-10-21T00:06:45.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1f30053640 0x7f1f30055b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f4c0b2170 0x7f1f4c065030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f4c0af620 0x7f1f4c066dd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 --2- 172.21.15.41:0/3219066128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f4c067a80 0x7f1f4c08f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 >> 172.21.15.41:0/3219066128 conn(0x7f1f4c0b5700 msgr2=0x7f1f4c149050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 shutdown_connections 2021-10-21T00:06:45.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.509+0000 7f1f514eb700 1 -- 172.21.15.41:0/3219066128 wait complete. 2021-10-21T00:06:45.516 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:45.524 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 5 2021-10-21T00:06:45.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 Processor -- start 2021-10-21T00:06:45.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- start start 2021-10-21T00:06:45.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 0x7ff6280b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6280b26d0 0x7ff628141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6280ba080 con 0x7ff6280b9ca0 2021-10-21T00:06:45.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62805c670 con 0x7ff6280b26d0 2021-10-21T00:06:45.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62805c8e0 con 0x7ff6280b0690 2021-10-21T00:06:45.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff626ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff6280b9ca0 0x7ff6280b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58500/0 (socket says 172.21.15.41:58500) 2021-10-21T00:06:45.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff626ffd700 1 -- 172.21.15.41:0/2074867200 learned_addr learned my addr 172.21.15.41:0/2074867200 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:45.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2074867200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 0x7ff6280b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6277fe700 1 --2- 172.21.15.41:0/2074867200 >> v2:172.21.15.62:3300/0 conn(0x7ff6280b26d0 0x7ff628141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff625ffb700 1 -- 172.21.15.41:0/2074867200 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447551899 0 0) 0x7ff6280ba080 con 0x7ff6280b9ca0 2021-10-21T00:06:45.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff625ffb700 1 -- 172.21.15.41:0/2074867200 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60c003260 con 0x7ff6280b9ca0 2021-10-21T00:06:45.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 -- 172.21.15.41:0/2074867200 >> v2:172.21.15.62:3300/0 conn(0x7ff6280b26d0 msgr2=0x7ff628141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2074867200 >> v2:172.21.15.62:3300/0 conn(0x7ff6280b26d0 0x7ff628141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 -- 172.21.15.41:0/2074867200 >> v1:172.21.15.41:6789/0 conn(0x7ff6280b9ca0 legacy=0x7ff6280b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 -- 172.21.15.41:0/2074867200 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62805cb80 con 0x7ff6280b0690 2021-10-21T00:06:45.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2074867200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 0x7ff6280b31e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff61c002f70 tx=0x7ff61c006df0).ready entity=mon.2 client_cookie=b8f3473ef3caa01d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff625ffb700 1 -- 172.21.15.41:0/2074867200 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c00d4a0 con 0x7ff6280b0690 2021-10-21T00:06:45.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff625ffb700 1 -- 172.21.15.41:0/2074867200 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c000e90 con 0x7ff6280b0690 2021-10-21T00:06:45.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff625ffb700 1 -- 172.21.15.41:0/2074867200 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c00d7f0 con 0x7ff6280b0690 2021-10-21T00:06:45.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- 172.21.15.41:0/2074867200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 msgr2=0x7ff6280b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/2074867200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 0x7ff6280b31e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff61c002f70 tx=0x7ff61c006df0).stop 2021-10-21T00:06:45.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- 172.21.15.41:0/2074867200 shutdown_connections 2021-10-21T00:06:45.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/2074867200 >> v2:172.21.15.62:3300/0 conn(0x7ff6280b26d0 0x7ff628141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/2074867200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b0690 0x7ff6280b31e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.633+0000 7ff62d6cb700 1 -- 172.21.15.41:0/2074867200 >> 172.21.15.41:0/2074867200 conn(0x7ff628062f00 msgr2=0x7ff6280b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- 172.21.15.41:0/2074867200 shutdown_connections 2021-10-21T00:06:45.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- 172.21.15.41:0/2074867200 wait complete. 2021-10-21T00:06:45.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 Processor -- start 2021-10-21T00:06:45.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- start start 2021-10-21T00:06:45.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6280b26d0 0x7ff62813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b9ca0 0x7ff62813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628156390 con 0x7ff6280b0690 2021-10-21T00:06:45.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62813f620 con 0x7ff6280b26d0 2021-10-21T00:06:45.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff62d6cb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280adeb0 con 0x7ff6280b9ca0 2021-10-21T00:06:45.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60736/0 (socket says 172.21.15.41:60736) 2021-10-21T00:06:45.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 -- 172.21.15.41:0/1410243497 learned_addr learned my addr 172.21.15.41:0/1410243497 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff6267fc700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6280b26d0 0x7ff62813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff6277fe700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b9ca0 0x7ff62813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 -- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b9ca0 msgr2=0x7ff62813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b9ca0 0x7ff62813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 -- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6280b26d0 msgr2=0x7ff62813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6280b26d0 0x7ff62813ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 -- 172.21.15.41:0/1410243497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c00b180 con 0x7ff6280b0690 2021-10-21T00:06:45.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.637+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff6280af800 tx=0x7ff618007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 -- 172.21.15.41:0/1410243497 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6180070d0 con 0x7ff6280b0690 2021-10-21T00:06:45.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 -- 172.21.15.41:0/1410243497 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618007230 con 0x7ff6280b0690 2021-10-21T00:06:45.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6280ae150 con 0x7ff6280b0690 2021-10-21T00:06:45.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 -- 172.21.15.41:0/1410243497 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff618005610 con 0x7ff6280b0690 2021-10-21T00:06:45.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6280b4df0 con 0x7ff6280b0690 2021-10-21T00:06:45.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 -- 172.21.15.41:0/1410243497 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff618010070 con 0x7ff6280b0690 2021-10-21T00:06:45.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 0x7ff604055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff617fff700 1 -- 172.21.15.41:0/1410243497 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff61806afd0 con 0x7ff6280b0690 2021-10-21T00:06:45.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.641+0000 7ff6267fc700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 0x7ff604055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff6267fc700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 0x7ff604055b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff61c01a000 tx=0x7ff61c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 Processor -- start 2021-10-21T00:06:45.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 -- start start 2021-10-21T00:06:45.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1825240 con 0x18b4dd0 2021-10-21T00:06:45.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x18058d0 con 0x18b6050 2021-10-21T00:06:45.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x18b0fd0 con 0x18eb6c0 2021-10-21T00:06:45.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60746/0 (socket says 172.21.15.41:60746) 2021-10-21T00:06:45.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff6267fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff6277fe700 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 -- 172.21.15.41:0/1939173424 learned_addr learned my addr 172.21.15.41:0/1939173424 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 -- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 msgr2=0x18b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 -- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 msgr2=0x18ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 -- 172.21.15.41:0/1939173424 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x185cd00 con 0x18b4dd0 2021-10-21T00:06:45.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff626ffd700 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7ff61806b1e0 tx=0x7ff618046f90).ready entity=mon.0 client_cookie=4e5a8fa4fdb04baa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1939173424 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61804b070 con 0x18b4dd0 2021-10-21T00:06:45.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1939173424 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6180440f0 con 0x18b4dd0 2021-10-21T00:06:45.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1939173424 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff618045240 con 0x18b4dd0 2021-10-21T00:06:45.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 -- 172.21.15.41:0/1939173424 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 msgr2=0x18b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.645+0000 7ff63790f740 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7ff61806b1e0 tx=0x7ff618046f90).stop 2021-10-21T00:06:45.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- 172.21.15.41:0/1939173424 shutdown_connections 2021-10-21T00:06:45.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- 172.21.15.41:0/1939173424 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18b51b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- 172.21.15.41:0/1939173424 >> 172.21.15.41:0/1939173424 conn(0x18b17e0 msgr2=0x18b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- 172.21.15.41:0/1939173424 shutdown_connections 2021-10-21T00:06:45.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- 172.21.15.41:0/1939173424 wait complete. 2021-10-21T00:06:45.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- start start 2021-10-21T00:06:45.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 Processor -- start 2021-10-21T00:06:45.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x18f96e0 con 0x18b4dd0 2021-10-21T00:06:45.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x18f98d0 con 0x18b6050 2021-10-21T00:06:45.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x18f9b70 con 0x18eb6c0 2021-10-21T00:06:45.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 10 client.0 ll_register_callbacks cb 0x186c2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:06:45.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60750/0 (socket says 172.21.15.41:60750) 2021-10-21T00:06:45.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 -- 172.21.15.41:0/22970762 learned_addr learned my addr 172.21.15.41:0/22970762 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff6267fc700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff6277fe700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 -- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 msgr2=0x18e88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 -- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 msgr2=0x18e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 -- 172.21.15.41:0/22970762 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6280b4df0 con 0x18b4dd0 2021-10-21T00:06:45.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff6277fe700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:45.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff626ffd700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff61806b1e0 tx=0x7ff618048070).ready entity=mon.0 client_cookie=826720f877b30fe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff601ffb700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:06:45.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff618055070 con 0x18b4dd0 2021-10-21T00:06:45.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff618014c80 con 0x18b4dd0 2021-10-21T00:06:45.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.649+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x181b220 con 0x18b4dd0 2021-10-21T00:06:45.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff618007e70 con 0x18b4dd0 2021-10-21T00:06:45.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 10 client.5802 fetch_fsmap learned FSMap version 21 2021-10-21T00:06:45.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1814b00 con 0x18b4dd0 2021-10-21T00:06:45.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61805e020 con 0x18b4dd0 2021-10-21T00:06:45.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7ff61804e020 con 0x18b4dd0 2021-10-21T00:06:45.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 10 client.5802 fetch_fsmap finished waiting for FSMap version 21 2021-10-21T00:06:45.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 10 client.5802 resolve_mds: resolved ID 'a' to GID 5619 2021-10-21T00:06:45.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 20 client.5802 populate_metadata read hostname 'smithi041' 2021-10-21T00:06:45.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18fcc30 0x18fd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 4 client.5802 mds_command: new command op to 5619 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-21T00:06:45.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 --> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1813590 con 0x18fcc30 2021-10-21T00:06:45.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff6267fc700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18fcc30 0x18fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff6267fc700 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18fcc30 0x18fd010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=74a03b67b4b923f0 server_cookie=ceed4cc23ee2dad2 in_seq=0 out_seq=0 2021-10-21T00:06:45.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 10 client.5802 ms_handle_connect on v2:172.21.15.41:6832/3050633316 2021-10-21T00:06:45.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 1 -- 172.21.15.41:0/22970762 <== mds.0 v2:172.21.15.41:6832/3050633316 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1813590 con 0x18fcc30 2021-10-21T00:06:45.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 10 client.5802 handle_command_reply: tid=0 2021-10-21T00:06:45.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 client.5802 shutdown 2021-10-21T00:06:45.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 msgr2=0x18e4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff61806b1e0 tx=0x7ff618048070).stop 2021-10-21T00:06:45.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 shutdown_connections 2021-10-21T00:06:45.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18fcc30 0x18fd010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b6050 0x18e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 --2- 172.21.15.41:0/22970762 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b4dd0 0x18e4c90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff601ffb700 0 client.5802 ms_handle_reset on v2:172.21.15.41:6832/3050633316 2021-10-21T00:06:45.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 >> 172.21.15.41:0/22970762 conn(0x18b17e0 msgr2=0x18ee260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 shutdown_connections 2021-10-21T00:06:45.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 1 -- 172.21.15.41:0/22970762 wait complete. 2021-10-21T00:06:45.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.653+0000 7ff63790f740 20 client.5802 trim_cache size 0 max 16384 2021-10-21T00:06:45.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 Processor -- start 2021-10-21T00:06:45.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- start start 2021-10-21T00:06:45.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b4dd0 0x18b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x190a2f0 con 0x18b6050 2021-10-21T00:06:45.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1822530 con 0x18b4dd0 2021-10-21T00:06:45.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x187ca10 con 0x18eb6c0 2021-10-21T00:06:45.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60758/0 (socket says 172.21.15.41:60758) 2021-10-21T00:06:45.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 -- 172.21.15.41:0/2623425149 learned_addr learned my addr 172.21.15.41:0/2623425149 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6277fe700 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff626ffd700 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b4dd0 0x18b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 -- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 msgr2=0x18e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 -- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b4dd0 msgr2=0x18b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b4dd0 0x18b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 -- 172.21.15.41:0/2623425149 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x181d400 con 0x18b6050 2021-10-21T00:06:45.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x17f3b60 tx=0x7ff61c012000).ready entity=mon.0 client_cookie=4a8131b5a5eec2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff603fff700 1 -- 172.21.15.41:0/2623425149 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c031650 con 0x18b6050 2021-10-21T00:06:45.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff603fff700 1 -- 172.21.15.41:0/2623425149 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c0317b0 con 0x18b6050 2021-10-21T00:06:45.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff603fff700 1 -- 172.21.15.41:0/2623425149 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c031b10 con 0x18b6050 2021-10-21T00:06:45.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- 172.21.15.41:0/2623425149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 msgr2=0x18e8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:45.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x17f3b60 tx=0x7ff61c012000).stop 2021-10-21T00:06:45.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- 172.21.15.41:0/2623425149 shutdown_connections 2021-10-21T00:06:45.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18eb6c0 0x18e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x18e8ff0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 --2- 172.21.15.41:0/2623425149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18b4dd0 0x18b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- 172.21.15.41:0/2623425149 >> 172.21.15.41:0/2623425149 conn(0x18b17e0 msgr2=0x18afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:45.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- 172.21.15.41:0/2623425149 shutdown_connections 2021-10-21T00:06:45.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.669+0000 7ff63790f740 1 -- 172.21.15.41:0/2623425149 wait complete. 2021-10-21T00:06:45.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 -- start start 2021-10-21T00:06:45.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 Processor -- start 2021-10-21T00:06:45.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18b4dd0 0x1901650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18eb6c0 0x1950750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x18b74d0 con 0x18b6050 2021-10-21T00:06:45.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x18b3fd0 con 0x18eb6c0 2021-10-21T00:06:45.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1901160 con 0x18b4dd0 2021-10-21T00:06:45.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff63790f740 10 client.0 ll_register_callbacks cb 0x18e61c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:06:45.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18b4dd0 0x1901650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60766/0 (socket says 172.21.15.41:60766) 2021-10-21T00:06:45.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18eb6c0 0x1950750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 -- 172.21.15.41:0/2976892395 learned_addr learned my addr 172.21.15.41:0/2976892395 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 -- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18b4dd0 msgr2=0x1901650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18b4dd0 0x1901650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 -- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18eb6c0 msgr2=0x1950750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18eb6c0 0x1950750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:45.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.673+0000 7ff6267fc700 1 -- 172.21.15.41:0/2976892395 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62805cb80 con 0x18b6050 2021-10-21T00:06:45.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff6267fc700 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x17f3b60 tx=0x7ff61c032000).ready entity=mon.0 client_cookie=eb75d348db3131c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:45.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:06:45.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c031b30 con 0x18b6050 2021-10-21T00:06:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff61c031c90 con 0x18b6050 2021-10-21T00:06:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6180440f0 con 0x18b6050 2021-10-21T00:06:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff61c031e50 con 0x18b6050 2021-10-21T00:06:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 10 client.5808 fetch_fsmap learned FSMap version 21 2021-10-21T00:06:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1819df0 con 0x18b6050 2021-10-21T00:06:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6180440f0 con 0x18b6050 2021-10-21T00:06:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7ff61c0459d0 con 0x18b6050 2021-10-21T00:06:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 10 client.5808 fetch_fsmap finished waiting for FSMap version 21 2021-10-21T00:06:45.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 10 client.5808 resolve_mds: resolved ID 'a' to GID 5619 2021-10-21T00:06:45.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 20 client.5808 populate_metadata read hostname 'smithi041' 2021-10-21T00:06:45.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18e7760 0x1950c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:45.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 4 client.5808 mds_command: new command op to 5619 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-10-21T00:06:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 --> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x17095e0 con 0x18e7760 2021-10-21T00:06:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff626ffd700 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18e7760 0x1950c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff602ffd700 10 client.5808 ms_handle_connect on v2:172.21.15.41:6832/3050633316 2021-10-21T00:06:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:45.677+0000 7ff626ffd700 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18e7760 0x1950c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5e0025eabf739df3 server_cookie=3557b0f54ae7817b in_seq=0 out_seq=0 2021-10-21T00:06:50.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff602ffd700 1 -- 172.21.15.41:0/2976892395 <== mds.0 v2:172.21.15.41:6832/3050633316 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x17095e0 con 0x18e7760 2021-10-21T00:06:50.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff602ffd700 10 client.5808 handle_command_reply: tid=0 2021-10-21T00:06:50.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 client.5808 shutdown 2021-10-21T00:06:50.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 msgr2=0x1950260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:50.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x17f3b60 tx=0x7ff61c032000).stop 2021-10-21T00:06:50.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 shutdown_connections 2021-10-21T00:06:50.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:6832/3050633316,v1:172.21.15.41:6833/3050633316] conn(0x18e7760 0x1950c40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18eb6c0 0x1950750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x18b6050 0x1950260 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff602ffd700 0 client.5808 ms_handle_reset on v2:172.21.15.41:6832/3050633316 2021-10-21T00:06:50.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 --2- 172.21.15.41:0/2976892395 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x18b4dd0 0x1901650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 >> 172.21.15.41:0/2976892395 conn(0x18b17e0 msgr2=0x18e6930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:50.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 shutdown_connections 2021-10-21T00:06:50.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 1 -- 172.21.15.41:0/2976892395 wait complete. 2021-10-21T00:06:50.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff63790f740 20 client.5808 trim_cache size 0 max 16384 2021-10-21T00:06:50.874 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:06:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: "client_recall": { 2021-10-21T00:06:50.874 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": -110, 2021-10-21T00:06:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "(110) Connection timed out", 2021-10-21T00:06:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: "recalled": 120 2021-10-21T00:06:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: "flush_journal": { 2021-10-21T00:06:50.875 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:06:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "" 2021-10-21T00:06:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: "trim_cache": { 2021-10-21T00:06:50.876 INFO:teuthology.orchestra.run.smithi041.stdout: "trimmed": 0 2021-10-21T00:06:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: "cache": { 2021-10-21T00:06:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": { 2021-10-21T00:06:50.877 INFO:teuthology.orchestra.run.smithi041.stdout: "items": 20087, 2021-10-21T00:06:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes": 3105888 2021-10-21T00:06:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:06:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:06:50.878 INFO:teuthology.orchestra.run.smithi041.stdout: "duration": 5.1859804230000002 2021-10-21T00:06:50.879 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:06:50.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 msgr2=0x7ff604055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:50.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 0x7ff604055b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ff61c01a000 tx=0x7ff61c014000).stop 2021-10-21T00:06:50.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 msgr2=0x7ff6280b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:50.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff6280af800 tx=0x7ff618007ad0).stop 2021-10-21T00:06:50.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 shutdown_connections 2021-10-21T00:06:50.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6040536d0 0x7ff604055b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6280b9ca0 0x7ff62813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6280b26d0 0x7ff62813ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 --2- 172.21.15.41:0/1410243497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff6280b0690 0x7ff6280b4880 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:50.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 >> 172.21.15.41:0/1410243497 conn(0x7ff628062f00 msgr2=0x7ff62805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:50.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 shutdown_connections 2021-10-21T00:06:50.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:50.865+0000 7ff62d6cb700 1 -- 172.21.15.41:0/1410243497 wait complete. 2021-10-21T00:06:50.884 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-21T00:06:50.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:50.885 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:50.885 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:50.893 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-21T00:06:50.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:06:50.895 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:50.895 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:06:50.896 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:06:50.896 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:50.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:50.957 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:50.957 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:50.963 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:06:50.964 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:06:50.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:06:50.965 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:51.015 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:06:51.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 Processor -- start 2021-10-21T00:06:51.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- start start 2021-10-21T00:06:51.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 0x7f31e40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31e4067a80 0x7f31e4149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e40b0b50 con 0x7f31e40af620 2021-10-21T00:06:51.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40b2550 con 0x7f31e4067a80 2021-10-21T00:06:51.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40b0d90 con 0x7f31e40b2170 2021-10-21T00:06:51.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31e4067a80 0x7f31e4149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31e40af620 0x7f31e40ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38372/0 (socket says 172.21.15.41:38372) 2021-10-21T00:06:51.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e259c700 1 -- 172.21.15.41:0/2125270663 learned_addr learned my addr 172.21.15.41:0/2125270663 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:51.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 0x7f31e40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e1d9b700 1 -- 172.21.15.41:0/2125270663 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391150593 0 0) 0x7f31d4001490 con 0x7f31e40af620 2021-10-21T00:06:51.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e1d9b700 1 -- 172.21.15.41:0/2125270663 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c8003260 con 0x7f31e40af620 2021-10-21T00:06:51.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 -- 172.21.15.41:0/2125270663 >> v2:172.21.15.41:3300/0 conn(0x7f31e4067a80 msgr2=0x7f31e4149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:51.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 --2- 172.21.15.41:0/2125270663 >> v2:172.21.15.41:3300/0 conn(0x7f31e4067a80 0x7f31e4149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 -- 172.21.15.41:0/2125270663 >> v1:172.21.15.62:6789/0 conn(0x7f31e40af620 legacy=0x7f31e40ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 -- 172.21.15.41:0/2125270663 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40b1030 con 0x7f31e40b2170 2021-10-21T00:06:51.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e2d9d700 1 --2- 172.21.15.41:0/2125270663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 0x7f31e40ab170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d8006df0).ready entity=mon.2 client_cookie=413e85c9da8a1244 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e1d9b700 1 -- 172.21.15.41:0/2125270663 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800d4a0 con 0x7f31e40b2170 2021-10-21T00:06:51.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e1d9b700 1 -- 172.21.15.41:0/2125270663 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d8000e90 con 0x7f31e40b2170 2021-10-21T00:06:51.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e1d9b700 1 -- 172.21.15.41:0/2125270663 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800d7f0 con 0x7f31e40b2170 2021-10-21T00:06:51.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- 172.21.15.41:0/2125270663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 msgr2=0x7f31e40ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 --2- 172.21.15.41:0/2125270663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 0x7f31e40ab170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d8006df0).stop 2021-10-21T00:06:51.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- 172.21.15.41:0/2125270663 shutdown_connections 2021-10-21T00:06:51.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 --2- 172.21.15.41:0/2125270663 >> v2:172.21.15.41:3300/0 conn(0x7f31e4067a80 0x7f31e4149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 --2- 172.21.15.41:0/2125270663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40b2170 0x7f31e40ab170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- 172.21.15.41:0/2125270663 >> 172.21.15.41:0/2125270663 conn(0x7f31e40b5700 msgr2=0x7f31e40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- 172.21.15.41:0/2125270663 shutdown_connections 2021-10-21T00:06:51.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.125+0000 7f31e88fa700 1 -- 172.21.15.41:0/2125270663 wait complete. 2021-10-21T00:06:51.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 Processor -- start 2021-10-21T00:06:51.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 -- start start 2021-10-21T00:06:51.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40af620 0x7f31e4159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31e40b2170 0x7f31e4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40aed30 con 0x7f31e4067a80 2021-10-21T00:06:51.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e41565c0 con 0x7f31e40b2170 2021-10-21T00:06:51.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e88fa700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4156860 con 0x7f31e40af620 2021-10-21T00:06:51.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60784/0 (socket says 172.21.15.41:60784) 2021-10-21T00:06:51.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 -- 172.21.15.41:0/1147046073 learned_addr learned my addr 172.21.15.41:0/1147046073 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:51.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e259c700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40af620 0x7f31e4159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e359e700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31e40b2170 0x7f31e4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 -- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40af620 msgr2=0x7f31e4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40af620 0x7f31e4159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 -- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31e40b2170 msgr2=0x7f31e4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31e40b2170 0x7f31e4159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 -- 172.21.15.41:0/1147046073 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d800b180 con 0x7f31e4067a80 2021-10-21T00:06:51.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.129+0000 7f31e2d9d700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8016070 con 0x7f31e4067a80 2021-10-21T00:06:51.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d80138d0 con 0x7f31e4067a80 2021-10-21T00:06:51.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4156b00 con 0x7f31e4067a80 2021-10-21T00:06:51.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8013c30 con 0x7f31e4067a80 2021-10-21T00:06:51.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e4156190 con 0x7f31e4067a80 2021-10-21T00:06:51.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e4156c90 con 0x7f31e4067a80 2021-10-21T00:06:51.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.133+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31d8025030 con 0x7f31e4067a80 2021-10-21T00:06:51.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.137+0000 7f31d3fff700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 0x7f31c0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.137+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31d806c920 con 0x7f31e4067a80 2021-10-21T00:06:51.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.137+0000 7f31e259c700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 0x7f31c0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.137+0000 7f31e259c700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 0x7f31c0055b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f31d400d000 tx=0x7f31d4000f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.141+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31d8043970 con 0x7f31e4067a80 2021-10-21T00:06:51.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.269+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31e40b12d0 con 0x7f31e4067a80 2021-10-21T00:06:51.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31d3fff700 1 -- 172.21.15.41:0/1147046073 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f31d8023020 con 0x7f31e4067a80 2021-10-21T00:06:51.278 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:51.278 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":50,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:06:29.180913+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:06:25.860491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-10-21T00:06:27.113771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:06:51.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 msgr2=0x7f31c0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 0x7f31c0055b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f31d400d000 tx=0x7f31d4000f40).stop 2021-10-21T00:06:51.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 msgr2=0x7f31e40ac780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d8014000).stop 2021-10-21T00:06:51.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 shutdown_connections 2021-10-21T00:06:51.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31c0053640 0x7f31c0055b00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31e40b2170 0x7f31e4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31e40af620 0x7f31e4159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 --2- 172.21.15.41:0/1147046073 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31e4067a80 0x7f31e40ac780 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 >> 172.21.15.41:0/1147046073 conn(0x7f31e40b5700 msgr2=0x7f31e41490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 shutdown_connections 2021-10-21T00:06:51.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.273+0000 7f31e88fa700 1 -- 172.21.15.41:0/1147046073 wait complete. 2021-10-21T00:06:51.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:06:25.860491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:06:27.113771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:06:51.292 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:06:51.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 Processor -- start 2021-10-21T00:06:51.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 -- start start 2021-10-21T00:06:51.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a5405c6f0 0x7f4a540aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 0x7f4a540b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5405cad0 con 0x7f4a540b0eb0 2021-10-21T00:06:51.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a540aece0 con 0x7f4a5405c6f0 2021-10-21T00:06:51.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a5a307700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540ae300 con 0x7f4a540b0560 2021-10-21T00:06:51.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.397+0000 7f4a588a4700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4a540b0eb0 0x7f4a5414a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58566/0 (socket says 172.21.15.41:58566) 2021-10-21T00:06:51.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a588a4700 1 -- 172.21.15.41:0/4207395068 learned_addr learned my addr 172.21.15.41:0/4207395068 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:51.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 --2- 172.21.15.41:0/4207395068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 0x7f4a540b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a53fff700 1 --2- 172.21.15.41:0/4207395068 >> v2:172.21.15.62:3300/0 conn(0x7f4a5405c6f0 0x7f4a540aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963588826 0 0) 0x7f4a5405cad0 con 0x7f4a540b0eb0 2021-10-21T00:06:51.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a40003260 con 0x7f4a540b0eb0 2021-10-21T00:06:51.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 -- 172.21.15.41:0/4207395068 >> v2:172.21.15.62:3300/0 conn(0x7f4a5405c6f0 msgr2=0x7f4a540aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:51.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 --2- 172.21.15.41:0/4207395068 >> v2:172.21.15.62:3300/0 conn(0x7f4a5405c6f0 0x7f4a540aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969645581 0 0) 0x7f4a40003260 con 0x7f4a540b0eb0 2021-10-21T00:06:51.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 -- 172.21.15.41:0/4207395068 >> v1:172.21.15.41:6789/0 conn(0x7f4a540b0eb0 legacy=0x7f4a5414a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 -- 172.21.15.41:0/4207395068 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540ae5a0 con 0x7f4a540b0560 2021-10-21T00:06:51.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a537fe700 1 --2- 172.21.15.41:0/4207395068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 0x7f4a540b09c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4a4c001800 tx=0x7f4a440091d0).ready entity=mon.2 client_cookie=205f7f8f39e1b0d7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4c001660 con 0x7f4a540b0560 2021-10-21T00:06:51.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4400f510 con 0x7f4a540b0560 2021-10-21T00:06:51.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a52ffd700 1 -- 172.21.15.41:0/4207395068 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4400f680 con 0x7f4a540b0560 2021-10-21T00:06:51.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- 172.21.15.41:0/4207395068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 msgr2=0x7f4a540b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 --2- 172.21.15.41:0/4207395068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 0x7f4a540b09c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4a4c001800 tx=0x7f4a440091d0).stop 2021-10-21T00:06:51.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- 172.21.15.41:0/4207395068 shutdown_connections 2021-10-21T00:06:51.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 --2- 172.21.15.41:0/4207395068 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a540b0560 0x7f4a540b09c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 --2- 172.21.15.41:0/4207395068 >> v2:172.21.15.62:3300/0 conn(0x7f4a5405c6f0 0x7f4a540aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- 172.21.15.41:0/4207395068 >> 172.21.15.41:0/4207395068 conn(0x7f4a54063210 msgr2=0x7f4a5405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- 172.21.15.41:0/4207395068 shutdown_connections 2021-10-21T00:06:51.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- 172.21.15.41:0/4207395068 wait complete. 2021-10-21T00:06:51.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 Processor -- start 2021-10-21T00:06:51.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.401+0000 7f4a5a307700 1 -- start start 2021-10-21T00:06:51.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5405c6f0 0x7f4a5414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a540b0eb0 0x7f4a540a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5414c4c0 con 0x7f4a540b0560 2021-10-21T00:06:51.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5414c760 con 0x7f4a540b0eb0 2021-10-21T00:06:51.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5414ca00 con 0x7f4a5405c6f0 2021-10-21T00:06:51.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60800/0 (socket says 172.21.15.41:60800) 2021-10-21T00:06:51.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a53fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5405c6f0 0x7f4a5414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a588a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a540b0eb0 0x7f4a540a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 -- 172.21.15.41:0/1864549632 learned_addr learned my addr 172.21.15.41:0/1864549632 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:51.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 -- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5405c6f0 msgr2=0x7f4a5414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5405c6f0 0x7f4a5414d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 -- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a540b0eb0 msgr2=0x7f4a540a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a540b0eb0 0x7f4a540a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 -- 172.21.15.41:0/1864549632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009470 con 0x7f4a540b0560 2021-10-21T00:06:51.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a537fe700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f4a4c001800 tx=0x7f4a44016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a44011c30 con 0x7f4a540b0560 2021-10-21T00:06:51.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44011d90 con 0x7f4a540b0560 2021-10-21T00:06:51.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5414aa80 con 0x7f4a540b0560 2021-10-21T00:06:51.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a44021630 con 0x7f4a540b0560 2021-10-21T00:06:51.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540ab2d0 con 0x7f4a540b0560 2021-10-21T00:06:51.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.405+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a540a8ee0 con 0x7f4a540b0560 2021-10-21T00:06:51.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.409+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a4400f070 con 0x7f4a540b0560 2021-10-21T00:06:51.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.409+0000 7f4a517fa700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 0x7f4a34055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.409+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a4406c340 con 0x7f4a540b0560 2021-10-21T00:06:51.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.409+0000 7f4a53fff700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 0x7f4a34055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.409+0000 7f4a53fff700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 0x7f4a34055b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4a4800b000 tx=0x7f4a48006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.417+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a44043480 con 0x7f4a540b0560 2021-10-21T00:06:51.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4a5414ac10 con 0x7f4a540b0560 2021-10-21T00:06:51.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a517fa700 1 -- 172.21.15.41:0/1864549632 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v50) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4a5414ac10 con 0x7f4a540b0560 2021-10-21T00:06:51.550 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:06:51.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 msgr2=0x7f4a34055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 0x7f4a34055b00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4a4800b000 tx=0x7f4a48006df0).stop 2021-10-21T00:06:51.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 msgr2=0x7f4a54149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f4a4c001800 tx=0x7f4a44016000).stop 2021-10-21T00:06:51.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 shutdown_connections 2021-10-21T00:06:51.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053640 0x7f4a34055b00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a540b0eb0 0x7f4a540a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a540b0560 0x7f4a54149ad0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 --2- 172.21.15.41:0/1864549632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5405c6f0 0x7f4a5414d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 >> 172.21.15.41:0/1864549632 conn(0x7f4a54063210 msgr2=0x7f4a5405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 shutdown_connections 2021-10-21T00:06:51.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.545+0000 7f4a5a307700 1 -- 172.21.15.41:0/1864549632 wait complete. 2021-10-21T00:06:51.563 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:06:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 Processor -- start 2021-10-21T00:06:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 -- start start 2021-10-21T00:06:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efeb009ab50 0x7efeb013fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00b1560 con 0x7efeb00af620 2021-10-21T00:06:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00b2550 con 0x7efeb009ab50 2021-10-21T00:06:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb7247700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb009a170 con 0x7efeb00b2170 2021-10-21T00:06:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb6a46700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7efeb00af620 0x7efeb013fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58576/0 (socket says 172.21.15.41:58576) 2021-10-21T00:06:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb6a46700 1 -- 172.21.15.41:0/2495051766 learned_addr learned my addr 172.21.15.41:0/2495051766 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5a44700 1 --2- 172.21.15.41:0/2495051766 >> v2:172.21.15.62:3300/0 conn(0x7efeb009ab50 0x7efeb013fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb6245700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964468847 0 0) 0x7efeb00b1560 con 0x7efeb00af620 2021-10-21T00:06:51.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe98003260 con 0x7efeb00af620 2021-10-21T00:06:51.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5a44700 1 -- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 msgr2=0x7efeb0099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:51.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5a44700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5a44700 1 -- 172.21.15.41:0/2495051766 >> v1:172.21.15.41:6789/0 conn(0x7efeb00af620 legacy=0x7efeb013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994481856 0 0) 0x7efe98003260 con 0x7efeb00af620 2021-10-21T00:06:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.665+0000 7efeb5a44700 1 -- 172.21.15.41:0/2495051766 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb009a410 con 0x7efeb009ab50 2021-10-21T00:06:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb5a44700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb009ab50 0x7efeb013fb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7efea8001b80 tx=0x7efeac006df0).ready entity=mon.1 client_cookie=b30867968d72b9d6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea80019e0 con 0x7efeb009ab50 2021-10-21T00:06:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac000e90 con 0x7efeb009ab50 2021-10-21T00:06:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb5243700 1 -- 172.21.15.41:0/2495051766 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeac012460 con 0x7efeb009ab50 2021-10-21T00:06:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb009ab50 msgr2=0x7efeb013fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb009ab50 0x7efeb013fb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7efea8001b80 tx=0x7efeac006df0).stop 2021-10-21T00:06:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- 172.21.15.41:0/2495051766 shutdown_connections 2021-10-21T00:06:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb009ab50 0x7efeb013fb00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 --2- 172.21.15.41:0/2495051766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- 172.21.15.41:0/2495051766 >> 172.21.15.41:0/2495051766 conn(0x7efeb00b5700 msgr2=0x7efeb00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- 172.21.15.41:0/2495051766 shutdown_connections 2021-10-21T00:06:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- 172.21.15.41:0/2495051766 wait complete. 2021-10-21T00:06:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 Processor -- start 2021-10-21T00:06:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.669+0000 7efeb7247700 1 -- start start 2021-10-21T00:06:51.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 0x7efeb0064980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0064e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01507d0 con 0x7efeb0152ef0 2021-10-21T00:06:51.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ac8f0 con 0x7efeb00af620 2021-10-21T00:06:51.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00acb90 con 0x7efeb00b2170 2021-10-21T00:06:51.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60814/0 (socket says 172.21.15.41:60814) 2021-10-21T00:06:51.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 -- 172.21.15.41:0/445896679 learned_addr learned my addr 172.21.15.41:0/445896679 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:51.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6245700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 0x7efeb0064980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb5a44700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0064e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 -- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 msgr2=0x7efeb0064e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0064e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 -- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 msgr2=0x7efeb0064980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 0x7efeb0064980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 -- 172.21.15.41:0/445896679 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac00b180 con 0x7efeb0152ef0 2021-10-21T00:06:51.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb5a44700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0064e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:51.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6245700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 0x7efeb0064980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:06:51.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb6a46700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7efea8001c40 tx=0x7efea8002180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8004ab0 con 0x7efeb0152ef0 2021-10-21T00:06:51.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8004c10 con 0x7efeb0152ef0 2021-10-21T00:06:51.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00ad190 con 0x7efeb0152ef0 2021-10-21T00:06:51.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efea8007170 con 0x7efeb0152ef0 2021-10-21T00:06:51.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0150540 con 0x7efeb0152ef0 2021-10-21T00:06:51.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.673+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb009a6b0 con 0x7efeb0152ef0 2021-10-21T00:06:51.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.677+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efea801c030 con 0x7efeb0152ef0 2021-10-21T00:06:51.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.677+0000 7efe9f7fe700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 0x7efe90055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.677+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efea806bca0 con 0x7efeb0152ef0 2021-10-21T00:06:51.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.677+0000 7efeb6245700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 0x7efe90055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.677+0000 7efeb6245700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 0x7efe90055a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7efea000b000 tx=0x7efea0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.681+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efea8042cf0 con 0x7efeb0152ef0 2021-10-21T00:06:51.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.809+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efeb0057350 con 0x7efeb0152ef0 2021-10-21T00:06:51.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.809+0000 7efe9f7fe700 1 -- 172.21.15.41:0/445896679 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7efea8046310 con 0x7efeb0152ef0 2021-10-21T00:06:51.816 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:51.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 msgr2=0x7efe90055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 0x7efe90055a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7efea000b000 tx=0x7efea0008040).stop 2021-10-21T00:06:51.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 msgr2=0x7efeb01533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7efea8001c40 tx=0x7efea8002180).stop 2021-10-21T00:06:51.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 shutdown_connections 2021-10-21T00:06:51.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe900535b0 0x7efe90055a70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efeb0152ef0 0x7efeb01533a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00b2170 0x7efeb0064e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 --2- 172.21.15.41:0/445896679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00af620 0x7efeb0064980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 >> 172.21.15.41:0/445896679 conn(0x7efeb00b5700 msgr2=0x7efeb00afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 shutdown_connections 2021-10-21T00:06:51.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.813+0000 7efeb7247700 1 -- 172.21.15.41:0/445896679 wait complete. 2021-10-21T00:06:51.829 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:06:51.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 Processor -- start 2021-10-21T00:06:51.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 -- start start 2021-10-21T00:06:51.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc2d8142050 0x7fc2d81424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80acde0 con 0x7fc2d80adb80 2021-10-21T00:06:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80b4110 con 0x7fc2d80b3d30 2021-10-21T00:06:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2de5cf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d80acb40 con 0x7fc2d8142050 2021-10-21T00:06:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2d77fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc2d80adb80 0x7fc2d8061b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58590/0 (socket says 172.21.15.41:58590) 2021-10-21T00:06:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2d77fe700 1 -- 172.21.15.41:0/2604451731 learned_addr learned my addr 172.21.15.41:0/2604451731 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2dcb6c700 1 --2- 172.21.15.41:0/2604451731 >> v2:172.21.15.62:3300/0 conn(0x7fc2d8142050 0x7fc2d81424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987444128 0 0) 0x7fc2d80acde0 con 0x7fc2d80adb80 2021-10-21T00:06:51.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.929+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b8003260 con 0x7fc2d80adb80 2021-10-21T00:06:51.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2dcb6c700 1 -- 172.21.15.41:0/2604451731 >> v1:172.21.15.62:6789/0 conn(0x7fc2d80b3d30 legacy=0x7fc2d8146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2dcb6c700 1 -- 172.21.15.41:0/2604451731 >> v1:172.21.15.41:6789/0 conn(0x7fc2d80adb80 legacy=0x7fc2d8061b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295513485 0 0) 0x7fc2b8003260 con 0x7fc2d80adb80 2021-10-21T00:06:51.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2dcb6c700 1 -- 172.21.15.41:0/2604451731 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8061660 con 0x7fc2d8142050 2021-10-21T00:06:51.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2dcb6c700 1 --2- 172.21.15.41:0/2604451731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d81424e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc2c0001800 tx=0x7fc2d00091d0).ready entity=mon.1 client_cookie=2bc79af04bfc4994 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c0001660 con 0x7fc2d8142050 2021-10-21T00:06:51.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d000b580 con 0x7fc2d8142050 2021-10-21T00:06:51.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2d6ffd700 1 -- 172.21.15.41:0/2604451731 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2d000b6f0 con 0x7fc2d8142050 2021-10-21T00:06:51.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 -- 172.21.15.41:0/2604451731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 msgr2=0x7fc2d81424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/2604451731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d81424e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc2c0001800 tx=0x7fc2d00091d0).stop 2021-10-21T00:06:51.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 -- 172.21.15.41:0/2604451731 shutdown_connections 2021-10-21T00:06:51.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/2604451731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d81424e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 -- 172.21.15.41:0/2604451731 >> 172.21.15.41:0/2604451731 conn(0x7fc2d8064910 msgr2=0x7fc2d8064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:51.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 -- 172.21.15.41:0/2604451731 shutdown_connections 2021-10-21T00:06:51.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.933+0000 7fc2de5cf700 1 -- 172.21.15.41:0/2604451731 wait complete. 2021-10-21T00:06:51.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 Processor -- start 2021-10-21T00:06:51.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- start start 2021-10-21T00:06:51.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d80adb80 0x7fc2d8151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d80b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d813e8b0 con 0x7fc2d80b3d30 2021-10-21T00:06:51.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80668b0 con 0x7fc2d8142050 2021-10-21T00:06:51.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80afab0 con 0x7fc2d80adb80 2021-10-21T00:06:51.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60826/0 (socket says 172.21.15.41:60826) 2021-10-21T00:06:51.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 -- 172.21.15.41:0/3887020732 learned_addr learned my addr 172.21.15.41:0/3887020732 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:51.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2dcb6c700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d80b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d7fff700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d80adb80 0x7fc2d8151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 -- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d80adb80 msgr2=0x7fc2d8151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d80adb80 0x7fc2d8151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 -- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 msgr2=0x7fc2d80b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:51.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d80b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:51.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 -- 172.21.15.41:0/3887020732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009470 con 0x7fc2d80b3d30 2021-10-21T00:06:51.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d77fe700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fc2d813e9f0 tx=0x7fc2c00019e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c000ce60 con 0x7fc2d80b3d30 2021-10-21T00:06:51.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0007170 con 0x7fc2d80b3d30 2021-10-21T00:06:51.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c0004730 con 0x7fc2d80b3d30 2021-10-21T00:06:51.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d8066610 con 0x7fc2d80b3d30 2021-10-21T00:06:51.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.937+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d8114af0 con 0x7fc2d80b3d30 2021-10-21T00:06:51.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d80b25b0 con 0x7fc2d80b3d30 2021-10-21T00:06:51.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2c001b070 con 0x7fc2d80b3d30 2021-10-21T00:06:51.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2d57fa700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 0x7fc2bc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:51.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2c006b0c0 con 0x7fc2d80b3d30 2021-10-21T00:06:51.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2d7fff700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 0x7fc2bc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:51.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.941+0000 7fc2d7fff700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 0x7fc2bc055b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc2c800d000 tx=0x7fc2c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:51.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:51.949+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2c0042180 con 0x7fc2d80b3d30 2021-10-21T00:06:52.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.077+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2d80b19a0 con 0x7fc2d80b3d30 2021-10-21T00:06:52.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.077+0000 7fc2d57fa700 1 -- 172.21.15.41:0/3887020732 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc2c00457a0 con 0x7fc2d80b3d30 2021-10-21T00:06:52.084 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:52.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 msgr2=0x7fc2bc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 0x7fc2bc055b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc2c800d000 tx=0x7fc2c8009040).stop 2021-10-21T00:06:52.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 msgr2=0x7fc2d8114600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fc2d813e9f0 tx=0x7fc2c00019e0).stop 2021-10-21T00:06:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 shutdown_connections 2021-10-21T00:06:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2bc0536d0 0x7fc2bc055b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2d8142050 0x7fc2d80b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2d80b3d30 0x7fc2d8114600 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 --2- 172.21.15.41:0/3887020732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2d80adb80 0x7fc2d8151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 >> 172.21.15.41:0/3887020732 conn(0x7fc2d8064910 msgr2=0x7fc2d813f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 shutdown_connections 2021-10-21T00:06:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.081+0000 7fc2de5cf700 1 -- 172.21.15.41:0/3887020732 wait complete. 2021-10-21T00:06:52.095 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:06:52.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 Processor -- start 2021-10-21T00:06:52.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 -- start start 2021-10-21T00:06:52.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d4062330 0x7f65d40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f65d40b3a20 0x7f65d413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d405bd40 con 0x7f65d4062f70 2021-10-21T00:06:52.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d405bf70 con 0x7f65d40b3a20 2021-10-21T00:06:52.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.201+0000 7f65dac1a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4142cb0 con 0x7f65d4062330 2021-10-21T00:06:52.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f65d40b3a20 0x7f65d413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d9417700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f65d4062f70 0x7f65d405c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58602/0 (socket says 172.21.15.41:58602) 2021-10-21T00:06:52.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d9417700 1 -- 172.21.15.41:0/2460513813 learned_addr learned my addr 172.21.15.41:0/2460513813 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:06:52.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d9c18700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d4062330 0x7f65d40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d8c16700 1 -- 172.21.15.41:0/2460513813 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444904336 0 0) 0x7f65d405bd40 con 0x7f65d4062f70 2021-10-21T00:06:52.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d8c16700 1 -- 172.21.15.41:0/2460513813 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65bc003260 con 0x7f65d4062f70 2021-10-21T00:06:52.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 -- 172.21.15.41:0/2460513813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d4062330 msgr2=0x7f65d40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:52.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d4062330 0x7f65d40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 -- 172.21.15.41:0/2460513813 >> v1:172.21.15.41:6789/0 conn(0x7f65d4062f70 legacy=0x7f65d405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 -- 172.21.15.41:0/2460513813 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4142950 con 0x7f65d40b3a20 2021-10-21T00:06:52.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65da419700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d40b3a20 0x7f65d413c510 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f65cc0032f0 tx=0x7f65cc0091d0).ready entity=mon.0 client_cookie=43c4c3dc471b7db4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d8c16700 1 -- 172.21.15.41:0/2460513813 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65cc00b600 con 0x7f65d40b3a20 2021-10-21T00:06:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d8c16700 1 -- 172.21.15.41:0/2460513813 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00b760 con 0x7f65d40b3a20 2021-10-21T00:06:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65d8c16700 1 -- 172.21.15.41:0/2460513813 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65cc00b8d0 con 0x7f65d40b3a20 2021-10-21T00:06:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- 172.21.15.41:0/2460513813 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d40b3a20 msgr2=0x7f65d413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d40b3a20 0x7f65d413c510 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f65cc0032f0 tx=0x7f65cc0091d0).stop 2021-10-21T00:06:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- 172.21.15.41:0/2460513813 shutdown_connections 2021-10-21T00:06:52.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d40b3a20 0x7f65d413c510 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 --2- 172.21.15.41:0/2460513813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d4062330 0x7f65d40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- 172.21.15.41:0/2460513813 >> 172.21.15.41:0/2460513813 conn(0x7f65d40b9080 msgr2=0x7f65d40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:52.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- 172.21.15.41:0/2460513813 shutdown_connections 2021-10-21T00:06:52.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- 172.21.15.41:0/2460513813 wait complete. 2021-10-21T00:06:52.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 Processor -- start 2021-10-21T00:06:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.205+0000 7f65dac1a700 1 -- start start 2021-10-21T00:06:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4062f70 0x7f65d41483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40b3a20 0x7f65d4140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d413ed20 con 0x7f65d4062330 2021-10-21T00:06:52.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d41412a0 con 0x7f65d4062f70 2021-10-21T00:06:52.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d413fed0 con 0x7f65d40b3a20 2021-10-21T00:06:52.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60838/0 (socket says 172.21.15.41:60838) 2021-10-21T00:06:52.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 -- 172.21.15.41:0/801625357 learned_addr learned my addr 172.21.15.41:0/801625357 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:52.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9417700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4062f70 0x7f65d41483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65da419700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40b3a20 0x7f65d4140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 -- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40b3a20 msgr2=0x7f65d4140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40b3a20 0x7f65d4140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 -- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4062f70 msgr2=0x7f65d41483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4062f70 0x7f65d41483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 -- 172.21.15.41:0/801625357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc009470 con 0x7f65d4062330 2021-10-21T00:06:52.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65d9c18700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f65d41410c0 tx=0x7f65c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c400c830 con 0x7f65d4062330 2021-10-21T00:06:52.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400c990 con 0x7f65d4062330 2021-10-21T00:06:52.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d4140100 con 0x7f65d4062330 2021-10-21T00:06:52.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65c400ccf0 con 0x7f65d4062330 2021-10-21T00:06:52.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.209+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40acb30 con 0x7f65d4062330 2021-10-21T00:06:52.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65c401c460 con 0x7f65d4062330 2021-10-21T00:06:52.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40ac890 con 0x7f65d4062330 2021-10-21T00:06:52.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65c2ffd700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 0x7f65b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f65c406bf00 con 0x7f65d4062330 2021-10-21T00:06:52.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65d9417700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 0x7f65b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.213+0000 7f65d9417700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 0x7f65b4055ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f65d000b000 tx=0x7f65d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.221+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65d40ac890 con 0x7f65d4062330 2021-10-21T00:06:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.349+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65d40ac890 con 0x7f65d4062330 2021-10-21T00:06:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.349+0000 7f65c2ffd700 1 -- 172.21.15.41:0/801625357 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+10 (secure 0 0 0) 0x7f65d40ac890 con 0x7f65d4062330 2021-10-21T00:06:52.355 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:06:52.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 msgr2=0x7f65b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 0x7f65b4055ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f65d000b000 tx=0x7f65d0009040).stop 2021-10-21T00:06:52.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 msgr2=0x7f65d4142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f65d41410c0 tx=0x7f65c4006df0).stop 2021-10-21T00:06:52.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 shutdown_connections 2021-10-21T00:06:52.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65b4053610 0x7f65b4055ad0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40b3a20 0x7f65d4140740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d4062f70 0x7f65d41483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 --2- 172.21.15.41:0/801625357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65d4062330 0x7f65d4142360 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 >> 172.21.15.41:0/801625357 conn(0x7f65d40b9080 msgr2=0x7f65d40b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:52.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 shutdown_connections 2021-10-21T00:06:52.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.353+0000 7f65dac1a700 1 -- 172.21.15.41:0/801625357 wait complete. 2021-10-21T00:06:52.373 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:06:52.374 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:06:52.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.469+0000 7f4283372700 1 Processor -- start 2021-10-21T00:06:52.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.469+0000 7f4283372700 1 -- start start 2021-10-21T00:06:52.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f427c062330 0x7f427c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f427c062f70 0x7f427c05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c05bd40 con 0x7f427c0b3a20 2021-10-21T00:06:52.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c05bf70 con 0x7f427c062f70 2021-10-21T00:06:52.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c142cb0 con 0x7f427c062330 2021-10-21T00:06:52.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f427c062f70 0x7f427c05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f427c062f70 0x7f427c05c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60848/0 (socket says 172.21.15.41:60848) 2021-10-21T00:06:52.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 -- 172.21.15.41:0/1948154384 learned_addr learned my addr 172.21.15.41:0/1948154384 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:52.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4282370700 1 --2- 172.21.15.41:0/1948154384 >> v2:172.21.15.62:3300/0 conn(0x7f427c062330 0x7f427c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 -- 172.21.15.41:0/1948154384 >> v2:172.21.15.62:3300/0 conn(0x7f427c062330 msgr2=0x7f427c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:06:52.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 --2- 172.21.15.41:0/1948154384 >> v2:172.21.15.62:3300/0 conn(0x7f427c062330 0x7f427c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 -- 172.21.15.41:0/1948154384 >> v1:172.21.15.62:6789/0 conn(0x7f427c0b3a20 legacy=0x7f427c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 -- 172.21.15.41:0/1948154384 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c142950 con 0x7f427c062f70 2021-10-21T00:06:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4281b6f700 1 --2- 172.21.15.41:0/1948154384 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062f70 0x7f427c05c410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f426c002f70 tx=0x7f426c006eb0).ready entity=mon.0 client_cookie=a2cc078176d4241d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f428136e700 1 -- 172.21.15.41:0/1948154384 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f426c00d5c0 con 0x7f427c062f70 2021-10-21T00:06:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f428136e700 1 -- 172.21.15.41:0/1948154384 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c000e90 con 0x7f427c062f70 2021-10-21T00:06:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f428136e700 1 -- 172.21.15.41:0/1948154384 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f426c00d950 con 0x7f427c062f70 2021-10-21T00:06:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- 172.21.15.41:0/1948154384 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062f70 msgr2=0x7f427c05c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 --2- 172.21.15.41:0/1948154384 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062f70 0x7f427c05c410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f426c002f70 tx=0x7f426c006eb0).stop 2021-10-21T00:06:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- 172.21.15.41:0/1948154384 shutdown_connections 2021-10-21T00:06:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 --2- 172.21.15.41:0/1948154384 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062f70 0x7f427c05c410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 --2- 172.21.15.41:0/1948154384 >> v2:172.21.15.62:3300/0 conn(0x7f427c062330 0x7f427c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- 172.21.15.41:0/1948154384 >> 172.21.15.41:0/1948154384 conn(0x7f427c0b9080 msgr2=0x7f427c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- 172.21.15.41:0/1948154384 shutdown_connections 2021-10-21T00:06:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.473+0000 7f4283372700 1 -- 172.21.15.41:0/1948154384 wait complete. 2021-10-21T00:06:52.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 Processor -- start 2021-10-21T00:06:52.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 -- start start 2021-10-21T00:06:52.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f427c062f70 0x7f427c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f427c0b3a20 0x7f427c13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c13cef0 con 0x7f427c062330 2021-10-21T00:06:52.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0af5a0 con 0x7f427c0b3a20 2021-10-21T00:06:52.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4283372700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c140030 con 0x7f427c062f70 2021-10-21T00:06:52.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60852/0 (socket says 172.21.15.41:60852) 2021-10-21T00:06:52.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 -- 172.21.15.41:0/3166152301 learned_addr learned my addr 172.21.15.41:0/3166152301 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:06:52.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4281b6f700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f427c062f70 0x7f427c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282b71700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f427c0b3a20 0x7f427c13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 -- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f427c062f70 msgr2=0x7f427c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f427c062f70 0x7f427c13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 -- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f427c0b3a20 msgr2=0x7f427c13ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f427c0b3a20 0x7f427c13ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 -- 172.21.15.41:0/3166152301 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c00b1e0 con 0x7f427c062330 2021-10-21T00:06:52.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f4282370700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f427c0af6e0 tx=0x7f4278006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.477+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278010780 con 0x7f427c062330 2021-10-21T00:06:52.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780108e0 con 0x7f427c062330 2021-10-21T00:06:52.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c1402d0 con 0x7f427c062330 2021-10-21T00:06:52.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278010c40 con 0x7f427c062330 2021-10-21T00:06:52.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0b4cd0 con 0x7f427c062330 2021-10-21T00:06:52.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c13fe50 con 0x7f427c062330 2021-10-21T00:06:52.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f427801c460 con 0x7f427c062330 2021-10-21T00:06:52.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f426b7fe700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 0x7f425c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:06:52.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f427806bdd0 con 0x7f427c062330 2021-10-21T00:06:52.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.481+0000 7f4281b6f700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 0x7f425c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:06:52.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.485+0000 7f4281b6f700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 0x7f425c055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f426c01c000 tx=0x7f426c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:06:52.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.489+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4278042d40 con 0x7f427c062330 2021-10-21T00:06:52.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.649+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f427c057350 con 0x7f427c062330 2021-10-21T00:06:52.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.649+0000 7f426b7fe700 1 -- 172.21.15.41:0/3166152301 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f4278046360 con 0x7f427c062330 2021-10-21T00:06:52.656 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:06:52.656 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:06:52.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 msgr2=0x7f425c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 0x7f425c055b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f426c01c000 tx=0x7f426c015000).stop 2021-10-21T00:06:52.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 msgr2=0x7f427c0b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:06:52.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f427c0af6e0 tx=0x7f4278006df0).stop 2021-10-21T00:06:52.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 shutdown_connections 2021-10-21T00:06:52.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f425c053640 0x7f425c055b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f427c0b3a20 0x7f427c13ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f427c062f70 0x7f427c13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 --2- 172.21.15.41:0/3166152301 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f427c062330 0x7f427c0b47e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:06:52.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 >> 172.21.15.41:0/3166152301 conn(0x7f427c0b9080 msgr2=0x7f427c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:06:52.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 shutdown_connections 2021-10-21T00:06:52.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:06:52.653+0000 7f4283372700 1 -- 172.21.15.41:0/3166152301 wait complete. 2021-10-21T00:06:52.660 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:06:52.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:06:28.177510+0000', 'modified': '2021-10-21T00:06:29.181089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5619': {'gid': 5619, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3050633316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3050633316}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3050633316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:06:52.871 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:06:52.872 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:06:52.993 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5619,"want_state":"up:active","state":"up:active","rank_uptime":24.801917154000002,"mdsmap_epoch":21,"osdmap_epoch":50,"osdmap_epoch_barrier":49,"uptime":29.892761471} 2021-10-21T00:06:52.994 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5619, "mdsmap_epoch": 21, "osdmap_epoch": 50, "osdmap_epoch_barrier": 49, "rank_uptime": 24.801917154, "state": "up:active", "uptime": 29.892761471, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:06:52.995 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:06:52.995 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:06:52.995 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:06:52.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:52.996 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:53.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:53.064 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:53.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:53.077 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:53.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:53.079 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:53.086 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:06:53.086 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:53.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:53.147 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:53.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:53.157 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:53.158 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:53.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:53.160 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:53.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:06:53.198+0000 7f0f27466080 -1 init, newargv = 0x55a382aa9950 newargc=9ceph-fuse[14279 2021-10-21T00:06:53.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:]: starting ceph client 2021-10-21T00:06:53.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14279]: starting fuse 2021-10-21T00:06:54.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:06:54.284 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:06:54.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:06:54.341 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:06:54.343 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:06:54.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:54.344 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:06:54.350 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:06:54.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:06:54.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:54.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:06:54.353 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:06:54.354 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:06:54.356 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:06:54.356 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:06:54.357 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:54.357 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:06:54.358 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:06:54.358 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:06:54.358 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:54.359 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:06:54.359 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:06:54.360 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:06:54.360 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:06:54.361 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:54.361 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:06:54.361 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:06:54.362 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:06:54.362 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:06:54.363 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:06:54.363 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:06:54.364 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:06:54.365 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:06:54.432 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14279.asok 2021-10-21T00:06:54.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14279.asok 2021-10-21T00:06:54.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:54.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14279.asok status 2021-10-21T00:06:54.524 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:06:54.525 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:06:54.525 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:06:54.525 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:06:54.525 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:06:54.526 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:06:54.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:06:54.526 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14279", 2021-10-21T00:06:54.526 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:06:54.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:54.527 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:06:54.527 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:06:54.527 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5405, 2021-10-21T00:06:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:06:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:06:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:06:54.528 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5405 2021-10-21T00:06:54.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:54.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:06:54.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:06:54.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:06:54.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2780386058 2021-10-21T00:06:54.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:06:54.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:54.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:06:54.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:06:54.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:06:54.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2780386058 2021-10-21T00:06:54.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:06:54.531 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5405 172.21.15.71:0/2780386058", 2021-10-21T00:06:54.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/2780386058", 2021-10-21T00:06:54.532 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:06:54.532 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 21, 2021-10-21T00:06:54.532 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 50, 2021-10-21T00:06:54.532 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:06:54.533 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:06:54.533 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:06:54.533 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:06:54.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:54.535 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:06:54.536 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:54.543 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:06:54.544 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:06:54.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:06:54.545 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:06:57.842 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:57.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:57.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:57.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:06:57.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:27.917 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:27.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:27.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:27.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:27.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:48.100 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:07:48.101 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:48.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:48.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:48.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:48.184 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:48.206 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:07:48.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:48.207 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:48.207 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:07:48.215 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:07:48.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:07:48.217 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:07:48.217 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:07:48.217 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:07:48.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14279]: fuse finished with error 0 and tester_r 0 2021-10-21T00:07:48.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:48.235 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:48.235 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:07:48.241 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:07:48.242 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:07:48.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:07:48.279 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:07:48.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:48.327 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:48.327 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:07:48.334 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:07:48.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:48.336 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:07:48.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:07:48.337 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:07:48.343 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:07:48.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:48.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:48.345 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:48.346 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:07:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:07:48.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:48.354 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:07:48.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:07:48.355 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:07:48.403 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:07:48.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:48.405 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:07:48.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.512+0000 7f6bc657a700 1 Processor -- start 2021-10-21T00:07:48.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc657a700 1 -- start start 2021-10-21T00:07:48.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc657a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6bc0067a00 0x7f6bc01468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:48.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc657a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc005c3c0 con 0x7f6bc005c6b0 2021-10-21T00:07:48.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc657a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc00b27a0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc657a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00b1920 con 0x7f6bc0067a00 2021-10-21T00:07:48.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc5d79700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f6bc005c6b0 0x7f6bc0141930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58634/0 (socket says 172.21.15.41:58634) 2021-10-21T00:07:48.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc5d79700 1 -- 172.21.15.41:0/3622918158 learned_addr learned my addr 172.21.15.41:0/3622918158 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:48.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc4d77700 1 --2- 172.21.15.41:0/3622918158 >> v2:172.21.15.62:3300/0 conn(0x7f6bc0067a00 0x7f6bc01468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:48.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780869662 0 0) 0x7f6bc005c3c0 con 0x7f6bc005c6b0 2021-10-21T00:07:48.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba8003260 con 0x7f6bc005c6b0 2021-10-21T00:07:48.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981650676 0 0) 0x7f6bc00b27a0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc005c3c0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc4d77700 1 -- 172.21.15.41:0/3622918158 >> v1:172.21.15.62:6789/0 conn(0x7f6bc005bfe0 legacy=0x7f6bc01461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc4d77700 1 -- 172.21.15.41:0/3622918158 >> v1:172.21.15.41:6789/0 conn(0x7f6bc005c6b0 legacy=0x7f6bc0141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc4d77700 1 -- 172.21.15.41:0/3622918158 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00b2a40 con 0x7f6bc0067a00 2021-10-21T00:07:48.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.516+0000 7f6bc4d77700 1 --2- 172.21.15.41:0/3622918158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc01468d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6bb0002f70 tx=0x7f6bb0006df0).ready entity=mon.1 client_cookie=9d8fb59c957c438c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:48.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb000d540 con 0x7f6bc0067a00 2021-10-21T00:07:48.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0000e90 con 0x7f6bc0067a00 2021-10-21T00:07:48.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6baffff700 1 -- 172.21.15.41:0/3622918158 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bb000d890 con 0x7f6bc0067a00 2021-10-21T00:07:48.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 -- 172.21.15.41:0/3622918158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 msgr2=0x7f6bc01468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 --2- 172.21.15.41:0/3622918158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc01468d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6bb0002f70 tx=0x7f6bb0006df0).stop 2021-10-21T00:07:48.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 -- 172.21.15.41:0/3622918158 shutdown_connections 2021-10-21T00:07:48.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 --2- 172.21.15.41:0/3622918158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc01468d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 -- 172.21.15.41:0/3622918158 >> 172.21.15.41:0/3622918158 conn(0x7f6bc00637b0 msgr2=0x7f6bc0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:48.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 -- 172.21.15.41:0/3622918158 shutdown_connections 2021-10-21T00:07:48.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.520+0000 7f6bc657a700 1 -- 172.21.15.41:0/3622918158 wait complete. 2021-10-21T00:07:48.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 Processor -- start 2021-10-21T00:07:48.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- start start 2021-10-21T00:07:48.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:48.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc005c6b0 0x7f6bc013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:48.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc013fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:48.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00652e0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0140260 con 0x7f6bc0067a00 2021-10-21T00:07:48.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01411d0 con 0x7f6bc005c6b0 2021-10-21T00:07:48.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:48.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60866/0 (socket says 172.21.15.41:60866) 2021-10-21T00:07:48.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 -- 172.21.15.41:0/1707271685 learned_addr learned my addr 172.21.15.41:0/1707271685 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:48.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc4d77700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc005c6b0 0x7f6bc013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:48.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5d79700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc013fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:48.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 -- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc005c6b0 msgr2=0x7f6bc013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc005c6b0 0x7f6bc013f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 -- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 msgr2=0x7f6bc013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc013fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 -- 172.21.15.41:0/1707271685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb000b180 con 0x7f6bc005bfe0 2021-10-21T00:07:48.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc5578700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f6bbc001160 tx=0x7f6bbc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:48.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc012400 con 0x7f6bc005bfe0 2021-10-21T00:07:48.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc012560 con 0x7f6bc005bfe0 2021-10-21T00:07:48.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc0140e90 con 0x7f6bc005bfe0 2021-10-21T00:07:48.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc0128c0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc00662a0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.524+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0141020 con 0x7f6bc005bfe0 2021-10-21T00:07:48.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.528+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6bbc010070 con 0x7f6bc005bfe0 2021-10-21T00:07:48.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.528+0000 7f6bae7fc700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 0x7f6ba0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:48.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.528+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6bbc06aaa0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.528+0000 7f6bc4d77700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 0x7f6ba0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:48.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.528+0000 7f6bc4d77700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 0x7f6ba0055b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6bb0018000 tx=0x7f6bb0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:48.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.536+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6bbc041c00 con 0x7f6bc005bfe0 2021-10-21T00:07:48.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.660+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6bc00b11e0 con 0x7f6bc005bfe0 2021-10-21T00:07:48.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.660+0000 7f6bae7fc700 1 -- 172.21.15.41:0/1707271685 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+33647 (secure 0 0 0) 0x7f6bbc045220 con 0x7f6bc005bfe0 2021-10-21T00:07:48.669 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:48.669 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:07:48.669 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 50, 2021-10-21T00:07:48.670 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:07:48.670 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:07:48.670 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:06:29.180913+0000", 2021-10-21T00:07:48.670 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:07:48.671 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:07:48.671 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:07:48.671 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:07:48.671 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:07:48.672 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:07:48.672 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:07:48.672 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:07:48.672 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:07:48.672 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:48.673 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:07:48.673 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:07:48.673 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:07:48.673 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:07:48.674 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:07:48.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 10, 2021-10-21T00:07:48.674 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:07:48.674 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:07:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:07:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:07:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:07:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.675 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:07:48.676 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:07:48.676 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:07:48.676 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:48.676 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:48.676 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:48.677 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:48.677 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:48.677 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:48.677 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:48.678 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:48.678 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:07:48.678 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:07:48.678 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:07:48.679 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:07:48.679 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:07:48.679 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:48.679 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:48.679 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:48.680 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:48.680 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:48.680 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:48.680 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:48.681 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.681 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:07:48.681 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:48.681 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:48.682 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:48.682 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:48.682 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:48.683 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:48.683 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:48.683 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:48.683 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:48.684 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:48.684 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:48.684 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:48.684 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:48.685 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:48.685 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:48.685 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:48.685 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:48.686 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:48.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:48.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:48.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:48.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:48.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:48.687 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:48.687 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:48.688 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:48.688 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.688 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:48.688 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:48.688 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:48.689 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:48.689 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:48.689 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:48.689 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:48.690 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:48.690 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:48.690 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:48.690 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:48.690 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:07:48.691 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:07:48.691 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.691 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:48.691 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:07:48.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.692 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.692 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.692 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:07:48.692 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:07:48.693 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:07:48.693 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:48.693 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:48.693 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:48.693 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:48.694 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:48.694 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:48.694 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:48.694 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:48.695 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:07:48.695 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:07:48.695 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:07:48.695 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:07:48.696 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:07:48.696 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:48.696 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:48.697 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:48.697 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:48.697 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:48.697 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:48.698 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:48.698 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.698 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:07:48.699 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:48.699 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:48.699 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:48.699 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:48.700 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:48.700 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:48.700 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:48.700 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:48.701 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:48.701 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:48.701 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:48.701 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:48.702 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:48.702 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:48.702 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:48.703 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:48.703 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:48.703 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:48.704 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:48.704 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:48.704 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:48.704 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:48.705 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:48.705 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:48.705 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:48.705 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:48.706 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.706 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:48.706 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:48.707 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:48.707 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:48.707 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:48.707 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:48.708 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:48.708 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:48.708 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:48.708 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:48.708 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:48.709 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:07:48.709 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:48.709 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:07:48.709 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.710 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.710 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.710 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 9, 2021-10-21T00:07:48.710 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:07:48.711 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:06:25.860491+0000", 2021-10-21T00:07:48.711 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:48.711 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:48.711 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:48.711 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:48.712 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:48.712 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:48.712 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:48.712 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:48.713 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:07:48.713 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:07:48.713 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:07:48.713 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:07:48.713 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:07:48.714 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:48.714 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:48.714 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:48.714 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:48.715 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:48.715 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:48.715 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:48.715 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.715 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "49", 2021-10-21T00:07:48.716 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:48.716 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:48.716 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:48.716 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:48.717 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:48.717 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:48.717 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:48.717 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:48.717 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:48.718 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:48.718 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:48.718 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:48.718 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:48.719 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:48.719 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:48.719 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:48.719 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:48.719 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:48.720 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:48.720 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:48.720 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:48.720 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:48.721 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:48.721 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:48.721 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:48.721 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:48.721 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.722 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:48.722 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:48.722 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:48.722 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:48.723 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:48.723 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:48.723 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:48.723 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:48.723 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:48.724 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:48.724 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:48.724 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:07:48.724 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:07:48.725 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:07:48.725 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:07:48.725 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.725 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:48.725 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:07:48.726 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:07:48.726 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.726 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.727 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.727 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 10, 2021-10-21T00:07:48.727 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:07:48.727 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:06:27.113771+0000", 2021-10-21T00:07:48.727 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:48.728 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:48.728 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:48.728 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:48.728 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:48.729 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:48.729 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:48.729 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:48.729 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:07:48.729 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:07:48.730 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:07:48.730 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:07:48.730 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:07:48.730 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:48.731 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:48.731 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:48.731 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:48.731 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:48.731 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:48.732 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:48.732 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.732 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "50", 2021-10-21T00:07:48.732 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:48.732 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:48.733 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:48.733 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:48.733 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:48.733 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:48.734 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:48.734 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:48.734 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:48.734 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:48.734 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:48.735 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:48.735 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:48.735 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:48.735 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:48.735 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:48.736 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:48.736 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:48.736 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:48.736 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:48.737 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:48.737 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:48.737 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:48.737 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:48.737 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:48.738 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:48.738 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.738 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:48.738 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:48.738 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:48.739 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:48.739 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:48.739 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:48.739 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:48.740 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:48.740 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:48.740 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:48.740 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:48.740 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:07:48.741 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:48.741 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:07:48.741 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:07:48.741 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.742 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.742 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.742 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:48.742 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:07:48.742 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.743 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:07:48.743 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:07:48.743 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.743 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.744 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.744 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.744 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.744 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.744 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.745 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.745 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.745 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.745 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.745 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.746 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.746 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.746 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:07:48.746 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.747 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.747 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.747 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.747 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:07:48.748 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.748 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.748 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.748 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.748 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.749 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.749 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.749 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.749 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:07:48.749 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.750 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.750 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.750 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.750 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:07:48.751 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.751 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.751 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.751 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.751 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.752 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.752 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.752 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.752 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:07:48.753 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.753 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.753 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.753 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.753 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:07:48.754 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.754 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.754 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.754 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.755 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.755 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.755 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.755 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.755 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:07:48.756 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.756 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.756 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.756 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.757 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:07:48.757 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:48.757 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.757 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.757 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.758 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:07:48.758 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:07:48.758 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:07:48.758 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:07:48.759 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.759 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.759 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.759 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.759 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.760 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.760 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:07:48.760 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:07:48.760 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.761 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.761 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.761 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.761 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.762 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.762 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.762 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.762 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.762 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.763 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.763 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.763 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.763 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.764 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:07:48.764 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.764 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.764 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.764 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.765 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:07:48.765 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.765 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.765 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.766 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.766 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.766 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.766 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.766 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.767 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:07:48.767 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.767 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.767 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.768 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.768 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:07:48.768 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.768 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.768 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.769 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.769 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.769 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.769 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.770 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.770 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:07:48.770 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.770 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.770 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.771 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.771 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:07:48.771 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.771 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.771 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.772 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.772 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.772 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.772 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.773 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.773 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:07:48.773 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.773 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.773 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.774 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.774 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:07:48.774 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:48.774 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.775 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.775 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.775 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:07:48.775 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:07:48.775 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:07:48.776 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:07:48.776 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.776 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.776 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.776 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.777 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.777 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.777 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:07:48.777 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:07:48.778 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.778 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.778 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.778 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.778 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.779 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.779 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.779 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.779 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.779 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.780 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.780 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.780 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.780 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.781 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:07:48.781 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.781 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.781 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.781 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.782 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:07:48.782 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.782 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.782 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.783 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.783 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.783 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.783 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.783 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.784 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:07:48.784 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.784 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.784 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.784 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.785 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:07:48.785 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.785 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.785 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.786 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.786 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.786 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.786 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.786 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.787 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:07:48.787 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.787 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.787 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.787 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.788 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:07:48.788 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.788 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.788 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.789 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.789 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.789 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.789 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.789 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.790 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:07:48.790 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.790 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.790 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.790 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.791 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:07:48.791 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:48.791 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.791 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.792 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.792 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:07:48.792 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:07:48.792 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:07:48.792 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:07:48.793 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.793 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.793 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.793 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.794 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.794 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.794 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:07:48.794 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:07:48.794 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.795 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.795 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.795 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.795 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.795 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.796 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.796 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:07:48.796 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.796 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.797 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.797 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.797 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.797 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.797 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:07:48.798 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.798 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.798 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.798 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.799 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:07:48.799 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.799 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.799 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.800 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.800 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.800 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.800 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.800 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.801 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:07:48.801 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.801 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.801 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.801 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.802 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:07:48.802 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.802 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.802 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.803 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.803 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.803 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.803 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.804 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.804 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:07:48.804 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.804 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.804 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.805 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.805 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:07:48.805 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.805 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.805 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.806 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.806 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.806 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.806 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.807 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.807 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:07:48.807 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.807 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.808 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.808 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.808 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:07:48.808 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:48.808 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.809 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.809 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.809 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:07:48.809 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:07:48.810 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:07:48.810 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:07:48.810 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.810 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.810 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.811 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.811 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.811 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.811 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:07:48.812 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:07:48.812 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.812 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.812 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.812 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.813 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.813 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.813 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.813 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.814 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.814 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.814 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.814 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.814 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.815 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.815 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:07:48.815 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.815 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.816 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.816 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.816 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:07:48.816 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.816 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.817 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.817 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.817 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.817 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.817 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.818 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.818 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:07:48.818 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.818 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.819 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.819 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.819 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:07:48.819 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.819 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.820 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.820 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.820 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.820 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.820 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.821 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.821 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:07:48.821 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.821 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.822 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.822 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.822 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:07:48.822 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.822 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.823 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.823 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.823 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.823 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.823 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.824 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.824 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:07:48.824 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.824 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.825 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.825 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.825 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:07:48.825 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:48.825 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.826 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.826 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.826 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:07:48.826 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:07:48.826 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:07:48.827 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:07:48.827 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.827 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.827 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.828 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.828 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.828 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.828 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:07:48.828 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:07:48.829 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.829 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.829 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.829 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.829 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.830 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.830 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.830 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.830 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.831 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.831 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.831 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.831 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.831 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.832 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:07:48.832 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.832 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.832 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.832 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.833 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:07:48.833 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.833 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.833 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.834 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.834 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.834 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.834 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.834 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.835 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:07:48.835 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.835 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.835 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.836 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.836 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:07:48.836 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.836 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.836 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.837 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.837 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.837 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.837 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.837 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.838 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:07:48.838 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.838 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.838 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.839 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.839 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:07:48.839 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.839 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.839 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.840 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.840 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.840 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.840 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.840 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.841 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:07:48.841 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.841 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.841 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.842 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.842 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:07:48.842 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:48.842 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.842 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.843 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.843 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:07:48.843 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:07:48.843 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:07:48.844 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:07:48.844 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.844 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.844 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.844 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.845 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.845 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.845 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:07:48.845 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:07:48.846 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.846 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.846 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.846 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.846 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.847 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.847 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.847 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:48.847 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.847 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.848 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.848 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.848 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.848 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.849 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:07:48.849 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.849 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.849 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.849 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.850 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:07:48.850 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.850 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.850 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.851 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.851 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.851 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.851 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.852 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.852 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:07:48.852 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.852 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.852 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.853 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.853 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:07:48.853 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.853 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.853 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.854 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.854 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.854 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.854 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.855 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.855 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:07:48.855 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.855 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.856 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.856 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.856 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:07:48.856 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.857 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.857 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.857 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.857 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.857 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.858 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.858 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.858 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:07:48.858 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.859 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.859 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.859 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.859 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:07:48.859 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:48.860 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.860 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.860 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.860 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:07:48.861 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:07:48.861 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:07:48.861 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:07:48.861 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.861 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.862 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.862 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.862 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.862 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.863 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:07:48.863 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:07:48.863 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:48.863 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:48.863 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:48.864 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:48.864 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:48.864 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:48.864 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:48.864 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:07:48.865 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:48.865 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:48.865 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:48.865 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.866 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.866 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.866 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:07:48.866 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.866 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.867 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.867 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.867 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:07:48.867 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.867 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.868 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.868 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.868 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:48.868 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.869 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.869 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.869 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:07:48.869 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.869 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.870 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.870 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.870 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:07:48.870 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.871 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.871 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.871 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.871 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:48.871 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.872 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.872 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.872 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:07:48.872 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.873 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.873 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.873 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.873 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:07:48.873 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.874 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.874 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.874 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.874 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:48.874 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:48.875 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.875 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:48.875 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:07:48.875 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.876 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.876 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.876 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:48.876 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:07:48.876 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:48.877 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.877 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.877 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.877 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:07:48.877 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:07:48.878 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:07:48.878 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:07:48.878 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:48.878 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:48.879 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:48.879 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:48.879 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.879 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:48.879 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:07:48.880 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.880 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:07:48.880 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.880 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.880 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.881 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.881 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.881 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:07:48.881 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.882 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.882 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.882 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:07:48.882 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.882 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.883 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.883 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.883 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.884 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:07:48.884 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.884 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.884 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.884 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:07:48.885 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.885 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.885 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.885 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.886 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.886 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:07:48.886 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.886 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.886 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.887 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:07:48.887 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.887 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.887 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.887 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.888 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.888 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:07:48.888 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.888 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.889 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.889 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:07:48.889 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.889 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.889 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.890 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.890 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.890 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:07:48.890 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.890 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.891 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.891 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:07:48.891 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.891 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.891 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.892 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.892 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.892 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:07:48.892 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.893 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.893 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.893 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:07:48.893 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.893 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.894 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.894 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.894 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.894 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:07:48.894 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.895 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.895 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:48.895 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:07:48.895 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:48.896 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:48.896 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:48.896 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:48.896 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:48.896 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:07:48.897 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:48.897 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.897 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:48.897 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:07:48.897 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:07:48.898 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:07:48.898 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:07:48.898 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:07:48.898 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:07:48.898 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:07:48.899 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:07:48.899 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:07:48.899 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:07:48.899 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:07:48.900 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:07:48.900 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:07:48.900 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:48.900 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:48.900 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:07:48.901 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:07:48.901 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:07:48.901 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:07:48.901 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:07:48.901 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:07:48.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 msgr2=0x7f6ba0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 0x7f6ba0055b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f6bb0018000 tx=0x7f6bb0014000).stop 2021-10-21T00:07:48.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 msgr2=0x7f6bc0065c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:48.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f6bbc001160 tx=0x7f6bbc007a80).stop 2021-10-21T00:07:48.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 shutdown_connections 2021-10-21T00:07:48.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6ba00536a0 0x7f6ba0055b60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc0067a00 0x7f6bc013fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc005c6b0 0x7f6bc013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 --2- 172.21.15.41:0/1707271685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6bc005bfe0 0x7f6bc0065c10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:48.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 >> 172.21.15.41:0/1707271685 conn(0x7f6bc00637b0 msgr2=0x7f6bc00b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:48.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 shutdown_connections 2021-10-21T00:07:48.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:48.664+0000 7f6bc657a700 1 -- 172.21.15.41:0/1707271685 wait complete. 2021-10-21T00:07:48.907 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:07:49.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 Processor -- start 2021-10-21T00:07:49.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 -- start start 2021-10-21T00:07:49.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa60c147950 0x7fa60c05f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0b4760 con 0x7fa60c0b4380 2021-10-21T00:07:49.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c062e50 con 0x7fa60c05fe30 2021-10-21T00:07:49.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60b59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b1b40 con 0x7fa60c147950 2021-10-21T00:07:49.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa609d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa60c147950 0x7fa60c05f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60a59c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa60c0b4380 0x7fa60c1464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58646/0 (socket says 172.21.15.41:58646) 2021-10-21T00:07:49.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.012+0000 7fa60a59c700 1 -- 172.21.15.41:0/4034685694 learned_addr learned my addr 172.21.15.41:0/4034685694 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:49.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa609d9b700 1 -- 172.21.15.41:0/4034685694 >> v1:172.21.15.62:6789/0 conn(0x7fa60c05fe30 legacy=0x7fa60c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa609d9b700 1 -- 172.21.15.41:0/4034685694 >> v1:172.21.15.41:6789/0 conn(0x7fa60c0b4380 legacy=0x7fa60c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa609d9b700 1 -- 172.21.15.41:0/4034685694 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0630f0 con 0x7fa60c147950 2021-10-21T00:07:49.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa609d9b700 1 --2- 172.21.15.41:0/4034685694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c147950 0x7fa60c05f940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa5fc002f70 tx=0x7fa5fc006df0).ready entity=mon.0 client_cookie=ba6ea33e0186b658 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60959a700 1 -- 172.21.15.41:0/4034685694 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00d610 con 0x7fa60c147950 2021-10-21T00:07:49.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60959a700 1 -- 172.21.15.41:0/4034685694 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc000e90 con 0x7fa60c147950 2021-10-21T00:07:49.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60959a700 1 -- 172.21.15.41:0/4034685694 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00d960 con 0x7fa60c147950 2021-10-21T00:07:49.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- 172.21.15.41:0/4034685694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c147950 msgr2=0x7fa60c05f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 --2- 172.21.15.41:0/4034685694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c147950 0x7fa60c05f940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa5fc002f70 tx=0x7fa5fc006df0).stop 2021-10-21T00:07:49.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- 172.21.15.41:0/4034685694 shutdown_connections 2021-10-21T00:07:49.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 --2- 172.21.15.41:0/4034685694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c147950 0x7fa60c05f940 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- 172.21.15.41:0/4034685694 >> 172.21.15.41:0/4034685694 conn(0x7fa60c0b7910 msgr2=0x7fa60c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:49.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- 172.21.15.41:0/4034685694 shutdown_connections 2021-10-21T00:07:49.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- 172.21.15.41:0/4034685694 wait complete. 2021-10-21T00:07:49.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 Processor -- start 2021-10-21T00:07:49.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- start start 2021-10-21T00:07:49.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 0x7fa60c09ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa60c147950 0x7fa60c09a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c14add0 con 0x7fa60c05fe30 2021-10-21T00:07:49.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c1572b0 con 0x7fa60c0b4380 2021-10-21T00:07:49.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.016+0000 7fa60b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09cf40 con 0x7fa60c147950 2021-10-21T00:07:49.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60880/0 (socket says 172.21.15.41:60880) 2021-10-21T00:07:49.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 -- 172.21.15.41:0/3229268390 learned_addr learned my addr 172.21.15.41:0/3229268390 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:49.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60ad9d700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa60c147950 0x7fa60c09a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa609d9b700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 0x7fa60c09ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 -- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa60c147950 msgr2=0x7fa60c09a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa60c147950 0x7fa60c09a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 -- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 msgr2=0x7fa60c09ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 0x7fa60c09ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 -- 172.21.15.41:0/3229268390 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc00b180 con 0x7fa60c05fe30 2021-10-21T00:07:49.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa609d9b700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 0x7fa60c09ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:49.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60a59c700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa60c063d20 tx=0x7fa600007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6000070d0 con 0x7fa60c05fe30 2021-10-21T00:07:49.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600007230 con 0x7fa60c05fe30 2021-10-21T00:07:49.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa600005610 con 0x7fa60c05fe30 2021-10-21T00:07:49.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c1574a0 con 0x7fa60c05fe30 2021-10-21T00:07:49.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0b1100 con 0x7fa60c05fe30 2021-10-21T00:07:49.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c157630 con 0x7fa60c05fe30 2021-10-21T00:07:49.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa600010070 con 0x7fa60c05fe30 2021-10-21T00:07:49.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 0x7fa5e8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.020+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa60006ae70 con 0x7fa60c05fe30 2021-10-21T00:07:49.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.024+0000 7fa609d9b700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 0x7fa5e8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.024+0000 7fa609d9b700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 0x7fa5e8055b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fa5fc01a000 tx=0x7fa5fc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.032+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa600041fd0 con 0x7fa60c05fe30 2021-10-21T00:07:49.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.192+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa60c063390 con 0x7fa60c05fe30 2021-10-21T00:07:49.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa5fb7fe700 1 -- 172.21.15.41:0/3229268390 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fa600018030 con 0x7fa60c05fe30 2021-10-21T00:07:49.202 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:49.202 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:06:29.181089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3050633316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3050633316},{"type":"v1","addr":"172.21.15.41:6833","nonce":3050633316}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:07:49.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 msgr2=0x7fa5e8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 0x7fa5e8055b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fa5fc01a000 tx=0x7fa5fc015000).stop 2021-10-21T00:07:49.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 msgr2=0x7fa60c09c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa60c063d20 tx=0x7fa600007c40).stop 2021-10-21T00:07:49.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 shutdown_connections 2021-10-21T00:07:49.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa5e8053640 0x7fa5e8055b00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa60c147950 0x7fa60c09a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa60c0b4380 0x7fa60c09ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 --2- 172.21.15.41:0/3229268390 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa60c05fe30 0x7fa60c09c560 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 >> 172.21.15.41:0/3229268390 conn(0x7fa60c0b7910 msgr2=0x7fa60c145230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:49.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 shutdown_connections 2021-10-21T00:07:49.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.196+0000 7fa60b59e700 1 -- 172.21.15.41:0/3229268390 wait complete. 2021-10-21T00:07:49.207 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 21 2021-10-21T00:07:49.215 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:07:49.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.312+0000 7f5358896700 1 Processor -- start 2021-10-21T00:07:49.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.312+0000 7f5358896700 1 -- start start 2021-10-21T00:07:49.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f535409a450 0x7f53540609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53540ab880 0x7f535405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53540abd10 con 0x7f535405fba0 2021-10-21T00:07:49.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535409a830 con 0x7f535409a450 2021-10-21T00:07:49.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540afed0 con 0x7f53540ab880 2021-10-21T00:07:49.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5352d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f535405fba0 0x7f5354140dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58658/0 (socket says 172.21.15.41:58658) 2021-10-21T00:07:49.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5352d9d700 1 -- 172.21.15.41:0/735812489 learned_addr learned my addr 172.21.15.41:0/735812489 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:49.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 --2- 172.21.15.41:0/735812489 >> v2:172.21.15.62:3300/0 conn(0x7f535409a450 0x7f53540609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5351d9b700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53540ab880 0x7f535405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535159a700 1 -- 172.21.15.41:0/735812489 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421954651 0 0) 0x7f53540abd10 con 0x7f535405fba0 2021-10-21T00:07:49.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535159a700 1 -- 172.21.15.41:0/735812489 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003260 con 0x7f535405fba0 2021-10-21T00:07:49.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 -- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53540ab880 msgr2=0x7f535405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:49.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53540ab880 0x7f535405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 -- 172.21.15.41:0/735812489 >> v1:172.21.15.41:6789/0 conn(0x7f535405fba0 legacy=0x7f5354140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 -- 172.21.15.41:0/735812489 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540b0170 con 0x7f535409a450 2021-10-21T00:07:49.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535259c700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53540609a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5344002f70 tx=0x7f5344006df0).ready entity=mon.1 client_cookie=2ae4a2526527d2a5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535159a700 1 -- 172.21.15.41:0/735812489 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f534400d4a0 con 0x7f535409a450 2021-10-21T00:07:49.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535159a700 1 -- 172.21.15.41:0/735812489 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344000e90 con 0x7f535409a450 2021-10-21T00:07:49.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f535159a700 1 -- 172.21.15.41:0/735812489 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f534400d7f0 con 0x7f535409a450 2021-10-21T00:07:49.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 msgr2=0x7f53540609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53540609a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5344002f70 tx=0x7f5344006df0).stop 2021-10-21T00:07:49.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- 172.21.15.41:0/735812489 shutdown_connections 2021-10-21T00:07:49.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53540ab880 0x7f535405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 --2- 172.21.15.41:0/735812489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53540609a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- 172.21.15.41:0/735812489 >> 172.21.15.41:0/735812489 conn(0x7f535405bca0 msgr2=0x7f535405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:49.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- 172.21.15.41:0/735812489 shutdown_connections 2021-10-21T00:07:49.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.316+0000 7f5358896700 1 -- 172.21.15.41:0/735812489 wait complete. 2021-10-21T00:07:49.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 Processor -- start 2021-10-21T00:07:49.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- start start 2021-10-21T00:07:49.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53541502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5354143010 0x7f53541434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53541422b0 con 0x7f535405fba0 2021-10-21T00:07:49.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354150920 con 0x7f535409a450 2021-10-21T00:07:49.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5354150bc0 con 0x7f5354143010 2021-10-21T00:07:49.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60894/0 (socket says 172.21.15.41:60894) 2021-10-21T00:07:49.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 -- 172.21.15.41:0/2202301267 learned_addr learned my addr 172.21.15.41:0/2202301267 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:49.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5352d9d700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5354143010 0x7f53541434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5351d9b700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53541502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 -- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5354143010 msgr2=0x7f53541434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5354143010 0x7f53541434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 -- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 msgr2=0x7f53541502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:49.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53541502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:49.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 -- 172.21.15.41:0/2202301267 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534400b180 con 0x7f535405fba0 2021-10-21T00:07:49.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f535259c700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f5344002f70 tx=0x7f5344014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5344016070 con 0x7f535405fba0 2021-10-21T00:07:49.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440137d0 con 0x7f535405fba0 2021-10-21T00:07:49.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53540650d0 con 0x7f535405fba0 2021-10-21T00:07:49.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5344013b30 con 0x7f535405fba0 2021-10-21T00:07:49.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.320+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5354143990 con 0x7f535405fba0 2021-10-21T00:07:49.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5354150dc0 con 0x7f535405fba0 2021-10-21T00:07:49.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f534400f030 con 0x7f535405fba0 2021-10-21T00:07:49.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f53437fe700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 0x7f5330055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:49.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f534406c600 con 0x7f535405fba0 2021-10-21T00:07:49.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f5351d9b700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 0x7f5330055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:49.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.324+0000 7f5351d9b700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 0x7f5330055ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f534800b000 tx=0x7f5348006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:49.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.332+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5344043760 con 0x7f535405fba0 2021-10-21T00:07:49.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:49.496+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f53540af950 con 0x7f535405fba0 2021-10-21T00:07:50.450 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:07:50.444+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:07:50.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.456+0000 7f53437fe700 1 -- 172.21.15.41:0/2202301267 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5344046d80 con 0x7f535405fba0 2021-10-21T00:07:50.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 msgr2=0x7f5330055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 0x7f5330055ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f534800b000 tx=0x7f5348006df0).stop 2021-10-21T00:07:50.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 msgr2=0x7f535414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f5344002f70 tx=0x7f5344014000).stop 2021-10-21T00:07:50.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 shutdown_connections 2021-10-21T00:07:50.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5330053610 0x7f5330055ad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5354143010 0x7f53541434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f535409a450 0x7f53541502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 --2- 172.21.15.41:0/2202301267 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f535405fba0 0x7f535414fe00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 >> 172.21.15.41:0/2202301267 conn(0x7f535405bca0 msgr2=0x7f53540b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:50.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 shutdown_connections 2021-10-21T00:07:50.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.460+0000 7f5358896700 1 -- 172.21.15.41:0/2202301267 wait complete. 2021-10-21T00:07:50.470 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:07:50.483 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:07:50.502 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:07:50.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 Processor -- start 2021-10-21T00:07:50.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 -- start start 2021-10-21T00:07:50.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5c005f9f0 0x7fb5c00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5c00b0730 0x7fb5c00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c0142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c005fdd0 con 0x7fb5c00b0730 2021-10-21T00:07:50.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c0140400 con 0x7fb5c005f9f0 2021-10-21T00:07:50.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bf59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00b27c0 con 0x7fb5c00b3150 2021-10-21T00:07:50.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5c00b0730 0x7fb5c00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb5c00b0730 0x7fb5c00b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60918/0 (socket says 172.21.15.41:60918) 2021-10-21T00:07:50.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 -- 172.21.15.41:0/3649945950 learned_addr learned my addr 172.21.15.41:0/3649945950 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:50.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5be59c700 1 --2- 172.21.15.41:0/3649945950 >> v2:172.21.15.62:3300/0 conn(0x7fb5c005f9f0 0x7fb5c00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bed9d700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c0142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 -- 172.21.15.41:0/3649945950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 msgr2=0x7fb5c0142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:50.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c0142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 -- 172.21.15.41:0/3649945950 >> v2:172.21.15.62:3300/0 conn(0x7fb5c005f9f0 msgr2=0x7fb5c00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:50.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/3649945950 >> v2:172.21.15.62:3300/0 conn(0x7fb5c005f9f0 0x7fb5c00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 -- 172.21.15.41:0/3649945950 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00b35a0 con 0x7fb5c00b0730 2021-10-21T00:07:50.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c00b0730 0x7fb5c00b2c60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fb5c013f630 tx=0x7fb5b8009290).ready entity=mon.0 client_cookie=4bea9ab17efae047 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bd59a700 1 -- 172.21.15.41:0/3649945950 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b800b680 con 0x7fb5c00b0730 2021-10-21T00:07:50.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bd59a700 1 -- 172.21.15.41:0/3649945950 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b800b7e0 con 0x7fb5c00b0730 2021-10-21T00:07:50.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.580+0000 7fb5bd59a700 1 -- 172.21.15.41:0/3649945950 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b800b950 con 0x7fb5c00b0730 2021-10-21T00:07:50.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- 172.21.15.41:0/3649945950 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c00b0730 msgr2=0x7fb5c00b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c00b0730 0x7fb5c00b2c60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fb5c013f630 tx=0x7fb5b8009290).stop 2021-10-21T00:07:50.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- 172.21.15.41:0/3649945950 shutdown_connections 2021-10-21T00:07:50.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c00b0730 0x7fb5c00b2c60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/3649945950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c0142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/3649945950 >> v2:172.21.15.62:3300/0 conn(0x7fb5c005f9f0 0x7fb5c00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- 172.21.15.41:0/3649945950 >> 172.21.15.41:0/3649945950 conn(0x7fb5c00637b0 msgr2=0x7fb5c0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:50.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- 172.21.15.41:0/3649945950 shutdown_connections 2021-10-21T00:07:50.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- 172.21.15.41:0/3649945950 wait complete. 2021-10-21T00:07:50.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 Processor -- start 2021-10-21T00:07:50.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.584+0000 7fb5bf59e700 1 -- start start 2021-10-21T00:07:50.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c00b0730 0x7fb5c00afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0151fb0 con 0x7fb5c005f9f0 2021-10-21T00:07:50.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0152250 con 0x7fb5c00b0730 2021-10-21T00:07:50.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01524f0 con 0x7fb5c00b3150 2021-10-21T00:07:50.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60920/0 (socket says 172.21.15.41:60920) 2021-10-21T00:07:50.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 -- 172.21.15.41:0/1024226812 learned_addr learned my addr 172.21.15.41:0/1024226812 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:50.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c00b0730 0x7fb5c00afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bed9d700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 -- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 msgr2=0x7fb5c014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 -- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c00b0730 msgr2=0x7fb5c00afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c00b0730 0x7fb5c00afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 -- 172.21.15.41:0/1024226812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8009530 con 0x7fb5c005f9f0 2021-10-21T00:07:50.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5be59c700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fb5b400c000 tx=0x7fb5b4006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b40104c0 con 0x7fb5c005f9f0 2021-10-21T00:07:50.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4010620 con 0x7fb5c005f9f0 2021-10-21T00:07:50.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c00b0020 con 0x7fb5c005f9f0 2021-10-21T00:07:50.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b4010980 con 0x7fb5c005f9f0 2021-10-21T00:07:50.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0064d30 con 0x7fb5c005f9f0 2021-10-21T00:07:50.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0140080 con 0x7fb5c005f9f0 2021-10-21T00:07:50.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb5b401a070 con 0x7fb5c005f9f0 2021-10-21T00:07:50.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.588+0000 7fb5af7fe700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 0x7fb59c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.592+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb5b406b850 con 0x7fb5c005f9f0 2021-10-21T00:07:50.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.592+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 0x7fb59c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.592+0000 7fb5bdd9b700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 0x7fb59c055ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fb5b801b000 tx=0x7fb5b8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.596+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb5b4042900 con 0x7fb5c005f9f0 2021-10-21T00:07:50.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c0057350 con 0x7fb5c005f9f0 2021-10-21T00:07:50.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5af7fe700 1 -- 172.21.15.41:0/1024226812 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1778 (secure 0 0 0) 0x7fb5b4045f20 con 0x7fb5c005f9f0 2021-10-21T00:07:50.766 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:50.766 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:06:28.177510+0000","modified":"2021-10-21T00:07:50.448270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-10-21T00:07:50.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 msgr2=0x7fb59c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 0x7fb59c055ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fb5b801b000 tx=0x7fb5b8016000).stop 2021-10-21T00:07:50.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 msgr2=0x7fb5c0152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fb5b400c000 tx=0x7fb5b4006d90).stop 2021-10-21T00:07:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 shutdown_connections 2021-10-21T00:07:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb59c053610 0x7fb59c055ad0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5c00b3150 0x7fb5c014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5c00b0730 0x7fb5c00afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 --2- 172.21.15.41:0/1024226812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5c005f9f0 0x7fb5c0152990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 >> 172.21.15.41:0/1024226812 conn(0x7fb5c00637b0 msgr2=0x7fb5c00b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 shutdown_connections 2021-10-21T00:07:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.760+0000 7fb5bf59e700 1 -- 172.21.15.41:0/1024226812 wait complete. 2021-10-21T00:07:50.771 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 22 2021-10-21T00:07:50.781 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:07:50.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 Processor -- start 2021-10-21T00:07:50.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 -- start start 2021-10-21T00:07:50.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf780af620 0x7fcf780ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf78067a80 0x7fcf78149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780b0b50 con 0x7fcf780b2170 2021-10-21T00:07:50.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780b2550 con 0x7fcf780af620 2021-10-21T00:07:50.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf7cb07700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780b0d90 con 0x7fcf78067a80 2021-10-21T00:07:50.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf76ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf780af620 0x7fcf780ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf76ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf780af620 0x7fcf780ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60928/0 (socket says 172.21.15.41:60928) 2021-10-21T00:07:50.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.880+0000 7fcf76ffd700 1 -- 172.21.15.41:0/2634260285 learned_addr learned my addr 172.21.15.41:0/2634260285 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:50.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf77fff700 1 --2- 172.21.15.41:0/2634260285 >> v2:172.21.15.62:3300/0 conn(0x7fcf78067a80 0x7fcf78149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf76ffd700 1 -- 172.21.15.41:0/2634260285 >> v2:172.21.15.62:3300/0 conn(0x7fcf78067a80 msgr2=0x7fcf78149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:50.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf76ffd700 1 --2- 172.21.15.41:0/2634260285 >> v2:172.21.15.62:3300/0 conn(0x7fcf78067a80 0x7fcf78149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf76ffd700 1 -- 172.21.15.41:0/2634260285 >> v1:172.21.15.62:6789/0 conn(0x7fcf780b2170 legacy=0x7fcf780ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf76ffd700 1 -- 172.21.15.41:0/2634260285 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780b1030 con 0x7fcf780af620 2021-10-21T00:07:50.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf76ffd700 1 --2- 172.21.15.41:0/2634260285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf780ab880 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcf780aafa0 tx=0x7fcf68006eb0).ready entity=mon.0 client_cookie=97b8dfaef5e99cc2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf767fc700 1 -- 172.21.15.41:0/2634260285 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6800d610 con 0x7fcf780af620 2021-10-21T00:07:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf767fc700 1 -- 172.21.15.41:0/2634260285 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68000e90 con 0x7fcf780af620 2021-10-21T00:07:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf767fc700 1 -- 172.21.15.41:0/2634260285 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf6800d9a0 con 0x7fcf780af620 2021-10-21T00:07:50.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 -- 172.21.15.41:0/2634260285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 msgr2=0x7fcf780ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/2634260285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf780ab880 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcf780aafa0 tx=0x7fcf68006eb0).stop 2021-10-21T00:07:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 -- 172.21.15.41:0/2634260285 shutdown_connections 2021-10-21T00:07:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/2634260285 >> v2:172.21.15.62:3300/0 conn(0x7fcf78067a80 0x7fcf78149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/2634260285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf780ab880 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 -- 172.21.15.41:0/2634260285 >> 172.21.15.41:0/2634260285 conn(0x7fcf780b5700 msgr2=0x7fcf780b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 -- 172.21.15.41:0/2634260285 shutdown_connections 2021-10-21T00:07:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.884+0000 7fcf7cb07700 1 -- 172.21.15.41:0/2634260285 wait complete. 2021-10-21T00:07:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 Processor -- start 2021-10-21T00:07:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- start start 2021-10-21T00:07:50.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf78067a80 0x7fcf78066800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf780b2170 0x7fcf78159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78066d90 con 0x7fcf780af620 2021-10-21T00:07:50.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780aebc0 con 0x7fcf78067a80 2021-10-21T00:07:50.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780aee60 con 0x7fcf780b2170 2021-10-21T00:07:50.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60936/0 (socket says 172.21.15.41:60936) 2021-10-21T00:07:50.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 -- 172.21.15.41:0/1893639078 learned_addr learned my addr 172.21.15.41:0/1893639078 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:50.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf777fe700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf78067a80 0x7fcf78066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf77fff700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf780b2170 0x7fcf78159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 -- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf780b2170 msgr2=0x7fcf78159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf780b2170 0x7fcf78159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 -- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf78067a80 msgr2=0x7fcf78066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:50.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf78067a80 0x7fcf78066800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:50.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 -- 172.21.15.41:0/1893639078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6800b1e0 con 0x7fcf780af620 2021-10-21T00:07:50.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf76ffd700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fcf780aafa0 tx=0x7fcf68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf68011760 con 0x7fcf780af620 2021-10-21T00:07:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680118c0 con 0x7fcf780af620 2021-10-21T00:07:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780671c0 con 0x7fcf780af620 2021-10-21T00:07:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf68011c20 con 0x7fcf780af620 2021-10-21T00:07:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.888+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780ae260 con 0x7fcf780af620 2021-10-21T00:07:50.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf78066ed0 con 0x7fcf780af620 2021-10-21T00:07:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf68025030 con 0x7fcf780af620 2021-10-21T00:07:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf74ff9700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 0x7fcf58055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcf6806ca80 con 0x7fcf780af620 2021-10-21T00:07:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf777fe700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 0x7fcf58055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.892+0000 7fcf777fe700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 0x7fcf58055ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fcf6c00d000 tx=0x7fcf6c007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:50.900+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf68043b90 con 0x7fcf780af620 2021-10-21T00:07:51.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.060+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf780b12d0 con 0x7fcf780af620 2021-10-21T00:07:51.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.512+0000 7fcf74ff9700 1 -- 172.21.15.41:0/1893639078 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf680230a0 con 0x7fcf780af620 2021-10-21T00:07:51.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 msgr2=0x7fcf58055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 0x7fcf58055ad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fcf6c00d000 tx=0x7fcf6c007b70).stop 2021-10-21T00:07:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 msgr2=0x7fcf7814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fcf780aafa0 tx=0x7fcf68015000).stop 2021-10-21T00:07:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 shutdown_connections 2021-10-21T00:07:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf58053610 0x7fcf58055ad0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf780b2170 0x7fcf78159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf780af620 0x7fcf7814cff0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 --2- 172.21.15.41:0/1893639078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf78067a80 0x7fcf78066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 >> 172.21.15.41:0/1893639078 conn(0x7fcf780b5700 msgr2=0x7fcf78149240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 shutdown_connections 2021-10-21T00:07:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.516+0000 7fcf7cb07700 1 -- 172.21.15.41:0/1893639078 wait complete. 2021-10-21T00:07:51.538 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:07:51.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.656+0000 7f01be903700 1 Processor -- start 2021-10-21T00:07:51.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.656+0000 7f01be903700 1 -- start start 2021-10-21T00:07:51.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 0x7f01b0006210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f01b0042490 0x7f01b00428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b0048210 con 0x7f01b00d7f30 2021-10-21T00:07:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00d8410 con 0x7f01b0042490 2021-10-21T00:07:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b003def0 con 0x7f01b0047e30 2021-10-21T00:07:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f01b0042490 0x7f01b00428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f01b0042490 0x7f01b00428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60946/0 (socket says 172.21.15.41:60946) 2021-10-21T00:07:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bd100700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f01b00d7f30 0x7f01b0041d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58712/0 (socket says 172.21.15.41:58712) 2021-10-21T00:07:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 -- 172.21.15.41:0/3772290814 learned_addr learned my addr 172.21.15.41:0/3772290814 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bd901700 1 --2- 172.21.15.41:0/3772290814 >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 0x7f01b0006210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 -- 172.21.15.41:0/3772290814 >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 msgr2=0x7f01b0006210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 --2- 172.21.15.41:0/3772290814 >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 0x7f01b0006210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 -- 172.21.15.41:0/3772290814 >> v1:172.21.15.41:6789/0 conn(0x7f01b00d7f30 legacy=0x7f01b0041d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 -- 172.21.15.41:0/3772290814 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b003e190 con 0x7f01b0042490 2021-10-21T00:07:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bd901700 1 --2- 172.21.15.41:0/3772290814 >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 0x7f01b0006210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be102700 1 --2- 172.21.15.41:0/3772290814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b0042490 0x7f01b00428a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f01b805d810 tx=0x7f01b805f5c0).ready entity=mon.0 client_cookie=daae72b47b22f67a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bc8ff700 1 -- 172.21.15.41:0/3772290814 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b8061110 con 0x7f01b0042490 2021-10-21T00:07:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bc8ff700 1 -- 172.21.15.41:0/3772290814 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b806afe0 con 0x7f01b0042490 2021-10-21T00:07:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01bc8ff700 1 -- 172.21.15.41:0/3772290814 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b805f120 con 0x7f01b0042490 2021-10-21T00:07:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- 172.21.15.41:0/3772290814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b0042490 msgr2=0x7f01b00428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 --2- 172.21.15.41:0/3772290814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b0042490 0x7f01b00428a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f01b805d810 tx=0x7f01b805f5c0).stop 2021-10-21T00:07:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- 172.21.15.41:0/3772290814 shutdown_connections 2021-10-21T00:07:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 --2- 172.21.15.41:0/3772290814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b0042490 0x7f01b00428a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 --2- 172.21.15.41:0/3772290814 >> v2:172.21.15.62:3300/0 conn(0x7f01b0047e30 0x7f01b0006210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- 172.21.15.41:0/3772290814 >> 172.21.15.41:0/3772290814 conn(0x7f01b000e2b0 msgr2=0x7f01b00473e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- 172.21.15.41:0/3772290814 shutdown_connections 2021-10-21T00:07:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.660+0000 7f01be903700 1 -- 172.21.15.41:0/3772290814 wait complete. 2021-10-21T00:07:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 Processor -- start 2021-10-21T00:07:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 -- start start 2021-10-21T00:07:51.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01b0042490 0x7f01b00a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b0047e30 0x7f01b0045550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00d2bb0 con 0x7f01b00d7f30 2021-10-21T00:07:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00a4ba0 con 0x7f01b0047e30 2021-10-21T00:07:51.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be903700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00a4e40 con 0x7f01b0042490 2021-10-21T00:07:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01bd901700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01b0042490 0x7f01b00a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60952/0 (socket says 172.21.15.41:60952) 2021-10-21T00:07:51.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 -- 172.21.15.41:0/2941582167 learned_addr learned my addr 172.21.15.41:0/2941582167 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01bd100700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b0047e30 0x7f01b0045550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 -- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01b0042490 msgr2=0x7f01b00a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01b0042490 0x7f01b00a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 -- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b0047e30 msgr2=0x7f01b0045550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:51.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.664+0000 7f01be102700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b0047e30 0x7f01b0045550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:51.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01be102700 1 -- 172.21.15.41:0/2941582167 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00a50e0 con 0x7f01b00d7f30 2021-10-21T00:07:51.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01be102700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f01b805d810 tx=0x7f01b8061000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:51.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b80686a0 con 0x7f01b00d7f30 2021-10-21T00:07:51.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8080950 con 0x7f01b00d7f30 2021-10-21T00:07:51.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b8080cb0 con 0x7f01b00d7f30 2021-10-21T00:07:51.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b00e35a0 con 0x7f01b00d7f30 2021-10-21T00:07:51.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b00a55c0 con 0x7f01b00d7f30 2021-10-21T00:07:51.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b003dd50 con 0x7f01b00d7f30 2021-10-21T00:07:51.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f01b805ce20 con 0x7f01b00d7f30 2021-10-21T00:07:51.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 0x7f0198055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:51.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.668+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f01b80da8a0 con 0x7f01b00d7f30 2021-10-21T00:07:51.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.672+0000 7f01bd901700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 0x7f0198055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:51.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.672+0000 7f01bd901700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 0x7f0198055a40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f01a800c000 tx=0x7f01a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:51.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.676+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01b003dd50 con 0x7f01b00d7f30 2021-10-21T00:07:51.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:51.804+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01b003dd50 con 0x7f01b00d7f30 2021-10-21T00:07:52.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.520+0000 7f01a6ffd700 1 -- 172.21.15.41:0/2941582167 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 185+0+0 (secure 0 0 0) 0x7f01b003dd50 con 0x7f01b00d7f30 2021-10-21T00:07:52.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 msgr2=0x7f0198055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:52.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 0x7f0198055a40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f01a800c000 tx=0x7f01a8008040).stop 2021-10-21T00:07:52.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 msgr2=0x7f01b00e3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:52.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f01b805d810 tx=0x7f01b8061000).stop 2021-10-21T00:07:52.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 shutdown_connections 2021-10-21T00:07:52.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0198053580 0x7f0198055a40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f01b00d7f30 0x7f01b00e3b80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01b0047e30 0x7f01b0045550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 --2- 172.21.15.41:0/2941582167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01b0042490 0x7f01b00a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.524+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 >> 172.21.15.41:0/2941582167 conn(0x7f01b000e2b0 msgr2=0x7f01b0007a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:52.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.528+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 shutdown_connections 2021-10-21T00:07:52.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.528+0000 7f01be903700 1 -- 172.21.15.41:0/2941582167 wait complete. 2021-10-21T00:07:52.535 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:07:52.547 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:07:52.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.652+0000 7f1f05af5700 1 Processor -- start 2021-10-21T00:07:52.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.652+0000 7f1f05af5700 1 -- start start 2021-10-21T00:07:52.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f000b2a40 0x7f1f0013a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f0005bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f00144bc0 con 0x7f1f0005c190 2021-10-21T00:07:52.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0005cb10 con 0x7f1f000b2a40 2021-10-21T00:07:52.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1f05af5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0005f9c0 con 0x7f1f0013a890 2021-10-21T00:07:52.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60960/0 (socket says 172.21.15.41:60960) 2021-10-21T00:07:52.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f000b2a40 0x7f1f0013a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efffff700 1 -- 172.21.15.41:0/914225514 learned_addr learned my addr 172.21.15.41:0/914225514 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:52.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1ef7fff700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f0005bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 -- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 msgr2=0x7f1f0005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:52.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f0005bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 -- 172.21.15.41:0/914225514 >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 msgr2=0x7f1f0005c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:52.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/914225514 >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 -- 172.21.15.41:0/914225514 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000608d0 con 0x7f1f000b2a40 2021-10-21T00:07:52.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efffff700 1 --2- 172.21.15.41:0/914225514 >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:07:52.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000b2a40 0x7f1f0013a3a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f1ef0002f70 tx=0x7f1ef0006d90).ready entity=mon.1 client_cookie=bdf5b593a4f408e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:52.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efeffd700 1 -- 172.21.15.41:0/914225514 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef000e470 con 0x7f1f000b2a40 2021-10-21T00:07:52.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efeffd700 1 -- 172.21.15.41:0/914225514 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0000e90 con 0x7f1f000b2a40 2021-10-21T00:07:52.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.656+0000 7f1efeffd700 1 -- 172.21.15.41:0/914225514 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef000e7c0 con 0x7f1f000b2a40 2021-10-21T00:07:52.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000b2a40 msgr2=0x7f1f0013a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:52.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000b2a40 0x7f1f0013a3a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f1ef0002f70 tx=0x7f1ef0006d90).stop 2021-10-21T00:07:52.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- 172.21.15.41:0/914225514 shutdown_connections 2021-10-21T00:07:52.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- 172.21.15.41:0/914225514 >> v2:172.21.15.41:3300/0 conn(0x7f1f0005c190 0x7f1f0005c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f0005bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- 172.21.15.41:0/914225514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000b2a40 0x7f1f0013a3a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- 172.21.15.41:0/914225514 >> 172.21.15.41:0/914225514 conn(0x7f1f00061ed0 msgr2=0x7f1f00063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:52.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- 172.21.15.41:0/914225514 shutdown_connections 2021-10-21T00:07:52.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- 172.21.15.41:0/914225514 wait complete. 2021-10-21T00:07:52.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 Processor -- start 2021-10-21T00:07:52.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- start start 2021-10-21T00:07:52.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 0x7f1f000b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f000af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.660+0000 7f1f05af5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000aed50 con 0x7f1f000b2a40 2021-10-21T00:07:52.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1f05af5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000af150 con 0x7f1f0005c190 2021-10-21T00:07:52.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1f05af5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001404f0 con 0x7f1f0013a890 2021-10-21T00:07:52.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1eff7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 0x7f1f000b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60964/0 (socket says 172.21.15.41:60964) 2021-10-21T00:07:52.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 -- 172.21.15.41:0/567884792 learned_addr learned my addr 172.21.15.41:0/567884792 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:52.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1efffff700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f000af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 -- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 msgr2=0x7f1f000af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:52.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f000af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 -- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 msgr2=0x7f1f000b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:52.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 0x7f1f000b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:52.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 -- 172.21.15.41:0/567884792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8009530 con 0x7f1f000b2a40 2021-10-21T00:07:52.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 0x7f1f000b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:07:52.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1efffff700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f000af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:07:52.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1ef7fff700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f1ee800c000 tx=0x7f1ee8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:52.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee8011750 con 0x7f1f000b2a40 2021-10-21T00:07:52.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee80118b0 con 0x7f1f000b2a40 2021-10-21T00:07:52.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef000b120 con 0x7f1f000b2a40 2021-10-21T00:07:52.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee8011c10 con 0x7f1f000b2a40 2021-10-21T00:07:52.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f000b5760 con 0x7f1f000b2a40 2021-10-21T00:07:52.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.664+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f00060b70 con 0x7f1f000b2a40 2021-10-21T00:07:52.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.668+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1ee8011d70 con 0x7f1f000b2a40 2021-10-21T00:07:52.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.668+0000 7f1efd7fa700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 0x7f1ee4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:52.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.668+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f1ee806bc50 con 0x7f1f000b2a40 2021-10-21T00:07:52.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.668+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 0x7f1ee4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:52.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.668+0000 7f1eff7fe700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 0x7f1ee4055b00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f1ef001a000 tx=0x7f1ef0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:52.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.676+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ee8042e00 con 0x7f1f000b2a40 2021-10-21T00:07:52.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:52.804+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f00057350 con 0x7f1f000b2a40 2021-10-21T00:07:53.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.528+0000 7f1efd7fa700 1 -- 172.21.15.41:0/567884792 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1ee8046420 con 0x7f1f000b2a40 2021-10-21T00:07:53.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 msgr2=0x7f1ee4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 0x7f1ee4055b00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f1ef001a000 tx=0x7f1ef0014000).stop 2021-10-21T00:07:53.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 msgr2=0x7f1f00140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f1ee800c000 tx=0x7f1ee8006df0).stop 2021-10-21T00:07:53.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 shutdown_connections 2021-10-21T00:07:53.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ee4053640 0x7f1ee4055b00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f0013a890 0x7f1f000af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1f000b2a40 0x7f1f00140000 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 --2- 172.21.15.41:0/567884792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f0005c190 0x7f1f000b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 >> 172.21.15.41:0/567884792 conn(0x7f1f00061ed0 msgr2=0x7f1f00138dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:53.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 shutdown_connections 2021-10-21T00:07:53.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.532+0000 7f1f05af5700 1 -- 172.21.15.41:0/567884792 wait complete. 2021-10-21T00:07:53.541 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:07:53.552 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:07:53.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.656+0000 7ffa1cdbd700 1 Processor -- start 2021-10-21T00:07:53.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.656+0000 7ffa1cdbd700 1 -- start start 2021-10-21T00:07:53.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa1814b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa180b65b0 con 0x7ffa180b0cc0 2021-10-21T00:07:53.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa18144ea0 con 0x7ffa180b61d0 2021-10-21T00:07:53.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181409e0 con 0x7ffa1805beb0 2021-10-21T00:07:53.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa16ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ffa180b0cc0 0x7ffa18144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58742/0 (socket says 172.21.15.41:58742) 2021-10-21T00:07:53.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa16ffd700 1 -- 172.21.15.41:0/1821567141 learned_addr learned my addr 172.21.15.41:0/1821567141 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:53.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa17fff700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa1814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668771665 0 0) 0x7ffa180b65b0 con 0x7ffa180b0cc0 2021-10-21T00:07:53.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003260 con 0x7ffa180b0cc0 2021-10-21T00:07:53.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2652947898 0 0) 0x7ffa04003260 con 0x7ffa180b0cc0 2021-10-21T00:07:53.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 msgr2=0x7ffa1814b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:53.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa1814b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 >> v1:172.21.15.62:6789/0 conn(0x7ffa180b61d0 legacy=0x7ffa18144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18067b60 con 0x7ffa180b0cc0 2021-10-21T00:07:53.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7ffa0c001660 con 0x7ffa180b0cc0 2021-10-21T00:07:53.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 >> v1:172.21.15.41:6789/0 conn(0x7ffa180b0cc0 legacy=0x7ffa18144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa04003780 0x7ffa04003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa04004500 0x7ffa04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa04004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181409e0 con 0x7ffa04003780 2021-10-21T00:07:53.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0400b780 con 0x7ffa04004500 2021-10-21T00:07:53.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0400b940 con 0x7ffa1805beb0 2021-10-21T00:07:53.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa04003780 0x7ffa04003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa16ffd700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa04004500 0x7ffa04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa17fff700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa04004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 -- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 msgr2=0x7ffa04004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:53.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa04004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 -- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa04004500 msgr2=0x7ffa04004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:53.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa04004500 0x7ffa04004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 -- 172.21.15.41:0/1821567141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04003260 con 0x7ffa04003780 2021-10-21T00:07:53.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa16ffd700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa04004500 0x7ffa04004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:53.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa17fff700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa1805beb0 0x7ffa04004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:53.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa177fe700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa04003780 0x7ffa04003ba0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ffa180aff10 tx=0x7ffa08007a00).ready entity=mon.0 client_cookie=5738724f18d0d7e6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa08007d10 con 0x7ffa04003780 2021-10-21T00:07:53.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08007030 con 0x7ffa04003780 2021-10-21T00:07:53.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa167fc700 1 -- 172.21.15.41:0/1821567141 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa08007390 con 0x7ffa04003780 2021-10-21T00:07:53.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/1821567141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa04003780 msgr2=0x7ffa04003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/1821567141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa04003780 0x7ffa04003ba0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7ffa180aff10 tx=0x7ffa08007a00).stop 2021-10-21T00:07:53.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa17fff700 1 -- 172.21.15.41:0/1821567141 reap_dead start 2021-10-21T00:07:53.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/1821567141 shutdown_connections 2021-10-21T00:07:53.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/1821567141 >> 172.21.15.41:0/1821567141 conn(0x7ffa18063b80 msgr2=0x7ffa180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:53.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/1821567141 shutdown_connections 2021-10-21T00:07:53.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.660+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/1821567141 wait complete. 2021-10-21T00:07:53.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 Processor -- start 2021-10-21T00:07:53.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- start start 2021-10-21T00:07:53.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa04003780 0x7ffa1813ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa18144890 0x7ffa1810f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1813e2f0 con 0x7ffa1813de50 2021-10-21T00:07:53.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1810f2d0 con 0x7ffa18144890 2021-10-21T00:07:53.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1813d420 con 0x7ffa04003780 2021-10-21T00:07:53.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:60984/0 (socket says 172.21.15.41:60984) 2021-10-21T00:07:53.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 -- 172.21.15.41:0/4169465325 learned_addr learned my addr 172.21.15.41:0/4169465325 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:53.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa17fff700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa18144890 0x7ffa1810f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa177fe700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa04003780 0x7ffa1813ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 -- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa04003780 msgr2=0x7ffa1813ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa04003780 0x7ffa1813ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 -- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa18144890 msgr2=0x7ffa1810f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa18144890 0x7ffa1810f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 -- 172.21.15.41:0/4169465325 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1810fc60 con 0x7ffa1813de50 2021-10-21T00:07:53.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa16ffd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ffa0c00b000 tx=0x7ffa18067cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c010640 con 0x7ffa1813de50 2021-10-21T00:07:53.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0107a0 con 0x7ffa1813de50 2021-10-21T00:07:53.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1810feb0 con 0x7ffa1813de50 2021-10-21T00:07:53.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c010b00 con 0x7ffa1813de50 2021-10-21T00:07:53.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.664+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa18153530 con 0x7ffa1813de50 2021-10-21T00:07:53.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1813e4f0 con 0x7ffa1813de50 2021-10-21T00:07:53.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa0c01a020 con 0x7ffa1813de50 2021-10-21T00:07:53.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa14ff9700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 0x7ff9f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ffa0c06b450 con 0x7ffa1813de50 2021-10-21T00:07:53.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa177fe700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 0x7ff9f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.668+0000 7ffa177fe700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 0x7ff9f8055b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ffa0801b000 tx=0x7ffa08015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.672+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa0c0426a0 con 0x7ffa1813de50 2021-10-21T00:07:53.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.804+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffa1805c7f0 con 0x7ffa1813de50 2021-10-21T00:07:53.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.812+0000 7ffa14ff9700 1 -- 172.21.15.41:0/4169465325 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffa0c069e60 con 0x7ffa1813de50 2021-10-21T00:07:53.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 msgr2=0x7ff9f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 0x7ff9f8055b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ffa0801b000 tx=0x7ffa08015000).stop 2021-10-21T00:07:53.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 msgr2=0x7ffa181443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ffa0c00b000 tx=0x7ffa18067cf0).stop 2021-10-21T00:07:53.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 shutdown_connections 2021-10-21T00:07:53.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff9f80536a0 0x7ff9f8055b60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa18144890 0x7ffa1810f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa1813de50 0x7ffa181443a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 --2- 172.21.15.41:0/4169465325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa04003780 0x7ffa1813ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 >> 172.21.15.41:0/4169465325 conn(0x7ffa18063b80 msgr2=0x7ffa1813a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:53.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 shutdown_connections 2021-10-21T00:07:53.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.816+0000 7ffa1cdbd700 1 -- 172.21.15.41:0/4169465325 wait complete. 2021-10-21T00:07:53.834 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-10-21T00:07:53.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 Processor -- start 2021-10-21T00:07:53.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 -- start start 2021-10-21T00:07:53.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81880b2170 0x7f81880ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880b0b50 con 0x7f8188067a80 2021-10-21T00:07:53.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880b2550 con 0x7f81880af620 2021-10-21T00:07:53.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.928+0000 7f818cea1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880b0d90 con 0x7f81880b2170 2021-10-21T00:07:53.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f8187fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8188067a80 0x7f8188149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58762/0 (socket says 172.21.15.41:58762) 2021-10-21T00:07:53.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f8187fff700 1 -- 172.21.15.41:0/1795035307 learned_addr learned my addr 172.21.15.41:0/1795035307 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:53.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81877fe700 1 --2- 172.21.15.41:0/1795035307 >> v2:172.21.15.62:3300/0 conn(0x7f81880b2170 0x7f81880ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81867fc700 1 -- 172.21.15.41:0/1795035307 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499496895 0 0) 0x7f8180001490 con 0x7f8188067a80 2021-10-21T00:07:53.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81867fc700 1 -- 172.21.15.41:0/1795035307 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8174003260 con 0x7f8188067a80 2021-10-21T00:07:53.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81877fe700 1 -- 172.21.15.41:0/1795035307 >> v1:172.21.15.62:6789/0 conn(0x7f81880af620 legacy=0x7f81880ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81877fe700 1 -- 172.21.15.41:0/1795035307 >> v1:172.21.15.41:6789/0 conn(0x7f8188067a80 legacy=0x7f8188149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81877fe700 1 -- 172.21.15.41:0/1795035307 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880b1030 con 0x7f81880b2170 2021-10-21T00:07:53.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81877fe700 1 --2- 172.21.15.41:0/1795035307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81880ab170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f81880aafa0 tx=0x7f817c006df0).ready entity=mon.1 client_cookie=b298e1525b811dbc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81867fc700 1 -- 172.21.15.41:0/1795035307 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c00d610 con 0x7f81880b2170 2021-10-21T00:07:53.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81867fc700 1 -- 172.21.15.41:0/1795035307 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c000e90 con 0x7f81880b2170 2021-10-21T00:07:53.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f81867fc700 1 -- 172.21.15.41:0/1795035307 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c00d960 con 0x7f81880b2170 2021-10-21T00:07:53.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 -- 172.21.15.41:0/1795035307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 msgr2=0x7f81880ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 --2- 172.21.15.41:0/1795035307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81880ab170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f81880aafa0 tx=0x7f817c006df0).stop 2021-10-21T00:07:53.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 -- 172.21.15.41:0/1795035307 shutdown_connections 2021-10-21T00:07:53.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 --2- 172.21.15.41:0/1795035307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81880ab170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 -- 172.21.15.41:0/1795035307 >> 172.21.15.41:0/1795035307 conn(0x7f81880b5700 msgr2=0x7f81880b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:53.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 -- 172.21.15.41:0/1795035307 shutdown_connections 2021-10-21T00:07:53.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.932+0000 7f818cea1700 1 -- 172.21.15.41:0/1795035307 wait complete. 2021-10-21T00:07:53.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 Processor -- start 2021-10-21T00:07:53.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- start start 2021-10-21T00:07:53.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8188067a80 0x7f81881471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880ae3c0 con 0x7f81880af620 2021-10-21T00:07:53.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880ae660 con 0x7f81880b2170 2021-10-21T00:07:53.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81880aeb00 con 0x7f8188067a80 2021-10-21T00:07:53.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8187fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8187fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44684/0 (socket says 172.21.15.41:44684) 2021-10-21T00:07:53.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f81877fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8188067a80 0x7f81881471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8187fff700 1 -- 172.21.15.41:0/1800287955 learned_addr learned my addr 172.21.15.41:0/1800287955 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:53.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32768/0 (socket says 172.21.15.41:32768) 2021-10-21T00:07:53.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 -- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8188067a80 msgr2=0x7f81881471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8188067a80 0x7f81881471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 -- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 msgr2=0x7f81881462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:53.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:53.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 -- 172.21.15.41:0/1800287955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c00b180 con 0x7f81880af620 2021-10-21T00:07:53.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8187fff700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:07:53.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8186ffd700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8188062740 tx=0x7f8178007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8178007030 con 0x7f81880af620 2021-10-21T00:07:53.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178007190 con 0x7f81880af620 2021-10-21T00:07:53.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8188067110 con 0x7f81880af620 2021-10-21T00:07:53.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8178006510 con 0x7f81880af620 2021-10-21T00:07:53.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.936+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81881467e0 con 0x7f81880af620 2021-10-21T00:07:53.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880b12d0 con 0x7f81880af620 2021-10-21T00:07:53.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8178010030 con 0x7f81880af620 2021-10-21T00:07:53.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f8184ff9700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 0x7f8168055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:53.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f817806b030 con 0x7f81880af620 2021-10-21T00:07:53.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f81877fe700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 0x7f8168055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:53.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.940+0000 7f81877fe700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 0x7f8168055b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f817c01a000 tx=0x7f817c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:53.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:53.948+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8178042470 con 0x7f81880af620 2021-10-21T00:07:54.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.108+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f8188057350 con 0x7f81880af620 2021-10-21T00:07:54.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.528+0000 7f8184ff9700 1 -- 172.21.15.41:0/1800287955 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v213) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8178045a90 con 0x7f81880af620 2021-10-21T00:07:54.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 msgr2=0x7f8168055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 0x7f8168055b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f817c01a000 tx=0x7f817c014000).stop 2021-10-21T00:07:54.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 msgr2=0x7f8188066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8188062740 tx=0x7f8178007b50).stop 2021-10-21T00:07:54.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 shutdown_connections 2021-10-21T00:07:54.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8168053640 0x7f8168055b00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81880b2170 0x7f81881462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f81880af620 0x7f8188066c20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 --2- 172.21.15.41:0/1800287955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8188067a80 0x7f81881471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 >> 172.21.15.41:0/1800287955 conn(0x7f81880b5700 msgr2=0x7f81880b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:54.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 shutdown_connections 2021-10-21T00:07:54.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.532+0000 7f818cea1700 1 -- 172.21.15.41:0/1800287955 wait complete. 2021-10-21T00:07:54.557 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-21T00:07:54.558 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-10-21T00:07:54.558 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-10-21T00:07:54.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.652+0000 7f5dee741700 1 Processor -- start 2021-10-21T00:07:54.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.652+0000 7f5dee741700 1 -- start start 2021-10-21T00:07:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5de80b1830 0x7f5de80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:54.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de80ae020 con 0x7f5de80b4380 2021-10-21T00:07:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de805fe50 con 0x7f5de81433e0 2021-10-21T00:07:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de80ade00 con 0x7f5de80b1830 2021-10-21T00:07:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5de80b1830 0x7f5de80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:54.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5ded73f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5de80b4380 0x7f5de805f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58774/0 (socket says 172.21.15.41:58774) 2021-10-21T00:07:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5de80b1830 0x7f5de80ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32774/0 (socket says 172.21.15.41:32774) 2021-10-21T00:07:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5ded73f700 1 -- 172.21.15.41:0/1294696397 learned_addr learned my addr 172.21.15.41:0/1294696397 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 -- 172.21.15.41:0/1294696397 >> v1:172.21.15.62:6789/0 conn(0x7f5de81433e0 legacy=0x7f5de8062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 -- 172.21.15.41:0/1294696397 >> v1:172.21.15.41:6789/0 conn(0x7f5de80b4380 legacy=0x7f5de805f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 -- 172.21.15.41:0/1294696397 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80b4760 con 0x7f5de80b1830 2021-10-21T00:07:54.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dd7fff700 1 -- 172.21.15.41:0/1294696397 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215794786 0 0) 0x7f5de80ae020 con 0x7f5de80b4380 2021-10-21T00:07:54.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5decf3e700 1 --2- 172.21.15.41:0/1294696397 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ad910 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f5dd8002f70 tx=0x7f5dd8006df0).ready entity=mon.0 client_cookie=9200d9daa3bc29f7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:54.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dd7fff700 1 -- 172.21.15.41:0/1294696397 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd800d610 con 0x7f5de80b1830 2021-10-21T00:07:54.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dd7fff700 1 -- 172.21.15.41:0/1294696397 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8000e90 con 0x7f5de80b1830 2021-10-21T00:07:54.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dd7fff700 1 -- 172.21.15.41:0/1294696397 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd800d960 con 0x7f5de80b1830 2021-10-21T00:07:54.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- 172.21.15.41:0/1294696397 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 msgr2=0x7f5de80ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 --2- 172.21.15.41:0/1294696397 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ad910 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f5dd8002f70 tx=0x7f5dd8006df0).stop 2021-10-21T00:07:54.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- 172.21.15.41:0/1294696397 shutdown_connections 2021-10-21T00:07:54.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 --2- 172.21.15.41:0/1294696397 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ad910 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- 172.21.15.41:0/1294696397 >> 172.21.15.41:0/1294696397 conn(0x7f5de80b7910 msgr2=0x7f5de80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:54.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- 172.21.15.41:0/1294696397 shutdown_connections 2021-10-21T00:07:54.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- 172.21.15.41:0/1294696397 wait complete. 2021-10-21T00:07:54.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 Processor -- start 2021-10-21T00:07:54.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.656+0000 7f5dee741700 1 -- start start 2021-10-21T00:07:54.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:54.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5de80b4380 0x7f5de81440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:54.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5de81433e0 0x7f5de8067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:54.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de809c450 con 0x7f5de80b1830 2021-10-21T00:07:54.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de809c1b0 con 0x7f5de80b4380 2021-10-21T00:07:54.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de81445c0 con 0x7f5de81433e0 2021-10-21T00:07:54.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:54.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32778/0 (socket says 172.21.15.41:32778) 2021-10-21T00:07:54.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 -- 172.21.15.41:0/836459326 learned_addr learned my addr 172.21.15.41:0/836459326 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:54.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5decf3e700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5de80b4380 0x7f5de81440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:54.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dedf40700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5de81433e0 0x7f5de8067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:54.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 -- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5de81433e0 msgr2=0x7f5de8067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5de81433e0 0x7f5de8067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 -- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5de80b4380 msgr2=0x7f5de81440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:54.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5de80b4380 0x7f5de81440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:54.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 -- 172.21.15.41:0/836459326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd800b180 con 0x7f5de80b1830 2021-10-21T00:07:54.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5ded73f700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f5de4000bc0 tx=0x7f5de4007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:54.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de40070d0 con 0x7f5de80b1830 2021-10-21T00:07:54.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4007230 con 0x7f5de80b1830 2021-10-21T00:07:54.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de809bd10 con 0x7f5de80b1830 2021-10-21T00:07:54.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de4005610 con 0x7f5de80b1830 2021-10-21T00:07:54.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de809cc60 con 0x7f5de80b1830 2021-10-21T00:07:54.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de8142ca0 con 0x7f5de80b1830 2021-10-21T00:07:54.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5de401a060 con 0x7f5de80b1830 2021-10-21T00:07:54.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 0x7f5dc8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:54.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.660+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5de406aa30 con 0x7f5de80b1830 2021-10-21T00:07:54.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.664+0000 7f5decf3e700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 0x7f5dc8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:54.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.664+0000 7f5decf3e700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 0x7f5dc8055a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5dd801c000 tx=0x7f5dd8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:54.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.668+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5de4041e70 con 0x7f5de80b1830 2021-10-21T00:07:54.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:54.832+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f5de80b0b90 con 0x7f5de80b1830 2021-10-21T00:07:55.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.532+0000 7f5dd67fc700 1 -- 172.21.15.41:0/836459326 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v214) v1 ==== 150+0+0 (secure 0 0 0) 0x7f5de4018070 con 0x7f5de80b1830 2021-10-21T00:07:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 msgr2=0x7f5dc8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 0x7f5dc8055a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5dd801c000 tx=0x7f5dd8015000).stop 2021-10-21T00:07:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 msgr2=0x7f5de80ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f5de4000bc0 tx=0x7f5de4007a60).stop 2021-10-21T00:07:55.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 shutdown_connections 2021-10-21T00:07:55.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5dc8053580 0x7f5dc8055a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5de81433e0 0x7f5de8067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5de80b4380 0x7f5de81440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 --2- 172.21.15.41:0/836459326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5de80b1830 0x7f5de80ae540 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 >> 172.21.15.41:0/836459326 conn(0x7f5de80b7910 msgr2=0x7f5de80b6310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 shutdown_connections 2021-10-21T00:07:55.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.536+0000 7f5dee741700 1 -- 172.21.15.41:0/836459326 wait complete. 2021-10-21T00:07:55.559 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:07:55.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 Processor -- start 2021-10-21T00:07:55.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 -- start start 2021-10-21T00:07:55.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbab80b61d0 0x7fbab80af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbab80af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab80afe90 con 0x7fbab80afa00 2021-10-21T00:07:55.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab80b65b0 con 0x7fbab80b61d0 2021-10-21T00:07:55.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe930700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8143db0 con 0x7fbab80677e0 2021-10-21T00:07:55.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe12f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fbab80afa00 0x7fbab8138f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58794/0 (socket says 172.21.15.41:58794) 2021-10-21T00:07:55.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe12f700 1 -- 172.21.15.41:0/2071035485 learned_addr learned my addr 172.21.15.41:0/2071035485 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:55.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> v2:172.21.15.62:3300/0 conn(0x7fbab80b61d0 0x7fbab80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd12d700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbab80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279847484 0 0) 0x7fbab0001490 con 0x7fbab80afa00 2021-10-21T00:07:55.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa0003260 con 0x7fbab80afa00 2021-10-21T00:07:55.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335898244 0 0) 0x7fbaa0003260 con 0x7fbab80afa00 2021-10-21T00:07:55.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 msgr2=0x7fbab80af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:55.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbab80af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 >> v2:172.21.15.62:3300/0 conn(0x7fbab80b61d0 msgr2=0x7fbab80af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:55.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 --2- 172.21.15.41:0/2071035485 >> v2:172.21.15.62:3300/0 conn(0x7fbab80b61d0 0x7fbab80af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80b18f0 con 0x7fbab80afa00 2021-10-21T00:07:55.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> v2:172.21.15.62:3300/0 conn(0x7fbab80b61d0 0x7fbab80af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:07:55.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fbab0001b70 con 0x7fbab80afa00 2021-10-21T00:07:55.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 >> v1:172.21.15.41:6789/0 conn(0x7fbab80afa00 legacy=0x7fbab8138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbaa0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaa0004500 0x7fbaa0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbaa0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80b65b0 con 0x7fbaa0003750 2021-10-21T00:07:55.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8143db0 con 0x7fbaa0004500 2021-10-21T00:07:55.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa000d960 con 0x7fbab80677e0 2021-10-21T00:07:55.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbaa0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe12f700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbaa0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd12d700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaa0004500 0x7fbaa0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 -- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 msgr2=0x7fbaa0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:55.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbaa0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 -- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaa0004500 msgr2=0x7fbaa0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:55.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaa0004500 0x7fbaa0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 -- 172.21.15.41:0/2071035485 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0003260 con 0x7fbaa0003750 2021-10-21T00:07:55.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd12d700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaa0004500 0x7fbaa0004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:55.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabe12f700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab80677e0 0x7fbaa0004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:55.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabd92e700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbaa0003b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fbab400c000 tx=0x7fbab4006df0).ready entity=mon.0 client_cookie=fd72f2789551d817 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:55.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab400e830 con 0x7fbaa0003750 2021-10-21T00:07:55.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400e990 con 0x7fbaa0003750 2021-10-21T00:07:55.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.660+0000 7fbabc92c700 1 -- 172.21.15.41:0/2071035485 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab400ecf0 con 0x7fbaa0003750 2021-10-21T00:07:55.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/2071035485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 msgr2=0x7fbaa0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 --2- 172.21.15.41:0/2071035485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbaa0003b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fbab400c000 tx=0x7fbab4006df0).stop 2021-10-21T00:07:55.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe12f700 1 -- 172.21.15.41:0/2071035485 reap_dead start 2021-10-21T00:07:55.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/2071035485 shutdown_connections 2021-10-21T00:07:55.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/2071035485 >> 172.21.15.41:0/2071035485 conn(0x7fbab8063b80 msgr2=0x7fbab80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:55.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/2071035485 shutdown_connections 2021-10-21T00:07:55.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/2071035485 wait complete. 2021-10-21T00:07:55.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 Processor -- start 2021-10-21T00:07:55.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- start start 2021-10-21T00:07:55.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab813a700 0x7fbab814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab814e020 0x7fbab8063fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8142710 con 0x7fbaa0003750 2021-10-21T00:07:55.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab814e4a0 con 0x7fbab814e020 2021-10-21T00:07:55.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab81430d0 con 0x7fbab813a700 2021-10-21T00:07:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32800/0 (socket says 172.21.15.41:32800) 2021-10-21T00:07:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 -- 172.21.15.41:0/3551843337 learned_addr learned my addr 172.21.15.41:0/3551843337 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe12f700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab814e020 0x7fbab8063fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd12d700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab813a700 0x7fbab814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 -- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab813a700 msgr2=0x7fbab814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab813a700 0x7fbab814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 -- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab814e020 msgr2=0x7fbab8063fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab814e020 0x7fbab8063fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 -- 172.21.15.41:0/3551843337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8066db0 con 0x7fbaa0003750 2021-10-21T00:07:55.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabd92e700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fbab80b2580 tx=0x7fbab4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:55.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab401b820 con 0x7fbaa0003750 2021-10-21T00:07:55.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4000e90 con 0x7fbaa0003750 2021-10-21T00:07:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab8067030 con 0x7fbaa0003750 2021-10-21T00:07:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbab401bb70 con 0x7fbaa0003750 2021-10-21T00:07:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.664+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab8065870 con 0x7fbaa0003750 2021-10-21T00:07:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab814e620 con 0x7fbaa0003750 2021-10-21T00:07:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbab401bcd0 con 0x7fbaa0003750 2021-10-21T00:07:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbaa6ffd700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 0x7fba98055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbab406cc30 con 0x7fbaa0003750 2021-10-21T00:07:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbabd12d700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 0x7fba98055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.668+0000 7fbabd12d700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 0x7fba98055a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbaa800b000 tx=0x7fbaa8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:55.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.672+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbab4044620 con 0x7fbaa0003750 2021-10-21T00:07:55.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.800+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbab80b1b90 con 0x7fbaa0003750 2021-10-21T00:07:55.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbaa6ffd700 1 -- 172.21.15.41:0/3551843337 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbab4047690 con 0x7fbaa0003750 2021-10-21T00:07:55.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 msgr2=0x7fba98055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 0x7fba98055a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fbaa800b000 tx=0x7fbaa8008040).stop 2021-10-21T00:07:55.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 msgr2=0x7fbab813a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:55.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fbab80b2580 tx=0x7fbab4019000).stop 2021-10-21T00:07:55.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 shutdown_connections 2021-10-21T00:07:55.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fba98053580 0x7fba98055a40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab814e020 0x7fbab8063fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbab813a700 0x7fbab814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 --2- 172.21.15.41:0/3551843337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbaa0003750 0x7fbab813a210 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:55.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 >> 172.21.15.41:0/3551843337 conn(0x7fbab8063b80 msgr2=0x7fbab8138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:55.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 shutdown_connections 2021-10-21T00:07:55.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:55.808+0000 7fbabe930700 1 -- 172.21.15.41:0/3551843337 wait complete. 2021-10-21T00:07:55.828 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:07:55.829 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:55.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:55.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:55.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:55.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:07:55.930 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:07:55.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:55.930 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:55.931 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:07:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:07:55.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:55.940 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:07:55.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:55.941 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:55.941 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:07:55.948 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:07:55.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:55.950 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:07:55.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:07:55.951 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:07:55.951 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:07:55.981 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:07:55.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:07:55.984 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:07:55.985 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:07:56.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.088+0000 7f869a465700 1 Processor -- start 2021-10-21T00:07:56.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.088+0000 7f869a465700 1 -- start start 2021-10-21T00:07:56.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f869a465700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8694143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f869a465700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86940b3bc0 0x7f8694143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f869a465700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8694142bc0 con 0x7f8694143a00 2021-10-21T00:07:56.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f869a465700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86941429a0 con 0x7f86940b3bc0 2021-10-21T00:07:56.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f869a465700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940ba050 con 0x7f86940b9c70 2021-10-21T00:07:56.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8698a02700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8694143a00 0x7f869405bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58814/0 (socket says 172.21.15.41:58814) 2021-10-21T00:07:56.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8698a02700 1 -- 172.21.15.41:0/664597259 learned_addr learned my addr 172.21.15.41:0/664597259 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:56.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 --2- 172.21.15.41:0/664597259 >> v2:172.21.15.62:3300/0 conn(0x7f86940b3bc0 0x7f8694143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8693fff700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8694143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403979321 0 0) 0x7f8694142bc0 con 0x7f8694143a00 2021-10-21T00:07:56.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8680003260 con 0x7f8694143a00 2021-10-21T00:07:56.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289579436 0 0) 0x7f8680003260 con 0x7f8694143a00 2021-10-21T00:07:56.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 msgr2=0x7f8694143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8694143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 >> v2:172.21.15.62:3300/0 conn(0x7f86940b3bc0 msgr2=0x7f8694143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 --2- 172.21.15.41:0/664597259 >> v2:172.21.15.62:3300/0 conn(0x7f86940b3bc0 0x7f8694143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86941463c0 con 0x7f8694143a00 2021-10-21T00:07:56.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f868c001a00 con 0x7f8694143a00 2021-10-21T00:07:56.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 >> v1:172.21.15.41:6789/0 conn(0x7f8694143a00 legacy=0x7f869405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8680003750 0x7f8680003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8680004500 0x7f8680004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8680004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941429a0 con 0x7f8680004500 2021-10-21T00:07:56.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940ba050 con 0x7f8680003750 2021-10-21T00:07:56.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868000b750 con 0x7f86940b9c70 2021-10-21T00:07:56.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8680004500 0x7f8680004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8693fff700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8680003750 0x7f8680003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8698a02700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8680004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 -- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 msgr2=0x7f8680004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8680004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 -- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8680003750 msgr2=0x7f8680003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8680003750 0x7f8680003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 -- 172.21.15.41:0/664597259 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680003260 con 0x7f8680004500 2021-10-21T00:07:56.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8698a02700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86940b9c70 0x7f8680004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:07:56.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f86937fe700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8680004500 0x7f8680004980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f868400c000 tx=0x7f8684006df0).ready entity=mon.0 client_cookie=dbbbea732d4e51c5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868400e5f0 con 0x7f8680004500 2021-10-21T00:07:56.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400e750 con 0x7f8680004500 2021-10-21T00:07:56.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.092+0000 7f8692ffd700 1 -- 172.21.15.41:0/664597259 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868400eab0 con 0x7f8680004500 2021-10-21T00:07:56.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/664597259 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8680004500 msgr2=0x7f8680004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 --2- 172.21.15.41:0/664597259 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8680004500 0x7f8680004980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f868400c000 tx=0x7f8684006df0).stop 2021-10-21T00:07:56.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 -- 172.21.15.41:0/664597259 reap_dead start 2021-10-21T00:07:56.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/664597259 shutdown_connections 2021-10-21T00:07:56.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/664597259 >> 172.21.15.41:0/664597259 conn(0x7f8694062e80 msgr2=0x7f86940b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:56.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/664597259 shutdown_connections 2021-10-21T00:07:56.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/664597259 wait complete. 2021-10-21T00:07:56.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 Processor -- start 2021-10-21T00:07:56.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- start start 2021-10-21T00:07:56.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 0x7f8694115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 0x7f8694152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869413f9f0 con 0x7f8694152630 2021-10-21T00:07:56.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940ae450 con 0x7f8694115970 2021-10-21T00:07:56.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8694153130 con 0x7f8680004500 2021-10-21T00:07:56.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32824/0 (socket says 172.21.15.41:32824) 2021-10-21T00:07:56.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 -- 172.21.15.41:0/3184716141 learned_addr learned my addr 172.21.15.41:0/3184716141 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:56.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8693fff700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 0x7f8694115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f86937fe700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 0x7f8694152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 -- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 msgr2=0x7f8694115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 0x7f8694115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 -- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 msgr2=0x7f8694152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 0x7f8694152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 -- 172.21.15.41:0/3184716141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694152e90 con 0x7f8694152630 2021-10-21T00:07:56.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f86937fe700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 0x7f8694152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:56.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8693fff700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 0x7f8694115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:56.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f8698a02700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f86940ae590 tx=0x7f868c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c004ab0 con 0x7f8694152630 2021-10-21T00:07:56.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c004c10 con 0x7f8694152630 2021-10-21T00:07:56.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86940af220 con 0x7f8694152630 2021-10-21T00:07:56.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c007030 con 0x7f8694152630 2021-10-21T00:07:56.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.096+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940af6c0 con 0x7f8694152630 2021-10-21T00:07:56.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f868c01c060 con 0x7f8694152630 2021-10-21T00:07:56.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86940af3b0 con 0x7f8694152630 2021-10-21T00:07:56.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f86917fa700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 0x7f8674055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f868c06b030 con 0x7f8694152630 2021-10-21T00:07:56.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f8693fff700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 0x7f8674055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.100+0000 7f8693fff700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 0x7f8674055a70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f868800b000 tx=0x7f8688008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.108+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f868c042470 con 0x7f8694152630 2021-10-21T00:07:56.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.236+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8694146120 con 0x7f8694152630 2021-10-21T00:07:56.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.236+0000 7f86917fa700 1 -- 172.21.15.41:0/3184716141 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f868c01a070 con 0x7f8694152630 2021-10-21T00:07:56.244 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:56.244 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:07:56.245 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 53, 2021-10-21T00:07:56.245 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:07:56.245 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:07:56.246 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:07:53.520864+0000", 2021-10-21T00:07:56.246 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:07:56.247 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:07:56.248 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:07:56.248 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:07:56.248 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:07:56.249 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:07:56.249 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:07:56.250 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:07:56.250 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:07:56.251 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:56.251 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:07:56.252 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:07:56.252 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:07:56.252 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:07:56.253 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:07:56.254 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 10, 2021-10-21T00:07:56.254 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:07:56.254 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:07:56.255 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:07:56.255 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:07:56.255 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:07:56.255 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.256 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:07:56.256 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:07:56.256 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:07:56.256 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:56.257 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:56.257 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:56.257 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:56.257 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:56.258 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:56.258 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:56.258 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:56.258 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:07:56.258 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:07:56.259 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:07:56.259 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:07:56.259 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:07:56.259 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:56.260 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:56.260 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:56.260 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:56.260 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:56.260 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:56.261 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:56.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.261 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:07:56.261 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:56.262 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:56.262 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:56.262 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:56.262 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:56.262 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:56.263 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:56.263 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:56.263 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:56.263 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:56.264 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:56.264 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:56.264 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:56.264 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:56.265 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:56.265 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:56.265 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:56.265 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:56.266 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:56.266 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:56.266 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:56.266 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:56.267 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:56.267 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:56.267 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:56.267 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:56.267 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.268 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:56.268 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:56.269 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:56.269 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:56.269 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:56.269 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:56.269 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:56.270 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:56.270 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:56.270 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:56.270 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:56.271 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:07:56.271 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:07:56.271 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.271 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:56.272 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:07:56.272 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.272 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.272 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.273 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:07:56.273 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:07:56.273 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:07:56.273 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:07:56.273 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:07:56.274 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:07:56.274 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:07:56.275 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:07:56.275 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:07:56.275 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:07:56.276 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:07:56.276 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:07:56.277 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:07:56.278 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:07:56.278 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:07:56.279 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:07:56.279 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:07:56.279 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:07:56.280 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:07:56.280 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:07:56.281 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:07:56.281 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:07:56.281 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:07:56.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.282 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:07:56.282 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:07:56.282 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:07:56.283 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:07:56.283 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:07:56.283 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:07:56.283 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:07:56.284 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:07:56.284 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:07:56.284 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:07:56.284 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:07:56.285 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:07:56.285 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:07:56.285 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:07:56.285 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:07:56.285 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:07:56.286 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:07:56.286 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:07:56.286 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:07:56.286 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:07:56.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:07:56.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:07:56.288 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:07:56.288 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:07:56.288 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:07:56.289 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:07:56.289 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:07:56.290 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.290 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:07:56.291 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:07:56.291 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:07:56.292 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:07:56.292 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:07:56.292 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:07:56.293 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:07:56.293 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:07:56.294 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:07:56.294 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:07:56.295 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:07:56.295 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:07:56.296 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:07:56.296 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:07:56.297 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.297 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.297 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:56.298 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:07:56.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.299 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:07:56.299 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:07:56.300 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.300 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.301 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.301 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.302 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.302 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.303 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.303 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.303 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.304 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.304 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.305 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.305 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.306 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.306 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:07:56.307 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.307 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.307 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.308 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.308 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:07:56.309 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.309 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.310 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.310 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.311 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.311 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.311 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.312 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.312 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:07:56.313 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.313 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.314 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.314 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:07:56.315 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.315 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.316 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.316 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.317 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.317 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.318 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.318 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:07:56.319 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.319 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.320 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.320 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:07:56.320 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.320 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.321 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.321 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.321 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.321 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.322 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.322 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.322 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:07:56.322 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.322 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.323 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.323 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:07:56.323 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:07:56.323 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.324 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.324 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.324 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:07:56.324 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:07:56.324 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:07:56.325 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:07:56.325 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.325 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.325 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.326 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.326 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.326 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.326 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:07:56.327 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:07:56.327 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.327 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.327 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.327 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.328 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.328 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.329 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.329 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.329 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.329 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.329 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.330 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:07:56.330 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.330 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.330 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.331 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.331 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:07:56.331 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.331 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.332 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.332 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.332 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.332 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.333 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.333 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:07:56.333 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.333 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.334 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.334 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.334 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:07:56.334 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.334 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.335 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.335 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.335 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.336 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.336 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:07:56.336 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.337 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.337 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.337 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:07:56.337 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.338 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.338 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.338 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.338 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.339 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:07:56.339 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.340 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.340 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.340 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.340 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:07:56.341 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:07:56.341 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.341 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.341 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.341 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:07:56.342 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:07:56.342 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:07:56.342 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:07:56.342 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.342 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.343 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.343 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.343 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.343 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.344 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:07:56.344 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:07:56.344 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.344 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.344 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.345 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.345 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.346 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.346 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.346 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.346 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.347 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.347 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.347 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:07:56.347 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.348 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.348 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.348 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.348 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:07:56.349 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.349 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.349 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.349 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.349 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.350 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.350 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.350 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.350 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:07:56.351 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.351 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.351 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:07:56.352 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.352 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.352 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.352 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.353 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.353 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.353 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.354 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:07:56.354 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.354 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.354 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.355 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.355 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:07:56.355 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.355 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.356 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.356 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.356 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.356 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.357 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.357 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.357 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:07:56.357 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.357 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.358 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.358 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.358 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:07:56.358 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:07:56.359 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.359 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.359 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.359 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:07:56.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:07:56.360 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:07:56.360 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:07:56.360 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.360 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.361 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.361 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.361 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.361 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:07:56.362 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:07:56.362 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.362 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.362 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.363 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.363 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.363 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:07:56.364 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.364 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.364 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.364 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.365 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.365 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.365 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:07:56.365 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.365 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.366 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.366 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:07:56.366 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.367 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.367 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.367 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.367 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.368 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.368 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.368 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.368 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:07:56.368 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.369 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.369 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.369 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.369 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:07:56.370 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.370 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.370 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.370 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.370 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.371 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.371 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:07:56.371 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.372 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.372 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.372 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:07:56.373 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.373 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.373 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.373 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.374 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.374 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.374 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.374 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:07:56.375 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.375 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.375 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.376 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:07:56.376 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:07:56.376 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.376 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.377 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:07:56.377 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:07:56.377 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:07:56.378 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:07:56.378 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.378 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.379 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.379 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.379 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.379 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.379 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:07:56.380 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:07:56.380 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.380 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.380 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.381 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.381 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.381 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.381 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.382 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.382 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.382 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.382 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.382 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.383 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.383 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.383 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:07:56.383 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.384 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.384 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.384 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.384 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:07:56.384 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.385 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.385 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.385 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.385 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.386 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.386 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.386 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.386 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:07:56.387 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.387 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.387 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.387 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:07:56.388 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.388 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.388 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.389 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.389 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.389 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.389 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.389 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.390 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:07:56.390 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.390 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.390 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.391 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.391 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:07:56.391 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.391 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.392 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.392 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.392 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.392 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.392 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.393 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.393 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:07:56.393 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.393 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.394 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.394 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.394 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:07:56.394 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:07:56.394 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.395 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.395 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.395 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:07:56.395 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:07:56.395 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:07:56.396 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:07:56.396 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.396 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.396 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.397 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.397 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.397 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.397 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:07:56.397 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:07:56.398 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.398 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.398 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.398 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.398 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.399 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.399 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.399 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.399 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.400 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.400 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.400 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.400 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.401 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:07:56.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.401 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.401 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.402 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:07:56.402 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.402 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.402 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.403 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.403 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.403 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.404 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:07:56.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.404 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.404 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.405 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:07:56.405 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.405 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.406 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.406 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.406 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.406 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.407 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:07:56.407 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.407 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.408 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.408 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.408 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:07:56.408 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.408 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.409 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.409 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.409 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.409 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.410 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.410 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.410 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:07:56.410 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.410 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.411 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.411 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.411 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:07:56.411 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:07:56.412 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.412 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.412 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.412 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:07:56.413 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:07:56.413 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:07:56.413 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:07:56.413 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.413 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.414 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.414 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.414 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.414 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.415 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:07:56.415 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:07:56.415 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.415 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.416 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.416 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.416 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.416 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.416 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.417 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 48, 2021-10-21T00:07:56.417 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.417 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.417 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.418 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.418 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:07:56.419 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.419 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.419 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.419 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:07:56.420 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.420 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.420 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.420 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.421 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.421 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.421 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.421 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:07:56.422 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.422 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.422 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:07:56.423 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.423 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.423 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.424 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.424 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.424 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.424 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.424 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.425 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:07:56.425 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.425 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.425 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.426 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.426 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:07:56.426 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.426 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.426 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.427 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.427 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.427 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.427 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.428 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.428 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:07:56.428 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.428 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.429 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.429 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.429 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:07:56.429 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:07:56.429 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.430 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.430 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.430 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:07:56.430 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:07:56.431 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:07:56.431 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:07:56.431 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.431 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.431 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.432 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.432 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.432 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.432 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:07:56.432 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:07:56.433 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:07:56.433 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:07:56.433 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:07:56.433 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:07:56.434 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:07:56.434 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:07:56.434 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:07:56.434 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:07:56.434 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:07:56.435 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:07:56.435 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:07:56.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.435 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.436 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:07:56.436 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.436 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.436 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.437 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.437 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:07:56.437 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.437 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.438 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.438 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.438 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:07:56.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.439 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:07:56.439 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.440 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.440 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.440 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.440 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:07:56.440 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.441 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.441 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.441 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.441 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:07:56.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.442 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.442 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:07:56.443 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.443 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.443 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.443 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.444 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:07:56.444 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.444 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.444 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.445 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.445 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:07:56.445 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:07:56.445 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.446 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:07:56.446 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:07:56.446 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.446 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.446 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.447 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:07:56.447 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:07:56.447 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:07:56.447 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.448 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.448 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.448 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:07:56.448 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:07:56.448 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:07:56.449 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:07:56.449 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:07:56.449 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:07:56.449 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:07:56.450 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:56.450 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.450 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:56.450 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:07:56.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.451 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:07:56.451 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.451 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.451 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.452 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.452 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.452 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:07:56.452 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.453 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.453 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.453 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:07:56.453 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.454 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.454 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.454 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.454 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.454 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:07:56.455 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.455 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.455 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:07:56.455 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.456 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.456 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.456 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.456 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.457 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:07:56.457 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.457 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.457 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:07:56.458 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.458 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.458 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.458 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.459 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.459 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:07:56.459 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.459 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.460 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:07:56.460 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.460 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.460 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.461 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.461 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.461 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:07:56.461 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.462 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.462 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:07:56.462 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.462 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.463 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.463 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.463 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.463 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:07:56.463 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.464 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.464 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.464 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:07:56.464 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.465 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.465 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.465 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.465 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.466 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:07:56.466 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.466 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.466 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:56.467 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:07:56.467 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:07:56.467 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:07:56.467 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:07:56.468 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:07:56.468 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:07:56.468 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:07:56.468 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:07:56.468 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.469 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:07:56.469 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:07:56.469 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:07:56.469 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:07:56.470 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:07:56.470 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:07:56.470 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/3050633316": "2021-10-22T00:07:49.502393+0000", 2021-10-21T00:07:56.470 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/3050633316": "2021-10-22T00:07:49.502393+0000" 2021-10-21T00:07:56.471 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.471 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:07:56.471 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:07:56.471 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:07:56.472 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:07:56.472 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:07:56.472 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:07:56.472 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:07:56.473 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:07:56.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:56.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:56.473 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:07:56.473 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:07:56.474 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:07:56.474 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:07:56.474 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:07:56.475 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:07:56.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 msgr2=0x7f8674055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 0x7f8674055a70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f868800b000 tx=0x7f8688008040).stop 2021-10-21T00:07:56.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 msgr2=0x7f8694112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f86940ae590 tx=0x7f868c009040).stop 2021-10-21T00:07:56.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 shutdown_connections 2021-10-21T00:07:56.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f86740535b0 0x7f8674055a70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8694152630 0x7f8694112c40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8694115970 0x7f8694152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 --2- 172.21.15.41:0/3184716141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8680004500 0x7f8694115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 >> 172.21.15.41:0/3184716141 conn(0x7f8694062e80 msgr2=0x7f869405ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:56.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 shutdown_connections 2021-10-21T00:07:56.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.240+0000 7f869a465700 1 -- 172.21.15.41:0/3184716141 wait complete. 2021-10-21T00:07:56.480 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:07:56.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.588+0000 7f421d4d8700 1 Processor -- start 2021-10-21T00:07:56.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.588+0000 7f421d4d8700 1 -- start start 2021-10-21T00:07:56.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42180aa750 0x7f421814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f421814b350 0x7f42180af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180609d0 con 0x7f421805f9f0 2021-10-21T00:07:56.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180b1620 con 0x7f42180aa750 2021-10-21T00:07:56.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421805fdd0 con 0x7f421814b350 2021-10-21T00:07:56.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42180aa750 0x7f421814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42177fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f421814b350 0x7f42180af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42180aa750 0x7f421814ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44746/0 (socket says 172.21.15.41:44746) 2021-10-21T00:07:56.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 -- 172.21.15.41:0/724101502 learned_addr learned my addr 172.21.15.41:0/724101502 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:56.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 -- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f421814b350 msgr2=0x7f42180af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 --2- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f421814b350 0x7f42180af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 -- 172.21.15.41:0/724101502 >> v1:172.21.15.62:6789/0 conn(0x7f421805f9f0 legacy=0x7f421814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 -- 172.21.15.41:0/724101502 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180b1380 con 0x7f42180aa750 2021-10-21T00:07:56.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f42167fc700 1 --2- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42180aa750 0x7f421814ae60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f42080032f0 tx=0x7f4208009290).ready entity=mon.1 client_cookie=2749110f3eda46ee server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f4215ffb700 1 -- 172.21.15.41:0/724101502 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420800b8a0 con 0x7f42180aa750 2021-10-21T00:07:56.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f4215ffb700 1 -- 172.21.15.41:0/724101502 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800ba00 con 0x7f42180aa750 2021-10-21T00:07:56.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f4215ffb700 1 -- 172.21.15.41:0/724101502 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420800bb70 con 0x7f42180aa750 2021-10-21T00:07:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42180aa750 msgr2=0x7f421814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 --2- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42180aa750 0x7f421814ae60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f42080032f0 tx=0x7f4208009290).stop 2021-10-21T00:07:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- 172.21.15.41:0/724101502 shutdown_connections 2021-10-21T00:07:56.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 --2- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f421814b350 0x7f42180af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 --2- 172.21.15.41:0/724101502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42180aa750 0x7f421814ae60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- 172.21.15.41:0/724101502 >> 172.21.15.41:0/724101502 conn(0x7f421805bca0 msgr2=0x7f421805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- 172.21.15.41:0/724101502 shutdown_connections 2021-10-21T00:07:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.592+0000 7f421d4d8700 1 -- 172.21.15.41:0/724101502 wait complete. 2021-10-21T00:07:56.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.596+0000 7f421d4d8700 1 Processor -- start 2021-10-21T00:07:56.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.596+0000 7f421d4d8700 1 -- start start 2021-10-21T00:07:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42180aa750 0x7f421815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f421814b350 0x7f4218156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218063030 con 0x7f421805f9f0 2021-10-21T00:07:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218099b70 con 0x7f421814b350 2021-10-21T00:07:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4218159a90 con 0x7f42180aa750 2021-10-21T00:07:56.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32834/0 (socket says 172.21.15.41:32834) 2021-10-21T00:07:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f42167fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42180aa750 0x7f421815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f42177fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f421814b350 0x7f4218156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 -- 172.21.15.41:0/349408783 learned_addr learned my addr 172.21.15.41:0/349408783 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 -- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42180aa750 msgr2=0x7f421815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42180aa750 0x7f421815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 -- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f421814b350 msgr2=0x7f4218156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f421814b350 0x7f4218156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 -- 172.21.15.41:0/349408783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009530 con 0x7f421805f9f0 2021-10-21T00:07:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4216ffd700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f42180af680 tx=0x7f420c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420c007030 con 0x7f421805f9f0 2021-10-21T00:07:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c007190 con 0x7f421805f9f0 2021-10-21T00:07:56.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4218159d30 con 0x7f421805f9f0 2021-10-21T00:07:56.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f420c006510 con 0x7f421805f9f0 2021-10-21T00:07:56.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218099860 con 0x7f421805f9f0 2021-10-21T00:07:56.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.600+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42180996b0 con 0x7f421805f9f0 2021-10-21T00:07:56.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.604+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f420c01b070 con 0x7f421805f9f0 2021-10-21T00:07:56.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.604+0000 7f4207fff700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 0x7f41f4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.604+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f420c06abf0 con 0x7f421805f9f0 2021-10-21T00:07:56.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.604+0000 7f42167fc700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 0x7f41f4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.604+0000 7f42167fc700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 0x7f41f4055b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f420801b000 tx=0x7f4208016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.608+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f420c042030 con 0x7f421805f9f0 2021-10-21T00:07:56.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4218057350 con 0x7f421805f9f0 2021-10-21T00:07:56.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f4207fff700 1 -- 172.21.15.41:0/349408783 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f420c045650 con 0x7f421805f9f0 2021-10-21T00:07:56.791 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:56.792 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5880,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2080566368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2080566368},{"type":"v1","addr":"172.21.15.41:6833","nonce":2080566368}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[]} 2021-10-21T00:07:56.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 msgr2=0x7f41f4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 0x7f41f4055b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f420801b000 tx=0x7f4208016000).stop 2021-10-21T00:07:56.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 msgr2=0x7f42180b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f42180af680 tx=0x7f420c007c00).stop 2021-10-21T00:07:56.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 shutdown_connections 2021-10-21T00:07:56.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41f40536a0 0x7f41f4055b60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f421814b350 0x7f4218156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42180aa750 0x7f421815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 --2- 172.21.15.41:0/349408783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f421805f9f0 0x7f42180b2df0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 >> 172.21.15.41:0/349408783 conn(0x7f421805bca0 msgr2=0x7f4218149550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:56.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 shutdown_connections 2021-10-21T00:07:56.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.784+0000 7f421d4d8700 1 -- 172.21.15.41:0/349408783 wait complete. 2021-10-21T00:07:56.797 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 24 2021-10-21T00:07:56.804 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:07:56.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 Processor -- start 2021-10-21T00:07:56.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- start start 2021-10-21T00:07:56.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 0x7f4ad414af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 0x7f4ad4064ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad405c3c0 con 0x7f4ad405bfe0 2021-10-21T00:07:56.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad4141370 con 0x7f4ad405f780 2021-10-21T00:07:56.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40b0c40 con 0x7f4ad414a3b0 2021-10-21T00:07:56.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad8893700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 0x7f4ad4064ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 0x7f4ad414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad8893700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 0x7f4ad4064ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:44764/0 (socket says 172.21.15.41:44764) 2021-10-21T00:07:56.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4ad405bfe0 0x7f4ad414a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38668/0 (socket says 172.21.15.41:38668) 2021-10-21T00:07:56.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad8893700 1 -- 172.21.15.41:0/2211454896 learned_addr learned my addr 172.21.15.41:0/2211454896 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:56.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 -- 172.21.15.41:0/2211454896 >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 msgr2=0x7f4ad4064ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:56.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 --2- 172.21.15.41:0/2211454896 >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 0x7f4ad4064ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 -- 172.21.15.41:0/2211454896 >> v1:172.21.15.62:6789/0 conn(0x7f4ad405bfe0 legacy=0x7f4ad414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 -- 172.21.15.41:0/2211454896 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40b0ee0 con 0x7f4ad414a3b0 2021-10-21T00:07:56.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad37fe700 1 --2- 172.21.15.41:0/2211454896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 0x7f4ad414af80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4acc002f70 tx=0x7f4acc006df0).ready entity=mon.2 client_cookie=e3db1c137cb7d3ff server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad2ffd700 1 -- 172.21.15.41:0/2211454896 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4acc00d570 con 0x7f4ad414a3b0 2021-10-21T00:07:56.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad2ffd700 1 -- 172.21.15.41:0/2211454896 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc000e90 con 0x7f4ad414a3b0 2021-10-21T00:07:56.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ad2ffd700 1 -- 172.21.15.41:0/2211454896 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4acc00d8c0 con 0x7f4ad414a3b0 2021-10-21T00:07:56.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- 172.21.15.41:0/2211454896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 msgr2=0x7f4ad414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/2211454896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 0x7f4ad414af80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4acc002f70 tx=0x7f4acc006df0).stop 2021-10-21T00:07:56.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- 172.21.15.41:0/2211454896 shutdown_connections 2021-10-21T00:07:56.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/2211454896 >> v2:172.21.15.62:3300/0 conn(0x7f4ad405f780 0x7f4ad4064ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/2211454896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad414a3b0 0x7f4ad414af80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- 172.21.15.41:0/2211454896 >> 172.21.15.41:0/2211454896 conn(0x7f4ad40639f0 msgr2=0x7f4ad4063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:56.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- 172.21.15.41:0/2211454896 shutdown_connections 2021-10-21T00:07:56.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.904+0000 7f4ada2f6700 1 -- 172.21.15.41:0/2211454896 wait complete. 2021-10-21T00:07:56.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 Processor -- start 2021-10-21T00:07:56.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- start start 2021-10-21T00:07:56.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad405f780 0x7f4ad40ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad40afbd0 0x7f4ad4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4065110 con 0x7f4ad405bfe0 2021-10-21T00:07:56.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40653b0 con 0x7f4ad40afbd0 2021-10-21T00:07:56.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4065650 con 0x7f4ad405f780 2021-10-21T00:07:56.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32848/0 (socket says 172.21.15.41:32848) 2021-10-21T00:07:56.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 -- 172.21.15.41:0/873881050 learned_addr learned my addr 172.21.15.41:0/873881050 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:56.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad8893700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad40afbd0 0x7f4ad4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad37fe700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad405f780 0x7f4ad40ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 -- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad405f780 msgr2=0x7f4ad40ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad405f780 0x7f4ad40ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 -- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad40afbd0 msgr2=0x7f4ad4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:56.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad40afbd0 0x7f4ad4159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:56.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 -- 172.21.15.41:0/873881050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc00b180 con 0x7f4ad405bfe0 2021-10-21T00:07:56.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad3fff700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f4ad40b3b50 tx=0x7f4abc00c940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc005ae0 con 0x7f4ad405bfe0 2021-10-21T00:07:56.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc005c40 con 0x7f4ad405bfe0 2021-10-21T00:07:56.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad40ae5c0 con 0x7f4ad405bfe0 2021-10-21T00:07:56.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc007110 con 0x7f4ad405bfe0 2021-10-21T00:07:56.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.908+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad415a180 con 0x7f4ad405bfe0 2021-10-21T00:07:56.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4065810 con 0x7f4ad405bfe0 2021-10-21T00:07:56.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4abc010030 con 0x7f4ad405bfe0 2021-10-21T00:07:56.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ad17fa700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 0x7f4aac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:56.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4abc06b560 con 0x7f4ad405bfe0 2021-10-21T00:07:56.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ad37fe700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 0x7f4aac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:56.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.912+0000 7f4ad37fe700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 0x7f4aac055b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4acc018000 tx=0x7f4acc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:56.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:56.920+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4abc042920 con 0x7f4ad405bfe0 2021-10-21T00:07:57.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad40b1180 con 0x7f4ad405bfe0 2021-10-21T00:07:57.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ad17fa700 1 -- 172.21.15.41:0/873881050 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f4abc045f40 con 0x7f4ad405bfe0 2021-10-21T00:07:57.095 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:57.095 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5213,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3412385093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3412385093},{"type":"v1","addr":"172.21.15.62:6835","nonce":3412385093}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19},{"gid":5880,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2080566368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2080566368},{"type":"v1","addr":"172.21.15.41:6833","nonce":2080566368}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[]} 2021-10-21T00:07:57.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 msgr2=0x7f4aac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 0x7f4aac055b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4acc018000 tx=0x7f4acc014000).stop 2021-10-21T00:07:57.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 msgr2=0x7f4ad41417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f4ad40b3b50 tx=0x7f4abc00c940).stop 2021-10-21T00:07:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 shutdown_connections 2021-10-21T00:07:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4aac053640 0x7f4aac055b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ad40afbd0 0x7f4ad4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ad405f780 0x7f4ad40ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 --2- 172.21.15.41:0/873881050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ad405bfe0 0x7f4ad41417f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 >> 172.21.15.41:0/873881050 conn(0x7f4ad40639f0 msgr2=0x7f4ad40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:57.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 shutdown_connections 2021-10-21T00:07:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.088+0000 7f4ada2f6700 1 -- 172.21.15.41:0/873881050 wait complete. 2021-10-21T00:07:57.100 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 24 2021-10-21T00:07:57.108 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:07:57.108 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:07:57.109 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:07:57.109 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:07:57.109 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:07:57.109 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:07:57.110 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:07:57.110 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:07:57.123 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:07:57.123 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:07:57.125 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:07:57.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:07:57.127 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:07:57.127 DEBUG:teuthology.parallel:result is None 2021-10-21T00:07:57.129 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:07:57.129 DEBUG:teuthology.parallel:result is None 2021-10-21T00:07:57.130 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:07:57.203 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:07:57.207 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:07:57.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 Processor -- start 2021-10-21T00:07:57.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 -- start start 2021-10-21T00:07:57.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f59e00b0730 0x7f59e0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e005fdd0 con 0x7f59e005f9f0 2021-10-21T00:07:57.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e0140400 con 0x7f59e00b0730 2021-10-21T00:07:57.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e6ce3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e00b27c0 con 0x7f59e00b3370 2021-10-21T00:07:57.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f59e00b0730 0x7f59e0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f59e00b0730 0x7f59e0138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32870/0 (socket says 172.21.15.41:32870) 2021-10-21T00:07:57.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 -- 172.21.15.41:0/3171941988 learned_addr learned my addr 172.21.15.41:0/3171941988 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:57.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e54e0700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 -- 172.21.15.41:0/3171941988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 msgr2=0x7f59e00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:57.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 -- 172.21.15.41:0/3171941988 >> v1:172.21.15.62:6789/0 conn(0x7f59e005f9f0 legacy=0x7f59e00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 -- 172.21.15.41:0/3171941988 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0140080 con 0x7f59e00b0730 2021-10-21T00:07:57.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e54e0700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:07:57.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e64e2700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e00b0730 0x7f59e0138b60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f59d80032f0 tx=0x7f59d8009290).ready entity=mon.0 client_cookie=bf3dd8366d87349c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e4cdf700 1 -- 172.21.15.41:0/3171941988 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d800b8a0 con 0x7f59e00b0730 2021-10-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e4cdf700 1 -- 172.21.15.41:0/3171941988 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d800ba00 con 0x7f59e00b0730 2021-10-21T00:07:57.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.240+0000 7f59e4cdf700 1 -- 172.21.15.41:0/3171941988 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d800bb70 con 0x7f59e00b0730 2021-10-21T00:07:57.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3171941988 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e00b0730 msgr2=0x7f59e0138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e00b0730 0x7f59e0138b60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f59d80032f0 tx=0x7f59d8009290).stop 2021-10-21T00:07:57.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3171941988 shutdown_connections 2021-10-21T00:07:57.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e00b0730 0x7f59e0138b60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3171941988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3171941988 >> 172.21.15.41:0/3171941988 conn(0x7f59e00637b0 msgr2=0x7f59e0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:57.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3171941988 shutdown_connections 2021-10-21T00:07:57.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3171941988 wait complete. 2021-10-21T00:07:57.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 Processor -- start 2021-10-21T00:07:57.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- start start 2021-10-21T00:07:57.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59e00b0730 0x7f59e012d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e0064870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e013cd30 con 0x7f59e005f9f0 2021-10-21T00:07:57.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e0138550 con 0x7f59e00b0730 2021-10-21T00:07:57.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e6ce3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e012e890 con 0x7f59e00b3370 2021-10-21T00:07:57.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.244+0000 7f59e5ce1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32874/0 (socket says 172.21.15.41:32874) 2021-10-21T00:07:57.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 -- 172.21.15.41:0/3253514342 learned_addr learned my addr 172.21.15.41:0/3253514342 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:57.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e54e0700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59e00b0730 0x7f59e012d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e64e2700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e0064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 -- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 msgr2=0x7f59e0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e0064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 -- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59e00b0730 msgr2=0x7f59e012d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:57.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59e00b0730 0x7f59e012d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:57.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 -- 172.21.15.41:0/3253514342 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8009530 con 0x7f59e005f9f0 2021-10-21T00:07:57.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e5ce1700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f59e0063400 tx=0x7f59dc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:57.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59dc007020 con 0x7f59e005f9f0 2021-10-21T00:07:57.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc007180 con 0x7f59e005f9f0 2021-10-21T00:07:57.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59dc006560 con 0x7f59e005f9f0 2021-10-21T00:07:57.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e012d950 con 0x7f59e005f9f0 2021-10-21T00:07:57.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e0064d60 con 0x7f59e005f9f0 2021-10-21T00:07:57.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e0138710 con 0x7f59e005f9f0 2021-10-21T00:07:57.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.248+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f59dc010070 con 0x7f59e005f9f0 2021-10-21T00:07:57.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.252+0000 7f59ceffd700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 0x7f59c00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:57.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.252+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f59dc007cb0 con 0x7f59e005f9f0 2021-10-21T00:07:57.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.252+0000 7f59e54e0700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 0x7f59c00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:57.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.252+0000 7f59e54e0700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 0x7f59c00559b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f59d000d000 tx=0x7f59d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:57.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.256+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f59dc041be0 con 0x7f59e005f9f0 2021-10-21T00:07:57.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:57.388+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f59e0057350 con 0x7f59e005f9f0 2021-10-21T00:07:58.011 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:58.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:58.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:58.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:58.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:07:58.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.256+0000 7f59ceffd700 1 -- 172.21.15.41:0/3253514342 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f59dc045200 con 0x7f59e005f9f0 2021-10-21T00:07:58.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 msgr2=0x7f59c00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 0x7f59c00559b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f59d000d000 tx=0x7f59d0008040).stop 2021-10-21T00:07:58.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 msgr2=0x7f59e012e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f59e0063400 tx=0x7f59dc007c40).stop 2021-10-21T00:07:58.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 shutdown_connections 2021-10-21T00:07:58.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59c00534f0 0x7f59c00559b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59e00b3370 0x7f59e0064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59e00b0730 0x7f59e012d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 --2- 172.21.15.41:0/3253514342 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f59e005f9f0 0x7f59e012e3a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 >> 172.21.15.41:0/3253514342 conn(0x7f59e00637b0 msgr2=0x7f59e005c310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:58.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 shutdown_connections 2021-10-21T00:07:58.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.260+0000 7f59e6ce3700 1 -- 172.21.15.41:0/3253514342 wait complete. 2021-10-21T00:07:58.271 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:07:58.281 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:07:58.282 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:07:58.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 Processor -- start 2021-10-21T00:07:58.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 -- start start 2021-10-21T00:07:58.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5c2c0b1fd0 0x7f5c2c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c2c0b0b40 0x7f5c2c0a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c13f560 con 0x7f5c2c0aa190 2021-10-21T00:07:58.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c13cfd0 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c31599700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c13f790 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c30d98700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5c2c0aa190 0x7f5c2c097f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58888/0 (socket says 172.21.15.41:58888) 2021-10-21T00:07:58.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5c2c0b1fd0 0x7f5c2c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c30d98700 1 -- 172.21.15.41:0/975244389 learned_addr learned my addr 172.21.15.41:0/975244389 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:58.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2b7fe700 1 --2- 172.21.15.41:0/975244389 >> v2:172.21.15.62:3300/0 conn(0x7f5c2c0b0b40 0x7f5c2c0a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2affd700 1 -- 172.21.15.41:0/975244389 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948822591 0 0) 0x7f5c2c13f560 con 0x7f5c2c0aa190 2021-10-21T00:07:58.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2affd700 1 -- 172.21.15.41:0/975244389 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c18003260 con 0x7f5c2c0aa190 2021-10-21T00:07:58.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2bfff700 1 -- 172.21.15.41:0/975244389 >> v2:172.21.15.62:3300/0 conn(0x7f5c2c0b0b40 msgr2=0x7f5c2c0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:58.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2bfff700 1 --2- 172.21.15.41:0/975244389 >> v2:172.21.15.62:3300/0 conn(0x7f5c2c0b0b40 0x7f5c2c0a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2bfff700 1 -- 172.21.15.41:0/975244389 >> v1:172.21.15.41:6789/0 conn(0x7f5c2c0aa190 legacy=0x7f5c2c097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.388+0000 7f5c2bfff700 1 -- 172.21.15.41:0/975244389 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c13fa30 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c2bfff700 1 --2- 172.21.15.41:0/975244389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c13fed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f5c20002f70 tx=0x7f5c20006df0).ready entity=mon.0 client_cookie=5a052da82bddcf25 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c2affd700 1 -- 172.21.15.41:0/975244389 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c2000d4f0 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c2affd700 1 -- 172.21.15.41:0/975244389 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20000e90 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c2affd700 1 -- 172.21.15.41:0/975244389 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c2000d840 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- 172.21.15.41:0/975244389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b1fd0 msgr2=0x7f5c2c13fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 --2- 172.21.15.41:0/975244389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c13fed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f5c20002f70 tx=0x7f5c20006df0).stop 2021-10-21T00:07:58.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- 172.21.15.41:0/975244389 shutdown_connections 2021-10-21T00:07:58.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 --2- 172.21.15.41:0/975244389 >> v2:172.21.15.62:3300/0 conn(0x7f5c2c0b0b40 0x7f5c2c0a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 --2- 172.21.15.41:0/975244389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c13fed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- 172.21.15.41:0/975244389 >> 172.21.15.41:0/975244389 conn(0x7f5c2c0b5700 msgr2=0x7f5c2c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:58.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- 172.21.15.41:0/975244389 shutdown_connections 2021-10-21T00:07:58.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- 172.21.15.41:0/975244389 wait complete. 2021-10-21T00:07:58.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 Processor -- start 2021-10-21T00:07:58.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.392+0000 7f5c31599700 1 -- start start 2021-10-21T00:07:58.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c2c0aa190 0x7f5c2c1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c0aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c135570 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0ae880 con 0x7f5c2c0b1fd0 2021-10-21T00:07:58.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c143970 con 0x7f5c2c0aa190 2021-10-21T00:07:58.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32888/0 (socket says 172.21.15.41:32888) 2021-10-21T00:07:58.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 -- 172.21.15.41:0/2605305896 learned_addr learned my addr 172.21.15.41:0/2605305896 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:58.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c30d98700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c0aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2bfff700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c2c0aa190 0x7f5c2c1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 -- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c2c0aa190 msgr2=0x7f5c2c1360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c2c0aa190 0x7f5c2c1360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 -- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 msgr2=0x7f5c2c0aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c0aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 -- 172.21.15.41:0/2605305896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2000b180 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c30d98700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:58.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c2b7fe700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f5c2c0adaa0 tx=0x7f5c1c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c00c850 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c00c9b0 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c0ae5e0 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c00cd10 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c135830 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c0b1130 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.396+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c1c0123f0 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.400+0000 7f5c297fa700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 0x7f5c0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.400+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5c1c06ba40 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.400+0000 7f5c2bfff700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 0x7f5c0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.400+0000 7f5c2bfff700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 0x7f5c0c055ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5c2001a000 tx=0x7f5c20014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.404+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c1c042d60 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.568+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5c2c057350 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c297fa700 1 -- 172.21.15.41:0/2605305896 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f5c1c046380 con 0x7f5c2c0b0b40 2021-10-21T00:07:58.578 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:58.578 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:07:58.578 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:07:58.579 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.579 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:07:58.579 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:07:58.579 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.579 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:07:58.580 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.580 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.580 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.580 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.581 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.581 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.581 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:07:58.581 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:07:58.581 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.582 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:07:58.582 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.582 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.582 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.583 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.583 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.583 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.583 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:07:58.583 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:07:58.584 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.584 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.584 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.584 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.584 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.585 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.586 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.586 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:07:58.586 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:07:58.587 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.587 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.587 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.587 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.588 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.588 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.588 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.588 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:07:58.589 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:07:58.589 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.589 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.589 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.590 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.590 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.590 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.590 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.591 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:07:58.591 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:07:58.591 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.591 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.591 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.592 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.592 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.592 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.593 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.593 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:07:58.593 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:07:58.593 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.594 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.594 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.594 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.594 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.594 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.595 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.595 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:07:58.595 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:07:58.595 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.596 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.596 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.596 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.596 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.597 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.597 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.597 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:07:58.597 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:07:58.597 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.598 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.598 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.598 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.599 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.599 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.599 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.599 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:07:58.600 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:07:58.600 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.600 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.601 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.601 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.601 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.601 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.601 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.602 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:07:58.602 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:07:58.602 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.602 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:07:58.603 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:07:58.603 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:07:58.603 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.603 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.603 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.604 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:07:58.605 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:07:58.605 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.605 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:07:58.605 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:07:58.605 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:07:58.606 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.606 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.606 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.606 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:07:58.607 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:07:58.607 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.607 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:07:58.607 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:07:58.608 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:07:58.608 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.608 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.608 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.608 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:07:58.609 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:07:58.609 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.610 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:07:58.610 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:07:58.611 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:07:58.612 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.613 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.613 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.614 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.614 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:07:58.614 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:07:58.614 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.615 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:07:58.615 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:07:58.615 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.615 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.616 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:58.616 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:58.616 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:07:58.616 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:07:58.616 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:07:58.617 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:07:58.617 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:07:58.617 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:07:58.617 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.618 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:58.618 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:07:58.618 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:07:58.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 msgr2=0x7f5c0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 0x7f5c0c055ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5c2001a000 tx=0x7f5c20014000).stop 2021-10-21T00:07:58.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 msgr2=0x7f5c2c135080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f5c2c0adaa0 tx=0x7f5c1c0091d0).stop 2021-10-21T00:07:58.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 shutdown_connections 2021-10-21T00:07:58.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c0c053610 0x7f5c0c055ad0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c2c0b1fd0 0x7f5c2c0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c2c0b0b40 0x7f5c2c135080 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 --2- 172.21.15.41:0/2605305896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c2c0aa190 0x7f5c2c1360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 >> 172.21.15.41:0/2605305896 conn(0x7f5c2c0b5700 msgr2=0x7f5c2c13c310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:58.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 shutdown_connections 2021-10-21T00:07:58.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.572+0000 7f5c31599700 1 -- 172.21.15.41:0/2605305896 wait complete. 2021-10-21T00:07:58.624 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:07:58.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 Processor -- start 2021-10-21T00:07:58.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- start start 2021-10-21T00:07:58.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4758062330 0x7f47580b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475805bd40 con 0x7f47580b3a20 2021-10-21T00:07:58.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475805bf70 con 0x7f4758062f70 2021-10-21T00:07:58.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4758142cb0 con 0x7f4758062330 2021-10-21T00:07:58.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475ed00700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f47580b3a20 0x7f475813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58900/0 (socket says 172.21.15.41:58900) 2021-10-21T00:07:58.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475ed00700 1 -- 172.21.15.41:0/324978139 learned_addr learned my addr 172.21.15.41:0/324978139 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:58.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475e4ff700 1 --2- 172.21.15.41:0/324978139 >> v2:172.21.15.41:3300/0 conn(0x7f4758062330 0x7f47580b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603622413 0 0) 0x7f475805bd40 con 0x7f47580b3a20 2021-10-21T00:07:58.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4744003260 con 0x7f47580b3a20 2021-10-21T00:07:58.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900054859 0 0) 0x7f475805bf70 con 0x7f4758062f70 2021-10-21T00:07:58.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f475805bd40 con 0x7f4758062f70 2021-10-21T00:07:58.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475e4ff700 1 -- 172.21.15.41:0/324978139 >> v1:172.21.15.62:6789/0 conn(0x7f4758062f70 legacy=0x7f475805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475e4ff700 1 -- 172.21.15.41:0/324978139 >> v1:172.21.15.41:6789/0 conn(0x7f47580b3a20 legacy=0x7f475813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475e4ff700 1 -- 172.21.15.41:0/324978139 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758142950 con 0x7f4758062330 2021-10-21T00:07:58.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475e4ff700 1 --2- 172.21.15.41:0/324978139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758062330 0x7f47580b3f30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4748002f70 tx=0x7f4748006df0).ready entity=mon.0 client_cookie=8cac855e722044a8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474800d540 con 0x7f4758062330 2021-10-21T00:07:58.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4748000e90 con 0x7f4758062330 2021-10-21T00:07:58.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475d4fd700 1 -- 172.21.15.41:0/324978139 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474800d890 con 0x7f4758062330 2021-10-21T00:07:58.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- 172.21.15.41:0/324978139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758062330 msgr2=0x7f47580b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 --2- 172.21.15.41:0/324978139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758062330 0x7f47580b3f30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4748002f70 tx=0x7f4748006df0).stop 2021-10-21T00:07:58.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- 172.21.15.41:0/324978139 shutdown_connections 2021-10-21T00:07:58.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 --2- 172.21.15.41:0/324978139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758062330 0x7f47580b3f30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- 172.21.15.41:0/324978139 >> 172.21.15.41:0/324978139 conn(0x7f47580b9080 msgr2=0x7f47580b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:58.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.728+0000 7f475f501700 1 -- 172.21.15.41:0/324978139 shutdown_connections 2021-10-21T00:07:58.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- 172.21.15.41:0/324978139 wait complete. 2021-10-21T00:07:58.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 Processor -- start 2021-10-21T00:07:58.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- start start 2021-10-21T00:07:58.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4758062f70 0x7f47581442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47580b3a20 0x7f4758145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758152920 con 0x7f4758146100 2021-10-21T00:07:58.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758152b80 con 0x7f4758062f70 2021-10-21T00:07:58.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4758152e20 con 0x7f47580b3a20 2021-10-21T00:07:58.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32906/0 (socket says 172.21.15.41:32906) 2021-10-21T00:07:58.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 -- 172.21.15.41:0/196188662 learned_addr learned my addr 172.21.15.41:0/196188662 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:58.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475dcfe700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47580b3a20 0x7f4758145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475e4ff700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4758062f70 0x7f47581442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 -- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47580b3a20 msgr2=0x7f4758145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47580b3a20 0x7f4758145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 -- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4758062f70 msgr2=0x7f47581442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4758062f70 0x7f47581442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 -- 172.21.15.41:0/196188662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474800b180 con 0x7f4758146100 2021-10-21T00:07:58.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475ed00700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f4750001110 tx=0x7f4750007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475000cdb0 con 0x7f4758146100 2021-10-21T00:07:58.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500070d0 con 0x7f4758146100 2021-10-21T00:07:58.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758144980 con 0x7f4758146100 2021-10-21T00:07:58.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4750007430 con 0x7f4758146100 2021-10-21T00:07:58.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.732+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47581455d0 con 0x7f4758146100 2021-10-21T00:07:58.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758144000 con 0x7f4758146100 2021-10-21T00:07:58.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f475001a060 con 0x7f4758146100 2021-10-21T00:07:58.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f47577fe700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 0x7f4738055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:58.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f475006a8b0 con 0x7f4758146100 2021-10-21T00:07:58.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f475e4ff700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 0x7f4738055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:58.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.736+0000 7f475e4ff700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 0x7f4738055b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4748018000 tx=0x7f4748014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:58.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.740+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4758144000 con 0x7f4758146100 2021-10-21T00:07:58.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.864+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4758144000 con 0x7f4758146100 2021-10-21T00:07:58.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f47577fe700 1 -- 172.21.15.41:0/196188662 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f4758144000 con 0x7f4758146100 2021-10-21T00:07:58.873 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:58.873 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":54,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:07:58.253710+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:07:58.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 msgr2=0x7f4738055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 0x7f4738055b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4748018000 tx=0x7f4748014000).stop 2021-10-21T00:07:58.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 msgr2=0x7f47580ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:58.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f4750001110 tx=0x7f4750007a80).stop 2021-10-21T00:07:58.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 shutdown_connections 2021-10-21T00:07:58.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f47380536a0 0x7f4738055b60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4758146100 0x7f47580ad820 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47580b3a20 0x7f4758145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 --2- 172.21.15.41:0/196188662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4758062f70 0x7f47581442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:58.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 >> 172.21.15.41:0/196188662 conn(0x7f47580b9080 msgr2=0x7f475813f220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:58.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 shutdown_connections 2021-10-21T00:07:58.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.868+0000 7f475f501700 1 -- 172.21.15.41:0/196188662 wait complete. 2021-10-21T00:07:58.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:07:58.888 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:07:59.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 Processor -- start 2021-10-21T00:07:59.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- start start 2021-10-21T00:07:59.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f74980b2170 0x7f74980ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f74980af620 0x7f74980ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980b0b50 con 0x7f74980abb50 2021-10-21T00:07:59.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980b2550 con 0x7f74980b2170 2021-10-21T00:07:59.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980b0d90 con 0x7f74980af620 2021-10-21T00:07:59.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f74980b2170 0x7f74980ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f74980b2170 0x7f74980ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32910/0 (socket says 172.21.15.41:32910) 2021-10-21T00:07:59.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 -- 172.21.15.41:0/3862953926 learned_addr learned my addr 172.21.15.41:0/3862953926 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f74967fc700 1 --2- 172.21.15.41:0/3862953926 >> v2:172.21.15.62:3300/0 conn(0x7f74980af620 0x7f74980ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 -- 172.21.15.41:0/3862953926 >> v2:172.21.15.62:3300/0 conn(0x7f74980af620 msgr2=0x7f74980ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:59.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 --2- 172.21.15.41:0/3862953926 >> v2:172.21.15.62:3300/0 conn(0x7f74980af620 0x7f74980ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 -- 172.21.15.41:0/3862953926 >> v1:172.21.15.41:6789/0 conn(0x7f74980abb50 legacy=0x7f749814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 -- 172.21.15.41:0/3862953926 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980b1030 con 0x7f74980b2170 2021-10-21T00:07:59.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7496ffd700 1 --2- 172.21.15.41:0/3862953926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980b2170 0x7f74980ab170 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f748c002f70 tx=0x7f748c006eb0).ready entity=mon.0 client_cookie=4fd702989a7c2213 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7495ffb700 1 -- 172.21.15.41:0/3862953926 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f748c00d5c0 con 0x7f74980b2170 2021-10-21T00:07:59.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7495ffb700 1 -- 172.21.15.41:0/3862953926 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c000e90 con 0x7f74980b2170 2021-10-21T00:07:59.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7495ffb700 1 -- 172.21.15.41:0/3862953926 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f748c00d950 con 0x7f74980b2170 2021-10-21T00:07:59.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- 172.21.15.41:0/3862953926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980b2170 msgr2=0x7f74980ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 --2- 172.21.15.41:0/3862953926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980b2170 0x7f74980ab170 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f748c002f70 tx=0x7f748c006eb0).stop 2021-10-21T00:07:59.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- 172.21.15.41:0/3862953926 shutdown_connections 2021-10-21T00:07:59.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 --2- 172.21.15.41:0/3862953926 >> v2:172.21.15.62:3300/0 conn(0x7f74980af620 0x7f74980ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 --2- 172.21.15.41:0/3862953926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980b2170 0x7f74980ab170 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- 172.21.15.41:0/3862953926 >> 172.21.15.41:0/3862953926 conn(0x7f74980b5700 msgr2=0x7f74980b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- 172.21.15.41:0/3862953926 shutdown_connections 2021-10-21T00:07:59.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:58.996+0000 7f7497fff700 1 -- 172.21.15.41:0/3862953926 wait complete. 2021-10-21T00:07:59.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 Processor -- start 2021-10-21T00:07:59.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- start start 2021-10-21T00:07:59.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74980abb50 0x7f7498149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74980b2170 0x7f74981463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980ac640 con 0x7f74980af620 2021-10-21T00:07:59.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980ae650 con 0x7f74980abb50 2021-10-21T00:07:59.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74981470e0 con 0x7f74980b2170 2021-10-21T00:07:59.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32920/0 (socket says 172.21.15.41:32920) 2021-10-21T00:07:59.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7496ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74980abb50 0x7f7498149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 -- 172.21.15.41:0/1744904943 learned_addr learned my addr 172.21.15.41:0/1744904943 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74977fe700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74980b2170 0x7f74981463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 -- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74980b2170 msgr2=0x7f74981463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74980b2170 0x7f74981463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 -- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74980abb50 msgr2=0x7f7498149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74980abb50 0x7f7498149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 -- 172.21.15.41:0/1744904943 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c00b1e0 con 0x7f74980af620 2021-10-21T00:07:59.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f74967fc700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f748800c000 tx=0x7f7488006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7488010780 con 0x7f74980af620 2021-10-21T00:07:59.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880108e0 con 0x7f74980af620 2021-10-21T00:07:59.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74981468e0 con 0x7f74980af620 2021-10-21T00:07:59.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7488010c40 con 0x7f74980af620 2021-10-21T00:07:59.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.000+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74980ac260 con 0x7f74980af620 2021-10-21T00:07:59.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74980ac4a0 con 0x7f74980af620 2021-10-21T00:07:59.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f748801c460 con 0x7f74980af620 2021-10-21T00:07:59.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7487fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 0x7f7474055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f748806ba60 con 0x7f74980af620 2021-10-21T00:07:59.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7496ffd700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 0x7f7474055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.004+0000 7f7496ffd700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 0x7f7474055b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f748c01c000 tx=0x7f748c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.008+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74980ac4a0 con 0x7f74980af620 2021-10-21T00:07:59.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.136+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f74980ac4a0 con 0x7f74980af620 2021-10-21T00:07:59.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.136+0000 7f7487fff700 1 -- 172.21.15.41:0/1744904943 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7f74980ac4a0 con 0x7f74980af620 2021-10-21T00:07:59.193 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:07:59.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 msgr2=0x7f7474055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 0x7f7474055b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f748c01c000 tx=0x7f748c015000).stop 2021-10-21T00:07:59.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 msgr2=0x7f7498145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f748800c000 tx=0x7f7488006df0).stop 2021-10-21T00:07:59.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 shutdown_connections 2021-10-21T00:07:59.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74740536a0 0x7f7474055b60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74980b2170 0x7f74981463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74980af620 0x7f7498145f00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 --2- 172.21.15.41:0/1744904943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74980abb50 0x7f7498149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 >> 172.21.15.41:0/1744904943 conn(0x7f74980b5700 msgr2=0x7f74980aafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 shutdown_connections 2021-10-21T00:07:59.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.140+0000 7f7497fff700 1 -- 172.21.15.41:0/1744904943 wait complete. 2021-10-21T00:07:59.198 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:07:59.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.300+0000 7fb15c120700 1 Processor -- start 2021-10-21T00:07:59.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.300+0000 7fb15c120700 1 -- start start 2021-10-21T00:07:59.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 0x7fb1540aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15405cad0 con 0x7fb1540b10d0 2021-10-21T00:07:59.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1540ae300 con 0x7fb1540b0560 2021-10-21T00:07:59.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540aece0 con 0x7fb15405c6f0 2021-10-21T00:07:59.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15a6bd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb1540b10d0 0x7fb154145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58928/0 (socket says 172.21.15.41:58928) 2021-10-21T00:07:59.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15a6bd700 1 -- 172.21.15.41:0/3784561669 learned_addr learned my addr 172.21.15.41:0/3784561669 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:59.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb159ebc700 1 --2- 172.21.15.41:0/3784561669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 0x7fb1540aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402708889 0 0) 0x7fb15405cad0 con 0x7fb1540b10d0 2021-10-21T00:07:59.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb13c003260 con 0x7fb1540b10d0 2021-10-21T00:07:59.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224332728 0 0) 0x7fb1540ae300 con 0x7fb1540b0560 2021-10-21T00:07:59.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15405cad0 con 0x7fb1540b0560 2021-10-21T00:07:59.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232344098 0 0) 0x7fb13c003260 con 0x7fb1540b10d0 2021-10-21T00:07:59.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb159ebc700 1 -- 172.21.15.41:0/3784561669 >> v1:172.21.15.62:6789/0 conn(0x7fb1540b0560 legacy=0x7fb1540b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb159ebc700 1 -- 172.21.15.41:0/3784561669 >> v1:172.21.15.41:6789/0 conn(0x7fb1540b10d0 legacy=0x7fb154145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb159ebc700 1 -- 172.21.15.41:0/3784561669 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540ae5a0 con 0x7fb15405c6f0 2021-10-21T00:07:59.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb159ebc700 1 --2- 172.21.15.41:0/3784561669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 0x7fb1540aeec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb150001110 tx=0x7fb14c0091d0).ready entity=mon.2 client_cookie=a299ae9ba4c8bf6d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb150001660 con 0x7fb15405c6f0 2021-10-21T00:07:59.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00f510 con 0x7fb15405c6f0 2021-10-21T00:07:59.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb158eba700 1 -- 172.21.15.41:0/3784561669 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14c00f680 con 0x7fb15405c6f0 2021-10-21T00:07:59.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- 172.21.15.41:0/3784561669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 msgr2=0x7fb1540aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 --2- 172.21.15.41:0/3784561669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 0x7fb1540aeec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb150001110 tx=0x7fb14c0091d0).stop 2021-10-21T00:07:59.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- 172.21.15.41:0/3784561669 shutdown_connections 2021-10-21T00:07:59.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 --2- 172.21.15.41:0/3784561669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb15405c6f0 0x7fb1540aeec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- 172.21.15.41:0/3784561669 >> 172.21.15.41:0/3784561669 conn(0x7fb154063210 msgr2=0x7fb15405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- 172.21.15.41:0/3784561669 shutdown_connections 2021-10-21T00:07:59.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.304+0000 7fb15c120700 1 -- 172.21.15.41:0/3784561669 wait complete. 2021-10-21T00:07:59.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 Processor -- start 2021-10-21T00:07:59.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- start start 2021-10-21T00:07:59.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb15405c6f0 0x7fb1540b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1540b10d0 0x7fb154148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154156040 con 0x7fb1540b0560 2021-10-21T00:07:59.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15414b260 con 0x7fb15405c6f0 2021-10-21T00:07:59.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb154149800 con 0x7fb1540b10d0 2021-10-21T00:07:59.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32932/0 (socket says 172.21.15.41:32932) 2021-10-21T00:07:59.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 -- 172.21.15.41:0/439061256 learned_addr learned my addr 172.21.15.41:0/439061256 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb159ebc700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb15405c6f0 0x7fb1540b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15a6bd700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1540b10d0 0x7fb154148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 -- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1540b10d0 msgr2=0x7fb154148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1540b10d0 0x7fb154148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 -- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb15405c6f0 msgr2=0x7fb1540b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb15405c6f0 0x7fb1540b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 -- 172.21.15.41:0/439061256 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009470 con 0x7fb1540b0560 2021-10-21T00:07:59.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb1596bb700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fb144001110 tx=0x7fb144007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14400ce50 con 0x7fb1540b0560 2021-10-21T00:07:59.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14400f470 con 0x7fb1540b0560 2021-10-21T00:07:59.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb154149a60 con 0x7fb1540b0560 2021-10-21T00:07:59.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14400f7d0 con 0x7fb1540b0560 2021-10-21T00:07:59.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.308+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15414a650 con 0x7fb1540b0560 2021-10-21T00:07:59.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1540ae840 con 0x7fb1540b0560 2021-10-21T00:07:59.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb144019030 con 0x7fb1540b0560 2021-10-21T00:07:59.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb142ffd700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 0x7fb134055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb14406aaa0 con 0x7fb1540b0560 2021-10-21T00:07:59.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb159ebc700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 0x7fb134055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.312+0000 7fb159ebc700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 0x7fb134055a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb14c01b000 tx=0x7fb14c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.320+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb144041f30 con 0x7fb1540b0560 2021-10-21T00:07:59.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.444+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb154057350 con 0x7fb1540b0560 2021-10-21T00:07:59.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb142ffd700 1 -- 172.21.15.41:0/439061256 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb144045550 con 0x7fb1540b0560 2021-10-21T00:07:59.454 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:07:59.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 msgr2=0x7fb134055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 0x7fb134055a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb14c01b000 tx=0x7fb14c016000).stop 2021-10-21T00:07:59.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 msgr2=0x7fb154148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fb144001110 tx=0x7fb144007ae0).stop 2021-10-21T00:07:59.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 shutdown_connections 2021-10-21T00:07:59.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb134053580 0x7fb134055a40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1540b10d0 0x7fb154148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1540b0560 0x7fb154148340 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 --2- 172.21.15.41:0/439061256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb15405c6f0 0x7fb1540b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 >> 172.21.15.41:0/439061256 conn(0x7fb154063210 msgr2=0x7fb1540b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.448+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 shutdown_connections 2021-10-21T00:07:59.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.452+0000 7fb15c120700 1 -- 172.21.15.41:0/439061256 wait complete. 2021-10-21T00:07:59.471 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:07:59.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 Processor -- start 2021-10-21T00:07:59.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 -- start start 2021-10-21T00:07:59.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a740af620 0x7f0a740ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740b0b50 con 0x7f0a74067a80 2021-10-21T00:07:59.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740b2550 con 0x7f0a740b2170 2021-10-21T00:07:59.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7b13a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740b0d90 con 0x7f0a740af620 2021-10-21T00:07:59.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79937700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a740af620 0x7f0a740ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7a939700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0a74067a80 0x7f0a74149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58944/0 (socket says 172.21.15.41:58944) 2021-10-21T00:07:59.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a7a939700 1 -- 172.21.15.41:0/2357114058 learned_addr learned my addr 172.21.15.41:0/2357114058 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:07:59.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79937700 1 -- 172.21.15.41:0/2357114058 >> v1:172.21.15.62:6789/0 conn(0x7f0a740b2170 legacy=0x7f0a740ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:59.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79937700 1 -- 172.21.15.41:0/2357114058 >> v1:172.21.15.41:6789/0 conn(0x7f0a74067a80 legacy=0x7f0a74149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79937700 1 -- 172.21.15.41:0/2357114058 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740b1030 con 0x7f0a740af620 2021-10-21T00:07:59.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79937700 1 --2- 172.21.15.41:0/2357114058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740ab880 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f0a740aafa0 tx=0x7f0a700091d0).ready entity=mon.0 client_cookie=5f42f9ea4f40a599 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79136700 1 -- 172.21.15.41:0/2357114058 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a7000b820 con 0x7f0a740af620 2021-10-21T00:07:59.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79136700 1 -- 172.21.15.41:0/2357114058 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000b980 con 0x7f0a740af620 2021-10-21T00:07:59.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.572+0000 7f0a79136700 1 -- 172.21.15.41:0/2357114058 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a7000baf0 con 0x7f0a740af620 2021-10-21T00:07:59.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2357114058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 msgr2=0x7f0a740ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2357114058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740ab880 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f0a740aafa0 tx=0x7f0a700091d0).stop 2021-10-21T00:07:59.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2357114058 shutdown_connections 2021-10-21T00:07:59.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2357114058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740ab880 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2357114058 >> 172.21.15.41:0/2357114058 conn(0x7f0a740b5700 msgr2=0x7f0a740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2357114058 shutdown_connections 2021-10-21T00:07:59.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2357114058 wait complete. 2021-10-21T00:07:59.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 Processor -- start 2021-10-21T00:07:59.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.576+0000 7f0a7b13a700 1 -- start start 2021-10-21T00:07:59.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a74067a80 0x7f0a740635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a740b2170 0x7f0a740661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74065170 con 0x7f0a740af620 2021-10-21T00:07:59.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740aeff0 con 0x7f0a740b2170 2021-10-21T00:07:59.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74063ad0 con 0x7f0a74067a80 2021-10-21T00:07:59.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32946/0 (socket says 172.21.15.41:32946) 2021-10-21T00:07:59.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 -- 172.21.15.41:0/2005478499 learned_addr learned my addr 172.21.15.41:0/2005478499 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7a138700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a74067a80 0x7f0a740635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7a939700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a740b2170 0x7f0a740661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 -- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a74067a80 msgr2=0x7f0a740635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a74067a80 0x7f0a740635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 -- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a740b2170 msgr2=0x7f0a740661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a740b2170 0x7f0a740661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 -- 172.21.15.41:0/2005478499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009470 con 0x7f0a740af620 2021-10-21T00:07:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a79937700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0a740aafa0 tx=0x7f0a70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a700032f0 con 0x7f0a740af620 2021-10-21T00:07:59.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7001f3f0 con 0x7f0a740af620 2021-10-21T00:07:59.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a7001f750 con 0x7f0a740af620 2021-10-21T00:07:59.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740674f0 con 0x7f0a740af620 2021-10-21T00:07:59.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.580+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a74156fc0 con 0x7f0a740af620 2021-10-21T00:07:59.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a741571c0 con 0x7f0a740af620 2021-10-21T00:07:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a7000f070 con 0x7f0a740af620 2021-10-21T00:07:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a637fe700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 0x7f0a54055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0a7006c170 con 0x7f0a740af620 2021-10-21T00:07:59.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a7a138700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 0x7f0a54055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.584+0000 7f0a7a138700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 0x7f0a54055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f0a6400d000 tx=0x7f0a64007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.588+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a70043490 con 0x7f0a740af620 2021-10-21T00:07:59.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.716+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a740b12d0 con 0x7f0a740af620 2021-10-21T00:07:59.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.716+0000 7f0a637fe700 1 -- 172.21.15.41:0/2005478499 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0a700240a0 con 0x7f0a740af620 2021-10-21T00:07:59.724 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:07:59.725 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:07:59.725 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:59.725 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:07:59.725 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:07:59.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:07:59.726 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:07:59.726 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:07:59.726 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:07:59.727 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:07:59.727 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:07:59.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 msgr2=0x7f0a54055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 0x7f0a54055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f0a6400d000 tx=0x7f0a64007b90).stop 2021-10-21T00:07:59.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 msgr2=0x7f0a740adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0a740aafa0 tx=0x7f0a70016000).stop 2021-10-21T00:07:59.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 shutdown_connections 2021-10-21T00:07:59.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a54053640 0x7f0a54055b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a740b2170 0x7f0a740661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a740af620 0x7f0a740adf90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 --2- 172.21.15.41:0/2005478499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a74067a80 0x7f0a740635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 >> 172.21.15.41:0/2005478499 conn(0x7f0a740b5700 msgr2=0x7f0a74149270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 shutdown_connections 2021-10-21T00:07:59.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.720+0000 7f0a7b13a700 1 -- 172.21.15.41:0/2005478499 wait complete. 2021-10-21T00:07:59.738 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:07:59.738 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:07:59.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.840+0000 7f6282f5e700 1 Processor -- start 2021-10-21T00:07:59.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 -- start start 2021-10-21T00:07:59.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f627c0b9b10 0x7f627c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f627c142ce0 0x7f627c143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0b4120 con 0x7f627c0b0ac0 2021-10-21T00:07:59.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0b46e0 con 0x7f627c0b9b10 2021-10-21T00:07:59.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0b4980 con 0x7f627c142ce0 2021-10-21T00:07:59.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f627c0b9b10 0x7f627c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f62814fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f627c142ce0 0x7f627c143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f627c0b9b10 0x7f627c146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32954/0 (socket says 172.21.15.41:32954) 2021-10-21T00:07:59.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 -- 172.21.15.41:0/4038588962 learned_addr learned my addr 172.21.15.41:0/4038588962 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 -- 172.21.15.41:0/4038588962 >> v2:172.21.15.62:3300/0 conn(0x7f627c142ce0 msgr2=0x7f627c143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:07:59.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 --2- 172.21.15.41:0/4038588962 >> v2:172.21.15.62:3300/0 conn(0x7f627c142ce0 0x7f627c143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 -- 172.21.15.41:0/4038588962 >> v1:172.21.15.62:6789/0 conn(0x7f627c0b0ac0 legacy=0x7f627c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 -- 172.21.15.41:0/4038588962 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0b5530 con 0x7f627c0b9b10 2021-10-21T00:07:59.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6280cfa700 1 --2- 172.21.15.41:0/4038588962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b9b10 0x7f627c146d30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264006eb0).ready entity=mon.0 client_cookie=7103fa0fb41df326 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f627b7fe700 1 -- 172.21.15.41:0/4038588962 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626400d5c0 con 0x7f627c0b9b10 2021-10-21T00:07:59.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f627b7fe700 1 -- 172.21.15.41:0/4038588962 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264000e90 con 0x7f627c0b9b10 2021-10-21T00:07:59.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f627b7fe700 1 -- 172.21.15.41:0/4038588962 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f626400d950 con 0x7f627c0b9b10 2021-10-21T00:07:59.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 -- 172.21.15.41:0/4038588962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b9b10 msgr2=0x7f627c146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.844+0000 7f6282f5e700 1 --2- 172.21.15.41:0/4038588962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b9b10 0x7f627c146d30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264006eb0).stop 2021-10-21T00:07:59.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 -- 172.21.15.41:0/4038588962 shutdown_connections 2021-10-21T00:07:59.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 --2- 172.21.15.41:0/4038588962 >> v2:172.21.15.62:3300/0 conn(0x7f627c142ce0 0x7f627c143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 --2- 172.21.15.41:0/4038588962 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b9b10 0x7f627c146d30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 -- 172.21.15.41:0/4038588962 >> 172.21.15.41:0/4038588962 conn(0x7f627c062ec0 msgr2=0x7f627c0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:07:59.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 -- 172.21.15.41:0/4038588962 shutdown_connections 2021-10-21T00:07:59.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 -- 172.21.15.41:0/4038588962 wait complete. 2021-10-21T00:07:59.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 Processor -- start 2021-10-21T00:07:59.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.848+0000 7f6282f5e700 1 -- start start 2021-10-21T00:07:59.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 0x7f627c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 0x7f627c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c156950 con 0x7f627c0b0ac0 2021-10-21T00:07:59.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c156410 con 0x7f627c142ce0 2021-10-21T00:07:59.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c1566b0 con 0x7f627c0b9b10 2021-10-21T00:07:59.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32958/0 (socket says 172.21.15.41:32958) 2021-10-21T00:07:59.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 -- 172.21.15.41:0/3770185961 learned_addr learned my addr 172.21.15.41:0/3770185961 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:07:59.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f627bfff700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 0x7f627c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f62814fb700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 0x7f627c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 -- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 msgr2=0x7f627c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 0x7f627c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 -- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 msgr2=0x7f627c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:07:59.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 0x7f627c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:07:59.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 -- 172.21.15.41:0/3770185961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626400b1e0 con 0x7f627c0b0ac0 2021-10-21T00:07:59.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f627bfff700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 0x7f627c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:59.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f62814fb700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 0x7f627c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:07:59.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6280cfa700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6264011860 con 0x7f627c0b0ac0 2021-10-21T00:07:59.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640119c0 con 0x7f627c0b0ac0 2021-10-21T00:07:59.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c1124c0 con 0x7f627c0b0ac0 2021-10-21T00:07:59.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6264011d20 con 0x7f627c0b0ac0 2021-10-21T00:07:59.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c156030 con 0x7f627c0b0ac0 2021-10-21T00:07:59.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.852+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c113820 con 0x7f627c0b0ac0 2021-10-21T00:07:59.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.856+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6264025030 con 0x7f627c0b0ac0 2021-10-21T00:07:59.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.856+0000 7f6279ffb700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:07:59.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.856+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f626406c7f0 con 0x7f627c0b0ac0 2021-10-21T00:07:59.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.856+0000 7f627bfff700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:07:59.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.856+0000 7f627bfff700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 0x7f6260055b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f626c00b000 tx=0x7f626c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:07:59.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.860+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6264043c80 con 0x7f627c0b0ac0 2021-10-21T00:07:59.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:07:59.988+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f627c057350 con 0x7f627c0b0ac0 2021-10-21T00:08:00.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.272+0000 7f6279ffb700 1 -- 172.21.15.41:0/3770185961 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v55) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6264023070 con 0x7f627c0b0ac0 2021-10-21T00:08:00.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 msgr2=0x7f6260055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 0x7f6260055b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f626c00b000 tx=0x7f626c009040).stop 2021-10-21T00:08:00.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 msgr2=0x7f627c113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f6264002f70 tx=0x7f6264015000).stop 2021-10-21T00:08:00.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 shutdown_connections 2021-10-21T00:08:00.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f62600536a0 0x7f6260055b60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627c142ce0 0x7f627c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f627c0b9b10 0x7f627c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 --2- 172.21.15.41:0/3770185961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f627c0b0ac0 0x7f627c113b00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 >> 172.21.15.41:0/3770185961 conn(0x7f627c062ec0 msgr2=0x7f627c142090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:00.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 shutdown_connections 2021-10-21T00:08:00.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.276+0000 7f6282f5e700 1 -- 172.21.15.41:0/3770185961 wait complete. 2021-10-21T00:08:00.287 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:08:00.299 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:08:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.400+0000 7f1e0759e700 1 Processor -- start 2021-10-21T00:08:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.400+0000 7f1e0759e700 1 -- start start 2021-10-21T00:08:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1e080b5f70 0x7f1e080b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 0x7f1e0813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080b6350 con 0x7f1e081423a0 2021-10-21T00:08:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080b0e10 con 0x7f1e080b5f70 2021-10-21T00:08:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080b10b0 con 0x7f1e08067a00 2021-10-21T00:08:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e05d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1e081423a0 0x7f1e080672f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58970/0 (socket says 172.21.15.41:58970) 2021-10-21T00:08:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e05d9b700 1 -- 172.21.15.41:0/1291246645 learned_addr learned my addr 172.21.15.41:0/1291246645 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 --2- 172.21.15.41:0/1291246645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 0x7f1e0813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0659c700 1 --2- 172.21.15.41:0/1291246645 >> v2:172.21.15.62:3300/0 conn(0x7f1e080b5f70 0x7f1e080b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0559a700 1 -- 172.21.15.41:0/1291246645 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915584947 0 0) 0x7f1e080b6350 con 0x7f1e081423a0 2021-10-21T00:08:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0559a700 1 -- 172.21.15.41:0/1291246645 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003260 con 0x7f1e081423a0 2021-10-21T00:08:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 -- 172.21.15.41:0/1291246645 >> v2:172.21.15.62:3300/0 conn(0x7f1e080b5f70 msgr2=0x7f1e080b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 --2- 172.21.15.41:0/1291246645 >> v2:172.21.15.62:3300/0 conn(0x7f1e080b5f70 0x7f1e080b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 -- 172.21.15.41:0/1291246645 >> v1:172.21.15.41:6789/0 conn(0x7f1e081423a0 legacy=0x7f1e080672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 -- 172.21.15.41:0/1291246645 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080b1350 con 0x7f1e08067a00 2021-10-21T00:08:00.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e06d9d700 1 --2- 172.21.15.41:0/1291246645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 0x7f1e0813ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1e000032f0 tx=0x7f1e000091d0).ready entity=mon.2 client_cookie=fda417f449b7f45 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0559a700 1 -- 172.21.15.41:0/1291246645 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0000b600 con 0x7f1e08067a00 2021-10-21T00:08:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0559a700 1 -- 172.21.15.41:0/1291246645 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000b760 con 0x7f1e08067a00 2021-10-21T00:08:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.404+0000 7f1e0559a700 1 -- 172.21.15.41:0/1291246645 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0000b8d0 con 0x7f1e08067a00 2021-10-21T00:08:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- 172.21.15.41:0/1291246645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 msgr2=0x7f1e0813ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- 172.21.15.41:0/1291246645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 0x7f1e0813ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1e000032f0 tx=0x7f1e000091d0).stop 2021-10-21T00:08:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- 172.21.15.41:0/1291246645 shutdown_connections 2021-10-21T00:08:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- 172.21.15.41:0/1291246645 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e08067a00 0x7f1e0813ee00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- 172.21.15.41:0/1291246645 >> v2:172.21.15.62:3300/0 conn(0x7f1e080b5f70 0x7f1e080b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- 172.21.15.41:0/1291246645 >> 172.21.15.41:0/1291246645 conn(0x7f1e080639f0 msgr2=0x7f1e080b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- 172.21.15.41:0/1291246645 shutdown_connections 2021-10-21T00:08:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- 172.21.15.41:0/1291246645 wait complete. 2021-10-21T00:08:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 Processor -- start 2021-10-21T00:08:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- start start 2021-10-21T00:08:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e080b5f70 0x7f1e08066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e081423a0 0x7f1e0813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0813a930 con 0x7f1e08067a00 2021-10-21T00:08:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081402a0 con 0x7f1e080b5f70 2021-10-21T00:08:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08150800 con 0x7f1e081423a0 2021-10-21T00:08:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32972/0 (socket says 172.21.15.41:32972) 2021-10-21T00:08:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 -- 172.21.15.41:0/3687809349 learned_addr learned my addr 172.21.15.41:0/3687809349 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e05d9b700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e080b5f70 0x7f1e08066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e06d9d700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e081423a0 0x7f1e0813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 -- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e081423a0 msgr2=0x7f1e0813ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e081423a0 0x7f1e0813ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 -- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e080b5f70 msgr2=0x7f1e08066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e080b5f70 0x7f1e08066460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.408+0000 7f1e0659c700 1 -- 172.21.15.41:0/3687809349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009470 con 0x7f1e08067a00 2021-10-21T00:08:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1e0659c700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1df800c000 tx=0x7f1df8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df8010780 con 0x7f1e08067a00 2021-10-21T00:08:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80108e0 con 0x7f1e08067a00 2021-10-21T00:08:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e08150aa0 con 0x7f1e08067a00 2021-10-21T00:08:00.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df8010c40 con 0x7f1e08067a00 2021-10-21T00:08:00.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e08141d80 con 0x7f1e08067a00 2021-10-21T00:08:00.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e08150660 con 0x7f1e08067a00 2021-10-21T00:08:00.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1df801c460 con 0x7f1e08067a00 2021-10-21T00:08:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.412+0000 7f1df77fe700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 0x7f1de4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.416+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f1df806bc80 con 0x7f1e08067a00 2021-10-21T00:08:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.416+0000 7f1e05d9b700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 0x7f1de4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:00.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.416+0000 7f1e05d9b700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 0x7f1de4055ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f1dfc00d000 tx=0x7f1dfc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:00.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.420+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e08150660 con 0x7f1e08067a00 2021-10-21T00:08:00.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:00.548+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f1e08150660 con 0x7f1e08067a00 2021-10-21T00:08:01.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.256+0000 7f1df77fe700 1 -- 172.21.15.41:0/3687809349 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v56) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1e08150660 con 0x7f1e08067a00 2021-10-21T00:08:01.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.260+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 msgr2=0x7f1de4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.260+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 0x7f1de4055ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f1dfc00d000 tx=0x7f1dfc009040).stop 2021-10-21T00:08:01.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.260+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 msgr2=0x7f1e0813e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.260+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1df800c000 tx=0x7f1df8006df0).stop 2021-10-21T00:08:01.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 shutdown_connections 2021-10-21T00:08:01.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1de4053610 0x7f1de4055ad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e081423a0 0x7f1e0813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e080b5f70 0x7f1e08066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 --2- 172.21.15.41:0/3687809349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1e08067a00 0x7f1e0813e560 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 >> 172.21.15.41:0/3687809349 conn(0x7f1e080639f0 msgr2=0x7f1e080b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 shutdown_connections 2021-10-21T00:08:01.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.264+0000 7f1e0759e700 1 -- 172.21.15.41:0/3687809349 wait complete. 2021-10-21T00:08:01.272 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:08:01.282 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:08:01.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.384+0000 7fec86f84700 1 Processor -- start 2021-10-21T00:08:01.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.384+0000 7fec86f84700 1 -- start start 2021-10-21T00:08:01.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.384+0000 7fec86f84700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec800b1fd0 0x7fec8005ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec80146ca0 con 0x7fec800ab600 2021-10-21T00:08:01.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800abaa0 con 0x7fec800b0d20 2021-10-21T00:08:01.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8005f7c0 con 0x7fec800b1fd0 2021-10-21T00:08:01.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85781700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fec800ab600 0x7fec80145e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:58984/0 (socket says 172.21.15.41:58984) 2021-10-21T00:08:01.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85781700 1 -- 172.21.15.41:0/2428878556 learned_addr learned my addr 172.21.15.41:0/2428878556 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:01.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85f82700 1 --2- 172.21.15.41:0/2428878556 >> v2:172.21.15.62:3300/0 conn(0x7fec800b1fd0 0x7fec8005ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192404920 0 0) 0x7fec80146ca0 con 0x7fec800ab600 2021-10-21T00:08:01.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec68003260 con 0x7fec800ab600 2021-10-21T00:08:01.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85f82700 1 -- 172.21.15.41:0/2428878556 >> v1:172.21.15.62:6789/0 conn(0x7fec800b0d20 legacy=0x7fec80146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 391562645 0 0) 0x7fec68003260 con 0x7fec800ab600 2021-10-21T00:08:01.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85f82700 1 -- 172.21.15.41:0/2428878556 >> v1:172.21.15.41:6789/0 conn(0x7fec800ab600 legacy=0x7fec80145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85f82700 1 -- 172.21.15.41:0/2428878556 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8005fa60 con 0x7fec800b1fd0 2021-10-21T00:08:01.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec85f82700 1 --2- 172.21.15.41:0/2428878556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800b1fd0 0x7fec8005ff00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fec7c001800 tx=0x7fec70006df0).ready entity=mon.1 client_cookie=f72abaaecfe55341 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c001660 con 0x7fec800b1fd0 2021-10-21T00:08:01.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec70000e90 con 0x7fec800b1fd0 2021-10-21T00:08:01.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec84f80700 1 -- 172.21.15.41:0/2428878556 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7000d4f0 con 0x7fec800b1fd0 2021-10-21T00:08:01.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- 172.21.15.41:0/2428878556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800b1fd0 msgr2=0x7fec8005ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 --2- 172.21.15.41:0/2428878556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800b1fd0 0x7fec8005ff00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fec7c001800 tx=0x7fec70006df0).stop 2021-10-21T00:08:01.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- 172.21.15.41:0/2428878556 shutdown_connections 2021-10-21T00:08:01.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 --2- 172.21.15.41:0/2428878556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800b1fd0 0x7fec8005ff00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- 172.21.15.41:0/2428878556 >> 172.21.15.41:0/2428878556 conn(0x7fec800b5700 msgr2=0x7fec800b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- 172.21.15.41:0/2428878556 shutdown_connections 2021-10-21T00:08:01.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.388+0000 7fec86f84700 1 -- 172.21.15.41:0/2428878556 wait complete. 2021-10-21T00:08:01.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 Processor -- start 2021-10-21T00:08:01.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- start start 2021-10-21T00:08:01.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800ab600 0x7fec800ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec800b1fd0 0x7fec80090540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800ac9b0 con 0x7fec800b0d20 2021-10-21T00:08:01.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80152660 con 0x7fec800ab600 2021-10-21T00:08:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80152900 con 0x7fec800b1fd0 2021-10-21T00:08:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:32988/0 (socket says 172.21.15.41:32988) 2021-10-21T00:08:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 -- 172.21.15.41:0/1314627412 learned_addr learned my addr 172.21.15.41:0/1314627412 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85f82700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800ab600 0x7fec800ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86783700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec800b1fd0 0x7fec80090540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 -- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec800b1fd0 msgr2=0x7fec80090540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec800b1fd0 0x7fec80090540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 -- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800ab600 msgr2=0x7fec800ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800ab600 0x7fec800ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 -- 172.21.15.41:0/1314627412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7000b180 con 0x7fec800b0d20 2021-10-21T00:08:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec85781700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fec7c0018c0 tx=0x7fec7c001e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c007170 con 0x7fec800b0d20 2021-10-21T00:08:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0072d0 con 0x7fec800b0d20 2021-10-21T00:08:01.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80152ba0 con 0x7fec800b0d20 2021-10-21T00:08:01.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c004710 con 0x7fec800b0d20 2021-10-21T00:08:01.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.392+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec80099cf0 con 0x7fec800b0d20 2021-10-21T00:08:01.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.396+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80152d30 con 0x7fec800b0d20 2021-10-21T00:08:01.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.396+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec7c01b070 con 0x7fec800b0d20 2021-10-21T00:08:01.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.396+0000 7fec6effd700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 0x7fec60055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.396+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fec7c06ae90 con 0x7fec800b0d20 2021-10-21T00:08:01.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.396+0000 7fec85f82700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 0x7fec60055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.400+0000 7fec85f82700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 0x7fec60055b60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fec7001a000 tx=0x7fec70014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.404+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec7c042060 con 0x7fec800b0d20 2021-10-21T00:08:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.572+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fec80142d60 con 0x7fec800b0d20 2021-10-21T00:08:01.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.580+0000 7fec6effd700 1 -- 172.21.15.41:0/1314627412 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v26) v1 ==== 189+0+0 (secure 0 0 0) 0x7fec7c045680 con 0x7fec800b0d20 2021-10-21T00:08:01.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 msgr2=0x7fec60055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 0x7fec60055b60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fec7001a000 tx=0x7fec70014000).stop 2021-10-21T00:08:01.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 msgr2=0x7fec80090050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fec7c0018c0 tx=0x7fec7c001e60).stop 2021-10-21T00:08:01.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 shutdown_connections 2021-10-21T00:08:01.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec600536a0 0x7fec60055b60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec800b1fd0 0x7fec80090540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec800b0d20 0x7fec80090050 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 --2- 172.21.15.41:0/1314627412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec800ab600 0x7fec800ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 >> 172.21.15.41:0/1314627412 conn(0x7fec800b5700 msgr2=0x7fec80140170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 shutdown_connections 2021-10-21T00:08:01.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.584+0000 7fec86f84700 1 -- 172.21.15.41:0/1314627412 wait complete. 2021-10-21T00:08:01.595 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 11 and data pool 12 2021-10-21T00:08:01.607 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:01.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 Processor -- start 2021-10-21T00:08:01.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 -- start start 2021-10-21T00:08:01.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43200b2170 0x7f43200ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200b0b50 con 0x7f43200af620 2021-10-21T00:08:01.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200b2550 con 0x7f4320067a80 2021-10-21T00:08:01.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f4324cbc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43200b0d90 con 0x7f43200b2170 2021-10-21T00:08:01.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431effd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f43200af620 0x7f43200ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59012/0 (socket says 172.21.15.41:59012) 2021-10-21T00:08:01.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431effd700 1 -- 172.21.15.41:0/1815928783 learned_addr learned my addr 172.21.15.41:0/1815928783 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:01.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431f7fe700 1 --2- 172.21.15.41:0/1815928783 >> v2:172.21.15.62:3300/0 conn(0x7f43200b2170 0x7f43200ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259477836 0 0) 0x7f4318001490 con 0x7f43200af620 2021-10-21T00:08:01.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4300003260 con 0x7f43200af620 2021-10-21T00:08:01.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333416080 0 0) 0x7f4300003260 con 0x7f43200af620 2021-10-21T00:08:01.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 >> v2:172.21.15.62:3300/0 conn(0x7f43200b2170 msgr2=0x7f43200ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:01.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 --2- 172.21.15.41:0/1815928783 >> v2:172.21.15.62:3300/0 conn(0x7f43200b2170 0x7f43200ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 >> v1:172.21.15.62:6789/0 conn(0x7f4320067a80 legacy=0x7f4320149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200b1030 con 0x7f43200af620 2021-10-21T00:08:01.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f4318001b70 con 0x7f43200af620 2021-10-21T00:08:01.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 >> v1:172.21.15.41:6789/0 conn(0x7f43200af620 legacy=0x7f43200ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300003750 0x7f4300003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4300004500 0x7f4300004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 0x7f430000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200b0d90 con 0x7f4300004e70 2021-10-21T00:08:01.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430000bd20 con 0x7f4300003750 2021-10-21T00:08:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430000bee0 con 0x7f4300004500 2021-10-21T00:08:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 0x7f430000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431f7fe700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300003750 0x7f4300003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431effd700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4300004500 0x7f4300004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 -- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4300004500 msgr2=0x7f4300004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4300004500 0x7f4300004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 -- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300003750 msgr2=0x7f4300003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:01.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300003750 0x7f4300003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 -- 172.21.15.41:0/1815928783 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300003260 con 0x7f4300004e70 2021-10-21T00:08:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431f7fe700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300003750 0x7f4300003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 -- 172.21.15.41:0/1815928783 reap_dead start 2021-10-21T00:08:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.696+0000 7f431ffff700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 0x7f430000b750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f4320062740 tx=0x7f4310007a00).ready entity=mon.0 client_cookie=8d68346732f2375d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4310007030 con 0x7f4300004e70 2021-10-21T00:08:01.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310007190 con 0x7f4300004e70 2021-10-21T00:08:01.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431e7fc700 1 -- 172.21.15.41:0/1815928783 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4310006510 con 0x7f4300004e70 2021-10-21T00:08:01.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 msgr2=0x7f430000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 0x7f430000b750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f4320062740 tx=0x7f4310007a00).stop 2021-10-21T00:08:01.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- 172.21.15.41:0/1815928783 shutdown_connections 2021-10-21T00:08:01.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 --2- 172.21.15.41:0/1815928783 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4300004e70 0x7f430000b750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- 172.21.15.41:0/1815928783 >> 172.21.15.41:0/1815928783 conn(0x7f43200b5700 msgr2=0x7f43200b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- 172.21.15.41:0/1815928783 shutdown_connections 2021-10-21T00:08:01.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- 172.21.15.41:0/1815928783 wait complete. 2021-10-21T00:08:01.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 Processor -- start 2021-10-21T00:08:01.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- start start 2021-10-21T00:08:01.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300004e70 0x7f4320146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43200ac0c0 0x7f4320156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200ac6b0 con 0x7f43200adc20 2021-10-21T00:08:01.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200ad7c0 con 0x7f4300004e70 2021-10-21T00:08:01.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f4324cbc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4320157110 con 0x7f43200ac0c0 2021-10-21T00:08:01.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33022/0 (socket says 172.21.15.41:33022) 2021-10-21T00:08:01.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 -- 172.21.15.41:0/4069768453 learned_addr learned my addr 172.21.15.41:0/4069768453 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:01.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431effd700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43200ac0c0 0x7f4320156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431f7fe700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300004e70 0x7f4320146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 -- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43200ac0c0 msgr2=0x7f4320156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43200ac0c0 0x7f4320156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 -- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300004e70 msgr2=0x7f4320146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.700+0000 7f431ffff700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300004e70 0x7f4320146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431ffff700 1 -- 172.21.15.41:0/4069768453 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43201573b0 con 0x7f43200adc20 2021-10-21T00:08:01.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431ffff700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4320062740 tx=0x7f4310015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4310013640 con 0x7f43200adc20 2021-10-21T00:08:01.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43100137a0 con 0x7f43200adc20 2021-10-21T00:08:01.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4320156e20 con 0x7f43200adc20 2021-10-21T00:08:01.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4310013b00 con 0x7f43200adc20 2021-10-21T00:08:01.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43200aca20 con 0x7f43200adc20 2021-10-21T00:08:01.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43200b12d0 con 0x7f43200adc20 2021-10-21T00:08:01.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4310027070 con 0x7f43200adc20 2021-10-21T00:08:01.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 0x7f43040559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f431006c080 con 0x7f43200adc20 2021-10-21T00:08:01.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.704+0000 7f431f7fe700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 0x7f43040559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.708+0000 7f431f7fe700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 0x7f43040559e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f430800b000 tx=0x7f4308008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.708+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43100431e0 con 0x7f43200adc20 2021-10-21T00:08:01.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.836+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4320057350 con 0x7f43200adc20 2021-10-21T00:08:01.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.836+0000 7f431cff9700 1 -- 172.21.15.41:0/4069768453 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f4310046800 con 0x7f43200adc20 2021-10-21T00:08:01.844 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:01.845 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":58,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:01.577428+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:00.049644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:00.609917+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 msgr2=0x7f43040559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 0x7f43040559e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f430800b000 tx=0x7f4308008040).stop 2021-10-21T00:08:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 msgr2=0x7f43200ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4320062740 tx=0x7f4310015000).stop 2021-10-21T00:08:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 shutdown_connections 2021-10-21T00:08:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4304053520 0x7f43040559e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f43200adc20 0x7f43200ae0d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43200ac0c0 0x7f4320156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 --2- 172.21.15.41:0/4069768453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4300004e70 0x7f4320146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 >> 172.21.15.41:0/4069768453 conn(0x7f43200b5700 msgr2=0x7f43201499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 shutdown_connections 2021-10-21T00:08:01.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.840+0000 7f4324cbc700 1 -- 172.21.15.41:0/4069768453 wait complete. 2021-10-21T00:08:01.858 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:01.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 Processor -- start 2021-10-21T00:08:01.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 -- start start 2021-10-21T00:08:01.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78dc05f9f0 0x7f78dc14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc0609d0 con 0x7f78dc0aa750 2021-10-21T00:08:01.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78dc0b1620 con 0x7f78dc05f9f0 2021-10-21T00:08:01.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc05fdd0 con 0x7f78dc14b350 2021-10-21T00:08:01.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78dc05f9f0 0x7f78dc14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e2485700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1483700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f78dc0aa750 0x7f78dc14ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:38856/0 (socket says 172.21.15.41:38856) 2021-10-21T00:08:01.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1483700 1 -- 172.21.15.41:0/2983173325 learned_addr learned my addr 172.21.15.41:0/2983173325 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:01.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e0c82700 1 -- 172.21.15.41:0/2983173325 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249944807 0 0) 0x7f78dc0609d0 con 0x7f78dc0aa750 2021-10-21T00:08:01.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e0c82700 1 -- 172.21.15.41:0/2983173325 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003260 con 0x7f78dc0aa750 2021-10-21T00:08:01.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 -- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 msgr2=0x7f78dc0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:01.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 --2- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 -- 172.21.15.41:0/2983173325 >> v1:172.21.15.62:6789/0 conn(0x7f78dc0aa750 legacy=0x7f78dc14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 -- 172.21.15.41:0/2983173325 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0b1380 con 0x7f78dc05f9f0 2021-10-21T00:08:01.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e1c84700 1 --2- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc05f9f0 0x7f78dc14a750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f78d0002f70 tx=0x7f78d0006df0).ready entity=mon.1 client_cookie=3f5cb4384105c620 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e0c82700 1 -- 172.21.15.41:0/2983173325 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d000d4a0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e0c82700 1 -- 172.21.15.41:0/2983173325 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d0000e90 con 0x7f78dc05f9f0 2021-10-21T00:08:01.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e0c82700 1 -- 172.21.15.41:0/2983173325 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d000d7f0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 -- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc05f9f0 msgr2=0x7f78dc14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.956+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc05f9f0 0x7f78dc14a750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f78d0002f70 tx=0x7f78d0006df0).stop 2021-10-21T00:08:01.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- 172.21.15.41:0/2983173325 shutdown_connections 2021-10-21T00:08:01.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/2983173325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc05f9f0 0x7f78dc14a750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- 172.21.15.41:0/2983173325 >> 172.21.15.41:0/2983173325 conn(0x7f78dc05bca0 msgr2=0x7f78dc05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:01.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- 172.21.15.41:0/2983173325 shutdown_connections 2021-10-21T00:08:01.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- 172.21.15.41:0/2983173325 wait complete. 2021-10-21T00:08:01.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 Processor -- start 2021-10-21T00:08:01.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- start start 2021-10-21T00:08:01.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc0aa750 0x7f78dc146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc062690 con 0x7f78dc05f9f0 2021-10-21T00:08:01.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc062930 con 0x7f78dc0aa750 2021-10-21T00:08:01.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e3ee8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc062bd0 con 0x7f78dc14b350 2021-10-21T00:08:01.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e2485700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33034/0 (socket says 172.21.15.41:33034) 2021-10-21T00:08:01.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1483700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc0aa750 0x7f78dc146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 -- 172.21.15.41:0/190256385 learned_addr learned my addr 172.21.15.41:0/190256385 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:01.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 -- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 msgr2=0x7f78dc146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 -- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc0aa750 msgr2=0x7f78dc146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:01.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc0aa750 0x7f78dc146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:01.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 -- 172.21.15.41:0/190256385 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d000b180 con 0x7f78dc05f9f0 2021-10-21T00:08:01.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e2485700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:01.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.960+0000 7f78e1c84700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f78d0002f70 tx=0x7f78d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d0016070 con 0x7f78dc05f9f0 2021-10-21T00:08:01.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d00138d0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc062e70 con 0x7f78dc05f9f0 2021-10-21T00:08:01.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d0013c30 con 0x7f78dc05f9f0 2021-10-21T00:08:01.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc0ad6b0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78dc0678f0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78d0025030 con 0x7f78dc05f9f0 2021-10-21T00:08:01.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 0x7f78c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:01.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78d006c8e0 con 0x7f78dc05f9f0 2021-10-21T00:08:01.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.964+0000 7f78e1483700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 0x7f78c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:01.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.968+0000 7f78e1483700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 0x7f78c4055a40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f78d400d000 tx=0x7f78d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:01.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:01.968+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78d0043a40 con 0x7f78dc05f9f0 2021-10-21T00:08:02.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.096+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78dc057350 con 0x7f78dc05f9f0 2021-10-21T00:08:02.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.096+0000 7f78ceffd700 1 -- 172.21.15.41:0/190256385 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f78d0023090 con 0x7f78dc05f9f0 2021-10-21T00:08:02.104 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:02.104 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":58,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:01.577428+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:00.049644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:00.609917+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:02.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 msgr2=0x7f78c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 0x7f78c4055a40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f78d400d000 tx=0x7f78d4009040).stop 2021-10-21T00:08:02.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 msgr2=0x7f78dc0b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f78d0002f70 tx=0x7f78d0014000).stop 2021-10-21T00:08:02.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 shutdown_connections 2021-10-21T00:08:02.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78c4053580 0x7f78c4055a40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78dc14b350 0x7f78dc146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78dc0aa750 0x7f78dc146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 --2- 172.21.15.41:0/190256385 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78dc05f9f0 0x7f78dc0b1760 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 >> 172.21.15.41:0/190256385 conn(0x7f78dc05bca0 msgr2=0x7f78dc147ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:02.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 shutdown_connections 2021-10-21T00:08:02.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.100+0000 7f78e3ee8700 1 -- 172.21.15.41:0/190256385 wait complete. 2021-10-21T00:08:02.118 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:08:02.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 Processor -- start 2021-10-21T00:08:02.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- start start 2021-10-21T00:08:02.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980b2170 0x7f3a980ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a980af620 0x7f3a980ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a980b0b50 con 0x7f3a980abb50 2021-10-21T00:08:02.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a980b2550 con 0x7f3a980af620 2021-10-21T00:08:02.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980b0d90 con 0x7f3a980b2170 2021-10-21T00:08:02.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a980af620 0x7f3a980ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3a980af620 0x7f3a980ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33042/0 (socket says 172.21.15.41:33042) 2021-10-21T00:08:02.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 -- 172.21.15.41:0/2513317568 learned_addr learned my addr 172.21.15.41:0/2513317568 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:02.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9659c700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980b2170 0x7f3a980ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 -- 172.21.15.41:0/2513317568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980b2170 msgr2=0x7f3a980ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:02.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980b2170 0x7f3a980ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 -- 172.21.15.41:0/2513317568 >> v1:172.21.15.41:6789/0 conn(0x7f3a980abb50 legacy=0x7f3a9814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 -- 172.21.15.41:0/2513317568 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980b1030 con 0x7f3a980af620 2021-10-21T00:08:02.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a95d9b700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980af620 0x7f3a980ab660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f3a88002f70 tx=0x7f3a88006eb0).ready entity=mon.0 client_cookie=4b259e0e78c26f5f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9559a700 1 -- 172.21.15.41:0/2513317568 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8800d5c0 con 0x7f3a980af620 2021-10-21T00:08:02.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9559a700 1 -- 172.21.15.41:0/2513317568 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88000e90 con 0x7f3a980af620 2021-10-21T00:08:02.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9559a700 1 -- 172.21.15.41:0/2513317568 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8800d950 con 0x7f3a980af620 2021-10-21T00:08:02.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- 172.21.15.41:0/2513317568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980af620 msgr2=0x7f3a980ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980af620 0x7f3a980ab660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f3a88002f70 tx=0x7f3a88006eb0).stop 2021-10-21T00:08:02.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- 172.21.15.41:0/2513317568 shutdown_connections 2021-10-21T00:08:02.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980af620 0x7f3a980ab660 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 --2- 172.21.15.41:0/2513317568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980b2170 0x7f3a980ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- 172.21.15.41:0/2513317568 >> 172.21.15.41:0/2513317568 conn(0x7f3a980b5700 msgr2=0x7f3a980b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:02.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- 172.21.15.41:0/2513317568 shutdown_connections 2021-10-21T00:08:02.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.220+0000 7f3a9759e700 1 -- 172.21.15.41:0/2513317568 wait complete. 2021-10-21T00:08:02.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 Processor -- start 2021-10-21T00:08:02.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- start start 2021-10-21T00:08:02.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980abb50 0x7f3a980ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a980af620 0x7f3a980acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a981469a0 con 0x7f3a980b2170 2021-10-21T00:08:02.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a981560d0 con 0x7f3a980af620 2021-10-21T00:08:02.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98146ff0 con 0x7f3a980abb50 2021-10-21T00:08:02.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33050/0 (socket says 172.21.15.41:33050) 2021-10-21T00:08:02.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 -- 172.21.15.41:0/3703670660 learned_addr learned my addr 172.21.15.41:0/3703670660 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:02.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9659c700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980abb50 0x7f3a980ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a95d9b700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a980af620 0x7f3a980acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 -- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980abb50 msgr2=0x7f3a980ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980abb50 0x7f3a980ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 -- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a980af620 msgr2=0x7f3a980acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a980af620 0x7f3a980acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 -- 172.21.15.41:0/3703670660 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8800b1e0 con 0x7f3a980b2170 2021-10-21T00:08:02.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a96d9d700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3a980aab80 tx=0x7f3a90007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9000f470 con 0x7f3a980b2170 2021-10-21T00:08:02.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000f5d0 con 0x7f3a980b2170 2021-10-21T00:08:02.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a980ad590 con 0x7f3a980b2170 2021-10-21T00:08:02.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a9000f930 con 0x7f3a980b2170 2021-10-21T00:08:02.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.224+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a980ae640 con 0x7f3a980b2170 2021-10-21T00:08:02.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a980ad3e0 con 0x7f3a980b2170 2021-10-21T00:08:02.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a90019030 con 0x7f3a980b2170 2021-10-21T00:08:02.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a8f7fe700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 0x7f3a7c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a9006af90 con 0x7f3a980b2170 2021-10-21T00:08:02.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a9659c700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 0x7f3a7c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.228+0000 7f3a9659c700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 0x7f3a7c055b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f3a8000c000 tx=0x7f3a80008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.236+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a900420f0 con 0x7f3a980b2170 2021-10-21T00:08:02.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.404+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3a980b0b50 con 0x7f3a980b2170 2021-10-21T00:08:02.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.584+0000 7f3a8f7fe700 1 -- 172.21.15.41:0/3703670660 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3a980b0b50 con 0x7f3a980b2170 2021-10-21T00:08:02.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 msgr2=0x7f3a7c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 0x7f3a7c055b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f3a8000c000 tx=0x7f3a80008040).stop 2021-10-21T00:08:02.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 msgr2=0x7f3a981426a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3a980aab80 tx=0x7f3a90007f50).stop 2021-10-21T00:08:02.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 shutdown_connections 2021-10-21T00:08:02.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3a7c0536d0 0x7f3a7c055b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3a980b2170 0x7f3a981426a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a980af620 0x7f3a980acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 --2- 172.21.15.41:0/3703670660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3a980abb50 0x7f3a980ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 >> 172.21.15.41:0/3703670660 conn(0x7f3a980b5700 msgr2=0x7f3a9805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:02.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 shutdown_connections 2021-10-21T00:08:02.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.588+0000 7f3a9759e700 1 -- 172.21.15.41:0/3703670660 wait complete. 2021-10-21T00:08:02.608 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:02.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 Processor -- start 2021-10-21T00:08:02.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 -- start start 2021-10-21T00:08:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 0x7faee40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 0x7faee40ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40b0b50 con 0x7faee40abb50 2021-10-21T00:08:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40b2550 con 0x7faee40b2170 2021-10-21T00:08:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee3fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40b0d90 con 0x7faee40af620 2021-10-21T00:08:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 0x7faee40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee2ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 0x7faee40ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33058/0 (socket says 172.21.15.41:33058) 2021-10-21T00:08:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee27fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 0x7faee40ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee2ffd700 1 -- 172.21.15.41:0/1832172403 learned_addr learned my addr 172.21.15.41:0/1832172403 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee27fc700 1 -- 172.21.15.41:0/1832172403 >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 msgr2=0x7faee40ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee27fc700 1 --2- 172.21.15.41:0/1832172403 >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 0x7faee40ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee27fc700 1 -- 172.21.15.41:0/1832172403 >> v1:172.21.15.62:6789/0 conn(0x7faee40abb50 legacy=0x7faee414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.708+0000 7faee27fc700 1 -- 172.21.15.41:0/1832172403 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40b1030 con 0x7faee40af620 2021-10-21T00:08:02.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee27fc700 1 --2- 172.21.15.41:0/1832172403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 0x7faee40ab660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7faed4002f70 tx=0x7faed4006df0).ready entity=mon.2 client_cookie=e715d111764e22bb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee1ffb700 1 -- 172.21.15.41:0/1832172403 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed400d570 con 0x7faee40af620 2021-10-21T00:08:02.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee1ffb700 1 -- 172.21.15.41:0/1832172403 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4000e90 con 0x7faee40af620 2021-10-21T00:08:02.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee1ffb700 1 -- 172.21.15.41:0/1832172403 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed400d8c0 con 0x7faee40af620 2021-10-21T00:08:02.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- 172.21.15.41:0/1832172403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 msgr2=0x7faee40ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 --2- 172.21.15.41:0/1832172403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 0x7faee40ab660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7faed4002f70 tx=0x7faed4006df0).stop 2021-10-21T00:08:02.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- 172.21.15.41:0/1832172403 shutdown_connections 2021-10-21T00:08:02.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 --2- 172.21.15.41:0/1832172403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40af620 0x7faee40ab660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 --2- 172.21.15.41:0/1832172403 >> v2:172.21.15.41:3300/0 conn(0x7faee40b2170 0x7faee40ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- 172.21.15.41:0/1832172403 >> 172.21.15.41:0/1832172403 conn(0x7faee40b5700 msgr2=0x7faee40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:02.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- 172.21.15.41:0/1832172403 shutdown_connections 2021-10-21T00:08:02.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- 172.21.15.41:0/1832172403 wait complete. 2021-10-21T00:08:02.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 Processor -- start 2021-10-21T00:08:02.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.712+0000 7faee3fff700 1 -- start start 2021-10-21T00:08:02.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faee40af620 0x7faee40ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40b2170 0x7faee40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4063cc0 con 0x7faee40abb50 2021-10-21T00:08:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4064d10 con 0x7faee40af620 2021-10-21T00:08:02.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40adb50 con 0x7faee40b2170 2021-10-21T00:08:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33062/0 (socket says 172.21.15.41:33062) 2021-10-21T00:08:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 -- 172.21.15.41:0/1280815099 learned_addr learned my addr 172.21.15.41:0/1280815099 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee27fc700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faee40af620 0x7faee40ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee37fe700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40b2170 0x7faee40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 -- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40b2170 msgr2=0x7faee40ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40b2170 0x7faee40ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 -- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faee40af620 msgr2=0x7faee40ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faee40af620 0x7faee40ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 -- 172.21.15.41:0/1280815099 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed400b180 con 0x7faee40abb50 2021-10-21T00:08:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee2ffd700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7faee4063e00 tx=0x7faed8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed8013610 con 0x7faee40abb50 2021-10-21T00:08:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8013770 con 0x7faee40abb50 2021-10-21T00:08:02.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee4064f40 con 0x7faee40abb50 2021-10-21T00:08:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed8013ad0 con 0x7faee40abb50 2021-10-21T00:08:02.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.716+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee40ac5b0 con 0x7faee40abb50 2021-10-21T00:08:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee40b12d0 con 0x7faee40abb50 2021-10-21T00:08:02.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faed8013c30 con 0x7faee40abb50 2021-10-21T00:08:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faed3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 0x7faec0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faed806b970 con 0x7faee40abb50 2021-10-21T00:08:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faee27fc700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 0x7faec0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:02.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.720+0000 7faee27fc700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 0x7faec0055b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7faed401a000 tx=0x7faed4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:02.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.728+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faed8042a30 con 0x7faee40abb50 2021-10-21T00:08:02.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faee4057350 con 0x7faee40abb50 2021-10-21T00:08:02.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faed3fff700 1 -- 172.21.15.41:0/1280815099 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7faed8046050 con 0x7faee40abb50 2021-10-21T00:08:02.902 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:02.903 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:02.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 msgr2=0x7faec0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 0x7faec0055b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7faed401a000 tx=0x7faed4014000).stop 2021-10-21T00:08:02.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 msgr2=0x7faee4147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:02.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7faee4063e00 tx=0x7faed8008040).stop 2021-10-21T00:08:02.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 shutdown_connections 2021-10-21T00:08:02.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faec00536a0 0x7faec0055b60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faee40b2170 0x7faee40ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faee40af620 0x7faee40ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 --2- 172.21.15.41:0/1280815099 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faee40abb50 0x7faee4147520 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:02.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 >> 172.21.15.41:0/1280815099 conn(0x7faee40b5700 msgr2=0x7faee405f840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:02.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 shutdown_connections 2021-10-21T00:08:02.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:02.896+0000 7faee3fff700 1 -- 172.21.15.41:0/1280815099 wait complete. 2021-10-21T00:08:02.908 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:02.916 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:03.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 Processor -- start 2021-10-21T00:08:03.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 -- start start 2021-10-21T00:08:03.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f566c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0b0b50 con 0x7f566c0af620 2021-10-21T00:08:03.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0b2550 con 0x7f566c067a80 2021-10-21T00:08:03.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0b0d90 con 0x7f566c0b2170 2021-10-21T00:08:03.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f5669d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f566c0af620 0x7f566c0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59072/0 (socket says 172.21.15.41:59072) 2021-10-21T00:08:03.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f5669d9b700 1 -- 172.21.15.41:0/4011418618 learned_addr learned my addr 172.21.15.41:0/4011418618 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:03.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566a59c700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f566c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325407257 0 0) 0x7f565c001490 con 0x7f566c0af620 2021-10-21T00:08:03.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5650003260 con 0x7f566c0af620 2021-10-21T00:08:03.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73703712 0 0) 0x7f5650003260 con 0x7f566c0af620 2021-10-21T00:08:03.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 msgr2=0x7f566c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f566c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 >> v1:172.21.15.62:6789/0 conn(0x7f566c067a80 legacy=0x7f566c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0b1030 con 0x7f566c0af620 2021-10-21T00:08:03.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f565c001b70 con 0x7f566c0af620 2021-10-21T00:08:03.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 >> v1:172.21.15.41:6789/0 conn(0x7f566c0af620 legacy=0x7f566c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5650003780 0x7f5650003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f5650004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500049f0 0x7f5650004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0b0d90 con 0x7f56500049f0 2021-10-21T00:08:03.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565000b780 con 0x7f5650003780 2021-10-21T00:08:03.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.012+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565000b940 con 0x7f566c0b2170 2021-10-21T00:08:03.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f5669d9b700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f5650004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566a59c700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5650003780 0x7f5650003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500049f0 0x7f5650004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 -- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 msgr2=0x7f5650004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c0b2170 0x7f5650004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 -- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5650003780 msgr2=0x7f5650003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5650003780 0x7f5650003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 -- 172.21.15.41:0/4011418618 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650003260 con 0x7f56500049f0 2021-10-21T00:08:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500049f0 0x7f5650004e70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f566c05d270 tx=0x7f5664007a00).ready entity=mon.0 client_cookie=6e74b482a61caec4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5664007d10 con 0x7f56500049f0 2021-10-21T00:08:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664007030 con 0x7f56500049f0 2021-10-21T00:08:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566959a700 1 -- 172.21.15.41:0/4011418618 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5664007390 con 0x7f56500049f0 2021-10-21T00:08:03.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- 172.21.15.41:0/4011418618 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500049f0 msgr2=0x7f5650004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 --2- 172.21.15.41:0/4011418618 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500049f0 0x7f5650004e70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f566c05d270 tx=0x7f5664007a00).stop 2021-10-21T00:08:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566ad9d700 1 -- 172.21.15.41:0/4011418618 reap_dead start 2021-10-21T00:08:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- 172.21.15.41:0/4011418618 shutdown_connections 2021-10-21T00:08:03.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- 172.21.15.41:0/4011418618 >> 172.21.15.41:0/4011418618 conn(0x7f566c0b5700 msgr2=0x7f566c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- 172.21.15.41:0/4011418618 shutdown_connections 2021-10-21T00:08:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- 172.21.15.41:0/4011418618 wait complete. 2021-10-21T00:08:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 Processor -- start 2021-10-21T00:08:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.016+0000 7f566b59e700 1 -- start start 2021-10-21T00:08:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c099ae0 0x7f566c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f566c0ac700 0x7f566c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c15a920 con 0x7f566c15a4a0 2021-10-21T00:08:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c145830 con 0x7f566c0ac700 2021-10-21T00:08:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ace50 con 0x7f566c099ae0 2021-10-21T00:08:03.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33086/0 (socket says 172.21.15.41:33086) 2021-10-21T00:08:03.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 -- 172.21.15.41:0/99275915 learned_addr learned my addr 172.21.15.41:0/99275915 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f5669d9b700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f566c0ac700 0x7f566c159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566a59c700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c099ae0 0x7f566c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 -- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c099ae0 msgr2=0x7f566c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c099ae0 0x7f566c1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 -- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f566c0ac700 msgr2=0x7f566c159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f566c0ac700 0x7f566c159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 -- 172.21.15.41:0/99275915 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c099ec0 con 0x7f566c15a4a0 2021-10-21T00:08:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566ad9d700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f566c09aa70 tx=0x7f5664013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5664007580 con 0x7f566c15a4a0 2021-10-21T00:08:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664001cd0 con 0x7f566c15a4a0 2021-10-21T00:08:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c1452f0 con 0x7f566c15a4a0 2021-10-21T00:08:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56640125a0 con 0x7f566c15a4a0 2021-10-21T00:08:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c159b10 con 0x7f566c15a4a0 2021-10-21T00:08:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.020+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c0b12d0 con 0x7f566c15a4a0 2021-10-21T00:08:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.024+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f566401d070 con 0x7f566c15a4a0 2021-10-21T00:08:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.024+0000 7f565b7fe700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 0x7f5648055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.024+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f566406b400 con 0x7f566c15a4a0 2021-10-21T00:08:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.024+0000 7f566a59c700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 0x7f5648055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.024+0000 7f566a59c700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 0x7f5648055b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f566000b000 tx=0x7f5660006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.028+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5664042560 con 0x7f566c15a4a0 2021-10-21T00:08:03.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.156+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f566c057350 con 0x7f566c15a4a0 2021-10-21T00:08:03.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.156+0000 7f565b7fe700 1 -- 172.21.15.41:0/99275915 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5664045b80 con 0x7f566c15a4a0 2021-10-21T00:08:03.163 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:03.164 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":59,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:02.581407+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:00.049644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:00.609917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:03.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 msgr2=0x7f5648055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 0x7f5648055b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f566000b000 tx=0x7f5660006df0).stop 2021-10-21T00:08:03.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 msgr2=0x7f566c0ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f566c09aa70 tx=0x7f5664013000).stop 2021-10-21T00:08:03.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 shutdown_connections 2021-10-21T00:08:03.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5648053640 0x7f5648055b00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f566c15a4a0 0x7f566c0ae320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f566c0ac700 0x7f566c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 --2- 172.21.15.41:0/99275915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f566c099ae0 0x7f566c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 >> 172.21.15.41:0/99275915 conn(0x7f566c0b5700 msgr2=0x7f566c1495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 shutdown_connections 2021-10-21T00:08:03.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.160+0000 7f566b59e700 1 -- 172.21.15.41:0/99275915 wait complete. 2021-10-21T00:08:03.177 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:03.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 Processor -- start 2021-10-21T00:08:03.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 -- start start 2021-10-21T00:08:03.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdb30143610 0x7fdb300b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb30142ad0 con 0x7fdb30062330 2021-10-21T00:08:03.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb30145f90 con 0x7fdb3013cc20 2021-10-21T00:08:03.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb370a4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300b3520 con 0x7fdb30143610 2021-10-21T00:08:03.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb360a2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdb30062330 0x7fdb3013c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59092/0 (socket says 172.21.15.41:59092) 2021-10-21T00:08:03.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb360a2700 1 -- 172.21.15.41:0/1911022280 learned_addr learned my addr 172.21.15.41:0/1911022280 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:03.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.292+0000 7fdb368a3700 1 --2- 172.21.15.41:0/1911022280 >> v2:172.21.15.41:3300/0 conn(0x7fdb30143610 0x7fdb300b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb350a0700 1 -- 172.21.15.41:0/1911022280 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891404653 0 0) 0x7fdb30142ad0 con 0x7fdb30062330 2021-10-21T00:08:03.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb350a0700 1 -- 172.21.15.41:0/1911022280 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb18003260 con 0x7fdb30062330 2021-10-21T00:08:03.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb368a3700 1 -- 172.21.15.41:0/1911022280 >> v1:172.21.15.62:6789/0 conn(0x7fdb3013cc20 legacy=0x7fdb30142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb368a3700 1 -- 172.21.15.41:0/1911022280 >> v1:172.21.15.41:6789/0 conn(0x7fdb30062330 legacy=0x7fdb3013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb368a3700 1 -- 172.21.15.41:0/1911022280 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30146230 con 0x7fdb30143610 2021-10-21T00:08:03.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb368a3700 1 --2- 172.21.15.41:0/1911022280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30143610 0x7fdb300b4140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fdb300b0720 tx=0x7fdb280091d0).ready entity=mon.0 client_cookie=3234067f225d9481 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb350a0700 1 -- 172.21.15.41:0/1911022280 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb2800b680 con 0x7fdb30143610 2021-10-21T00:08:03.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb350a0700 1 -- 172.21.15.41:0/1911022280 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800b7e0 con 0x7fdb30143610 2021-10-21T00:08:03.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb350a0700 1 -- 172.21.15.41:0/1911022280 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb2800b950 con 0x7fdb30143610 2021-10-21T00:08:03.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 -- 172.21.15.41:0/1911022280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30143610 msgr2=0x7fdb300b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 --2- 172.21.15.41:0/1911022280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30143610 0x7fdb300b4140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fdb300b0720 tx=0x7fdb280091d0).stop 2021-10-21T00:08:03.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 -- 172.21.15.41:0/1911022280 shutdown_connections 2021-10-21T00:08:03.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 --2- 172.21.15.41:0/1911022280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30143610 0x7fdb300b4140 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 -- 172.21.15.41:0/1911022280 >> 172.21.15.41:0/1911022280 conn(0x7fdb300b9080 msgr2=0x7fdb300b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 -- 172.21.15.41:0/1911022280 shutdown_connections 2021-10-21T00:08:03.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.296+0000 7fdb370a4700 1 -- 172.21.15.41:0/1911022280 wait complete. 2021-10-21T00:08:03.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 Processor -- start 2021-10-21T00:08:03.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- start start 2021-10-21T00:08:03.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb30143610 0x7fdb30149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb30140910 0x7fdb301451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301444c0 con 0x7fdb30062330 2021-10-21T00:08:03.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30144aa0 con 0x7fdb30143610 2021-10-21T00:08:03.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30144d40 con 0x7fdb30140910 2021-10-21T00:08:03.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33096/0 (socket says 172.21.15.41:33096) 2021-10-21T00:08:03.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 -- 172.21.15.41:0/2721306685 learned_addr learned my addr 172.21.15.41:0/2721306685 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb358a1700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb30143610 0x7fdb30149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb368a3700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb30140910 0x7fdb301451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 -- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb30140910 msgr2=0x7fdb301451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb30140910 0x7fdb301451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 -- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb30143610 msgr2=0x7fdb30149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb30143610 0x7fdb30149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 -- 172.21.15.41:0/2721306685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009470 con 0x7fdb30062330 2021-10-21T00:08:03.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb360a2700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fdb20001110 tx=0x7fdb20007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb2000ce20 con 0x7fdb30062330 2021-10-21T00:08:03.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200072e0 con 0x7fdb30062330 2021-10-21T00:08:03.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb301456d0 con 0x7fdb30062330 2021-10-21T00:08:03.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb20005800 con 0x7fdb30062330 2021-10-21T00:08:03.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.300+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb301554a0 con 0x7fdb30062330 2021-10-21T00:08:03.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb301427a0 con 0x7fdb30062330 2021-10-21T00:08:03.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb20010070 con 0x7fdb30062330 2021-10-21T00:08:03.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb1f7fe700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 0x7fdb10055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb2006b080 con 0x7fdb30062330 2021-10-21T00:08:03.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb358a1700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 0x7fdb10055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.304+0000 7fdb358a1700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 0x7fdb10055b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fdb2c00d000 tx=0x7fdb2c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.308+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb200420e0 con 0x7fdb30062330 2021-10-21T00:08:03.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.476+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdb30063020 con 0x7fdb30062330 2021-10-21T00:08:03.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb1f7fe700 1 -- 172.21.15.41:0/2721306685 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdb20018020 con 0x7fdb30062330 2021-10-21T00:08:03.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 msgr2=0x7fdb10055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 0x7fdb10055b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fdb2c00d000 tx=0x7fdb2c000bc0).stop 2021-10-21T00:08:03.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 msgr2=0x7fdb30143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fdb20001110 tx=0x7fdb20007ad0).stop 2021-10-21T00:08:03.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 shutdown_connections 2021-10-21T00:08:03.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb100536d0 0x7fdb10055b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb30140910 0x7fdb301451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb30143610 0x7fdb30149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 --2- 172.21.15.41:0/2721306685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb30062330 0x7fdb30143e90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 >> 172.21.15.41:0/2721306685 conn(0x7fdb300b9080 msgr2=0x7fdb300b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 shutdown_connections 2021-10-21T00:08:03.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.484+0000 7fdb370a4700 1 -- 172.21.15.41:0/2721306685 wait complete. 2021-10-21T00:08:03.498 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:08:03.505 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:03.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 Processor -- start 2021-10-21T00:08:03.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 -- start start 2021-10-21T00:08:03.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b4380 0x7f4aa8063070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 0x7f4aa80b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4aa805f7c0 0x7f4aa805fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80b24e0 con 0x7f4aa805f7c0 2021-10-21T00:08:03.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80b4760 con 0x7f4aa80b1830 2021-10-21T00:08:03.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8062930 con 0x7f4aa80b4380 2021-10-21T00:08:03.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4aa805f7c0 0x7f4aa805fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4aa805f7c0 0x7f4aa805fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33106/0 (socket says 172.21.15.41:33106) 2021-10-21T00:08:03.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 -- 172.21.15.41:0/3741692005 learned_addr learned my addr 172.21.15.41:0/3741692005 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa6ffd700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b4380 0x7f4aa8063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa67fc700 1 --2- 172.21.15.41:0/3741692005 >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 0x7f4aa80b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 -- 172.21.15.41:0/3741692005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b4380 msgr2=0x7f4aa8063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b4380 0x7f4aa8063070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 -- 172.21.15.41:0/3741692005 >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 msgr2=0x7f4aa80b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/3741692005 >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 0x7f4aa80b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 -- 172.21.15.41:0/3741692005 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8062bd0 con 0x7f4aa805f7c0 2021-10-21T00:08:03.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa67fc700 1 --2- 172.21.15.41:0/3741692005 >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 0x7f4aa80b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:03.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa805f7c0 0x7f4aa805fc70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f4a98002f70 tx=0x7f4a98006eb0).ready entity=mon.0 client_cookie=1eedcbba9ffdf66f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.604+0000 7f4aa5ffb700 1 -- 172.21.15.41:0/3741692005 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9800d570 con 0x7f4aa805f7c0 2021-10-21T00:08:03.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa5ffb700 1 -- 172.21.15.41:0/3741692005 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98000e90 con 0x7f4aa805f7c0 2021-10-21T00:08:03.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa5ffb700 1 -- 172.21.15.41:0/3741692005 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9800d900 con 0x7f4aa805f7c0 2021-10-21T00:08:03.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/3741692005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa805f7c0 msgr2=0x7f4aa805fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa805f7c0 0x7f4aa805fc70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f4a98002f70 tx=0x7f4a98006eb0).stop 2021-10-21T00:08:03.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/3741692005 shutdown_connections 2021-10-21T00:08:03.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa805f7c0 0x7f4aa805fc70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/3741692005 >> v2:172.21.15.62:3300/0 conn(0x7f4aa80b1830 0x7f4aa80b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/3741692005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b4380 0x7f4aa8063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/3741692005 >> 172.21.15.41:0/3741692005 conn(0x7f4aa80b7960 msgr2=0x7f4aa80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/3741692005 shutdown_connections 2021-10-21T00:08:03.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/3741692005 wait complete. 2021-10-21T00:08:03.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 Processor -- start 2021-10-21T00:08:03.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- start start 2021-10-21T00:08:03.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa805f7c0 0x7f4aa809b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b1830 0x7f4aa8146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa809bdc0 con 0x7f4aa80b4380 2021-10-21T00:08:03.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8140050 con 0x7f4aa805f7c0 2021-10-21T00:08:03.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa809a730 con 0x7f4aa80b1830 2021-10-21T00:08:03.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33114/0 (socket says 172.21.15.41:33114) 2021-10-21T00:08:03.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 -- 172.21.15.41:0/4134638337 learned_addr learned my addr 172.21.15.41:0/4134638337 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa67fc700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b1830 0x7f4aa8146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa6ffd700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa805f7c0 0x7f4aa809b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 -- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b1830 msgr2=0x7f4aa8146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b1830 0x7f4aa8146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 -- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa805f7c0 msgr2=0x7f4aa809b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa805f7c0 0x7f4aa809b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 -- 172.21.15.41:0/4134638337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9000b180 con 0x7f4aa80b4380 2021-10-21T00:08:03.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa77fe700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4a98002f70 tx=0x7f4a98015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a980116e0 con 0x7f4aa80b4380 2021-10-21T00:08:03.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98011840 con 0x7f4aa80b4380 2021-10-21T00:08:03.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9800b1e0 con 0x7f4aa80b4380 2021-10-21T00:08:03.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a98011ba0 con 0x7f4aa80b4380 2021-10-21T00:08:03.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.608+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa81467f0 con 0x7f4aa80b4380 2021-10-21T00:08:03.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa80aed30 con 0x7f4aa80b4380 2021-10-21T00:08:03.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a98025030 con 0x7f4aa80b4380 2021-10-21T00:08:03.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4a9ffff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a9806c910 con 0x7f4aa80b4380 2021-10-21T00:08:03.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4aa6ffd700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.612+0000 7f4aa6ffd700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 0x7f4a80055a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4aa000b000 tx=0x7f4aa00091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.616+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a98043a70 con 0x7f4aa80b4380 2021-10-21T00:08:03.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.784+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4aa809aae0 con 0x7f4aa80b4380 2021-10-21T00:08:03.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.792+0000 7f4a9ffff700 1 -- 172.21.15.41:0/4134638337 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4aa809aae0 con 0x7f4aa80b4380 2021-10-21T00:08:03.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 msgr2=0x7f4a80055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 0x7f4a80055a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4aa000b000 tx=0x7f4aa00091d0).stop 2021-10-21T00:08:03.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 msgr2=0x7f4aa8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4a98002f70 tx=0x7f4a98015000).stop 2021-10-21T00:08:03.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 shutdown_connections 2021-10-21T00:08:03.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a80053580 0x7f4a80055a40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aa80b4380 0x7f4aa8155210 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aa80b1830 0x7f4aa8146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 --2- 172.21.15.41:0/4134638337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa805f7c0 0x7f4aa809b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 >> 172.21.15.41:0/4134638337 conn(0x7f4aa80b7960 msgr2=0x7f4aa8060360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 shutdown_connections 2021-10-21T00:08:03.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.796+0000 7f4aa7fff700 1 -- 172.21.15.41:0/4134638337 wait complete. 2021-10-21T00:08:03.805 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:08:03.816 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:03.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.924+0000 7f7b44ba6700 1 Processor -- start 2021-10-21T00:08:03.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.924+0000 7f7b44ba6700 1 -- start start 2021-10-21T00:08:03.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b4005bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7b4005c190 0x7f7b40142a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4005cad0 con 0x7f7b400b26f0 2021-10-21T00:08:03.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400b0e50 con 0x7f7b4005c190 2021-10-21T00:08:03.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4005c830 con 0x7f7b400b0a70 2021-10-21T00:08:03.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7b4005c190 0x7f7b40142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7b4005c190 0x7f7b40142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33122/0 (socket says 172.21.15.41:33122) 2021-10-21T00:08:03.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 -- 172.21.15.41:0/984128919 learned_addr learned my addr 172.21.15.41:0/984128919 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3f7fe700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b4005bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 -- 172.21.15.41:0/984128919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 msgr2=0x7f7b4005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:03.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b4005bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 -- 172.21.15.41:0/984128919 >> v1:172.21.15.62:6789/0 conn(0x7f7b400b26f0 legacy=0x7f7b4005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 -- 172.21.15.41:0/984128919 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40067c30 con 0x7f7b4005c190 2021-10-21T00:08:03.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3ffff700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b40142a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7b380032f0 tx=0x7f7b38009290).ready entity=mon.0 client_cookie=72a9437ec2793d92 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3effd700 1 -- 172.21.15.41:0/984128919 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3800b8a0 con 0x7f7b4005c190 2021-10-21T00:08:03.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3effd700 1 -- 172.21.15.41:0/984128919 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800ba00 con 0x7f7b4005c190 2021-10-21T00:08:03.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b3effd700 1 -- 172.21.15.41:0/984128919 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3800bb70 con 0x7f7b4005c190 2021-10-21T00:08:03.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- 172.21.15.41:0/984128919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 msgr2=0x7f7b40142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b40142a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7b380032f0 tx=0x7f7b38009290).stop 2021-10-21T00:08:03.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- 172.21.15.41:0/984128919 shutdown_connections 2021-10-21T00:08:03.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b40142a40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/984128919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b4005bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- 172.21.15.41:0/984128919 >> 172.21.15.41:0/984128919 conn(0x7f7b400637b0 msgr2=0x7f7b40063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:03.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- 172.21.15.41:0/984128919 shutdown_connections 2021-10-21T00:08:03.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.928+0000 7f7b44ba6700 1 -- 172.21.15.41:0/984128919 wait complete. 2021-10-21T00:08:03.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 Processor -- start 2021-10-21T00:08:03.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 -- start start 2021-10-21T00:08:03.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b40140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b400b26f0 0x7f7b40113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400af5c0 con 0x7f7b4005c190 2021-10-21T00:08:03.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40064c60 con 0x7f7b400b26f0 2021-10-21T00:08:03.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40065100 con 0x7f7b400b0a70 2021-10-21T00:08:03.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33126/0 (socket says 172.21.15.41:33126) 2021-10-21T00:08:03.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 -- 172.21.15.41:0/834969191 learned_addr learned my addr 172.21.15.41:0/834969191 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:03.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b37fff700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b40140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3ffff700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b400b26f0 0x7f7b40113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 -- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 msgr2=0x7f7b40140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b40140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 -- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b400b26f0 msgr2=0x7f7b40113390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:03.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b400b26f0 0x7f7b40113390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:03.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 -- 172.21.15.41:0/834969191 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009530 con 0x7f7b4005c190 2021-10-21T00:08:03.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3f7fe700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f7b3000c000 tx=0x7f7b30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b30010780 con 0x7f7b4005c190 2021-10-21T00:08:03.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300108e0 con 0x7f7b4005c190 2021-10-21T00:08:03.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400ae640 con 0x7f7b4005c190 2021-10-21T00:08:03.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.932+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b30010c40 con 0x7f7b4005c190 2021-10-21T00:08:03.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b401415e0 con 0x7f7b4005c190 2021-10-21T00:08:03.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b3001c460 con 0x7f7b4005c190 2021-10-21T00:08:03.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400af7c0 con 0x7f7b4005c190 2021-10-21T00:08:03.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b3d7fa700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 0x7f7b24055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:03.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b3006bcf0 con 0x7f7b4005c190 2021-10-21T00:08:03.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b37fff700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 0x7f7b24055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:03.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.936+0000 7f7b37fff700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 0x7f7b24055b60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7b2800d000 tx=0x7f7b28009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:03.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:03.944+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b30042df0 con 0x7f7b4005c190 2021-10-21T00:08:04.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.112+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7b40146cc0 con 0x7f7b4005c190 2021-10-21T00:08:04.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.120+0000 7f7b3d7fa700 1 -- 172.21.15.41:0/834969191 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7b30046410 con 0x7f7b4005c190 2021-10-21T00:08:04.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 msgr2=0x7f7b24055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 0x7f7b24055b60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f7b2800d000 tx=0x7f7b28009040).stop 2021-10-21T00:08:04.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 msgr2=0x7f7b401553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f7b3000c000 tx=0x7f7b30006df0).stop 2021-10-21T00:08:04.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 shutdown_connections 2021-10-21T00:08:04.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b240536a0 0x7f7b24055b60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b400b26f0 0x7f7b40113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7b400b0a70 0x7f7b40140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 --2- 172.21.15.41:0/834969191 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7b4005c190 0x7f7b401553d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 >> 172.21.15.41:0/834969191 conn(0x7f7b400637b0 msgr2=0x7f7b40145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:04.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 shutdown_connections 2021-10-21T00:08:04.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.124+0000 7f7b44ba6700 1 -- 172.21.15.41:0/834969191 wait complete. 2021-10-21T00:08:04.134 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:08:04.143 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:04.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 Processor -- start 2021-10-21T00:08:04.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- start start 2021-10-21T00:08:04.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 0x7f8e2814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8e2814b350 0x7f8e280af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280609d0 con 0x7f8e2805f9f0 2021-10-21T00:08:04.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280b1620 con 0x7f8e2814b350 2021-10-21T00:08:04.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2805fdd0 con 0x7f8e280aa750 2021-10-21T00:08:04.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e277fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8e2805f9f0 0x7f8e2814a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59134/0 (socket says 172.21.15.41:59134) 2021-10-21T00:08:04.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e277fe700 1 -- 172.21.15.41:0/2886554366 learned_addr learned my addr 172.21.15.41:0/2886554366 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:04.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 --2- 172.21.15.41:0/2886554366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 0x7f8e2814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e27fff700 1 --2- 172.21.15.41:0/2886554366 >> v2:172.21.15.62:3300/0 conn(0x7f8e2814b350 0x7f8e280af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e267fc700 1 -- 172.21.15.41:0/2886554366 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336077883 0 0) 0x7f8e280609d0 con 0x7f8e2805f9f0 2021-10-21T00:08:04.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e267fc700 1 -- 172.21.15.41:0/2886554366 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e08003260 con 0x7f8e2805f9f0 2021-10-21T00:08:04.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 -- 172.21.15.41:0/2886554366 >> v2:172.21.15.62:3300/0 conn(0x7f8e2814b350 msgr2=0x7f8e280af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:04.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 --2- 172.21.15.41:0/2886554366 >> v2:172.21.15.62:3300/0 conn(0x7f8e2814b350 0x7f8e280af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 -- 172.21.15.41:0/2886554366 >> v1:172.21.15.41:6789/0 conn(0x7f8e2805f9f0 legacy=0x7f8e2814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 -- 172.21.15.41:0/2886554366 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280b1380 con 0x7f8e280aa750 2021-10-21T00:08:04.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e26ffd700 1 --2- 172.21.15.41:0/2886554366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 0x7f8e2814ae60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8e200032f0 tx=0x7f8e200091d0).ready entity=mon.2 client_cookie=7645d2b36b0283f3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e267fc700 1 -- 172.21.15.41:0/2886554366 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2000b600 con 0x7f8e280aa750 2021-10-21T00:08:04.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e267fc700 1 -- 172.21.15.41:0/2886554366 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000b760 con 0x7f8e280aa750 2021-10-21T00:08:04.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e267fc700 1 -- 172.21.15.41:0/2886554366 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2000b8d0 con 0x7f8e280aa750 2021-10-21T00:08:04.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- 172.21.15.41:0/2886554366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 msgr2=0x7f8e2814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 --2- 172.21.15.41:0/2886554366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 0x7f8e2814ae60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8e200032f0 tx=0x7f8e200091d0).stop 2021-10-21T00:08:04.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- 172.21.15.41:0/2886554366 shutdown_connections 2021-10-21T00:08:04.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 --2- 172.21.15.41:0/2886554366 >> v2:172.21.15.62:3300/0 conn(0x7f8e2814b350 0x7f8e280af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 --2- 172.21.15.41:0/2886554366 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e280aa750 0x7f8e2814ae60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.240+0000 7f8e2df01700 1 -- 172.21.15.41:0/2886554366 >> 172.21.15.41:0/2886554366 conn(0x7f8e2805bca0 msgr2=0x7f8e2805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:04.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- 172.21.15.41:0/2886554366 shutdown_connections 2021-10-21T00:08:04.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- 172.21.15.41:0/2886554366 wait complete. 2021-10-21T00:08:04.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 Processor -- start 2021-10-21T00:08:04.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- start start 2021-10-21T00:08:04.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e2805f9f0 0x7f8e28064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e280aa750 0x7f8e280992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28062d10 con 0x7f8e2814b350 2021-10-21T00:08:04.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28157410 con 0x7f8e280aa750 2021-10-21T00:08:04.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28159750 con 0x7f8e2805f9f0 2021-10-21T00:08:04.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33142/0 (socket says 172.21.15.41:33142) 2021-10-21T00:08:04.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 -- 172.21.15.41:0/378892044 learned_addr learned my addr 172.21.15.41:0/378892044 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:04.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e277fe700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e2805f9f0 0x7f8e28064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e26ffd700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e280aa750 0x7f8e280992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 -- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e2805f9f0 msgr2=0x7f8e28064490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e2805f9f0 0x7f8e28064490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 -- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e280aa750 msgr2=0x7f8e280992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e280aa750 0x7f8e280992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 -- 172.21.15.41:0/378892044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009470 con 0x7f8e2814b350 2021-10-21T00:08:04.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e27fff700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f8e1800c000 tx=0x7f8e18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18011750 con 0x7f8e2814b350 2021-10-21T00:08:04.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e280ad2c0 con 0x7f8e2814b350 2021-10-21T00:08:04.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.244+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e28156660 con 0x7f8e2814b350 2021-10-21T00:08:04.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e180118b0 con 0x7f8e2814b350 2021-10-21T00:08:04.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18011c10 con 0x7f8e2814b350 2021-10-21T00:08:04.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e28159b80 con 0x7f8e2814b350 2021-10-21T00:08:04.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8e18011d70 con 0x7f8e2814b350 2021-10-21T00:08:04.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e24ff9700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e1806bba0 con 0x7f8e2814b350 2021-10-21T00:08:04.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e277fe700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.248+0000 7f8e277fe700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 0x7f8e0c055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8e1000d000 tx=0x7f8e10009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.256+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e28159b80 con 0x7f8e2814b350 2021-10-21T00:08:04.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.416+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e28159b80 con 0x7f8e2814b350 2021-10-21T00:08:04.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.416+0000 7f8e24ff9700 1 -- 172.21.15.41:0/378892044 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f8e28159b80 con 0x7f8e2814b350 2021-10-21T00:08:04.424 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:04.425 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:04.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 msgr2=0x7f8e0c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 0x7f8e0c055a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8e1000d000 tx=0x7f8e10009040).stop 2021-10-21T00:08:04.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 msgr2=0x7f8e28156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f8e1800c000 tx=0x7f8e18006df0).stop 2021-10-21T00:08:04.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 shutdown_connections 2021-10-21T00:08:04.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8e0c053580 0x7f8e0c055a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8e2814b350 0x7f8e28156170 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e280aa750 0x7f8e280992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 --2- 172.21.15.41:0/378892044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e2805f9f0 0x7f8e28064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 >> 172.21.15.41:0/378892044 conn(0x7f8e2805bca0 msgr2=0x7f8e280b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:04.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 shutdown_connections 2021-10-21T00:08:04.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.420+0000 7f8e2df01700 1 -- 172.21.15.41:0/378892044 wait complete. 2021-10-21T00:08:04.430 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:04.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:01.577786+0000', 'modified': '2021-10-21T00:08:02.580692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5489}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5489': {'gid': 5489, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/1883344240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 1883344240}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 1883344240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:08:04.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:08:04.640 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:08:04.758 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5489,"want_state":"up:active","state":"up:active","rank_uptime":3.16323489,"mdsmap_epoch":27,"osdmap_epoch":59,"osdmap_epoch_barrier":58,"uptime":7.5392374379999998} 2021-10-21T00:08:04.759 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5489, "mdsmap_epoch": 27, "osdmap_epoch": 59, "osdmap_epoch_barrier": 58, "rank_uptime": 3.16323489, "state": "up:active", "uptime": 7.539237438, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:08:04.759 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:04.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 Processor -- start 2021-10-21T00:08:04.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 -- start start 2021-10-21T00:08:04.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d300b4380 0x7f1d3005f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d30140890 0x7f1d30140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300b4760 con 0x7f1d300b1830 2021-10-21T00:08:04.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300ad4c0 con 0x7f1d30140890 2021-10-21T00:08:04.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d36737700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300ad760 con 0x7f1d300b4380 2021-10-21T00:08:04.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d34f34700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1d300b1830 0x7f1d3005fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59148/0 (socket says 172.21.15.41:59148) 2021-10-21T00:08:04.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d34f34700 1 -- 172.21.15.41:0/2443462206 learned_addr learned my addr 172.21.15.41:0/2443462206 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:04.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35f36700 1 --2- 172.21.15.41:0/2443462206 >> v2:172.21.15.41:3300/0 conn(0x7f1d30140890 0x7f1d30140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35735700 1 --2- 172.21.15.41:0/2443462206 >> v2:172.21.15.62:3300/0 conn(0x7f1d300b4380 0x7f1d3005f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35f36700 1 -- 172.21.15.41:0/2443462206 >> v2:172.21.15.62:3300/0 conn(0x7f1d300b4380 msgr2=0x7f1d3005f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:04.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35f36700 1 --2- 172.21.15.41:0/2443462206 >> v2:172.21.15.62:3300/0 conn(0x7f1d300b4380 0x7f1d3005f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35f36700 1 -- 172.21.15.41:0/2443462206 >> v1:172.21.15.41:6789/0 conn(0x7f1d300b1830 legacy=0x7f1d3005fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.852+0000 7f1d35f36700 1 -- 172.21.15.41:0/2443462206 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300ada00 con 0x7f1d30140890 2021-10-21T00:08:04.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d35f36700 1 --2- 172.21.15.41:0/2443462206 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d30140890 0x7f1d30140cc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1d28002f70 tx=0x7f1d28006df0).ready entity=mon.0 client_cookie=6723fef53be1059 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d27fff700 1 -- 172.21.15.41:0/2443462206 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2800d570 con 0x7f1d30140890 2021-10-21T00:08:04.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d27fff700 1 -- 172.21.15.41:0/2443462206 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28000e90 con 0x7f1d30140890 2021-10-21T00:08:04.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d27fff700 1 -- 172.21.15.41:0/2443462206 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2800d8c0 con 0x7f1d30140890 2021-10-21T00:08:04.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- 172.21.15.41:0/2443462206 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d30140890 msgr2=0x7f1d30140cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 --2- 172.21.15.41:0/2443462206 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d30140890 0x7f1d30140cc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1d28002f70 tx=0x7f1d28006df0).stop 2021-10-21T00:08:04.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- 172.21.15.41:0/2443462206 shutdown_connections 2021-10-21T00:08:04.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 --2- 172.21.15.41:0/2443462206 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d30140890 0x7f1d30140cc0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 --2- 172.21.15.41:0/2443462206 >> v2:172.21.15.62:3300/0 conn(0x7f1d300b4380 0x7f1d3005f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- 172.21.15.41:0/2443462206 >> 172.21.15.41:0/2443462206 conn(0x7f1d300b7910 msgr2=0x7f1d300b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:04.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- 172.21.15.41:0/2443462206 shutdown_connections 2021-10-21T00:08:04.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- 172.21.15.41:0/2443462206 wait complete. 2021-10-21T00:08:04.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 Processor -- start 2021-10-21T00:08:04.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.856+0000 7f1d36737700 1 -- start start 2021-10-21T00:08:04.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d300b4380 0x7f1d30066ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d30140890 0x7f1d3013d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300af170 con 0x7f1d300b1830 2021-10-21T00:08:04.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300b0bf0 con 0x7f1d300b4380 2021-10-21T00:08:04.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3013aff0 con 0x7f1d30140890 2021-10-21T00:08:04.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33152/0 (socket says 172.21.15.41:33152) 2021-10-21T00:08:04.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 -- 172.21.15.41:0/3989041379 learned_addr learned my addr 172.21.15.41:0/3989041379 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:04.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d34f34700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d300b4380 0x7f1d30066ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35f36700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d30140890 0x7f1d3013d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 -- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d30140890 msgr2=0x7f1d3013d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d30140890 0x7f1d3013d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 -- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d300b4380 msgr2=0x7f1d30066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:04.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d300b4380 0x7f1d30066ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:04.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 -- 172.21.15.41:0/3989041379 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2800b180 con 0x7f1d300b1830 2021-10-21T00:08:04.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d35735700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f1d2000c000 tx=0x7f1d20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d20010780 con 0x7f1d300b1830 2021-10-21T00:08:04.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200108e0 con 0x7f1d300b1830 2021-10-21T00:08:04.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3013b290 con 0x7f1d300b1830 2021-10-21T00:08:04.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d20010c40 con 0x7f1d300b1830 2021-10-21T00:08:04.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d300b0870 con 0x7f1d300b1830 2021-10-21T00:08:04.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3009a400 con 0x7f1d300b1830 2021-10-21T00:08:04.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.860+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d2001c460 con 0x7f1d300b1830 2021-10-21T00:08:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.864+0000 7f1d267fc700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 0x7f1d18055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.864+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d2006bef0 con 0x7f1d300b1830 2021-10-21T00:08:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.864+0000 7f1d34f34700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 0x7f1d18055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.864+0000 7f1d34f34700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 0x7f1d18055ad0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1d2c00b000 tx=0x7f1d2c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:04.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:04.872+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d3009a400 con 0x7f1d300b1830 2021-10-21T00:08:05.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.000+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d3009a400 con 0x7f1d300b1830 2021-10-21T00:08:05.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.000+0000 7f1d267fc700 1 -- 172.21.15.41:0/3989041379 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f1d3009a400 con 0x7f1d300b1830 2021-10-21T00:08:05.008 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:05.008 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":59,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:02.581407+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:00.049644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:00.609917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:05.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 msgr2=0x7f1d18055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 0x7f1d18055ad0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1d2c00b000 tx=0x7f1d2c009040).stop 2021-10-21T00:08:05.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 msgr2=0x7f1d300ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f1d2000c000 tx=0x7f1d20006df0).stop 2021-10-21T00:08:05.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 shutdown_connections 2021-10-21T00:08:05.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d18053610 0x7f1d18055ad0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d30140890 0x7f1d3013d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d300b4380 0x7f1d30066ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 --2- 172.21.15.41:0/3989041379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d300b1830 0x7f1d300ae200 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 >> 172.21.15.41:0/3989041379 conn(0x7f1d300b7910 msgr2=0x7f1d300b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 shutdown_connections 2021-10-21T00:08:05.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.004+0000 7f1d36737700 1 -- 172.21.15.41:0/3989041379 wait complete. 2021-10-21T00:08:05.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:08:00.049644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:08:00.609917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:08:05.022 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:08:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 Processor -- start 2021-10-21T00:08:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 -- start start 2021-10-21T00:08:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab880b9ca0 0x7fab880b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 0x7fab88141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab880ba080 con 0x7fab880b31e0 2021-10-21T00:08:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8805c670 con 0x7fab880b9ca0 2021-10-21T00:08:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8cd7b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8805c8e0 con 0x7fab880b26d0 2021-10-21T00:08:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab7dd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fab880b31e0 0x7fab880b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59164/0 (socket says 172.21.15.41:59164) 2021-10-21T00:08:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab7dd9b700 1 -- 172.21.15.41:0/3360995920 learned_addr learned my addr 172.21.15.41:0/3360995920 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab86d9d700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 0x7fab88141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 --2- 172.21.15.41:0/3360995920 >> v2:172.21.15.62:3300/0 conn(0x7fab880b9ca0 0x7fab880b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab85d9b700 1 -- 172.21.15.41:0/3360995920 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665711379 0 0) 0x7fab880ba080 con 0x7fab880b31e0 2021-10-21T00:08:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab85d9b700 1 -- 172.21.15.41:0/3360995920 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab68003260 con 0x7fab880b31e0 2021-10-21T00:08:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 -- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 msgr2=0x7fab88141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 0x7fab88141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 -- 172.21.15.41:0/3360995920 >> v1:172.21.15.41:6789/0 conn(0x7fab880b31e0 legacy=0x7fab880b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 -- 172.21.15.41:0/3360995920 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8805cb80 con 0x7fab880b9ca0 2021-10-21T00:08:05.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab86d9d700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 0x7fab88141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:05.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.124+0000 7fab8659c700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b9ca0 0x7fab880b0690 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78006df0).ready entity=mon.1 client_cookie=2f11d8ee3d2b3260 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab85d9b700 1 -- 172.21.15.41:0/3360995920 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7800d4a0 con 0x7fab880b9ca0 2021-10-21T00:08:05.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab85d9b700 1 -- 172.21.15.41:0/3360995920 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78000e90 con 0x7fab880b9ca0 2021-10-21T00:08:05.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab85d9b700 1 -- 172.21.15.41:0/3360995920 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7800d7f0 con 0x7fab880b9ca0 2021-10-21T00:08:05.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b9ca0 msgr2=0x7fab880b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b9ca0 0x7fab880b0690 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fab78002f70 tx=0x7fab78006df0).stop 2021-10-21T00:08:05.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/3360995920 shutdown_connections 2021-10-21T00:08:05.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b26d0 0x7fab88141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/3360995920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b9ca0 0x7fab880b0690 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/3360995920 >> 172.21.15.41:0/3360995920 conn(0x7fab88062f00 msgr2=0x7fab880b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/3360995920 shutdown_connections 2021-10-21T00:08:05.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/3360995920 wait complete. 2021-10-21T00:08:05.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 Processor -- start 2021-10-21T00:08:05.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- start start 2021-10-21T00:08:05.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b26d0 0x7fab880b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b9ca0 0x7fab881556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8813f6c0 con 0x7fab880b31e0 2021-10-21T00:08:05.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8813f960 con 0x7fab880b26d0 2021-10-21T00:08:05.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8813fc00 con 0x7fab880b9ca0 2021-10-21T00:08:05.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33170/0 (socket says 172.21.15.41:33170) 2021-10-21T00:08:05.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 -- 172.21.15.41:0/4258351732 learned_addr learned my addr 172.21.15.41:0/4258351732 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab86d9d700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b9ca0 0x7fab881556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8659c700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b26d0 0x7fab880b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 -- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b9ca0 msgr2=0x7fab881556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b9ca0 0x7fab881556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 -- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b26d0 msgr2=0x7fab880b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b26d0 0x7fab880b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 -- 172.21.15.41:0/4258351732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009470 con 0x7fab880b31e0 2021-10-21T00:08:05.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7dd9b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fab70001110 tx=0x7fab70007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7000ce20 con 0x7fab880b31e0 2021-10-21T00:08:05.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700072e0 con 0x7fab880b31e0 2021-10-21T00:08:05.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7800b180 con 0x7fab880b31e0 2021-10-21T00:08:05.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab70005800 con 0x7fab880b31e0 2021-10-21T00:08:05.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.128+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab88151b20 con 0x7fab880b31e0 2021-10-21T00:08:05.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab88144450 con 0x7fab880b31e0 2021-10-21T00:08:05.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab70010070 con 0x7fab880b31e0 2021-10-21T00:08:05.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab7ffff700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 0x7fab6c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab7006b070 con 0x7fab880b31e0 2021-10-21T00:08:05.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab8659c700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 0x7fab6c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.132+0000 7fab8659c700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 0x7fab6c055b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fab7801a000 tx=0x7fab78014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.140+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab700421d0 con 0x7fab880b31e0 2021-10-21T00:08:05.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.264+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fab88057350 con 0x7fab880b31e0 2021-10-21T00:08:05.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.264+0000 7fab7ffff700 1 -- 172.21.15.41:0/4258351732 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v59) v1 ==== 110+0+10 (secure 0 0 0) 0x7fab700457f0 con 0x7fab880b31e0 2021-10-21T00:08:05.272 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:08:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 msgr2=0x7fab6c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 0x7fab6c055b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fab7801a000 tx=0x7fab78014000).stop 2021-10-21T00:08:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 msgr2=0x7fab881551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fab70001110 tx=0x7fab70007ad0).stop 2021-10-21T00:08:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 shutdown_connections 2021-10-21T00:08:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab6c0536a0 0x7fab6c055b60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab880b9ca0 0x7fab881556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab880b31e0 0x7fab881551c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 --2- 172.21.15.41:0/4258351732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab880b26d0 0x7fab880b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 >> 172.21.15.41:0/4258351732 conn(0x7fab88062f00 msgr2=0x7fab88143440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 shutdown_connections 2021-10-21T00:08:05.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.268+0000 7fab8cd7b700 1 -- 172.21.15.41:0/4258351732 wait complete. 2021-10-21T00:08:05.285 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:08:05.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 Processor -- start 2021-10-21T00:08:05.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 -- start start 2021-10-21T00:08:05.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ff40672c0 0x7f1ff405c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff4147250 con 0x7f1ff40677c0 2021-10-21T00:08:05.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40ad110 con 0x7f1ff40672c0 2021-10-21T00:08:05.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff947e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff405d130 con 0x7f1ff40b6130 2021-10-21T00:08:05.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ff40672c0 0x7f1ff405c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ff40672c0 0x7f1ff405c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33176/0 (socket says 172.21.15.41:33176) 2021-10-21T00:08:05.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1152026492 learned_addr learned my addr 172.21.15.41:0/1152026492 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff2ffd700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1152026492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 msgr2=0x7f1ff405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:05.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff405bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1152026492 >> v1:172.21.15.62:6789/0 conn(0x7f1ff40677c0 legacy=0x7f1ff4141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:05.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1152026492 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4146df0 con 0x7f1ff40672c0 2021-10-21T00:08:05.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff2ffd700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff405bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:05.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff27fc700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40672c0 0x7f1ff405c190 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f1fe8002f70 tx=0x7f1fe8006eb0).ready entity=mon.0 client_cookie=622cfb15657e0004 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff1ffb700 1 -- 172.21.15.41:0/1152026492 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe800d5c0 con 0x7f1ff40672c0 2021-10-21T00:08:05.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff1ffb700 1 -- 172.21.15.41:0/1152026492 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8000e90 con 0x7f1ff40672c0 2021-10-21T00:08:05.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.392+0000 7f1ff1ffb700 1 -- 172.21.15.41:0/1152026492 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe800d950 con 0x7f1ff40672c0 2021-10-21T00:08:05.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- 172.21.15.41:0/1152026492 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40672c0 msgr2=0x7f1ff405c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40672c0 0x7f1ff405c190 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f1fe8002f70 tx=0x7f1fe8006eb0).stop 2021-10-21T00:08:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- 172.21.15.41:0/1152026492 shutdown_connections 2021-10-21T00:08:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40672c0 0x7f1ff405c190 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1152026492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff405bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- 172.21.15.41:0/1152026492 >> 172.21.15.41:0/1152026492 conn(0x7f1ff4063b40 msgr2=0x7f1ff40b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- 172.21.15.41:0/1152026492 shutdown_connections 2021-10-21T00:08:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- 172.21.15.41:0/1152026492 wait complete. 2021-10-21T00:08:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 Processor -- start 2021-10-21T00:08:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- start start 2021-10-21T00:08:05.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff40672c0 0x7f1ff40a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff4142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4066520 con 0x7f1ff40677c0 2021-10-21T00:08:05.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4147880 con 0x7f1ff40672c0 2021-10-21T00:08:05.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff947e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4147b20 con 0x7f1ff40b6130 2021-10-21T00:08:05.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff4142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff4142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:51680/0 (socket says 172.21.15.41:51680) 2021-10-21T00:08:05.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff37fe700 1 -- 172.21.15.41:0/1952639347 learned_addr learned my addr 172.21.15.41:0/1952639347 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff40672c0 0x7f1ff40a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33184/0 (socket says 172.21.15.41:33184) 2021-10-21T00:08:05.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 msgr2=0x7f1ff4142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff4142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff40672c0 msgr2=0x7f1ff40a3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff40672c0 0x7f1ff40a3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 -- 172.21.15.41:0/1952639347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe800b1e0 con 0x7f1ff40677c0 2021-10-21T00:08:05.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.396+0000 7f1ff27fc700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f1fe8002f70 tx=0x7f1fe8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe800d940 con 0x7f1ff40677c0 2021-10-21T00:08:05.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8011b80 con 0x7f1ff40677c0 2021-10-21T00:08:05.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4151fb0 con 0x7f1ff40677c0 2021-10-21T00:08:05.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe801e460 con 0x7f1ff40677c0 2021-10-21T00:08:05.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff4147580 con 0x7f1ff40677c0 2021-10-21T00:08:05.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff4057350 con 0x7f1ff40677c0 2021-10-21T00:08:05.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1fe801a040 con 0x7f1ff40677c0 2021-10-21T00:08:05.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 0x7f1fd0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fe806cd40 con 0x7f1ff40677c0 2021-10-21T00:08:05.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.400+0000 7f1ff2ffd700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 0x7f1fd0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.404+0000 7f1ff2ffd700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 0x7f1fd0055ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f1fe400d000 tx=0x7f1fe4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.404+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1fe8043ea0 con 0x7f1ff40677c0 2021-10-21T00:08:05.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ff4067ca0 con 0x7f1ff40677c0 2021-10-21T00:08:05.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1fe3fff700 1 -- 172.21.15.41:0/1952639347 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fe8023070 con 0x7f1ff40677c0 2021-10-21T00:08:05.538 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:05.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 msgr2=0x7f1fd0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 0x7f1fd0055ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f1fe400d000 tx=0x7f1fe4008040).stop 2021-10-21T00:08:05.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 msgr2=0x7f1ff4155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f1fe8002f70 tx=0x7f1fe8015000).stop 2021-10-21T00:08:05.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 shutdown_connections 2021-10-21T00:08:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1fd0053610 0x7f1fd0055ad0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ff40b6130 0x7f1ff4142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ff40677c0 0x7f1ff4155590 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 --2- 172.21.15.41:0/1952639347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ff40672c0 0x7f1ff40a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 >> 172.21.15.41:0/1952639347 conn(0x7f1ff4063b40 msgr2=0x7f1ff40b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 shutdown_connections 2021-10-21T00:08:05.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.532+0000 7f1ff947e700 1 -- 172.21.15.41:0/1952639347 wait complete. 2021-10-21T00:08:05.551 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:08:05.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 Processor -- start 2021-10-21T00:08:05.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- start start 2021-10-21T00:08:05.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f46440b6270 0x7f46440ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440afb40 con 0x7f46440b1d10 2021-10-21T00:08:05.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440b0e00 con 0x7f46440b5e90 2021-10-21T00:08:05.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440b1ab0 con 0x7f46440b6270 2021-10-21T00:08:05.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46437fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f46440b1d10 0x7f4644142c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59192/0 (socket says 172.21.15.41:59192) 2021-10-21T00:08:05.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46437fe700 1 -- 172.21.15.41:0/4059129346 learned_addr learned my addr 172.21.15.41:0/4059129346 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:05.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4648ee9700 1 --2- 172.21.15.41:0/4059129346 >> v2:172.21.15.62:3300/0 conn(0x7f46440b6270 0x7f46440ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173924460 0 0) 0x7f46440afb40 con 0x7f46440b1d10 2021-10-21T00:08:05.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4630003260 con 0x7f46440b1d10 2021-10-21T00:08:05.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293183808 0 0) 0x7f4630003260 con 0x7f46440b1d10 2021-10-21T00:08:05.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4648ee9700 1 -- 172.21.15.41:0/4059129346 >> v1:172.21.15.62:6789/0 conn(0x7f46440b5e90 legacy=0x7f46440b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4648ee9700 1 -- 172.21.15.41:0/4059129346 >> v1:172.21.15.41:6789/0 conn(0x7f46440b1d10 legacy=0x7f4644142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4648ee9700 1 -- 172.21.15.41:0/4059129346 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440af7a0 con 0x7f46440b6270 2021-10-21T00:08:05.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4648ee9700 1 --2- 172.21.15.41:0/4059129346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f46440ad280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4634001800 tx=0x7f463c0091d0).ready entity=mon.1 client_cookie=f2bd7caa2194d244 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4634001660 con 0x7f46440b6270 2021-10-21T00:08:05.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00b580 con 0x7f46440b6270 2021-10-21T00:08:05.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f4642ffd700 1 -- 172.21.15.41:0/4059129346 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f463c00b6f0 con 0x7f46440b6270 2021-10-21T00:08:05.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- 172.21.15.41:0/4059129346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 msgr2=0x7f46440ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 --2- 172.21.15.41:0/4059129346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f46440ad280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f4634001800 tx=0x7f463c0091d0).stop 2021-10-21T00:08:05.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- 172.21.15.41:0/4059129346 shutdown_connections 2021-10-21T00:08:05.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 --2- 172.21.15.41:0/4059129346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f46440ad280 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- 172.21.15.41:0/4059129346 >> 172.21.15.41:0/4059129346 conn(0x7f4644063b80 msgr2=0x7f46440b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- 172.21.15.41:0/4059129346 shutdown_connections 2021-10-21T00:08:05.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.656+0000 7f46496ea700 1 -- 172.21.15.41:0/4059129346 wait complete. 2021-10-21T00:08:05.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 Processor -- start 2021-10-21T00:08:05.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- start start 2021-10-21T00:08:05.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46440b1d10 0x7f464410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f4644155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464410e970 con 0x7f46440b5e90 2021-10-21T00:08:05.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644110900 con 0x7f46440b6270 2021-10-21T00:08:05.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464410eba0 con 0x7f46440b1d10 2021-10-21T00:08:05.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33198/0 (socket says 172.21.15.41:33198) 2021-10-21T00:08:05.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 -- 172.21.15.41:0/3778693516 learned_addr learned my addr 172.21.15.41:0/3778693516 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f4648ee9700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f4644155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f4643fff700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46440b1d10 0x7f464410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 -- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46440b1d10 msgr2=0x7f464410f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46440b1d10 0x7f464410f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 -- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 msgr2=0x7f4644155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f4644155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 -- 172.21.15.41:0/3778693516 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009470 con 0x7f46440b5e90 2021-10-21T00:08:05.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f4648ee9700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f4644155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:05.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46437fe700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f46340018c0 tx=0x7f4634001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4634007170 con 0x7f46440b5e90 2021-10-21T00:08:05.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340072d0 con 0x7f46440b5e90 2021-10-21T00:08:05.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4634004920 con 0x7f46440b5e90 2021-10-21T00:08:05.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464410ee40 con 0x7f46440b5e90 2021-10-21T00:08:05.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.660+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4644066e30 con 0x7f46440b5e90 2021-10-21T00:08:05.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.664+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46441428f0 con 0x7f46440b5e90 2021-10-21T00:08:05.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.664+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f463401b070 con 0x7f46440b5e90 2021-10-21T00:08:05.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.664+0000 7f46417fa700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 0x7f46240559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.664+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f463406b150 con 0x7f46440b5e90 2021-10-21T00:08:05.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.664+0000 7f4643fff700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 0x7f46240559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.668+0000 7f4643fff700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 0x7f46240559b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f463800d000 tx=0x7f4638007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.672+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4634042250 con 0x7f46440b5e90 2021-10-21T00:08:05.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.795+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4644057350 con 0x7f46440b5e90 2021-10-21T00:08:05.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.795+0000 7f46417fa700 1 -- 172.21.15.41:0/3778693516 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4634019030 con 0x7f46440b5e90 2021-10-21T00:08:05.804 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:05.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 msgr2=0x7f46240559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 0x7f46240559b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f463800d000 tx=0x7f4638007b90).stop 2021-10-21T00:08:05.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 msgr2=0x7f46440643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f46340018c0 tx=0x7f4634001b30).stop 2021-10-21T00:08:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 shutdown_connections 2021-10-21T00:08:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46240534f0 0x7f46240559b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46440b6270 0x7f4644155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46440b5e90 0x7f46440643e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 --2- 172.21.15.41:0/3778693516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46440b1d10 0x7f464410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 >> 172.21.15.41:0/3778693516 conn(0x7f4644063b80 msgr2=0x7f46440b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 shutdown_connections 2021-10-21T00:08:05.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.799+0000 7f46496ea700 1 -- 172.21.15.41:0/3778693516 wait complete. 2021-10-21T00:08:05.817 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:08:05.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 Processor -- start 2021-10-21T00:08:05.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- start start 2021-10-21T00:08:05.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a500b2170 0x7f4a500ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500b0b50 con 0x7f4a50067a80 2021-10-21T00:08:05.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500b2550 con 0x7f4a500af620 2021-10-21T00:08:05.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500b0d90 con 0x7f4a500b2170 2021-10-21T00:08:05.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a500b2170 0x7f4a500ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a500b2170 0x7f4a500ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33202/0 (socket says 172.21.15.41:33202) 2021-10-21T00:08:05.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 -- 172.21.15.41:0/1384733801 learned_addr learned my addr 172.21.15.41:0/1384733801 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 -- 172.21.15.41:0/1384733801 >> v1:172.21.15.62:6789/0 conn(0x7f4a500af620 legacy=0x7f4a500ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 -- 172.21.15.41:0/1384733801 >> v1:172.21.15.41:6789/0 conn(0x7f4a50067a80 legacy=0x7f4a50149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 -- 172.21.15.41:0/1384733801 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500b1030 con 0x7f4a500b2170 2021-10-21T00:08:05.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4e59c700 1 --2- 172.21.15.41:0/1384733801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500b2170 0x7f4a500ab170 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f4a500aafa0 tx=0x7f4a40006eb0).ready entity=mon.0 client_cookie=dce77a48ce80272f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4d59a700 1 -- 172.21.15.41:0/1384733801 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d660 con 0x7f4a500b2170 2021-10-21T00:08:05.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4d59a700 1 -- 172.21.15.41:0/1384733801 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40000e90 con 0x7f4a500b2170 2021-10-21T00:08:05.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4d59a700 1 -- 172.21.15.41:0/1384733801 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d9f0 con 0x7f4a500b2170 2021-10-21T00:08:05.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- 172.21.15.41:0/1384733801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500b2170 msgr2=0x7f4a500ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/1384733801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500b2170 0x7f4a500ab170 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f4a500aafa0 tx=0x7f4a40006eb0).stop 2021-10-21T00:08:05.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- 172.21.15.41:0/1384733801 shutdown_connections 2021-10-21T00:08:05.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/1384733801 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500b2170 0x7f4a500ab170 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- 172.21.15.41:0/1384733801 >> 172.21.15.41:0/1384733801 conn(0x7f4a500b5700 msgr2=0x7f4a500b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:05.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- 172.21.15.41:0/1384733801 shutdown_connections 2021-10-21T00:08:05.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.923+0000 7f4a4f59e700 1 -- 172.21.15.41:0/1384733801 wait complete. 2021-10-21T00:08:05.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 Processor -- start 2021-10-21T00:08:05.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- start start 2021-10-21T00:08:05.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 0x7f4a500ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a500b2170 0x7f4a50144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50146e50 con 0x7f4a500af620 2021-10-21T00:08:05.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50156fe0 con 0x7f4a50067a80 2021-10-21T00:08:05.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500adfd0 con 0x7f4a500b2170 2021-10-21T00:08:05.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33210/0 (socket says 172.21.15.41:33210) 2021-10-21T00:08:05.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 -- 172.21.15.41:0/77500197 learned_addr learned my addr 172.21.15.41:0/77500197 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:05.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4ed9d700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a500b2170 0x7f4a50144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4e59c700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 0x7f4a500ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 -- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a500b2170 msgr2=0x7f4a50144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a500b2170 0x7f4a50144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 -- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 msgr2=0x7f4a500ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 0x7f4a500ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:05.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 -- 172.21.15.41:0/77500197 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4000b1e0 con 0x7f4a500af620 2021-10-21T00:08:05.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4e59c700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 0x7f4a500ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:05.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4dd9b700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f4a50062740 tx=0x7f4a38007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a38012400 con 0x7f4a500af620 2021-10-21T00:08:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38012560 con 0x7f4a500af620 2021-10-21T00:08:05.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a500ae2b0 con 0x7f4a500af620 2021-10-21T00:08:05.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a380128c0 con 0x7f4a500af620 2021-10-21T00:08:05.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.927+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a500ae7b0 con 0x7f4a500af620 2021-10-21T00:08:05.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a50157150 con 0x7f4a500af620 2021-10-21T00:08:05.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a38019030 con 0x7f4a500af620 2021-10-21T00:08:05.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a477fe700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 0x7f4a34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:05.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a3806aca0 con 0x7f4a500af620 2021-10-21T00:08:05.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a4e59c700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 0x7f4a34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:05.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.931+0000 7f4a4e59c700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 0x7f4a34055ad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4a4001a000 tx=0x7f4a40015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:05.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:05.939+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a50157150 con 0x7f4a500af620 2021-10-21T00:08:06.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.063+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a50157150 con 0x7f4a500af620 2021-10-21T00:08:06.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.063+0000 7f4a477fe700 1 -- 172.21.15.41:0/77500197 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4a50157150 con 0x7f4a500af620 2021-10-21T00:08:06.072 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:06.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 msgr2=0x7f4a34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 0x7f4a34055ad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4a4001a000 tx=0x7f4a40015000).stop 2021-10-21T00:08:06.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 msgr2=0x7f4a501449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f4a50062740 tx=0x7f4a38007c20).stop 2021-10-21T00:08:06.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 shutdown_connections 2021-10-21T00:08:06.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a34053610 0x7f4a34055ad0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a500b2170 0x7f4a50144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a500af620 0x7f4a501449c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 --2- 172.21.15.41:0/77500197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a50067a80 0x7f4a500ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 >> 172.21.15.41:0/77500197 conn(0x7f4a500b5700 msgr2=0x7f4a500b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 shutdown_connections 2021-10-21T00:08:06.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.067+0000 7f4a4f59e700 1 -- 172.21.15.41:0/77500197 wait complete. 2021-10-21T00:08:06.091 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:08:06.092 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:06.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 Processor -- start 2021-10-21T00:08:06.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 -- start start 2021-10-21T00:08:06.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f64600b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64600ab600 0x7f646005fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600b2550 con 0x7f64600602d0 2021-10-21T00:08:06.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600aba40 con 0x7f64600ab600 2021-10-21T00:08:06.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6466143700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460142d60 con 0x7f64600b2170 2021-10-21T00:08:06.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6465942700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f64600602d0 0x7f6460145e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59222/0 (socket says 172.21.15.41:59222) 2021-10-21T00:08:06.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6465942700 1 -- 172.21.15.41:0/3392897906 learned_addr learned my addr 172.21.15.41:0/3392897906 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:06.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 --2- 172.21.15.41:0/3392897906 >> v2:172.21.15.62:3300/0 conn(0x7f64600ab600 0x7f646005fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6465141700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f64600b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6457fff700 1 -- 172.21.15.41:0/3392897906 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932259514 0 0) 0x7f64600b2550 con 0x7f64600602d0 2021-10-21T00:08:06.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6457fff700 1 -- 172.21.15.41:0/3392897906 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6444003260 con 0x7f64600602d0 2021-10-21T00:08:06.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 -- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 msgr2=0x7f64600b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:06.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f64600b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 -- 172.21.15.41:0/3392897906 >> v1:172.21.15.41:6789/0 conn(0x7f64600602d0 legacy=0x7f6460145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 -- 172.21.15.41:0/3392897906 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600b1350 con 0x7f64600ab600 2021-10-21T00:08:06.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6464940700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600ab600 0x7f646005fde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f645c002f70 tx=0x7f645c006df0).ready entity=mon.1 client_cookie=92b1c6685fed35b9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:06.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6457fff700 1 -- 172.21.15.41:0/3392897906 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c00d4a0 con 0x7f64600ab600 2021-10-21T00:08:06.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6457fff700 1 -- 172.21.15.41:0/3392897906 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c000e90 con 0x7f64600ab600 2021-10-21T00:08:06.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.191+0000 7f6457fff700 1 -- 172.21.15.41:0/3392897906 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c00d7f0 con 0x7f64600ab600 2021-10-21T00:08:06.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600ab600 msgr2=0x7f646005fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600ab600 0x7f646005fde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f645c002f70 tx=0x7f645c006df0).stop 2021-10-21T00:08:06.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- 172.21.15.41:0/3392897906 shutdown_connections 2021-10-21T00:08:06.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600ab600 0x7f646005fde0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 --2- 172.21.15.41:0/3392897906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f64600b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- 172.21.15.41:0/3392897906 >> 172.21.15.41:0/3392897906 conn(0x7f64600b5700 msgr2=0x7f64600b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:06.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- 172.21.15.41:0/3392897906 shutdown_connections 2021-10-21T00:08:06.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- 172.21.15.41:0/3392897906 wait complete. 2021-10-21T00:08:06.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 Processor -- start 2021-10-21T00:08:06.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.195+0000 7f6466143700 1 -- start start 2021-10-21T00:08:06.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 0x7f64600995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f646013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646009a7b0 con 0x7f64600ab600 2021-10-21T00:08:06.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460155070 con 0x7f64600602d0 2021-10-21T00:08:06.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460098790 con 0x7f64600b2170 2021-10-21T00:08:06.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33224/0 (socket says 172.21.15.41:33224) 2021-10-21T00:08:06.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 -- 172.21.15.41:0/367579610 learned_addr learned my addr 172.21.15.41:0/367579610 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:06.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6465141700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 0x7f64600995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6465942700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f646013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 -- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 msgr2=0x7f646013eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f646013eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 -- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 msgr2=0x7f64600995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 0x7f64600995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 -- 172.21.15.41:0/367579610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c00b180 con 0x7f64600ab600 2021-10-21T00:08:06.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6465141700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 0x7f64600995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:06.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6464940700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f645c002f70 tx=0x7f645c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:06.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c016070 con 0x7f64600ab600 2021-10-21T00:08:06.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0137d0 con 0x7f64600ab600 2021-10-21T00:08:06.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6460099b80 con 0x7f64600ab600 2021-10-21T00:08:06.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645c013b30 con 0x7f64600ab600 2021-10-21T00:08:06.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600acd70 con 0x7f64600ab600 2021-10-21T00:08:06.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.199+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6460098ec0 con 0x7f64600ab600 2021-10-21T00:08:06.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.203+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f645c025030 con 0x7f64600ab600 2021-10-21T00:08:06.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.203+0000 7f64567fc700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 0x7f64480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:06.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.203+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f645c06c840 con 0x7f64600ab600 2021-10-21T00:08:06.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.203+0000 7f6465141700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 0x7f64480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:06.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.203+0000 7f6465141700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 0x7f64480559b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f645000b000 tx=0x7f6450006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:06.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.211+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6460098ec0 con 0x7f64600ab600 2021-10-21T00:08:06.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.375+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6460098ec0 con 0x7f64600ab600 2021-10-21T00:08:06.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.375+0000 7f64567fc700 1 -- 172.21.15.41:0/367579610 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f645c023870 con 0x7f64600ab600 2021-10-21T00:08:06.385 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:06.385 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:06.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 msgr2=0x7f64480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 0x7f64480559b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f645000b000 tx=0x7f6450006df0).stop 2021-10-21T00:08:06.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 msgr2=0x7f64600ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:06.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f645c002f70 tx=0x7f645c014000).stop 2021-10-21T00:08:06.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 shutdown_connections 2021-10-21T00:08:06.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64480534f0 0x7f64480559b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64600b2170 0x7f646013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64600ab600 0x7f64600ac880 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 --2- 172.21.15.41:0/367579610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64600602d0 0x7f64600995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:06.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 >> 172.21.15.41:0/367579610 conn(0x7f64600b5700 msgr2=0x7f6460148790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:06.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 shutdown_connections 2021-10-21T00:08:06.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:06.379+0000 7f6466143700 1 -- 172.21.15.41:0/367579610 wait complete. 2021-10-21T00:08:06.392 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:06.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:01.577786+0000', 'modified': '2021-10-21T00:08:02.580692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5489}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5489': {'gid': 5489, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/1883344240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 1883344240}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 1883344240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:08:06.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:08:06.600 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:08:06.721 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":5489,"want_state":"up:active","state":"up:active","rank_uptime":5.1252874180000001,"mdsmap_epoch":27,"osdmap_epoch":59,"osdmap_epoch_barrier":58,"uptime":9.5012918519999996} 2021-10-21T00:08:06.722 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 5489, "mdsmap_epoch": 27, "osdmap_epoch": 59, "osdmap_epoch_barrier": 58, "rank_uptime": 5.125287418, "state": "up:active", "uptime": 9.501291852, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:08:06.723 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:08:06.724 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:08:06.724 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:08:06.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:06.726 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:06.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:08:06.751 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:06.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:06.808 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:06.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:06.809 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:08:06.816 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:08:06.817 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:06.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:08:06.835 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:06.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:06.850 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:06.851 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:06.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:06.852 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:08:06.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:08:06.888+0000 7f89cc5c4080 -1 init, newargv = 0x563a27ea56e0 newargc=9ceph-fuse[14378]: starting ceph client 2021-10-21T00:08:06.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr: 2021-10-21T00:08:06.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14378]: starting fuse 2021-10-21T00:08:08.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:08:08.024 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:08.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:08.083 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:08.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.085 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:08:08.090 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:08:08.090 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:08:08.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:08:08.091 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:08:08.092 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:08:08.092 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:08:08.097 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:08:08.097 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.098 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:08:08.098 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:08:08.099 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:08:08.099 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.099 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:08:08.100 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:08:08.100 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:08:08.101 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:08:08.101 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.102 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:08:08.102 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:08:08.102 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:08:08.103 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:08:08.103 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:08:08.104 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.104 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:08:08.105 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:08:08.174 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14378.asok 2021-10-21T00:08:08.179 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14378.asok 2021-10-21T00:08:08.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14378.asok status 2021-10-21T00:08:08.268 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:08:08.268 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:08:08.269 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:08:08.269 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:08:08.269 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:08:08.269 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:08:08.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:08:08.270 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14378", 2021-10-21T00:08:08.270 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:08:08.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:08.270 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:08:08.271 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:08:08.271 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5597, 2021-10-21T00:08:08.271 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:08:08.271 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:08:08.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:08:08.272 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5597 2021-10-21T00:08:08.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:08.272 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:08:08.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:08:08.273 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:08:08.273 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 467518590 2021-10-21T00:08:08.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:08:08.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:08.273 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:08:08.274 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:08:08.274 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:08:08.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 467518590 2021-10-21T00:08:08.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:08.275 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5597 172.21.15.71:0/467518590", 2021-10-21T00:08:08.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/467518590", 2021-10-21T00:08:08.275 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:08:08.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 27, 2021-10-21T00:08:08.276 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 59, 2021-10-21T00:08:08.276 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:08:08.276 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:08:08.277 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:08:08.277 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:08:08.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.278 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:08.279 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:08.285 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:08:08.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:08.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.287 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:08.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:08.348 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:08.348 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:08.355 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:08:08.357 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:08.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:08:08.358 DEBUG:teuthology.orchestra.run.smithi071:> import sys 2021-10-21T00:08:08.359 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:08:08.359 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:08:08.360 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.360 DEBUG:teuthology.orchestra.run.smithi071:> n = 1000 2021-10-21T00:08:08.361 DEBUG:teuthology.orchestra.run.smithi071:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-10-21T00:08:08.361 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.361 DEBUG:teuthology.orchestra.run.smithi071:> if not os.path.exists(os.path.dirname(abs_path)): 2021-10-21T00:08:08.362 DEBUG:teuthology.orchestra.run.smithi071:> os.makedirs(os.path.dirname(abs_path)) 2021-10-21T00:08:08.362 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:08.363 DEBUG:teuthology.orchestra.run.smithi071:> for i in range(0, n): 2021-10-21T00:08:08.363 DEBUG:teuthology.orchestra.run.smithi071:> fname = "{0}_{1}".format(abs_path, i) 2021-10-21T00:08:08.363 DEBUG:teuthology.orchestra.run.smithi071:> with open(fname, '"'"'w'"'"') as f: 2021-10-21T00:08:08.364 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:08:08.364 DEBUG:teuthology.orchestra.run.smithi071:> if True: 2021-10-21T00:08:08.365 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:08:08.365 DEBUG:teuthology.orchestra.run.smithi071:> os.fsync(f.fileno()) 2021-10-21T00:08:08.365 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:08:18.247 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:18.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 Processor -- start 2021-10-21T00:08:18.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- start start 2021-10-21T00:08:18.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5aa80aa750 0x7f5aa814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa814b350 0x7f5aa80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa80609d0 con 0x7f5aa805f9f0 2021-10-21T00:08:18.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa80b1620 con 0x7f5aa80aa750 2021-10-21T00:08:18.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa805fdd0 con 0x7f5aa814b350 2021-10-21T00:08:18.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aae594700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5aa805f9f0 0x7f5aa814a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59232/0 (socket says 172.21.15.41:59232) 2021-10-21T00:08:18.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aae594700 1 -- 172.21.15.41:0/3955477774 learned_addr learned my addr 172.21.15.41:0/3955477774 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:18.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 --2- 172.21.15.41:0/3955477774 >> v2:172.21.15.62:3300/0 conn(0x7f5aa80aa750 0x7f5aa814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aaed95700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa814b350 0x7f5aa80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aad592700 1 -- 172.21.15.41:0/3955477774 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112646987 0 0) 0x7f5aa80609d0 con 0x7f5aa805f9f0 2021-10-21T00:08:18.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aad592700 1 -- 172.21.15.41:0/3955477774 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a94003260 con 0x7f5aa805f9f0 2021-10-21T00:08:18.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 -- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa814b350 msgr2=0x7f5aa80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:18.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa814b350 0x7f5aa80af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 -- 172.21.15.41:0/3955477774 >> v1:172.21.15.41:6789/0 conn(0x7f5aa805f9f0 legacy=0x7f5aa814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 -- 172.21.15.41:0/3955477774 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80b1380 con 0x7f5aa80aa750 2021-10-21T00:08:18.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aadd93700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa80aa750 0x7f5aa814ae60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f5aa00032f0 tx=0x7f5aa00091d0).ready entity=mon.1 client_cookie=808d9c6a9ffc05b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aad592700 1 -- 172.21.15.41:0/3955477774 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000b600 con 0x7f5aa80aa750 2021-10-21T00:08:18.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aad592700 1 -- 172.21.15.41:0/3955477774 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000b760 con 0x7f5aa80aa750 2021-10-21T00:08:18.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5aad592700 1 -- 172.21.15.41:0/3955477774 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000b8d0 con 0x7f5aa80aa750 2021-10-21T00:08:18.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa80aa750 msgr2=0x7f5aa814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa80aa750 0x7f5aa814ae60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f5aa00032f0 tx=0x7f5aa00091d0).stop 2021-10-21T00:08:18.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- 172.21.15.41:0/3955477774 shutdown_connections 2021-10-21T00:08:18.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa814b350 0x7f5aa80af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/3955477774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa80aa750 0x7f5aa814ae60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.351+0000 7f5ab07f8700 1 -- 172.21.15.41:0/3955477774 >> 172.21.15.41:0/3955477774 conn(0x7f5aa805bca0 msgr2=0x7f5aa805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:18.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- 172.21.15.41:0/3955477774 shutdown_connections 2021-10-21T00:08:18.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- 172.21.15.41:0/3955477774 wait complete. 2021-10-21T00:08:18.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 Processor -- start 2021-10-21T00:08:18.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- start start 2021-10-21T00:08:18.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 0x7f5aa8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa80aa750 0x7f5aa80aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8098410 con 0x7f5aa814b350 2021-10-21T00:08:18.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8097ed0 con 0x7f5aa805f9f0 2021-10-21T00:08:18.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5ab07f8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8098170 con 0x7f5aa80aa750 2021-10-21T00:08:18.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5aaed95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5aae594700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 0x7f5aa8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5aadd93700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa80aa750 0x7f5aa80aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5aae594700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 0x7f5aa8147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:45154/0 (socket says 172.21.15.41:45154) 2021-10-21T00:08:18.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aae594700 1 -- 172.21.15.41:0/2227109623 learned_addr learned my addr 172.21.15.41:0/2227109623 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:18.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.355+0000 7f5aaed95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33240/0 (socket says 172.21.15.41:33240) 2021-10-21T00:08:18.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 -- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa80aa750 msgr2=0x7f5aa80aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa80aa750 0x7f5aa80aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 -- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 msgr2=0x7f5aa8147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 0x7f5aa8147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 -- 172.21.15.41:0/2227109623 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0009470 con 0x7f5aa814b350 2021-10-21T00:08:18.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5aaed95700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5a9800c000 tx=0x7f5a98006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a98016070 con 0x7f5aa814b350 2021-10-21T00:08:18.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98011750 con 0x7f5aa814b350 2021-10-21T00:08:18.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa80ad3f0 con 0x7f5aa814b350 2021-10-21T00:08:18.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9800eea0 con 0x7f5aa814b350 2021-10-21T00:08:18.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa81462a0 con 0x7f5aa814b350 2021-10-21T00:08:18.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa80678f0 con 0x7f5aa814b350 2021-10-21T00:08:18.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.359+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a98011ab0 con 0x7f5aa814b350 2021-10-21T00:08:18.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.363+0000 7f5a9f7fe700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 0x7f5a88055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.363+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a9806b880 con 0x7f5aa814b350 2021-10-21T00:08:18.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.363+0000 7f5aae594700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 0x7f5a88055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.363+0000 7f5aae594700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 0x7f5a88055a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f5aa400d000 tx=0x7f5aa4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.371+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a980429f0 con 0x7f5aa814b350 2021-10-21T00:08:18.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5aa8057350 con 0x7f5aa814b350 2021-10-21T00:08:18.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5a9f7fe700 1 -- 172.21.15.41:0/2227109623 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f5a98046010 con 0x7f5aa814b350 2021-10-21T00:08:18.538 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:18.539 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:18.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 msgr2=0x7f5a88055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 0x7f5a88055a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f5aa400d000 tx=0x7f5aa4009040).stop 2021-10-21T00:08:18.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 msgr2=0x7f5aa80acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5a9800c000 tx=0x7f5a98006df0).stop 2021-10-21T00:08:18.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 shutdown_connections 2021-10-21T00:08:18.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a88053580 0x7f5a88055a40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5aa814b350 0x7f5aa80acf00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5aa80aa750 0x7f5aa80aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 --2- 172.21.15.41:0/2227109623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5aa805f9f0 0x7f5aa8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 >> 172.21.15.41:0/2227109623 conn(0x7f5aa805bca0 msgr2=0x7f5aa80b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:18.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 shutdown_connections 2021-10-21T00:08:18.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.531+0000 7f5ab07f8700 1 -- 172.21.15.41:0/2227109623 wait complete. 2021-10-21T00:08:18.545 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:18.552 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-10-21T00:08:18.656 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-10-21T00:08:18.657 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-10-21T00:08:18.657 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:18.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 Processor -- start 2021-10-21T00:08:18.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 -- start start 2021-10-21T00:08:18.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f171005f9f0 0x7f171014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17100aa750 0x7f171014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100609d0 con 0x7f171014b130 2021-10-21T00:08:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100b1620 con 0x7f171005f9f0 2021-10-21T00:08:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171005fdd0 con 0x7f17100aa750 2021-10-21T00:08:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f171005f9f0 0x7f171014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f171005f9f0 0x7f171014a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33244/0 (socket says 172.21.15.41:33244) 2021-10-21T00:08:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 -- 172.21.15.41:0/2702177054 learned_addr learned my addr 172.21.15.41:0/2702177054 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170dd9b700 1 --2- 172.21.15.41:0/2702177054 >> v2:172.21.15.62:3300/0 conn(0x7f17100aa750 0x7f171014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 -- 172.21.15.41:0/2702177054 >> v2:172.21.15.62:3300/0 conn(0x7f17100aa750 msgr2=0x7f171014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:18.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 --2- 172.21.15.41:0/2702177054 >> v2:172.21.15.62:3300/0 conn(0x7f17100aa750 0x7f171014ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 -- 172.21.15.41:0/2702177054 >> v1:172.21.15.41:6789/0 conn(0x7f171014b130 legacy=0x7f17101495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 -- 172.21.15.41:0/2702177054 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171014b580 con 0x7f171005f9f0 2021-10-21T00:08:18.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170e59c700 1 --2- 172.21.15.41:0/2702177054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f171005f9f0 0x7f171014a750 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f16f8002f70 tx=0x7f16f8006eb0).ready entity=mon.0 client_cookie=b29ab521cb6b8639 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170d59a700 1 -- 172.21.15.41:0/2702177054 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16f800d5c0 con 0x7f171005f9f0 2021-10-21T00:08:18.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170d59a700 1 -- 172.21.15.41:0/2702177054 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8000e90 con 0x7f171005f9f0 2021-10-21T00:08:18.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f170d59a700 1 -- 172.21.15.41:0/2702177054 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16f800d950 con 0x7f171005f9f0 2021-10-21T00:08:18.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 -- 172.21.15.41:0/2702177054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f171005f9f0 msgr2=0x7f171014a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.751+0000 7f1714dba700 1 --2- 172.21.15.41:0/2702177054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f171005f9f0 0x7f171014a750 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f16f8002f70 tx=0x7f16f8006eb0).stop 2021-10-21T00:08:18.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- 172.21.15.41:0/2702177054 shutdown_connections 2021-10-21T00:08:18.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 --2- 172.21.15.41:0/2702177054 >> v2:172.21.15.62:3300/0 conn(0x7f17100aa750 0x7f171014ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 --2- 172.21.15.41:0/2702177054 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f171005f9f0 0x7f171014a750 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- 172.21.15.41:0/2702177054 >> 172.21.15.41:0/2702177054 conn(0x7f171005bca0 msgr2=0x7f171005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:18.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- 172.21.15.41:0/2702177054 shutdown_connections 2021-10-21T00:08:18.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- 172.21.15.41:0/2702177054 wait complete. 2021-10-21T00:08:18.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 Processor -- start 2021-10-21T00:08:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- start start 2021-10-21T00:08:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f171005f9f0 0x7f17100992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f171014b130 0x7f1710066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100adee0 con 0x7f17100aa750 2021-10-21T00:08:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100ae110 con 0x7f171014b130 2021-10-21T00:08:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100ae3b0 con 0x7f171005f9f0 2021-10-21T00:08:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33250/0 (socket says 172.21.15.41:33250) 2021-10-21T00:08:18.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 -- 172.21.15.41:0/2853497567 learned_addr learned my addr 172.21.15.41:0/2853497567 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:18.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170ed9d700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f171014b130 0x7f1710066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170e59c700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f171005f9f0 0x7f17100992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 -- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f171005f9f0 msgr2=0x7f17100992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f171005f9f0 0x7f17100992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 -- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f171014b130 msgr2=0x7f1710066f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f171014b130 0x7f1710066f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 -- 172.21.15.41:0/2853497567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f800b1e0 con 0x7f17100aa750 2021-10-21T00:08:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f170dd9b700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f170800c000 tx=0x7f17080091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f170800c850 con 0x7f17100aa750 2021-10-21T00:08:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800c9b0 con 0x7f17100aa750 2021-10-21T00:08:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17100673f0 con 0x7f17100aa750 2021-10-21T00:08:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.755+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f170800cd10 con 0x7f17100aa750 2021-10-21T00:08:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17100adc80 con 0x7f17100aa750 2021-10-21T00:08:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17100b1380 con 0x7f17100aa750 2021-10-21T00:08:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1708022070 con 0x7f17100aa750 2021-10-21T00:08:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f17077fe700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 0x7f16f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f170806c0a0 con 0x7f17100aa750 2021-10-21T00:08:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.759+0000 7f170e59c700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 0x7f16f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.763+0000 7f170e59c700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 0x7f16f4055ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f16f801a000 tx=0x7f16f8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.767+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1708043180 con 0x7f17100aa750 2021-10-21T00:08:18.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.943+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17100686c0 con 0x7f17100aa750 2021-10-21T00:08:18.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f17077fe700 1 -- 172.21.15.41:0/2853497567 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f17080467a0 con 0x7f17100aa750 2021-10-21T00:08:18.953 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:18.954 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:18.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 msgr2=0x7f16f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 0x7f16f4055ad0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f16f801a000 tx=0x7f16f8015000).stop 2021-10-21T00:08:18.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 msgr2=0x7f1710066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:18.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f170800c000 tx=0x7f17080091d0).stop 2021-10-21T00:08:18.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 shutdown_connections 2021-10-21T00:08:18.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f16f4053610 0x7f16f4055ad0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f171014b130 0x7f1710066f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17100aa750 0x7f1710066a10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 --2- 172.21.15.41:0/2853497567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f171005f9f0 0x7f17100992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:18.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 >> 172.21.15.41:0/2853497567 conn(0x7f171005bca0 msgr2=0x7f171005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:18.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 shutdown_connections 2021-10-21T00:08:18.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:18.947+0000 7f1714dba700 1 -- 172.21.15.41:0/2853497567 wait complete. 2021-10-21T00:08:18.959 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:18.966 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-10-21T00:08:19.065 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-10-21T00:08:19.065 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-10-21T00:08:19.066 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:19.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.159+0000 7f992ee79700 1 Processor -- start 2021-10-21T00:08:19.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.159+0000 7f992ee79700 1 -- start start 2021-10-21T00:08:19.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 0x7f9928152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280609d0 con 0x7f99280aa750 2021-10-21T00:08:19.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992805fdd0 con 0x7f992805f9f0 2021-10-21T00:08:19.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280b1620 con 0x7f992814fc90 2021-10-21T00:08:19.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f9927fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f99280aa750 0x7f992814ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59262/0 (socket says 172.21.15.41:59262) 2021-10-21T00:08:19.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f9927fff700 1 -- 172.21.15.41:0/4282437682 learned_addr learned my addr 172.21.15.41:0/4282437682 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:19.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992d416700 1 --2- 172.21.15.41:0/4282437682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 0x7f9928152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418261833 0 0) 0x7f99280609d0 con 0x7f99280aa750 2021-10-21T00:08:19.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9914003260 con 0x7f99280aa750 2021-10-21T00:08:19.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872611138 0 0) 0x7f992805fdd0 con 0x7f992805f9f0 2021-10-21T00:08:19.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99280609d0 con 0x7f992805f9f0 2021-10-21T00:08:19.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992d416700 1 -- 172.21.15.41:0/4282437682 >> v1:172.21.15.62:6789/0 conn(0x7f992805f9f0 legacy=0x7f992814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992d416700 1 -- 172.21.15.41:0/4282437682 >> v1:172.21.15.41:6789/0 conn(0x7f99280aa750 legacy=0x7f992814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126544448 0 0) 0x7f9914003260 con 0x7f99280aa750 2021-10-21T00:08:19.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992d416700 1 -- 172.21.15.41:0/4282437682 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992814b570 con 0x7f992814fc90 2021-10-21T00:08:19.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992d416700 1 --2- 172.21.15.41:0/4282437682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 0x7f9928152080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f991c001110 tx=0x7f9918006df0).ready entity=mon.2 client_cookie=9128881d33608fd2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991c001680 con 0x7f992814fc90 2021-10-21T00:08:19.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918000e90 con 0x7f992814fc90 2021-10-21T00:08:19.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f99277fe700 1 -- 172.21.15.41:0/4282437682 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9918012460 con 0x7f992814fc90 2021-10-21T00:08:19.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- 172.21.15.41:0/4282437682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 msgr2=0x7f9928152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 --2- 172.21.15.41:0/4282437682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 0x7f9928152080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f991c001110 tx=0x7f9918006df0).stop 2021-10-21T00:08:19.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- 172.21.15.41:0/4282437682 shutdown_connections 2021-10-21T00:08:19.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 --2- 172.21.15.41:0/4282437682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f992814fc90 0x7f9928152080 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- 172.21.15.41:0/4282437682 >> 172.21.15.41:0/4282437682 conn(0x7f992805bca0 msgr2=0x7f992805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- 172.21.15.41:0/4282437682 shutdown_connections 2021-10-21T00:08:19.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.163+0000 7f992ee79700 1 -- 172.21.15.41:0/4282437682 wait complete. 2021-10-21T00:08:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 Processor -- start 2021-10-21T00:08:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- start start 2021-10-21T00:08:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f992805f9f0 0x7f99280adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99280aa750 0x7f992814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280999f0 con 0x7f992814fc90 2021-10-21T00:08:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280adfc0 con 0x7f992805f9f0 2021-10-21T00:08:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280ae200 con 0x7f99280aa750 2021-10-21T00:08:19.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33268/0 (socket says 172.21.15.41:33268) 2021-10-21T00:08:19.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 -- 172.21.15.41:0/210119869 learned_addr learned my addr 172.21.15.41:0/210119869 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992cc15700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f992805f9f0 0x7f99280adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f9927fff700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99280aa750 0x7f992814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 -- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99280aa750 msgr2=0x7f992814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99280aa750 0x7f992814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 -- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f992805f9f0 msgr2=0x7f99280adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f992805f9f0 0x7f99280adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 -- 172.21.15.41:0/210119869 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991800b180 con 0x7f992814fc90 2021-10-21T00:08:19.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992d416700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f9928099b30 tx=0x7f9918014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9918016070 con 0x7f992814fc90 2021-10-21T00:08:19.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918002f50 con 0x7f992814fc90 2021-10-21T00:08:19.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280ae4a0 con 0x7f992814fc90 2021-10-21T00:08:19.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9918012460 con 0x7f992814fc90 2021-10-21T00:08:19.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99280ac260 con 0x7f992814fc90 2021-10-21T00:08:19.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.167+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99280b1380 con 0x7f992814fc90 2021-10-21T00:08:19.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.171+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9918025030 con 0x7f992814fc90 2021-10-21T00:08:19.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.171+0000 7f9925ffb700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 0x7f9908055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.171+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f991806c790 con 0x7f992814fc90 2021-10-21T00:08:19.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.171+0000 7f992cc15700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 0x7f9908055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.171+0000 7f992cc15700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 0x7f9908055ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f992000d000 tx=0x7f9920007e30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.179+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99180438f0 con 0x7f992814fc90 2021-10-21T00:08:19.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.343+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9928057350 con 0x7f992814fc90 2021-10-21T00:08:19.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f9925ffb700 1 -- 172.21.15.41:0/210119869 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f9918023090 con 0x7f992814fc90 2021-10-21T00:08:19.354 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:19.354 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:19.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 msgr2=0x7f9908055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 0x7f9908055ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f992000d000 tx=0x7f9920007e30).stop 2021-10-21T00:08:19.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 msgr2=0x7f9928098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f9928099b30 tx=0x7f9918014000).stop 2021-10-21T00:08:19.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 shutdown_connections 2021-10-21T00:08:19.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9908053610 0x7f9908055ad0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f992814fc90 0x7f9928098840 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99280aa750 0x7f992814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 --2- 172.21.15.41:0/210119869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f992805f9f0 0x7f99280adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 >> 172.21.15.41:0/210119869 conn(0x7f992805bca0 msgr2=0x7f99280b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 shutdown_connections 2021-10-21T00:08:19.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.347+0000 7f992ee79700 1 -- 172.21.15.41:0/210119869 wait complete. 2021-10-21T00:08:19.359 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:19.366 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-10-21T00:08:19.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 Processor -- start 2021-10-21T00:08:19.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 -- start start 2021-10-21T00:08:19.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 0x7fe4a80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe4a8062f70 0x7fe4a805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a805bd40 con 0x7fe4a80b3a20 2021-10-21T00:08:19.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a805bf70 con 0x7fe4a8062f70 2021-10-21T00:08:19.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a8142cb0 con 0x7fe4a8062330 2021-10-21T00:08:19.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a6d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe4a80b3a20 0x7fe4a813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59278/0 (socket says 172.21.15.41:59278) 2021-10-21T00:08:19.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a5d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe4a8062f70 0x7fe4a805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.463+0000 7fe4a6d9d700 1 -- 172.21.15.41:0/1087451558 learned_addr learned my addr 172.21.15.41:0/1087451558 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:19.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1087451558 >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 0x7fe4a80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1087451558 >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 msgr2=0x7fe4a80b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1087451558 >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 0x7fe4a80b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1087451558 >> v1:172.21.15.41:6789/0 conn(0x7fe4a80b3a20 legacy=0x7fe4a813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a559a700 1 -- 172.21.15.41:0/1087451558 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692080394 0 0) 0x7fe4a805bd40 con 0x7fe4a80b3a20 2021-10-21T00:08:19.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1087451558 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8142950 con 0x7fe4a8062f70 2021-10-21T00:08:19.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1087451558 >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 0x7fe4a80b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:19.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1087451558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a805c410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490006df0).ready entity=mon.0 client_cookie=a9c97e132fc4e5d7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a559a700 1 -- 172.21.15.41:0/1087451558 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49000d5c0 con 0x7fe4a8062f70 2021-10-21T00:08:19.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a559a700 1 -- 172.21.15.41:0/1087451558 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490000e90 con 0x7fe4a8062f70 2021-10-21T00:08:19.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a559a700 1 -- 172.21.15.41:0/1087451558 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe49000d910 con 0x7fe4a8062f70 2021-10-21T00:08:19.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- 172.21.15.41:0/1087451558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 msgr2=0x7fe4a805c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 --2- 172.21.15.41:0/1087451558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a805c410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490006df0).stop 2021-10-21T00:08:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- 172.21.15.41:0/1087451558 shutdown_connections 2021-10-21T00:08:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 --2- 172.21.15.41:0/1087451558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a805c410 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 --2- 172.21.15.41:0/1087451558 >> v2:172.21.15.62:3300/0 conn(0x7fe4a8062330 0x7fe4a80b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- 172.21.15.41:0/1087451558 >> 172.21.15.41:0/1087451558 conn(0x7fe4a80b9080 msgr2=0x7fe4a80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- 172.21.15.41:0/1087451558 shutdown_connections 2021-10-21T00:08:19.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- 172.21.15.41:0/1087451558 wait complete. 2021-10-21T00:08:19.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 Processor -- start 2021-10-21T00:08:19.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.467+0000 7fe4a759e700 1 -- start start 2021-10-21T00:08:19.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 0x7fe4a8141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4a80b3a20 0x7fe4a8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8146bd0 con 0x7fe4a8062f70 2021-10-21T00:08:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a81461b0 con 0x7fe4a80b3a20 2021-10-21T00:08:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80ad8b0 con 0x7fe4a8062330 2021-10-21T00:08:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33280/0 (socket says 172.21.15.41:33280) 2021-10-21T00:08:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/2739343788 learned_addr learned my addr 172.21.15.41:0/2739343788 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4a80b3a20 0x7fe4a8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a659c700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 0x7fe4a8141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 msgr2=0x7fe4a8141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 0x7fe4a8141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4a80b3a20 msgr2=0x7fe4a8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4a80b3a20 0x7fe4a8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/2739343788 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49000b180 con 0x7fe4a8062f70 2021-10-21T00:08:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a659c700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 0x7fe4a8141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe49f7fe700 1 -- 172.21.15.41:0/2739343788 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490016070 con 0x7fe4a8062f70 2021-10-21T00:08:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe49f7fe700 1 -- 172.21.15.41:0/2739343788 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000de40 con 0x7fe4a8062f70 2021-10-21T00:08:19.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a80addc0 con 0x7fe4a8062f70 2021-10-21T00:08:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe49f7fe700 1 -- 172.21.15.41:0/2739343788 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490013e90 con 0x7fe4a8062f70 2021-10-21T00:08:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.471+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8143e70 con 0x7fe4a8062f70 2021-10-21T00:08:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe49f7fe700 1 -- 172.21.15.41:0/2739343788 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe49000f030 con 0x7fe4a8062f70 2021-10-21T00:08:19.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe49f7fe700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 0x7fe48c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe49f7fe700 1 -- 172.21.15.41:0/2739343788 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe49006c7d0 con 0x7fe4a8062f70 2021-10-21T00:08:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a659c700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 0x7fe48c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a659c700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 0x7fe48c055a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fe49800c000 tx=0x7fe498008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 Processor -- start 2021-10-21T00:08:19.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 -- start start 2021-10-21T00:08:19.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d923d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1d957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ccc240 con 0x1d57dc0 2021-10-21T00:08:19.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cac8d0 con 0x1d56ce0 2021-10-21T00:08:19.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d570c0 con 0x1d95330 2021-10-21T00:08:19.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33288/0 (socket says 172.21.15.41:33288) 2021-10-21T00:08:19.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/939809465 learned_addr learned my addr 172.21.15.41:0/939809465 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a659c700 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.475+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1d957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 msgr2=0x1d957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1d957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 msgr2=0x1d923d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d923d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/939809465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d03d00 con 0x1d57dc0 2021-10-21T00:08:19.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe49006adf0 tx=0x7fe490010000).ready entity=mon.0 client_cookie=b0d2cf2efcfa43b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a759e700 1 -- 172.21.15.41:0/939809465 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490046dc0 con 0x1d57dc0 2021-10-21T00:08:19.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a759e700 1 -- 172.21.15.41:0/939809465 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490047400 con 0x1d57dc0 2021-10-21T00:08:19.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4a759e700 1 -- 172.21.15.41:0/939809465 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490046b40 con 0x1d57dc0 2021-10-21T00:08:19.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- 172.21.15.41:0/939809465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 msgr2=0x1d5ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe49006adf0 tx=0x7fe490010000).stop 2021-10-21T00:08:19.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- 172.21.15.41:0/939809465 shutdown_connections 2021-10-21T00:08:19.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1d957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1d5ccb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- 172.21.15.41:0/939809465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d923d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- 172.21.15.41:0/939809465 >> 172.21.15.41:0/939809465 conn(0x1d588c0 msgr2=0x1d58fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- 172.21.15.41:0/939809465 shutdown_connections 2021-10-21T00:08:19.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- 172.21.15.41:0/939809465 wait complete. 2021-10-21T00:08:19.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- start start 2021-10-21T00:08:19.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 Processor -- start 2021-10-21T00:08:19.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d9a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d57dc0 0x1da3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d5e3c0 con 0x1d95330 2021-10-21T00:08:19.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1da4800 con 0x1d56ce0 2021-10-21T00:08:19.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d5e120 con 0x1d57dc0 2021-10-21T00:08:19.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.479+0000 7fe4b701b740 10 client.0 ll_register_callbacks cb 0x1d132e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:08:19.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33296/0 (socket says 172.21.15.41:33296) 2021-10-21T00:08:19.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d9a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 -- 172.21.15.41:0/3967822823 learned_addr learned my addr 172.21.15.41:0/3967822823 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d57dc0 0x1da3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 -- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d57dc0 msgr2=0x1da3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d57dc0 0x1da3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 -- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 msgr2=0x1d9a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d9a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 -- 172.21.15.41:0/3967822823 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8143e70 con 0x1d95330 2021-10-21T00:08:19.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe4a0009000 tx=0x7fe4a0009040).ready entity=mon.0 client_cookie=7849aed4f9c54c33 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:08:19.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4a0005970 con 0x1d95330 2021-10-21T00:08:19.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe4a0005ad0 con 0x1d95330 2021-10-21T00:08:19.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1cc2220 con 0x1d95330 2021-10-21T00:08:19.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a0007a40 con 0x1d95330 2021-10-21T00:08:19.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 10 client.6165 fetch_fsmap learned FSMap version 27 2021-10-21T00:08:19.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x1cbbb00 con 0x1d95330 2021-10-21T00:08:19.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1cc2220 con 0x1d95330 2021-10-21T00:08:19.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 27) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe4a0005c90 con 0x1d95330 2021-10-21T00:08:19.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 10 client.6165 fetch_fsmap finished waiting for FSMap version 27 2021-10-21T00:08:19.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 10 client.6165 resolve_mds: resolved ID 'a' to GID 5489 2021-10-21T00:08:19.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 20 client.6165 populate_metadata read hostname 'smithi041' 2021-10-21T00:08:19.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d96f10 0x1d8bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 4 client.6165 mds_command: new command op to 5489 tid=0[{"prefix": "get_command_descriptions"}] 2021-10-21T00:08:19.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 --> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1cba590 con 0x1d96f10 2021-10-21T00:08:19.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a659c700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d96f10 0x1d8bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 10 client.6165 ms_handle_connect on v2:172.21.15.41:6832/1883344240 2021-10-21T00:08:19.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4a659c700 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d96f10 0x1d8bd70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=86f33e477b30ed23 server_cookie=72ddb586a7fc0a72 in_seq=0 out_seq=0 2021-10-21T00:08:19.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 1 -- 172.21.15.41:0/3967822823 <== mds.0 v2:172.21.15.41:6832/1883344240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1cba590 con 0x1d96f10 2021-10-21T00:08:19.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 10 client.6165 handle_command_reply: tid=0 2021-10-21T00:08:19.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 client.6165 shutdown 2021-10-21T00:08:19.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 msgr2=0x1da4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe4a0009000 tx=0x7fe4a0009040).stop 2021-10-21T00:08:19.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 shutdown_connections 2021-10-21T00:08:19.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d96f10 0x1d8bd70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d95330 0x1da4310 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4857fa700 0 client.6165 ms_handle_reset on v2:172.21.15.41:6832/1883344240 2021-10-21T00:08:19.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d57dc0 0x1da3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 --2- 172.21.15.41:0/3967822823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d56ce0 0x1d9a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 >> 172.21.15.41:0/3967822823 conn(0x1d588c0 msgr2=0x1d957e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 shutdown_connections 2021-10-21T00:08:19.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 1 -- 172.21.15.41:0/3967822823 wait complete. 2021-10-21T00:08:19.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.483+0000 7fe4b701b740 20 client.6165 trim_cache size 0 max 16384 2021-10-21T00:08:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 Processor -- start 2021-10-21T00:08:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- start start 2021-10-21T00:08:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d56ce0 0x1d996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d95330 0x1da3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d96dd0 con 0x1d57dc0 2021-10-21T00:08:19.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d58770 con 0x1d95330 2021-10-21T00:08:19.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d97530 con 0x1d56ce0 2021-10-21T00:08:19.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33302/0 (socket says 172.21.15.41:33302) 2021-10-21T00:08:19.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1478599607 learned_addr learned my addr 172.21.15.41:0/1478599607 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d95330 0x1da3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d56ce0 0x1d996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d56ce0 msgr2=0x1d996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d56ce0 0x1d996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d95330 msgr2=0x1da3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d95330 0x1da3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 -- 172.21.15.41:0/1478599607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cc4400 con 0x1d57dc0 2021-10-21T00:08:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x1cb22b0 tx=0x7fe490003080).ready entity=mon.0 client_cookie=5f2d4336ac7bfb20 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4877fe700 1 -- 172.21.15.41:0/1478599607 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe490046dc0 con 0x1d57dc0 2021-10-21T00:08:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4877fe700 1 -- 172.21.15.41:0/1478599607 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490046950 con 0x1d57dc0 2021-10-21T00:08:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4877fe700 1 -- 172.21.15.41:0/1478599607 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4900463c0 con 0x1d57dc0 2021-10-21T00:08:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- 172.21.15.41:0/1478599607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 msgr2=0x1db0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x1cb22b0 tx=0x7fe490003080).stop 2021-10-21T00:08:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- 172.21.15.41:0/1478599607 shutdown_connections 2021-10-21T00:08:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d95330 0x1da3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d57dc0 0x1db0a50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1478599607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d56ce0 0x1d996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- 172.21.15.41:0/1478599607 >> 172.21.15.41:0/1478599607 conn(0x1d588c0 msgr2=0x1d8d910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- 172.21.15.41:0/1478599607 shutdown_connections 2021-10-21T00:08:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- 172.21.15.41:0/1478599607 wait complete. 2021-10-21T00:08:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 -- start start 2021-10-21T00:08:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.503+0000 7fe4b701b740 1 Processor -- start 2021-10-21T00:08:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d57dc0 0x1df4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1da00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8d230 con 0x1d56ce0 2021-10-21T00:08:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d987e0 con 0x1d57dc0 2021-10-21T00:08:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d92c60 con 0x1d95330 2021-10-21T00:08:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 10 client.0 ll_register_callbacks cb 0x1d983e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-10-21T00:08:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33306/0 (socket says 172.21.15.41:33306) 2021-10-21T00:08:19.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 -- 172.21.15.41:0/1908321166 learned_addr learned my addr 172.21.15.41:0/1908321166 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:19.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a6d9d700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1da00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d57dc0 0x1df4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 -- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 msgr2=0x1da00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1da00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 -- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d57dc0 msgr2=0x1df4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d57dc0 0x1df4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 -- 172.21.15.41:0/1908321166 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1d03d00 con 0x1d56ce0 2021-10-21T00:08:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a659c700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe49801e000 tx=0x7fe498023040).ready entity=mon.0 client_cookie=f69c750959218058 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 10 client.0 ms_handle_connect on v2:172.21.15.41:3300/0 2021-10-21T00:08:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe498029400 con 0x1d56ce0 2021-10-21T00:08:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mon.0 v2:172.21.15.41:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe498021e40 con 0x1d56ce0 2021-10-21T00:08:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe490047400 con 0x1d56ce0 2021-10-21T00:08:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe498029560 con 0x1d56ce0 2021-10-21T00:08:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 10 client.6171 fetch_fsmap learned FSMap version 27 2021-10-21T00:08:19.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x1cc0df0 con 0x1d56ce0 2021-10-21T00:08:19.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mon.0 v2:172.21.15.41:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498000e90 con 0x1d56ce0 2021-10-21T00:08:19.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mon.0 v2:172.21.15.41:3300/0 5 ==== fsmap(e 27) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fe498029c10 con 0x1d56ce0 2021-10-21T00:08:19.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 10 client.6171 fetch_fsmap finished waiting for FSMap version 27 2021-10-21T00:08:19.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 10 client.6171 resolve_mds: resolved ID 'a' to GID 5489 2021-10-21T00:08:19.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 20 client.6171 populate_metadata read hostname 'smithi041' 2021-10-21T00:08:19.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d995c0 0x1d999a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:19.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 4 client.6171 mds_command: new command op to 5489 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-10-21T00:08:19.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 --> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x1bb05e0 con 0x1d995c0 2021-10-21T00:08:19.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d995c0 0x1d999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:19.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4867fc700 10 client.6171 ms_handle_connect on v2:172.21.15.41:6832/1883344240 2021-10-21T00:08:19.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:19.507+0000 7fe4a5d9b700 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d995c0 0x1d999a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cc31ccf2024875e5 server_cookie=71c6848cf93834b5 in_seq=0 out_seq=0 2021-10-21T00:08:28.092 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:28.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:28.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:28.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:28.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4867fc700 1 -- 172.21.15.41:0/1908321166 <== mds.0 v2:172.21.15.41:6832/1883344240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x1bb05e0 con 0x1d995c0 2021-10-21T00:08:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4867fc700 10 client.6171 handle_command_reply: tid=0 2021-10-21T00:08:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 client.6171 shutdown 2021-10-21T00:08:29.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 msgr2=0x1d8c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe49801e000 tx=0x7fe498023040).stop 2021-10-21T00:08:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 shutdown_connections 2021-10-21T00:08:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:6832/1883344240,v1:172.21.15.41:6833/1883344240] conn(0x1d995c0 0x1d999a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x1d95330 0x1da00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1d57dc0 0x1df4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4867fc700 0 client.6171 ms_handle_reset on v2:172.21.15.41:6832/1883344240 2021-10-21T00:08:29.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 --2- 172.21.15.41:0/1908321166 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x1d56ce0 0x1d8c660 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 >> 172.21.15.41:0/1908321166 conn(0x1d588c0 msgr2=0x1d8d680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:29.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 shutdown_connections 2021-10-21T00:08:29.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 1 -- 172.21.15.41:0/1908321166 wait complete. 2021-10-21T00:08:29.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.775+0000 7fe4b701b740 20 client.6171 trim_cache size 0 max 16384 2021-10-21T00:08:29.786 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:08:29.786 INFO:teuthology.orchestra.run.smithi041.stdout: "client_recall": { 2021-10-21T00:08:29.786 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": -110, 2021-10-21T00:08:29.786 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "(110) Connection timed out", 2021-10-21T00:08:29.787 INFO:teuthology.orchestra.run.smithi041.stdout: "recalled": 240 2021-10-21T00:08:29.787 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:29.787 INFO:teuthology.orchestra.run.smithi041.stdout: "flush_journal": { 2021-10-21T00:08:29.787 INFO:teuthology.orchestra.run.smithi041.stdout: "return_code": 0, 2021-10-21T00:08:29.787 INFO:teuthology.orchestra.run.smithi041.stdout: "message": "" 2021-10-21T00:08:29.788 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:29.788 INFO:teuthology.orchestra.run.smithi041.stdout: "trim_cache": { 2021-10-21T00:08:29.788 INFO:teuthology.orchestra.run.smithi041.stdout: "trimmed": 220 2021-10-21T00:08:29.788 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:29.789 INFO:teuthology.orchestra.run.smithi041.stdout: "cache": { 2021-10-21T00:08:29.789 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": { 2021-10-21T00:08:29.789 INFO:teuthology.orchestra.run.smithi041.stdout: "items": 15452, 2021-10-21T00:08:29.789 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes": 2428496 2021-10-21T00:08:29.789 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:29.790 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:29.790 INFO:teuthology.orchestra.run.smithi041.stdout: "duration": 10.263656437 2021-10-21T00:08:29.790 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:08:29.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 msgr2=0x7fe48c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:29.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 0x7fe48c055a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fe49800c000 tx=0x7fe498008040).stop 2021-10-21T00:08:29.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 msgr2=0x7fe4a8151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:29.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fe490002f70 tx=0x7fe490014000).stop 2021-10-21T00:08:29.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 shutdown_connections 2021-10-21T00:08:29.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe48c053580 0x7fe48c055a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4a80b3a20 0x7fe4a8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4a8062f70 0x7fe4a8151fa0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 --2- 172.21.15.41:0/2739343788 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4a8062330 0x7fe4a8141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:29.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 >> 172.21.15.41:0/2739343788 conn(0x7fe4a80b9080 msgr2=0x7fe4a805c330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:29.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 shutdown_connections 2021-10-21T00:08:29.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:29.779+0000 7fe4a759e700 1 -- 172.21.15.41:0/2739343788 wait complete. 2021-10-21T00:08:29.796 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:08:29.797 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:29.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:29.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:29.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:29.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:29.901 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:08:29.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:29.902 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:29.902 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:29.911 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:08:30.496 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:30.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:08:30.498 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:08:30.498 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:30.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14378]: fuse finished with error 0 and tester_r 0 2021-10-21T00:08:30.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:30.559 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:30.560 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:30.567 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:08:30.568 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:08:30.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:08:30.684 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:30.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:30.692 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:30.693 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:08:30.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:30.702 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:08:30.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:08:30.703 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:30.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:30.711 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:08:30.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:30.712 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:30.712 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:08:30.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:30.721 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:08:30.721 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:08:30.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:08:30.722 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:08:30.768 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:08:30.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:30.770 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:08:30.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 Processor -- start 2021-10-21T00:08:30.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- start start 2021-10-21T00:08:30.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6f809a450 0x7fe6f80609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f80ab880 0x7fe6f805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6f805fba0 0x7fe6f8060030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f80abd10 con 0x7fe6f805fba0 2021-10-21T00:08:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8060520 con 0x7fe6f809a450 2021-10-21T00:08:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f809a830 con 0x7fe6f80ab880 2021-10-21T00:08:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6f805fba0 0x7fe6f8060030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe6f805fba0 0x7fe6f8060030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33320/0 (socket says 172.21.15.41:33320) 2021-10-21T00:08:30.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 -- 172.21.15.41:0/2146592459 learned_addr learned my addr 172.21.15.41:0/2146592459 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:30.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6ee7fc700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f80ab880 0x7fe6f805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f6ffd700 1 --2- 172.21.15.41:0/2146592459 >> v2:172.21.15.62:3300/0 conn(0x7fe6f809a450 0x7fe6f80609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 -- 172.21.15.41:0/2146592459 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f80ab880 msgr2=0x7fe6f805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:30.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f80ab880 0x7fe6f805f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 -- 172.21.15.41:0/2146592459 >> v2:172.21.15.62:3300/0 conn(0x7fe6f809a450 msgr2=0x7fe6f80609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:30.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 --2- 172.21.15.41:0/2146592459 >> v2:172.21.15.62:3300/0 conn(0x7fe6f809a450 0x7fe6f80609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 -- 172.21.15.41:0/2146592459 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80afed0 con 0x7fe6f805fba0 2021-10-21T00:08:30.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f77fe700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f805fba0 0x7fe6f8060030 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fe6f80afdf0 tx=0x7fe6f0009290).ready entity=mon.0 client_cookie=32c05fc31c9d2eb9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:30.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f67fc700 1 -- 172.21.15.41:0/2146592459 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f000b680 con 0x7fe6f805fba0 2021-10-21T00:08:30.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f67fc700 1 -- 172.21.15.41:0/2146592459 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000b7e0 con 0x7fe6f805fba0 2021-10-21T00:08:30.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6f67fc700 1 -- 172.21.15.41:0/2146592459 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6f000b950 con 0x7fe6f805fba0 2021-10-21T00:08:30.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- 172.21.15.41:0/2146592459 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f805fba0 msgr2=0x7fe6f8060030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:30.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f805fba0 0x7fe6f8060030 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fe6f80afdf0 tx=0x7fe6f0009290).stop 2021-10-21T00:08:30.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- 172.21.15.41:0/2146592459 shutdown_connections 2021-10-21T00:08:30.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f805fba0 0x7fe6f8060030 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2146592459 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f80ab880 0x7fe6f805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2146592459 >> v2:172.21.15.62:3300/0 conn(0x7fe6f809a450 0x7fe6f80609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- 172.21.15.41:0/2146592459 >> 172.21.15.41:0/2146592459 conn(0x7fe6f805bca0 msgr2=0x7fe6f805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:30.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- 172.21.15.41:0/2146592459 shutdown_connections 2021-10-21T00:08:30.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.879+0000 7fe6fd300700 1 -- 172.21.15.41:0/2146592459 wait complete. 2021-10-21T00:08:30.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 Processor -- start 2021-10-21T00:08:30.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 -- start start 2021-10-21T00:08:30.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6f805fba0 0x7fe6f8153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 0x7fe6f80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8145af0 con 0x7fe6f809a450 2021-10-21T00:08:30.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8145d20 con 0x7fe6f805fba0 2021-10-21T00:08:30.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6fd300700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8145fc0 con 0x7fe6f8143410 2021-10-21T00:08:30.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6ee7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6ee7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33324/0 (socket says 172.21.15.41:33324) 2021-10-21T00:08:30.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.883+0000 7fe6ee7fc700 1 -- 172.21.15.41:0/2298863464 learned_addr learned my addr 172.21.15.41:0/2298863464 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:30.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f6ffd700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6f805fba0 0x7fe6f8153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f77fe700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 0x7fe6f80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 -- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 msgr2=0x7fe6f80ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:30.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 0x7fe6f80ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 -- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6f805fba0 msgr2=0x7fe6f8153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:30.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6f805fba0 0x7fe6f8153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:30.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 -- 172.21.15.41:0/2298863464 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009530 con 0x7fe6f809a450 2021-10-21T00:08:30.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f77fe700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 0x7fe6f80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:30.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6ee7fc700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe6e000c000 tx=0x7fe6e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:30.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e0010780 con 0x7fe6f809a450 2021-10-21T00:08:30.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e00108e0 con 0x7fe6f809a450 2021-10-21T00:08:30.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8142020 con 0x7fe6f809a450 2021-10-21T00:08:30.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e0010c40 con 0x7fe6f809a450 2021-10-21T00:08:30.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f8142660 con 0x7fe6f809a450 2021-10-21T00:08:30.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f81421b0 con 0x7fe6f809a450 2021-10-21T00:08:30.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.887+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6e001c460 con 0x7fe6f809a450 2021-10-21T00:08:30.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.891+0000 7fe6f4ff9700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 0x7fe6dc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:30.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.891+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6e006bc50 con 0x7fe6f809a450 2021-10-21T00:08:30.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.891+0000 7fe6f6ffd700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 0x7fe6dc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:30.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.891+0000 7fe6f6ffd700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 0x7fe6dc055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe6e800b000 tx=0x7fe6e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:30.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:30.895+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6e0042d50 con 0x7fe6f809a450 2021-10-21T00:08:31.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.019+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe6f80b0170 con 0x7fe6f809a450 2021-10-21T00:08:31.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.019+0000 7fe6f4ff9700 1 -- 172.21.15.41:0/2298863464 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+33648 (secure 0 0 0) 0x7fe6e0046370 con 0x7fe6f809a450 2021-10-21T00:08:31.025 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:31.025 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:08:31.026 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 59, 2021-10-21T00:08:31.026 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:08:31.026 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:08:31.026 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:08:02.581407+0000", 2021-10-21T00:08:31.027 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:08:31.027 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:08:31.027 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:08:31.027 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:08:31.027 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:08:31.028 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:08:31.028 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:08:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:08:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:08:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:08:31.029 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:08:31.030 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:08:31.030 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:08:31.031 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:08:31.031 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 12, 2021-10-21T00:08:31.031 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:08:31.031 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:08:31.031 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:08:31.032 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:08:31.032 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:08:31.032 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.032 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:08:31.033 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:08:31.033 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:08:31.033 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:31.034 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:31.034 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:31.034 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:31.034 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:31.035 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:31.035 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:31.035 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:31.035 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:08:31.035 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:08:31.036 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:08:31.036 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:08:31.036 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:08:31.036 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:31.036 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:31.037 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:31.037 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:31.037 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:31.037 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:31.038 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:31.038 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.038 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:08:31.038 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:31.039 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:31.039 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:31.039 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:31.039 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:31.040 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:31.040 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:31.040 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:31.040 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:31.041 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:31.041 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:31.042 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:31.042 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:31.043 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:31.043 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:31.043 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:31.043 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:31.044 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:31.044 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:31.044 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:31.044 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:31.045 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:31.045 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:31.045 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:31.045 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:31.046 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:31.046 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.047 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:31.047 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:31.047 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:31.047 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:31.047 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:31.048 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:31.048 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:31.048 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:31.048 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:31.048 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:31.049 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:31.050 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:08:31.050 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:08:31.050 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.050 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:31.051 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:08:31.051 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.051 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.052 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.052 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:08:31.052 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:08:31.052 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:08:31.053 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:31.053 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:31.053 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:31.053 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:31.053 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:31.054 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:31.054 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:31.054 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:31.055 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:08:31.055 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:08:31.055 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:08:31.055 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:08:31.056 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:08:31.056 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:31.057 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:31.057 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:31.058 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:31.058 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:31.059 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:31.059 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:31.060 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.060 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:08:31.060 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:31.060 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:31.061 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:31.061 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:31.061 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:31.062 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:31.062 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:31.064 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:31.064 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:31.065 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:31.065 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:31.066 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:31.066 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:31.067 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:31.067 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:31.067 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:31.067 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:31.068 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:31.068 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:31.068 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:31.068 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:31.068 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:31.069 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:31.069 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:31.069 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:31.069 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:31.069 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.070 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:31.070 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:31.070 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:31.070 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:31.071 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:31.071 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:31.072 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:31.072 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:31.073 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:31.073 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:31.074 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:31.074 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:08:31.074 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:31.074 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:08:31.075 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.075 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.075 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.075 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 11, 2021-10-21T00:08:31.075 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:08:31.076 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:08:00.049644+0000", 2021-10-21T00:08:31.076 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:31.076 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:31.076 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:31.077 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:31.077 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:31.077 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:31.077 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:31.077 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:31.078 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:08:31.078 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:08:31.078 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:08:31.078 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:08:31.078 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:08:31.079 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:31.079 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:31.079 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:31.079 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:31.080 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:31.080 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:31.081 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:31.082 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.082 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "58", 2021-10-21T00:08:31.082 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:31.082 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:31.083 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:31.083 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:31.083 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:31.084 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:31.084 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:31.084 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:31.084 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:31.085 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:31.085 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:31.085 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:31.087 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:31.087 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:31.087 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:31.087 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:31.087 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:31.088 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:31.088 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:31.088 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:31.088 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:31.089 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:31.089 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:31.089 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:31.090 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:31.090 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:31.090 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.090 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:31.090 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:31.091 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:31.091 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:31.091 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:31.091 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:31.092 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:31.092 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:31.092 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:31.092 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:31.092 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:31.093 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:08:31.093 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:08:31.093 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:08:31.093 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:08:31.093 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.094 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:31.094 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:08:31.094 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:08:31.094 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.095 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.095 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.095 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.095 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 12, 2021-10-21T00:08:31.095 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:08:31.096 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:08:00.609917+0000", 2021-10-21T00:08:31.096 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:31.096 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:31.096 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:31.097 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:31.097 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:31.097 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:31.097 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:31.098 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:31.099 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:08:31.099 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:08:31.099 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:08:31.099 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:08:31.099 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:08:31.100 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:31.100 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:31.100 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:31.100 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:31.101 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:31.101 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:31.101 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:31.101 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.101 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "59", 2021-10-21T00:08:31.102 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:31.102 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:31.102 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:31.102 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:31.102 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:31.103 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:31.103 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:31.103 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:31.103 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:31.104 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:31.104 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:31.104 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:31.104 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:31.104 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:31.105 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:31.105 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:31.105 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:31.105 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:31.105 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:31.106 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:31.106 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:31.106 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:31.106 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:31.107 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:31.107 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:31.107 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:31.107 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.107 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:31.108 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:31.108 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:31.108 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:31.108 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:31.109 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:31.109 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:31.109 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:31.109 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:31.109 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:31.110 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:31.110 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:08:31.110 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:31.110 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:08:31.110 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:08:31.111 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.111 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.111 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.111 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:31.112 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:08:31.112 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.112 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:08:31.112 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:08:31.112 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.113 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.113 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.113 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.113 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.113 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.114 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.114 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:31.114 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.115 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.115 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.115 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.115 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.115 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.116 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:08:31.116 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.116 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.116 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.117 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.117 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:08:31.117 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.117 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.117 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.118 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.118 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.118 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.118 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.118 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.119 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:08:31.119 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.119 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.119 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.120 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.120 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:08:31.120 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.120 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.120 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.121 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.121 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.121 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.121 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.122 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.122 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:08:31.122 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.122 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.122 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.123 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.123 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:08:31.123 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.123 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.124 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.124 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.124 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.124 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.124 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:08:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.125 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.126 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.126 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:08:31.126 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:31.126 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.127 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.127 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.127 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:08:31.127 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:08:31.127 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:08:31.128 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:08:31.128 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.128 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.128 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.128 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.129 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.129 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.129 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:08:31.129 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:08:31.130 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.130 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.130 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.130 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.130 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.131 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.131 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.131 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:31.131 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.131 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.132 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.132 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.132 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.132 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.132 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:08:31.133 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.133 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.133 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.133 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.134 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:08:31.134 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.134 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.134 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.134 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.135 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.135 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.135 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.135 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.135 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:08:31.136 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.136 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.136 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.136 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.137 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:08:31.137 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.137 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.137 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.137 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.138 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.138 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.138 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.138 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.138 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:08:31.139 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.139 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.139 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.139 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.140 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:08:31.140 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.140 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.140 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.140 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.141 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.141 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.141 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.141 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.141 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:08:31.142 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.142 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.142 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.142 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.142 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:08:31.143 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:31.143 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.143 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.143 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.144 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:08:31.144 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:08:31.144 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:08:31.144 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:08:31.145 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.145 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.145 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.145 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.145 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.146 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.146 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:08:31.146 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:08:31.146 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.146 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.147 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.147 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.147 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.147 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.148 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.148 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:31.148 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.148 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.148 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.149 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.149 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.149 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.150 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:08:31.150 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.150 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.150 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.150 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.151 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:08:31.151 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.151 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.151 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.152 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.152 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.152 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.152 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.152 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.153 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:08:31.153 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.153 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.153 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.153 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.154 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:08:31.154 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.154 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.154 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.155 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.155 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.155 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.155 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.155 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.156 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:08:31.156 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.156 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.156 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.156 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.157 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:08:31.157 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.157 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.157 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.157 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.158 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.158 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.158 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.158 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.159 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:08:31.159 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.159 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.159 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.159 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.160 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:08:31.160 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:31.160 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.160 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.160 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.161 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:08:31.161 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:08:31.161 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:08:31.161 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:08:31.162 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.162 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.162 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.162 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.162 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.163 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.163 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:08:31.163 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:08:31.163 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.163 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.164 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.164 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.164 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.164 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.164 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.165 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:08:31.165 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.165 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.165 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.166 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.166 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.166 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.166 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:08:31.166 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.167 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.167 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.167 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.167 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:08:31.168 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.168 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.168 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.168 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.168 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.169 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.169 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.169 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.169 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:08:31.169 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.170 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.170 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.170 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.170 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:08:31.171 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.171 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.171 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.171 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.171 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.172 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.172 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.172 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.172 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:08:31.172 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.173 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.173 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.173 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.173 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:08:31.174 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.174 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.174 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.174 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.174 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.175 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.175 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.175 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.175 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:08:31.175 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.176 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.176 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.176 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.177 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:08:31.178 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:31.178 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.178 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.178 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.178 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:08:31.179 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:08:31.179 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:08:31.179 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:08:31.179 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.180 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.180 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.180 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.180 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.180 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.181 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:08:31.181 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:08:31.181 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.181 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.181 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.182 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.182 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.182 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.182 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.182 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 57, 2021-10-21T00:08:31.183 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.183 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.183 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.183 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.184 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.184 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.184 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:08:31.184 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.184 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.185 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.185 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.185 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:08:31.185 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.185 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.186 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.186 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.186 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.186 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.187 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.187 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.187 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:08:31.187 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.187 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.188 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.188 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.188 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:08:31.188 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.188 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.189 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.189 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.189 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.189 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.190 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.190 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.190 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:08:31.190 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.190 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.191 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.191 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.191 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:08:31.191 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.191 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.192 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.192 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.192 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.192 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.193 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:31.194 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.195 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.195 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.195 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:08:31.195 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:08:31.196 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:08:31.196 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:08:31.196 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.196 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.196 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.197 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.197 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.197 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.197 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:08:31.197 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:08:31.198 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.198 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.198 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.198 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.199 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.199 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.199 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.199 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:31.199 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.200 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.200 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.200 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.200 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.200 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.201 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:08:31.201 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.201 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.201 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.201 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.202 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:08:31.202 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.202 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.202 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.203 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.204 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:08:31.204 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.204 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.204 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.204 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.205 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:08:31.205 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.205 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.205 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.206 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.206 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.206 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.206 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.206 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.207 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:08:31.207 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.207 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.207 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.207 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.208 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:08:31.208 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.208 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.208 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.209 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.209 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.209 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.209 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.209 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.210 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:08:31.210 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.210 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.210 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.210 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:08:31.211 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:31.211 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.211 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.212 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.212 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:08:31.212 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:08:31.212 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:08:31.212 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:08:31.213 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.213 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.213 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.213 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.213 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.214 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.214 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:08:31.214 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:08:31.214 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.215 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.215 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.215 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.215 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.215 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.216 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.216 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:31.216 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.216 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.216 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.217 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.217 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:08:31.217 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.218 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.218 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.218 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.218 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:08:31.219 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.219 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.219 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.219 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.219 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.220 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.220 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.220 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.220 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:08:31.220 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.221 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.221 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:08:31.221 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.222 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.222 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.222 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.222 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.223 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.223 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.223 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.223 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:08:31.223 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.224 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.224 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.224 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.224 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:08:31.224 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.225 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.225 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.225 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.225 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.233 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.233 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.233 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.233 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:08:31.234 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.234 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.234 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.234 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.235 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:08:31.235 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:31.235 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.235 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.235 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.236 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:08:31.236 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:08:31.236 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:08:31.236 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:08:31.237 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.237 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.237 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.238 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.238 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.238 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.238 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:08:31.239 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:08:31.239 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:31.239 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:31.240 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:31.240 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:31.240 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:31.240 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:31.240 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:31.241 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:31.241 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:31.241 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:31.241 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:31.241 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.242 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.242 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.242 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:08:31.242 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.243 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.243 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.243 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.243 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:08:31.243 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.244 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.244 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.244 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.244 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:31.244 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.245 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.245 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.245 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:08:31.245 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.246 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.246 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.246 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:08:31.247 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.247 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.247 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.247 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.247 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:31.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.248 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.248 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:08:31.249 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.249 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.249 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.249 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:08:31.250 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.250 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.250 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.250 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.251 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:31.251 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:31.251 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.251 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:31.251 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:08:31.252 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.252 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.252 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.252 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:31.252 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:08:31.253 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:31.253 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.253 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.253 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.254 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:08:31.254 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:08:31.254 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:08:31.254 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:08:31.254 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:31.255 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:31.255 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:31.255 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:31.255 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.255 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:31.256 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:08:31.256 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.256 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:08:31.256 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.257 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.257 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.257 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.257 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.257 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:08:31.258 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.258 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.258 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:08:31.258 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.259 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.259 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.259 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.259 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.260 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:08:31.260 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.260 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.260 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.260 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:08:31.261 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.261 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.261 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.261 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.261 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.262 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:08:31.262 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.262 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.262 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.263 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:08:31.263 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.263 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.263 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.263 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.264 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.264 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:08:31.264 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.264 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.264 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.265 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:08:31.265 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.265 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.265 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.266 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.266 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.266 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:08:31.266 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.266 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.267 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.267 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:08:31.267 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.267 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.267 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:08:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.268 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.269 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.269 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:08:31.269 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.269 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.270 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.270 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.270 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.270 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:08:31.270 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.271 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.271 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:31.271 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:08:31.271 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:31.272 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:31.272 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:31.272 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:31.272 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:31.272 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:08:31.273 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:31.273 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.273 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:31.273 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:08:31.273 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:08:31.274 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:08:31.274 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:08:31.274 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:08:31.274 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:08:31.275 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:08:31.275 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:08:31.275 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:08:31.275 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:08:31.275 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:08:31.276 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:08:31.276 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:08:31.276 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:31.276 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:31.276 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:08:31.277 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:08:31.277 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:08:31.277 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:08:31.277 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:08:31.277 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:08:31.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 msgr2=0x7fe6dc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 0x7fe6dc055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe6e800b000 tx=0x7fe6e8008040).stop 2021-10-21T00:08:31.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 msgr2=0x7fe6f8142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe6e000c000 tx=0x7fe6e0006df0).stop 2021-10-21T00:08:31.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 shutdown_connections 2021-10-21T00:08:31.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6dc0536d0 0x7fe6dc055b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6f8143410 0x7fe6f80ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe6f809a450 0x7fe6f8142dd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 --2- 172.21.15.41:0/2298863464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6f805fba0 0x7fe6f8153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 >> 172.21.15.41:0/2298863464 conn(0x7fe6f805bca0 msgr2=0x7fe6f80b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:31.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 shutdown_connections 2021-10-21T00:08:31.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.023+0000 7fe6fd300700 1 -- 172.21.15.41:0/2298863464 wait complete. 2021-10-21T00:08:31.283 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:31.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.387+0000 7faf41e2e700 1 Processor -- start 2021-10-21T00:08:31.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.387+0000 7faf41e2e700 1 -- start start 2021-10-21T00:08:31.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0ae020 con 0x7faf3c0b1830 2021-10-21T00:08:31.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0ade00 con 0x7faf3c0b4380 2021-10-21T00:08:31.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c05fe50 con 0x7faf3c1433e0 2021-10-21T00:08:31.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf40e2c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf3bfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faf3c0b1830 0x7faf3c05f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39156/0 (socket says 172.21.15.41:39156) 2021-10-21T00:08:31.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:51832/0 (socket says 172.21.15.41:51832) 2021-10-21T00:08:31.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf40e2c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:45248/0 (socket says 172.21.15.41:45248) 2021-10-21T00:08:31.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf3bfff700 1 -- 172.21.15.41:0/35805763 learned_addr learned my addr 172.21.15.41:0/35805763 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:31.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 -- 172.21.15.41:0/35805763 >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 msgr2=0x7faf3c0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:31.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 --2- 172.21.15.41:0/35805763 >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 -- 172.21.15.41:0/35805763 >> v1:172.21.15.62:6789/0 conn(0x7faf3c0b1830 legacy=0x7faf3c05f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 -- 172.21.15.41:0/35805763 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0b4760 con 0x7faf3c1433e0 2021-10-21T00:08:31.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf40e2c700 1 --2- 172.21.15.41:0/35805763 >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:31.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf4162d700 1 --2- 172.21.15.41:0/35805763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faf340032f0 tx=0x7faf340091d0).ready entity=mon.2 client_cookie=6e77cfdb3e00dfdc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf3b7fe700 1 -- 172.21.15.41:0/35805763 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3400b6c0 con 0x7faf3c1433e0 2021-10-21T00:08:31.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf3b7fe700 1 -- 172.21.15.41:0/35805763 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3400b820 con 0x7faf3c1433e0 2021-10-21T00:08:31.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf3b7fe700 1 -- 172.21.15.41:0/35805763 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3400b990 con 0x7faf3c1433e0 2021-10-21T00:08:31.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- 172.21.15.41:0/35805763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 msgr2=0x7faf3c062940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 --2- 172.21.15.41:0/35805763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faf340032f0 tx=0x7faf340091d0).stop 2021-10-21T00:08:31.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- 172.21.15.41:0/35805763 shutdown_connections 2021-10-21T00:08:31.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 --2- 172.21.15.41:0/35805763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c1433e0 0x7faf3c062940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 --2- 172.21.15.41:0/35805763 >> v2:172.21.15.62:3300/0 conn(0x7faf3c0b4380 0x7faf3c0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- 172.21.15.41:0/35805763 >> 172.21.15.41:0/35805763 conn(0x7faf3c0b7910 msgr2=0x7faf3c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:31.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- 172.21.15.41:0/35805763 shutdown_connections 2021-10-21T00:08:31.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.391+0000 7faf41e2e700 1 -- 172.21.15.41:0/35805763 wait complete. 2021-10-21T00:08:31.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 Processor -- start 2021-10-21T00:08:31.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- start start 2021-10-21T00:08:31.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 0x7faf3c140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 0x7faf3c140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c066d30 con 0x7faf3c0b4380 2021-10-21T00:08:31.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c145530 con 0x7faf3c1433e0 2021-10-21T00:08:31.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c1457d0 con 0x7faf3c0b1830 2021-10-21T00:08:31.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 0x7faf3c140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf40e2c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf40e2c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:51834/0 (socket says 172.21.15.41:51834) 2021-10-21T00:08:31.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf40e2c700 1 -- 172.21.15.41:0/1190612335 learned_addr learned my addr 172.21.15.41:0/1190612335 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:31.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf4162d700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 0x7faf3c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 -- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 msgr2=0x7faf3c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 -- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 msgr2=0x7faf3c140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 0x7faf3c140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 -- 172.21.15.41:0/1190612335 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3000b180 con 0x7faf3c0b4380 2021-10-21T00:08:31.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf4162d700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 0x7faf3c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:31.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf40e2c700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:31.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf3bfff700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 0x7faf3c140130 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7faf3c063d20 tx=0x7faf28007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2800ce80 con 0x7faf3c0b4380 2021-10-21T00:08:31.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf34009470 con 0x7faf3c0b4380 2021-10-21T00:08:31.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280070d0 con 0x7faf3c0b4380 2021-10-21T00:08:31.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf28007430 con 0x7faf3c0b4380 2021-10-21T00:08:31.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.395+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c144290 con 0x7faf3c0b4380 2021-10-21T00:08:31.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c144450 con 0x7faf3c0b4380 2021-10-21T00:08:31.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf28010070 con 0x7faf3c0b4380 2021-10-21T00:08:31.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf39ffb700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 0x7faf1c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf2806adf0 con 0x7faf3c0b4380 2021-10-21T00:08:31.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf40e2c700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 0x7faf1c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.399+0000 7faf40e2c700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 0x7faf1c055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7faf3000b000 tx=0x7faf30006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.407+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf28041eb0 con 0x7faf3c0b4380 2021-10-21T00:08:31.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.571+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf3c142ca0 con 0x7faf3c0b4380 2021-10-21T00:08:31.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.571+0000 7faf39ffb700 1 -- 172.21.15.41:0/1190612335 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2140 (secure 0 0 0) 0x7faf28018030 con 0x7faf3c0b4380 2021-10-21T00:08:31.577 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:31.577 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:02.580692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/1883344240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1883344240},{"type":"v1","addr":"172.21.15.41:6833","nonce":1883344240}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:31.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 msgr2=0x7faf1c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 0x7faf1c055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7faf3000b000 tx=0x7faf30006df0).stop 2021-10-21T00:08:31.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 msgr2=0x7faf3c140130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 0x7faf3c140130 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7faf3c063d20 tx=0x7faf28007b50).stop 2021-10-21T00:08:31.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 shutdown_connections 2021-10-21T00:08:31.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf1c053610 0x7faf1c055ad0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf3c1433e0 0x7faf3c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf3c0b4380 0x7faf3c140130 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 --2- 172.21.15.41:0/1190612335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf3c0b1830 0x7faf3c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 >> 172.21.15.41:0/1190612335 conn(0x7faf3c0b7910 msgr2=0x7faf3c0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:31.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 shutdown_connections 2021-10-21T00:08:31.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.575+0000 7faf41e2e700 1 -- 172.21.15.41:0/1190612335 wait complete. 2021-10-21T00:08:31.583 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 27 2021-10-21T00:08:31.590 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:08:31.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 Processor -- start 2021-10-21T00:08:31.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 -- start start 2021-10-21T00:08:31.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640af620 0x7f0b640ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b64067a80 0x7f0b64149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640b0b50 con 0x7f0b640b2170 2021-10-21T00:08:31.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640b2550 con 0x7f0b64067a80 2021-10-21T00:08:31.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b69562700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b0d90 con 0x7f0b640af620 2021-10-21T00:08:31.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b68d61700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b64067a80 0x7f0b64149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b68d61700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b64067a80 0x7f0b64149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33348/0 (socket says 172.21.15.41:33348) 2021-10-21T00:08:31.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b68d61700 1 -- 172.21.15.41:0/2549408337 learned_addr learned my addr 172.21.15.41:0/2549408337 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:31.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b63fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0b640b2170 0x7f0b640ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59346/0 (socket says 172.21.15.41:59346) 2021-10-21T00:08:31.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.687+0000 7f0b637fe700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640af620 0x7f0b640ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b68d61700 1 -- 172.21.15.41:0/2549408337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640af620 msgr2=0x7f0b640ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:31.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b68d61700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640af620 0x7f0b640ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b68d61700 1 -- 172.21.15.41:0/2549408337 >> v1:172.21.15.41:6789/0 conn(0x7f0b640b2170 legacy=0x7f0b640ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b62ffd700 1 -- 172.21.15.41:0/2549408337 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243284048 0 0) 0x7f0b54001110 con 0x7f0b640b2170 2021-10-21T00:08:31.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b68d61700 1 -- 172.21.15.41:0/2549408337 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640b1030 con 0x7f0b64067a80 2021-10-21T00:08:31.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b68d61700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64149320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f0b5c002f70 tx=0x7f0b5c006eb0).ready entity=mon.0 client_cookie=e137c028a177050 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b62ffd700 1 -- 172.21.15.41:0/2549408337 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c00d570 con 0x7f0b64067a80 2021-10-21T00:08:31.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b62ffd700 1 -- 172.21.15.41:0/2549408337 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c000e90 con 0x7f0b64067a80 2021-10-21T00:08:31.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b62ffd700 1 -- 172.21.15.41:0/2549408337 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c00d8c0 con 0x7f0b64067a80 2021-10-21T00:08:31.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 -- 172.21.15.41:0/2549408337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 msgr2=0x7f0b64149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64149320 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f0b5c002f70 tx=0x7f0b5c006eb0).stop 2021-10-21T00:08:31.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 -- 172.21.15.41:0/2549408337 shutdown_connections 2021-10-21T00:08:31.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64149320 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 --2- 172.21.15.41:0/2549408337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640af620 0x7f0b640ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 -- 172.21.15.41:0/2549408337 >> 172.21.15.41:0/2549408337 conn(0x7f0b640b5700 msgr2=0x7f0b640b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:31.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 -- 172.21.15.41:0/2549408337 shutdown_connections 2021-10-21T00:08:31.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.691+0000 7f0b69562700 1 -- 172.21.15.41:0/2549408337 wait complete. 2021-10-21T00:08:31.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 Processor -- start 2021-10-21T00:08:31.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- start start 2021-10-21T00:08:31.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b640af620 0x7f0b640ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640b2170 0x7f0b640ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b64157030 con 0x7f0b64067a80 2021-10-21T00:08:31.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640ac5a0 con 0x7f0b640af620 2021-10-21T00:08:31.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640ac7d0 con 0x7f0b640b2170 2021-10-21T00:08:31.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33350/0 (socket says 172.21.15.41:33350) 2021-10-21T00:08:31.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 -- 172.21.15.41:0/2951454734 learned_addr learned my addr 172.21.15.41:0/2951454734 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:31.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b68d61700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640b2170 0x7f0b640ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b637fe700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b640af620 0x7f0b640ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 -- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640b2170 msgr2=0x7f0b640ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640b2170 0x7f0b640ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 -- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b640af620 msgr2=0x7f0b640ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:31.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b640af620 0x7f0b640ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:31.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 -- 172.21.15.41:0/2951454734 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c00b1e0 con 0x7f0b64067a80 2021-10-21T00:08:31.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b63fff700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f0b64148c40 tx=0x7f0b54007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b540070d0 con 0x7f0b64067a80 2021-10-21T00:08:31.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54007230 con 0x7f0b64067a80 2021-10-21T00:08:31.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b640aca70 con 0x7f0b64067a80 2021-10-21T00:08:31.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b54005740 con 0x7f0b64067a80 2021-10-21T00:08:31.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.695+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b641447a0 con 0x7f0b64067a80 2021-10-21T00:08:31.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b640acc00 con 0x7f0b64067a80 2021-10-21T00:08:31.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b5401a060 con 0x7f0b64067a80 2021-10-21T00:08:31.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b617fa700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 0x7f0b48055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:31.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b5406ac00 con 0x7f0b64067a80 2021-10-21T00:08:31.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b637fe700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 0x7f0b48055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:31.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.699+0000 7f0b637fe700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 0x7f0b48055b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f0b4c00b000 tx=0x7f0b4c0091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:31.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.703+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b54041c50 con 0x7f0b64067a80 2021-10-21T00:08:31.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:31.871+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0b640b0b30 con 0x7f0b64067a80 2021-10-21T00:08:32.214 INFO:tasks.ceph.mds.a.smithi041.stderr:2021-10-21T00:08:32.211+0000 7f2686ac9700 -1 MDSIOContextBase: blacklisted! Restarting... 2021-10-21T00:08:32.235 INFO:tasks.ceph.mds.a.smithi041.stderr: -1> 2021-10-21T00:08:32.211+0000 7f2686ac9700 -1 MDSIOContextBase: blacklisted! Restarting... 2021-10-21T00:08:32.257 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:08:32.468 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:08:32.463+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:08:32.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.471+0000 7f0b617fa700 1 -- 172.21.15.41:0/2951454734 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b54018070 con 0x7f0b64067a80 2021-10-21T00:08:32.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 msgr2=0x7f0b48055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 0x7f0b48055b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f0b4c00b000 tx=0x7f0b4c0091d0).stop 2021-10-21T00:08:32.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 msgr2=0x7f0b64156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f0b64148c40 tx=0x7f0b54007920).stop 2021-10-21T00:08:32.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 shutdown_connections 2021-10-21T00:08:32.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b480536d0 0x7f0b48055b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b640b2170 0x7f0b640ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b640af620 0x7f0b640ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 --2- 172.21.15.41:0/2951454734 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b64067a80 0x7f0b64156b40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 >> 172.21.15.41:0/2951454734 conn(0x7f0b640b5700 msgr2=0x7f0b6414c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:32.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 shutdown_connections 2021-10-21T00:08:32.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.475+0000 7f0b69562700 1 -- 172.21.15.41:0/2951454734 wait complete. 2021-10-21T00:08:32.483 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:08:32.496 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:32.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 Processor -- start 2021-10-21T00:08:32.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 -- start start 2021-10-21T00:08:32.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be014b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be00b4760 con 0x7f7be00b1830 2021-10-21T00:08:32.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be00ad4c0 con 0x7f7be00b4380 2021-10-21T00:08:32.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.599+0000 7f7be63df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00ad760 con 0x7f7be0149240 2021-10-21T00:08:32.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be4bdc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7be00b1830 0x7f7be005fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59372/0 (socket says 172.21.15.41:59372) 2021-10-21T00:08:32.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be4bdc700 1 -- 172.21.15.41:0/1849260455 learned_addr learned my addr 172.21.15.41:0/1849260455 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:32.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be5bde700 1 --2- 172.21.15.41:0/1849260455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573539304 0 0) 0x7f7be00b4760 con 0x7f7be00b1830 2021-10-21T00:08:32.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bcc003260 con 0x7f7be00b1830 2021-10-21T00:08:32.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456122881 0 0) 0x7f7be00ad4c0 con 0x7f7be00b4380 2021-10-21T00:08:32.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be00b4760 con 0x7f7be00b4380 2021-10-21T00:08:32.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159696687 0 0) 0x7f7bcc003260 con 0x7f7be00b1830 2021-10-21T00:08:32.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be5bde700 1 -- 172.21.15.41:0/1849260455 >> v1:172.21.15.62:6789/0 conn(0x7f7be00b4380 legacy=0x7f7be005f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be5bde700 1 -- 172.21.15.41:0/1849260455 >> v1:172.21.15.41:6789/0 conn(0x7f7be00b1830 legacy=0x7f7be005fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be5bde700 1 -- 172.21.15.41:0/1849260455 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00ada00 con 0x7f7be0149240 2021-10-21T00:08:32.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be5bde700 1 --2- 172.21.15.41:0/1849260455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be014b630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7bd0001b80 tx=0x7f7bd8006df0).ready entity=mon.2 client_cookie=88d172cb3a4b6790 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd00019e0 con 0x7f7be0149240 2021-10-21T00:08:32.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8000e90 con 0x7f7be0149240 2021-10-21T00:08:32.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7bdffff700 1 -- 172.21.15.41:0/1849260455 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd8012460 con 0x7f7be0149240 2021-10-21T00:08:32.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 -- 172.21.15.41:0/1849260455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 msgr2=0x7f7be014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 --2- 172.21.15.41:0/1849260455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be014b630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7bd0001b80 tx=0x7f7bd8006df0).stop 2021-10-21T00:08:32.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 -- 172.21.15.41:0/1849260455 shutdown_connections 2021-10-21T00:08:32.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 --2- 172.21.15.41:0/1849260455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be014b630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 -- 172.21.15.41:0/1849260455 >> 172.21.15.41:0/1849260455 conn(0x7f7be00b7910 msgr2=0x7f7be00b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:32.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 -- 172.21.15.41:0/1849260455 shutdown_connections 2021-10-21T00:08:32.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.603+0000 7f7be63df700 1 -- 172.21.15.41:0/1849260455 wait complete. 2021-10-21T00:08:32.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 Processor -- start 2021-10-21T00:08:32.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- start start 2021-10-21T00:08:32.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7be00b4380 0x7f7be013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be0133380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be013ff20 con 0x7f7be00b1830 2021-10-21T00:08:32.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01405a0 con 0x7f7be00b4380 2021-10-21T00:08:32.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01407d0 con 0x7f7be0149240 2021-10-21T00:08:32.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33376/0 (socket says 172.21.15.41:33376) 2021-10-21T00:08:32.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 -- 172.21.15.41:0/1718817147 learned_addr learned my addr 172.21.15.41:0/1718817147 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:32.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be5bde700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be0133380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be4bdc700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7be00b4380 0x7f7be013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 -- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 msgr2=0x7f7be0133380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be0133380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 -- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7be00b4380 msgr2=0x7f7be013fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7be00b4380 0x7f7be013fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 -- 172.21.15.41:0/1718817147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd800b180 con 0x7f7be00b1830 2021-10-21T00:08:32.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be53dd700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7bd4001110 tx=0x7f7bd4007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4012400 con 0x7f7be00b1830 2021-10-21T00:08:32.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4012560 con 0x7f7be00b1830 2021-10-21T00:08:32.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be0140c70 con 0x7f7be00b1830 2021-10-21T00:08:32.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd40128c0 con 0x7f7be00b1830 2021-10-21T00:08:32.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.607+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0140f90 con 0x7f7be00b1830 2021-10-21T00:08:32.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be0057350 con 0x7f7be00b1830 2021-10-21T00:08:32.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bd4019030 con 0x7f7be00b1830 2021-10-21T00:08:32.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7bde7fc700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 0x7f7bc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7bd406ad80 con 0x7f7be00b1830 2021-10-21T00:08:32.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7be4bdc700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 0x7f7bc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.611+0000 7f7be4bdc700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 0x7f7bc0055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f7bd000d000 tx=0x7f7bd0001a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.615+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bd4041e90 con 0x7f7be00b1830 2021-10-21T00:08:32.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.783+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be005cec0 con 0x7f7be00b1830 2021-10-21T00:08:32.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.783+0000 7f7bde7fc700 1 -- 172.21.15.41:0/1718817147 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f7bd406c070 con 0x7f7be00b1830 2021-10-21T00:08:32.789 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:32.789 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":28,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:01.577786+0000","modified":"2021-10-21T00:08:32.466276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-10-21T00:08:32.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 msgr2=0x7f7bc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 0x7f7bc0055b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f7bd000d000 tx=0x7f7bd0001a00).stop 2021-10-21T00:08:32.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 msgr2=0x7f7be01397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7bd4001110 tx=0x7f7bd4007ae0).stop 2021-10-21T00:08:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 shutdown_connections 2021-10-21T00:08:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7bc00536a0 0x7f7bc0055b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7be0149240 0x7f7be0133380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7be00b4380 0x7f7be013fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 --2- 172.21.15.41:0/1718817147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7be00b1830 0x7f7be01397b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 >> 172.21.15.41:0/1718817147 conn(0x7f7be00b7910 msgr2=0x7f7be00657f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 shutdown_connections 2021-10-21T00:08:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.787+0000 7f7be63df700 1 -- 172.21.15.41:0/1718817147 wait complete. 2021-10-21T00:08:32.794 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 28 2021-10-21T00:08:32.807 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:08:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 Processor -- start 2021-10-21T00:08:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 -- start start 2021-10-21T00:08:32.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3c40b9c70 0x7fe3c4143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c4142bc0 con 0x7fe3c40b3bc0 2021-10-21T00:08:32.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40ba050 con 0x7fe3c41418f0 2021-10-21T00:08:32.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3ca033700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c41429a0 con 0x7fe3c40b9c70 2021-10-21T00:08:32.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c2ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe3c40b3bc0 0x7fe3c4143510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59386/0 (socket says 172.21.15.41:59386) 2021-10-21T00:08:32.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c2ffd700 1 -- 172.21.15.41:0/3207059529 learned_addr learned my addr 172.21.15.41:0/3207059529 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:32.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c37fe700 1 --2- 172.21.15.41:0/3207059529 >> v2:172.21.15.62:3300/0 conn(0x7fe3c40b9c70 0x7fe3c4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c27fc700 1 -- 172.21.15.41:0/3207059529 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645851848 0 0) 0x7fe3c4142bc0 con 0x7fe3c40b3bc0 2021-10-21T00:08:32.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c27fc700 1 -- 172.21.15.41:0/3207059529 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b0003260 con 0x7fe3c40b3bc0 2021-10-21T00:08:32.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c37fe700 1 -- 172.21.15.41:0/3207059529 >> v1:172.21.15.62:6789/0 conn(0x7fe3c41418f0 legacy=0x7fe3c4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c37fe700 1 -- 172.21.15.41:0/3207059529 >> v1:172.21.15.41:6789/0 conn(0x7fe3c40b3bc0 legacy=0x7fe3c4143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.911+0000 7fe3c37fe700 1 -- 172.21.15.41:0/3207059529 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c41463c0 con 0x7fe3c40b9c70 2021-10-21T00:08:32.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c37fe700 1 --2- 172.21.15.41:0/3207059529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b9c70 0x7fe3c4143020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8006df0).ready entity=mon.1 client_cookie=f2e1e147cb96c216 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c27fc700 1 -- 172.21.15.41:0/3207059529 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b800d610 con 0x7fe3c40b9c70 2021-10-21T00:08:32.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c27fc700 1 -- 172.21.15.41:0/3207059529 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8000e90 con 0x7fe3c40b9c70 2021-10-21T00:08:32.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c27fc700 1 -- 172.21.15.41:0/3207059529 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3b800d960 con 0x7fe3c40b9c70 2021-10-21T00:08:32.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- 172.21.15.41:0/3207059529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b9c70 msgr2=0x7fe3c4143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 --2- 172.21.15.41:0/3207059529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b9c70 0x7fe3c4143020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe3b8002f70 tx=0x7fe3b8006df0).stop 2021-10-21T00:08:32.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- 172.21.15.41:0/3207059529 shutdown_connections 2021-10-21T00:08:32.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 --2- 172.21.15.41:0/3207059529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b9c70 0x7fe3c4143020 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- 172.21.15.41:0/3207059529 >> 172.21.15.41:0/3207059529 conn(0x7fe3c4062e80 msgr2=0x7fe3c40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:32.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- 172.21.15.41:0/3207059529 shutdown_connections 2021-10-21T00:08:32.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- 172.21.15.41:0/3207059529 wait complete. 2021-10-21T00:08:32.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 Processor -- start 2021-10-21T00:08:32.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- start start 2021-10-21T00:08:32.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b3bc0 0x7fe3c40ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c40b9c70 0x7fe3c41430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c413e560 con 0x7fe3c41418f0 2021-10-21T00:08:32.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ae2c0 con 0x7fe3c40b3bc0 2021-10-21T00:08:32.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3ca033700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40af080 con 0x7fe3c40b9c70 2021-10-21T00:08:32.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33394/0 (socket says 172.21.15.41:33394) 2021-10-21T00:08:32.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c3fff700 1 -- 172.21.15.41:0/804483184 learned_addr learned my addr 172.21.15.41:0/804483184 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:32.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c37fe700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b3bc0 0x7fe3c40ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.915+0000 7fe3c2ffd700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c40b9c70 0x7fe3c41430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 -- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c40b9c70 msgr2=0x7fe3c41430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c40b9c70 0x7fe3c41430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 -- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b3bc0 msgr2=0x7fe3c40ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:32.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b3bc0 0x7fe3c40ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:32.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 -- 172.21.15.41:0/804483184 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b800b180 con 0x7fe3c41418f0 2021-10-21T00:08:32.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c3fff700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fe3c4063290 tx=0x7fe3bc0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc006aa0 con 0x7fe3c41418f0 2021-10-21T00:08:32.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc006c00 con 0x7fe3c41418f0 2021-10-21T00:08:32.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c40af320 con 0x7fe3c41418f0 2021-10-21T00:08:32.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3bc007030 con 0x7fe3c41418f0 2021-10-21T00:08:32.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4143650 con 0x7fe3c41418f0 2021-10-21T00:08:32.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c41520e0 con 0x7fe3c41418f0 2021-10-21T00:08:32.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3bc010030 con 0x7fe3c41418f0 2021-10-21T00:08:32.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.919+0000 7fe3c0ff9700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 0x7fe3a4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:32.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.923+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe3bc06b750 con 0x7fe3c41418f0 2021-10-21T00:08:32.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.923+0000 7fe3c37fe700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 0x7fe3a4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:32.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.923+0000 7fe3c37fe700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 0x7fe3a4055a70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fe3b801a000 tx=0x7fe3b8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:32.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:32.927+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3bc0427c0 con 0x7fe3c41418f0 2021-10-21T00:08:33.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.091+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe3c4146120 con 0x7fe3c41418f0 2021-10-21T00:08:33.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.883+0000 7fe3c0ff9700 1 -- 172.21.15.41:0/804483184 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3bc045de0 con 0x7fe3c41418f0 2021-10-21T00:08:33.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 msgr2=0x7fe3a4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:33.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 0x7fe3a4055a70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fe3b801a000 tx=0x7fe3b8014000).stop 2021-10-21T00:08:33.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 msgr2=0x7fe3c4152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:33.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fe3c4063290 tx=0x7fe3bc0013a0).stop 2021-10-21T00:08:33.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 shutdown_connections 2021-10-21T00:08:33.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3a40535b0 0x7fe3a4055a70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:33.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3c41418f0 0x7fe3c4152770 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:33.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c40b9c70 0x7fe3c41430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:33.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 --2- 172.21.15.41:0/804483184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c40b3bc0 0x7fe3c40ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:33.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 >> 172.21.15.41:0/804483184 conn(0x7fe3c4062e80 msgr2=0x7fe3c413eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:33.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 shutdown_connections 2021-10-21T00:08:33.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:33.887+0000 7fe3ca033700 1 -- 172.21.15.41:0/804483184 wait complete. 2021-10-21T00:08:33.909 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:08:34.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.023+0000 7fb1ddf98700 1 Processor -- start 2021-10-21T00:08:34.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.023+0000 7fb1ddf98700 1 -- start start 2021-10-21T00:08:34.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1d80b05b0 0x7fb1d8143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d8143970 0x7fb1d813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80b64e0 con 0x7fb1d80b6100 2021-10-21T00:08:34.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b09f0 con 0x7fb1d80b05b0 2021-10-21T00:08:34.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80ae890 con 0x7fb1d8143970 2021-10-21T00:08:34.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1d80b05b0 0x7fb1d8143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1d80b05b0 0x7fb1d8143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33400/0 (socket says 172.21.15.41:33400) 2021-10-21T00:08:34.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 -- 172.21.15.41:0/4030689887 learned_addr learned my addr 172.21.15.41:0/4030689887 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:34.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1d7fff700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d8143970 0x7fb1d813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 -- 172.21.15.41:0/4030689887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d8143970 msgr2=0x7fb1d813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:34.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d8143970 0x7fb1d813fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 -- 172.21.15.41:0/4030689887 >> v1:172.21.15.62:6789/0 conn(0x7fb1d80b6100 legacy=0x7fb1d8142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 -- 172.21.15.41:0/4030689887 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80aeb30 con 0x7fb1d80b05b0 2021-10-21T00:08:34.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ceffd700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d80b05b0 0x7fb1d8143480 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb1c0002f70 tx=0x7fb1c0006f40).ready entity=mon.0 client_cookie=5471025c3ce16174 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:34.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1d6ffd700 1 -- 172.21.15.41:0/4030689887 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c000dc70 con 0x7fb1d80b05b0 2021-10-21T00:08:34.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1d6ffd700 1 -- 172.21.15.41:0/4030689887 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0000e90 con 0x7fb1d80b05b0 2021-10-21T00:08:34.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1d6ffd700 1 -- 172.21.15.41:0/4030689887 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c000be90 con 0x7fb1d80b05b0 2021-10-21T00:08:34.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- 172.21.15.41:0/4030689887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d80b05b0 msgr2=0x7fb1d8143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d80b05b0 0x7fb1d8143480 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb1c0002f70 tx=0x7fb1c0006f40).stop 2021-10-21T00:08:34.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- 172.21.15.41:0/4030689887 shutdown_connections 2021-10-21T00:08:34.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d8143970 0x7fb1d813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/4030689887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d80b05b0 0x7fb1d8143480 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- 172.21.15.41:0/4030689887 >> 172.21.15.41:0/4030689887 conn(0x7fb1d8063ab0 msgr2=0x7fb1d80b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:34.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- 172.21.15.41:0/4030689887 shutdown_connections 2021-10-21T00:08:34.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.027+0000 7fb1ddf98700 1 -- 172.21.15.41:0/4030689887 wait complete. 2021-10-21T00:08:34.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 Processor -- start 2021-10-21T00:08:34.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 -- start start 2021-10-21T00:08:34.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 0x7fb1d813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d80b6100 0x7fb1d813c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8152450 con 0x7fb1d8143970 2021-10-21T00:08:34.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d81526f0 con 0x7fb1d80b05b0 2021-10-21T00:08:34.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ddf98700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8152990 con 0x7fb1d80b6100 2021-10-21T00:08:34.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 0x7fb1d813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33408/0 (socket says 172.21.15.41:33408) 2021-10-21T00:08:34.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d7fff700 1 -- 172.21.15.41:0/1005196525 learned_addr learned my addr 172.21.15.41:0/1005196525 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:34.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1ceffd700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d80b6100 0x7fb1d813c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 -- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d80b6100 msgr2=0x7fb1d813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d80b6100 0x7fb1d813c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 -- 172.21.15.41:0/1005196525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 msgr2=0x7fb1d813ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d77fe700 1 -- 172.21.15.41:0/1005196525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c000b460 con 0x7fb1d80b05b0 2021-10-21T00:08:34.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.031+0000 7fb1d7fff700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:34.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d77fe700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 0x7fb1d813b7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fb1d8069fb0 tx=0x7fb1c8007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:34.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c8012400 con 0x7fb1d80b05b0 2021-10-21T00:08:34.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8012560 con 0x7fb1d80b05b0 2021-10-21T00:08:34.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d8152020 con 0x7fb1d80b05b0 2021-10-21T00:08:34.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c80128c0 con 0x7fb1d80b05b0 2021-10-21T00:08:34.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d813bfc0 con 0x7fb1d80b05b0 2021-10-21T00:08:34.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8152b50 con 0x7fb1d80b05b0 2021-10-21T00:08:34.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1c8019030 con 0x7fb1d80b05b0 2021-10-21T00:08:34.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 0x7fb1bc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:34.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.035+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb1c806ac00 con 0x7fb1d80b05b0 2021-10-21T00:08:34.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.039+0000 7fb1ceffd700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 0x7fb1bc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:34.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.039+0000 7fb1ceffd700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 0x7fb1bc055ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb1c001b000 tx=0x7fb1d80ae380).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:34.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.047+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1c8070020 con 0x7fb1d80b05b0 2021-10-21T00:08:34.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.175+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1d80af270 con 0x7fb1d80b05b0 2021-10-21T00:08:34.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.891+0000 7fb1d57fa700 1 -- 172.21.15.41:0/1005196525 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb1c8041d10 con 0x7fb1d80b05b0 2021-10-21T00:08:34.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 msgr2=0x7fb1bc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 0x7fb1bc055ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb1c001b000 tx=0x7fb1d80ae380).stop 2021-10-21T00:08:34.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 msgr2=0x7fb1d813b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:34.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 0x7fb1d813b7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fb1d8069fb0 tx=0x7fb1c8007b90).stop 2021-10-21T00:08:34.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 shutdown_connections 2021-10-21T00:08:34.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb1bc053610 0x7fb1bc055ad0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1d8143970 0x7fb1d813ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1d80b6100 0x7fb1d813c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:34.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 --2- 172.21.15.41:0/1005196525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1d80b05b0 0x7fb1d813b7e0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0x7fb1d8069fb0 tx=0x7fb1c8007b90).stop 2021-10-21T00:08:34.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 >> 172.21.15.41:0/1005196525 conn(0x7fb1d8063ab0 msgr2=0x7fb1d80b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:34.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.895+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 shutdown_connections 2021-10-21T00:08:34.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:34.899+0000 7fb1ddf98700 1 -- 172.21.15.41:0/1005196525 wait complete. 2021-10-21T00:08:34.905 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:08:34.916 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:08:35.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 Processor -- start 2021-10-21T00:08:35.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 -- start start 2021-10-21T00:08:35.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f00b5f70 0x7f77f00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f77f013f4f0 0x7f77f0067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00b6350 con 0x7f77f00b0180 2021-10-21T00:08:35.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00ae560 con 0x7f77f013f4f0 2021-10-21T00:08:35.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f709c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00ae800 con 0x7f77f00b5f70 2021-10-21T00:08:35.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f689b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f77f013f4f0 0x7f77f0067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f689b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f77f013f4f0 0x7f77f0067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33416/0 (socket says 172.21.15.41:33416) 2021-10-21T00:08:35.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f689b700 1 -- 172.21.15.41:0/2191433949 learned_addr learned my addr 172.21.15.41:0/2191433949 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:35.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.023+0000 7f77f609a700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f00b5f70 0x7f77f00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f5098700 1 -- 172.21.15.41:0/2191433949 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811421439 0 0) 0x7f77f00b6350 con 0x7f77f00b0180 2021-10-21T00:08:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f689b700 1 -- 172.21.15.41:0/2191433949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f00b5f70 msgr2=0x7f77f00aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f689b700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f00b5f70 0x7f77f00aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f689b700 1 -- 172.21.15.41:0/2191433949 >> v1:172.21.15.62:6789/0 conn(0x7f77f00b0180 legacy=0x7f77f013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f689b700 1 -- 172.21.15.41:0/2191433949 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00aeaa0 con 0x7f77f013f4f0 2021-10-21T00:08:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f689b700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f013f4f0 0x7f77f0067030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f77f00ad9c0 tx=0x7f77e8009290).ready entity=mon.0 client_cookie=30e275d783c40c3c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f5098700 1 -- 172.21.15.41:0/2191433949 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77e800b860 con 0x7f77f013f4f0 2021-10-21T00:08:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f5098700 1 -- 172.21.15.41:0/2191433949 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800b9c0 con 0x7f77f013f4f0 2021-10-21T00:08:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f5098700 1 -- 172.21.15.41:0/2191433949 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77e800bb30 con 0x7f77f013f4f0 2021-10-21T00:08:35.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 -- 172.21.15.41:0/2191433949 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f013f4f0 msgr2=0x7f77f0067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f013f4f0 0x7f77f0067030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f77f00ad9c0 tx=0x7f77e8009290).stop 2021-10-21T00:08:35.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 -- 172.21.15.41:0/2191433949 shutdown_connections 2021-10-21T00:08:35.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f013f4f0 0x7f77f0067030 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 --2- 172.21.15.41:0/2191433949 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f00b5f70 0x7f77f00aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 -- 172.21.15.41:0/2191433949 >> 172.21.15.41:0/2191433949 conn(0x7f77f00639f0 msgr2=0x7f77f00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:35.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 -- 172.21.15.41:0/2191433949 shutdown_connections 2021-10-21T00:08:35.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.027+0000 7f77f709c700 1 -- 172.21.15.41:0/2191433949 wait complete. 2021-10-21T00:08:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 Processor -- start 2021-10-21T00:08:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- start start 2021-10-21T00:08:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 0x7f77f0066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f013f4f0 0x7f77f014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f010ef50 con 0x7f77f00b5f70 2021-10-21T00:08:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0066240 con 0x7f77f00b0180 2021-10-21T00:08:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0065fa0 con 0x7f77f013f4f0 2021-10-21T00:08:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33420/0 (socket says 172.21.15.41:33420) 2021-10-21T00:08:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 -- 172.21.15.41:0/3418940790 learned_addr learned my addr 172.21.15.41:0/3418940790 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f609a700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 0x7f77f0066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f689b700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f013f4f0 0x7f77f014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 -- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f013f4f0 msgr2=0x7f77f014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f013f4f0 0x7f77f014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 -- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 msgr2=0x7f77f0066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 0x7f77f0066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 -- 172.21.15.41:0/3418940790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8009530 con 0x7f77f00b5f70 2021-10-21T00:08:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f609a700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 0x7f77f0066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f5899700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f77e0000ed0 tx=0x7f77e0007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77e00106b0 con 0x7f77f00b5f70 2021-10-21T00:08:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0010810 con 0x7f77f00b5f70 2021-10-21T00:08:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f010ecb0 con 0x7f77f00b5f70 2021-10-21T00:08:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77e0010b70 con 0x7f77f00b5f70 2021-10-21T00:08:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.031+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f0110b90 con 0x7f77f00b5f70 2021-10-21T00:08:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0110930 con 0x7f77f00b5f70 2021-10-21T00:08:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f77e0021070 con 0x7f77f00b5f70 2021-10-21T00:08:35.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77df7fe700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 0x7f77d0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:35.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f77e006e060 con 0x7f77f00b5f70 2021-10-21T00:08:35.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77f609a700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 0x7f77d0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:35.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.035+0000 7f77f609a700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 0x7f77d0055b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f77ec00b000 tx=0x7f77ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:35.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.039+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77e0045320 con 0x7f77f00b5f70 2021-10-21T00:08:35.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.167+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77f0057350 con 0x7f77f00b5f70 2021-10-21T00:08:35.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.907+0000 7f77df7fe700 1 -- 172.21.15.41:0/3418940790 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 173+0+0 (secure 0 0 0) 0x7f77e0015030 con 0x7f77f00b5f70 2021-10-21T00:08:35.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 msgr2=0x7f77d0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 0x7f77d0055b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f77ec00b000 tx=0x7f77ec008040).stop 2021-10-21T00:08:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 msgr2=0x7f77f014e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f77e0000ed0 tx=0x7f77e0007b20).stop 2021-10-21T00:08:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 shutdown_connections 2021-10-21T00:08:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f77d00536a0 0x7f77d0055b60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77f013f4f0 0x7f77f014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77f00b5f70 0x7f77f014e9d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 --2- 172.21.15.41:0/3418940790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77f00b0180 0x7f77f0066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 >> 172.21.15.41:0/3418940790 conn(0x7f77f00639f0 msgr2=0x7f77f0144f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:35.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 shutdown_connections 2021-10-21T00:08:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:35.911+0000 7f77f709c700 1 -- 172.21.15.41:0/3418940790 wait complete. 2021-10-21T00:08:35.917 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:08:35.928 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:08:36.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 Processor -- start 2021-10-21T00:08:36.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 -- start start 2021-10-21T00:08:36.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff78c0b9c20 0x7ff78c0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff78c0b41a0 0x7ff78c0b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0ba000 con 0x7ff78c05c860 2021-10-21T00:08:36.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c143bc0 con 0x7ff78c0b41a0 2021-10-21T00:08:36.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7918ad700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c05ccf0 con 0x7ff78c0b9c20 2021-10-21T00:08:36.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7910ac700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff78c0b41a0 0x7ff78c0b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7910ac700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff78c0b41a0 0x7ff78c0b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33430/0 (socket says 172.21.15.41:33430) 2021-10-21T00:08:36.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7910ac700 1 -- 172.21.15.41:0/2436872639 learned_addr learned my addr 172.21.15.41:0/2436872639 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:36.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.039+0000 7ff7908ab700 1 --2- 172.21.15.41:0/2436872639 >> v2:172.21.15.62:3300/0 conn(0x7ff78c0b9c20 0x7ff78c0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7910ac700 1 -- 172.21.15.41:0/2436872639 >> v2:172.21.15.62:3300/0 conn(0x7ff78c0b9c20 msgr2=0x7ff78c0acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff78b7fe700 1 -- 172.21.15.41:0/2436872639 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397415181 0 0) 0x7ff78c0ba000 con 0x7ff78c05c860 2021-10-21T00:08:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7910ac700 1 --2- 172.21.15.41:0/2436872639 >> v2:172.21.15.62:3300/0 conn(0x7ff78c0b9c20 0x7ff78c0acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7910ac700 1 -- 172.21.15.41:0/2436872639 >> v1:172.21.15.62:6789/0 conn(0x7ff78c05c860 legacy=0x7ff78c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7910ac700 1 -- 172.21.15.41:0/2436872639 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c142ad0 con 0x7ff78c0b41a0 2021-10-21T00:08:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7910ac700 1 --2- 172.21.15.41:0/2436872639 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0b45c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff78c0ba190 tx=0x7ff784009290).ready entity=mon.0 client_cookie=f688a717b10563f5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff78b7fe700 1 -- 172.21.15.41:0/2436872639 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78400b830 con 0x7ff78c0b41a0 2021-10-21T00:08:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff78b7fe700 1 -- 172.21.15.41:0/2436872639 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400b990 con 0x7ff78c0b41a0 2021-10-21T00:08:36.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff78b7fe700 1 -- 172.21.15.41:0/2436872639 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78400bb00 con 0x7ff78c0b41a0 2021-10-21T00:08:36.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 -- 172.21.15.41:0/2436872639 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 msgr2=0x7ff78c0b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 --2- 172.21.15.41:0/2436872639 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0b45c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff78c0ba190 tx=0x7ff784009290).stop 2021-10-21T00:08:36.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 -- 172.21.15.41:0/2436872639 shutdown_connections 2021-10-21T00:08:36.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 --2- 172.21.15.41:0/2436872639 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0b45c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 --2- 172.21.15.41:0/2436872639 >> v2:172.21.15.62:3300/0 conn(0x7ff78c0b9c20 0x7ff78c0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 -- 172.21.15.41:0/2436872639 >> 172.21.15.41:0/2436872639 conn(0x7ff78c062f00 msgr2=0x7ff78c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:36.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 -- 172.21.15.41:0/2436872639 shutdown_connections 2021-10-21T00:08:36.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.043+0000 7ff7918ad700 1 -- 172.21.15.41:0/2436872639 wait complete. 2021-10-21T00:08:36.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 Processor -- start 2021-10-21T00:08:36.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 -- start start 2021-10-21T00:08:36.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c05c860 0x7ff78c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff78c0b9c20 0x7ff78c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0aea30 con 0x7ff78c0b41a0 2021-10-21T00:08:36.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c148900 con 0x7ff78c05c860 2021-10-21T00:08:36.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7918ad700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c148ba0 con 0x7ff78c0b9c20 2021-10-21T00:08:36.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff78bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7908ab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c05c860 0x7ff78c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff78bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33434/0 (socket says 172.21.15.41:33434) 2021-10-21T00:08:36.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff78bfff700 1 -- 172.21.15.41:0/4212034452 learned_addr learned my addr 172.21.15.41:0/4212034452 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:36.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.047+0000 7ff7910ac700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff78c0b9c20 0x7ff78c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 -- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff78c0b9c20 msgr2=0x7ff78c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff78c0b9c20 0x7ff78c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 -- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c05c860 msgr2=0x7ff78c152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c05c860 0x7ff78c152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 -- 172.21.15.41:0/4212034452 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009530 con 0x7ff78c0b41a0 2021-10-21T00:08:36.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff78bfff700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7ff77c000bc0 tx=0x7ff77c007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77c012400 con 0x7ff78c0b41a0 2021-10-21T00:08:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c012560 con 0x7ff78c0b41a0 2021-10-21T00:08:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c0aee70 con 0x7ff78c0b41a0 2021-10-21T00:08:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77c0128c0 con 0x7ff78c0b41a0 2021-10-21T00:08:36.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c148400 con 0x7ff78c0b41a0 2021-10-21T00:08:36.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c148d60 con 0x7ff78c0b41a0 2021-10-21T00:08:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff77c019030 con 0x7ff78c0b41a0 2021-10-21T00:08:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 0x7ff76c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff77c06a890 con 0x7ff78c0b41a0 2021-10-21T00:08:36.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.051+0000 7ff7908ab700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 0x7ff76c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.055+0000 7ff7908ab700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 0x7ff76c055b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff780006000 tx=0x7ff780006d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.059+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff77c041d80 con 0x7ff78c0b41a0 2021-10-21T00:08:36.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.187+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff78c142d70 con 0x7ff78c0b41a0 2021-10-21T00:08:36.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff789ffb700 1 -- 172.21.15.41:0/4212034452 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff77c0453a0 con 0x7ff78c0b41a0 2021-10-21T00:08:36.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 msgr2=0x7ff76c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 0x7ff76c055b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff780006000 tx=0x7ff780006d90).stop 2021-10-21T00:08:36.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 msgr2=0x7ff78c0ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7ff77c000bc0 tx=0x7ff77c007a70).stop 2021-10-21T00:08:36.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 shutdown_connections 2021-10-21T00:08:36.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff76c0536a0 0x7ff76c055b60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff78c0b9c20 0x7ff78c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff78c0b41a0 0x7ff78c0ae540 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 --2- 172.21.15.41:0/4212034452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c05c860 0x7ff78c152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 >> 172.21.15.41:0/4212034452 conn(0x7ff78c062f00 msgr2=0x7ff78c13fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:36.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 shutdown_connections 2021-10-21T00:08:36.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.195+0000 7ff7918ad700 1 -- 172.21.15.41:0/4212034452 wait complete. 2021-10-21T00:08:36.213 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-10-21T00:08:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.303+0000 7f3218ac6700 1 Processor -- start 2021-10-21T00:08:36.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.303+0000 7f3218ac6700 1 -- start start 2021-10-21T00:08:36.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 0x7f3214147950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f32141464e0 0x7f3214146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f321405f940 0x7f321405fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140b1b40 con 0x7f32141464e0 2021-10-21T00:08:36.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3214146e10 con 0x7f32140b4380 2021-10-21T00:08:36.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214147e40 con 0x7f321405f940 2021-10-21T00:08:36.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f32141464e0 0x7f3214146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f32141464e0 0x7f3214146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33440/0 (socket says 172.21.15.41:33440) 2021-10-21T00:08:36.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 -- 172.21.15.41:0/2827765631 learned_addr learned my addr 172.21.15.41:0/2827765631 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:36.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3213fff700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f321405f940 0x7f321405fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f32137fe700 1 --2- 172.21.15.41:0/2827765631 >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 0x7f3214147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 -- 172.21.15.41:0/2827765631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f321405f940 msgr2=0x7f321405fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:36.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f321405f940 0x7f321405fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 -- 172.21.15.41:0/2827765631 >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 msgr2=0x7f3214147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:36.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 --2- 172.21.15.41:0/2827765631 >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 0x7f3214147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 -- 172.21.15.41:0/2827765631 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140b4760 con 0x7f32141464e0 2021-10-21T00:08:36.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f32137fe700 1 --2- 172.21.15.41:0/2827765631 >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 0x7f3214147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:36.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3212ffd700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32141464e0 0x7f3214146920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f31fc002f70 tx=0x7f31fc006eb0).ready entity=mon.0 client_cookie=27e2340c480765a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f32127fc700 1 -- 172.21.15.41:0/2827765631 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc00d570 con 0x7f32141464e0 2021-10-21T00:08:36.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f32127fc700 1 -- 172.21.15.41:0/2827765631 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc000e90 con 0x7f32141464e0 2021-10-21T00:08:36.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f32127fc700 1 -- 172.21.15.41:0/2827765631 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc00d900 con 0x7f32141464e0 2021-10-21T00:08:36.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- 172.21.15.41:0/2827765631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32141464e0 msgr2=0x7f3214146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32141464e0 0x7f3214146920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f31fc002f70 tx=0x7f31fc006eb0).stop 2021-10-21T00:08:36.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- 172.21.15.41:0/2827765631 shutdown_connections 2021-10-21T00:08:36.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32141464e0 0x7f3214146920 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- 172.21.15.41:0/2827765631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f321405f940 0x7f321405fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- 172.21.15.41:0/2827765631 >> v2:172.21.15.62:3300/0 conn(0x7f32140b4380 0x7f3214147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- 172.21.15.41:0/2827765631 >> 172.21.15.41:0/2827765631 conn(0x7f32140b7910 msgr2=0x7f32140b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:36.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- 172.21.15.41:0/2827765631 shutdown_connections 2021-10-21T00:08:36.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- 172.21.15.41:0/2827765631 wait complete. 2021-10-21T00:08:36.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 Processor -- start 2021-10-21T00:08:36.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- start start 2021-10-21T00:08:36.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f321405f940 0x7f321409b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32141464e0 0x7f3214159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321409b090 con 0x7f32140b4380 2021-10-21T00:08:36.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140afd70 con 0x7f321405f940 2021-10-21T00:08:36.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.307+0000 7f3218ac6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140affd0 con 0x7f32141464e0 2021-10-21T00:08:36.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33448/0 (socket says 172.21.15.41:33448) 2021-10-21T00:08:36.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 -- 172.21.15.41:0/269126805 learned_addr learned my addr 172.21.15.41:0/269126805 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:36.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f32137fe700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f321405f940 0x7f321409b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3213fff700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32141464e0 0x7f3214159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 -- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32141464e0 msgr2=0x7f3214159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32141464e0 0x7f3214159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 -- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f321405f940 msgr2=0x7f321409b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f321405f940 0x7f321409b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 -- 172.21.15.41:0/269126805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc00b1e0 con 0x7f32140b4380 2021-10-21T00:08:36.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3212ffd700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f31fc002f70 tx=0x7f31fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc00d8f0 con 0x7f32140b4380 2021-10-21T00:08:36.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc011b80 con 0x7f32140b4380 2021-10-21T00:08:36.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321409ab90 con 0x7f32140b4380 2021-10-21T00:08:36.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31fc01e460 con 0x7f32140b4380 2021-10-21T00:08:36.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321415a100 con 0x7f32140b4380 2021-10-21T00:08:36.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321409adb0 con 0x7f32140b4380 2021-10-21T00:08:36.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31fc025030 con 0x7f32140b4380 2021-10-21T00:08:36.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 0x7f31f80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:36.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f31fc06cdd0 con 0x7f32140b4380 2021-10-21T00:08:36.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.311+0000 7f32137fe700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 0x7f31f80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:36.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.315+0000 7f32137fe700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 0x7f31f80559b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f320400d000 tx=0x7f3204008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:36.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.319+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31fc044210 con 0x7f32140b4380 2021-10-21T00:08:36.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.483+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f3214062e50 con 0x7f32140b4380 2021-10-21T00:08:36.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.907+0000 7f3210ff9700 1 -- 172.21.15.41:0/269126805 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v242) v1 ==== 147+0+0 (secure 0 0 0) 0x7f31fc023070 con 0x7f32140b4380 2021-10-21T00:08:36.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 msgr2=0x7f31f80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 0x7f31f80559b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f320400d000 tx=0x7f3204008040).stop 2021-10-21T00:08:36.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 msgr2=0x7f321409a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:36.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f31fc002f70 tx=0x7f31fc015000).stop 2021-10-21T00:08:36.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 shutdown_connections 2021-10-21T00:08:36.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31f80534f0 0x7f31f80559b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32141464e0 0x7f3214159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f32140b4380 0x7f321409a4f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 --2- 172.21.15.41:0/269126805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f321405f940 0x7f321409b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:36.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 >> 172.21.15.41:0/269126805 conn(0x7f32140b7910 msgr2=0x7f3214145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:36.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 shutdown_connections 2021-10-21T00:08:36.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:36.911+0000 7f3218ac6700 1 -- 172.21.15.41:0/269126805 wait complete. 2021-10-21T00:08:36.935 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-10-21T00:08:36.935 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:08:36.936 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-10-21T00:08:37.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.043+0000 7f63f7fff700 1 Processor -- start 2021-10-21T00:08:37.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.043+0000 7f63f7fff700 1 -- start start 2021-10-21T00:08:37.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63f805c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80b6350 con 0x7f63f8142520 2021-10-21T00:08:37.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f805cee0 con 0x7f63f80b1a50 2021-10-21T00:08:37.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8067d00 con 0x7f63f80b5f70 2021-10-21T00:08:37.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f63f8142520 0x7f63f8145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59460/0 (socket says 172.21.15.41:59460) 2021-10-21T00:08:37.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 -- 172.21.15.41:0/2144176993 learned_addr learned my addr 172.21.15.41:0/2144176993 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:37.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f6ffd700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63f805c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952550040 0 0) 0x7f63f80b6350 con 0x7f63f8142520 2021-10-21T00:08:37.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d8003260 con 0x7f63f8142520 2021-10-21T00:08:37.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3078702861 0 0) 0x7f63d8003260 con 0x7f63f8142520 2021-10-21T00:08:37.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 msgr2=0x7f63f805c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:37.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63f805c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 >> v1:172.21.15.62:6789/0 conn(0x7f63f80b1a50 legacy=0x7f63f8141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f805d180 con 0x7f63f8142520 2021-10-21T00:08:37.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f63f00019e0 con 0x7f63f8142520 2021-10-21T00:08:37.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 >> v1:172.21.15.41:6789/0 conn(0x7f63f8142520 legacy=0x7f63f8145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63d8003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d8003cb0 0x7f63d8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63d8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8067d00 con 0x7f63d80049f0 2021-10-21T00:08:37.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d800b800 con 0x7f63d8003cb0 2021-10-21T00:08:37.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d800b9c0 con 0x7f63f80b5f70 2021-10-21T00:08:37.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63d8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f6ffd700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63d8003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63effff700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d8003cb0 0x7f63d8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 -- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 msgr2=0x7f63d8003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:37.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f80b5f70 0x7f63d8003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 -- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d8003cb0 msgr2=0x7f63d8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:37.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d8003cb0 0x7f63d8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 -- 172.21.15.41:0/2144176993 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8003260 con 0x7f63d80049f0 2021-10-21T00:08:37.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63effff700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d8003cb0 0x7f63d8004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:37.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63d8004e70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f63f00016f0 tx=0x7f63f805ccb0).ready entity=mon.0 client_cookie=fdda8d80b799c0d1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:37.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f000cc70 con 0x7f63d80049f0 2021-10-21T00:08:37.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000cdd0 con 0x7f63d80049f0 2021-10-21T00:08:37.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f67fc700 1 -- 172.21.15.41:0/2144176993 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f0005b80 con 0x7f63d80049f0 2021-10-21T00:08:37.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 -- 172.21.15.41:0/2144176993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 msgr2=0x7f63d8004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f7fff700 1 --2- 172.21.15.41:0/2144176993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63d8004e70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f63f00016f0 tx=0x7f63f805ccb0).stop 2021-10-21T00:08:37.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.047+0000 7f63f77fe700 1 -- 172.21.15.41:0/2144176993 reap_dead start 2021-10-21T00:08:37.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- 172.21.15.41:0/2144176993 shutdown_connections 2021-10-21T00:08:37.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- 172.21.15.41:0/2144176993 >> 172.21.15.41:0/2144176993 conn(0x7f63f80639f0 msgr2=0x7f63f80b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:37.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- 172.21.15.41:0/2144176993 shutdown_connections 2021-10-21T00:08:37.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- 172.21.15.41:0/2144176993 wait complete. 2021-10-21T00:08:37.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 Processor -- start 2021-10-21T00:08:37.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- start start 2021-10-21T00:08:37.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f8151bb0 0x7f63f80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f81555d0 0x7f63f8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8152bd0 con 0x7f63d80049f0 2021-10-21T00:08:37.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8152e90 con 0x7f63f8151bb0 2021-10-21T00:08:37.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81551e0 con 0x7f63f81555d0 2021-10-21T00:08:37.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.051+0000 7f63f6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33466/0 (socket says 172.21.15.41:33466) 2021-10-21T00:08:37.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 -- 172.21.15.41:0/654687603 learned_addr learned my addr 172.21.15.41:0/654687603 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:37.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63effff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f8151bb0 0x7f63f80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f77fe700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f81555d0 0x7f63f8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 -- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f81555d0 msgr2=0x7f63f8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f81555d0 0x7f63f8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 -- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f8151bb0 msgr2=0x7f63f80ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f8151bb0 0x7f63f80ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 -- 172.21.15.41:0/654687603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8146870 con 0x7f63d80049f0 2021-10-21T00:08:37.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f6ffd700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f63e800b000 tx=0x7f63e8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:37.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e800f760 con 0x7f63d80049f0 2021-10-21T00:08:37.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e800f8c0 con 0x7f63d80049f0 2021-10-21T00:08:37.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f8146b10 con 0x7f63d80049f0 2021-10-21T00:08:37.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e800fc20 con 0x7f63d80049f0 2021-10-21T00:08:37.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f8066c70 con 0x7f63d80049f0 2021-10-21T00:08:37.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8151f90 con 0x7f63d80049f0 2021-10-21T00:08:37.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63e8014440 con 0x7f63d80049f0 2021-10-21T00:08:37.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 0x7f63dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:37.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.055+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f63e806bfd0 con 0x7f63d80049f0 2021-10-21T00:08:37.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.059+0000 7f63effff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 0x7f63dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:37.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.059+0000 7f63effff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 0x7f63dc055ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f63e000d000 tx=0x7f63e000c040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:37.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.063+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63e80433b0 con 0x7f63d80049f0 2021-10-21T00:08:37.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.231+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f63f8057350 con 0x7f63d80049f0 2021-10-21T00:08:37.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.911+0000 7f63f4ff9700 1 -- 172.21.15.41:0/654687603 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v243) v1 ==== 142+0+0 (secure 0 0 0) 0x7f63e8018070 con 0x7f63d80049f0 2021-10-21T00:08:37.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 msgr2=0x7f63dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 0x7f63dc055ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f63e000d000 tx=0x7f63e000c040).stop 2021-10-21T00:08:37.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 msgr2=0x7f63f8147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:37.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f63e800b000 tx=0x7f63e8006df0).stop 2021-10-21T00:08:37.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 shutdown_connections 2021-10-21T00:08:37.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63dc053610 0x7f63dc055ad0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63f81555d0 0x7f63f8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63f8151bb0 0x7f63f80ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 --2- 172.21.15.41:0/654687603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63d80049f0 0x7f63f8147a30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:37.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 >> 172.21.15.41:0/654687603 conn(0x7f63f80639f0 msgr2=0x7f63f80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:37.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 shutdown_connections 2021-10-21T00:08:37.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:37.915+0000 7f63f7fff700 1 -- 172.21.15.41:0/654687603 wait complete. 2021-10-21T00:08:37.937 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:08:38.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 Processor -- start 2021-10-21T00:08:38.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 -- start start 2021-10-21T00:08:38.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 0x7f0d3405c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d340b41a0 0x7f0d34141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340ba000 con 0x7f0d340b9c20 2021-10-21T00:08:38.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d34143bc0 con 0x7f0d340b41a0 2021-10-21T00:08:38.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.047+0000 7f0d38ab1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34142ad0 con 0x7f0d340acd30 2021-10-21T00:08:38.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d337fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0d340b9c20 0x7f0d341434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59478/0 (socket says 172.21.15.41:59478) 2021-10-21T00:08:38.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d337fe700 1 -- 172.21.15.41:0/3784956100 learned_addr learned my addr 172.21.15.41:0/3784956100 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:38.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 --2- 172.21.15.41:0/3784956100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 0x7f0d3405c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d33fff700 1 --2- 172.21.15.41:0/3784956100 >> v2:172.21.15.62:3300/0 conn(0x7f0d340b41a0 0x7f0d34141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326763637 0 0) 0x7f0d340ba000 con 0x7f0d340b9c20 2021-10-21T00:08:38.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d20003260 con 0x7f0d340b9c20 2021-10-21T00:08:38.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 -- 172.21.15.41:0/3784956100 >> v2:172.21.15.62:3300/0 conn(0x7f0d340b41a0 msgr2=0x7f0d34141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:38.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 --2- 172.21.15.41:0/3784956100 >> v2:172.21.15.62:3300/0 conn(0x7f0d340b41a0 0x7f0d34141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 -- 172.21.15.41:0/3784956100 >> v1:172.21.15.41:6789/0 conn(0x7f0d340b9c20 legacy=0x7f0d341434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 212625502 0 0) 0x7f0d20003260 con 0x7f0d340b9c20 2021-10-21T00:08:38.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 -- 172.21.15.41:0/3784956100 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34142d70 con 0x7f0d340acd30 2021-10-21T00:08:38.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d32ffd700 1 --2- 172.21.15.41:0/3784956100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 0x7f0d3405c860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0d24004f60 tx=0x7f0d28006df0).ready entity=mon.2 client_cookie=707883362dfc4b38 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d24004dc0 con 0x7f0d340acd30 2021-10-21T00:08:38.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d28000e90 con 0x7f0d340acd30 2021-10-21T00:08:38.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d327fc700 1 -- 172.21.15.41:0/3784956100 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d28012460 con 0x7f0d340acd30 2021-10-21T00:08:38.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 -- 172.21.15.41:0/3784956100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 msgr2=0x7f0d3405c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/3784956100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 0x7f0d3405c860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0d24004f60 tx=0x7f0d28006df0).stop 2021-10-21T00:08:38.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 -- 172.21.15.41:0/3784956100 shutdown_connections 2021-10-21T00:08:38.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/3784956100 >> v2:172.21.15.62:3300/0 conn(0x7f0d340b41a0 0x7f0d34141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/3784956100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340acd30 0x7f0d3405c860 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 -- 172.21.15.41:0/3784956100 >> 172.21.15.41:0/3784956100 conn(0x7f0d34062f00 msgr2=0x7f0d340b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:38.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 -- 172.21.15.41:0/3784956100 shutdown_connections 2021-10-21T00:08:38.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.051+0000 7f0d38ab1700 1 -- 172.21.15.41:0/3784956100 wait complete. 2021-10-21T00:08:38.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 Processor -- start 2021-10-21T00:08:38.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 -- start start 2021-10-21T00:08:38.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d340acd30 0x7f0d340b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340b41a0 0x7f0d340adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340b21a0 con 0x7f0d340b9c20 2021-10-21T00:08:38.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340b3660 con 0x7f0d340acd30 2021-10-21T00:08:38.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d38ab1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340afa90 con 0x7f0d340b41a0 2021-10-21T00:08:38.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d33fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d337fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d340acd30 0x7f0d340b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d33fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33486/0 (socket says 172.21.15.41:33486) 2021-10-21T00:08:38.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d33fff700 1 -- 172.21.15.41:0/885053432 learned_addr learned my addr 172.21.15.41:0/885053432 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:38.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.055+0000 7f0d32ffd700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340b41a0 0x7f0d340adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 -- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340b41a0 msgr2=0x7f0d340adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340b41a0 0x7f0d340adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 -- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d340acd30 msgr2=0x7f0d340b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d340acd30 0x7f0d340b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 -- 172.21.15.41:0/885053432 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2800b180 con 0x7f0d340b9c20 2021-10-21T00:08:38.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d33fff700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f0d34146f00 tx=0x7f0d2c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c00c640 con 0x7f0d340b9c20 2021-10-21T00:08:38.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00c7a0 con 0x7f0d340b9c20 2021-10-21T00:08:38.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340b0fe0 con 0x7f0d340b9c20 2021-10-21T00:08:38.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c00cb00 con 0x7f0d340b9c20 2021-10-21T00:08:38.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340b1280 con 0x7f0d340b9c20 2021-10-21T00:08:38.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d34143010 con 0x7f0d340b9c20 2021-10-21T00:08:38.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.059+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d2c00cc60 con 0x7f0d340b9c20 2021-10-21T00:08:38.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.063+0000 7f0d30ff9700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 0x7f0d14055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.063+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0d2c06b840 con 0x7f0d340b9c20 2021-10-21T00:08:38.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.063+0000 7f0d337fe700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 0x7f0d14055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.063+0000 7f0d337fe700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 0x7f0d14055b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0d2400d000 tx=0x7f0d24004d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.067+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d2c042c80 con 0x7f0d340b9c20 2021-10-21T00:08:38.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.199+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d34057350 con 0x7f0d340b9c20 2021-10-21T00:08:38.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d30ff9700 1 -- 172.21.15.41:0/885053432 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d2c0462a0 con 0x7f0d340b9c20 2021-10-21T00:08:38.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 msgr2=0x7f0d14055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 0x7f0d14055b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0d2400d000 tx=0x7f0d24004d30).stop 2021-10-21T00:08:38.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 msgr2=0x7f0d341524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f0d34146f00 tx=0x7f0d2c0091d0).stop 2021-10-21T00:08:38.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 shutdown_connections 2021-10-21T00:08:38.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d140536d0 0x7f0d14055b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d340b9c20 0x7f0d341524d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d340b41a0 0x7f0d340adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 --2- 172.21.15.41:0/885053432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d340acd30 0x7f0d340b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 >> 172.21.15.41:0/885053432 conn(0x7f0d34062f00 msgr2=0x7f0d3405c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:38.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 shutdown_connections 2021-10-21T00:08:38.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.203+0000 7f0d38ab1700 1 -- 172.21.15.41:0/885053432 wait complete. 2021-10-21T00:08:38.225 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:08:38.226 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:38.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:38.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:38.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:38.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:08:38.333 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:08:38.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:38.334 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:38.334 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:08:38.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:38.343 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:38.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:38.345 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:38.345 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:38.358 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:08:38.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:38.360 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:08:38.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:38.361 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:38.361 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:08:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:08:38.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:08:38.382 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:08:38.382 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:08:38.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 Processor -- start 2021-10-21T00:08:38.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 -- start start 2021-10-21T00:08:38.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f29e40b2170 0x7f29e40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29e40af620 0x7f29e40ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e414a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40b0b50 con 0x7f29e40b2170 2021-10-21T00:08:38.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40b2550 con 0x7f29e40af620 2021-10-21T00:08:38.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e8989700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40b0d90 con 0x7f29e40abb50 2021-10-21T00:08:38.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f29e40b2170 0x7f29e40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e2ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29e40af620 0x7f29e40ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e414a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f29e40b2170 0x7f29e40ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33492/0 (socket says 172.21.15.41:33492) 2021-10-21T00:08:38.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 -- 172.21.15.41:0/3579939286 learned_addr learned my addr 172.21.15.41:0/3579939286 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:38.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 -- 172.21.15.41:0/3579939286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 msgr2=0x7f29e414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:38.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 --2- 172.21.15.41:0/3579939286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e414a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 -- 172.21.15.41:0/3579939286 >> v2:172.21.15.62:3300/0 conn(0x7f29e40af620 msgr2=0x7f29e40ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:38.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 --2- 172.21.15.41:0/3579939286 >> v2:172.21.15.62:3300/0 conn(0x7f29e40af620 0x7f29e40ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 -- 172.21.15.41:0/3579939286 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40b1030 con 0x7f29e40b2170 2021-10-21T00:08:38.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e37fe700 1 --2- 172.21.15.41:0/3579939286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ab170 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f29d8002f70 tx=0x7f29d8006eb0).ready entity=mon.0 client_cookie=90bc893950ba7721 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e27fc700 1 -- 172.21.15.41:0/3579939286 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d800d570 con 0x7f29e40b2170 2021-10-21T00:08:38.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e27fc700 1 -- 172.21.15.41:0/3579939286 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8000e90 con 0x7f29e40b2170 2021-10-21T00:08:38.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.495+0000 7f29e27fc700 1 -- 172.21.15.41:0/3579939286 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d800d900 con 0x7f29e40b2170 2021-10-21T00:08:38.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- 172.21.15.41:0/3579939286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 msgr2=0x7f29e40ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 --2- 172.21.15.41:0/3579939286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ab170 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f29d8002f70 tx=0x7f29d8006eb0).stop 2021-10-21T00:08:38.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- 172.21.15.41:0/3579939286 shutdown_connections 2021-10-21T00:08:38.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 --2- 172.21.15.41:0/3579939286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e414a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 --2- 172.21.15.41:0/3579939286 >> v2:172.21.15.62:3300/0 conn(0x7f29e40af620 0x7f29e40ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 --2- 172.21.15.41:0/3579939286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ab170 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- 172.21.15.41:0/3579939286 >> 172.21.15.41:0/3579939286 conn(0x7f29e40b5700 msgr2=0x7f29e40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:38.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- 172.21.15.41:0/3579939286 shutdown_connections 2021-10-21T00:08:38.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- 172.21.15.41:0/3579939286 wait complete. 2021-10-21T00:08:38.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 Processor -- start 2021-10-21T00:08:38.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.499+0000 7f29e8989700 1 -- start start 2021-10-21T00:08:38.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e41445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29e40af620 0x7f29e4144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4145380 con 0x7f29e40b2170 2021-10-21T00:08:38.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4156e30 con 0x7f29e40af620 2021-10-21T00:08:38.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40aca60 con 0x7f29e40abb50 2021-10-21T00:08:38.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33500/0 (socket says 172.21.15.41:33500) 2021-10-21T00:08:38.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 -- 172.21.15.41:0/221309514 learned_addr learned my addr 172.21.15.41:0/221309514 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:38.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e37fe700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e41445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e2ffd700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29e40af620 0x7f29e4144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 -- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 msgr2=0x7f29e41445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e41445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 -- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29e40af620 msgr2=0x7f29e4144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29e40af620 0x7f29e4144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 -- 172.21.15.41:0/221309514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d800b1e0 con 0x7f29e40b2170 2021-10-21T00:08:38.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e37fe700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e41445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:38.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e3fff700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f29dc006e00 tx=0x7f29dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29dc00c670 con 0x7f29e40b2170 2021-10-21T00:08:38.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00c7d0 con 0x7f29e40b2170 2021-10-21T00:08:38.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29dc00cb30 con 0x7f29e40b2170 2021-10-21T00:08:38.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e4156110 con 0x7f29e40b2170 2021-10-21T00:08:38.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e41565c0 con 0x7f29e40b2170 2021-10-21T00:08:38.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f29dc022070 con 0x7f29e40b2170 2021-10-21T00:08:38.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e40acc80 con 0x7f29e40b2170 2021-10-21T00:08:38.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 0x7f29c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.503+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f29dc06bc50 con 0x7f29e40b2170 2021-10-21T00:08:38.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.507+0000 7f29e37fe700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 0x7f29c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.507+0000 7f29e37fe700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 0x7f29c4055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f29d801a000 tx=0x7f29d8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.511+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f29dc043090 con 0x7f29e40b2170 2021-10-21T00:08:38.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.639+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f29e40b12d0 con 0x7f29e40b2170 2021-10-21T00:08:38.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e0ff9700 1 -- 172.21.15.41:0/221309514 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v62) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f29dc0466b0 con 0x7f29e40b2170 2021-10-21T00:08:38.647 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:38.647 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:08:38.648 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 62, 2021-10-21T00:08:38.648 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:08:38.648 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:08:38.649 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:08:35.900111+0000", 2021-10-21T00:08:38.649 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:08:38.649 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:08:38.650 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:08:38.650 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:08:38.650 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:08:38.650 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:08:38.651 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:08:38.651 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:08:38.651 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:08:38.651 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:38.652 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:08:38.652 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:08:38.652 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:08:38.654 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:08:38.654 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:08:38.654 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 12, 2021-10-21T00:08:38.655 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:08:38.655 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:08:38.655 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:08:38.655 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:08:38.655 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:08:38.656 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.656 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:08:38.656 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:08:38.656 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:08:38.657 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:38.657 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:38.657 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:38.657 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:38.658 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:38.658 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:38.658 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:38.658 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:38.658 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:08:38.659 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:08:38.659 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:08:38.659 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:08:38.659 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:08:38.660 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:38.660 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:38.660 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:38.660 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:38.660 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:38.661 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:38.661 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:38.661 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.661 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:08:38.662 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:38.662 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:38.662 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:38.662 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:38.662 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:38.663 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:38.663 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:38.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:38.663 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:38.664 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:38.664 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:38.664 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:38.664 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:38.664 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:38.665 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:38.665 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:38.665 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:38.665 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:38.665 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:38.666 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:38.666 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:38.666 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:38.666 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:38.667 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:38.667 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:38.667 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:38.667 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.667 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:38.668 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:38.668 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:38.668 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:38.668 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:38.668 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:38.669 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:38.669 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:38.669 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:38.669 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:38.670 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:38.670 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:08:38.670 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:08:38.670 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.670 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:38.671 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:08:38.671 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.671 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.671 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.671 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:08:38.672 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:08:38.672 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:08:38.672 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:08:38.672 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:08:38.673 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:08:38.673 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:08:38.673 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:08:38.673 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:08:38.673 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:08:38.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:08:38.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:08:38.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:08:38.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:08:38.675 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:08:38.675 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:08:38.675 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:08:38.675 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:08:38.675 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:08:38.676 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:08:38.676 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:08:38.676 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:08:38.676 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:08:38.676 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.677 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:08:38.677 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:08:38.677 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:08:38.677 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:08:38.678 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:08:38.678 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:08:38.678 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:08:38.678 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:08:38.678 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:08:38.679 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:08:38.679 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:08:38.679 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:08:38.679 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:08:38.679 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:08:38.680 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:08:38.680 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:08:38.680 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:08:38.680 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:08:38.681 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:08:38.681 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:08:38.681 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:08:38.681 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:08:38.681 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:08:38.682 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:08:38.682 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:08:38.682 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:08:38.682 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:08:38.682 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.683 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:08:38.683 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:08:38.683 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:08:38.683 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:08:38.684 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:08:38.684 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:08:38.684 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:08:38.684 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:08:38.684 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:08:38.685 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:08:38.685 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:08:38.685 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:08:38.685 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:08:38.685 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:08:38.686 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.686 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.686 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:38.686 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:08:38.687 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.687 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:08:38.687 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:08:38.687 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.687 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.688 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.688 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.688 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.688 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.689 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.689 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:38.689 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.689 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.689 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.690 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.690 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.690 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.690 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:08:38.691 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.691 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.691 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.691 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.691 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:08:38.692 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.692 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.692 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.693 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.693 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.693 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.693 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.693 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:08:38.694 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.694 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.694 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.694 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.694 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:08:38.695 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.695 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.695 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.695 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.696 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.696 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.696 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.696 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.696 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:08:38.697 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.697 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.697 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.697 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.698 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:08:38.698 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.698 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.698 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.698 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.699 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.699 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.699 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.699 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.699 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:08:38.700 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.700 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.700 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.700 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.701 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:08:38.701 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:08:38.701 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.701 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.701 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.702 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:08:38.702 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:08:38.702 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:08:38.702 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:08:38.703 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.703 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.703 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.703 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.703 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.704 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.704 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:08:38.704 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:08:38.704 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.704 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.705 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.705 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.705 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.705 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.706 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.706 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:38.706 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.706 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.706 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.707 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.707 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.707 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.707 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:08:38.708 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.708 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.708 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.708 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.708 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:08:38.709 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.709 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.709 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.709 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.709 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.710 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.710 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.710 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.710 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:08:38.711 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.711 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.711 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.711 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.711 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:08:38.712 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.712 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.712 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.712 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.712 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.713 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.713 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.713 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.713 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:08:38.714 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.714 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.714 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.714 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.714 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:08:38.715 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.715 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.715 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.715 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.715 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.716 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.716 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.716 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.716 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:08:38.717 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.717 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.717 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.717 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.717 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:08:38.718 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:08:38.718 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.718 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.718 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.718 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:08:38.719 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:08:38.719 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:08:38.719 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:08:38.719 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.720 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.720 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.720 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.720 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.720 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.721 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:08:38.721 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:08:38.721 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.721 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.721 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.722 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.722 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.722 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.722 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.723 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:38.723 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.723 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.723 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.723 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.724 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.724 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.724 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:08:38.724 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.725 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.725 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.725 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.725 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:08:38.725 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.726 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.726 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.726 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.726 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.727 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.727 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.727 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:08:38.727 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.728 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.728 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.728 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.728 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:08:38.728 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.729 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.729 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.729 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.729 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.730 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.730 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.730 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.730 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:08:38.730 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.731 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.731 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.731 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.731 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:08:38.731 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.732 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.732 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.732 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.732 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.733 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.733 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.733 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.733 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:08:38.733 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.734 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.734 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.734 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.734 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:08:38.734 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:08:38.735 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.735 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.735 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.735 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:08:38.736 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:08:38.736 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:08:38.736 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:08:38.736 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.736 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.737 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.737 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.737 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.737 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.737 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:08:38.738 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:08:38.738 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.738 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.738 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.739 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.739 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.739 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.739 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.739 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 47, 2021-10-21T00:08:38.740 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.740 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.740 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.740 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.740 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.741 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.741 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:08:38.741 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.741 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.741 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.742 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.742 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:08:38.742 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.742 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.743 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.743 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.743 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.743 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.743 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.744 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.744 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:08:38.744 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.744 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.745 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.745 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.745 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:08:38.745 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.745 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.746 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.746 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.746 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.746 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.747 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.747 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.747 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:08:38.747 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.747 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.748 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.748 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.748 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:08:38.748 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.748 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.749 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.749 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.749 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.749 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.749 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.750 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.750 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:08:38.750 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.750 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.751 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.751 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.751 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:08:38.751 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:08:38.751 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.752 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.752 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.752 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:08:38.752 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:08:38.752 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:08:38.753 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:08:38.753 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.753 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.753 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.754 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.754 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.754 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.754 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:08:38.754 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:08:38.755 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.755 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.755 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.755 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.756 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.756 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.756 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.756 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 57, 2021-10-21T00:08:38.756 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.757 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.757 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.757 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.757 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.758 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.758 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:08:38.758 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.758 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.758 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.759 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.759 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:08:38.759 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.759 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.760 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.760 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.760 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.760 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.760 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.761 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.761 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:08:38.761 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.761 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.762 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.762 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.762 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:08:38.762 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.762 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.763 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.763 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.763 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.763 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.764 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.764 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.764 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:08:38.764 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.764 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.765 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.765 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.765 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:08:38.765 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.766 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.766 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.766 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.766 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.766 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.767 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.767 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.767 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:08:38.767 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.768 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.768 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.768 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.768 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:08:38.768 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:08:38.769 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.769 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.769 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.769 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:08:38.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:08:38.770 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:08:38.770 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:08:38.770 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.770 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.771 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.771 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.771 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.771 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.771 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:08:38.772 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:08:38.772 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.772 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.772 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.773 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.773 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.773 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.773 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.773 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:38.774 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.774 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.774 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.774 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.774 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.775 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.775 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:08:38.775 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.775 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.776 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.776 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.776 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:08:38.776 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.776 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.777 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.777 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.777 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.777 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.777 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.778 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.778 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:08:38.778 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.778 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.779 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.779 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.779 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:08:38.779 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.779 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.780 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.780 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.780 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.780 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.781 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.781 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.781 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:08:38.781 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.782 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.782 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.782 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.782 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:08:38.782 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.783 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.783 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.783 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.783 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.784 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.784 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.784 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.784 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:08:38.784 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.785 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.785 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.785 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.785 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:08:38.785 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:08:38.786 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.786 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.786 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.786 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:08:38.787 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:08:38.787 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:08:38.787 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:08:38.787 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.787 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.788 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.788 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.788 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.788 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.789 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:08:38.789 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:08:38.789 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.789 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.790 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.790 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.790 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.790 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.790 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.791 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:08:38.791 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.791 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.791 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.791 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.792 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.792 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.792 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:08:38.792 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.793 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.793 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.793 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.793 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:08:38.793 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.794 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.794 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.794 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.794 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.794 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.795 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.795 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.795 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:08:38.795 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.796 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.796 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.796 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.796 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:08:38.796 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.797 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.797 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.797 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.797 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.798 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.798 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.798 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.798 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:08:38.799 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.799 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.799 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.799 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.799 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:08:38.800 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.800 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.800 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.800 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.801 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.801 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.801 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.801 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.801 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:08:38.802 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.802 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.802 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.802 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.802 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:08:38.803 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:08:38.803 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.803 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.803 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.804 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:08:38.804 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:08:38.804 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:08:38.804 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:08:38.804 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.805 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.805 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.805 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.805 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.806 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.806 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:08:38.806 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:08:38.806 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:08:38.806 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:08:38.807 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:08:38.807 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:08:38.807 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:08:38.807 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:08:38.808 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:08:38.808 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 55, 2021-10-21T00:08:38.808 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:08:38.808 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:08:38.808 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:08:38.809 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.809 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.809 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.809 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:08:38.809 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.810 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.810 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.810 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.810 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:08:38.811 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.811 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.811 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.811 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.811 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:08:38.812 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.812 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.812 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.812 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:08:38.812 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.813 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.813 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.813 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.813 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:08:38.814 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.814 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.814 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.814 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.814 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:08:38.815 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.815 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.815 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.815 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:08:38.816 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.816 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.816 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.816 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.816 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:08:38.817 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.817 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.817 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.817 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.817 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:08:38.818 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:08:38.818 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.818 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:08:38.818 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:08:38.819 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.819 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.819 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.819 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:08:38.819 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:08:38.820 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:08:38.820 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.820 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.820 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.820 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:08:38.821 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:08:38.821 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:08:38.821 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:08:38.821 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:08:38.822 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:08:38.822 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:08:38.822 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:38.822 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.822 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:38.823 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:08:38.823 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.823 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:08:38.823 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.824 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.824 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.824 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.824 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.824 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:08:38.825 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.825 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.825 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.825 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:08:38.826 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.826 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.826 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.826 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.826 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.827 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:08:38.827 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.827 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.827 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.827 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:08:38.828 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.828 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.828 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.828 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.828 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.829 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:08:38.829 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.829 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.829 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.830 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:08:38.830 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.830 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.830 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.830 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.831 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.831 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:08:38.831 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.831 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.831 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.832 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:08:38.832 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.832 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.832 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.833 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.833 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.833 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:08:38.833 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.833 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.834 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.834 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:08:38.834 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.834 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.834 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.835 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.835 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.835 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:08:38.835 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.836 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.836 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.836 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:08:38.836 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.836 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.837 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.837 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.837 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.837 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:08:38.837 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.838 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.838 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:38.838 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:08:38.838 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:08:38.839 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:08:38.839 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:08:38.839 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:08:38.839 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:08:38.839 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:08:38.840 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:08:38.840 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.840 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:08:38.840 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:08:38.840 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:08:38.841 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:08:38.841 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:08:38.841 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:08:38.841 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/1883344240": "2021-10-22T00:08:31.873469+0000", 2021-10-21T00:08:38.842 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/1883344240": "2021-10-22T00:08:31.873469+0000" 2021-10-21T00:08:38.842 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.842 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:08:38.842 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:08:38.842 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:08:38.843 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:08:38.843 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:08:38.843 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:08:38.843 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:08:38.843 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:08:38.844 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:38.844 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:38.844 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:08:38.844 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:08:38.844 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:08:38.845 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:08:38.845 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:08:38.845 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:08:38.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 msgr2=0x7f29c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 0x7f29c4055ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f29d801a000 tx=0x7f29d8015000).stop 2021-10-21T00:08:38.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 msgr2=0x7f29e40ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f29dc006e00 tx=0x7f29dc0091d0).stop 2021-10-21T00:08:38.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 shutdown_connections 2021-10-21T00:08:38.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f29c4053610 0x7f29c4055ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f29e40b2170 0x7f29e40ac570 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29e40af620 0x7f29e4144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 --2- 172.21.15.41:0/221309514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29e40abb50 0x7f29e41445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 >> 172.21.15.41:0/221309514 conn(0x7f29e40b5700 msgr2=0x7f29e405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:38.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 shutdown_connections 2021-10-21T00:08:38.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.643+0000 7f29e8989700 1 -- 172.21.15.41:0/221309514 wait complete. 2021-10-21T00:08:38.851 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:38.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 Processor -- start 2021-10-21T00:08:38.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 -- start start 2021-10-21T00:08:38.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 0x7f21580ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21580b1830 0x7f215805f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21580ae020 con 0x7f21581433e0 2021-10-21T00:08:38.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21580ade00 con 0x7f21580b1830 2021-10-21T00:08:38.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215ddb0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21580b4760 con 0x7f21580b4380 2021-10-21T00:08:38.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215d5af700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f21581433e0 0x7f2158062940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59510/0 (socket says 172.21.15.41:59510) 2021-10-21T00:08:38.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215d5af700 1 -- 172.21.15.41:0/663940158 learned_addr learned my addr 172.21.15.41:0/663940158 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:38.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.951+0000 7f215cdae700 1 --2- 172.21.15.41:0/663940158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 0x7f21580ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f2157fff700 1 --2- 172.21.15.41:0/663940158 >> v2:172.21.15.62:3300/0 conn(0x7f21580b1830 0x7f215805f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f21577fe700 1 -- 172.21.15.41:0/663940158 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87625604 0 0) 0x7f21580ae020 con 0x7f21581433e0 2021-10-21T00:08:38.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f21577fe700 1 -- 172.21.15.41:0/663940158 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f213c003260 con 0x7f21581433e0 2021-10-21T00:08:38.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215cdae700 1 -- 172.21.15.41:0/663940158 >> v2:172.21.15.62:3300/0 conn(0x7f21580b1830 msgr2=0x7f215805f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:38.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215cdae700 1 --2- 172.21.15.41:0/663940158 >> v2:172.21.15.62:3300/0 conn(0x7f21580b1830 0x7f215805f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215cdae700 1 -- 172.21.15.41:0/663940158 >> v1:172.21.15.41:6789/0 conn(0x7f21581433e0 legacy=0x7f2158062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215cdae700 1 -- 172.21.15.41:0/663940158 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158142ca0 con 0x7f21580b4380 2021-10-21T00:08:38.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215cdae700 1 --2- 172.21.15.41:0/663940158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 0x7f21580ad910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f214c002f70 tx=0x7f214c006df0).ready entity=mon.2 client_cookie=f041f99735cffed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f21577fe700 1 -- 172.21.15.41:0/663940158 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f214c00d4a0 con 0x7f21580b4380 2021-10-21T00:08:38.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f21577fe700 1 -- 172.21.15.41:0/663940158 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c000e90 con 0x7f21580b4380 2021-10-21T00:08:38.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f21577fe700 1 -- 172.21.15.41:0/663940158 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f214c00d7f0 con 0x7f21580b4380 2021-10-21T00:08:38.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 -- 172.21.15.41:0/663940158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 msgr2=0x7f21580ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 --2- 172.21.15.41:0/663940158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 0x7f21580ad910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f214c002f70 tx=0x7f214c006df0).stop 2021-10-21T00:08:38.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 -- 172.21.15.41:0/663940158 shutdown_connections 2021-10-21T00:08:38.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 --2- 172.21.15.41:0/663940158 >> v2:172.21.15.62:3300/0 conn(0x7f21580b1830 0x7f215805f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 --2- 172.21.15.41:0/663940158 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b4380 0x7f21580ad910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 -- 172.21.15.41:0/663940158 >> 172.21.15.41:0/663940158 conn(0x7f21580b7910 msgr2=0x7f21580b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:38.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 -- 172.21.15.41:0/663940158 shutdown_connections 2021-10-21T00:08:38.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.955+0000 7f215ddb0700 1 -- 172.21.15.41:0/663940158 wait complete. 2021-10-21T00:08:38.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 Processor -- start 2021-10-21T00:08:38.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 -- start start 2021-10-21T00:08:38.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b1830 0x7f2158152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 0x7f215809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215809ca70 con 0x7f21581433e0 2021-10-21T00:08:38.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215809a5b0 con 0x7f21580b4380 2021-10-21T00:08:38.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215ddb0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2158065cc0 con 0x7f21580b1830 2021-10-21T00:08:38.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33514/0 (socket says 172.21.15.41:33514) 2021-10-21T00:08:38.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 -- 172.21.15.41:0/3109036739 learned_addr learned my addr 172.21.15.41:0/3109036739 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:38.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f2157fff700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 0x7f215809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215cdae700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b1830 0x7f2158152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 -- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b1830 msgr2=0x7f2158152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b1830 0x7f2158152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 -- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 msgr2=0x7f215809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:38.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 0x7f215809a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:38.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f215d5af700 1 -- 172.21.15.41:0/3109036739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c00b180 con 0x7f21581433e0 2021-10-21T00:08:38.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.959+0000 7f2157fff700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 0x7f215809a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:38.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f215d5af700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f2150001490 tx=0x7f2150007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2150005c70 con 0x7f21581433e0 2021-10-21T00:08:38.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150005dd0 con 0x7f21581433e0 2021-10-21T00:08:38.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2158065910 con 0x7f21581433e0 2021-10-21T00:08:38.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21500072c0 con 0x7f21581433e0 2021-10-21T00:08:38.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2158067220 con 0x7f21581433e0 2021-10-21T00:08:38.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215809cbe0 con 0x7f21581433e0 2021-10-21T00:08:38.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2150010070 con 0x7f21581433e0 2021-10-21T00:08:38.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 0x7f2138055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:38.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f215006af40 con 0x7f21581433e0 2021-10-21T00:08:38.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.963+0000 7f215cdae700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 0x7f2138055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:38.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.967+0000 7f215cdae700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 0x7f2138055a40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f214c018000 tx=0x7f214c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:38.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:38.971+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f215809cbe0 con 0x7f21581433e0 2021-10-21T00:08:39.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.139+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f215809cbb0 con 0x7f21581433e0 2021-10-21T00:08:39.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f2155ffb700 1 -- 172.21.15.41:0/3109036739 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f2150042380 con 0x7f21581433e0 2021-10-21T00:08:39.145 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:39.146 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/489886945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":489886945},{"type":"v1","addr":"172.21.15.41:6833","nonce":489886945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[]} 2021-10-21T00:08:39.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 msgr2=0x7f2138055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 0x7f2138055a40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f214c018000 tx=0x7f214c014000).stop 2021-10-21T00:08:39.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 msgr2=0x7f2158152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f2150001490 tx=0x7f2150007da0).stop 2021-10-21T00:08:39.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 shutdown_connections 2021-10-21T00:08:39.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2138053580 0x7f2138055a40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21581433e0 0x7f2158152b60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21580b4380 0x7f215809a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 --2- 172.21.15.41:0/3109036739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21580b1830 0x7f2158152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 >> 172.21.15.41:0/3109036739 conn(0x7f21580b7910 msgr2=0x7f21580b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:39.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 shutdown_connections 2021-10-21T00:08:39.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.143+0000 7f215ddb0700 1 -- 172.21.15.41:0/3109036739 wait complete. 2021-10-21T00:08:39.151 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 30 2021-10-21T00:08:39.158 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:39.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 Processor -- start 2021-10-21T00:08:39.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 -- start start 2021-10-21T00:08:39.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1500af620 0x7fa1500ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa150067a80 0x7fa150149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500b0b50 con 0x7fa1500b2170 2021-10-21T00:08:39.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500b2550 con 0x7fa150067a80 2021-10-21T00:08:39.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15675e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500b0d90 con 0x7fa1500af620 2021-10-21T00:08:39.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa155f5d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa150067a80 0x7fa150149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa155f5d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa150067a80 0x7fa150149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33522/0 (socket says 172.21.15.41:33522) 2021-10-21T00:08:39.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa155f5d700 1 -- 172.21.15.41:0/3788802650 learned_addr learned my addr 172.21.15.41:0/3788802650 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:39.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa15575c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa1500b2170 0x7fa1500ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59522/0 (socket says 172.21.15.41:59522) 2021-10-21T00:08:39.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.255+0000 7fa154f5b700 1 --2- 172.21.15.41:0/3788802650 >> v2:172.21.15.62:3300/0 conn(0x7fa1500af620 0x7fa1500ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa155f5d700 1 -- 172.21.15.41:0/3788802650 >> v2:172.21.15.62:3300/0 conn(0x7fa1500af620 msgr2=0x7fa1500ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:39.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa155f5d700 1 --2- 172.21.15.41:0/3788802650 >> v2:172.21.15.62:3300/0 conn(0x7fa1500af620 0x7fa1500ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa155f5d700 1 -- 172.21.15.41:0/3788802650 >> v1:172.21.15.41:6789/0 conn(0x7fa1500b2170 legacy=0x7fa1500ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa147fff700 1 -- 172.21.15.41:0/3788802650 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163046567 0 0) 0x7fa140001110 con 0x7fa1500b2170 2021-10-21T00:08:39.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa155f5d700 1 -- 172.21.15.41:0/3788802650 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500b1030 con 0x7fa150067a80 2021-10-21T00:08:39.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa155f5d700 1 --2- 172.21.15.41:0/3788802650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa150067a80 0x7fa150149320 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa1500aafa0 tx=0x7fa148006eb0).ready entity=mon.0 client_cookie=c77ddeab13573b8c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa147fff700 1 -- 172.21.15.41:0/3788802650 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14800d610 con 0x7fa150067a80 2021-10-21T00:08:39.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa147fff700 1 -- 172.21.15.41:0/3788802650 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148000e90 con 0x7fa150067a80 2021-10-21T00:08:39.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa147fff700 1 -- 172.21.15.41:0/3788802650 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14800d960 con 0x7fa150067a80 2021-10-21T00:08:39.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 -- 172.21.15.41:0/3788802650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa150067a80 msgr2=0x7fa150149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 --2- 172.21.15.41:0/3788802650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa150067a80 0x7fa150149320 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa1500aafa0 tx=0x7fa148006eb0).stop 2021-10-21T00:08:39.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 -- 172.21.15.41:0/3788802650 shutdown_connections 2021-10-21T00:08:39.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 --2- 172.21.15.41:0/3788802650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa150067a80 0x7fa150149320 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 --2- 172.21.15.41:0/3788802650 >> v2:172.21.15.62:3300/0 conn(0x7fa1500af620 0x7fa1500ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 -- 172.21.15.41:0/3788802650 >> 172.21.15.41:0/3788802650 conn(0x7fa1500b5700 msgr2=0x7fa1500b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:39.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 -- 172.21.15.41:0/3788802650 shutdown_connections 2021-10-21T00:08:39.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.259+0000 7fa15675e700 1 -- 172.21.15.41:0/3788802650 wait complete. 2021-10-21T00:08:39.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 Processor -- start 2021-10-21T00:08:39.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 -- start start 2021-10-21T00:08:39.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa150067a80 0x7fa1500ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 0x7fa15008f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500660e0 con 0x7fa1500af620 2021-10-21T00:08:39.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150067300 con 0x7fa150067a80 2021-10-21T00:08:39.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15675e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500658f0 con 0x7fa1500b2170 2021-10-21T00:08:39.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa154f5b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa15575c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa150067a80 0x7fa1500ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 0x7fa15008f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa154f5b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33526/0 (socket says 172.21.15.41:33526) 2021-10-21T00:08:39.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa154f5b700 1 -- 172.21.15.41:0/2237255189 learned_addr learned my addr 172.21.15.41:0/2237255189 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:39.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 -- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa150067a80 msgr2=0x7fa1500ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa150067a80 0x7fa1500ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 -- 172.21.15.41:0/2237255189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 msgr2=0x7fa150066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 -- 172.21.15.41:0/2237255189 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14800b1e0 con 0x7fa1500b2170 2021-10-21T00:08:39.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa154f5b700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:39.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.263+0000 7fa155f5d700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 0x7fa15008f3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa1500aafa0 tx=0x7fa148015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148011760 con 0x7fa1500b2170 2021-10-21T00:08:39.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1480118c0 con 0x7fa1500b2170 2021-10-21T00:08:39.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150064760 con 0x7fa1500b2170 2021-10-21T00:08:39.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa148011c20 con 0x7fa1500b2170 2021-10-21T00:08:39.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15008f8b0 con 0x7fa1500b2170 2021-10-21T00:08:39.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500b12d0 con 0x7fa1500b2170 2021-10-21T00:08:39.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa14801a040 con 0x7fa1500b2170 2021-10-21T00:08:39.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 0x7fa138055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa14806c300 con 0x7fa1500b2170 2021-10-21T00:08:39.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.267+0000 7fa15575c700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 0x7fa138055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.271+0000 7fa15575c700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 0x7fa138055b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa14000d000 tx=0x7fa140007bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.279+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa148043790 con 0x7fa1500b2170 2021-10-21T00:08:39.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.439+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa150057350 con 0x7fa1500b2170 2021-10-21T00:08:39.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa1467fc700 1 -- 172.21.15.41:0/2237255189 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fa1480234d0 con 0x7fa1500b2170 2021-10-21T00:08:39.446 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:39.446 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5486,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3771543615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3771543615},{"type":"v1","addr":"172.21.15.62:6835","nonce":3771543615}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/489886945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":489886945},{"type":"v1","addr":"172.21.15.41:6833","nonce":489886945}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[]} 2021-10-21T00:08:39.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 msgr2=0x7fa138055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 0x7fa138055b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa14000d000 tx=0x7fa140007bc0).stop 2021-10-21T00:08:39.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 msgr2=0x7fa15008f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 0x7fa15008f3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa1500aafa0 tx=0x7fa148015000).stop 2021-10-21T00:08:39.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 shutdown_connections 2021-10-21T00:08:39.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1380536a0 0x7fa138055b60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1500b2170 0x7fa15008f3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1500af620 0x7fa150066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 --2- 172.21.15.41:0/2237255189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa150067a80 0x7fa1500ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 >> 172.21.15.41:0/2237255189 conn(0x7fa1500b5700 msgr2=0x7fa15005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:39.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 shutdown_connections 2021-10-21T00:08:39.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.443+0000 7fa15675e700 1 -- 172.21.15.41:0/2237255189 wait complete. 2021-10-21T00:08:39.451 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 30 2021-10-21T00:08:39.459 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:08:39.459 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:08:39.459 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:08:39.460 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:08:39.460 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:08:39.460 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:08:39.461 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:08:39.461 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:08:39.473 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:08:39.473 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:08:39.476 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:08:39.476 DEBUG:teuthology.parallel:result is None 2021-10-21T00:08:39.477 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:08:39.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:08:39.480 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:08:39.481 DEBUG:teuthology.parallel:result is None 2021-10-21T00:08:39.481 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:08:39.545 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:08:39.556 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:08:39.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 Processor -- start 2021-10-21T00:08:39.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 -- start start 2021-10-21T00:08:39.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2540b3370 0x7fe2540b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 0x7fe254138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25405fdd0 con 0x7fe25405f9f0 2021-10-21T00:08:39.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe254140400 con 0x7fe2540b3370 2021-10-21T00:08:39.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe25a7e4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540b27c0 con 0x7fe2540b0730 2021-10-21T00:08:39.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe2597e2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe25405f9f0 0x7fe2540b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59546/0 (socket says 172.21.15.41:59546) 2021-10-21T00:08:39.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe2597e2700 1 -- 172.21.15.41:0/3859076572 learned_addr learned my addr 172.21.15.41:0/3859076572 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:39.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.571+0000 7fe259fe3700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 0x7fe254138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 --2- 172.21.15.41:0/3859076572 >> v2:172.21.15.62:3300/0 conn(0x7fe2540b3370 0x7fe2540b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 -- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 msgr2=0x7fe254138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:39.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 0x7fe254138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 -- 172.21.15.41:0/3859076572 >> v1:172.21.15.41:6789/0 conn(0x7fe25405f9f0 legacy=0x7fe2540b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 -- 172.21.15.41:0/3859076572 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254140080 con 0x7fe2540b3370 2021-10-21T00:08:39.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe259fe3700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 0x7fe254138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:39.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.575+0000 7fe258fe1700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b3370 0x7fe2540b0e50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe25413f630 tx=0x7fe244006df0).ready entity=mon.1 client_cookie=d366a0ea2005aaf9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe243fff700 1 -- 172.21.15.41:0/3859076572 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400d570 con 0x7fe2540b3370 2021-10-21T00:08:39.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe243fff700 1 -- 172.21.15.41:0/3859076572 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244000e90 con 0x7fe2540b3370 2021-10-21T00:08:39.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe243fff700 1 -- 172.21.15.41:0/3859076572 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400d8c0 con 0x7fe2540b3370 2021-10-21T00:08:39.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 -- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b3370 msgr2=0x7fe2540b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b3370 0x7fe2540b0e50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe25413f630 tx=0x7fe244006df0).stop 2021-10-21T00:08:39.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 -- 172.21.15.41:0/3859076572 shutdown_connections 2021-10-21T00:08:39.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2540b0730 0x7fe254138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/3859076572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b3370 0x7fe2540b0e50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 -- 172.21.15.41:0/3859076572 >> 172.21.15.41:0/3859076572 conn(0x7fe2540637b0 msgr2=0x7fe254063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:39.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 -- 172.21.15.41:0/3859076572 shutdown_connections 2021-10-21T00:08:39.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.579+0000 7fe25a7e4700 1 -- 172.21.15.41:0/3859076572 wait complete. 2021-10-21T00:08:39.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 Processor -- start 2021-10-21T00:08:39.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 -- start start 2021-10-21T00:08:39.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 0x7fe25413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe254067680 con 0x7fe2540b3370 2021-10-21T00:08:39.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541501d0 con 0x7fe2540b0730 2021-10-21T00:08:39.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe25a7e4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe254153cc0 con 0x7fe25405f9f0 2021-10-21T00:08:39.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe259fe3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe258fe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 0x7fe25413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe258fe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:45468/0 (socket says 172.21.15.41:45468) 2021-10-21T00:08:39.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe259fe3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33554/0 (socket says 172.21.15.41:33554) 2021-10-21T00:08:39.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe258fe1700 1 -- 172.21.15.41:0/2635573429 learned_addr learned my addr 172.21.15.41:0/2635573429 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:39.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 -- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 msgr2=0x7fe2541430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 -- 172.21.15.41:0/2635573429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 msgr2=0x7fe25414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:39.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:39.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 -- 172.21.15.41:0/2635573429 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c009470 con 0x7fe25405f9f0 2021-10-21T00:08:39.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe258fe1700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:39.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe259fe3700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:39.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.583+0000 7fe2597e2700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 0x7fe25413cb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe25413ca30 tx=0x7fe250007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2500070d0 con 0x7fe25405f9f0 2021-10-21T00:08:39.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250007230 con 0x7fe25405f9f0 2021-10-21T00:08:39.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24400b180 con 0x7fe25405f9f0 2021-10-21T00:08:39.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2500073a0 con 0x7fe25405f9f0 2021-10-21T00:08:39.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2540671e0 con 0x7fe25405f9f0 2021-10-21T00:08:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254154160 con 0x7fe25405f9f0 2021-10-21T00:08:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe25001a060 con 0x7fe25405f9f0 2021-10-21T00:08:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 0x7fe234055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe25006acc0 con 0x7fe25405f9f0 2021-10-21T00:08:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe258fe1700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 0x7fe234055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.587+0000 7fe258fe1700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 0x7fe234055b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fe24401a000 tx=0x7fe244014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:39.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.595+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe250042100 con 0x7fe25405f9f0 2021-10-21T00:08:39.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:39.743+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe254057350 con 0x7fe25405f9f0 2021-10-21T00:08:40.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.591+0000 7fe2427fc700 1 -- 172.21.15.41:0/2635573429 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe250018030 con 0x7fe25405f9f0 2021-10-21T00:08:40.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 msgr2=0x7fe234055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 0x7fe234055b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fe24401a000 tx=0x7fe244014000).stop 2021-10-21T00:08:40.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 msgr2=0x7fe25413cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 0x7fe25413cb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe25413ca30 tx=0x7fe250007a00).stop 2021-10-21T00:08:40.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 shutdown_connections 2021-10-21T00:08:40.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe2340536a0 0x7fe234055b60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2540b3370 0x7fe25414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2540b0730 0x7fe2541430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 --2- 172.21.15.41:0/2635573429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe25405f9f0 0x7fe25413cb40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 >> 172.21.15.41:0/2635573429 conn(0x7fe2540637b0 msgr2=0x7fe2540afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:40.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 shutdown_connections 2021-10-21T00:08:40.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.595+0000 7fe25a7e4700 1 -- 172.21.15.41:0/2635573429 wait complete. 2021-10-21T00:08:40.603 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:08:40.617 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:08:40.618 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:08:40.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.719+0000 7fa2a544a700 1 Processor -- start 2021-10-21T00:08:40.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- start start 2021-10-21T00:08:40.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2a00aa750 0x7fa2a014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2a014b350 0x7fa2a00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a00609d0 con 0x7fa2a005f9f0 2021-10-21T00:08:40.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00b1620 con 0x7fa2a014b350 2021-10-21T00:08:40.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a005fdd0 con 0x7fa2a00aa750 2021-10-21T00:08:40.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2a014b350 0x7fa2a00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2a014b350 0x7fa2a00af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33564/0 (socket says 172.21.15.41:33564) 2021-10-21T00:08:40.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 -- 172.21.15.41:0/3459001875 learned_addr learned my addr 172.21.15.41:0/3459001875 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:40.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29e7fc700 1 --2- 172.21.15.41:0/3459001875 >> v2:172.21.15.62:3300/0 conn(0x7fa2a00aa750 0x7fa2a014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 -- 172.21.15.41:0/3459001875 >> v2:172.21.15.62:3300/0 conn(0x7fa2a00aa750 msgr2=0x7fa2a014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:40.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 --2- 172.21.15.41:0/3459001875 >> v2:172.21.15.62:3300/0 conn(0x7fa2a00aa750 0x7fa2a014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 -- 172.21.15.41:0/3459001875 >> v1:172.21.15.62:6789/0 conn(0x7fa2a005f9f0 legacy=0x7fa2a014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:40.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 -- 172.21.15.41:0/3459001875 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00b1380 con 0x7fa2a014b350 2021-10-21T00:08:40.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29f7fe700 1 --2- 172.21.15.41:0/3459001875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a014b350 0x7fa2a00af7c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa2a00af680 tx=0x7fa298009290).ready entity=mon.0 client_cookie=522f20c6df66a96c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:40.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29dffb700 1 -- 172.21.15.41:0/3459001875 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29800b830 con 0x7fa2a014b350 2021-10-21T00:08:40.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29dffb700 1 -- 172.21.15.41:0/3459001875 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800b990 con 0x7fa2a014b350 2021-10-21T00:08:40.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa29dffb700 1 -- 172.21.15.41:0/3459001875 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29800bb40 con 0x7fa2a014b350 2021-10-21T00:08:40.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- 172.21.15.41:0/3459001875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a014b350 msgr2=0x7fa2a00af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 --2- 172.21.15.41:0/3459001875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a014b350 0x7fa2a00af7c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fa2a00af680 tx=0x7fa298009290).stop 2021-10-21T00:08:40.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- 172.21.15.41:0/3459001875 shutdown_connections 2021-10-21T00:08:40.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 --2- 172.21.15.41:0/3459001875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a014b350 0x7fa2a00af7c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 --2- 172.21.15.41:0/3459001875 >> v2:172.21.15.62:3300/0 conn(0x7fa2a00aa750 0x7fa2a014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- 172.21.15.41:0/3459001875 >> 172.21.15.41:0/3459001875 conn(0x7fa2a005bca0 msgr2=0x7fa2a005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:40.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- 172.21.15.41:0/3459001875 shutdown_connections 2021-10-21T00:08:40.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.723+0000 7fa2a544a700 1 -- 172.21.15.41:0/3459001875 wait complete. 2021-10-21T00:08:40.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 Processor -- start 2021-10-21T00:08:40.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- start start 2021-10-21T00:08:40.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a005f9f0 0x7fa2a00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a014b350 0x7fa2a0067010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00638e0 con 0x7fa2a00aa750 2021-10-21T00:08:40.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0067500 con 0x7fa2a014b350 2021-10-21T00:08:40.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00adb20 con 0x7fa2a005f9f0 2021-10-21T00:08:40.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33568/0 (socket says 172.21.15.41:33568) 2021-10-21T00:08:40.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 -- 172.21.15.41:0/2454388907 learned_addr learned my addr 172.21.15.41:0/2454388907 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:40.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29f7fe700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a014b350 0x7fa2a0067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29effd700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a005f9f0 0x7fa2a00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 -- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a005f9f0 msgr2=0x7fa2a00b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a005f9f0 0x7fa2a00b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 -- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a014b350 msgr2=0x7fa2a0067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a014b350 0x7fa2a0067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 -- 172.21.15.41:0/2454388907 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009530 con 0x7fa2a00aa750 2021-10-21T00:08:40.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa29e7fc700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa29000a000 tx=0x7fa290008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:40.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2900106e0 con 0x7fa2a00aa750 2021-10-21T00:08:40.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290010840 con 0x7fa2a00aa750 2021-10-21T00:08:40.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a00addc0 con 0x7fa2a00aa750 2021-10-21T00:08:40.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa290010ba0 con 0x7fa2a00aa750 2021-10-21T00:08:40.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.727+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a00b1f60 con 0x7fa2a00aa750 2021-10-21T00:08:40.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa29001a030 con 0x7fa2a00aa750 2021-10-21T00:08:40.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a00678f0 con 0x7fa2a00aa750 2021-10-21T00:08:40.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa28ffff700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 0x7fa27c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:40.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa29006b280 con 0x7fa2a00aa750 2021-10-21T00:08:40.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa29effd700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 0x7fa27c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:40.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.731+0000 7fa29effd700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 0x7fa27c055a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fa29400d000 tx=0x7fa294007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:40.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.739+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa290042600 con 0x7fa2a00aa750 2021-10-21T00:08:40.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.911+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa2a0057350 con 0x7fa2a00aa750 2021-10-21T00:08:40.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.911+0000 7fa28ffff700 1 -- 172.21.15.41:0/2454388907 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fa290045c20 con 0x7fa2a00aa750 2021-10-21T00:08:40.915 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:40.916 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:08:40.916 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:08:40.916 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.916 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:08:40.917 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:08:40.917 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.917 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:08:40.917 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.918 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.918 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.918 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.918 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.919 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.919 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:08:40.919 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:08:40.919 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.920 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:08:40.920 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.920 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.920 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.920 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.921 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.921 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.921 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:08:40.921 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:08:40.922 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.922 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.922 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.922 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.923 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.923 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.923 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.923 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:08:40.923 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:08:40.924 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.924 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.924 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.924 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.925 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.925 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.925 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.925 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:08:40.925 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:08:40.927 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.927 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.927 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.927 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.928 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.928 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.928 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.928 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:08:40.928 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:08:40.929 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.929 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.929 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.929 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.930 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.930 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.930 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.931 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:08:40.931 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:08:40.931 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.932 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.933 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.933 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.933 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.934 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.934 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.934 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:08:40.934 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:08:40.935 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.935 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.935 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.935 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.935 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.936 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.936 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.936 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:08:40.936 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:08:40.937 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.937 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.937 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.937 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.937 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.938 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.938 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.938 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:08:40.938 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:08:40.938 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.939 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.939 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.939 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.939 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.940 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.940 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.940 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:08:40.940 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:08:40.940 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.941 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:08:40.941 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:08:40.941 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:08:40.941 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.942 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.942 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.942 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:08:40.942 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:08:40.942 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.943 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:08:40.943 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:08:40.943 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:08:40.944 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.944 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.944 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.944 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:08:40.944 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:08:40.945 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.945 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:08:40.945 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:08:40.945 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:08:40.946 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.946 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.946 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.946 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:08:40.947 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:08:40.947 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.947 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:08:40.947 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:08:40.947 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:08:40.948 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.948 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.948 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.948 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.948 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:08:40.949 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:08:40.949 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.949 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:08:40.949 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:08:40.950 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.950 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.950 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:40.950 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:40.950 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:08:40.951 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:08:40.951 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:08:40.951 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:08:40.951 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:08:40.951 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:08:40.952 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.952 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:40.952 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:08:40.952 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:08:40.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.911+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 msgr2=0x7fa27c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.911+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 0x7fa27c055a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fa29400d000 tx=0x7fa294007b70).stop 2021-10-21T00:08:40.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 msgr2=0x7fa2a0066b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:40.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa29000a000 tx=0x7fa290008040).stop 2021-10-21T00:08:40.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 shutdown_connections 2021-10-21T00:08:40.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa27c0535b0 0x7fa27c055a70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2a014b350 0x7fa2a0067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2a00aa750 0x7fa2a0066b20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 --2- 172.21.15.41:0/2454388907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2a005f9f0 0x7fa2a00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:40.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 >> 172.21.15.41:0/2454388907 conn(0x7fa2a005bca0 msgr2=0x7fa2a009a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:40.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 shutdown_connections 2021-10-21T00:08:40.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:40.915+0000 7fa2a544a700 1 -- 172.21.15.41:0/2454388907 wait complete. 2021-10-21T00:08:40.958 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 Processor -- start 2021-10-21T00:08:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 -- start start 2021-10-21T00:08:41.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd67c05f9f0 0x7fd67c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd67c14b350 0x7fd67c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c0609d0 con 0x7fd67c0aa750 2021-10-21T00:08:41.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c0b1620 con 0x7fd67c14b350 2021-10-21T00:08:41.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd684134700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c05fdd0 con 0x7fd67c05f9f0 2021-10-21T00:08:41.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd6826d1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd67c14b350 0x7fd67c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd6826d1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd67c14b350 0x7fd67c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33578/0 (socket says 172.21.15.41:33578) 2021-10-21T00:08:41.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.059+0000 7fd6826d1700 1 -- 172.21.15.41:0/2973334815 learned_addr learned my addr 172.21.15.41:0/2973334815 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd681ed0700 1 --2- 172.21.15.41:0/2973334815 >> v2:172.21.15.62:3300/0 conn(0x7fd67c05f9f0 0x7fd67c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 -- 172.21.15.41:0/2973334815 >> v2:172.21.15.62:3300/0 conn(0x7fd67c05f9f0 msgr2=0x7fd67c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:41.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 --2- 172.21.15.41:0/2973334815 >> v2:172.21.15.62:3300/0 conn(0x7fd67c05f9f0 0x7fd67c14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 -- 172.21.15.41:0/2973334815 >> v1:172.21.15.41:6789/0 conn(0x7fd67c0aa750 legacy=0x7fd67c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 -- 172.21.15.41:0/2973334815 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0b1380 con 0x7fd67c14b350 2021-10-21T00:08:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 --2- 172.21.15.41:0/2973334815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c14b350 0x7fd67c0af7c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fd674002f70 tx=0x7fd674006eb0).ready entity=mon.0 client_cookie=67429e8cf065adec server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd680ece700 1 -- 172.21.15.41:0/2973334815 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd67400d610 con 0x7fd67c14b350 2021-10-21T00:08:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd680ece700 1 -- 172.21.15.41:0/2973334815 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674000e90 con 0x7fd67c14b350 2021-10-21T00:08:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd680ece700 1 -- 172.21.15.41:0/2973334815 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd67400d9a0 con 0x7fd67c14b350 2021-10-21T00:08:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- 172.21.15.41:0/2973334815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c14b350 msgr2=0x7fd67c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- 172.21.15.41:0/2973334815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c14b350 0x7fd67c0af7c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fd674002f70 tx=0x7fd674006eb0).stop 2021-10-21T00:08:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- 172.21.15.41:0/2973334815 shutdown_connections 2021-10-21T00:08:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- 172.21.15.41:0/2973334815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c14b350 0x7fd67c0af7c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- 172.21.15.41:0/2973334815 >> v2:172.21.15.62:3300/0 conn(0x7fd67c05f9f0 0x7fd67c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- 172.21.15.41:0/2973334815 >> 172.21.15.41:0/2973334815 conn(0x7fd67c05bca0 msgr2=0x7fd67c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- 172.21.15.41:0/2973334815 shutdown_connections 2021-10-21T00:08:41.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- 172.21.15.41:0/2973334815 wait complete. 2021-10-21T00:08:41.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 Processor -- start 2021-10-21T00:08:41.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- start start 2021-10-21T00:08:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 0x7fd67c0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd67c14b350 0x7fd67c0ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c062940 con 0x7fd67c0aa750 2021-10-21T00:08:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c062be0 con 0x7fd67c05f9f0 2021-10-21T00:08:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd684134700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c062e80 con 0x7fd67c14b350 2021-10-21T00:08:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6816cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6816cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33582/0 (socket says 172.21.15.41:33582) 2021-10-21T00:08:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6816cf700 1 -- 172.21.15.41:0/1749169787 learned_addr learned my addr 172.21.15.41:0/1749169787 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd681ed0700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 0x7fd67c0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.063+0000 7fd6826d1700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd67c14b350 0x7fd67c0ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 -- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd67c14b350 msgr2=0x7fd67c0ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd67c14b350 0x7fd67c0ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 -- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 msgr2=0x7fd67c0ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 0x7fd67c0ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 -- 172.21.15.41:0/1749169787 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67400b1e0 con 0x7fd67c0aa750 2021-10-21T00:08:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd681ed0700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 0x7fd67c0ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd6816cf700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fd67c0af680 tx=0x7fd6780014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd678010510 con 0x7fd67c0aa750 2021-10-21T00:08:41.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678010670 con 0x7fd67c0aa750 2021-10-21T00:08:41.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c0ad720 con 0x7fd67c0aa750 2021-10-21T00:08:41.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6780107e0 con 0x7fd67c0aa750 2021-10-21T00:08:41.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c0ae400 con 0x7fd67c0aa750 2021-10-21T00:08:41.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0678f0 con 0x7fd67c0aa750 2021-10-21T00:08:41.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd678010070 con 0x7fd67c0aa750 2021-10-21T00:08:41.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 0x7fd65c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd67806b230 con 0x7fd67c0aa750 2021-10-21T00:08:41.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.067+0000 7fd681ed0700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 0x7fd65c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.071+0000 7fd681ed0700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 0x7fd65c055b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd66c00c000 tx=0x7fd66c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.071+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6780426c0 con 0x7fd67c0aa750 2021-10-21T00:08:41.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.199+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd67c057350 con 0x7fd67c0aa750 2021-10-21T00:08:41.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.199+0000 7fd66affd700 1 -- 172.21.15.41:0/1749169787 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13182 (secure 0 0 0) 0x7fd678045ce0 con 0x7fd67c0aa750 2021-10-21T00:08:41.206 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:41.207 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":64,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:40.582967+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:41.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 msgr2=0x7fd65c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 0x7fd65c055b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd66c00c000 tx=0x7fd66c008040).stop 2021-10-21T00:08:41.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 msgr2=0x7fd67c0992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fd67c0af680 tx=0x7fd6780014a0).stop 2021-10-21T00:08:41.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 shutdown_connections 2021-10-21T00:08:41.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd65c0536a0 0x7fd65c055b60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd67c14b350 0x7fd67c0ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd67c0aa750 0x7fd67c0992f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 --2- 172.21.15.41:0/1749169787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd67c05f9f0 0x7fd67c0ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 >> 172.21.15.41:0/1749169787 conn(0x7fd67c05bca0 msgr2=0x7fd67c0b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 shutdown_connections 2021-10-21T00:08:41.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.203+0000 7fd684134700 1 -- 172.21.15.41:0/1749169787 wait complete. 2021-10-21T00:08:41.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:08:41.221 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:08:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.323+0000 7f659509f700 1 Processor -- start 2021-10-21T00:08:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.323+0000 7f659509f700 1 -- start start 2021-10-21T00:08:41.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659509f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6590062330 0x7f65900b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659509f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 0x7f659013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659509f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659005bd40 con 0x7f6590062f70 2021-10-21T00:08:41.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659509f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659005bf70 con 0x7f6590062330 2021-10-21T00:08:41.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659509f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6590142cb0 con 0x7f65900b3a20 2021-10-21T00:08:41.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6590062330 0x7f65900b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659489e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 0x7f659013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6590062330 0x7f65900b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33590/0 (socket says 172.21.15.41:33590) 2021-10-21T00:08:41.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f659489e700 1 --2- 172.21.15.41:0/2052691069 >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 0x7f659013c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:45510/0 (socket says 172.21.15.41:45510) 2021-10-21T00:08:41.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658f7fe700 1 --1- 172.21.15.41:0/2052691069 >> v1:172.21.15.62:6789/0 conn(0x7f6590062f70 0x7f659005c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39414/0 (socket says 172.21.15.41:39414) 2021-10-21T00:08:41.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 -- 172.21.15.41:0/2052691069 learned_addr learned my addr 172.21.15.41:0/2052691069 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 -- 172.21.15.41:0/2052691069 >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 msgr2=0x7f659013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:41.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 --2- 172.21.15.41:0/2052691069 >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 0x7f659013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 -- 172.21.15.41:0/2052691069 >> v1:172.21.15.62:6789/0 conn(0x7f6590062f70 legacy=0x7f659005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658effd700 1 -- 172.21.15.41:0/2052691069 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078137137 0 0) 0x7f659005bd40 con 0x7f6590062f70 2021-10-21T00:08:41.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 -- 172.21.15.41:0/2052691069 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590142950 con 0x7f6590062330 2021-10-21T00:08:41.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658ffff700 1 --2- 172.21.15.41:0/2052691069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062330 0x7f65900b3f30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f6578002f70 tx=0x7f6578006eb0).ready entity=mon.0 client_cookie=42bb7b0eba2b48bd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658effd700 1 -- 172.21.15.41:0/2052691069 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657800d5c0 con 0x7f6590062330 2021-10-21T00:08:41.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658effd700 1 -- 172.21.15.41:0/2052691069 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578000e90 con 0x7f6590062330 2021-10-21T00:08:41.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.327+0000 7f658effd700 1 -- 172.21.15.41:0/2052691069 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657800d910 con 0x7f6590062330 2021-10-21T00:08:41.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- 172.21.15.41:0/2052691069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062330 msgr2=0x7f65900b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 --2- 172.21.15.41:0/2052691069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062330 0x7f65900b3f30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f6578002f70 tx=0x7f6578006eb0).stop 2021-10-21T00:08:41.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- 172.21.15.41:0/2052691069 shutdown_connections 2021-10-21T00:08:41.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 --2- 172.21.15.41:0/2052691069 >> v2:172.21.15.62:3300/0 conn(0x7f65900b3a20 0x7f659013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 --2- 172.21.15.41:0/2052691069 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062330 0x7f65900b3f30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- 172.21.15.41:0/2052691069 >> 172.21.15.41:0/2052691069 conn(0x7f65900b9080 msgr2=0x7f65900b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- 172.21.15.41:0/2052691069 shutdown_connections 2021-10-21T00:08:41.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- 172.21.15.41:0/2052691069 wait complete. 2021-10-21T00:08:41.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 Processor -- start 2021-10-21T00:08:41.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.331+0000 7f659509f700 1 -- start start 2021-10-21T00:08:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6590062330 0x7f6590151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65900b3a20 0x7f65900ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900ac930 con 0x7f6590062f70 2021-10-21T00:08:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900acbd0 con 0x7f6590062330 2021-10-21T00:08:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900ace70 con 0x7f65900b3a20 2021-10-21T00:08:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33596/0 (socket says 172.21.15.41:33596) 2021-10-21T00:08:41.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 -- 172.21.15.41:0/3956392912 learned_addr learned my addr 172.21.15.41:0/3956392912 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658ffff700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6590062330 0x7f6590151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659489e700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65900b3a20 0x7f65900ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 -- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65900b3a20 msgr2=0x7f65900ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65900b3a20 0x7f65900ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 -- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6590062330 msgr2=0x7f6590151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6590062330 0x7f6590151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 -- 172.21.15.41:0/3956392912 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657800b1e0 con 0x7f6590062f70 2021-10-21T00:08:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658f7fe700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f6580000ed0 tx=0x7f6580007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65800070d0 con 0x7f6590062f70 2021-10-21T00:08:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580007230 con 0x7f6590062f70 2021-10-21T00:08:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6590141890 con 0x7f6590062f70 2021-10-21T00:08:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6580005740 con 0x7f6590062f70 2021-10-21T00:08:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.335+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65900ad800 con 0x7f6590062f70 2021-10-21T00:08:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590141a20 con 0x7f6590062f70 2021-10-21T00:08:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6580010070 con 0x7f6590062f70 2021-10-21T00:08:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f658d7fa700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 0x7f6574055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f658006ad70 con 0x7f6590062f70 2021-10-21T00:08:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f658ffff700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 0x7f6574055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.339+0000 7f658ffff700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 0x7f6574055a40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f657801c000 tx=0x7f6578015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.343+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6580042200 con 0x7f6590062f70 2021-10-21T00:08:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f65900ad030 con 0x7f6590062f70 2021-10-21T00:08:41.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f658d7fa700 1 -- 172.21.15.41:0/3956392912 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6580045820 con 0x7f6590062f70 2021-10-21T00:08:41.471 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:08:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 msgr2=0x7f6574055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 0x7f6574055a40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f657801c000 tx=0x7f6578015000).stop 2021-10-21T00:08:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 msgr2=0x7f65901408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f6580000ed0 tx=0x7f6580007a90).stop 2021-10-21T00:08:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 shutdown_connections 2021-10-21T00:08:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6574053580 0x7f6574055a40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65900b3a20 0x7f65900ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6590062f70 0x7f65901408b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 --2- 172.21.15.41:0/3956392912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6590062330 0x7f6590151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.467+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 >> 172.21.15.41:0/3956392912 conn(0x7f65900b9080 msgr2=0x7f65900b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.471+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 shutdown_connections 2021-10-21T00:08:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.471+0000 7f659509f700 1 -- 172.21.15.41:0/3956392912 wait complete. 2021-10-21T00:08:41.485 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:08:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 Processor -- start 2021-10-21T00:08:41.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- start start 2021-10-21T00:08:41.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa30c0b2170 0x7fa30c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa30c067a80 0x7fa30c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0b0b50 con 0x7fa30c0af620 2021-10-21T00:08:41.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0b2550 con 0x7fa30c0b2170 2021-10-21T00:08:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0b0d90 con 0x7fa30c067a80 2021-10-21T00:08:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa30c0b2170 0x7fa30c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa30c0b2170 0x7fa30c0ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33602/0 (socket says 172.21.15.41:33602) 2021-10-21T00:08:41.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 -- 172.21.15.41:0/2853561414 learned_addr learned my addr 172.21.15.41:0/2853561414 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30b7fe700 1 --2- 172.21.15.41:0/2853561414 >> v2:172.21.15.62:3300/0 conn(0x7fa30c067a80 0x7fa30c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 -- 172.21.15.41:0/2853561414 >> v2:172.21.15.62:3300/0 conn(0x7fa30c067a80 msgr2=0x7fa30c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 --2- 172.21.15.41:0/2853561414 >> v2:172.21.15.62:3300/0 conn(0x7fa30c067a80 0x7fa30c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 -- 172.21.15.41:0/2853561414 >> v1:172.21.15.62:6789/0 conn(0x7fa30c0af620 legacy=0x7fa30c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 -- 172.21.15.41:0/2853561414 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0b1030 con 0x7fa30c0b2170 2021-10-21T00:08:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30affd700 1 --2- 172.21.15.41:0/2853561414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c0b2170 0x7fa30c0ab170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fa30c0aafa0 tx=0x7fa2fc006eb0).ready entity=mon.0 client_cookie=92cb8549140b4438 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa309ffb700 1 -- 172.21.15.41:0/2853561414 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc00d610 con 0x7fa30c0b2170 2021-10-21T00:08:41.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa309ffb700 1 -- 172.21.15.41:0/2853561414 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc000e90 con 0x7fa30c0b2170 2021-10-21T00:08:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa309ffb700 1 -- 172.21.15.41:0/2853561414 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc00d960 con 0x7fa30c0b2170 2021-10-21T00:08:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- 172.21.15.41:0/2853561414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c0b2170 msgr2=0x7fa30c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 --2- 172.21.15.41:0/2853561414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c0b2170 0x7fa30c0ab170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fa30c0aafa0 tx=0x7fa2fc006eb0).stop 2021-10-21T00:08:41.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 -- 172.21.15.41:0/2853561414 shutdown_connections 2021-10-21T00:08:41.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 --2- 172.21.15.41:0/2853561414 >> v2:172.21.15.62:3300/0 conn(0x7fa30c067a80 0x7fa30c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.591+0000 7fa30bfff700 1 --2- 172.21.15.41:0/2853561414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c0b2170 0x7fa30c0ab170 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- 172.21.15.41:0/2853561414 >> 172.21.15.41:0/2853561414 conn(0x7fa30c0b5700 msgr2=0x7fa30c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- 172.21.15.41:0/2853561414 shutdown_connections 2021-10-21T00:08:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- 172.21.15.41:0/2853561414 wait complete. 2021-10-21T00:08:41.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 Processor -- start 2021-10-21T00:08:41.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- start start 2021-10-21T00:08:41.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 0x7fa30c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 0x7fa30c064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c156ea0 con 0x7fa30c067a80 2021-10-21T00:08:41.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0ac5d0 con 0x7fa30c0af620 2021-10-21T00:08:41.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c157340 con 0x7fa30c0b2170 2021-10-21T00:08:41.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33608/0 (socket says 172.21.15.41:33608) 2021-10-21T00:08:41.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 -- 172.21.15.41:0/4284382200 learned_addr learned my addr 172.21.15.41:0/4284382200 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30b7fe700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 0x7fa30c064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30a7fc700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 0x7fa30c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 -- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 msgr2=0x7fa30c064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 0x7fa30c064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 -- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 msgr2=0x7fa30c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 0x7fa30c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 -- 172.21.15.41:0/4284382200 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc00b1e0 con 0x7fa30c067a80 2021-10-21T00:08:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30b7fe700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 0x7fa30c064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30a7fc700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 0x7fa30c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30affd700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fa30c0aafa0 tx=0x7fa2fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc002f50 con 0x7fa30c067a80 2021-10-21T00:08:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc00d990 con 0x7fa30c067a80 2021-10-21T00:08:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2fc011e90 con 0x7fa30c067a80 2021-10-21T00:08:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.595+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c0aca70 con 0x7fa30c067a80 2021-10-21T00:08:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c148970 con 0x7fa30c067a80 2021-10-21T00:08:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c1570a0 con 0x7fa30c067a80 2021-10-21T00:08:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2fc025030 con 0x7fa30c067a80 2021-10-21T00:08:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa303fff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 0x7fa2f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa2fc06ca80 con 0x7fa30c067a80 2021-10-21T00:08:41.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.599+0000 7fa30a7fc700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 0x7fa2f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.603+0000 7fa30a7fc700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 0x7fa2f0055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa2f400b000 tx=0x7fa2f4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.607+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2fc043e70 con 0x7fa30c067a80 2021-10-21T00:08:41.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.731+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa30c0b12d0 con 0x7fa30c067a80 2021-10-21T00:08:41.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa303fff700 1 -- 172.21.15.41:0/4284382200 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2fc023020 con 0x7fa30c067a80 2021-10-21T00:08:41.738 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:41.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 msgr2=0x7fa2f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 0x7fa2f0055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa2f400b000 tx=0x7fa2f4009040).stop 2021-10-21T00:08:41.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 msgr2=0x7fa30c1462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fa30c0aafa0 tx=0x7fa2fc015000).stop 2021-10-21T00:08:41.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 shutdown_connections 2021-10-21T00:08:41.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2f0053610 0x7fa2f0055ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa30c0b2170 0x7fa30c064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa30c0af620 0x7fa30c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 --2- 172.21.15.41:0/4284382200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa30c067a80 0x7fa30c1462f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 >> 172.21.15.41:0/4284382200 conn(0x7fa30c0b5700 msgr2=0x7fa30c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 shutdown_connections 2021-10-21T00:08:41.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.735+0000 7fa30bfff700 1 -- 172.21.15.41:0/4284382200 wait complete. 2021-10-21T00:08:41.750 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:08:41.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 Processor -- start 2021-10-21T00:08:41.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 -- start start 2021-10-21T00:08:41.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c05bd40 con 0x7f563c0b3a20 2021-10-21T00:08:41.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c05bf70 con 0x7f563c062f70 2021-10-21T00:08:41.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f564319a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c142cb0 con 0x7f563c062330 2021-10-21T00:08:41.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642999700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f563c0b3a20 0x7f563c13c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59622/0 (socket says 172.21.15.41:59622) 2021-10-21T00:08:41.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642999700 1 -- 172.21.15.41:0/343661698 learned_addr learned my addr 172.21.15.41:0/343661698 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:41.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642198700 1 --2- 172.21.15.41:0/343661698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034608571 0 0) 0x7f563c05bd40 con 0x7f563c0b3a20 2021-10-21T00:08:41.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5624003260 con 0x7f563c0b3a20 2021-10-21T00:08:41.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169479034 0 0) 0x7f563c05bf70 con 0x7f563c062f70 2021-10-21T00:08:41.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c05bd40 con 0x7f563c062f70 2021-10-21T00:08:41.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642198700 1 -- 172.21.15.41:0/343661698 >> v1:172.21.15.62:6789/0 conn(0x7f563c062f70 legacy=0x7f563c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642198700 1 -- 172.21.15.41:0/343661698 >> v1:172.21.15.41:6789/0 conn(0x7f563c0b3a20 legacy=0x7f563c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642198700 1 -- 172.21.15.41:0/343661698 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c142950 con 0x7f563c062330 2021-10-21T00:08:41.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5642198700 1 --2- 172.21.15.41:0/343661698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c0b3f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).ready entity=mon.2 client_cookie=610d1d5643cf28a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d5c0 con 0x7f563c062330 2021-10-21T00:08:41.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638000e90 con 0x7f563c062330 2021-10-21T00:08:41.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.847+0000 7f5641196700 1 -- 172.21.15.41:0/343661698 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d910 con 0x7f563c062330 2021-10-21T00:08:41.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/343661698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 msgr2=0x7f563c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 --2- 172.21.15.41:0/343661698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c0b3f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).stop 2021-10-21T00:08:41.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/343661698 shutdown_connections 2021-10-21T00:08:41.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 --2- 172.21.15.41:0/343661698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c0b3f30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/343661698 >> 172.21.15.41:0/343661698 conn(0x7f563c0b9080 msgr2=0x7f563c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:41.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/343661698 shutdown_connections 2021-10-21T00:08:41.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/343661698 wait complete. 2021-10-21T00:08:41.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 Processor -- start 2021-10-21T00:08:41.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- start start 2021-10-21T00:08:41.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f563c062f70 0x7f563c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0af570 con 0x7f563c0b3a20 2021-10-21T00:08:41.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1469d0 con 0x7f563c062f70 2021-10-21T00:08:41.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1458c0 con 0x7f563c062330 2021-10-21T00:08:41.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33626/0 (socket says 172.21.15.41:33626) 2021-10-21T00:08:41.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 -- 172.21.15.41:0/473548100 learned_addr learned my addr 172.21.15.41:0/473548100 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:41.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642198700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5641997700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f563c062f70 0x7f563c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 -- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 msgr2=0x7f563c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 -- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f563c062f70 msgr2=0x7f563c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f563c062f70 0x7f563c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 -- 172.21.15.41:0/473548100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800b180 con 0x7f563c0b3a20 2021-10-21T00:08:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f5642999700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5634001490 tx=0x7f5634007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5634005ba0 con 0x7f563c0b3a20 2021-10-21T00:08:41.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634005d00 con 0x7f563c0b3a20 2021-10-21T00:08:41.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c1454c0 con 0x7f563c0b3a20 2021-10-21T00:08:41.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.851+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56340072c0 con 0x7f563c0b3a20 2021-10-21T00:08:41.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c112de0 con 0x7f563c0b3a20 2021-10-21T00:08:41.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c146b40 con 0x7f563c0b3a20 2021-10-21T00:08:41.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5634010070 con 0x7f563c0b3a20 2021-10-21T00:08:41.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f562b7fe700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 0x7f561c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:41.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f563406af50 con 0x7f563c0b3a20 2021-10-21T00:08:41.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.855+0000 7f5642198700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 0x7f561c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:41.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.859+0000 7f5642198700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 0x7f561c055b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5638018000 tx=0x7f5638014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:41.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.863+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f563c146b40 con 0x7f563c0b3a20 2021-10-21T00:08:41.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f563c146b40 con 0x7f563c0b3a20 2021-10-21T00:08:41.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f562b7fe700 1 -- 172.21.15.41:0/473548100 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+143 (secure 0 0 0) 0x7f563c146b40 con 0x7f563c0b3a20 2021-10-21T00:08:41.995 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:41.995 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:08:41.996 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:41.996 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:08:41.996 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:08:41.996 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:08:41.997 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:08:41.997 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:08:41.997 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:08:41.997 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:08:41.997 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:08:41.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 msgr2=0x7f561c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 0x7f561c055b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5638018000 tx=0x7f5638014000).stop 2021-10-21T00:08:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 msgr2=0x7f563c1145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f5634001490 tx=0x7f5634007e00).stop 2021-10-21T00:08:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 shutdown_connections 2021-10-21T00:08:42.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f561c0536d0 0x7f561c055b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f563c0b3a20 0x7f563c1145b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f563c062f70 0x7f563c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 --2- 172.21.15.41:0/473548100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f563c062330 0x7f563c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 >> 172.21.15.41:0/473548100 conn(0x7f563c0b9080 msgr2=0x7f563c13fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:42.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 shutdown_connections 2021-10-21T00:08:42.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:41.991+0000 7f564319a700 1 -- 172.21.15.41:0/473548100 wait complete. 2021-10-21T00:08:42.008 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:08:42.008 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:08:42.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.110+0000 7f6659065700 1 Processor -- start 2021-10-21T00:08:42.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.110+0000 7f6659065700 1 -- start start 2021-10-21T00:08:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 0x7f66540b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66540af770 0x7f66541466f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665405caf0 con 0x7f665413c670 2021-10-21T00:08:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665405bfb0 con 0x7f66540af770 2021-10-21T00:08:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6654145fb0 con 0x7f66540b1800 2021-10-21T00:08:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6658864700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f665413c670 0x7f6654142940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59632/0 (socket says 172.21.15.41:59632) 2021-10-21T00:08:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6658864700 1 -- 172.21.15.41:0/1718804159 learned_addr learned my addr 172.21.15.41:0/1718804159 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 --2- 172.21.15.41:0/1718804159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 0x7f66540b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f66537fe700 1 --2- 172.21.15.41:0/1718804159 >> v2:172.21.15.62:3300/0 conn(0x7f66540af770 0x7f66541466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6652ffd700 1 -- 172.21.15.41:0/1718804159 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493347102 0 0) 0x7f665405caf0 con 0x7f665413c670 2021-10-21T00:08:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6652ffd700 1 -- 172.21.15.41:0/1718804159 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634003260 con 0x7f665413c670 2021-10-21T00:08:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 -- 172.21.15.41:0/1718804159 >> v2:172.21.15.62:3300/0 conn(0x7f66540af770 msgr2=0x7f66541466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 --2- 172.21.15.41:0/1718804159 >> v2:172.21.15.62:3300/0 conn(0x7f66540af770 0x7f66541466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 -- 172.21.15.41:0/1718804159 >> v1:172.21.15.41:6789/0 conn(0x7f665413c670 legacy=0x7f6654142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 -- 172.21.15.41:0/1718804159 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654146250 con 0x7f66540b1800 2021-10-21T00:08:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6653fff700 1 --2- 172.21.15.41:0/1718804159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 0x7f66540b1be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6644002f70 tx=0x7f6644006df0).ready entity=mon.2 client_cookie=9025daa709d708ad server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6652ffd700 1 -- 172.21.15.41:0/1718804159 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664400d4a0 con 0x7f66540b1800 2021-10-21T00:08:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6652ffd700 1 -- 172.21.15.41:0/1718804159 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644000e90 con 0x7f66540b1800 2021-10-21T00:08:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6652ffd700 1 -- 172.21.15.41:0/1718804159 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664400d7f0 con 0x7f66540b1800 2021-10-21T00:08:42.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- 172.21.15.41:0/1718804159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 msgr2=0x7f66540b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 --2- 172.21.15.41:0/1718804159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 0x7f66540b1be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6644002f70 tx=0x7f6644006df0).stop 2021-10-21T00:08:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- 172.21.15.41:0/1718804159 shutdown_connections 2021-10-21T00:08:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 --2- 172.21.15.41:0/1718804159 >> v2:172.21.15.62:3300/0 conn(0x7f66540af770 0x7f66541466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 --2- 172.21.15.41:0/1718804159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66540b1800 0x7f66540b1be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- 172.21.15.41:0/1718804159 >> 172.21.15.41:0/1718804159 conn(0x7f66540627b0 msgr2=0x7f6654062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- 172.21.15.41:0/1718804159 shutdown_connections 2021-10-21T00:08:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.114+0000 7f6659065700 1 -- 172.21.15.41:0/1718804159 wait complete. 2021-10-21T00:08:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 Processor -- start 2021-10-21T00:08:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- start start 2021-10-21T00:08:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66540b1800 0x7f66540631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f665413c670 0x7f665413f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654066510 con 0x7f66540af770 2021-10-21T00:08:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654065e40 con 0x7f66540b1800 2021-10-21T00:08:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6654065fb0 con 0x7f665413c670 2021-10-21T00:08:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33636/0 (socket says 172.21.15.41:33636) 2021-10-21T00:08:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 -- 172.21.15.41:0/4261113367 learned_addr learned my addr 172.21.15.41:0/4261113367 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f66537fe700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66540b1800 0x7f66540631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6658864700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f665413c670 0x7f665413f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 -- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f665413c670 msgr2=0x7f665413f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f665413c670 0x7f665413f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 -- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66540b1800 msgr2=0x7f66540631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66540b1800 0x7f66540631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 -- 172.21.15.41:0/4261113367 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664400b180 con 0x7f66540af770 2021-10-21T00:08:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6653fff700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f6644002f70 tx=0x7f6644014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6644016070 con 0x7f66540af770 2021-10-21T00:08:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440138d0 con 0x7f66540af770 2021-10-21T00:08:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6654065a80 con 0x7f66540af770 2021-10-21T00:08:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6644013c30 con 0x7f66540af770 2021-10-21T00:08:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.118+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665413da50 con 0x7f66540af770 2021-10-21T00:08:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654066120 con 0x7f66540af770 2021-10-21T00:08:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f664400f030 con 0x7f66540af770 2021-10-21T00:08:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f66517fa700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 0x7f6638055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f664406c420 con 0x7f66540af770 2021-10-21T00:08:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f66537fe700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 0x7f6638055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.122+0000 7f66537fe700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 0x7f6638055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f663c00b000 tx=0x7f663c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.130+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6644043810 con 0x7f66540af770 2021-10-21T00:08:42.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.254+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6654066650 con 0x7f66540af770 2021-10-21T00:08:42.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f66517fa700 1 -- 172.21.15.41:0/4261113367 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v65) v1 ==== 133+0+0 (secure 0 0 0) 0x7f66440230a0 con 0x7f66540af770 2021-10-21T00:08:42.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 msgr2=0x7f6638055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 0x7f6638055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f663c00b000 tx=0x7f663c006df0).stop 2021-10-21T00:08:42.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 msgr2=0x7f6654064150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f6644002f70 tx=0x7f6644014000).stop 2021-10-21T00:08:42.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 shutdown_connections 2021-10-21T00:08:42.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6638053610 0x7f6638055ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f665413c670 0x7f665413f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66540b1800 0x7f66540631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 --2- 172.21.15.41:0/4261113367 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66540af770 0x7f6654064150 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 >> 172.21.15.41:0/4261113367 conn(0x7f66540627b0 msgr2=0x7f66540ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:42.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 shutdown_connections 2021-10-21T00:08:42.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.370+0000 7f6659065700 1 -- 172.21.15.41:0/4261113367 wait complete. 2021-10-21T00:08:42.382 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:08:42.392 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:08:42.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 Processor -- start 2021-10-21T00:08:42.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 -- start start 2021-10-21T00:08:42.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7ebc0af700 0x7f7ebc0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc13f710 con 0x7f7ebc06a190 2021-10-21T00:08:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc0b6350 con 0x7f7ebc0b5f70 2021-10-21T00:08:42.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec14b3700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7ebc06a190 0x7f7ebc0ac9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59648/0 (socket says 172.21.15.41:59648) 2021-10-21T00:08:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc0adf10 con 0x7f7ebc0af700 2021-10-21T00:08:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec14b3700 1 -- 172.21.15.41:0/3926112603 learned_addr learned my addr 172.21.15.41:0/3926112603 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec24b5700 1 --2- 172.21.15.41:0/3926112603 >> v2:172.21.15.41:3300/0 conn(0x7f7ebc0af700 0x7f7ebc0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882219008 0 0) 0x7f7ebc13f710 con 0x7f7ebc06a190 2021-10-21T00:08:42.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea4003260 con 0x7f7ebc06a190 2021-10-21T00:08:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec24b5700 1 -- 172.21.15.41:0/3926112603 >> v1:172.21.15.62:6789/0 conn(0x7f7ebc0b5f70 legacy=0x7f7ebc13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051197575 0 0) 0x7f7ebc0b6350 con 0x7f7ebc0b5f70 2021-10-21T00:08:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec24b5700 1 -- 172.21.15.41:0/3926112603 >> v1:172.21.15.41:6789/0 conn(0x7f7ebc06a190 legacy=0x7f7ebc0ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec24b5700 1 -- 172.21.15.41:0/3926112603 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc067600 con 0x7f7ebc0af700 2021-10-21T00:08:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec24b5700 1 --2- 172.21.15.41:0/3926112603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc0ad0b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f7eac001800 tx=0x7f7eb40091d0).ready entity=mon.0 client_cookie=20e3d0aa15a1f42d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eac001660 con 0x7f7ebc0af700 2021-10-21T00:08:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb400b580 con 0x7f7ebc0af700 2021-10-21T00:08:42.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.502+0000 7f7ec0cb2700 1 -- 172.21.15.41:0/3926112603 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eb400b6f0 con 0x7f7ebc0af700 2021-10-21T00:08:42.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 msgr2=0x7f7ebc0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/3926112603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc0ad0b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f7eac001800 tx=0x7f7eb40091d0).stop 2021-10-21T00:08:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 shutdown_connections 2021-10-21T00:08:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/3926112603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc0ad0b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 >> 172.21.15.41:0/3926112603 conn(0x7f7ebc0639f0 msgr2=0x7f7ebc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 shutdown_connections 2021-10-21T00:08:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/3926112603 wait complete. 2021-10-21T00:08:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 Processor -- start 2021-10-21T00:08:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- start start 2021-10-21T00:08:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ebc06a190 0x7f7ebc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ebc0b5f70 0x7f7ebc1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc13a880 con 0x7f7ebc0af700 2021-10-21T00:08:42.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc13ab20 con 0x7f7ebc06a190 2021-10-21T00:08:42.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec2cb6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc13adc0 con 0x7f7ebc0b5f70 2021-10-21T00:08:42.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec14b3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec14b3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33652/0 (socket says 172.21.15.41:33652) 2021-10-21T00:08:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec14b3700 1 -- 172.21.15.41:0/111963435 learned_addr learned my addr 172.21.15.41:0/111963435 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec1cb4700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ebc06a190 0x7f7ebc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.506+0000 7f7ec24b5700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ebc0b5f70 0x7f7ebc1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 -- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ebc0b5f70 msgr2=0x7f7ebc1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ebc0b5f70 0x7f7ebc1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 -- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ebc06a190 msgr2=0x7f7ebc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ebc06a190 0x7f7ebc0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 -- 172.21.15.41:0/111963435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009470 con 0x7f7ebc0af700 2021-10-21T00:08:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec14b3700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7eac001840 tx=0x7f7eac001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eac007170 con 0x7f7ebc0af700 2021-10-21T00:08:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0072d0 con 0x7f7ebc0af700 2021-10-21T00:08:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eac004920 con 0x7f7ebc0af700 2021-10-21T00:08:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc13f180 con 0x7f7ebc0af700 2021-10-21T00:08:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc1539d0 con 0x7f7ebc0af700 2021-10-21T00:08:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc0b17e0 con 0x7f7ebc0af700 2021-10-21T00:08:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7eac004a80 con 0x7f7ebc0af700 2021-10-21T00:08:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 0x7f7e9c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7eac06b280 con 0x7f7ebc0af700 2021-10-21T00:08:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.510+0000 7f7ec1cb4700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 0x7f7e9c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.514+0000 7f7ec1cb4700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 0x7f7e9c055a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7eb800d000 tx=0x7f7eb8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.518+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7eac0425b0 con 0x7f7ebc0af700 2021-10-21T00:08:42.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:42.650+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7ebc057350 con 0x7f7ebc0af700 2021-10-21T00:08:43.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.382+0000 7f7eaaffd700 1 -- 172.21.15.41:0/111963435 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v66) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7eac045bd0 con 0x7f7ebc0af700 2021-10-21T00:08:43.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 msgr2=0x7f7e9c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 0x7f7e9c055a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7eb800d000 tx=0x7f7eb8009040).stop 2021-10-21T00:08:43.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 msgr2=0x7f7ebc13eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f7eac001840 tx=0x7f7eac001a60).stop 2021-10-21T00:08:43.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 shutdown_connections 2021-10-21T00:08:43.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e9c053580 0x7f7e9c055a40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ebc0b5f70 0x7f7ebc1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ebc0af700 0x7f7ebc13eba0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 --2- 172.21.15.41:0/111963435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ebc06a190 0x7f7ebc0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 >> 172.21.15.41:0/111963435 conn(0x7f7ebc0639f0 msgr2=0x7f7ebc137200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:43.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 shutdown_connections 2021-10-21T00:08:43.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.390+0000 7f7ec2cb6700 1 -- 172.21.15.41:0/111963435 wait complete. 2021-10-21T00:08:43.397 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:08:43.407 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:08:43.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 Processor -- start 2021-10-21T00:08:43.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 -- start start 2021-10-21T00:08:43.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca805bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4ca805c190 0x7f4ca8142a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca805cad0 con 0x7f4ca80b26f0 2021-10-21T00:08:43.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80b0e50 con 0x7f4ca805c190 2021-10-21T00:08:43.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.510+0000 7f4cad91d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca805c830 con 0x7f4ca80b0a70 2021-10-21T00:08:43.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4ca805c190 0x7f4ca8142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4ca80b26f0 0x7f4ca805f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59662/0 (socket says 172.21.15.41:59662) 2021-10-21T00:08:43.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4ca805c190 0x7f4ca8142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33662/0 (socket says 172.21.15.41:33662) 2021-10-21T00:08:43.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca7fff700 1 -- 172.21.15.41:0/3297382245 learned_addr learned my addr 172.21.15.41:0/3297382245 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:43.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cac91b700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca805bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 -- 172.21.15.41:0/3297382245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 msgr2=0x7f4ca805bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:43.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca805bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 -- 172.21.15.41:0/3297382245 >> v1:172.21.15.41:6789/0 conn(0x7f4ca80b26f0 legacy=0x7f4ca805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca77fe700 1 -- 172.21.15.41:0/3297382245 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23982964 0 0) 0x7f4ca805cad0 con 0x7f4ca80b26f0 2021-10-21T00:08:43.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 -- 172.21.15.41:0/3297382245 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8067c30 con 0x7f4ca805c190 2021-10-21T00:08:43.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad11c700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca805c190 0x7f4ca8142a40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98006df0).ready entity=mon.0 client_cookie=4c570a7a1b86ca2b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca77fe700 1 -- 172.21.15.41:0/3297382245 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d570 con 0x7f4ca805c190 2021-10-21T00:08:43.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca77fe700 1 -- 172.21.15.41:0/3297382245 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98000e90 con 0x7f4ca805c190 2021-10-21T00:08:43.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4ca77fe700 1 -- 172.21.15.41:0/3297382245 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d8c0 con 0x7f4ca805c190 2021-10-21T00:08:43.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- 172.21.15.41:0/3297382245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca805c190 msgr2=0x7f4ca8142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca805c190 0x7f4ca8142a40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98006df0).stop 2021-10-21T00:08:43.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- 172.21.15.41:0/3297382245 shutdown_connections 2021-10-21T00:08:43.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca805c190 0x7f4ca8142a40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- 172.21.15.41:0/3297382245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca805bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- 172.21.15.41:0/3297382245 >> 172.21.15.41:0/3297382245 conn(0x7f4ca80637b0 msgr2=0x7f4ca8063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:43.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- 172.21.15.41:0/3297382245 shutdown_connections 2021-10-21T00:08:43.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- 172.21.15.41:0/3297382245 wait complete. 2021-10-21T00:08:43.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 Processor -- start 2021-10-21T00:08:43.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- start start 2021-10-21T00:08:43.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ca805c190 0x7f4ca8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca813d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8152d00 con 0x7f4ca80b26f0 2021-10-21T00:08:43.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8151f80 con 0x7f4ca805c190 2021-10-21T00:08:43.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.514+0000 7f4cad91d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8155d50 con 0x7f4ca80b0a70 2021-10-21T00:08:43.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33668/0 (socket says 172.21.15.41:33668) 2021-10-21T00:08:43.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 -- 172.21.15.41:0/166115958 learned_addr learned my addr 172.21.15.41:0/166115958 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:43.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4ca7fff700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca813d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cac91b700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ca805c190 0x7f4ca8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 -- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 msgr2=0x7f4ca813d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca813d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 -- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ca805c190 msgr2=0x7f4ca8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ca805c190 0x7f4ca8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 -- 172.21.15.41:0/166115958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9800b180 con 0x7f4ca80b26f0 2021-10-21T00:08:43.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad11c700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c98016070 con 0x7f4ca80b26f0 2021-10-21T00:08:43.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98013850 con 0x7f4ca80b26f0 2021-10-21T00:08:43.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c98013bb0 con 0x7f4ca80b26f0 2021-10-21T00:08:43.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8145470 con 0x7f4ca80b26f0 2021-10-21T00:08:43.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8155a00 con 0x7f4ca80b26f0 2021-10-21T00:08:43.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8155f50 con 0x7f4ca80b26f0 2021-10-21T00:08:43.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.518+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c9800f030 con 0x7f4ca80b26f0 2021-10-21T00:08:43.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.522+0000 7f4ca5ffb700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 0x7f4c8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.522+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f4c9806c5a0 con 0x7f4ca80b26f0 2021-10-21T00:08:43.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.522+0000 7f4cac91b700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 0x7f4c8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.522+0000 7f4cac91b700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 0x7f4c8c055ad0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f4ca000b000 tx=0x7f4ca00091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.526+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c98043710 con 0x7f4ca80b26f0 2021-10-21T00:08:43.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.698+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4ca8145600 con 0x7f4ca80b26f0 2021-10-21T00:08:43.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.706+0000 7f4ca5ffb700 1 -- 172.21.15.41:0/166115958 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v32) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4c980230d0 con 0x7f4ca80b26f0 2021-10-21T00:08:43.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 msgr2=0x7f4c8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 0x7f4c8c055ad0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f4ca000b000 tx=0x7f4ca00091d0).stop 2021-10-21T00:08:43.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 msgr2=0x7f4ca8147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98014000).stop 2021-10-21T00:08:43.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 shutdown_connections 2021-10-21T00:08:43.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4c8c053610 0x7f4c8c055ad0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.710+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ca80b26f0 0x7f4ca8147fb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.714+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ca80b0a70 0x7f4ca813d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.714+0000 7f4cad91d700 1 --2- 172.21.15.41:0/166115958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ca805c190 0x7f4ca8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.714+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 >> 172.21.15.41:0/166115958 conn(0x7f4ca80637b0 msgr2=0x7f4ca8142100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:43.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.714+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 shutdown_connections 2021-10-21T00:08:43.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.714+0000 7f4cad91d700 1 -- 172.21.15.41:0/166115958 wait complete. 2021-10-21T00:08:43.720 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 13 and data pool 14 2021-10-21T00:08:43.732 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:43.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 Processor -- start 2021-10-21T00:08:43.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 -- start start 2021-10-21T00:08:43.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f735c0af700 0x7f735c140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c13f710 con 0x7f735c06a190 2021-10-21T00:08:43.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c0adf10 con 0x7f735c0af700 2021-10-21T00:08:43.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0ad9b0 con 0x7f735c0b5f70 2021-10-21T00:08:43.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f735c0af700 0x7f735c140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735a59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f7359d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f735c06a190 0x7f735c142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39510/0 (socket says 172.21.15.41:39510) 2021-10-21T00:08:43.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f735c0af700 0x7f735c140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:45604/0 (socket says 172.21.15.41:45604) 2021-10-21T00:08:43.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f7359d9b700 1 -- 172.21.15.41:0/698942062 learned_addr learned my addr 172.21.15.41:0/698942062 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:43.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735a59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52180/0 (socket says 172.21.15.41:52180) 2021-10-21T00:08:43.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735959a700 1 -- 172.21.15.41:0/698942062 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335495537 0 0) 0x7f735c13f710 con 0x7f735c06a190 2021-10-21T00:08:43.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735959a700 1 -- 172.21.15.41:0/698942062 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003260 con 0x7f735c06a190 2021-10-21T00:08:43.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 -- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 msgr2=0x7f735c13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:43.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 -- 172.21.15.41:0/698942062 >> v1:172.21.15.62:6789/0 conn(0x7f735c06a190 legacy=0x7f735c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735ad9d700 1 -- 172.21.15.41:0/698942062 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0b6350 con 0x7f735c0af700 2021-10-21T00:08:43.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.822+0000 7f735a59c700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:43.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735ad9d700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c0af700 0x7f735c140030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f735c0adaf0 tx=0x7f73540091d0).ready entity=mon.1 client_cookie=b4449d7138695d69 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735959a700 1 -- 172.21.15.41:0/698942062 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f735400f8a0 con 0x7f735c0af700 2021-10-21T00:08:43.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735959a700 1 -- 172.21.15.41:0/698942062 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400fa00 con 0x7f735c0af700 2021-10-21T00:08:43.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735959a700 1 -- 172.21.15.41:0/698942062 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f735400fd60 con 0x7f735c0af700 2021-10-21T00:08:43.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 -- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c0af700 msgr2=0x7f735c140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c0af700 0x7f735c140030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f735c0adaf0 tx=0x7f73540091d0).stop 2021-10-21T00:08:43.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 -- 172.21.15.41:0/698942062 shutdown_connections 2021-10-21T00:08:43.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c0af700 0x7f735c140030 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 --2- 172.21.15.41:0/698942062 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 -- 172.21.15.41:0/698942062 >> 172.21.15.41:0/698942062 conn(0x7f735c0639f0 msgr2=0x7f735c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:43.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 -- 172.21.15.41:0/698942062 shutdown_connections 2021-10-21T00:08:43.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.826+0000 7f735b59e700 1 -- 172.21.15.41:0/698942062 wait complete. 2021-10-21T00:08:43.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 Processor -- start 2021-10-21T00:08:43.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- start start 2021-10-21T00:08:43.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c06a190 0x7f735c139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c13a810 con 0x7f735c0af700 2021-10-21T00:08:43.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c13c940 con 0x7f735c06a190 2021-10-21T00:08:43.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c142fd0 con 0x7f735c0b5f70 2021-10-21T00:08:43.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33690/0 (socket says 172.21.15.41:33690) 2021-10-21T00:08:43.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 -- 172.21.15.41:0/376119489 learned_addr learned my addr 172.21.15.41:0/376119489 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:43.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735ad9d700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735a59c700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c06a190 0x7f735c139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 -- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 msgr2=0x7f735c142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 -- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c06a190 msgr2=0x7f735c139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c06a190 0x7f735c139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 -- 172.21.15.41:0/376119489 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c00b180 con 0x7f735c0af700 2021-10-21T00:08:43.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735ad9d700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:43.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f7359d9b700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7350001110 tx=0x7f7350007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f735000ce00 con 0x7f735c0af700 2021-10-21T00:08:43.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500072e0 con 0x7f735c0af700 2021-10-21T00:08:43.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7354009470 con 0x7f735c0af700 2021-10-21T00:08:43.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7350005800 con 0x7f735c0af700 2021-10-21T00:08:43.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.830+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c13a2d0 con 0x7f735c0af700 2021-10-21T00:08:43.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7350010070 con 0x7f735c0af700 2021-10-21T00:08:43.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c067600 con 0x7f735c0af700 2021-10-21T00:08:43.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f734b7fe700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 0x7f7338055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:43.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f735006b260 con 0x7f735c0af700 2021-10-21T00:08:43.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f735a59c700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 0x7f7338055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:43.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.834+0000 7f735a59c700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 0x7f7338055b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f734c00b000 tx=0x7f734c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:43.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.838+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7350042230 con 0x7f735c0af700 2021-10-21T00:08:43.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.966+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f735c057350 con 0x7f735c0af700 2021-10-21T00:08:43.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.966+0000 7f734b7fe700 1 -- 172.21.15.41:0/376119489 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f7350045850 con 0x7f735c0af700 2021-10-21T00:08:43.974 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:43.974 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":68,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:43.702635+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:43.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 msgr2=0x7f7338055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 0x7f7338055b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f734c00b000 tx=0x7f734c008040).stop 2021-10-21T00:08:43.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 msgr2=0x7f735c150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:43.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f7350001110 tx=0x7f7350007aa0).stop 2021-10-21T00:08:43.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 shutdown_connections 2021-10-21T00:08:43.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7338053640 0x7f7338055b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f735c0b5f70 0x7f735c142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f735c0af700 0x7f735c150d60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 --2- 172.21.15.41:0/376119489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f735c06a190 0x7f735c139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:43.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 >> 172.21.15.41:0/376119489 conn(0x7f735c0639f0 msgr2=0x7f735c1382a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:43.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 shutdown_connections 2021-10-21T00:08:43.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:43.970+0000 7f735b59e700 1 -- 172.21.15.41:0/376119489 wait complete. 2021-10-21T00:08:43.987 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:44.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 Processor -- start 2021-10-21T00:08:44.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- start start 2021-10-21T00:08:44.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 0x7f6d4405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6d440b3a20 0x7f6d4413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4405bd40 con 0x7f6d44062330 2021-10-21T00:08:44.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4405bf70 con 0x7f6d440b3a20 2021-10-21T00:08:44.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44142cb0 con 0x7f6d44062f70 2021-10-21T00:08:44.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f6d44062330 0x7f6d440b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59698/0 (socket says 172.21.15.41:59698) 2021-10-21T00:08:44.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4259c700 1 -- 172.21.15.41:0/2719715979 learned_addr learned my addr 172.21.15.41:0/2719715979 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:44.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 --2- 172.21.15.41:0/2719715979 >> v2:172.21.15.41:3300/0 conn(0x7f6d440b3a20 0x7f6d4413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d39d9b700 1 --2- 172.21.15.41:0/2719715979 >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 0x7f6d4405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d41d9b700 1 -- 172.21.15.41:0/2719715979 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609975408 0 0) 0x7f6d4405bd40 con 0x7f6d44062330 2021-10-21T00:08:44.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d41d9b700 1 -- 172.21.15.41:0/2719715979 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d24003260 con 0x7f6d44062330 2021-10-21T00:08:44.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 -- 172.21.15.41:0/2719715979 >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 msgr2=0x7f6d4405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 --2- 172.21.15.41:0/2719715979 >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 0x7f6d4405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 -- 172.21.15.41:0/2719715979 >> v1:172.21.15.41:6789/0 conn(0x7f6d44062330 legacy=0x7f6d440b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 -- 172.21.15.41:0/2719715979 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44142950 con 0x7f6d440b3a20 2021-10-21T00:08:44.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d39d9b700 1 --2- 172.21.15.41:0/2719715979 >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 0x7f6d4405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:44.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d42d9d700 1 --2- 172.21.15.41:0/2719715979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d440b3a20 0x7f6d4413c510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c0091d0).ready entity=mon.0 client_cookie=5d479fa79d6884d8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d41d9b700 1 -- 172.21.15.41:0/2719715979 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b600 con 0x7f6d440b3a20 2021-10-21T00:08:44.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d41d9b700 1 -- 172.21.15.41:0/2719715979 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b760 con 0x7f6d440b3a20 2021-10-21T00:08:44.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d41d9b700 1 -- 172.21.15.41:0/2719715979 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d3c00b8d0 con 0x7f6d440b3a20 2021-10-21T00:08:44.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- 172.21.15.41:0/2719715979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d440b3a20 msgr2=0x7f6d4413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2719715979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d440b3a20 0x7f6d4413c510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f6d3c0032f0 tx=0x7f6d3c0091d0).stop 2021-10-21T00:08:44.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- 172.21.15.41:0/2719715979 shutdown_connections 2021-10-21T00:08:44.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2719715979 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d440b3a20 0x7f6d4413c510 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2719715979 >> v2:172.21.15.62:3300/0 conn(0x7f6d44062f70 0x7f6d4405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- 172.21.15.41:0/2719715979 >> 172.21.15.41:0/2719715979 conn(0x7f6d440b9080 msgr2=0x7f6d440b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:44.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- 172.21.15.41:0/2719715979 shutdown_connections 2021-10-21T00:08:44.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.090+0000 7f6d4359e700 1 -- 172.21.15.41:0/2719715979 wait complete. 2021-10-21T00:08:44.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.094+0000 7f6d4359e700 1 Processor -- start 2021-10-21T00:08:44.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.094+0000 7f6d4359e700 1 -- start start 2021-10-21T00:08:44.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d44062f70 0x7f6d44151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 0x7f6d441126d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44112270 con 0x7f6d44062330 2021-10-21T00:08:44.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44155d30 con 0x7f6d440b3a20 2021-10-21T00:08:44.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44155fd0 con 0x7f6d44062f70 2021-10-21T00:08:44.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33702/0 (socket says 172.21.15.41:33702) 2021-10-21T00:08:44.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 -- 172.21.15.41:0/2319421026 learned_addr learned my addr 172.21.15.41:0/2319421026 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:44.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d39d9b700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d44062f70 0x7f6d44151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d42d9d700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 0x7f6d441126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 -- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d44062f70 msgr2=0x7f6d44151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d44062f70 0x7f6d44151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 -- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 msgr2=0x7f6d441126d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 0x7f6d441126d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 -- 172.21.15.41:0/2319421026 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c00b180 con 0x7f6d44062330 2021-10-21T00:08:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d42d9d700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 0x7f6d441126d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4259c700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f6d34001110 tx=0x7f6d34007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d340072e0 con 0x7f6d44062330 2021-10-21T00:08:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34007440 con 0x7f6d44062330 2021-10-21T00:08:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c009470 con 0x7f6d44062330 2021-10-21T00:08:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d34005800 con 0x7f6d44062330 2021-10-21T00:08:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4414a290 con 0x7f6d44062330 2021-10-21T00:08:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d44057350 con 0x7f6d44062330 2021-10-21T00:08:44.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.098+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d34010070 con 0x7f6d44062330 2021-10-21T00:08:44.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.102+0000 7f6d3bfff700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 0x7f6d28055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.102+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d3406b100 con 0x7f6d44062330 2021-10-21T00:08:44.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.102+0000 7f6d39d9b700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 0x7f6d28055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.102+0000 7f6d39d9b700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 0x7f6d28055b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6d2c00b000 tx=0x7f6d2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.106+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d34042260 con 0x7f6d44062330 2021-10-21T00:08:44.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.234+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4405d080 con 0x7f6d44062330 2021-10-21T00:08:44.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.234+0000 7f6d3bfff700 1 -- 172.21.15.41:0/2319421026 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f6d34045880 con 0x7f6d44062330 2021-10-21T00:08:44.241 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:44.241 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":68,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:43.702635+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:44.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 msgr2=0x7f6d28055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 0x7f6d28055b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f6d2c00b000 tx=0x7f6d2c008040).stop 2021-10-21T00:08:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 msgr2=0x7f6d44149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f6d34001110 tx=0x7f6d34007ad0).stop 2021-10-21T00:08:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 shutdown_connections 2021-10-21T00:08:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6d280536a0 0x7f6d28055b60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d440b3a20 0x7f6d441126d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d44062f70 0x7f6d44151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 --2- 172.21.15.41:0/2319421026 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d44062330 0x7f6d44149960 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 >> 172.21.15.41:0/2319421026 conn(0x7f6d440b9080 msgr2=0x7f6d44142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 shutdown_connections 2021-10-21T00:08:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.238+0000 7f6d4359e700 1 -- 172.21.15.41:0/2319421026 wait complete. 2021-10-21T00:08:44.263 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:08:44.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 Processor -- start 2021-10-21T00:08:44.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 -- start start 2021-10-21T00:08:44.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 0x7f3e800ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e800af620 0x7f3e800ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800b0b50 con 0x7f3e800abb50 2021-10-21T00:08:44.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800b2550 con 0x7f3e800af620 2021-10-21T00:08:44.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.370+0000 7f3e854c8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800b0d90 con 0x7f3e800b2170 2021-10-21T00:08:44.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e84cc7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e84cc7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33712/0 (socket says 172.21.15.41:33712) 2021-10-21T00:08:44.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e84cc7700 1 -- 172.21.15.41:0/970372293 learned_addr learned my addr 172.21.15.41:0/970372293 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:44.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/970372293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 0x7f3e800ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7f7fe700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.62:3300/0 conn(0x7f3e800af620 0x7f3e800ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 -- 172.21.15.41:0/970372293 >> v2:172.21.15.62:3300/0 conn(0x7f3e800af620 msgr2=0x7f3e800ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.62:3300/0 conn(0x7f3e800af620 0x7f3e800ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 -- 172.21.15.41:0/970372293 >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 msgr2=0x7f3e8014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 -- 172.21.15.41:0/970372293 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800b1030 con 0x7f3e800b2170 2021-10-21T00:08:44.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e84cc7700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:44.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/970372293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 0x7f3e800ab170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3e780032f0 tx=0x7f3e780091d0).ready entity=mon.2 client_cookie=7c70c0d9ab4ae08 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7effd700 1 -- 172.21.15.41:0/970372293 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7800b600 con 0x7f3e800b2170 2021-10-21T00:08:44.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7effd700 1 -- 172.21.15.41:0/970372293 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800b760 con 0x7f3e800b2170 2021-10-21T00:08:44.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e7effd700 1 -- 172.21.15.41:0/970372293 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7800b8d0 con 0x7f3e800b2170 2021-10-21T00:08:44.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 -- 172.21.15.41:0/970372293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 msgr2=0x7f3e800ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 --2- 172.21.15.41:0/970372293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 0x7f3e800ab170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3e780032f0 tx=0x7f3e780091d0).stop 2021-10-21T00:08:44.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 -- 172.21.15.41:0/970372293 shutdown_connections 2021-10-21T00:08:44.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.41:3300/0 conn(0x7f3e800abb50 0x7f3e8014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 --2- 172.21.15.41:0/970372293 >> v2:172.21.15.62:3300/0 conn(0x7f3e800af620 0x7f3e800ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 --2- 172.21.15.41:0/970372293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800b2170 0x7f3e800ab170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 -- 172.21.15.41:0/970372293 >> 172.21.15.41:0/970372293 conn(0x7f3e800b5700 msgr2=0x7f3e800b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:44.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 -- 172.21.15.41:0/970372293 shutdown_connections 2021-10-21T00:08:44.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.374+0000 7f3e854c8700 1 -- 172.21.15.41:0/970372293 wait complete. 2021-10-21T00:08:44.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 Processor -- start 2021-10-21T00:08:44.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 -- start start 2021-10-21T00:08:44.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800abb50 0x7f3e800b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 0x7f3e80144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800acab0 con 0x7f3e800b2170 2021-10-21T00:08:44.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80144660 con 0x7f3e800af620 2021-10-21T00:08:44.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e854c8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80144880 con 0x7f3e800abb50 2021-10-21T00:08:44.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33720/0 (socket says 172.21.15.41:33720) 2021-10-21T00:08:44.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 -- 172.21.15.41:0/3207991296 learned_addr learned my addr 172.21.15.41:0/3207991296 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:44.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800abb50 0x7f3e800b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e7f7fe700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 0x7f3e80144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 -- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800abb50 msgr2=0x7f3e800b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800abb50 0x7f3e800b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 -- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 msgr2=0x7f3e80144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 0x7f3e80144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 -- 172.21.15.41:0/3207991296 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7000b1e0 con 0x7f3e800b2170 2021-10-21T00:08:44.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e7f7fe700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 0x7f3e80144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:44.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.378+0000 7f3e84cc7700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f3e7000c000 tx=0x7f3e70006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e70012600 con 0x7f3e800b2170 2021-10-21T00:08:44.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e78009470 con 0x7f3e800b2170 2021-10-21T00:08:44.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e801450a0 con 0x7f3e800b2170 2021-10-21T00:08:44.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70012760 con 0x7f3e800b2170 2021-10-21T00:08:44.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e70012ac0 con 0x7f3e800b2170 2021-10-21T00:08:44.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e70012c20 con 0x7f3e800b2170 2021-10-21T00:08:44.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 0x7f3e64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e7006bce0 con 0x7f3e800b2170 2021-10-21T00:08:44.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e80159680 con 0x7f3e800b2170 2021-10-21T00:08:44.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.382+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 0x7f3e64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.386+0000 7f3e7ffff700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 0x7f3e64055ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f3e7801c000 tx=0x7f3e78016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.390+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e70016070 con 0x7f3e800b2170 2021-10-21T00:08:44.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.554+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3e80146980 con 0x7f3e800b2170 2021-10-21T00:08:44.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.710+0000 7f3e7d7fa700 1 -- 172.21.15.41:0/3207991296 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3e80146980 con 0x7f3e800b2170 2021-10-21T00:08:44.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 msgr2=0x7f3e64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 0x7f3e64055ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f3e7801c000 tx=0x7f3e78016000).stop 2021-10-21T00:08:44.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 msgr2=0x7f3e801455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f3e7000c000 tx=0x7f3e70006eb0).stop 2021-10-21T00:08:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 shutdown_connections 2021-10-21T00:08:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e64053610 0x7f3e64055ad0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e800b2170 0x7f3e801455e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e800af620 0x7f3e80144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 --2- 172.21.15.41:0/3207991296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e800abb50 0x7f3e800b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 >> 172.21.15.41:0/3207991296 conn(0x7f3e800b5700 msgr2=0x7f3e800b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:44.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 shutdown_connections 2021-10-21T00:08:44.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.714+0000 7f3e854c8700 1 -- 172.21.15.41:0/3207991296 wait complete. 2021-10-21T00:08:44.736 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:44.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 Processor -- start 2021-10-21T00:08:44.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 -- start start 2021-10-21T00:08:44.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff468099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680b1560 con 0x7ff46809ab50 2021-10-21T00:08:44.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680b2550 con 0x7ff4680af620 2021-10-21T00:08:44.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff46cf10700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46809a170 con 0x7ff4680b2170 2021-10-21T00:08:44.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff45ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff46809ab50 0x7ff46813fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59726/0 (socket says 172.21.15.41:59726) 2021-10-21T00:08:44.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff45ffff700 1 -- 172.21.15.41:0/2808284263 learned_addr learned my addr 172.21.15.41:0/2808284263 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:44.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff4677fe700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff468099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17882257 0 0) 0x7ff4680b1560 con 0x7ff46809ab50 2021-10-21T00:08:44.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.838+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff448003260 con 0x7ff46809ab50 2021-10-21T00:08:44.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022823904 0 0) 0x7ff4680b2550 con 0x7ff4680af620 2021-10-21T00:08:44.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4680b1560 con 0x7ff4680af620 2021-10-21T00:08:44.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3247826501 0 0) 0x7ff448003260 con 0x7ff46809ab50 2021-10-21T00:08:44.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 msgr2=0x7ff468099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff468099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 >> v1:172.21.15.62:6789/0 conn(0x7ff4680af620 legacy=0x7ff468143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46809a410 con 0x7ff46809ab50 2021-10-21T00:08:44.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7ff450001680 con 0x7ff46809ab50 2021-10-21T00:08:44.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 >> v1:172.21.15.41:6789/0 conn(0x7ff46809ab50 legacy=0x7ff46813fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff448003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff448003e20 0x7ff448004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4480049f0 0x7ff448004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46809a170 con 0x7ff448003e20 2021-10-21T00:08:44.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800b860 con 0x7ff4480049f0 2021-10-21T00:08:44.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800ba20 con 0x7ff4680b2170 2021-10-21T00:08:44.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff448003e20 0x7ff448004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff4677fe700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff448003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff467fff700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4480049f0 0x7ff448004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 -- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 msgr2=0x7ff448003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4680b2170 0x7ff448003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 -- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4480049f0 msgr2=0x7ff448004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:44.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4480049f0 0x7ff448004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 -- 172.21.15.41:0/2808284263 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448003260 con 0x7ff448003e20 2021-10-21T00:08:44.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff45ffff700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff448003e20 0x7ff448004500 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff450001450 tx=0x7ff450001df0).ready entity=mon.0 client_cookie=b66462de979f3818 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4500078b0 con 0x7ff448003e20 2021-10-21T00:08:44.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450007170 con 0x7ff448003e20 2021-10-21T00:08:44.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff466ffd700 1 -- 172.21.15.41:0/2808284263 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4500074d0 con 0x7ff448003e20 2021-10-21T00:08:44.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 -- 172.21.15.41:0/2808284263 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff448003e20 msgr2=0x7ff448004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2808284263 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff448003e20 0x7ff448004500 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff450001450 tx=0x7ff450001df0).stop 2021-10-21T00:08:44.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff467fff700 1 -- 172.21.15.41:0/2808284263 reap_dead start 2021-10-21T00:08:44.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 -- 172.21.15.41:0/2808284263 shutdown_connections 2021-10-21T00:08:44.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 -- 172.21.15.41:0/2808284263 >> 172.21.15.41:0/2808284263 conn(0x7ff4680b5700 msgr2=0x7ff4680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:44.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 -- 172.21.15.41:0/2808284263 shutdown_connections 2021-10-21T00:08:44.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 -- 172.21.15.41:0/2808284263 wait complete. 2021-10-21T00:08:44.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.842+0000 7ff46cf10700 1 Processor -- start 2021-10-21T00:08:44.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- start start 2021-10-21T00:08:44.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff448003e20 0x7ff4680adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 0x7ff46808f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680660d0 con 0x7ff46808fb90 2021-10-21T00:08:44.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468066370 con 0x7ff448003e20 2021-10-21T00:08:44.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff468066610 con 0x7ff468065960 2021-10-21T00:08:44.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33740/0 (socket says 172.21.15.41:33740) 2021-10-21T00:08:44.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 0x7ff46808f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 -- 172.21.15.41:0/2249914085 learned_addr learned my addr 172.21.15.41:0/2249914085 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:44.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff448003e20 0x7ff4680adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 -- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 msgr2=0x7ff46808f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 0x7ff46808f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 -- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff448003e20 msgr2=0x7ff4680adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:44.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff448003e20 0x7ff4680adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:44.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 -- 172.21.15.41:0/2249914085 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680604c0 con 0x7ff46808fb90 2021-10-21T00:08:44.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff45ffff700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 0x7ff46808f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:44.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff467fff700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff460001210 tx=0x7ff460009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff460003220 con 0x7ff46808fb90 2021-10-21T00:08:44.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460003380 con 0x7ff46808fb90 2021-10-21T00:08:44.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4600018f0 con 0x7ff46808fb90 2021-10-21T00:08:44.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff468066ab0 con 0x7ff46808fb90 2021-10-21T00:08:44.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.846+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff468141020 con 0x7ff46808fb90 2021-10-21T00:08:44.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4680667d0 con 0x7ff46808fb90 2021-10-21T00:08:44.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff46001e070 con 0x7ff46808fb90 2021-10-21T00:08:44.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff4657fa700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 0x7ff44c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:44.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff46006b120 con 0x7ff46808fb90 2021-10-21T00:08:44.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff4677fe700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 0x7ff44c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:44.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.850+0000 7ff4677fe700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 0x7ff44c055ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff45800b000 tx=0x7ff458008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:44.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:44.854+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff460042170 con 0x7ff46808fb90 2021-10-21T00:08:45.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.014+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff46809a6b0 con 0x7ff46808fb90 2021-10-21T00:08:45.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.014+0000 7ff4657fa700 1 -- 172.21.15.41:0/2249914085 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7ff460045790 con 0x7ff46808fb90 2021-10-21T00:08:45.022 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:45.022 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:45.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 msgr2=0x7ff44c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 0x7ff44c055ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff45800b000 tx=0x7ff458008040).stop 2021-10-21T00:08:45.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 msgr2=0x7ff468090040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff460001210 tx=0x7ff460009040).stop 2021-10-21T00:08:45.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 shutdown_connections 2021-10-21T00:08:45.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff44c053610 0x7ff44c055ad0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff46808fb90 0x7ff468090040 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff468065960 0x7ff46808f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 --2- 172.21.15.41:0/2249914085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff448003e20 0x7ff4680adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 >> 172.21.15.41:0/2249914085 conn(0x7ff4680b5700 msgr2=0x7ff4680b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 shutdown_connections 2021-10-21T00:08:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.018+0000 7ff46cf10700 1 -- 172.21.15.41:0/2249914085 wait complete. 2021-10-21T00:08:45.027 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:45.035 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:45.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.130+0000 7fdf36199700 1 Processor -- start 2021-10-21T00:08:45.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.130+0000 7fdf36199700 1 -- start start 2021-10-21T00:08:45.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf36199700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf300ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf36199700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf300af700 0x7fdf300ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf36199700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3013f710 con 0x7fdf300b5f70 2021-10-21T00:08:45.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf36199700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300adf10 con 0x7fdf300af700 2021-10-21T00:08:45.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf36199700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300b6350 con 0x7fdf3006a190 2021-10-21T00:08:45.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf35197700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdf300b5f70 0x7fdf3013fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59746/0 (socket says 172.21.15.41:59746) 2021-10-21T00:08:45.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf35197700 1 -- 172.21.15.41:0/1711189548 learned_addr learned my addr 172.21.15.41:0/1711189548 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:45.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 --2- 172.21.15.41:0/1711189548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf300ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf35998700 1 --2- 172.21.15.41:0/1711189548 >> v2:172.21.15.62:3300/0 conn(0x7fdf300af700 0x7fdf300ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf1ffff700 1 -- 172.21.15.41:0/1711189548 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422652379 0 0) 0x7fdf3013f710 con 0x7fdf300b5f70 2021-10-21T00:08:45.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf1ffff700 1 -- 172.21.15.41:0/1711189548 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf18003260 con 0x7fdf300b5f70 2021-10-21T00:08:45.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 -- 172.21.15.41:0/1711189548 >> v2:172.21.15.62:3300/0 conn(0x7fdf300af700 msgr2=0x7fdf300ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 --2- 172.21.15.41:0/1711189548 >> v2:172.21.15.62:3300/0 conn(0x7fdf300af700 0x7fdf300ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 -- 172.21.15.41:0/1711189548 >> v1:172.21.15.41:6789/0 conn(0x7fdf300b5f70 legacy=0x7fdf3013fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 -- 172.21.15.41:0/1711189548 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30067600 con 0x7fdf3006a190 2021-10-21T00:08:45.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf34996700 1 --2- 172.21.15.41:0/1711189548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf300ac9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdf20002f70 tx=0x7fdf20006df0).ready entity=mon.2 client_cookie=e4cde2c7fe93a2a5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf1ffff700 1 -- 172.21.15.41:0/1711189548 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2000d4a0 con 0x7fdf3006a190 2021-10-21T00:08:45.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf1ffff700 1 -- 172.21.15.41:0/1711189548 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20000e90 con 0x7fdf3006a190 2021-10-21T00:08:45.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.134+0000 7fdf1ffff700 1 -- 172.21.15.41:0/1711189548 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2000d7f0 con 0x7fdf3006a190 2021-10-21T00:08:45.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- 172.21.15.41:0/1711189548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 msgr2=0x7fdf300ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 --2- 172.21.15.41:0/1711189548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf300ac9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fdf20002f70 tx=0x7fdf20006df0).stop 2021-10-21T00:08:45.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- 172.21.15.41:0/1711189548 shutdown_connections 2021-10-21T00:08:45.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 --2- 172.21.15.41:0/1711189548 >> v2:172.21.15.62:3300/0 conn(0x7fdf300af700 0x7fdf300ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 --2- 172.21.15.41:0/1711189548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf300ac9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- 172.21.15.41:0/1711189548 >> 172.21.15.41:0/1711189548 conn(0x7fdf300639f0 msgr2=0x7fdf300b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- 172.21.15.41:0/1711189548 shutdown_connections 2021-10-21T00:08:45.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- 172.21.15.41:0/1711189548 wait complete. 2021-10-21T00:08:45.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 Processor -- start 2021-10-21T00:08:45.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.138+0000 7fdf36199700 1 -- start start 2021-10-21T00:08:45.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf30149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 0x7fdf300b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30139830 con 0x7fdf300b5f70 2021-10-21T00:08:45.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30155cb0 con 0x7fdf300af700 2021-10-21T00:08:45.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30155f50 con 0x7fdf3006a190 2021-10-21T00:08:45.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33754/0 (socket says 172.21.15.41:33754) 2021-10-21T00:08:45.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 -- 172.21.15.41:0/1044745027 learned_addr learned my addr 172.21.15.41:0/1044745027 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:45.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf34996700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 0x7fdf300b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35197700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf30149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 -- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 msgr2=0x7fdf30149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf30149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 -- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 msgr2=0x7fdf300b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 0x7fdf300b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 -- 172.21.15.41:0/1044745027 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2000b180 con 0x7fdf300b5f70 2021-10-21T00:08:45.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf34996700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 0x7fdf300b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:45.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf35998700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdf28006e00 tx=0x7fdf280091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2800eeb0 con 0x7fdf300b5f70 2021-10-21T00:08:45.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800c850 con 0x7fdf300b5f70 2021-10-21T00:08:45.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300b3b80 con 0x7fdf300b5f70 2021-10-21T00:08:45.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf2800cbb0 con 0x7fdf300b5f70 2021-10-21T00:08:45.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf300b4ba0 con 0x7fdf300b5f70 2021-10-21T00:08:45.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.142+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf30155af0 con 0x7fdf300b5f70 2021-10-21T00:08:45.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.146+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf2800cd10 con 0x7fdf300b5f70 2021-10-21T00:08:45.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.146+0000 7fdf1e7fc700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 0x7fdf10055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.146+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdf2806bcc0 con 0x7fdf300b5f70 2021-10-21T00:08:45.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.146+0000 7fdf35197700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 0x7fdf10055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.146+0000 7fdf35197700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 0x7fdf10055b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fdf2c00d000 tx=0x7fdf2c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.150+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf28072080 con 0x7fdf300b5f70 2021-10-21T00:08:45.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.278+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf30057350 con 0x7fdf300b5f70 2021-10-21T00:08:45.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.278+0000 7fdf1e7fc700 1 -- 172.21.15.41:0/1044745027 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fdf28042d10 con 0x7fdf300b5f70 2021-10-21T00:08:45.285 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:45.286 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":69,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:44.706242+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:45.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 msgr2=0x7fdf10055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 0x7fdf10055b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fdf2c00d000 tx=0x7fdf2c009040).stop 2021-10-21T00:08:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 msgr2=0x7fdf300b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdf28006e00 tx=0x7fdf280091d0).stop 2021-10-21T00:08:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 shutdown_connections 2021-10-21T00:08:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf10053640 0x7fdf10055b00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf300b5f70 0x7fdf300b4510 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf300af700 0x7fdf300b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 --2- 172.21.15.41:0/1044745027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf3006a190 0x7fdf30149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 >> 172.21.15.41:0/1044745027 conn(0x7fdf300639f0 msgr2=0x7fdf3013ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 shutdown_connections 2021-10-21T00:08:45.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.282+0000 7fdf36199700 1 -- 172.21.15.41:0/1044745027 wait complete. 2021-10-21T00:08:45.304 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:45.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 Processor -- start 2021-10-21T00:08:45.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- start start 2021-10-21T00:08:45.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff0062330 0x7f9ff00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 0x7f9ff013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00b3520 con 0x7f9ff0062330 2021-10-21T00:08:45.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff0143c40 con 0x7f9ff013c510 2021-10-21T00:08:45.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0142ad0 con 0x7f9ff0142f00 2021-10-21T00:08:45.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff0062330 0x7f9ff00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ff0062330 0x7f9ff00b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33758/0 (socket says 172.21.15.41:33758) 2021-10-21T00:08:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 -- 172.21.15.41:0/1226308554 learned_addr learned my addr 172.21.15.41:0/1226308554 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9feffff700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fe6ffd700 1 --2- 172.21.15.41:0/1226308554 >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 0x7f9ff013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 -- 172.21.15.41:0/1226308554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 msgr2=0x7f9ff0143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 -- 172.21.15.41:0/1226308554 >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 msgr2=0x7f9ff013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1226308554 >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 0x7f9ff013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 -- 172.21.15.41:0/1226308554 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff013ce60 con 0x7f9ff0062330 2021-10-21T00:08:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fe6ffd700 1 --2- 172.21.15.41:0/1226308554 >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 0x7f9ff013c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff0062330 0x7f9ff00b4140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f9ff00b17c0 tx=0x7f9fe0006eb0).ready entity=mon.0 client_cookie=db3ceee30ddea7fd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9feeffd700 1 -- 172.21.15.41:0/1226308554 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe000d570 con 0x7f9ff0062330 2021-10-21T00:08:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9feeffd700 1 -- 172.21.15.41:0/1226308554 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0000e90 con 0x7f9ff0062330 2021-10-21T00:08:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9feeffd700 1 -- 172.21.15.41:0/1226308554 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe000d8c0 con 0x7f9ff0062330 2021-10-21T00:08:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1226308554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff0062330 msgr2=0x7f9ff00b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff0062330 0x7f9ff00b4140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f9ff00b17c0 tx=0x7f9fe0006eb0).stop 2021-10-21T00:08:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1226308554 shutdown_connections 2021-10-21T00:08:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1226308554 >> v2:172.21.15.62:3300/0 conn(0x7f9ff013c510 0x7f9ff013c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1226308554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff0062330 0x7f9ff00b4140 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1226308554 >> 172.21.15.41:0/1226308554 conn(0x7f9ff00b9080 msgr2=0x7f9ff00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1226308554 shutdown_connections 2021-10-21T00:08:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.418+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1226308554 wait complete. 2021-10-21T00:08:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 Processor -- start 2021-10-21T00:08:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- start start 2021-10-21T00:08:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 0x7f9ff01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0142320 con 0x7f9ff013c510 2021-10-21T00:08:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0151bc0 con 0x7f9ff0062330 2021-10-21T00:08:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0151e60 con 0x7f9ff0142f00 2021-10-21T00:08:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33764/0 (socket says 172.21.15.41:33764) 2021-10-21T00:08:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 -- 172.21.15.41:0/1072973201 learned_addr learned my addr 172.21.15.41:0/1072973201 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9feffff700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 0x7f9ff01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 -- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 msgr2=0x7f9ff0155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 -- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 msgr2=0x7f9ff01525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 0x7f9ff01525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 -- 172.21.15.41:0/1072973201 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe000b1e0 con 0x7f9ff013c510 2021-10-21T00:08:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9feffff700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 0x7f9ff01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fe6ffd700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f9fd8007000 tx=0x7f9fd8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd8010580 con 0x7f9ff013c510 2021-10-21T00:08:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd80106e0 con 0x7f9ff013c510 2021-10-21T00:08:45.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd8010a40 con 0x7f9ff013c510 2021-10-21T00:08:45.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff0152100 con 0x7f9ff013c510 2021-10-21T00:08:45.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.422+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff00ad3e0 con 0x7f9ff013c510 2021-10-21T00:08:45.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0152290 con 0x7f9ff013c510 2021-10-21T00:08:45.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fd8010ba0 con 0x7f9ff013c510 2021-10-21T00:08:45.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9fed7fa700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 0x7f9fd4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9fd806bc40 con 0x7f9ff013c510 2021-10-21T00:08:45.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 0x7f9fd4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.426+0000 7f9fef7fe700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 0x7f9fd4055a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f9fe0019000 tx=0x7f9fe0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.434+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9fd8042c30 con 0x7f9ff013c510 2021-10-21T00:08:45.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.602+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9ff0145f90 con 0x7f9ff013c510 2021-10-21T00:08:45.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.606+0000 7f9fed7fa700 1 -- 172.21.15.41:0/1072973201 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9fd8046250 con 0x7f9ff013c510 2021-10-21T00:08:45.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 msgr2=0x7f9fd4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 0x7f9fd4055a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f9fe0019000 tx=0x7f9fe0015000).stop 2021-10-21T00:08:45.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 msgr2=0x7f9ff00accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f9fd8007000 tx=0x7f9fd8008040).stop 2021-10-21T00:08:45.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 shutdown_connections 2021-10-21T00:08:45.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fd4053580 0x7f9fd4055a40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff0142f00 0x7f9ff0155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ff013c510 0x7f9ff00accd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 --2- 172.21.15.41:0/1072973201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff0062330 0x7f9ff01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 >> 172.21.15.41:0/1072973201 conn(0x7f9ff00b9080 msgr2=0x7f9ff013ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 shutdown_connections 2021-10-21T00:08:45.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.610+0000 7f9ff4d24700 1 -- 172.21.15.41:0/1072973201 wait complete. 2021-10-21T00:08:45.621 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:08:45.626 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:45.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 Processor -- start 2021-10-21T00:08:45.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 -- start start 2021-10-21T00:08:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd85c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0b18b0 con 0x7fd85c0b6120 2021-10-21T00:08:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0b6500 con 0x7fd85c13e610 2021-10-21T00:08:45.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd864534700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c13f6c0 con 0x7fd85c0b05e0 2021-10-21T00:08:45.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8622d0700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd85c0b6120 0x7fd85c0ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59774/0 (socket says 172.21.15.41:59774) 2021-10-21T00:08:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8622d0700 1 -- 172.21.15.41:0/1689403192 learned_addr learned my addr 172.21.15.41:0/1689403192 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd861acf700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd85c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042181055 0 0) 0x7fd85c0b18b0 con 0x7fd85c0b6120 2021-10-21T00:08:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003260 con 0x7fd85c0b6120 2021-10-21T00:08:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4074961914 0 0) 0x7fd844003260 con 0x7fd85c0b6120 2021-10-21T00:08:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 msgr2=0x7fd85c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd85c0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 >> v1:172.21.15.62:6789/0 conn(0x7fd85c13e610 legacy=0x7fd85c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0b1660 con 0x7fd85c0b6120 2021-10-21T00:08:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd8580019e0 con 0x7fd85c0b6120 2021-10-21T00:08:45.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 >> v1:172.21.15.41:6789/0 conn(0x7fd85c0b6120 legacy=0x7fd85c0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd844003780 0x7fd844003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd844004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.754+0000 7fd8612ce700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8440049f0 0x7fd844004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400b800 con 0x7fd8440049f0 2021-10-21T00:08:45.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400b940 con 0x7fd844003780 2021-10-21T00:08:45.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400bb00 con 0x7fd85c0b05e0 2021-10-21T00:08:45.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8622d0700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd844003780 0x7fd844003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8440049f0 0x7fd844004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd861acf700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd844004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 -- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 msgr2=0x7fd844004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c0b05e0 0x7fd844004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 -- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd844003780 msgr2=0x7fd844003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:45.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd844003780 0x7fd844003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 -- 172.21.15.41:0/1689403192 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003260 con 0x7fd8440049f0 2021-10-21T00:08:45.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8440049f0 0x7fd844004e70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd85c06a010 tx=0x7fd854007a00).ready entity=mon.0 client_cookie=283f082b63674ba8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd854007d10 con 0x7fd8440049f0 2021-10-21T00:08:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854007030 con 0x7fd8440049f0 2021-10-21T00:08:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd8612ce700 1 -- 172.21.15.41:0/1689403192 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd854007390 con 0x7fd8440049f0 2021-10-21T00:08:45.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 -- 172.21.15.41:0/1689403192 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8440049f0 msgr2=0x7fd844004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 --2- 172.21.15.41:0/1689403192 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8440049f0 0x7fd844004e70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd85c06a010 tx=0x7fd854007a00).stop 2021-10-21T00:08:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd862ad1700 1 -- 172.21.15.41:0/1689403192 reap_dead start 2021-10-21T00:08:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 -- 172.21.15.41:0/1689403192 shutdown_connections 2021-10-21T00:08:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 -- 172.21.15.41:0/1689403192 >> 172.21.15.41:0/1689403192 conn(0x7fd85c063ae0 msgr2=0x7fd85c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 -- 172.21.15.41:0/1689403192 shutdown_connections 2021-10-21T00:08:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.758+0000 7fd864534700 1 -- 172.21.15.41:0/1689403192 wait complete. 2021-10-21T00:08:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 Processor -- start 2021-10-21T00:08:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- start start 2021-10-21T00:08:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 0x7fd85c1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 0x7fd85c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c13ce00 con 0x7fd85c0b38b0 2021-10-21T00:08:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c142f70 con 0x7fd85c1438c0 2021-10-21T00:08:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b3c90 con 0x7fd85c13dd80 2021-10-21T00:08:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33784/0 (socket says 172.21.15.41:33784) 2021-10-21T00:08:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 -- 172.21.15.41:0/4025238522 learned_addr learned my addr 172.21.15.41:0/4025238522 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd862ad1700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 0x7fd85c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd861acf700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 0x7fd85c1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 -- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 msgr2=0x7fd85c1433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 0x7fd85c1433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 -- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 msgr2=0x7fd85c151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 0x7fd85c151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 -- 172.21.15.41:0/4025238522 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0b43f0 con 0x7fd85c0b38b0 2021-10-21T00:08:45.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd862ad1700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 0x7fd85c151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:45.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd861acf700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 0x7fd85c1433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:45.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd8622d0700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fd85c0b3e20 tx=0x7fd85c05cd90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85800fac0 con 0x7fd85c0b38b0 2021-10-21T00:08:45.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800fc20 con 0x7fd85c0b38b0 2021-10-21T00:08:45.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd858007810 con 0x7fd85c0b38b0 2021-10-21T00:08:45.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c13d030 con 0x7fd85c0b38b0 2021-10-21T00:08:45.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.762+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c143d70 con 0x7fd85c0b38b0 2021-10-21T00:08:45.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c057350 con 0x7fd85c0b38b0 2021-10-21T00:08:45.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd85801b030 con 0x7fd85c0b38b0 2021-10-21T00:08:45.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd84b7fe700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 0x7fd83c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:45.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd85806b9c0 con 0x7fd85c0b38b0 2021-10-21T00:08:45.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd861acf700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 0x7fd83c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:45.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.766+0000 7fd861acf700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 0x7fd83c055b00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd84c00b000 tx=0x7fd84c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:45.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.774+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd858042990 con 0x7fd85c0b38b0 2021-10-21T00:08:45.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.942+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd85c05f1e0 con 0x7fd85c0b38b0 2021-10-21T00:08:45.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.946+0000 7fd84b7fe700 1 -- 172.21.15.41:0/4025238522 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd858019030 con 0x7fd85c0b38b0 2021-10-21T00:08:45.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 msgr2=0x7fd83c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 0x7fd83c055b00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd84c00b000 tx=0x7fd84c008040).stop 2021-10-21T00:08:45.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 msgr2=0x7fd85c14e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:45.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fd85c0b3e20 tx=0x7fd85c05cd90).stop 2021-10-21T00:08:45.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 shutdown_connections 2021-10-21T00:08:45.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd83c053640 0x7fd83c055b00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd85c1438c0 0x7fd85c151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd85c13dd80 0x7fd85c1433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 --2- 172.21.15.41:0/4025238522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd85c0b38b0 0x7fd85c14e9e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:45.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 >> 172.21.15.41:0/4025238522 conn(0x7fd85c063ae0 msgr2=0x7fd85c0ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:45.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 shutdown_connections 2021-10-21T00:08:45.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:45.950+0000 7fd864534700 1 -- 172.21.15.41:0/4025238522 wait complete. 2021-10-21T00:08:45.963 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:08:45.976 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:08:46.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 Processor -- start 2021-10-21T00:08:46.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 -- start start 2021-10-21T00:08:46.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f146c0b9c70 0x7f146c143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f146c0b3bc0 0x7f146c143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c143a00 0x7f146c05bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c1429a0 con 0x7f146c0b3bc0 2021-10-21T00:08:46.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c142bc0 con 0x7f146c0b9c70 2021-10-21T00:08:46.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f1474445700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0ba050 con 0x7f146c143a00 2021-10-21T00:08:46.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f146c0b3bc0 0x7f146c143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f146c0b3bc0 0x7f146c143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33794/0 (socket says 172.21.15.41:33794) 2021-10-21T00:08:46.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 -- 172.21.15.41:0/2104499929 learned_addr learned my addr 172.21.15.41:0/2104499929 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:46.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14729e2700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c143a00 0x7f146c05bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14721e1700 1 --2- 172.21.15.41:0/2104499929 >> v2:172.21.15.62:3300/0 conn(0x7f146c0b9c70 0x7f146c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 -- 172.21.15.41:0/2104499929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c143a00 msgr2=0x7f146c05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:46.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c143a00 0x7f146c05bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 -- 172.21.15.41:0/2104499929 >> v2:172.21.15.62:3300/0 conn(0x7f146c0b9c70 msgr2=0x7f146c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:46.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 --2- 172.21.15.41:0/2104499929 >> v2:172.21.15.62:3300/0 conn(0x7f146c0b9c70 0x7f146c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 -- 172.21.15.41:0/2104499929 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c1463c0 con 0x7f146c0b3bc0 2021-10-21T00:08:46.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14719e0700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c0b3bc0 0x7f146c143510 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f145c002f70 tx=0x7f145c006eb0).ready entity=mon.0 client_cookie=659e7c1bf953e493 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14711df700 1 -- 172.21.15.41:0/2104499929 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145c00d570 con 0x7f146c0b3bc0 2021-10-21T00:08:46.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14711df700 1 -- 172.21.15.41:0/2104499929 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c000e90 con 0x7f146c0b3bc0 2021-10-21T00:08:46.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.090+0000 7f14711df700 1 -- 172.21.15.41:0/2104499929 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145c00d900 con 0x7f146c0b3bc0 2021-10-21T00:08:46.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- 172.21.15.41:0/2104499929 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c0b3bc0 msgr2=0x7f146c143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c0b3bc0 0x7f146c143510 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f145c002f70 tx=0x7f145c006eb0).stop 2021-10-21T00:08:46.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- 172.21.15.41:0/2104499929 shutdown_connections 2021-10-21T00:08:46.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c0b3bc0 0x7f146c143510 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 --2- 172.21.15.41:0/2104499929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c143a00 0x7f146c05bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 --2- 172.21.15.41:0/2104499929 >> v2:172.21.15.62:3300/0 conn(0x7f146c0b9c70 0x7f146c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- 172.21.15.41:0/2104499929 >> 172.21.15.41:0/2104499929 conn(0x7f146c062e80 msgr2=0x7f146c0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:46.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- 172.21.15.41:0/2104499929 shutdown_connections 2021-10-21T00:08:46.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- 172.21.15.41:0/2104499929 wait complete. 2021-10-21T00:08:46.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 Processor -- start 2021-10-21T00:08:46.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.094+0000 7f1474445700 1 -- start start 2021-10-21T00:08:46.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f146c0b3bc0 0x7f146c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c0b9c70 0x7f146c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1552e0 con 0x7f146c143a00 2021-10-21T00:08:46.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c144980 con 0x7f146c0b3bc0 2021-10-21T00:08:46.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c144c20 con 0x7f146c0b9c70 2021-10-21T00:08:46.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14721e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f146c0b3bc0 0x7f146c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33802/0 (socket says 172.21.15.41:33802) 2021-10-21T00:08:46.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 -- 172.21.15.41:0/763250767 learned_addr learned my addr 172.21.15.41:0/763250767 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:46.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14719e0700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c0b9c70 0x7f146c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 -- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c0b9c70 msgr2=0x7f146c149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c0b9c70 0x7f146c149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 -- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f146c0b3bc0 msgr2=0x7f146c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f146c0b3bc0 0x7f146c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 -- 172.21.15.41:0/763250767 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c00b1e0 con 0x7f146c143a00 2021-10-21T00:08:46.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f14729e2700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f146400c000 tx=0x7f14640091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1464012600 con 0x7f146c143a00 2021-10-21T00:08:46.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1464012760 con 0x7f146c143a00 2021-10-21T00:08:46.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c144ec0 con 0x7f146c143a00 2021-10-21T00:08:46.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1464012ac0 con 0x7f146c143a00 2021-10-21T00:08:46.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.098+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c0acab0 con 0x7f146c143a00 2021-10-21T00:08:46.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.102+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c145050 con 0x7f146c143a00 2021-10-21T00:08:46.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.102+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1464022070 con 0x7f146c143a00 2021-10-21T00:08:46.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.102+0000 7f145b7fe700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 0x7f144c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.102+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f146406bf80 con 0x7f146c143a00 2021-10-21T00:08:46.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.102+0000 7f14721e1700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 0x7f144c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.106+0000 7f14721e1700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 0x7f144c055a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f146800c000 tx=0x7f1468008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.106+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1464042f50 con 0x7f146c143a00 2021-10-21T00:08:46.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.274+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f146c146120 con 0x7f146c143a00 2021-10-21T00:08:46.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f145b7fe700 1 -- 172.21.15.41:0/763250767 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1464016020 con 0x7f146c143a00 2021-10-21T00:08:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 msgr2=0x7f144c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 0x7f144c055a40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f146800c000 tx=0x7f1468008040).stop 2021-10-21T00:08:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 msgr2=0x7f146c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f146400c000 tx=0x7f14640091d0).stop 2021-10-21T00:08:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 shutdown_connections 2021-10-21T00:08:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f144c053580 0x7f144c055a40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f146c143a00 0x7f146c1556d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f146c0b9c70 0x7f146c149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 --2- 172.21.15.41:0/763250767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f146c0b3bc0 0x7f146c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 >> 172.21.15.41:0/763250767 conn(0x7f146c062e80 msgr2=0x7f146c142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 shutdown_connections 2021-10-21T00:08:46.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.282+0000 7f1474445700 1 -- 172.21.15.41:0/763250767 wait complete. 2021-10-21T00:08:46.293 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:08:46.303 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:46.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 Processor -- start 2021-10-21T00:08:46.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- start start 2021-10-21T00:08:46.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa16c0b9c70 0x7fa16c143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c142bc0 con 0x7fa16c1418f0 2021-10-21T00:08:46.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0ba050 con 0x7fa16c0b3bc0 2021-10-21T00:08:46.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c1429a0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa16c0b9c70 0x7fa16c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa16c0b9c70 0x7fa16c143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33806/0 (socket says 172.21.15.41:33806) 2021-10-21T00:08:46.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 -- 172.21.15.41:0/3419299509 learned_addr learned my addr 172.21.15.41:0/3419299509 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:46.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 -- 172.21.15.41:0/3419299509 >> v1:172.21.15.62:6789/0 conn(0x7fa16c0b3bc0 legacy=0x7fa16c143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 -- 172.21.15.41:0/3419299509 >> v1:172.21.15.41:6789/0 conn(0x7fa16c1418f0 legacy=0x7fa16c141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 -- 172.21.15.41:0/3419299509 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c1463c0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16b7fe700 1 --2- 172.21.15.41:0/3419299509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c143020 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa15c002f70 tx=0x7fa15c006eb0).ready entity=mon.0 client_cookie=e374f539194ec8ed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16affd700 1 -- 172.21.15.41:0/3419299509 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15c00d660 con 0x7fa16c0b9c70 2021-10-21T00:08:46.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16affd700 1 -- 172.21.15.41:0/3419299509 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c000e90 con 0x7fa16c0b9c70 2021-10-21T00:08:46.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa16affd700 1 -- 172.21.15.41:0/3419299509 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15c00d9f0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- 172.21.15.41:0/3419299509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 msgr2=0x7fa16c143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 --2- 172.21.15.41:0/3419299509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c143020 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa15c002f70 tx=0x7fa15c006eb0).stop 2021-10-21T00:08:46.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- 172.21.15.41:0/3419299509 shutdown_connections 2021-10-21T00:08:46.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 --2- 172.21.15.41:0/3419299509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c143020 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- 172.21.15.41:0/3419299509 >> 172.21.15.41:0/3419299509 conn(0x7fa16c062e80 msgr2=0x7fa16c0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:46.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- 172.21.15.41:0/3419299509 shutdown_connections 2021-10-21T00:08:46.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.402+0000 7fa172242700 1 -- 172.21.15.41:0/3419299509 wait complete. 2021-10-21T00:08:46.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 Processor -- start 2021-10-21T00:08:46.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 -- start start 2021-10-21T00:08:46.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa16c0b3bc0 0x7fa16c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa16c1418f0 0x7fa16c145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0b84f0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0ad4a0 con 0x7fa16c1418f0 2021-10-21T00:08:46.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa172242700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0b9280 con 0x7fa16c0b3bc0 2021-10-21T00:08:46.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33812/0 (socket says 172.21.15.41:33812) 2021-10-21T00:08:46.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 -- 172.21.15.41:0/1815018999 learned_addr learned my addr 172.21.15.41:0/1815018999 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:46.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa16bfff700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa16c1418f0 0x7fa16c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa16b7fe700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa16c0b3bc0 0x7fa16c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 -- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa16c0b3bc0 msgr2=0x7fa16c155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa16c0b3bc0 0x7fa16c155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 -- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa16c1418f0 msgr2=0x7fa16c145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa16c1418f0 0x7fa16c145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 -- 172.21.15.41:0/1815018999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c00b1e0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa162ffd700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa16c063290 tx=0x7fa154007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.406+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154012400 con 0x7fa16c0b9c70 2021-10-21T00:08:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154012560 con 0x7fa16c0b9c70 2021-10-21T00:08:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c0b8e80 con 0x7fa16c0b9c70 2021-10-21T00:08:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1540128c0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c1129a0 con 0x7fa16c0b9c70 2021-10-21T00:08:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c143c20 con 0x7fa16c0b9c70 2021-10-21T00:08:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa154019030 con 0x7fa16c0b9c70 2021-10-21T00:08:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa1697fa700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 0x7fa150055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa15406ac40 con 0x7fa16c0b9c70 2021-10-21T00:08:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa16b7fe700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 0x7fa150055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:46.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.410+0000 7fa16b7fe700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 0x7fa150055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa15c01c000 tx=0x7fa15c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:46.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.418+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa154041d40 con 0x7fa16c0b9c70 2021-10-21T00:08:46.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.582+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa16c057350 con 0x7fa16c0b9c70 2021-10-21T00:08:46.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.582+0000 7fa1697fa700 1 -- 172.21.15.41:0/1815018999 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fa154045360 con 0x7fa16c0b9c70 2021-10-21T00:08:46.588 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:46.588 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 msgr2=0x7fa150055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 0x7fa150055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fa15c01c000 tx=0x7fa15c015000).stop 2021-10-21T00:08:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 msgr2=0x7fa16c0ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa16c063290 tx=0x7fa154007c50).stop 2021-10-21T00:08:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 shutdown_connections 2021-10-21T00:08:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa150053640 0x7fa150055b00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa16c1418f0 0x7fa16c145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa16c0b9c70 0x7fa16c0ae2b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 --2- 172.21.15.41:0/1815018999 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa16c0b3bc0 0x7fa16c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 >> 172.21.15.41:0/1815018999 conn(0x7fa16c062e80 msgr2=0x7fa16c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 shutdown_connections 2021-10-21T00:08:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:46.586+0000 7fa172242700 1 -- 172.21.15.41:0/1815018999 wait complete. 2021-10-21T00:08:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:46.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:43.702897+0000', 'modified': '2021-10-21T00:08:44.705473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6270': {'gid': 6270, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/2873838223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 2873838223}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 2873838223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:08:46.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:08:46.810 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:08:46.927 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6270,"want_state":"up:active","state":"up:active","rank_uptime":3.2097684339999999,"mdsmap_epoch":33,"osdmap_epoch":69,"osdmap_epoch_barrier":68,"uptime":7.3705228170000003} 2021-10-21T00:08:46.929 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6270, "mdsmap_epoch": 33, "osdmap_epoch": 69, "osdmap_epoch_barrier": 68, "rank_uptime": 3.209768434, "state": "up:active", "uptime": 7.370522817, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:08:46.930 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:47.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.030+0000 7f8dd359e700 1 Processor -- start 2021-10-21T00:08:47.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.030+0000 7f8dd359e700 1 -- start start 2021-10-21T00:08:47.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8dd4062330 0x7f8dd40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 0x7f8dd405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd405bd40 con 0x7f8dd40b3a20 2021-10-21T00:08:47.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd405bf70 con 0x7f8dd4062330 2021-10-21T00:08:47.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4142cb0 con 0x7f8dd4062f70 2021-10-21T00:08:47.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd2d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8dd40b3a20 0x7f8dd413c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59824/0 (socket says 172.21.15.41:59824) 2021-10-21T00:08:47.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 0x7f8dd405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd2d9d700 1 -- 172.21.15.41:0/1576795096 learned_addr learned my addr 172.21.15.41:0/1576795096 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:47.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd259c700 1 --2- 172.21.15.41:0/1576795096 >> v2:172.21.15.62:3300/0 conn(0x7f8dd4062330 0x7f8dd40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd159a700 1 -- 172.21.15.41:0/1576795096 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225290566 0 0) 0x7f8dd405bd40 con 0x7f8dd40b3a20 2021-10-21T00:08:47.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd159a700 1 -- 172.21.15.41:0/1576795096 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db4003260 con 0x7f8dd40b3a20 2021-10-21T00:08:47.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 -- 172.21.15.41:0/1576795096 >> v2:172.21.15.62:3300/0 conn(0x7f8dd4062330 msgr2=0x7f8dd40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:47.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 --2- 172.21.15.41:0/1576795096 >> v2:172.21.15.62:3300/0 conn(0x7f8dd4062330 0x7f8dd40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 -- 172.21.15.41:0/1576795096 >> v1:172.21.15.41:6789/0 conn(0x7f8dd40b3a20 legacy=0x7f8dd413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 -- 172.21.15.41:0/1576795096 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4142950 con 0x7f8dd4062f70 2021-10-21T00:08:47.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd1d9b700 1 --2- 172.21.15.41:0/1576795096 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 0x7f8dd405c410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8dbc002f70 tx=0x7f8dbc006df0).ready entity=mon.2 client_cookie=a5df128498f7df22 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd159a700 1 -- 172.21.15.41:0/1576795096 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00d4a0 con 0x7f8dd4062f70 2021-10-21T00:08:47.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd159a700 1 -- 172.21.15.41:0/1576795096 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc000e90 con 0x7f8dd4062f70 2021-10-21T00:08:47.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd159a700 1 -- 172.21.15.41:0/1576795096 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00d7f0 con 0x7f8dd4062f70 2021-10-21T00:08:47.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- 172.21.15.41:0/1576795096 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 msgr2=0x7f8dd405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 --2- 172.21.15.41:0/1576795096 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 0x7f8dd405c410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8dbc002f70 tx=0x7f8dbc006df0).stop 2021-10-21T00:08:47.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- 172.21.15.41:0/1576795096 shutdown_connections 2021-10-21T00:08:47.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 --2- 172.21.15.41:0/1576795096 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd4062f70 0x7f8dd405c410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 --2- 172.21.15.41:0/1576795096 >> v2:172.21.15.62:3300/0 conn(0x7f8dd4062330 0x7f8dd40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- 172.21.15.41:0/1576795096 >> 172.21.15.41:0/1576795096 conn(0x7f8dd40b9080 msgr2=0x7f8dd40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- 172.21.15.41:0/1576795096 shutdown_connections 2021-10-21T00:08:47.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- 172.21.15.41:0/1576795096 wait complete. 2021-10-21T00:08:47.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 Processor -- start 2021-10-21T00:08:47.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.034+0000 7f8dd359e700 1 -- start start 2021-10-21T00:08:47.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 0x7f8dd4146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dd4062f70 0x7f8dd40ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 0x7f8dd413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4144f00 con 0x7f8dd4062330 2021-10-21T00:08:47.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4146e00 con 0x7f8dd4062f70 2021-10-21T00:08:47.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4145120 con 0x7f8dd40b3a20 2021-10-21T00:08:47.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 0x7f8dd4146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 0x7f8dd4146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33824/0 (socket says 172.21.15.41:33824) 2021-10-21T00:08:47.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd259c700 1 -- 172.21.15.41:0/3706039581 learned_addr learned my addr 172.21.15.41:0/3706039581 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:47.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 0x7f8dd413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd1d9b700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dd4062f70 0x7f8dd40ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 -- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dd4062f70 msgr2=0x7f8dd40ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dd4062f70 0x7f8dd40ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 -- 172.21.15.41:0/3706039581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 msgr2=0x7f8dd4146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 0x7f8dd4146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 -- 172.21.15.41:0/3706039581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc00b180 con 0x7f8dd40b3a20 2021-10-21T00:08:47.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd2d9d700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 0x7f8dd413dee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8dcc001490 tx=0x7f8dcc007d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dcc00ce20 con 0x7f8dd40b3a20 2021-10-21T00:08:47.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd41453c0 con 0x7f8dd40b3a20 2021-10-21T00:08:47.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc005ba0 con 0x7f8dd40b3a20 2021-10-21T00:08:47.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dcc0070d0 con 0x7f8dd40b3a20 2021-10-21T00:08:47.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.038+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd4144010 con 0x7f8dd40b3a20 2021-10-21T00:08:47.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd4057350 con 0x7f8dd40b3a20 2021-10-21T00:08:47.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8dcc010070 con 0x7f8dd40b3a20 2021-10-21T00:08:47.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dcb7fe700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 0x7f8db8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8dcc06b0c0 con 0x7f8dd40b3a20 2021-10-21T00:08:47.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dd259c700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 0x7f8db8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.042+0000 7f8dd259c700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 0x7f8db8055a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f8dc400b000 tx=0x7f8dc4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.050+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8dcc042180 con 0x7f8dd40b3a20 2021-10-21T00:08:47.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.174+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dd4151cc0 con 0x7f8dd40b3a20 2021-10-21T00:08:47.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dcb7fe700 1 -- 172.21.15.41:0/3706039581 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f8dcc018070 con 0x7f8dd40b3a20 2021-10-21T00:08:47.182 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:47.182 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":69,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:44.706242+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:47.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 msgr2=0x7f8db8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 0x7f8db8055a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f8dc400b000 tx=0x7f8dc4006df0).stop 2021-10-21T00:08:47.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 msgr2=0x7f8dd413dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 0x7f8dd413dee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8dcc001490 tx=0x7f8dcc007d20).stop 2021-10-21T00:08:47.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 shutdown_connections 2021-10-21T00:08:47.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8db8053580 0x7f8db8055a40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dd40b3a20 0x7f8dd413dee0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dd4062f70 0x7f8dd40ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 --2- 172.21.15.41:0/3706039581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dd4062330 0x7f8dd4146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 >> 172.21.15.41:0/3706039581 conn(0x7f8dd40b9080 msgr2=0x7f8dd40b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 shutdown_connections 2021-10-21T00:08:47.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.178+0000 7f8dd359e700 1 -- 172.21.15.41:0/3706039581 wait complete. 2021-10-21T00:08:47.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:08:42.313703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:08:42.705186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:08:47.196 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:08:47.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 Processor -- start 2021-10-21T00:08:47.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- start start 2021-10-21T00:08:47.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7668062f70 0x7f766805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f76680b3a20 0x7f766813c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766805bd40 con 0x7f7668062330 2021-10-21T00:08:47.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766805bf70 con 0x7f76680b3a20 2021-10-21T00:08:47.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7668142cb0 con 0x7f7668062f70 2021-10-21T00:08:47.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f76680b3a20 0x7f766813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7666ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7668062330 0x7f76680b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59834/0 (socket says 172.21.15.41:59834) 2021-10-21T00:08:47.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7666ffd700 1 -- 172.21.15.41:0/4076527311 learned_addr learned my addr 172.21.15.41:0/4076527311 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:47.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76667fc700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7668062f70 0x7f766805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 -- 172.21.15.41:0/4076527311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7668062f70 msgr2=0x7f766805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:47.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7668062f70 0x7f766805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 -- 172.21.15.41:0/4076527311 >> v1:172.21.15.41:6789/0 conn(0x7f7668062330 legacy=0x7f76680b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 -- 172.21.15.41:0/4076527311 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668142950 con 0x7f76680b3a20 2021-10-21T00:08:47.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7665ffb700 1 -- 172.21.15.41:0/4076527311 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593497792 0 0) 0x7f766805bd40 con 0x7f7668062330 2021-10-21T00:08:47.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f76677fe700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76680b3a20 0x7f766813c510 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f76600032f0 tx=0x7f76600091d0).ready entity=mon.0 client_cookie=561d942d07613af0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7665ffb700 1 -- 172.21.15.41:0/4076527311 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f766000b6c0 con 0x7f76680b3a20 2021-10-21T00:08:47.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7665ffb700 1 -- 172.21.15.41:0/4076527311 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766000b820 con 0x7f76680b3a20 2021-10-21T00:08:47.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7665ffb700 1 -- 172.21.15.41:0/4076527311 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f766000b990 con 0x7f76680b3a20 2021-10-21T00:08:47.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- 172.21.15.41:0/4076527311 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76680b3a20 msgr2=0x7f766813c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76680b3a20 0x7f766813c510 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f76600032f0 tx=0x7f76600091d0).stop 2021-10-21T00:08:47.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- 172.21.15.41:0/4076527311 shutdown_connections 2021-10-21T00:08:47.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76680b3a20 0x7f766813c510 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 --2- 172.21.15.41:0/4076527311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7668062f70 0x7f766805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- 172.21.15.41:0/4076527311 >> 172.21.15.41:0/4076527311 conn(0x7f76680b9080 msgr2=0x7f76680b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.298+0000 7f7667fff700 1 -- 172.21.15.41:0/4076527311 shutdown_connections 2021-10-21T00:08:47.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.302+0000 7f7667fff700 1 -- 172.21.15.41:0/4076527311 wait complete. 2021-10-21T00:08:47.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.302+0000 7f7667fff700 1 Processor -- start 2021-10-21T00:08:47.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.302+0000 7f7667fff700 1 -- start start 2021-10-21T00:08:47.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7668062f70 0x7f76681552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76680b3a20 0x7f7668155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668146b00 con 0x7f7668062330 2021-10-21T00:08:47.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680ae100 con 0x7f7668062f70 2021-10-21T00:08:47.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680ae5a0 con 0x7f76680b3a20 2021-10-21T00:08:47.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33838/0 (socket says 172.21.15.41:33838) 2021-10-21T00:08:47.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 -- 172.21.15.41:0/2321756819 learned_addr learned my addr 172.21.15.41:0/2321756819 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:47.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f76667fc700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7668062f70 0x7f76681552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f76677fe700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76680b3a20 0x7f7668155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 -- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76680b3a20 msgr2=0x7f7668155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76680b3a20 0x7f7668155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 -- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7668062f70 msgr2=0x7f76681552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7668062f70 0x7f76681552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 -- 172.21.15.41:0/2321756819 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660009470 con 0x7f7668062330 2021-10-21T00:08:47.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7666ffd700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f7658000ed0 tx=0x7f7658007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76580070d0 con 0x7f7668062330 2021-10-21T00:08:47.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658007230 con 0x7f7668062330 2021-10-21T00:08:47.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680ae890 con 0x7f7668062330 2021-10-21T00:08:47.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7658005610 con 0x7f7668062330 2021-10-21T00:08:47.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76680af570 con 0x7f7668062330 2021-10-21T00:08:47.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.306+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7668146d00 con 0x7f7668062330 2021-10-21T00:08:47.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.310+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f765801a060 con 0x7f7668062330 2021-10-21T00:08:47.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.310+0000 7f7657fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 0x7f7644055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.310+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f765806b130 con 0x7f7668062330 2021-10-21T00:08:47.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.310+0000 7f76667fc700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 0x7f7644055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.310+0000 7f76667fc700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 0x7f7644055ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f765c00b000 tx=0x7f765c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.318+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7658042290 con 0x7f7668062330 2021-10-21T00:08:47.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.446+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7668155fc0 con 0x7f7668062330 2021-10-21T00:08:47.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.446+0000 7f7657fff700 1 -- 172.21.15.41:0/2321756819 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v69) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7658018020 con 0x7f7668062330 2021-10-21T00:08:47.455 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:08:47.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 msgr2=0x7f7644055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 0x7f7644055ad0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f765c00b000 tx=0x7f765c006df0).stop 2021-10-21T00:08:47.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 msgr2=0x7f76681444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f7658000ed0 tx=0x7f7658007ac0).stop 2021-10-21T00:08:47.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 shutdown_connections 2021-10-21T00:08:47.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7644053610 0x7f7644055ad0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76680b3a20 0x7f7668155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7668062f70 0x7f76681552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 --2- 172.21.15.41:0/2321756819 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7668062330 0x7f76681444b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 >> 172.21.15.41:0/2321756819 conn(0x7f76680b9080 msgr2=0x7f7668141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 shutdown_connections 2021-10-21T00:08:47.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.450+0000 7f7667fff700 1 -- 172.21.15.41:0/2321756819 wait complete. 2021-10-21T00:08:47.467 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:08:47.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 Processor -- start 2021-10-21T00:08:47.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 -- start start 2021-10-21T00:08:47.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 0x7f7e9813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7e980af700 0x7f7e98142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980adf10 con 0x7f7e980af700 2021-10-21T00:08:47.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9813f710 con 0x7f7e980b5f70 2021-10-21T00:08:47.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9e29d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980b6350 con 0x7f7e9806a190 2021-10-21T00:08:47.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7e980af700 0x7f7e98142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7e980af700 0x7f7e98142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33848/0 (socket says 172.21.15.41:33848) 2021-10-21T00:08:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 -- 172.21.15.41:0/378133881 learned_addr learned my addr 172.21.15.41:0/378133881 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9d29b700 1 --2- 172.21.15.41:0/378133881 >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 0x7f7e9813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9ca9a700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 -- 172.21.15.41:0/378133881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 msgr2=0x7f7e98140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 -- 172.21.15.41:0/378133881 >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 msgr2=0x7f7e9813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/378133881 >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 0x7f7e9813fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 -- 172.21.15.41:0/378133881 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98140520 con 0x7f7e980af700 2021-10-21T00:08:47.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9d29b700 1 --2- 172.21.15.41:0/378133881 >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 0x7f7e9813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:47.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.570+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980af700 0x7f7e98142bd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f7e9805cfe0 tx=0x7f7e90009290).ready entity=mon.0 client_cookie=51fb147fae12860b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e8ffff700 1 -- 172.21.15.41:0/378133881 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9000b830 con 0x7f7e980af700 2021-10-21T00:08:47.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e8ffff700 1 -- 172.21.15.41:0/378133881 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9000b990 con 0x7f7e980af700 2021-10-21T00:08:47.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e8ffff700 1 -- 172.21.15.41:0/378133881 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9000bb00 con 0x7f7e980af700 2021-10-21T00:08:47.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- 172.21.15.41:0/378133881 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980af700 msgr2=0x7f7e98142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980af700 0x7f7e98142bd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f7e9805cfe0 tx=0x7f7e90009290).stop 2021-10-21T00:08:47.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- 172.21.15.41:0/378133881 shutdown_connections 2021-10-21T00:08:47.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980af700 0x7f7e98142bd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/378133881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/378133881 >> v2:172.21.15.62:3300/0 conn(0x7f7e980b5f70 0x7f7e9813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- 172.21.15.41:0/378133881 >> 172.21.15.41:0/378133881 conn(0x7f7e980639f0 msgr2=0x7f7e980b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- 172.21.15.41:0/378133881 shutdown_connections 2021-10-21T00:08:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- 172.21.15.41:0/378133881 wait complete. 2021-10-21T00:08:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 Processor -- start 2021-10-21T00:08:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.574+0000 7f7e9e29d700 1 -- start start 2021-10-21T00:08:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e980af700 0x7f7e98064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 0x7f7e9813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98141310 con 0x7f7e980b5f70 2021-10-21T00:08:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98066b30 con 0x7f7e980af700 2021-10-21T00:08:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98065520 con 0x7f7e9806a190 2021-10-21T00:08:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9d29b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9d29b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52350/0 (socket says 172.21.15.41:52350) 2021-10-21T00:08:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 0x7f7e9813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9d29b700 1 -- 172.21.15.41:0/494475365 learned_addr learned my addr 172.21.15.41:0/494475365 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9ca9a700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e980af700 0x7f7e98064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 -- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 msgr2=0x7f7e98140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 -- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e980af700 msgr2=0x7f7e98064cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e980af700 0x7f7e98064cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 -- 172.21.15.41:0/494475365 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009530 con 0x7f7e980b5f70 2021-10-21T00:08:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9d29b700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:47.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9da9c700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 0x7f7e9813dc20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f7e9805cfe0 tx=0x7f7e90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9000b830 con 0x7f7e980b5f70 2021-10-21T00:08:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e900205d0 con 0x7f7e980b5f70 2021-10-21T00:08:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980651c0 con 0x7f7e980b5f70 2021-10-21T00:08:47.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e90020930 con 0x7f7e980b5f70 2021-10-21T00:08:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e98066f30 con 0x7f7e980b5f70 2021-10-21T00:08:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.578+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980678a0 con 0x7f7e980b5f70 2021-10-21T00:08:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.582+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e9000f070 con 0x7f7e980b5f70 2021-10-21T00:08:47.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.582+0000 7f7e8e7fc700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 0x7f7e800559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.582+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e9006c320 con 0x7f7e980b5f70 2021-10-21T00:08:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.582+0000 7f7e9d29b700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 0x7f7e800559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.582+0000 7f7e9d29b700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 0x7f7e800559b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7e94008000 tx=0x7f7e94008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.586+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e90043480 con 0x7f7e980b5f70 2021-10-21T00:08:47.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.714+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e98057350 con 0x7f7e980b5f70 2021-10-21T00:08:47.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.714+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/494475365 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e90015020 con 0x7f7e980b5f70 2021-10-21T00:08:47.721 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:47.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 msgr2=0x7f7e800559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 0x7f7e800559b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7e94008000 tx=0x7f7e94008040).stop 2021-10-21T00:08:47.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 msgr2=0x7f7e9813dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 0x7f7e9813dc20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f7e9805cfe0 tx=0x7f7e90016000).stop 2021-10-21T00:08:47.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 shutdown_connections 2021-10-21T00:08:47.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800534f0 0x7f7e800559b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7e980b5f70 0x7f7e9813dc20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e980af700 0x7f7e98064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 --2- 172.21.15.41:0/494475365 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e9806a190 0x7f7e98140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 >> 172.21.15.41:0/494475365 conn(0x7f7e980639f0 msgr2=0x7f7e980b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 shutdown_connections 2021-10-21T00:08:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.718+0000 7f7e9e29d700 1 -- 172.21.15.41:0/494475365 wait complete. 2021-10-21T00:08:47.733 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:08:47.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.838+0000 7ff308d05700 1 Processor -- start 2021-10-21T00:08:47.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.838+0000 7ff308d05700 1 -- start start 2021-10-21T00:08:47.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff3040addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff304060bf0 con 0x7ff30405c6f0 2021-10-21T00:08:47.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30405cad0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304060950 con 0x7ff3040b08f0 2021-10-21T00:08:47.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff30405c6f0 0x7ff3040ad6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59862/0 (socket says 172.21.15.41:59862) 2021-10-21T00:08:47.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30259c700 1 -- 172.21.15.41:0/3705634258 learned_addr learned my addr 172.21.15.41:0/3705634258 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:47.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff301d9b700 1 --2- 172.21.15.41:0/3705634258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff3040addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232811366 0 0) 0x7ff304060bf0 con 0x7ff30405c6f0 2021-10-21T00:08:47.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2e4003260 con 0x7ff30405c6f0 2021-10-21T00:08:47.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176529406 0 0) 0x7ff30405cad0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff304060bf0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff301d9b700 1 -- 172.21.15.41:0/3705634258 >> v1:172.21.15.62:6789/0 conn(0x7ff3040ae2a0 legacy=0x7ff304140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff301d9b700 1 -- 172.21.15.41:0/3705634258 >> v1:172.21.15.41:6789/0 conn(0x7ff30405c6f0 legacy=0x7ff3040ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223862813 0 0) 0x7ff2e4003260 con 0x7ff30405c6f0 2021-10-21T00:08:47.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff301d9b700 1 -- 172.21.15.41:0/3705634258 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304143120 con 0x7ff3040b08f0 2021-10-21T00:08:47.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff301d9b700 1 --2- 172.21.15.41:0/3705634258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff3040addb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff2f4001110 tx=0x7ff2ec006df0).ready entity=mon.2 client_cookie=76014bbcc6239ea server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f4001660 con 0x7ff3040b08f0 2021-10-21T00:08:47.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec000e90 con 0x7ff3040b08f0 2021-10-21T00:08:47.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff30159a700 1 -- 172.21.15.41:0/3705634258 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec012460 con 0x7ff3040b08f0 2021-10-21T00:08:47.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- 172.21.15.41:0/3705634258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 msgr2=0x7ff3040addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 --2- 172.21.15.41:0/3705634258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff3040addb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff2f4001110 tx=0x7ff2ec006df0).stop 2021-10-21T00:08:47.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- 172.21.15.41:0/3705634258 shutdown_connections 2021-10-21T00:08:47.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 --2- 172.21.15.41:0/3705634258 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff3040addb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- 172.21.15.41:0/3705634258 >> 172.21.15.41:0/3705634258 conn(0x7ff3040b2380 msgr2=0x7ff30405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- 172.21.15.41:0/3705634258 shutdown_connections 2021-10-21T00:08:47.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 -- 172.21.15.41:0/3705634258 wait complete. 2021-10-21T00:08:47.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.842+0000 7ff308d05700 1 Processor -- start 2021-10-21T00:08:47.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- start start 2021-10-21T00:08:47.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff30405c6f0 0x7ff30409a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff304097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304133ee0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040aafe0 con 0x7ff30405c6f0 2021-10-21T00:08:47.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040ab280 con 0x7ff3040b08f0 2021-10-21T00:08:47.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33868/0 (socket says 172.21.15.41:33868) 2021-10-21T00:08:47.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 -- 172.21.15.41:0/2451104215 learned_addr learned my addr 172.21.15.41:0/2451104215 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:47.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff30259c700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff30405c6f0 0x7ff30409a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff302d9d700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff304097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 -- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 msgr2=0x7ff304097de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff304097de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 -- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff30405c6f0 msgr2=0x7ff30409a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff30405c6f0 0x7ff30409a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 -- 172.21.15.41:0/2451104215 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec00b180 con 0x7ff3040ae2a0 2021-10-21T00:08:47.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff301d9b700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff2f4001110 tx=0x7ff2ec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec016070 con 0x7ff3040ae2a0 2021-10-21T00:08:47.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00db50 con 0x7ff3040ae2a0 2021-10-21T00:08:47.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff304133b60 con 0x7ff3040ae2a0 2021-10-21T00:08:47.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec012460 con 0x7ff3040ae2a0 2021-10-21T00:08:47.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff304062da0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.846+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3040b0e90 con 0x7ff3040ae2a0 2021-10-21T00:08:47.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.850+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2ec00f030 con 0x7ff3040ae2a0 2021-10-21T00:08:47.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.850+0000 7ff2fb7fe700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 0x7ff2e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:47.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.850+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2ec06c210 con 0x7ff3040ae2a0 2021-10-21T00:08:47.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.850+0000 7ff30259c700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 0x7ff2e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:47.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.850+0000 7ff30259c700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 0x7ff2e8055a40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff2f4011000 tx=0x7ff2f4000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:47.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.854+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2ec043370 con 0x7ff3040ae2a0 2021-10-21T00:08:47.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.982+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff30405ce40 con 0x7ff3040ae2a0 2021-10-21T00:08:47.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.982+0000 7ff2fb7fe700 1 -- 172.21.15.41:0/2451104215 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff2ec0220a0 con 0x7ff3040ae2a0 2021-10-21T00:08:47.990 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:47.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 msgr2=0x7ff2e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 0x7ff2e8055a40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ff2f4011000 tx=0x7ff2f4000bc0).stop 2021-10-21T00:08:47.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 msgr2=0x7ff304062690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:47.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff2f4001110 tx=0x7ff2ec014000).stop 2021-10-21T00:08:47.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 shutdown_connections 2021-10-21T00:08:47.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2e8053580 0x7ff2e8055a40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3040b08f0 0x7ff304097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3040ae2a0 0x7ff304062690 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 --2- 172.21.15.41:0/2451104215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff30405c6f0 0x7ff30409a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:47.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 >> 172.21.15.41:0/2451104215 conn(0x7ff3040b2380 msgr2=0x7ff3040b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:47.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 shutdown_connections 2021-10-21T00:08:47.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:47.986+0000 7ff308d05700 1 -- 172.21.15.41:0/2451104215 wait complete. 2021-10-21T00:08:48.007 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:08:48.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 Processor -- start 2021-10-21T00:08:48.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 -- start start 2021-10-21T00:08:48.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efe78149440 0x7efe7814b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780af000 con 0x7efe780ae900 2021-10-21T00:08:48.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7805cad0 con 0x7efe7805c6f0 2021-10-21T00:08:48.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe80100700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe78144c40 con 0x7efe78149440 2021-10-21T00:08:48.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe7d69b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7efe780ae900 0x7efe78144530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59880/0 (socket says 172.21.15.41:59880) 2021-10-21T00:08:48.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe7d69b700 1 -- 172.21.15.41:0/28808540 learned_addr learned my addr 172.21.15.41:0/28808540 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:48.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.106+0000 7efe7e69d700 1 --2- 172.21.15.41:0/28808540 >> v2:172.21.15.62:3300/0 conn(0x7efe78149440 0x7efe7814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676761444 0 0) 0x7efe780af000 con 0x7efe780ae900 2021-10-21T00:08:48.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe60003260 con 0x7efe780ae900 2021-10-21T00:08:48.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7e69d700 1 -- 172.21.15.41:0/28808540 >> v1:172.21.15.62:6789/0 conn(0x7efe7805c6f0 legacy=0x7efe78143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7e69d700 1 -- 172.21.15.41:0/28808540 >> v1:172.21.15.41:6789/0 conn(0x7efe780ae900 legacy=0x7efe78144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1885167942 0 0) 0x7efe60003260 con 0x7efe780ae900 2021-10-21T00:08:48.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7e69d700 1 -- 172.21.15.41:0/28808540 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78067a80 con 0x7efe78149440 2021-10-21T00:08:48.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7e69d700 1 --2- 172.21.15.41:0/28808540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe78149440 0x7efe7814b830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7efe700032f0 tx=0x7efe700091d0).ready entity=mon.1 client_cookie=509c43edc3efc615 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7000b6c0 con 0x7efe78149440 2021-10-21T00:08:48.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000b820 con 0x7efe78149440 2021-10-21T00:08:48.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe7ce9a700 1 -- 172.21.15.41:0/28808540 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7000b990 con 0x7efe78149440 2021-10-21T00:08:48.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 -- 172.21.15.41:0/28808540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe78149440 msgr2=0x7efe7814b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 --2- 172.21.15.41:0/28808540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe78149440 0x7efe7814b830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7efe700032f0 tx=0x7efe700091d0).stop 2021-10-21T00:08:48.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 -- 172.21.15.41:0/28808540 shutdown_connections 2021-10-21T00:08:48.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 --2- 172.21.15.41:0/28808540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe78149440 0x7efe7814b830 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 -- 172.21.15.41:0/28808540 >> 172.21.15.41:0/28808540 conn(0x7efe78063210 msgr2=0x7efe7805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:48.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 -- 172.21.15.41:0/28808540 shutdown_connections 2021-10-21T00:08:48.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 -- 172.21.15.41:0/28808540 wait complete. 2021-10-21T00:08:48.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.110+0000 7efe80100700 1 Processor -- start 2021-10-21T00:08:48.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- start start 2021-10-21T00:08:48.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7805c6f0 0x7efe780b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe780ae900 0x7efe78145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78065080 con 0x7efe78149440 2021-10-21T00:08:48.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe78066120 con 0x7efe7805c6f0 2021-10-21T00:08:48.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780652b0 con 0x7efe780ae900 2021-10-21T00:08:48.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33884/0 (socket says 172.21.15.41:33884) 2021-10-21T00:08:48.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7d69b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe780ae900 0x7efe78145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 -- 172.21.15.41:0/1368930329 learned_addr learned my addr 172.21.15.41:0/1368930329 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:48.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7de9c700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7805c6f0 0x7efe780b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 -- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe780ae900 msgr2=0x7efe78145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe780ae900 0x7efe78145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 -- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7805c6f0 msgr2=0x7efe780b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7805c6f0 0x7efe780b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 -- 172.21.15.41:0/1368930329 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70009470 con 0x7efe78149440 2021-10-21T00:08:48.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe7e69d700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7efe700032f0 tx=0x7efe70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7000b6c0 con 0x7efe78149440 2021-10-21T00:08:48.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70021630 con 0x7efe78149440 2021-10-21T00:08:48.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe78066380 con 0x7efe78149440 2021-10-21T00:08:48.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe70021990 con 0x7efe78149440 2021-10-21T00:08:48.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.114+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe78143010 con 0x7efe78149440 2021-10-21T00:08:48.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe780af230 con 0x7efe78149440 2021-10-21T00:08:48.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe70027020 con 0x7efe78149440 2021-10-21T00:08:48.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe66ffd700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe7006cbd0 con 0x7efe78149440 2021-10-21T00:08:48.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe7de9c700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.118+0000 7efe7de9c700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 0x7efe58055b60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7efe6800d000 tx=0x7efe68007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.122+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe70043d30 con 0x7efe78149440 2021-10-21T00:08:48.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.246+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe78067230 con 0x7efe78149440 2021-10-21T00:08:48.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe66ffd700 1 -- 172.21.15.41:0/1368930329 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+10 (secure 0 0 0) 0x7efe70015020 con 0x7efe78149440 2021-10-21T00:08:48.254 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:48.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 msgr2=0x7efe58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 0x7efe58055b60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7efe6800d000 tx=0x7efe68007b90).stop 2021-10-21T00:08:48.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 msgr2=0x7efe78145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7efe700032f0 tx=0x7efe70016000).stop 2021-10-21T00:08:48.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 shutdown_connections 2021-10-21T00:08:48.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe580536a0 0x7efe58055b60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe78149440 0x7efe78145d10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe780ae900 0x7efe78145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 --2- 172.21.15.41:0/1368930329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7805c6f0 0x7efe780b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 >> 172.21.15.41:0/1368930329 conn(0x7efe78063210 msgr2=0x7efe780b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:48.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 shutdown_connections 2021-10-21T00:08:48.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.250+0000 7efe80100700 1 -- 172.21.15.41:0/1368930329 wait complete. 2021-10-21T00:08:48.267 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:08:48.267 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:48.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 Processor -- start 2021-10-21T00:08:48.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 -- start start 2021-10-21T00:08:48.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3b7005bfe0 0x7f3b701461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70067a00 0x7f3b701466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7005c3c0 con 0x7f3b70146ba0 2021-10-21T00:08:48.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b700b1920 con 0x7f3b7005bfe0 2021-10-21T00:08:48.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b75118700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700b27a0 con 0x7f3b70067a00 2021-10-21T00:08:48.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b6ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3b7005bfe0 0x7f3b701461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b6ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3b7005bfe0 0x7f3b701461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33888/0 (socket says 172.21.15.41:33888) 2021-10-21T00:08:48.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.362+0000 7f3b6ffff700 1 -- 172.21.15.41:0/78877885 learned_addr learned my addr 172.21.15.41:0/78877885 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:48.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6f7fe700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70067a00 0x7f3b701466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6ffff700 1 -- 172.21.15.41:0/78877885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70067a00 msgr2=0x7f3b701466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:48.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6ffff700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70067a00 0x7f3b701466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6ffff700 1 -- 172.21.15.41:0/78877885 >> v1:172.21.15.62:6789/0 conn(0x7f3b70146ba0 legacy=0x7f3b7005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6ffff700 1 -- 172.21.15.41:0/78877885 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700b2a40 con 0x7f3b7005bfe0 2021-10-21T00:08:48.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6ffff700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b701461c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f3b60002f70 tx=0x7f3b60006e50).ready entity=mon.0 client_cookie=b51b0382ac9dd3d4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6effd700 1 -- 172.21.15.41:0/78877885 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6000d5c0 con 0x7f3b7005bfe0 2021-10-21T00:08:48.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6effd700 1 -- 172.21.15.41:0/78877885 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60000e90 con 0x7f3b7005bfe0 2021-10-21T00:08:48.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b6effd700 1 -- 172.21.15.41:0/78877885 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6000d950 con 0x7f3b7005bfe0 2021-10-21T00:08:48.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- 172.21.15.41:0/78877885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 msgr2=0x7f3b701461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b701461c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f3b60002f70 tx=0x7f3b60006e50).stop 2021-10-21T00:08:48.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- 172.21.15.41:0/78877885 shutdown_connections 2021-10-21T00:08:48.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70067a00 0x7f3b701466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 --2- 172.21.15.41:0/78877885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b701461c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- 172.21.15.41:0/78877885 >> 172.21.15.41:0/78877885 conn(0x7f3b700637b0 msgr2=0x7f3b70063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:48.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- 172.21.15.41:0/78877885 shutdown_connections 2021-10-21T00:08:48.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- 172.21.15.41:0/78877885 wait complete. 2021-10-21T00:08:48.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 Processor -- start 2021-10-21T00:08:48.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.366+0000 7f3b75118700 1 -- start start 2021-10-21T00:08:48.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70067a00 0x7f3b70065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 0x7f3b7013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70156000 con 0x7f3b7005bfe0 2021-10-21T00:08:48.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700aed00 con 0x7f3b70067a00 2021-10-21T00:08:48.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70113510 con 0x7f3b70146ba0 2021-10-21T00:08:48.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33894/0 (socket says 172.21.15.41:33894) 2021-10-21T00:08:48.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 -- 172.21.15.41:0/2048446981 learned_addr learned my addr 172.21.15.41:0/2048446981 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:48.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6f7fe700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70067a00 0x7f3b70065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b74917700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 0x7f3b7013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 -- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 msgr2=0x7f3b7013ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 0x7f3b7013ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 -- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70067a00 msgr2=0x7f3b70065f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70067a00 0x7f3b70065f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 -- 172.21.15.41:0/2048446981 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6000b1e0 con 0x7f3b7005bfe0 2021-10-21T00:08:48.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b74917700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 0x7f3b7013ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:48.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6ffff700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f3b60002f70 tx=0x7f3b60014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b60016070 con 0x7f3b7005bfe0 2021-10-21T00:08:48.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6000de00 con 0x7f3b7005bfe0 2021-10-21T00:08:48.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70113770 con 0x7f3b7005bfe0 2021-10-21T00:08:48.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b6001e450 con 0x7f3b7005bfe0 2021-10-21T00:08:48.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b70066450 con 0x7f3b7005bfe0 2021-10-21T00:08:48.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b700b1480 con 0x7f3b7005bfe0 2021-10-21T00:08:48.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b60025030 con 0x7f3b7005bfe0 2021-10-21T00:08:48.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 0x7f3b500559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:48.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.370+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b6006ca50 con 0x7f3b7005bfe0 2021-10-21T00:08:48.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.374+0000 7f3b6f7fe700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 0x7f3b500559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:48.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.374+0000 7f3b6f7fe700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 0x7f3b500559e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3b6400b000 tx=0x7f3b64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:48.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.382+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b60043bb0 con 0x7f3b7005bfe0 2021-10-21T00:08:48.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.546+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b70057350 con 0x7f3b7005bfe0 2021-10-21T00:08:48.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.546+0000 7f3b6d7fa700 1 -- 172.21.15.41:0/2048446981 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f3b60023090 con 0x7f3b7005bfe0 2021-10-21T00:08:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:48.553 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:48.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 msgr2=0x7f3b500559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 0x7f3b500559e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3b6400b000 tx=0x7f3b64008040).stop 2021-10-21T00:08:48.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 msgr2=0x7f3b700b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:48.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f3b60002f70 tx=0x7f3b60014000).stop 2021-10-21T00:08:48.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 shutdown_connections 2021-10-21T00:08:48.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b50053520 0x7f3b500559e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b70146ba0 0x7f3b7013ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b70067a00 0x7f3b70065f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 --2- 172.21.15.41:0/2048446981 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3b7005bfe0 0x7f3b700b0060 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:48.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 >> 172.21.15.41:0/2048446981 conn(0x7f3b700637b0 msgr2=0x7f3b701406c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:48.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 shutdown_connections 2021-10-21T00:08:48.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:48.550+0000 7f3b75118700 1 -- 172.21.15.41:0/2048446981 wait complete. 2021-10-21T00:08:48.558 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:48.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:43.702897+0000', 'modified': '2021-10-21T00:08:44.705473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6270': {'gid': 6270, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/2873838223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 2873838223}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 2873838223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:08:48.769 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:08:48.769 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:08:48.888 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6270,"want_state":"up:active","state":"up:active","rank_uptime":5.1706912369999998,"mdsmap_epoch":33,"osdmap_epoch":69,"osdmap_epoch_barrier":68,"uptime":9.3314451290000004} 2021-10-21T00:08:48.889 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6270, "mdsmap_epoch": 33, "osdmap_epoch": 69, "osdmap_epoch_barrier": 68, "rank_uptime": 5.170691237, "state": "up:active", "uptime": 9.331445129, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:08:48.890 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:08:48.891 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:08:48.891 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:08:48.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:48.893 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:48.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:08:48.960 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:48.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:48.971 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:48.972 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:48.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:48.974 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:08:48.982 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:08:48.983 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:48.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:08:49.003 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:49.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:49.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:08:49.051+0000 7ff3b44a9080 -1 init, newargv = 0x56156160e770 newargc=9 2021-10-21T00:08:49.061 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14473]: starting ceph client 2021-10-21T00:08:49.062 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:49.063 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:49.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:49.064 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:08:49.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14473]: starting fuse 2021-10-21T00:08:49.072 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:08:49.073 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:08:49.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:49.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:08:49.074 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:08:49.075 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:08:49.075 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:08:49.076 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:08:49.076 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:49.077 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:08:49.077 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:08:49.077 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:08:49.078 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:49.078 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:08:49.079 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:08:49.079 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:08:49.079 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:08:49.080 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:49.080 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:08:49.081 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:08:49.082 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:08:49.082 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:08:49.082 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:08:49.083 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:49.083 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:08:49.084 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:08:49.124 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14473.asok 2021-10-21T00:08:49.129 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14473.asok 2021-10-21T00:08:49.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:49.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14473.asok status 2021-10-21T00:08:49.263 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:08:49.264 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:08:49.264 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:08:49.264 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:08:49.265 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:08:49.265 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:08:49.265 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:08:49.265 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14473", 2021-10-21T00:08:49.266 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:08:49.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:49.266 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:08:49.266 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:08:49.267 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 6441, 2021-10-21T00:08:49.267 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:08:49.267 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:08:49.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:08:49.267 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 6441 2021-10-21T00:08:49.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:49.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:08:49.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:08:49.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:08:49.269 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3233948456 2021-10-21T00:08:49.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:08:49.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:49.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:08:49.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:08:49.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:08:49.270 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3233948456 2021-10-21T00:08:49.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:08:49.271 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.6441 172.21.15.71:0/3233948456", 2021-10-21T00:08:49.271 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/3233948456", 2021-10-21T00:08:49.271 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:08:49.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 33, 2021-10-21T00:08:49.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 69, 2021-10-21T00:08:49.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:08:49.272 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:08:49.273 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:08:49.273 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:08:49.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:49.275 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:49.275 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:49.283 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:08:49.284 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:49.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:49.285 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:49.304 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:08:49.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 Processor -- start 2021-10-21T00:08:49.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- start start 2021-10-21T00:08:49.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ab80b9c70 0x7f9ab8143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8142bc0 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80ba050 con 0x7f9ab81418f0 2021-10-21T00:08:49.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab81429a0 con 0x7f9ab80b9c70 2021-10-21T00:08:49.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9ab80b3bc0 0x7f9ab8143510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59904/0 (socket says 172.21.15.41:59904) 2021-10-21T00:08:49.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abcd95700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9ab80b9c70 0x7f9ab8143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab7fff700 1 -- 172.21.15.41:0/2286875080 learned_addr learned my addr 172.21.15.41:0/2286875080 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:49.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab77fe700 1 -- 172.21.15.41:0/2286875080 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123431192 0 0) 0x7f9ab8142bc0 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab77fe700 1 -- 172.21.15.41:0/2286875080 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa4003260 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abcd95700 1 -- 172.21.15.41:0/2286875080 >> v1:172.21.15.62:6789/0 conn(0x7f9ab81418f0 legacy=0x7f9ab8141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abcd95700 1 -- 172.21.15.41:0/2286875080 >> v1:172.21.15.41:6789/0 conn(0x7f9ab80b3bc0 legacy=0x7f9ab8143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abcd95700 1 -- 172.21.15.41:0/2286875080 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab81463c0 con 0x7f9ab80b9c70 2021-10-21T00:08:49.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abcd95700 1 --2- 172.21.15.41:0/2286875080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b9c70 0x7f9ab8143020 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9aac001800 tx=0x7f9aa8006df0).ready entity=mon.0 client_cookie=5a07b833797efc55 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab77fe700 1 -- 172.21.15.41:0/2286875080 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aac001660 con 0x7f9ab80b9c70 2021-10-21T00:08:49.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab77fe700 1 -- 172.21.15.41:0/2286875080 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8000e90 con 0x7f9ab80b9c70 2021-10-21T00:08:49.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9ab77fe700 1 -- 172.21.15.41:0/2286875080 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aa8011400 con 0x7f9ab80b9c70 2021-10-21T00:08:49.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- 172.21.15.41:0/2286875080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b9c70 msgr2=0x7f9ab8143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 --2- 172.21.15.41:0/2286875080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b9c70 0x7f9ab8143020 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9aac001800 tx=0x7f9aa8006df0).stop 2021-10-21T00:08:49.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- 172.21.15.41:0/2286875080 shutdown_connections 2021-10-21T00:08:49.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 --2- 172.21.15.41:0/2286875080 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b9c70 0x7f9ab8143020 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.418+0000 7f9abeff9700 1 -- 172.21.15.41:0/2286875080 >> 172.21.15.41:0/2286875080 conn(0x7f9ab8062e80 msgr2=0x7f9ab80b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:49.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- 172.21.15.41:0/2286875080 shutdown_connections 2021-10-21T00:08:49.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- 172.21.15.41:0/2286875080 wait complete. 2021-10-21T00:08:49.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 Processor -- start 2021-10-21T00:08:49.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- start start 2021-10-21T00:08:49.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ab80b9c70 0x7f9ab80ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab81418f0 0x7f9ab81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81435d0 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8115540 con 0x7f9ab81418f0 2021-10-21T00:08:49.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81157e0 con 0x7f9ab80b9c70 2021-10-21T00:08:49.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33910/0 (socket says 172.21.15.41:33910) 2021-10-21T00:08:49.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ab80b9c70 0x7f9ab80ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 -- 172.21.15.41:0/187129938 learned_addr learned my addr 172.21.15.41:0/187129938 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abd596700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab81418f0 0x7f9ab81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 -- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ab80b9c70 msgr2=0x7f9ab80ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ab80b9c70 0x7f9ab80ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 -- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab81418f0 msgr2=0x7f9ab81527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab81418f0 0x7f9ab81527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 -- 172.21.15.41:0/187129938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa800b180 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abcd95700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f9aac001800 tx=0x7f9ab80b0c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aa800d9a0 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800db00 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8155560 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aa800de60 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.422+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab80aed60 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9aa801b070 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8146120 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9ab5ffb700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 0x7f9a98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9aa806c060 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9ab7fff700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 0x7f9a98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.426+0000 7f9ab7fff700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 0x7f9a98055ad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9aac00d000 tx=0x7f9aac0019e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.430+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9aa8043270 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.558+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ab8057350 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.558+0000 7f9ab5ffb700 1 -- 172.21.15.41:0/187129938 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9aa800a070 con 0x7f9ab80b3bc0 2021-10-21T00:08:49.565 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:49.565 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":69,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:08:44.706242+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:08:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 msgr2=0x7f9a98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 0x7f9a98055ad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9aac00d000 tx=0x7f9aac0019e0).stop 2021-10-21T00:08:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 msgr2=0x7f9ab8151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f9aac001800 tx=0x7f9ab80b0c80).stop 2021-10-21T00:08:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 shutdown_connections 2021-10-21T00:08:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a98053610 0x7f9a98055ad0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab81418f0 0x7f9ab81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ab80b9c70 0x7f9ab80ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 --2- 172.21.15.41:0/187129938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9ab80b3bc0 0x7f9ab8151f90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 >> 172.21.15.41:0/187129938 conn(0x7f9ab8062e80 msgr2=0x7f9ab80b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:49.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 shutdown_connections 2021-10-21T00:08:49.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.562+0000 7f9abeff9700 1 -- 172.21.15.41:0/187129938 wait complete. 2021-10-21T00:08:49.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:08:42.313703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:08:42.705186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:08:49.580 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:08:49.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 Processor -- start 2021-10-21T00:08:49.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 -- start start 2021-10-21T00:08:49.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f706c09ab50 0x7f706c099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 0x7f706c140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0b1560 con 0x7f706c0b2170 2021-10-21T00:08:49.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0b2550 con 0x7f706c09ab50 2021-10-21T00:08:49.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707188d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c09a170 con 0x7f706c0af620 2021-10-21T00:08:49.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707088b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f706c0b2170 0x7f706c13fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59918/0 (socket says 172.21.15.41:59918) 2021-10-21T00:08:49.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707088b700 1 -- 172.21.15.41:0/665865209 learned_addr learned my addr 172.21.15.41:0/665865209 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:49.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 --2- 172.21.15.41:0/665865209 >> v2:172.21.15.41:3300/0 conn(0x7f706c09ab50 0x7f706c099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707108c700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 0x7f706c140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119228439 0 0) 0x7f706c0b1560 con 0x7f706c0b2170 2021-10-21T00:08:49.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7050003260 con 0x7f706c0b2170 2021-10-21T00:08:49.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3507722246 0 0) 0x7f7050003260 con 0x7f706c0b2170 2021-10-21T00:08:49.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 -- 172.21.15.41:0/665865209 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 msgr2=0x7f706c140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:49.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 0x7f706c140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 -- 172.21.15.41:0/665865209 >> v1:172.21.15.41:6789/0 conn(0x7f706c0b2170 legacy=0x7f706c13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 -- 172.21.15.41:0/665865209 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c09a410 con 0x7f706c09ab50 2021-10-21T00:08:49.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f707108c700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 0x7f706c140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:08:49.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706bfff700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c09ab50 0x7f706c099b40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f7060001800 tx=0x7f7058006df0).ready entity=mon.0 client_cookie=321fddd74bbc1d82 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7060001660 con 0x7f706c09ab50 2021-10-21T00:08:49.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7058000e90 con 0x7f706c09ab50 2021-10-21T00:08:49.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.690+0000 7f706b7fe700 1 -- 172.21.15.41:0/665865209 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7058012460 con 0x7f706c09ab50 2021-10-21T00:08:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/665865209 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c09ab50 msgr2=0x7f706c099b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c09ab50 0x7f706c099b40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f7060001800 tx=0x7f7058006df0).stop 2021-10-21T00:08:49.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/665865209 shutdown_connections 2021-10-21T00:08:49.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c0af620 0x7f706c140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- 172.21.15.41:0/665865209 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c09ab50 0x7f706c099b40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/665865209 >> 172.21.15.41:0/665865209 conn(0x7f706c0b5700 msgr2=0x7f706c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:49.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/665865209 shutdown_connections 2021-10-21T00:08:49.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/665865209 wait complete. 2021-10-21T00:08:49.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 Processor -- start 2021-10-21T00:08:49.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- start start 2021-10-21T00:08:49.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 0x7f706c08f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c08fed0 0x7f706c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c066ef0 con 0x7f706c0af620 2021-10-21T00:08:49.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c150700 con 0x7f706c0b2170 2021-10-21T00:08:49.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c08f540 con 0x7f706c08fed0 2021-10-21T00:08:49.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33922/0 (socket says 172.21.15.41:33922) 2021-10-21T00:08:49.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 -- 172.21.15.41:0/199504542 learned_addr learned my addr 172.21.15.41:0/199504542 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:49.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707108c700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c08fed0 0x7f706c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f706bfff700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 0x7f706c08f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 -- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c08fed0 msgr2=0x7f706c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c08fed0 0x7f706c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 -- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 msgr2=0x7f706c08f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 0x7f706c08f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 -- 172.21.15.41:0/199504542 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064009470 con 0x7f706c0af620 2021-10-21T00:08:49.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f706bfff700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 0x7f706c08f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:08:49.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707088b700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f70600018c0 tx=0x7f7060001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f706000cea0 con 0x7f706c0af620 2021-10-21T00:08:49.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060007170 con 0x7f706c0af620 2021-10-21T00:08:49.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705800b180 con 0x7f706c0af620 2021-10-21T00:08:49.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7060004730 con 0x7f706c0af620 2021-10-21T00:08:49.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.694+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c064b00 con 0x7f706c0af620 2021-10-21T00:08:49.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c09a6b0 con 0x7f706c0af620 2021-10-21T00:08:49.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7060004890 con 0x7f706c0af620 2021-10-21T00:08:49.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f7069ffb700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 0x7f704c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f706006b360 con 0x7f706c0af620 2021-10-21T00:08:49.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f706bfff700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 0x7f704c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.698+0000 7f706bfff700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 0x7f704c055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7058018000 tx=0x7f7058014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.702+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70600424c0 con 0x7f706c0af620 2021-10-21T00:08:49.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.826+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f706c057350 con 0x7f706c0af620 2021-10-21T00:08:49.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.826+0000 7f7069ffb700 1 -- 172.21.15.41:0/199504542 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v69) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7060045ae0 con 0x7f706c0af620 2021-10-21T00:08:49.833 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:08:49.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 msgr2=0x7f704c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 0x7f704c055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f7058018000 tx=0x7f7058014000).stop 2021-10-21T00:08:49.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 msgr2=0x7f706c0ad610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f70600018c0 tx=0x7f7060001e50).stop 2021-10-21T00:08:49.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 shutdown_connections 2021-10-21T00:08:49.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f704c0536a0 0x7f704c055b60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f706c08fed0 0x7f706c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f706c0b2170 0x7f706c08f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 --2- 172.21.15.41:0/199504542 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f706c0af620 0x7f706c0ad610 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 >> 172.21.15.41:0/199504542 conn(0x7f706c0b5700 msgr2=0x7f706c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:49.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 shutdown_connections 2021-10-21T00:08:49.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.830+0000 7f707188d700 1 -- 172.21.15.41:0/199504542 wait complete. 2021-10-21T00:08:49.846 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:08:49.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.958+0000 7f4462fe1700 1 Processor -- start 2021-10-21T00:08:49.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.958+0000 7f4462fe1700 1 -- start start 2021-10-21T00:08:49.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c05bfe0 0x7f445c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f445c05c6b0 0x7f445c141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c05c3c0 con 0x7f445c067a00 2021-10-21T00:08:49.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0b1920 con 0x7f445c05c6b0 2021-10-21T00:08:49.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b27a0 con 0x7f445c05bfe0 2021-10-21T00:08:49.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f445c05c6b0 0x7f445c141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f445c05c6b0 0x7f445c141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33932/0 (socket says 172.21.15.41:33932) 2021-10-21T00:08:49.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 -- 172.21.15.41:0/3172163132 learned_addr learned my addr 172.21.15.41:0/3172163132 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:49.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4461fdf700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c05bfe0 0x7f445c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 -- 172.21.15.41:0/3172163132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c05bfe0 msgr2=0x7f445c1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:49.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c05bfe0 0x7f445c1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 -- 172.21.15.41:0/3172163132 >> v1:172.21.15.62:6789/0 conn(0x7f445c067a00 legacy=0x7f445c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 -- 172.21.15.41:0/3172163132 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0b2a40 con 0x7f445c05c6b0 2021-10-21T00:08:49.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f44627e0700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c141930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f44540032f0 tx=0x7f4454009290).ready entity=mon.0 client_cookie=9aa2c6de7ed3c1fa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4460fdd700 1 -- 172.21.15.41:0/3172163132 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f445400b8a0 con 0x7f445c05c6b0 2021-10-21T00:08:49.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4460fdd700 1 -- 172.21.15.41:0/3172163132 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400ba00 con 0x7f445c05c6b0 2021-10-21T00:08:49.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4460fdd700 1 -- 172.21.15.41:0/3172163132 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f445400bb70 con 0x7f445c05c6b0 2021-10-21T00:08:49.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- 172.21.15.41:0/3172163132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 msgr2=0x7f445c141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c141930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f44540032f0 tx=0x7f4454009290).stop 2021-10-21T00:08:49.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- 172.21.15.41:0/3172163132 shutdown_connections 2021-10-21T00:08:49.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c141930 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 --2- 172.21.15.41:0/3172163132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c05bfe0 0x7f445c1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- 172.21.15.41:0/3172163132 >> 172.21.15.41:0/3172163132 conn(0x7f445c0637b0 msgr2=0x7f445c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:49.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- 172.21.15.41:0/3172163132 shutdown_connections 2021-10-21T00:08:49.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.962+0000 7f4462fe1700 1 -- 172.21.15.41:0/3172163132 wait complete. 2021-10-21T00:08:49.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 Processor -- start 2021-10-21T00:08:49.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 -- start start 2021-10-21T00:08:49.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f445c05bfe0 0x7f445c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c067a00 0x7f445c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0afbd0 con 0x7f445c05c6b0 2021-10-21T00:08:49.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0afe70 con 0x7f445c05bfe0 2021-10-21T00:08:49.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4462fe1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b0110 con 0x7f445c067a00 2021-10-21T00:08:49.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f44617de700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f44617de700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33938/0 (socket says 172.21.15.41:33938) 2021-10-21T00:08:49.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f4461fdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f445c05bfe0 0x7f445c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f44617de700 1 -- 172.21.15.41:0/1882127232 learned_addr learned my addr 172.21.15.41:0/1882127232 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.966+0000 7f44627e0700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c067a00 0x7f445c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 -- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c067a00 msgr2=0x7f445c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c067a00 0x7f445c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 -- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f445c05bfe0 msgr2=0x7f445c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f445c05bfe0 0x7f445c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:49.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 -- 172.21.15.41:0/1882127232 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009530 con 0x7f445c05c6b0 2021-10-21T00:08:49.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f44617de700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f445c064620 tx=0x7f444c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444c00ccd0 con 0x7f445c05c6b0 2021-10-21T00:08:49.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00ce30 con 0x7f445c05c6b0 2021-10-21T00:08:49.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444c0125f0 con 0x7f445c05c6b0 2021-10-21T00:08:49.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c113a20 con 0x7f445c05c6b0 2021-10-21T00:08:49.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c151c50 con 0x7f445c05c6b0 2021-10-21T00:08:49.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c113bb0 con 0x7f445c05c6b0 2021-10-21T00:08:49.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.970+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f444c019030 con 0x7f445c05c6b0 2021-10-21T00:08:49.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.974+0000 7f444affd700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 0x7f443c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:49.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.974+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f444c06ac70 con 0x7f445c05c6b0 2021-10-21T00:08:49.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.974+0000 7f4461fdf700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 0x7f443c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:49.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.974+0000 7f4461fdf700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 0x7f443c055a40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f445800c000 tx=0x7f4458008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:49.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:49.982+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f444c041d30 con 0x7f445c05c6b0 2021-10-21T00:08:50.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.106+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f445c0b11e0 con 0x7f445c05c6b0 2021-10-21T00:08:50.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.106+0000 7f444affd700 1 -- 172.21.15.41:0/1882127232 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f444c045350 con 0x7f445c05c6b0 2021-10-21T00:08:50.112 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:50.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 msgr2=0x7f443c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 0x7f443c055a40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f445800c000 tx=0x7f4458008040).stop 2021-10-21T00:08:50.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 msgr2=0x7f445c152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f445c064620 tx=0x7f444c007c20).stop 2021-10-21T00:08:50.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 shutdown_connections 2021-10-21T00:08:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f443c053580 0x7f443c055a40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f445c067a00 0x7f445c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f445c05c6b0 0x7f445c152270 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 --2- 172.21.15.41:0/1882127232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f445c05bfe0 0x7f445c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 >> 172.21.15.41:0/1882127232 conn(0x7f445c0637b0 msgr2=0x7f445c1429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 shutdown_connections 2021-10-21T00:08:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.110+0000 7f4462fe1700 1 -- 172.21.15.41:0/1882127232 wait complete. 2021-10-21T00:08:50.125 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:08:50.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 Processor -- start 2021-10-21T00:08:50.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 -- start start 2021-10-21T00:08:50.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f687c0b5e90 0x7f687c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b1d10 0x7f687c0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0afb40 con 0x7f687c0b13a0 2021-10-21T00:08:50.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c0b0e00 con 0x7f687c0b5e90 2021-10-21T00:08:50.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6883105700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0af7a0 con 0x7f687c0b1d10 2021-10-21T00:08:50.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6882103700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f687c0b5e90 0x7f687c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6881902700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b1d10 0x7f687c0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6882904700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f687c0b13a0 0x7f687c142c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39774/0 (socket says 172.21.15.41:39774) 2021-10-21T00:08:50.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.226+0000 7f6882904700 1 -- 172.21.15.41:0/466653508 learned_addr learned my addr 172.21.15.41:0/466653508 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6882103700 1 -- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b1d10 msgr2=0x7f687c0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6882103700 1 --2- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b1d10 0x7f687c0ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6882103700 1 -- 172.21.15.41:0/466653508 >> v1:172.21.15.62:6789/0 conn(0x7f687c0b13a0 legacy=0x7f687c142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6882103700 1 -- 172.21.15.41:0/466653508 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0af910 con 0x7f687c0b5e90 2021-10-21T00:08:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6882103700 1 --2- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b5e90 0x7f687c0b6270 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f687c13f3d0 tx=0x7f6878006df0).ready entity=mon.1 client_cookie=389c883176f1702d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6881101700 1 -- 172.21.15.41:0/466653508 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6878014070 con 0x7f687c0b5e90 2021-10-21T00:08:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6881101700 1 -- 172.21.15.41:0/466653508 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878000e90 con 0x7f687c0b5e90 2021-10-21T00:08:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6881101700 1 -- 172.21.15.41:0/466653508 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687800fb60 con 0x7f687c0b5e90 2021-10-21T00:08:50.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 -- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b5e90 msgr2=0x7f687c0b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 --2- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b5e90 0x7f687c0b6270 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f687c13f3d0 tx=0x7f6878006df0).stop 2021-10-21T00:08:50.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 -- 172.21.15.41:0/466653508 shutdown_connections 2021-10-21T00:08:50.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 --2- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b1d10 0x7f687c0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 --2- 172.21.15.41:0/466653508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b5e90 0x7f687c0b6270 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 -- 172.21.15.41:0/466653508 >> 172.21.15.41:0/466653508 conn(0x7f687c063b80 msgr2=0x7f687c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 -- 172.21.15.41:0/466653508 shutdown_connections 2021-10-21T00:08:50.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.230+0000 7f6883105700 1 -- 172.21.15.41:0/466653508 wait complete. 2021-10-21T00:08:50.242 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 Processor -- start 2021-10-21T00:08:50.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 -- start start 2021-10-21T00:08:50.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b1d10 0x7f687c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b5e90 0x7f687c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1104f0 con 0x7f687c0b13a0 2021-10-21T00:08:50.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c066c80 con 0x7f687c0b1d10 2021-10-21T00:08:50.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6883105700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c10ead0 con 0x7f687c0b5e90 2021-10-21T00:08:50.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6881902700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b1d10 0x7f687c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33950/0 (socket says 172.21.15.41:33950) 2021-10-21T00:08:50.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 -- 172.21.15.41:0/1047447831 learned_addr learned my addr 172.21.15.41:0/1047447831 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:50.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882904700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b5e90 0x7f687c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 -- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b5e90 msgr2=0x7f687c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b5e90 0x7f687c14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 -- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b1d10 msgr2=0x7f687c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b1d10 0x7f687c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 -- 172.21.15.41:0/1047447831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687800b180 con 0x7f687c0b13a0 2021-10-21T00:08:50.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.234+0000 7f6882103700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f687c13f3d0 tx=0x7f6878016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6878010e90 con 0x7f687c0b13a0 2021-10-21T00:08:50.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878002f70 con 0x7f687c0b13a0 2021-10-21T00:08:50.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687801d640 con 0x7f687c0b13a0 2021-10-21T00:08:50.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c110250 con 0x7f687c0b13a0 2021-10-21T00:08:50.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c112730 con 0x7f687c0b13a0 2021-10-21T00:08:50.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c1428f0 con 0x7f687c0b13a0 2021-10-21T00:08:50.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f687801d7a0 con 0x7f687c0b13a0 2021-10-21T00:08:50.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 0x7f685c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f687806f9b0 con 0x7f687c0b13a0 2021-10-21T00:08:50.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.238+0000 7f6881902700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 0x7f685c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.242+0000 7f6881902700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 0x7f685c055a70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f687000b000 tx=0x7f6870006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.246+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6878046bc0 con 0x7f687c0b13a0 2021-10-21T00:08:50.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.374+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f687c057350 con 0x7f687c0b13a0 2021-10-21T00:08:50.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.374+0000 7f686f7fe700 1 -- 172.21.15.41:0/1047447831 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+10 (secure 0 0 0) 0x7f687804a1e0 con 0x7f687c0b13a0 2021-10-21T00:08:50.379 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:50.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 msgr2=0x7f685c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 0x7f685c055a70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f687000b000 tx=0x7f6870006df0).stop 2021-10-21T00:08:50.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 msgr2=0x7f687c10fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f687c13f3d0 tx=0x7f6878016000).stop 2021-10-21T00:08:50.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 shutdown_connections 2021-10-21T00:08:50.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f685c0535b0 0x7f685c055a70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f687c0b5e90 0x7f687c14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.385 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f687c0b1d10 0x7f687c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 --2- 172.21.15.41:0/1047447831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f687c0b13a0 0x7f687c10fb90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 >> 172.21.15.41:0/1047447831 conn(0x7f687c063b80 msgr2=0x7f687c0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 shutdown_connections 2021-10-21T00:08:50.386 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.378+0000 7f6883105700 1 -- 172.21.15.41:0/1047447831 wait complete. 2021-10-21T00:08:50.401 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:08:50.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 Processor -- start 2021-10-21T00:08:50.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 -- start start 2021-10-21T00:08:50.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480af620 0x7f72480ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7248067a80 0x7f7248149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480b0b50 con 0x7f72480b2170 2021-10-21T00:08:50.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480b2550 con 0x7f7248067a80 2021-10-21T00:08:50.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f724c877700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480b0d90 con 0x7f72480af620 2021-10-21T00:08:50.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7248067a80 0x7f7248149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7248067a80 0x7f7248149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33962/0 (socket says 172.21.15.41:33962) 2021-10-21T00:08:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 -- 172.21.15.41:0/281866705 learned_addr learned my addr 172.21.15.41:0/281866705 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7246ffd700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480af620 0x7f72480ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 -- 172.21.15.41:0/281866705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480af620 msgr2=0x7f72480ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:50.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480af620 0x7f72480ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 -- 172.21.15.41:0/281866705 >> v1:172.21.15.62:6789/0 conn(0x7f72480b2170 legacy=0x7f72480ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 -- 172.21.15.41:0/281866705 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480b1030 con 0x7f7248067a80 2021-10-21T00:08:50.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f7247fff700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248149320 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7240002f70 tx=0x7f7240006eb0).ready entity=mon.0 client_cookie=65aa524e0b5b6513 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f72467fc700 1 -- 172.21.15.41:0/281866705 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f724000d570 con 0x7f7248067a80 2021-10-21T00:08:50.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f72467fc700 1 -- 172.21.15.41:0/281866705 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7240000e90 con 0x7f7248067a80 2021-10-21T00:08:50.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.506+0000 7f72467fc700 1 -- 172.21.15.41:0/281866705 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f724000d900 con 0x7f7248067a80 2021-10-21T00:08:50.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- 172.21.15.41:0/281866705 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 msgr2=0x7f7248149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248149320 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7240002f70 tx=0x7f7240006eb0).stop 2021-10-21T00:08:50.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- 172.21.15.41:0/281866705 shutdown_connections 2021-10-21T00:08:50.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248149320 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- 172.21.15.41:0/281866705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480af620 0x7f72480ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- 172.21.15.41:0/281866705 >> 172.21.15.41:0/281866705 conn(0x7f72480b5700 msgr2=0x7f72480b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- 172.21.15.41:0/281866705 shutdown_connections 2021-10-21T00:08:50.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- 172.21.15.41:0/281866705 wait complete. 2021-10-21T00:08:50.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 Processor -- start 2021-10-21T00:08:50.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- start start 2021-10-21T00:08:50.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 0x7f72480ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480b2170 0x7f72480ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248148ab0 con 0x7f7248067a80 2021-10-21T00:08:50.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480aeca0 con 0x7f72480af620 2021-10-21T00:08:50.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f724c877700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7248157020 con 0x7f72480b2170 2021-10-21T00:08:50.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33964/0 (socket says 172.21.15.41:33964) 2021-10-21T00:08:50.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 -- 172.21.15.41:0/3704717893 learned_addr learned my addr 172.21.15.41:0/3704717893 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:50.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f7247fff700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480b2170 0x7f72480ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f7246ffd700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 0x7f72480ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 -- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480b2170 msgr2=0x7f72480ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480b2170 0x7f72480ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 -- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 msgr2=0x7f72480ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 0x7f72480ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 -- 172.21.15.41:0/3704717893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724000b1e0 con 0x7f7248067a80 2021-10-21T00:08:50.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f7246ffd700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 0x7f72480ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:50.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.510+0000 7f72477fe700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f72480aab80 tx=0x7f723c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f723c00ce30 con 0x7f7248067a80 2021-10-21T00:08:50.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c00f470 con 0x7f7248067a80 2021-10-21T00:08:50.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480ac610 con 0x7f7248067a80 2021-10-21T00:08:50.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f723c00f7d0 con 0x7f7248067a80 2021-10-21T00:08:50.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72481447c0 con 0x7f7248067a80 2021-10-21T00:08:50.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f723c019030 con 0x7f7248067a80 2021-10-21T00:08:50.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 0x7f7228055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72480b0b50 con 0x7f7248067a80 2021-10-21T00:08:50.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f723c06ac60 con 0x7f7248067a80 2021-10-21T00:08:50.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7246ffd700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 0x7f7228055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.514+0000 7f7246ffd700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 0x7f7228055b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f723800b000 tx=0x7f7238008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.522+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72480b0b50 con 0x7f7248067a80 2021-10-21T00:08:50.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.650+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72480b0b50 con 0x7f7248067a80 2021-10-21T00:08:50.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.650+0000 7f7244ff9700 1 -- 172.21.15.41:0/3704717893 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+10 (secure 0 0 0) 0x7f72480b0b50 con 0x7f7248067a80 2021-10-21T00:08:50.655 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:08:50.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 msgr2=0x7f7228055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 0x7f7228055b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f723800b000 tx=0x7f7238008040).stop 2021-10-21T00:08:50.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 msgr2=0x7f7248156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f72480aab80 tx=0x7f723c007c50).stop 2021-10-21T00:08:50.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 shutdown_connections 2021-10-21T00:08:50.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72280536a0 0x7f7228055b60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72480b2170 0x7f72480ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72480af620 0x7f72480ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 --2- 172.21.15.41:0/3704717893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7248067a80 0x7f7248156a30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 >> 172.21.15.41:0/3704717893 conn(0x7f72480b5700 msgr2=0x7f724805f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 shutdown_connections 2021-10-21T00:08:50.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.654+0000 7f724c877700 1 -- 172.21.15.41:0/3704717893 wait complete. 2021-10-21T00:08:50.676 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:08:50.676 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:50.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 Processor -- start 2021-10-21T00:08:50.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 -- start start 2021-10-21T00:08:50.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb77c0af620 0x7fb77c0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb77c067a80 0x7fb77c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0b0b50 con 0x7fb77c0b2170 2021-10-21T00:08:50.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0b2550 con 0x7fb77c0af620 2021-10-21T00:08:50.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb781c7e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0b0d90 con 0x7fb77c067a80 2021-10-21T00:08:50.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb77bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb77c0af620 0x7fb77c0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb780c7c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb77c0b2170 0x7fb77c0ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59974/0 (socket says 172.21.15.41:59974) 2021-10-21T00:08:50.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.774+0000 7fb780c7c700 1 -- 172.21.15.41:0/4218863378 learned_addr learned my addr 172.21.15.41:0/4218863378 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:50.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb78147d700 1 --2- 172.21.15.41:0/4218863378 >> v2:172.21.15.62:3300/0 conn(0x7fb77c067a80 0x7fb77c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77bfff700 1 -- 172.21.15.41:0/4218863378 >> v2:172.21.15.62:3300/0 conn(0x7fb77c067a80 msgr2=0x7fb77c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:50.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77bfff700 1 --2- 172.21.15.41:0/4218863378 >> v2:172.21.15.62:3300/0 conn(0x7fb77c067a80 0x7fb77c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77bfff700 1 -- 172.21.15.41:0/4218863378 >> v1:172.21.15.41:6789/0 conn(0x7fb77c0b2170 legacy=0x7fb77c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77b7fe700 1 -- 172.21.15.41:0/4218863378 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309729417 0 0) 0x7fb770001110 con 0x7fb77c0b2170 2021-10-21T00:08:50.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77bfff700 1 -- 172.21.15.41:0/4218863378 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0b1030 con 0x7fb77c0af620 2021-10-21T00:08:50.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77bfff700 1 --2- 172.21.15.41:0/4218863378 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c0ab880 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fb77c0aafa0 tx=0x7fb76c0091d0).ready entity=mon.0 client_cookie=619f5c40c449e91 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77b7fe700 1 -- 172.21.15.41:0/4218863378 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00b680 con 0x7fb77c0af620 2021-10-21T00:08:50.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77b7fe700 1 -- 172.21.15.41:0/4218863378 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00b7e0 con 0x7fb77c0af620 2021-10-21T00:08:50.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb77b7fe700 1 -- 172.21.15.41:0/4218863378 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00b950 con 0x7fb77c0af620 2021-10-21T00:08:50.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- 172.21.15.41:0/4218863378 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 msgr2=0x7fb77c0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- 172.21.15.41:0/4218863378 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c0ab880 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fb77c0aafa0 tx=0x7fb76c0091d0).stop 2021-10-21T00:08:50.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- 172.21.15.41:0/4218863378 shutdown_connections 2021-10-21T00:08:50.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- 172.21.15.41:0/4218863378 >> v2:172.21.15.62:3300/0 conn(0x7fb77c067a80 0x7fb77c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- 172.21.15.41:0/4218863378 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c0ab880 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- 172.21.15.41:0/4218863378 >> 172.21.15.41:0/4218863378 conn(0x7fb77c0b5700 msgr2=0x7fb77c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- 172.21.15.41:0/4218863378 shutdown_connections 2021-10-21T00:08:50.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- 172.21.15.41:0/4218863378 wait complete. 2021-10-21T00:08:50.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 Processor -- start 2021-10-21T00:08:50.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- start start 2021-10-21T00:08:50.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c067a80 0x7fb77c1447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb77c0b2170 0x7fb77c0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c159be0 con 0x7fb77c0af620 2021-10-21T00:08:50.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c159e80 con 0x7fb77c067a80 2021-10-21T00:08:50.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.778+0000 7fb781c7e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c15a120 con 0x7fb77c0b2170 2021-10-21T00:08:50.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33980/0 (socket says 172.21.15.41:33980) 2021-10-21T00:08:50.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 -- 172.21.15.41:0/1591884541 learned_addr learned my addr 172.21.15.41:0/1591884541 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:50.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb78147d700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb77c0b2170 0x7fb77c0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb780c7c700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c067a80 0x7fb77c1447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 -- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb77c0b2170 msgr2=0x7fb77c0ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb77c0b2170 0x7fb77c0ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 -- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c067a80 msgr2=0x7fb77c1447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c067a80 0x7fb77c1447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 -- 172.21.15.41:0/1591884541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009470 con 0x7fb77c0af620 2021-10-21T00:08:50.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb77bfff700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fb77c0aafa0 tx=0x7fb76c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00b680 con 0x7fb77c0af620 2021-10-21T00:08:50.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c021630 con 0x7fb77c0af620 2021-10-21T00:08:50.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c159860 con 0x7fb77c0af620 2021-10-21T00:08:50.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c021990 con 0x7fb77c0af620 2021-10-21T00:08:50.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c0aca90 con 0x7fb77c0af620 2021-10-21T00:08:50.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.782+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c15a2e0 con 0x7fb77c0af620 2021-10-21T00:08:50.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.786+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb76c027020 con 0x7fb77c0af620 2021-10-21T00:08:50.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.786+0000 7fb779ffb700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 0x7fb75c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:50.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.786+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb76c06cd80 con 0x7fb77c0af620 2021-10-21T00:08:50.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.786+0000 7fb780c7c700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 0x7fb75c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:50.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.786+0000 7fb780c7c700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 0x7fb75c055b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770007c00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:50.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.790+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb76c043ee0 con 0x7fb77c0af620 2021-10-21T00:08:50.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.954+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb77c159a50 con 0x7fb77c0af620 2021-10-21T00:08:50.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.954+0000 7fb779ffb700 1 -- 172.21.15.41:0/1591884541 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb76c06e020 con 0x7fb77c0af620 2021-10-21T00:08:50.961 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:50.961 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:50.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 msgr2=0x7fb75c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 0x7fb75c055b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770007c00).stop 2021-10-21T00:08:50.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 msgr2=0x7fb77c099ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:50.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fb77c0aafa0 tx=0x7fb76c016000).stop 2021-10-21T00:08:50.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 shutdown_connections 2021-10-21T00:08:50.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb75c0536d0 0x7fb75c055b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb77c0b2170 0x7fb77c0ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb77c0af620 0x7fb77c099ec0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 --2- 172.21.15.41:0/1591884541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c067a80 0x7fb77c1447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:50.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 >> 172.21.15.41:0/1591884541 conn(0x7fb77c0b5700 msgr2=0x7fb77c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:50.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 shutdown_connections 2021-10-21T00:08:50.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:50.958+0000 7fb781c7e700 1 -- 172.21.15.41:0/1591884541 wait complete. 2021-10-21T00:08:50.967 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:51.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:43.702897+0000', 'modified': '2021-10-21T00:08:44.705473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6270': {'gid': 6270, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/2873838223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 2873838223}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 2873838223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:08:51.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:08:51.177 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:08:51.296 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6270,"want_state":"up:active","state":"up:active","rank_uptime":7.5788815459999999,"mdsmap_epoch":33,"osdmap_epoch":69,"osdmap_epoch_barrier":68,"uptime":11.739631881999999} 2021-10-21T00:08:51.297 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6270, "mdsmap_epoch": 33, "osdmap_epoch": 69, "osdmap_epoch_barrier": 68, "rank_uptime": 7.578881546, "state": "up:active", "uptime": 11.739631882, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:08:51.297 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:08:51.297 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:08:51.298 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:08:51.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:51.299 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:51.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:08:51.364 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:51.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:51.376 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:51.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:51.377 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:08:51.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:08:51.429 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:51.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:08:51.448 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:51.449 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:51.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:08:51.506+0000 7f7650bf0080 -1 init, newargv = 0x55878bd2f870 newargc=9 2021-10-21T00:08:51.510 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[13959]: starting ceph client 2021-10-21T00:08:51.511 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:51.511 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:51.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:51.512 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:08:51.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[13959]: starting fuse 2021-10-21T00:08:52.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:08:52.639 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:08:52.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:08:52.695 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:08:52.697 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:08:52.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:52.699 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:08:52.706 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:08:52.706 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:08:52.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:52.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:08:52.708 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:08:52.709 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:08:52.709 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:08:52.709 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:08:52.710 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:08:52.710 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:08:52.711 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:08:52.711 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:08:52.712 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:08:52.712 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:08:52.712 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:08:52.713 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:08:52.713 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:08:52.714 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:08:52.714 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:08:52.714 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:08:52.715 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:08:52.715 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:08:52.716 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:08:52.716 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:08:52.717 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:08:52.717 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:08:52.763 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.13959.asok 2021-10-21T00:08:52.768 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13959.asok 2021-10-21T00:08:52.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:52.770 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13959.asok status 2021-10-21T00:08:52.857 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:08:52.858 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:08:52.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:08:52.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:08:52.859 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:08:52.860 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:08:52.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:08:52.861 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "13959", 2021-10-21T00:08:52.861 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:08:52.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:08:52.862 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:08:52.863 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:08:52.863 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5867, 2021-10-21T00:08:52.864 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:08:52.864 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:08:52.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:08:52.865 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 5867 2021-10-21T00:08:52.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:08:52.866 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:08:52.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:08:52.867 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:08:52.867 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 281230654 2021-10-21T00:08:52.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:08:52.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:08:52.869 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:08:52.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:08:52.869 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:08:52.870 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 281230654 2021-10-21T00:08:52.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:08:52.871 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.5867 172.21.15.99:0/281230654", 2021-10-21T00:08:52.871 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/281230654", 2021-10-21T00:08:52.872 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:08:52.872 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 33, 2021-10-21T00:08:52.872 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 69, 2021-10-21T00:08:52.873 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:08:52.873 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:08:52.874 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:08:52.874 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:08:52.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:52.877 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:52.878 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:52.886 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:08:52.887 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:08:52.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:52.888 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:52.906 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:53.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 Processor -- start 2021-10-21T00:08:53.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- start start 2021-10-21T00:08:53.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f82d00b3dd0 0x7f82d0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 0x7f82d00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00ba050 con 0x7f82d00b9c70 2021-10-21T00:08:53.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d0147060 con 0x7f82d00b3dd0 2021-10-21T00:08:53.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00b4520 con 0x7f82d00b2070 2021-10-21T00:08:53.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f82d00b3dd0 0x7f82d0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82ce59c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f82d00b9c70 0x7f82d0146460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:59988/0 (socket says 172.21.15.41:59988) 2021-10-21T00:08:53.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82ce59c700 1 -- 172.21.15.41:0/1052574684 learned_addr learned my addr 172.21.15.41:0/1052574684 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:53.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82ced9d700 1 --2- 172.21.15.41:0/1052574684 >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 0x7f82d00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1052574684 >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 msgr2=0x7f82d00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:08:53.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 --2- 172.21.15.41:0/1052574684 >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 0x7f82d00b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1052574684 >> v1:172.21.15.41:6789/0 conn(0x7f82d00b9c70 legacy=0x7f82d0146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1052574684 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d014b240 con 0x7f82d00b3dd0 2021-10-21T00:08:53.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cdd9b700 1 --2- 172.21.15.41:0/1052574684 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d0146b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f82c80032f0 tx=0x7f82c80091d0).ready entity=mon.0 client_cookie=c6f299efa6e96a4a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82ced9d700 1 --2- 172.21.15.41:0/1052574684 >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 0x7f82d00b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:08:53.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cd59a700 1 -- 172.21.15.41:0/1052574684 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c8009ea0 con 0x7f82d00b3dd0 2021-10-21T00:08:53.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cd59a700 1 -- 172.21.15.41:0/1052574684 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800b870 con 0x7f82d00b3dd0 2021-10-21T00:08:53.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82cd59a700 1 -- 172.21.15.41:0/1052574684 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c800ba20 con 0x7f82d00b3dd0 2021-10-21T00:08:53.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- 172.21.15.41:0/1052574684 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 msgr2=0x7f82d0146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1052574684 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d0146b70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f82c80032f0 tx=0x7f82c80091d0).stop 2021-10-21T00:08:53.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- 172.21.15.41:0/1052574684 shutdown_connections 2021-10-21T00:08:53.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1052574684 >> v2:172.21.15.62:3300/0 conn(0x7f82d00b2070 0x7f82d00b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1052574684 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d0146b70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- 172.21.15.41:0/1052574684 >> 172.21.15.41:0/1052574684 conn(0x7f82d0062e80 msgr2=0x7f82d00b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:53.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- 172.21.15.41:0/1052574684 shutdown_connections 2021-10-21T00:08:53.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.014+0000 7f82d4a96700 1 -- 172.21.15.41:0/1052574684 wait complete. 2021-10-21T00:08:53.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 Processor -- start 2021-10-21T00:08:53.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 -- start start 2021-10-21T00:08:53.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00b2070 0x7f82d011ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82d00b9c70 0x7f82d0156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0156fc0 con 0x7f82d00b3dd0 2021-10-21T00:08:53.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0063590 con 0x7f82d00b2070 2021-10-21T00:08:53.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82d4a96700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d01571e0 con 0x7f82d00b9c70 2021-10-21T00:08:53.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:33994/0 (socket says 172.21.15.41:33994) 2021-10-21T00:08:53.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1561101739 learned_addr learned my addr 172.21.15.41:0/1561101739 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:53.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82ce59c700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00b2070 0x7f82d011ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82ced9d700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82d00b9c70 0x7f82d0156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82d00b9c70 msgr2=0x7f82d0156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82d00b9c70 0x7f82d0156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00b2070 msgr2=0x7f82d011ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00b2070 0x7f82d011ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.018+0000 7f82cdd9b700 1 -- 172.21.15.41:0/1561101739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009470 con 0x7f82d00b3dd0 2021-10-21T00:08:53.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82cdd9b700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f82c80032f0 tx=0x7f82c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c8009ea0 con 0x7f82d00b3dd0 2021-10-21T00:08:53.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c800b9e0 con 0x7f82d00b3dd0 2021-10-21T00:08:53.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d0157480 con 0x7f82d00b3dd0 2021-10-21T00:08:53.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c8006b60 con 0x7f82d00b3dd0 2021-10-21T00:08:53.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d011b330 con 0x7f82d00b3dd0 2021-10-21T00:08:53.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d014b4e0 con 0x7f82d00b3dd0 2021-10-21T00:08:53.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82c8026030 con 0x7f82d00b3dd0 2021-10-21T00:08:53.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 0x7f82a80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f82c806c450 con 0x7f82d00b3dd0 2021-10-21T00:08:53.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.022+0000 7f82ce59c700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 0x7f82a80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.026+0000 7f82ce59c700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 0x7f82a80559e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f82b800d000 tx=0x7f82b8000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.034+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82c8043600 con 0x7f82d00b3dd0 2021-10-21T00:08:53.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.198+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d0057350 con 0x7f82d00b3dd0 2021-10-21T00:08:53.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.198+0000 7f82c77fe700 1 -- 172.21.15.41:0/1561101739 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f82c8024090 con 0x7f82d00b3dd0 2021-10-21T00:08:53.204 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:53.204 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:53.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 msgr2=0x7f82a80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 0x7f82a80559e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f82b800d000 tx=0x7f82b8000bc0).stop 2021-10-21T00:08:53.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 msgr2=0x7f82d01565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f82c80032f0 tx=0x7f82c8016000).stop 2021-10-21T00:08:53.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 shutdown_connections 2021-10-21T00:08:53.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f82a8053520 0x7f82a80559e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f82d00b9c70 0x7f82d0156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f82d00b3dd0 0x7f82d01565e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 --2- 172.21.15.41:0/1561101739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00b2070 0x7f82d011ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 >> 172.21.15.41:0/1561101739 conn(0x7f82d0062e80 msgr2=0x7f82d00b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:53.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 shutdown_connections 2021-10-21T00:08:53.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.202+0000 7f82d4a96700 1 -- 172.21.15.41:0/1561101739 wait complete. 2021-10-21T00:08:53.209 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:53.216 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:08:53.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.314+0000 7f7421d55700 1 Processor -- start 2021-10-21T00:08:53.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.314+0000 7f7421d55700 1 -- start start 2021-10-21T00:08:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0609d0 con 0x7f741c14b350 2021-10-21T00:08:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c05fdd0 con 0x7f741c0aa750 2021-10-21T00:08:53.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0b1620 con 0x7f741c05f9f0 2021-10-21T00:08:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f741c14b350 0x7f741c0af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60006/0 (socket says 172.21.15.41:60006) 2021-10-21T00:08:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f741c0aa750 0x7f741c14ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39826/0 (socket says 172.21.15.41:39826) 2021-10-21T00:08:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741affd700 1 -- 172.21.15.41:0/127908037 learned_addr learned my addr 172.21.15.41:0/127908037 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:08:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741b7fe700 1 --2- 172.21.15.41:0/127908037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620470317 0 0) 0x7f741c05fdd0 con 0x7f741c0aa750 2021-10-21T00:08:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7408003260 con 0x7f741c0aa750 2021-10-21T00:08:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009935511 0 0) 0x7f741c0609d0 con 0x7f741c14b350 2021-10-21T00:08:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c05fdd0 con 0x7f741c14b350 2021-10-21T00:08:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741b7fe700 1 -- 172.21.15.41:0/127908037 >> v1:172.21.15.62:6789/0 conn(0x7f741c0aa750 legacy=0x7f741c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741b7fe700 1 -- 172.21.15.41:0/127908037 >> v1:172.21.15.41:6789/0 conn(0x7f741c14b350 legacy=0x7f741c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741b7fe700 1 -- 172.21.15.41:0/127908037 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0b1380 con 0x7f741c05f9f0 2021-10-21T00:08:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741b7fe700 1 --2- 172.21.15.41:0/127908037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c14a750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7410002f70 tx=0x7f7410006df0).ready entity=mon.2 client_cookie=74a798737b76ebca server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741000d5c0 con 0x7f741c05f9f0 2021-10-21T00:08:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410000e90 con 0x7f741c05f9f0 2021-10-21T00:08:53.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f741a7fc700 1 -- 172.21.15.41:0/127908037 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741000d910 con 0x7f741c05f9f0 2021-10-21T00:08:53.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- 172.21.15.41:0/127908037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 msgr2=0x7f741c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 --2- 172.21.15.41:0/127908037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c14a750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7410002f70 tx=0x7f7410006df0).stop 2021-10-21T00:08:53.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- 172.21.15.41:0/127908037 shutdown_connections 2021-10-21T00:08:53.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 --2- 172.21.15.41:0/127908037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c14a750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- 172.21.15.41:0/127908037 >> 172.21.15.41:0/127908037 conn(0x7f741c05bca0 msgr2=0x7f741c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:53.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- 172.21.15.41:0/127908037 shutdown_connections 2021-10-21T00:08:53.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.318+0000 7f7421d55700 1 -- 172.21.15.41:0/127908037 wait complete. 2021-10-21T00:08:53.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 Processor -- start 2021-10-21T00:08:53.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- start start 2021-10-21T00:08:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c098be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0aa750 0x7f741c0ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0aef90 con 0x7f741c14b350 2021-10-21T00:08:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09a5e0 con 0x7f741c0aa750 2021-10-21T00:08:53.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09a340 con 0x7f741c05f9f0 2021-10-21T00:08:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34010/0 (socket says 172.21.15.41:34010) 2021-10-21T00:08:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741b7fe700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c098be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 -- 172.21.15.41:0/3716634116 learned_addr learned my addr 172.21.15.41:0/3716634116 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:08:53.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741affd700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0aa750 0x7f741c0ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 -- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 msgr2=0x7f741c098be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c098be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 -- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0aa750 msgr2=0x7f741c0ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0aa750 0x7f741c0ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 -- 172.21.15.41:0/3716634116 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741000b180 con 0x7f741c14b350 2021-10-21T00:08:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f741bfff700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f7414001490 tx=0x7f7414007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741400ce70 con 0x7f741c14b350 2021-10-21T00:08:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414005ae0 con 0x7f741c14b350 2021-10-21T00:08:53.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c1487a0 con 0x7f741c14b350 2021-10-21T00:08:53.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7414005e40 con 0x7f741c14b350 2021-10-21T00:08:53.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.322+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c148de0 con 0x7f741c14b350 2021-10-21T00:08:53.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.326+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c148930 con 0x7f741c14b350 2021-10-21T00:08:53.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.326+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7414010070 con 0x7f741c14b350 2021-10-21T00:08:53.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.326+0000 7f7418ff9700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 0x7f73fc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:08:53.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.326+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f741406b1b0 con 0x7f741c14b350 2021-10-21T00:08:53.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.326+0000 7f741b7fe700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 0x7f73fc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:08:53.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.330+0000 7f741b7fe700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 0x7f73fc055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f7410018000 tx=0x7f7410014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:08:53.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.334+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7414042200 con 0x7f741c14b350 2021-10-21T00:08:53.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.494+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f741c0678f0 con 0x7f741c14b350 2021-10-21T00:08:53.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.494+0000 7f7418ff9700 1 -- 172.21.15.41:0/3716634116 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f7414045820 con 0x7f741c14b350 2021-10-21T00:08:53.501 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:08:53.501 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:08:53.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 msgr2=0x7f73fc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 0x7f73fc055a40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f7410018000 tx=0x7f7410014000).stop 2021-10-21T00:08:53.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 msgr2=0x7f741c143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:08:53.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f7414001490 tx=0x7f7414007d40).stop 2021-10-21T00:08:53.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 shutdown_connections 2021-10-21T00:08:53.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73fc053580 0x7f73fc055a40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f741c14b350 0x7f741c143d60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0aa750 0x7f741c0ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 --2- 172.21.15.41:0/3716634116 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f741c05f9f0 0x7f741c098be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:08:53.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 >> 172.21.15.41:0/3716634116 conn(0x7f741c05bca0 msgr2=0x7f741c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:08:53.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 shutdown_connections 2021-10-21T00:08:53.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:08:53.498+0000 7f7421d55700 1 -- 172.21.15.41:0/3716634116 wait complete. 2021-10-21T00:08:53.508 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:08:53.513 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-10-21T00:08:53.617 INFO:teuthology.orchestra.run.smithi041.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-10-21T00:08:53.617 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-10-21T00:08:53.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:53.618 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:53.619 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:08:53.627 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:08:53.628 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:08:53.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:08:53.630 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:08:53.630 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:08:53.631 DEBUG:teuthology.orchestra.run.smithi071:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-10-21T00:08:53.631 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:08:53.632 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:08:53.632 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content2'"'"') 2021-10-21T00:08:53.633 DEBUG:teuthology.orchestra.run.smithi071:> while True: 2021-10-21T00:08:53.633 DEBUG:teuthology.orchestra.run.smithi071:> time.sleep(1) 2021-10-21T00:08:53.634 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:08:53.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-10-21T00:08:53.658 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-10-21T00:08:53.659 INFO:teuthology.orchestra.run.smithi071.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-10-21T00:08:54.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-10-21T00:08:54.680 INFO:teuthology.orchestra.run.smithi071.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-10-21T00:08:54.681 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-10-21T00:08:54.681 DEBUG:teuthology.orchestra.run.smithi099:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-10-21T00:08:54.718 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-10-21T00:08:54.719 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-10-21T00:08:54.719 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:08:54.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:08:54.741 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:08:54.741 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:08:54.768 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:08:54.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:08:54.770 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:08:54.771 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:08:54.772 DEBUG:teuthology.orchestra.run.smithi099:> import time 2021-10-21T00:08:54.772 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:08:54.772 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-10-21T00:08:54.773 DEBUG:teuthology.orchestra.run.smithi099:> try: 2021-10-21T00:08:54.774 DEBUG:teuthology.orchestra.run.smithi099:> while True: 2021-10-21T00:08:54.774 DEBUG:teuthology.orchestra.run.smithi099:> os.write(fd, b'"'"'content'"'"') 2021-10-21T00:08:54.775 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(1) 2021-10-21T00:08:54.775 DEBUG:teuthology.orchestra.run.smithi099:> if not False: 2021-10-21T00:08:54.776 DEBUG:teuthology.orchestra.run.smithi099:> break 2021-10-21T00:08:54.776 DEBUG:teuthology.orchestra.run.smithi099:> except IOError as e: 2021-10-21T00:08:54.776 DEBUG:teuthology.orchestra.run.smithi099:> pass 2021-10-21T00:08:54.777 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2021-10-21T00:08:54.777 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:08:58.152 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:58.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:58.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:58.164 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:08:58.166 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:28.247 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:28.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:28.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:28.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:28.258 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:35.707 INFO:tasks.cephfs.test_misc:cap_waiter waited 40.92773747444153s 2021-10-21T00:09:35.708 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-10-21T00:09:35.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.813+0000 7f3927fff700 1 Processor -- start 2021-10-21T00:09:35.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3927fff700 1 -- start start 2021-10-21T00:09:35.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3927fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 0x7f392805c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:35.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3927fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280ba000 con 0x7f39280b9c20 2021-10-21T00:09:35.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3927fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3928142ad0 con 0x7f39280b41a0 2021-10-21T00:09:35.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3927fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3928143bc0 con 0x7f39280acd30 2021-10-21T00:09:35.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3926ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f39280b9c20 0x7f39281434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60018/0 (socket says 172.21.15.41:60018) 2021-10-21T00:09:35.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f3926ffd700 1 -- 172.21.15.41:0/1523292967 learned_addr learned my addr 172.21.15.41:0/1523292967 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:35.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f391ffff700 1 --2- 172.21.15.41:0/1523292967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 0x7f392805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:35.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824413286 0 0) 0x7f39280ba000 con 0x7f39280b9c20 2021-10-21T00:09:35.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3908003260 con 0x7f39280b9c20 2021-10-21T00:09:35.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922561309 0 0) 0x7f3928142ad0 con 0x7f39280b41a0 2021-10-21T00:09:35.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39280ba000 con 0x7f39280b41a0 2021-10-21T00:09:35.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f391ffff700 1 -- 172.21.15.41:0/1523292967 >> v1:172.21.15.62:6789/0 conn(0x7f39280b41a0 legacy=0x7f3928141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f391ffff700 1 -- 172.21.15.41:0/1523292967 >> v1:172.21.15.41:6789/0 conn(0x7f39280b9c20 legacy=0x7f39281434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88654245 0 0) 0x7f3908003260 con 0x7f39280b9c20 2021-10-21T00:09:35.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f391ffff700 1 -- 172.21.15.41:0/1523292967 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928142d70 con 0x7f39280acd30 2021-10-21T00:09:35.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f391ffff700 1 --2- 172.21.15.41:0/1523292967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 0x7f392805c860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3918001290 tx=0x7f3910006df0).ready entity=mon.2 client_cookie=9062438c84facbc2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:35.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39180017e0 con 0x7f39280acd30 2021-10-21T00:09:35.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910000e90 con 0x7f39280acd30 2021-10-21T00:09:35.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.817+0000 7f39267fc700 1 -- 172.21.15.41:0/1523292967 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3910012460 con 0x7f39280acd30 2021-10-21T00:09:35.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- 172.21.15.41:0/1523292967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 msgr2=0x7f392805c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 --2- 172.21.15.41:0/1523292967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 0x7f392805c860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3918001290 tx=0x7f3910006df0).stop 2021-10-21T00:09:35.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- 172.21.15.41:0/1523292967 shutdown_connections 2021-10-21T00:09:35.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 --2- 172.21.15.41:0/1523292967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280acd30 0x7f392805c860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- 172.21.15.41:0/1523292967 >> 172.21.15.41:0/1523292967 conn(0x7f3928062f00 msgr2=0x7f39280b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:35.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- 172.21.15.41:0/1523292967 shutdown_connections 2021-10-21T00:09:35.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- 172.21.15.41:0/1523292967 wait complete. 2021-10-21T00:09:35.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 Processor -- start 2021-10-21T00:09:35.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.821+0000 7f3927fff700 1 -- start start 2021-10-21T00:09:35.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:35.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280b41a0 0x7f3928144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:35.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280b9c20 0x7f39280b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:35.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928144a90 con 0x7f39280acd30 2021-10-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280aebd0 con 0x7f39280b41a0 2021-10-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280aee70 con 0x7f39280b9c20 2021-10-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:35.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34022/0 (socket says 172.21.15.41:34022) 2021-10-21T00:09:35.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 -- 172.21.15.41:0/1751926982 learned_addr learned my addr 172.21.15.41:0/1751926982 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:35.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f391ffff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280b41a0 0x7f3928144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:35.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f39277fe700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280b9c20 0x7f39280b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:35.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 -- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280b9c20 msgr2=0x7f39280b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280b9c20 0x7f39280b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 -- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280b41a0 msgr2=0x7f3928144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280b41a0 0x7f3928144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 -- 172.21.15.41:0/1751926982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391000b180 con 0x7f39280acd30 2021-10-21T00:09:35.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3926ffd700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3918001160 tx=0x7f391800c740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:35.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39180070d0 con 0x7f39280acd30 2021-10-21T00:09:35.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918007230 con 0x7f39280acd30 2021-10-21T00:09:35.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39180073a0 con 0x7f39280acd30 2021-10-21T00:09:35.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39280af110 con 0x7f39280acd30 2021-10-21T00:09:35.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392813bde0 con 0x7f39280acd30 2021-10-21T00:09:35.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.825+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392813c420 con 0x7f39280acd30 2021-10-21T00:09:35.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.829+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3918010070 con 0x7f39280acd30 2021-10-21T00:09:35.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.829+0000 7f3924ff9700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 0x7f390c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:35.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.829+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f391806afd0 con 0x7f39280acd30 2021-10-21T00:09:35.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.829+0000 7f391ffff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 0x7f390c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:35.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.829+0000 7f391ffff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 0x7f390c0559b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f391001a000 tx=0x7f3910014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:35.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.833+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f392813c420 con 0x7f39280acd30 2021-10-21T00:09:35.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.977+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f392813c420 con 0x7f39280acd30 2021-10-21T00:09:35.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.977+0000 7f3924ff9700 1 -- 172.21.15.41:0/1751926982 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v70) v1 ==== 98+0+80 (secure 0 0 0) 0x7f392813c420 con 0x7f39280acd30 2021-10-21T00:09:35.985 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 msgr2=0x7f390c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 0x7f390c0559b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f391001a000 tx=0x7f3910014000).stop 2021-10-21T00:09:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 msgr2=0x7f39280af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3918001160 tx=0x7f391800c740).stop 2021-10-21T00:09:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 shutdown_connections 2021-10-21T00:09:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f390c0534f0 0x7f390c0559b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39280b9c20 0x7f39280b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280b41a0 0x7f3928144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 --2- 172.21.15.41:0/1751926982 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39280acd30 0x7f39280af5b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:35.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 >> 172.21.15.41:0/1751926982 conn(0x7f3928062f00 msgr2=0x7f39281456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:35.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 shutdown_connections 2021-10-21T00:09:35.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:35.981+0000 7f3927fff700 1 -- 172.21.15.41:0/1751926982 wait complete. 2021-10-21T00:09:35.991 INFO:teuthology.orchestra.run.smithi041.stderr:listed 1 entries 2021-10-21T00:09:35.997 INFO:teuthology.orchestra.run.smithi041.stdout:[{"addr":"172.21.15.71:0/3233948456","until":"2021-10-21T01:09:29.549499+0000"}] 2021-10-21T00:09:36.013 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-10-21T00:09:36.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:36.014 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:36.014 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:36.020 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-10-21T00:09:36.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:36.021 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-10-21T00:09:36.022 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:09:36.022 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:09:36.023 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:36.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:36.040 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:36.040 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:36.046 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:09:36.047 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:09:36.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:09:36.049 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:36.096 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:36.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.197+0000 7fb5463d6700 1 Processor -- start 2021-10-21T00:09:36.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.197+0000 7fb5463d6700 1 -- start start 2021-10-21T00:09:36.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb54014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5400aa750 0x7fb54014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5400609d0 con 0x7fb54014b130 2021-10-21T00:09:36.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400b1620 con 0x7fb5400aa750 2021-10-21T00:09:36.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54005fdd0 con 0x7fb54005f9f0 2021-10-21T00:09:36.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb544973700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb54014b130 0x7fb5401495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60036/0 (socket says 172.21.15.41:60036) 2021-10-21T00:09:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb544973700 1 -- 172.21.15.41:0/4123975368 learned_addr learned my addr 172.21.15.41:0/4123975368 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/4123975368 >> v2:172.21.15.62:3300/0 conn(0x7fb5400aa750 0x7fb54014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53ffff700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb54014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53effd700 1 -- 172.21.15.41:0/4123975368 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374590158 0 0) 0x7fb5400609d0 con 0x7fb54014b130 2021-10-21T00:09:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53effd700 1 -- 172.21.15.41:0/4123975368 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb52c003260 con 0x7fb54014b130 2021-10-21T00:09:36.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 -- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 msgr2=0x7fb54014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:36.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb54014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 -- 172.21.15.41:0/4123975368 >> v1:172.21.15.41:6789/0 conn(0x7fb54014b130 legacy=0x7fb5401495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 -- 172.21.15.41:0/4123975368 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400b1380 con 0x7fb5400aa750 2021-10-21T00:09:36.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5400aa750 0x7fb54014ac40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb530002f70 tx=0x7fb530006df0).ready entity=mon.1 client_cookie=e1bc89fe3b20971b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53effd700 1 -- 172.21.15.41:0/4123975368 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53000d4a0 con 0x7fb5400aa750 2021-10-21T00:09:36.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53effd700 1 -- 172.21.15.41:0/4123975368 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530000e90 con 0x7fb5400aa750 2021-10-21T00:09:36.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb53effd700 1 -- 172.21.15.41:0/4123975368 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53000d7f0 con 0x7fb5400aa750 2021-10-21T00:09:36.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5400aa750 msgr2=0x7fb54014ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5400aa750 0x7fb54014ac40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb530002f70 tx=0x7fb530006df0).stop 2021-10-21T00:09:36.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- 172.21.15.41:0/4123975368 shutdown_connections 2021-10-21T00:09:36.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5400aa750 0x7fb54014ac40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 --2- 172.21.15.41:0/4123975368 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb54014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- 172.21.15.41:0/4123975368 >> 172.21.15.41:0/4123975368 conn(0x7fb54005bca0 msgr2=0x7fb54005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- 172.21.15.41:0/4123975368 shutdown_connections 2021-10-21T00:09:36.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.201+0000 7fb5463d6700 1 -- 172.21.15.41:0/4123975368 wait complete. 2021-10-21T00:09:36.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 Processor -- start 2021-10-21T00:09:36.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 -- start start 2021-10-21T00:09:36.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb540159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 0x7fb540098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400aeaf0 con 0x7fb5400aa750 2021-10-21T00:09:36.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540064370 con 0x7fb54014b130 2021-10-21T00:09:36.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb5463d6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400aed10 con 0x7fb54005f9f0 2021-10-21T00:09:36.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34038/0 (socket says 172.21.15.41:34038) 2021-10-21T00:09:36.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 -- 172.21.15.41:0/752397058 learned_addr learned my addr 172.21.15.41:0/752397058 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:36.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb544973700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 0x7fb540098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53ffff700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb540159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 -- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 msgr2=0x7fb540159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb540159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 -- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 msgr2=0x7fb540098dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 0x7fb540098dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 -- 172.21.15.41:0/752397058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53000b180 con 0x7fb5400aa750 2021-10-21T00:09:36.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb544973700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 0x7fb540098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:36.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53f7fe700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb530002f70 tx=0x7fb530014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb530016070 con 0x7fb5400aa750 2021-10-21T00:09:36.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.205+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300138d0 con 0x7fb5400aa750 2021-10-21T00:09:36.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb530013c30 con 0x7fb5400aa750 2021-10-21T00:09:36.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5400aefb0 con 0x7fb5400aa750 2021-10-21T00:09:36.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5400994d0 con 0x7fb5400aa750 2021-10-21T00:09:36.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540062c70 con 0x7fb5400aa750 2021-10-21T00:09:36.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb530025030 con 0x7fb5400aa750 2021-10-21T00:09:36.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53d7fa700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 0x7fb520055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb53006c960 con 0x7fb5400aa750 2021-10-21T00:09:36.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53ffff700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 0x7fb520055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.209+0000 7fb53ffff700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 0x7fb520055ad0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fb53400b000 tx=0x7fb534006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.213+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb540062c70 con 0x7fb5400aa750 2021-10-21T00:09:36.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.345+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb540062c70 con 0x7fb5400aa750 2021-10-21T00:09:36.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.345+0000 7fb53d7fa700 1 -- 172.21.15.41:0/752397058 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fb540062c70 con 0x7fb5400aa750 2021-10-21T00:09:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:36.354 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":70,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:30.478918+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:08:42.313703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-10-21T00:08:42.705186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.71:0/3233948456":"2021-10-21T01:09:29.549499+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:36.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 msgr2=0x7fb520055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 0x7fb520055ad0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fb53400b000 tx=0x7fb534006df0).stop 2021-10-21T00:09:36.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 msgr2=0x7fb5400ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb530002f70 tx=0x7fb530014000).stop 2021-10-21T00:09:36.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 shutdown_connections 2021-10-21T00:09:36.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb520053610 0x7fb520055ad0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54014b130 0x7fb540098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb5400aa750 0x7fb5400ae600 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 --2- 172.21.15.41:0/752397058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54005f9f0 0x7fb540159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 >> 172.21.15.41:0/752397058 conn(0x7fb54005bca0 msgr2=0x7fb54005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 shutdown_connections 2021-10-21T00:09:36.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.349+0000 7fb5463d6700 1 -- 172.21.15.41:0/752397058 wait complete. 2021-10-21T00:09:36.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:08:42.313703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:08:42.705186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:09:36.367 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:09:36.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 Processor -- start 2021-10-21T00:09:36.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 -- start start 2021-10-21T00:09:36.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 0x7ff1100b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1100b26d0 0x7ff110141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100ba080 con 0x7ff1100b31e0 2021-10-21T00:09:36.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11005c670 con 0x7ff1100b26d0 2021-10-21T00:09:36.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff114c22700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11005c8e0 con 0x7ff1100b9ca0 2021-10-21T00:09:36.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff10ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1100b26d0 0x7ff110141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff10ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1100b26d0 0x7ff110141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34048/0 (socket says 172.21.15.41:34048) 2021-10-21T00:09:36.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff10ed9d700 1 -- 172.21.15.41:0/913836377 learned_addr learned my addr 172.21.15.41:0/913836377 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:36.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.473+0000 7ff10e59c700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 0x7ff1100b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 -- 172.21.15.41:0/913836377 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 msgr2=0x7ff1100b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 0x7ff1100b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 -- 172.21.15.41:0/913836377 >> v1:172.21.15.62:6789/0 conn(0x7ff1100b31e0 legacy=0x7ff1100b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 -- 172.21.15.41:0/913836377 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11005cb80 con 0x7ff1100b26d0 2021-10-21T00:09:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10e59c700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 0x7ff1100b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff110141bc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7ff1080032f0 tx=0x7ff108009290).ready entity=mon.0 client_cookie=3b6d555120441e51 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10dd9b700 1 -- 172.21.15.41:0/913836377 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10800b8a0 con 0x7ff1100b26d0 2021-10-21T00:09:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10dd9b700 1 -- 172.21.15.41:0/913836377 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800ba00 con 0x7ff1100b26d0 2021-10-21T00:09:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10dd9b700 1 -- 172.21.15.41:0/913836377 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10800bb70 con 0x7ff1100b26d0 2021-10-21T00:09:36.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- 172.21.15.41:0/913836377 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 msgr2=0x7ff110141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff110141bc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7ff1080032f0 tx=0x7ff108009290).stop 2021-10-21T00:09:36.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- 172.21.15.41:0/913836377 shutdown_connections 2021-10-21T00:09:36.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff110141bc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- 172.21.15.41:0/913836377 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b9ca0 0x7ff1100b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- 172.21.15.41:0/913836377 >> 172.21.15.41:0/913836377 conn(0x7ff110062f00 msgr2=0x7ff1100b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- 172.21.15.41:0/913836377 shutdown_connections 2021-10-21T00:09:36.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- 172.21.15.41:0/913836377 wait complete. 2021-10-21T00:09:36.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 Processor -- start 2021-10-21T00:09:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- start start 2021-10-21T00:09:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b31e0 0x7ff1100b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 0x7ff1100af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100af110 con 0x7ff1100b26d0 2021-10-21T00:09:36.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110113eb0 con 0x7ff1100b9ca0 2021-10-21T00:09:36.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff114c22700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff110114150 con 0x7ff1100b31e0 2021-10-21T00:09:36.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34050/0 (socket says 172.21.15.41:34050) 2021-10-21T00:09:36.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10e59c700 1 -- 172.21.15.41:0/3217257667 learned_addr learned my addr 172.21.15.41:0/3217257667 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:36.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff105d9b700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b31e0 0x7ff1100b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.477+0000 7ff10ed9d700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 0x7ff1100af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 -- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b31e0 msgr2=0x7ff1100b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b31e0 0x7ff1100b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 -- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 msgr2=0x7ff1100af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 0x7ff1100af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 -- 172.21.15.41:0/3217257667 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108009530 con 0x7ff1100b26d0 2021-10-21T00:09:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10ed9d700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 0x7ff1100af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff10e59c700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7ff100006940 tx=0x7ff100008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff100011780 con 0x7ff1100b26d0 2021-10-21T00:09:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1100ad820 con 0x7ff1100b26d0 2021-10-21T00:09:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000118e0 con 0x7ff1100b26d0 2021-10-21T00:09:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff100011c40 con 0x7ff1100b26d0 2021-10-21T00:09:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1100aed70 con 0x7ff1100b26d0 2021-10-21T00:09:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100af280 con 0x7ff1100b26d0 2021-10-21T00:09:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff10001c460 con 0x7ff1100b26d0 2021-10-21T00:09:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.481+0000 7ff107fff700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 0x7ff0e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.485+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff10006bd00 con 0x7ff1100b26d0 2021-10-21T00:09:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.485+0000 7ff105d9b700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 0x7ff0e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.485+0000 7ff105d9b700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 0x7ff0e8055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ff0f800d000 tx=0x7ff0f8007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.493+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff100042c40 con 0x7ff1100b26d0 2021-10-21T00:09:36.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff110057350 con 0x7ff1100b26d0 2021-10-21T00:09:36.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff107fff700 1 -- 172.21.15.41:0/3217257667 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v70) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff100046260 con 0x7ff1100b26d0 2021-10-21T00:09:36.627 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:09:36.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 msgr2=0x7ff0e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 0x7ff0e8055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ff0f800d000 tx=0x7ff0f8007b90).stop 2021-10-21T00:09:36.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 msgr2=0x7ff1101551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7ff100006940 tx=0x7ff100008040).stop 2021-10-21T00:09:36.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 shutdown_connections 2021-10-21T00:09:36.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff0e80536a0 0x7ff0e8055b60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1100b9ca0 0x7ff1100af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1100b31e0 0x7ff1100b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 --2- 172.21.15.41:0/3217257667 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1100b26d0 0x7ff1101551e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 >> 172.21.15.41:0/3217257667 conn(0x7ff110062f00 msgr2=0x7ff110142520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 shutdown_connections 2021-10-21T00:09:36.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.621+0000 7ff114c22700 1 -- 172.21.15.41:0/3217257667 wait complete. 2021-10-21T00:09:36.640 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:09:36.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.741+0000 7f55f55d4700 1 Processor -- start 2021-10-21T00:09:36.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.741+0000 7f55f55d4700 1 -- start start 2021-10-21T00:09:36.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 0x7f55f0065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00b76e0 con 0x7f55f00b7300 2021-10-21T00:09:36.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00ac890 con 0x7f55f0066370 2021-10-21T00:09:36.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0144de0 con 0x7f55f0065a00 2021-10-21T00:09:36.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55eeffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f55f00b7300 0x7f55f013a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60060/0 (socket says 172.21.15.41:60060) 2021-10-21T00:09:36.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55eeffd700 1 -- 172.21.15.41:0/2207819401 learned_addr learned my addr 172.21.15.41:0/2207819401 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:36.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55e67fc700 1 --2- 172.21.15.41:0/2207819401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 0x7f55f0065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628861602 0 0) 0x7f55f00b76e0 con 0x7f55f00b7300 2021-10-21T00:09:36.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d0003260 con 0x7f55f00b7300 2021-10-21T00:09:36.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729210320 0 0) 0x7f55f00ac890 con 0x7f55f0066370 2021-10-21T00:09:36.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55e67fc700 1 -- 172.21.15.41:0/2207819401 >> v1:172.21.15.62:6789/0 conn(0x7f55f0066370 legacy=0x7f55f014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55e67fc700 1 -- 172.21.15.41:0/2207819401 >> v1:172.21.15.41:6789/0 conn(0x7f55f00b7300 legacy=0x7f55f013a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55e67fc700 1 -- 172.21.15.41:0/2207819401 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00acb30 con 0x7f55f0065a00 2021-10-21T00:09:36.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55e67fc700 1 --2- 172.21.15.41:0/2207819401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 0x7f55f0065e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f55e0001800 tx=0x7f55d8006df0).ready entity=mon.2 client_cookie=fd590161477320b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e0001660 con 0x7f55f0065a00 2021-10-21T00:09:36.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8000e90 con 0x7f55f0065a00 2021-10-21T00:09:36.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55ee7fc700 1 -- 172.21.15.41:0/2207819401 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d800d4a0 con 0x7f55f0065a00 2021-10-21T00:09:36.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- 172.21.15.41:0/2207819401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 msgr2=0x7f55f0065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2207819401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 0x7f55f0065e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f55e0001800 tx=0x7f55d8006df0).stop 2021-10-21T00:09:36.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- 172.21.15.41:0/2207819401 shutdown_connections 2021-10-21T00:09:36.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2207819401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0065a00 0x7f55f0065e80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- 172.21.15.41:0/2207819401 >> 172.21.15.41:0/2207819401 conn(0x7f55f0069df0 msgr2=0x7f55f0064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- 172.21.15.41:0/2207819401 shutdown_connections 2021-10-21T00:09:36.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.745+0000 7f55f55d4700 1 -- 172.21.15.41:0/2207819401 wait complete. 2021-10-21T00:09:36.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 Processor -- start 2021-10-21T00:09:36.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 -- start start 2021-10-21T00:09:36.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55f0065a00 0x7f55f0066a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0066370 0x7f55f013b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00afda0 con 0x7f55f00b7300 2021-10-21T00:09:36.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f014fc30 con 0x7f55f0065a00 2021-10-21T00:09:36.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55f55d4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00affd0 con 0x7f55f0066370 2021-10-21T00:09:36.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34068/0 (socket says 172.21.15.41:34068) 2021-10-21T00:09:36.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 -- 172.21.15.41:0/2676601245 learned_addr learned my addr 172.21.15.41:0/2676601245 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:36.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55e67fc700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0066370 0x7f55f013b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55eeffd700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55f0065a00 0x7f55f0066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 -- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0066370 msgr2=0x7f55f013b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0066370 0x7f55f013b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 -- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55f0065a00 msgr2=0x7f55f0066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55f0065a00 0x7f55f0066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 -- 172.21.15.41:0/2676601245 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d800b180 con 0x7f55f00b7300 2021-10-21T00:09:36.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.749+0000 7f55ef7fe700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f55e8001250 tx=0x7f55e8007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e800f470 con 0x7f55f00b7300 2021-10-21T00:09:36.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800f5d0 con 0x7f55f00b7300 2021-10-21T00:09:36.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f00b0270 con 0x7f55f00b7300 2021-10-21T00:09:36.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f0150dd0 con 0x7f55f00b7300 2021-10-21T00:09:36.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e800f930 con 0x7f55f00b7300 2021-10-21T00:09:36.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55e8019030 con 0x7f55f00b7300 2021-10-21T00:09:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 0x7f55d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00ad9d0 con 0x7f55f00b7300 2021-10-21T00:09:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f55e806af30 con 0x7f55f00b7300 2021-10-21T00:09:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.753+0000 7f55eeffd700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 0x7f55d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.757+0000 7f55eeffd700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 0x7f55d4055b60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f55e000d000 tx=0x7f55e0000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.761+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55e8045ac0 con 0x7f55f00b7300 2021-10-21T00:09:36.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.889+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55f0057350 con 0x7f55f00b7300 2021-10-21T00:09:36.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.889+0000 7f55ecff9700 1 -- 172.21.15.41:0/2676601245 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55e80170a0 con 0x7f55f00b7300 2021-10-21T00:09:36.897 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:36.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 msgr2=0x7f55d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 0x7f55d4055b60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f55e000d000 tx=0x7f55e0000bc0).stop 2021-10-21T00:09:36.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 msgr2=0x7f55f01409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:36.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f55e8001250 tx=0x7f55e8007dc0).stop 2021-10-21T00:09:36.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 shutdown_connections 2021-10-21T00:09:36.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55d40536a0 0x7f55d4055b60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55f00b7300 0x7f55f01409a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55f0066370 0x7f55f013b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 --2- 172.21.15.41:0/2676601245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55f0065a00 0x7f55f0066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:36.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 >> 172.21.15.41:0/2676601245 conn(0x7f55f0069df0 msgr2=0x7f55f0143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:36.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 shutdown_connections 2021-10-21T00:09:36.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:36.893+0000 7f55f55d4700 1 -- 172.21.15.41:0/2676601245 wait complete. 2021-10-21T00:09:36.910 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:09:37.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.005+0000 7fe86a879700 1 Processor -- start 2021-10-21T00:09:37.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.005+0000 7fe86a879700 1 -- start start 2021-10-21T00:09:37.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 0x7fe8640acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe86405c860 0x7fe8641434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8640ba000 con 0x7fe8640b41a0 2021-10-21T00:09:37.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86405ccc0 con 0x7fe86405c860 2021-10-21T00:09:37.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe864142ad0 con 0x7fe8640b9c20 2021-10-21T00:09:37.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a078700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe8640b41a0 0x7fe864145f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60078/0 (socket says 172.21.15.41:60078) 2021-10-21T00:09:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a078700 1 -- 172.21.15.41:0/4274973617 learned_addr learned my addr 172.21.15.41:0/4274973617 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 --2- 172.21.15.41:0/4274973617 >> v2:172.21.15.62:3300/0 conn(0x7fe86405c860 0x7fe8641434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869877700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 0x7fe8640acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe868875700 1 -- 172.21.15.41:0/4274973617 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109960777 0 0) 0x7fe8640ba000 con 0x7fe8640b41a0 2021-10-21T00:09:37.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe868875700 1 -- 172.21.15.41:0/4274973617 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe84c003260 con 0x7fe8640b41a0 2021-10-21T00:09:37.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 -- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 msgr2=0x7fe8640acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:37.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 0x7fe8640acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 -- 172.21.15.41:0/4274973617 >> v1:172.21.15.41:6789/0 conn(0x7fe8640b41a0 legacy=0x7fe864145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 -- 172.21.15.41:0/4274973617 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864142d70 con 0x7fe86405c860 2021-10-21T00:09:37.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869877700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 0x7fe8640acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:37.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe869076700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe86405c860 0x7fe8641434b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fe858002f70 tx=0x7fe858006df0).ready entity=mon.1 client_cookie=599a608366049305 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe868875700 1 -- 172.21.15.41:0/4274973617 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe85800d4a0 con 0x7fe86405c860 2021-10-21T00:09:37.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe868875700 1 -- 172.21.15.41:0/4274973617 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858000e90 con 0x7fe86405c860 2021-10-21T00:09:37.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe868875700 1 -- 172.21.15.41:0/4274973617 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe85800d7f0 con 0x7fe86405c860 2021-10-21T00:09:37.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe86405c860 msgr2=0x7fe8641434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe86405c860 0x7fe8641434b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fe858002f70 tx=0x7fe858006df0).stop 2021-10-21T00:09:37.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- 172.21.15.41:0/4274973617 shutdown_connections 2021-10-21T00:09:37.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe86405c860 0x7fe8641434b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 --2- 172.21.15.41:0/4274973617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8640b9c20 0x7fe8640acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- 172.21.15.41:0/4274973617 >> 172.21.15.41:0/4274973617 conn(0x7fe864062f00 msgr2=0x7fe8640b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- 172.21.15.41:0/4274973617 shutdown_connections 2021-10-21T00:09:37.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.009+0000 7fe86a879700 1 -- 172.21.15.41:0/4274973617 wait complete. 2021-10-21T00:09:37.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 Processor -- start 2021-10-21T00:09:37.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- start start 2021-10-21T00:09:37.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 0x7fe8641458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 0x7fe8640afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640af590 con 0x7fe8640b41a0 2021-10-21T00:09:37.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864145de0 con 0x7fe8640b9c20 2021-10-21T00:09:37.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640af7c0 con 0x7fe86405c860 2021-10-21T00:09:37.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34080/0 (socket says 172.21.15.41:34080) 2021-10-21T00:09:37.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 -- 172.21.15.41:0/2633094749 learned_addr learned my addr 172.21.15.41:0/2633094749 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:37.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869877700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 0x7fe8641458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a078700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 0x7fe8640afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 -- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 msgr2=0x7fe8641458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 0x7fe8641458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 -- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 msgr2=0x7fe8640afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 0x7fe8640afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 -- 172.21.15.41:0/2633094749 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86000b120 con 0x7fe8640b41a0 2021-10-21T00:09:37.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869877700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 0x7fe8641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:09:37.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a078700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 0x7fe8640afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:09:37.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe869076700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fe858002f70 tx=0x7fe858014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe858016070 con 0x7fe8640b41a0 2021-10-21T00:09:37.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858013a40 con 0x7fe8640b41a0 2021-10-21T00:09:37.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe858013da0 con 0x7fe8640b41a0 2021-10-21T00:09:37.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85800b180 con 0x7fe8640b41a0 2021-10-21T00:09:37.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.013+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe864146070 con 0x7fe8640b41a0 2021-10-21T00:09:37.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe85800f030 con 0x7fe8640b41a0 2021-10-21T00:09:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe864143010 con 0x7fe8640b41a0 2021-10-21T00:09:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe856ffd700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 0x7fe844055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe85806c680 con 0x7fe8640b41a0 2021-10-21T00:09:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe869877700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 0x7fe844055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.017+0000 7fe869877700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 0x7fe844055a70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fe860008000 tx=0x7fe860008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.021+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe8580437b0 con 0x7fe8640b41a0 2021-10-21T00:09:37.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.145+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe864140fa0 con 0x7fe8640b41a0 2021-10-21T00:09:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.145+0000 7fe856ffd700 1 -- 172.21.15.41:0/2633094749 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe858023020 con 0x7fe8640b41a0 2021-10-21T00:09:37.154 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:37.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 msgr2=0x7fe844055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 0x7fe844055a70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fe860008000 tx=0x7fe860008040).stop 2021-10-21T00:09:37.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 msgr2=0x7fe8641464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fe858002f70 tx=0x7fe858014000).stop 2021-10-21T00:09:37.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 shutdown_connections 2021-10-21T00:09:37.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8440535b0 0x7fe844055a70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8640b9c20 0x7fe8640afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8640b41a0 0x7fe8641464a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 --2- 172.21.15.41:0/2633094749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe86405c860 0x7fe8641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 >> 172.21.15.41:0/2633094749 conn(0x7fe864062f00 msgr2=0x7fe8641405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 shutdown_connections 2021-10-21T00:09:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.149+0000 7fe86a879700 1 -- 172.21.15.41:0/2633094749 wait complete. 2021-10-21T00:09:37.167 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:09:37.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.265+0000 7fbc74a06700 1 Processor -- start 2021-10-21T00:09:37.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.265+0000 7fbc74a06700 1 -- start start 2021-10-21T00:09:37.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc700b9ca0 0x7fbc700b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc700b26d0 0x7fbc70141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc700ba080 con 0x7fbc700b31e0 2021-10-21T00:09:37.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7005c670 con 0x7fbc700b26d0 2021-10-21T00:09:37.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7005c8e0 con 0x7fbc700b9ca0 2021-10-21T00:09:37.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc700b26d0 0x7fbc70141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc700b26d0 0x7fbc70141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34086/0 (socket says 172.21.15.41:34086) 2021-10-21T00:09:37.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 -- 172.21.15.41:0/1785758697 learned_addr learned my addr 172.21.15.41:0/1785758697 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:37.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6dd9b700 1 --1- 172.21.15.41:0/1785758697 >> v1:172.21.15.41:6789/0 conn(0x7fbc700b31e0 0x7fbc700b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60090/0 (socket says 172.21.15.41:60090) 2021-10-21T00:09:37.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6e59c700 1 --2- 172.21.15.41:0/1785758697 >> v2:172.21.15.62:3300/0 conn(0x7fbc700b9ca0 0x7fbc700b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 -- 172.21.15.41:0/1785758697 >> v2:172.21.15.62:3300/0 conn(0x7fbc700b9ca0 msgr2=0x7fbc700b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:37.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 --2- 172.21.15.41:0/1785758697 >> v2:172.21.15.62:3300/0 conn(0x7fbc700b9ca0 0x7fbc700b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 -- 172.21.15.41:0/1785758697 >> v1:172.21.15.41:6789/0 conn(0x7fbc700b31e0 legacy=0x7fbc700b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6d59a700 1 -- 172.21.15.41:0/1785758697 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025292181 0 0) 0x7fbc700ba080 con 0x7fbc700b31e0 2021-10-21T00:09:37.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 -- 172.21.15.41:0/1785758697 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7005cb80 con 0x7fbc700b26d0 2021-10-21T00:09:37.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6ed9d700 1 --2- 172.21.15.41:0/1785758697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70141bc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fbc68002f70 tx=0x7fbc68006eb0).ready entity=mon.0 client_cookie=8f8e34c2441d2685 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6d59a700 1 -- 172.21.15.41:0/1785758697 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6800d5c0 con 0x7fbc700b26d0 2021-10-21T00:09:37.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6d59a700 1 -- 172.21.15.41:0/1785758697 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68000e90 con 0x7fbc700b26d0 2021-10-21T00:09:37.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc6d59a700 1 -- 172.21.15.41:0/1785758697 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6800d910 con 0x7fbc700b26d0 2021-10-21T00:09:37.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- 172.21.15.41:0/1785758697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 msgr2=0x7fbc70141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 --2- 172.21.15.41:0/1785758697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70141bc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fbc68002f70 tx=0x7fbc68006eb0).stop 2021-10-21T00:09:37.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- 172.21.15.41:0/1785758697 shutdown_connections 2021-10-21T00:09:37.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 --2- 172.21.15.41:0/1785758697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70141bc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 --2- 172.21.15.41:0/1785758697 >> v2:172.21.15.62:3300/0 conn(0x7fbc700b9ca0 0x7fbc700b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- 172.21.15.41:0/1785758697 >> 172.21.15.41:0/1785758697 conn(0x7fbc70062f00 msgr2=0x7fbc700b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- 172.21.15.41:0/1785758697 shutdown_connections 2021-10-21T00:09:37.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.269+0000 7fbc74a06700 1 -- 172.21.15.41:0/1785758697 wait complete. 2021-10-21T00:09:37.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 Processor -- start 2021-10-21T00:09:37.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- start start 2021-10-21T00:09:37.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 0x7fbc700ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc700b9ca0 0x7fbc70151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700aebb0 con 0x7fbc700b26d0 2021-10-21T00:09:37.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70112dd0 con 0x7fbc700b9ca0 2021-10-21T00:09:37.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700ac890 con 0x7fbc700b31e0 2021-10-21T00:09:37.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34092/0 (socket says 172.21.15.41:34092) 2021-10-21T00:09:37.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 -- 172.21.15.41:0/735409536 learned_addr learned my addr 172.21.15.41:0/735409536 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:37.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6dd9b700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 0x7fbc700ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6ed9d700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc700b9ca0 0x7fbc70151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 -- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 msgr2=0x7fbc700ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 0x7fbc700ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 -- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc700b9ca0 msgr2=0x7fbc70151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc700b9ca0 0x7fbc70151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 -- 172.21.15.41:0/735409536 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6800b1e0 con 0x7fbc700b26d0 2021-10-21T00:09:37.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6dd9b700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 0x7fbc700ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:37.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc6e59c700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fbc60006e00 tx=0x7fbc600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6000c850 con 0x7fbc700b26d0 2021-10-21T00:09:37.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6000c9b0 con 0x7fbc700b26d0 2021-10-21T00:09:37.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc70113000 con 0x7fbc700b26d0 2021-10-21T00:09:37.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6000cd10 con 0x7fbc700b26d0 2021-10-21T00:09:37.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.273+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc700ad740 con 0x7fbc700b26d0 2021-10-21T00:09:37.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc70146fe0 con 0x7fbc700b26d0 2021-10-21T00:09:37.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc60022070 con 0x7fbc700b26d0 2021-10-21T00:09:37.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc677fe700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 0x7fbc54055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbc6006c080 con 0x7fbc700b26d0 2021-10-21T00:09:37.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc6dd9b700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 0x7fbc54055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.277+0000 7fbc6dd9b700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 0x7fbc54055ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbc5800b000 tx=0x7fbc58007100).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.281+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc600431b0 con 0x7fbc700b26d0 2021-10-21T00:09:37.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.409+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc700ac9d0 con 0x7fbc700b26d0 2021-10-21T00:09:37.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.409+0000 7fbc677fe700 1 -- 172.21.15.41:0/735409536 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbc60016020 con 0x7fbc700b26d0 2021-10-21T00:09:37.417 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:37.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 msgr2=0x7fbc54055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 0x7fbc54055ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbc5800b000 tx=0x7fbc58007100).stop 2021-10-21T00:09:37.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 msgr2=0x7fbc70112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fbc60006e00 tx=0x7fbc600091d0).stop 2021-10-21T00:09:37.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 shutdown_connections 2021-10-21T00:09:37.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc54053610 0x7fbc54055ad0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc700b9ca0 0x7fbc70151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc700b31e0 0x7fbc700ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 --2- 172.21.15.41:0/735409536 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc700b26d0 0x7fbc70112780 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 >> 172.21.15.41:0/735409536 conn(0x7fbc70062f00 msgr2=0x7fbc700b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 shutdown_connections 2021-10-21T00:09:37.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.413+0000 7fbc74a06700 1 -- 172.21.15.41:0/735409536 wait complete. 2021-10-21T00:09:37.430 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:09:37.430 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:37.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 Processor -- start 2021-10-21T00:09:37.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- start start 2021-10-21T00:09:37.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68c40b3bc0 0x7f68c4143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c4142bc0 con 0x7f68c4143a00 2021-10-21T00:09:37.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c41429a0 con 0x7f68c40b3bc0 2021-10-21T00:09:37.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40ba050 con 0x7f68c40b9c70 2021-10-21T00:09:37.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68c40b3bc0 0x7f68c4143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52596/0 (socket says 172.21.15.41:52596) 2021-10-21T00:09:37.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 -- 172.21.15.41:0/2515532006 learned_addr learned my addr 172.21.15.41:0/2515532006 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:37.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 -- 172.21.15.41:0/2515532006 >> v2:172.21.15.62:3300/0 conn(0x7f68c40b3bc0 msgr2=0x7f68c4143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:37.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 --2- 172.21.15.41:0/2515532006 >> v2:172.21.15.62:3300/0 conn(0x7f68c40b3bc0 0x7f68c4143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 -- 172.21.15.41:0/2515532006 >> v1:172.21.15.62:6789/0 conn(0x7f68c4143a00 legacy=0x7f68c405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 -- 172.21.15.41:0/2515532006 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c41463c0 con 0x7f68c40b9c70 2021-10-21T00:09:37.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c89c0700 1 --2- 172.21.15.41:0/2515532006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f68c40b1ab0 tx=0x7f68b4009290).ready entity=mon.2 client_cookie=7a8d9de264bc50ed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c37fe700 1 -- 172.21.15.41:0/2515532006 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b400b860 con 0x7f68c40b9c70 2021-10-21T00:09:37.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c37fe700 1 -- 172.21.15.41:0/2515532006 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400b9c0 con 0x7f68c40b9c70 2021-10-21T00:09:37.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68c37fe700 1 -- 172.21.15.41:0/2515532006 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b400bb30 con 0x7f68c40b9c70 2021-10-21T00:09:37.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- 172.21.15.41:0/2515532006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 msgr2=0x7f68c4143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 --2- 172.21.15.41:0/2515532006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f68c40b1ab0 tx=0x7f68b4009290).stop 2021-10-21T00:09:37.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- 172.21.15.41:0/2515532006 shutdown_connections 2021-10-21T00:09:37.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 --2- 172.21.15.41:0/2515532006 >> v2:172.21.15.62:3300/0 conn(0x7f68c40b3bc0 0x7f68c4143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 --2- 172.21.15.41:0/2515532006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b9c70 0x7f68c4143020 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- 172.21.15.41:0/2515532006 >> 172.21.15.41:0/2515532006 conn(0x7f68c4062e80 msgr2=0x7f68c40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- 172.21.15.41:0/2515532006 shutdown_connections 2021-10-21T00:09:37.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.525+0000 7f68cac24700 1 -- 172.21.15.41:0/2515532006 wait complete. 2021-10-21T00:09:37.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 Processor -- start 2021-10-21T00:09:37.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- start start 2021-10-21T00:09:37.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f68c40b9c70 0x7f68c4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c4143a00 0x7f68c4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c413e710 con 0x7f68c40b9c70 2021-10-21T00:09:37.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4156550 con 0x7f68c4143a00 2021-10-21T00:09:37.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40b8360 con 0x7f68c40b3bc0 2021-10-21T00:09:37.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f68c40b9c70 0x7f68c4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52602/0 (socket says 172.21.15.41:52602) 2021-10-21T00:09:37.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 -- 172.21.15.41:0/3557075951 learned_addr learned my addr 172.21.15.41:0/3557075951 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:37.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c91c1700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c4143a00 0x7f68c4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 -- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c4143a00 msgr2=0x7f68c4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c4143a00 0x7f68c4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 -- 172.21.15.41:0/3557075951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f68c40b9c70 msgr2=0x7f68c4155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f68c40b9c70 0x7f68c4155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 -- 172.21.15.41:0/3557075951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009530 con 0x7f68c40b3bc0 2021-10-21T00:09:37.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c89c0700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f68c40b1ab0 tx=0x7f68b4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b40032f0 con 0x7f68c40b3bc0 2021-10-21T00:09:37.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4021440 con 0x7f68c40b3bc0 2021-10-21T00:09:37.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40b8600 con 0x7f68c40b3bc0 2021-10-21T00:09:37.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b40217a0 con 0x7f68c40b3bc0 2021-10-21T00:09:37.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.529+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40af540 con 0x7f68c40b3bc0 2021-10-21T00:09:37.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c40b4660 con 0x7f68c40b3bc0 2021-10-21T00:09:37.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68b400f070 con 0x7f68c40b3bc0 2021-10-21T00:09:37.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68c1ffb700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 0x7f68a8055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:37.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f68b406cec0 con 0x7f68c40b3bc0 2021-10-21T00:09:37.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68c3fff700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 0x7f68a8055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:37.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.533+0000 7f68c3fff700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 0x7f68a8055b50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f68ac00b000 tx=0x7f68ac006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:37.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.541+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68b4043ee0 con 0x7f68c40b3bc0 2021-10-21T00:09:37.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.705+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68c4057350 con 0x7f68c40b3bc0 2021-10-21T00:09:37.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.705+0000 7f68c1ffb700 1 -- 172.21.15.41:0/3557075951 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f68b4015030 con 0x7f68c40b3bc0 2021-10-21T00:09:37.714 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:37.714 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:09:37.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 msgr2=0x7f68a8055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 0x7f68a8055b50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f68ac00b000 tx=0x7f68ac006df0).stop 2021-10-21T00:09:37.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 msgr2=0x7f68c40aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:37.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f68c40b1ab0 tx=0x7f68b4016000).stop 2021-10-21T00:09:37.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 shutdown_connections 2021-10-21T00:09:37.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f68a8053690 0x7f68a8055b50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68c4143a00 0x7f68c4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f68c40b9c70 0x7f68c4155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 --2- 172.21.15.41:0/3557075951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68c40b3bc0 0x7f68c40aefd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:37.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 >> 172.21.15.41:0/3557075951 conn(0x7f68c4062e80 msgr2=0x7f68c4140ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:37.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 shutdown_connections 2021-10-21T00:09:37.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:37.709+0000 7f68cac24700 1 -- 172.21.15.41:0/3557075951 wait complete. 2021-10-21T00:09:37.719 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:09:37.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:08:43.702897+0000', 'modified': '2021-10-21T00:08:44.705473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6270': {'gid': 6270, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/2873838223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 2873838223}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 2873838223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:09:37.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:09:37.930 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:09:38.046 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6270,"want_state":"up:active","state":"up:active","rank_uptime":54.328511356999996,"mdsmap_epoch":33,"osdmap_epoch":70,"osdmap_epoch_barrier":70,"uptime":58.489266319000002} 2021-10-21T00:09:38.047 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6270, "mdsmap_epoch": 33, "osdmap_epoch": 70, "osdmap_epoch_barrier": 70, "rank_uptime": 54.328511357, "state": "up:active", "uptime": 58.489266319, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:09:38.047 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:09:38.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:09:38.048 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:09:38.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:38.049 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:38.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:09:38.076 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:09:38.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:09:38.087 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:09:38.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:09:38.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:38.089 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:09:38.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:09:38.139 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:38.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:09:38.157 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:09:38.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:09:38.216 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:09:38.217 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:09:38.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:38.219 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:09:38.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:09:38.214+0000 7f6f2a10d080 -1 init, newargv = 0x55a32932b9f0 newargc=9 2021-10-21T00:09:38.220 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14554]: starting ceph client 2021-10-21T00:09:38.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14554]: starting fuse 2021-10-21T00:09:39.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:09:39.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:09:39.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:09:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:09:39.402 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:09:39.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.404 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:09:39.410 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:09:39.411 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:09:39.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:09:39.412 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:09:39.412 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:09:39.413 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:09:39.413 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:09:39.414 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:39.414 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:09:39.414 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:09:39.415 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:09:39.415 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:39.416 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:09:39.416 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:09:39.416 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:09:39.417 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:09:39.417 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:39.418 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:09:39.418 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:09:39.418 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:09:39.419 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:09:39.419 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:09:39.420 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:39.420 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:09:39.420 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:09:39.467 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14554.asok 2021-10-21T00:09:39.473 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14554.asok 2021-10-21T00:09:39.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14554.asok status 2021-10-21T00:09:39.611 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:09:39.611 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:09:39.611 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:09:39.612 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:09:39.612 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:09:39.612 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:09:39.612 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:09:39.612 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14554", 2021-10-21T00:09:39.613 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:09:39.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:39.613 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:09:39.613 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:09:39.614 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 6555, 2021-10-21T00:09:39.614 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:09:39.614 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:09:39.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:09:39.614 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 6555 2021-10-21T00:09:39.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:39.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:09:39.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:09:39.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:09:39.616 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3065171967 2021-10-21T00:09:39.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:09:39.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:39.616 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:09:39.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:09:39.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:09:39.617 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3065171967 2021-10-21T00:09:39.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:39.617 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.6555 172.21.15.71:0/3065171967", 2021-10-21T00:09:39.618 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/3065171967", 2021-10-21T00:09:39.618 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:09:39.618 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 33, 2021-10-21T00:09:39.618 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 70, 2021-10-21T00:09:39.618 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:09:39.619 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:09:39.619 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:09:39.619 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:09:39.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.621 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:39.621 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:39.629 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:09:39.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:09:39.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.631 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:39.694 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:09:39.695 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:39.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:39.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:39.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:39.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:39.800 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:09:39.801 INFO:tasks.cephfs.mount:Terminating background process 2021-10-21T00:09:39.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.802 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:39.802 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:39.810 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:09:39.811 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:09:39.812 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:09:39.812 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:09:39.813 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:39.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14554]: fuse finished with error 0 and tester_r 0 2021-10-21T00:09:39.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:39.869 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:39.870 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:39.877 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:09:39.878 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:09:39.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:09:39.994 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:40.043 INFO:tasks.cephfs.mount:Terminating background process 2021-10-21T00:09:40.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:40.045 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:40.045 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:09:40.057 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:09:40.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:09:40.059 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:09:40.060 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:09:40.060 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:09:40.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[13959]: fuse finished with error 0 and tester_r 0 2021-10-21T00:09:40.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:40.119 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:40.120 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:09:40.127 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:09:40.128 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:09:40.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:09:40.246 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:09:40.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:40.302 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:40.303 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:09:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:09:40.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:40.312 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:09:40.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:09:40.313 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:09:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:09:40.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:40.364 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:09:40.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 Processor -- start 2021-10-21T00:09:40.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 -- start start 2021-10-21T00:09:40.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 0x7f52d00ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b0b50 con 0x7f52d00af620 2021-10-21T00:09:40.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b2550 con 0x7f52d0067a80 2021-10-21T00:09:40.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cf59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b0d90 con 0x7f52d00b2170 2021-10-21T00:09:40.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cdd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f52d00af620 0x7f52d00ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60118/0 (socket says 172.21.15.41:60118) 2021-10-21T00:09:40.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52cdd9b700 1 -- 172.21.15.41:0/345522163 learned_addr learned my addr 172.21.15.41:0/345522163 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:40.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.469+0000 7f52ce59c700 1 --2- 172.21.15.41:0/345522163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 0x7f52d00ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cd59a700 1 -- 172.21.15.41:0/345522163 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920603665 0 0) 0x7f52b8001110 con 0x7f52d00af620 2021-10-21T00:09:40.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cd59a700 1 -- 172.21.15.41:0/345522163 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b0003260 con 0x7f52d00af620 2021-10-21T00:09:40.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52ce59c700 1 -- 172.21.15.41:0/345522163 >> v1:172.21.15.62:6789/0 conn(0x7f52d0067a80 legacy=0x7f52d0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52ce59c700 1 -- 172.21.15.41:0/345522163 >> v1:172.21.15.41:6789/0 conn(0x7f52d00af620 legacy=0x7f52d00ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52ce59c700 1 -- 172.21.15.41:0/345522163 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00b1030 con 0x7f52d00b2170 2021-10-21T00:09:40.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52ce59c700 1 --2- 172.21.15.41:0/345522163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 0x7f52d00ab170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f52c80032f0 tx=0x7f52c80091d0).ready entity=mon.2 client_cookie=2c1bd8ea800d63d4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cd59a700 1 -- 172.21.15.41:0/345522163 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c800b6c0 con 0x7f52d00b2170 2021-10-21T00:09:40.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cd59a700 1 -- 172.21.15.41:0/345522163 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800b820 con 0x7f52d00b2170 2021-10-21T00:09:40.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cd59a700 1 -- 172.21.15.41:0/345522163 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c800b990 con 0x7f52d00b2170 2021-10-21T00:09:40.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- 172.21.15.41:0/345522163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 msgr2=0x7f52d00ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 --2- 172.21.15.41:0/345522163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 0x7f52d00ab170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f52c80032f0 tx=0x7f52c80091d0).stop 2021-10-21T00:09:40.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- 172.21.15.41:0/345522163 shutdown_connections 2021-10-21T00:09:40.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 --2- 172.21.15.41:0/345522163 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d00b2170 0x7f52d00ab170 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- 172.21.15.41:0/345522163 >> 172.21.15.41:0/345522163 conn(0x7f52d00b5700 msgr2=0x7f52d00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:40.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- 172.21.15.41:0/345522163 shutdown_connections 2021-10-21T00:09:40.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- 172.21.15.41:0/345522163 wait complete. 2021-10-21T00:09:40.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 Processor -- start 2021-10-21T00:09:40.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- start start 2021-10-21T00:09:40.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d0067a80 0x7f52d00ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00af620 0x7f52d0156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00ae670 con 0x7f52d00b2170 2021-10-21T00:09:40.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00ae910 con 0x7f52d00af620 2021-10-21T00:09:40.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.473+0000 7f52cf59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0144470 con 0x7f52d0067a80 2021-10-21T00:09:40.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34122/0 (socket says 172.21.15.41:34122) 2021-10-21T00:09:40.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 -- 172.21.15.41:0/106480420 learned_addr learned my addr 172.21.15.41:0/106480420 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:40.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52cdd9b700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00af620 0x7f52d0156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ce59c700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d0067a80 0x7f52d00ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 -- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d0067a80 msgr2=0x7f52d00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d0067a80 0x7f52d00ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 -- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00af620 msgr2=0x7f52d0156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00af620 0x7f52d0156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 -- 172.21.15.41:0/106480420 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8009470 con 0x7f52d00b2170 2021-10-21T00:09:40.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ced9d700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f52d005d270 tx=0x7f52c0007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c0012400 con 0x7f52d00b2170 2021-10-21T00:09:40.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0012560 con 0x7f52d00b2170 2021-10-21T00:09:40.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00ad6a0 con 0x7f52d00b2170 2021-10-21T00:09:40.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c00128c0 con 0x7f52d00b2170 2021-10-21T00:09:40.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0148840 con 0x7f52d00b2170 2021-10-21T00:09:40.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a8003410 con 0x7f52d00b2170 2021-10-21T00:09:40.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52c0019030 con 0x7f52d00b2170 2021-10-21T00:09:40.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 0x7f52b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f52c006ab70 con 0x7f52d00b2170 2021-10-21T00:09:40.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.477+0000 7f52ce59c700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 0x7f52b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.481+0000 7f52ce59c700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 0x7f52b4055ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f52c801c000 tx=0x7f52c8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.481+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52c0041ca0 con 0x7f52d00b2170 2021-10-21T00:09:40.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.613+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f52a80036c0 con 0x7f52d00b2170 2021-10-21T00:09:40.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.613+0000 7f52c77fe700 1 -- 172.21.15.41:0/106480420 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v70) v1 ==== 81+0+33724 (secure 0 0 0) 0x7f52c00452c0 con 0x7f52d00b2170 2021-10-21T00:09:40.621 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:40.621 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:09:40.622 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 70, 2021-10-21T00:09:40.622 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:09:40.622 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:09:40.622 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:09:30.478918+0000", 2021-10-21T00:09:40.622 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:09:40.623 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:09:40.623 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:09:40.623 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:09:40.624 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:09:40.624 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:09:40.624 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:09:40.624 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:09:40.624 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:09:40.625 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:40.625 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:09:40.625 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:09:40.625 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:09:40.626 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:09:40.626 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:09:40.626 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 14, 2021-10-21T00:09:40.626 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:09:40.627 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:09:40.627 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:09:40.627 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:09:40.627 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:09:40.628 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.628 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:09:40.628 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:09:40.628 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:09:40.628 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:40.629 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:40.629 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:40.629 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:40.629 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:40.630 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:40.630 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:40.630 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:40.630 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:09:40.630 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:09:40.631 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:09:40.631 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:09:40.631 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:09:40.632 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:40.632 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:40.632 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:40.632 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:40.633 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:40.633 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:40.633 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:40.633 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.633 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:09:40.634 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:40.634 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:40.634 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:40.634 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:40.635 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:40.635 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:40.635 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:40.635 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:40.636 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:40.636 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:40.636 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:40.636 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:40.636 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:40.637 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:40.637 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:40.637 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:40.637 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:40.638 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:40.639 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:40.640 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.640 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:40.640 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:40.640 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:40.641 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:40.641 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:40.641 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:40.641 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:40.641 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:40.642 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:40.642 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:40.642 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:40.642 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:09:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:09:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:09:40.643 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:09:40.644 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:09:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:09:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:40.645 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:40.646 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:40.646 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:40.646 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:40.646 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:40.647 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:09:40.647 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:09:40.647 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:09:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:09:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:09:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:40.648 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:40.649 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:40.649 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:40.649 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:40.649 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:40.650 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.650 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:09:40.650 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:40.650 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:40.650 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:40.651 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:40.651 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:40.651 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:40.651 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:40.652 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:40.652 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:40.652 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:40.652 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:40.653 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:40.653 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:40.653 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:40.653 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:40.653 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:40.654 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:40.654 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:40.654 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:40.654 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:40.655 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:40.655 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:40.655 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:40.655 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:40.655 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:40.656 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:40.656 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.656 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:40.656 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:40.657 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:40.657 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:40.657 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:40.657 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:40.658 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:40.658 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:40.658 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:40.658 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:40.658 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:40.659 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:09:40.659 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:40.659 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:09:40.659 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.660 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.660 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.660 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 13, 2021-10-21T00:09:40.660 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:09:40.661 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:08:42.313703+0000", 2021-10-21T00:09:40.661 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:40.661 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:40.661 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:40.661 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:40.662 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:40.662 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:40.662 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:40.662 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:40.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:09:40.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:09:40.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:09:40.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:09:40.663 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:09:40.664 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:40.664 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:40.664 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:40.664 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:40.665 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:40.665 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:40.665 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:40.665 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.665 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "68", 2021-10-21T00:09:40.666 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:40.666 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:40.666 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:40.666 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:40.667 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:40.667 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:40.667 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:40.667 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:40.667 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:40.668 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:40.668 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:40.668 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:40.668 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:40.669 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:40.669 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:40.669 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:40.669 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:40.669 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:40.670 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:40.670 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:40.670 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:40.670 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:40.671 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:40.671 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:40.671 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:40.671 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:40.671 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.672 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:40.672 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:40.672 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:40.672 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:40.673 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:40.673 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:40.673 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:40.673 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:40.673 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:40.674 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:40.674 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:40.674 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:09:40.674 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:09:40.675 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:09:40.675 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:09:40.675 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.675 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:40.675 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:09:40.676 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:09:40.676 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.676 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.676 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 14, 2021-10-21T00:09:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:09:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:08:42.705186+0000", 2021-10-21T00:09:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:40.678 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:40.678 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:40.678 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:40.678 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:40.679 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:40.679 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:40.679 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:40.679 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:09:40.679 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:09:40.680 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:09:40.680 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:09:40.680 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:09:40.680 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:40.680 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:40.681 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:40.681 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:40.681 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:40.681 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:40.682 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:40.682 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.682 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "69", 2021-10-21T00:09:40.682 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:40.682 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:40.683 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:40.683 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:40.683 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:40.683 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:40.684 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:40.684 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:40.684 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:40.684 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:40.684 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:40.685 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:40.685 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:40.685 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:40.685 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:40.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:40.686 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:40.686 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:40.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:40.686 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:40.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:40.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:40.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:40.687 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:40.688 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:40.688 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:40.688 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.688 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:40.688 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:40.689 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:40.689 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:40.689 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:40.689 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:40.690 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:40.690 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:40.690 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:40.690 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:40.690 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:40.691 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:09:40.691 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:40.691 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:09:40.691 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:09:40.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.692 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:40.692 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:09:40.693 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.693 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:09:40.693 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:09:40.693 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.694 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.694 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.694 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.694 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.694 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.695 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.695 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:40.695 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.695 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.696 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.696 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.696 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.696 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.697 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:09:40.697 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.697 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.697 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.697 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.698 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:09:40.698 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.698 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.698 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.699 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.699 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.699 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.699 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.699 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.700 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:09:40.700 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.700 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.700 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.701 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.701 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:09:40.701 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.701 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.701 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.702 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.702 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.702 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.702 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.703 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.703 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:09:40.703 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.703 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.703 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.704 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.704 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:09:40.704 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.704 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.705 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.705 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.705 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.705 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.705 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.706 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.706 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:09:40.706 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.706 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.707 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.707 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.707 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:09:40.708 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:40.708 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.708 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.708 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.709 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:09:40.709 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:09:40.709 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:09:40.709 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:09:40.709 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.710 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.710 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.710 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.710 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.711 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.711 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:09:40.711 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:09:40.711 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.711 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.712 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.712 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.712 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.712 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.713 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.713 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:09:40.713 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.713 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.713 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.714 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.714 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.714 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.714 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:09:40.715 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.715 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.715 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.715 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.715 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:09:40.716 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.716 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.716 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.716 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.716 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.717 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.717 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.717 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.717 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:09:40.718 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.718 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.718 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.718 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.718 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:09:40.719 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.719 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.719 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.719 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.720 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.720 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.720 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.721 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.721 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:09:40.721 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.721 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.721 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.722 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.722 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:09:40.722 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.722 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.722 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.723 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.723 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.723 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.723 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.724 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.724 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:09:40.724 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.724 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.724 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.725 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.725 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:09:40.725 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:40.725 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.726 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.726 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:09:40.726 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:09:40.726 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:09:40.727 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:09:40.727 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.727 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.727 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.728 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.728 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.728 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.728 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:09:40.728 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:09:40.729 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.729 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.729 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.729 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.729 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.730 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.730 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.730 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:40.730 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.731 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.731 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.731 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.731 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.731 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.732 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:09:40.732 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.732 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.732 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.733 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.733 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:09:40.733 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.733 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.733 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.734 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.734 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.734 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.734 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.735 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.735 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:09:40.735 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.735 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.735 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.736 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.736 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:09:40.736 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.736 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.736 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.737 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.737 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.737 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.737 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.738 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.738 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:09:40.738 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.738 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.738 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.739 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.739 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:09:40.739 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.739 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.740 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.740 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.740 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.740 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.740 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.741 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.741 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:09:40.741 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.741 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.742 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.742 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.742 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:09:40.742 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:40.742 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.743 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.743 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.743 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:09:40.743 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:09:40.744 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:09:40.744 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:09:40.744 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.744 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.744 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.745 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.745 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.745 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.745 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:09:40.746 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:09:40.746 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.746 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.746 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.746 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.747 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.747 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.747 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.748 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:40.748 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.748 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.748 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.748 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.749 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.749 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.749 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:09:40.749 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.750 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.750 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.750 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.750 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:09:40.750 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.751 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.751 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.751 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.751 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.752 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.752 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.752 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.752 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:09:40.752 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.753 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.753 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.753 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.753 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:09:40.754 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.754 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.754 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.754 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.754 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.755 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.755 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.755 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.755 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:09:40.756 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.756 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.756 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.756 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.757 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:09:40.757 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.757 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.757 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.757 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.758 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.758 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.758 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.758 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.759 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:09:40.759 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.759 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.759 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.760 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.760 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:09:40.760 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:40.760 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.760 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.761 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.761 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:09:40.761 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:09:40.761 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:09:40.761 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:09:40.762 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.762 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.762 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.762 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.763 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.763 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.763 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:09:40.763 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:09:40.764 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.764 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.764 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.764 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.764 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.765 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.765 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.765 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:09:40.765 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.766 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.766 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.766 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.766 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.766 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.767 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:09:40.767 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.767 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.767 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.768 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.768 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:09:40.768 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.768 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.768 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.769 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.769 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.769 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.770 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.770 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:09:40.770 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.770 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.770 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.771 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.771 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:09:40.771 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.771 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.772 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.772 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.772 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.772 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.772 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.773 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.773 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:09:40.773 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.773 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.773 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.774 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.774 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:09:40.774 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.774 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.775 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.775 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.775 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.775 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.775 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.776 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.776 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:09:40.776 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.776 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.777 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.777 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.777 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:09:40.777 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:40.777 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.778 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.778 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.778 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:09:40.778 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:09:40.779 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:09:40.779 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:09:40.779 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.779 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.780 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.780 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.780 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.780 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.781 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:09:40.781 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:09:40.781 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.781 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.781 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.782 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.782 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.782 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.782 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.783 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:40.783 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.783 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.783 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.783 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.784 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.784 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.784 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:09:40.784 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.785 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.785 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.785 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.785 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:09:40.785 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.786 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.786 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.786 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.786 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.787 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.787 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.787 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.787 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:09:40.788 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.788 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.788 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.788 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.788 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:09:40.789 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.789 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.789 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.789 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.790 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.790 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.790 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.790 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.790 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:09:40.791 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.791 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.791 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.791 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.792 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:09:40.792 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.792 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.792 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.793 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.793 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.793 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.793 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.793 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.794 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:09:40.794 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.794 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.794 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.795 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.795 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:09:40.795 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:40.795 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.796 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.796 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.796 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:09:40.796 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:09:40.796 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:09:40.797 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:09:40.797 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.797 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.797 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.798 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.798 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.798 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.798 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:09:40.798 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:09:40.799 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.799 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.799 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.799 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.800 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.800 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.800 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.800 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:40.800 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.801 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.801 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.801 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.801 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.802 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.802 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:09:40.802 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.802 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.802 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.803 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.803 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:09:40.803 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.803 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.804 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.804 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.804 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.804 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.804 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.805 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.805 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:09:40.805 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.805 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.805 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.806 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.806 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:09:40.806 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.806 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.807 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.807 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.808 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.808 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.808 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.808 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.809 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:09:40.809 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.809 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.809 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.809 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.810 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:09:40.810 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.810 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.810 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.811 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.811 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.811 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.811 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.812 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.812 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:09:40.812 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.812 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.812 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.813 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.813 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:09:40.813 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:40.813 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.814 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.814 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.814 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:09:40.814 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:09:40.814 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:09:40.815 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:09:40.815 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.815 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.815 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.815 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.816 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.816 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.816 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:09:40.816 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:09:40.817 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:40.817 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:40.817 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:40.817 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:40.817 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:40.818 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:40.818 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:40.818 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:09:40.818 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:40.819 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:40.819 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:40.819 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.819 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.820 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.820 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:09:40.820 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.820 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.821 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.821 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.821 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:09:40.821 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.822 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.822 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.822 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.822 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:40.822 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.823 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.823 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.823 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:09:40.823 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.824 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.824 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.824 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.824 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:09:40.824 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.825 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.825 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.825 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.825 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:40.826 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.826 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.826 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.826 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:09:40.826 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.827 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.827 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.827 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.827 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:09:40.828 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.828 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.828 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.828 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.828 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:40.829 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:40.829 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.829 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:40.829 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:09:40.829 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.830 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.830 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.830 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:40.830 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:09:40.831 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:40.831 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.831 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.831 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.831 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:09:40.832 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:09:40.832 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:09:40.832 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:09:40.832 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:40.833 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:40.833 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:40.833 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:40.833 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.833 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:40.834 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:09:40.834 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.834 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:09:40.834 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.834 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.835 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.835 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.835 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.835 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:09:40.836 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.836 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.836 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.836 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:09:40.836 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.837 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.837 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.837 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.837 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.838 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:09:40.839 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.839 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.839 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.839 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.840 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.840 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:09:40.840 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.840 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.840 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.841 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:09:40.841 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.841 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.841 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.842 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.842 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.842 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:09:40.842 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.843 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.843 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.843 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:09:40.843 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.843 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.844 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.844 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.844 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.844 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:09:40.845 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.845 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.845 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.845 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:09:40.845 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.846 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.846 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.846 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.846 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.846 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:09:40.847 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.847 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.847 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.847 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:09:40.848 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.848 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.848 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.848 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.849 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.849 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:09:40.849 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.849 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.850 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:40.850 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:09:40.850 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:40.850 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:40.850 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:40.851 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:40.851 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:40.851 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:09:40.851 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:40.851 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.852 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:40.852 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:09:40.852 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:09:40.852 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:09:40.853 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:09:40.853 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:09:40.853 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.71:0/3233948456": "2021-10-21T01:09:29.549499+0000" 2021-10-21T00:09:40.853 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.853 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:09:40.854 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:09:40.854 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:09:40.854 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:09:40.854 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:09:40.854 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:09:40.855 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:09:40.855 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:09:40.855 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:40.855 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:40.856 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:09:40.856 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:09:40.856 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:09:40.856 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:09:40.856 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:09:40.857 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:09:40.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 msgr2=0x7f52b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 0x7f52b4055ad0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f52c801c000 tx=0x7f52c8016000).stop 2021-10-21T00:09:40.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 msgr2=0x7f52d0156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f52d005d270 tx=0x7f52c0007b90).stop 2021-10-21T00:09:40.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 shutdown_connections 2021-10-21T00:09:40.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52b4053610 0x7f52b4055ad0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52d00b2170 0x7f52d0156db0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00af620 0x7f52d0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 --2- 172.21.15.41:0/106480420 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52d0067a80 0x7f52d00ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 >> 172.21.15.41:0/106480420 conn(0x7f52d00b5700 msgr2=0x7f52d0149ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:40.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 shutdown_connections 2021-10-21T00:09:40.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.617+0000 7f52cf59e700 1 -- 172.21.15.41:0/106480420 wait complete. 2021-10-21T00:09:40.862 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:40.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.965+0000 7f7f6359e700 1 Processor -- start 2021-10-21T00:09:40.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.965+0000 7f7f6359e700 1 -- start start 2021-10-21T00:09:40.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 0x7f7f6413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6405bd40 con 0x7f7f64062330 2021-10-21T00:09:40.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6405bf70 con 0x7f7f640b3a20 2021-10-21T00:09:40.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64142cb0 con 0x7f7f64062f70 2021-10-21T00:09:40.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52626/0 (socket says 172.21.15.41:52626) 2021-10-21T00:09:40.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 -- 172.21.15.41:0/2117661551 learned_addr learned my addr 172.21.15.41:0/2117661551 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:40.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6259c700 1 --1- 172.21.15.41:0/2117661551 >> v1:172.21.15.62:6789/0 conn(0x7f7f64062330 0x7f7f640b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:39952/0 (socket says 172.21.15.41:39952) 2021-10-21T00:09:40.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f62d9d700 1 --2- 172.21.15.41:0/2117661551 >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 0x7f7f6413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 -- 172.21.15.41:0/2117661551 >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 msgr2=0x7f7f6413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:40.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 --2- 172.21.15.41:0/2117661551 >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 0x7f7f6413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 -- 172.21.15.41:0/2117661551 >> v1:172.21.15.62:6789/0 conn(0x7f7f64062330 legacy=0x7f7f640b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 -- 172.21.15.41:0/2117661551 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64142950 con 0x7f7f64062f70 2021-10-21T00:09:40.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f62d9d700 1 --2- 172.21.15.41:0/2117661551 >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 0x7f7f6413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:40.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f61d9b700 1 --2- 172.21.15.41:0/2117661551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7f54002f70 tx=0x7f7f54006eb0).ready entity=mon.2 client_cookie=dbec9e91278dbca3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6159a700 1 -- 172.21.15.41:0/2117661551 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5400d5c0 con 0x7f7f64062f70 2021-10-21T00:09:40.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6159a700 1 -- 172.21.15.41:0/2117661551 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54000e90 con 0x7f7f64062f70 2021-10-21T00:09:40.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6159a700 1 -- 172.21.15.41:0/2117661551 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5400d950 con 0x7f7f64062f70 2021-10-21T00:09:40.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- 172.21.15.41:0/2117661551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 msgr2=0x7f7f6405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 --2- 172.21.15.41:0/2117661551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7f54002f70 tx=0x7f7f54006eb0).stop 2021-10-21T00:09:40.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- 172.21.15.41:0/2117661551 shutdown_connections 2021-10-21T00:09:40.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 --2- 172.21.15.41:0/2117661551 >> v2:172.21.15.62:3300/0 conn(0x7f7f640b3a20 0x7f7f6413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 --2- 172.21.15.41:0/2117661551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f6405c410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- 172.21.15.41:0/2117661551 >> 172.21.15.41:0/2117661551 conn(0x7f7f640b9080 msgr2=0x7f7f640b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:40.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- 172.21.15.41:0/2117661551 shutdown_connections 2021-10-21T00:09:40.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.969+0000 7f7f6359e700 1 -- 172.21.15.41:0/2117661551 wait complete. 2021-10-21T00:09:40.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 Processor -- start 2021-10-21T00:09:40.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 -- start start 2021-10-21T00:09:40.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f640aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64114200 con 0x7f7f64062330 2021-10-21T00:09:40.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64112e80 con 0x7f7f640b3a20 2021-10-21T00:09:40.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64145530 con 0x7f7f64062f70 2021-10-21T00:09:40.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f62d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f640aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f62d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:46054/0 (socket says 172.21.15.41:46054) 2021-10-21T00:09:40.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f62d9d700 1 -- 172.21.15.41:0/4267770638 learned_addr learned my addr 172.21.15.41:0/4267770638 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:40.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34132/0 (socket says 172.21.15.41:34132) 2021-10-21T00:09:40.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 -- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 msgr2=0x7f7f64114620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 -- 172.21.15.41:0/4267770638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 msgr2=0x7f7f64143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:40.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:40.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 -- 172.21.15.41:0/4267770638 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5400b1e0 con 0x7f7f64062f70 2021-10-21T00:09:40.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f62d9d700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:40.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f6259c700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:40.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.973+0000 7f7f61d9b700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f640aece0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7f641521e0 tx=0x7f7f54015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f540116e0 con 0x7f7f64062f70 2021-10-21T00:09:40.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54011840 con 0x7f7f64062f70 2021-10-21T00:09:40.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f54011ba0 con 0x7f7f64062f70 2021-10-21T00:09:40.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f641457d0 con 0x7f7f64062f70 2021-10-21T00:09:40.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f64145e40 con 0x7f7f64062f70 2021-10-21T00:09:40.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f64146c70 con 0x7f7f64062f70 2021-10-21T00:09:40.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7f5401a040 con 0x7f7f64062f70 2021-10-21T00:09:40.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 0x7f7f480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:40.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7f5406c830 con 0x7f7f64062f70 2021-10-21T00:09:40.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.977+0000 7f7f6259c700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 0x7f7f480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:40.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.981+0000 7f7f6259c700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 0x7f7f480559b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f7f4c00d000 tx=0x7f7f4c007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:40.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:40.989+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f64146c70 con 0x7f7f64062f70 2021-10-21T00:09:41.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.149+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f64146c70 con 0x7f7f64062f70 2021-10-21T00:09:41.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.153+0000 7f7f5b7fe700 1 -- 172.21.15.41:0/4267770638 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f7f64146c70 con 0x7f7f64062f70 2021-10-21T00:09:41.160 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:41.160 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:08:44.705473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6270":{"gid":6270,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/2873838223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2873838223},{"type":"v1","addr":"172.21.15.41:6833","nonce":2873838223}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:09:41.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.153+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 msgr2=0x7f7f480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.153+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 0x7f7f480559b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f7f4c00d000 tx=0x7f7f4c007b80).stop 2021-10-21T00:09:41.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 msgr2=0x7f7f640aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f640aece0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7f641521e0 tx=0x7f7f54015000).stop 2021-10-21T00:09:41.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 shutdown_connections 2021-10-21T00:09:41.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7f480534f0 0x7f7f480559b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f640b3a20 0x7f7f64114620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f64062f70 0x7f7f640aece0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 --2- 172.21.15.41:0/4267770638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7f64062330 0x7f7f64143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 >> 172.21.15.41:0/4267770638 conn(0x7f7f640b9080 msgr2=0x7f7f640b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:41.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 shutdown_connections 2021-10-21T00:09:41.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.157+0000 7f7f6359e700 1 -- 172.21.15.41:0/4267770638 wait complete. 2021-10-21T00:09:41.166 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 33 2021-10-21T00:09:41.178 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:09:41.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.281+0000 7f7612834700 1 Processor -- start 2021-10-21T00:09:41.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.281+0000 7f7612834700 1 -- start start 2021-10-21T00:09:41.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f760c0699a0 0x7f760c0ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:41.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c13f710 con 0x7f760c0af700 2021-10-21T00:09:41.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0b6350 con 0x7f760c0b5f70 2021-10-21T00:09:41.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0adf10 con 0x7f760c0699a0 2021-10-21T00:09:41.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7611031700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f760c0699a0 0x7f760c0ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:41.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612033700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f760c0af700 0x7f760c0ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60146/0 (socket says 172.21.15.41:60146) 2021-10-21T00:09:41.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612033700 1 -- 172.21.15.41:0/2365795660 learned_addr learned my addr 172.21.15.41:0/2365795660 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:41.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7611031700 1 -- 172.21.15.41:0/2365795660 >> v1:172.21.15.62:6789/0 conn(0x7f760c0b5f70 legacy=0x7f760c13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7611031700 1 -- 172.21.15.41:0/2365795660 >> v1:172.21.15.41:6789/0 conn(0x7f760c0af700 legacy=0x7f760c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7611031700 1 -- 172.21.15.41:0/2365795660 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c067600 con 0x7f760c0699a0 2021-10-21T00:09:41.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7610830700 1 -- 172.21.15.41:0/2365795660 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441372623 0 0) 0x7f760c13f710 con 0x7f760c0af700 2021-10-21T00:09:41.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7611031700 1 --2- 172.21.15.41:0/2365795660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0699a0 0x7f760c0ac9a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f75fc002f70 tx=0x7f75fc006df0).ready entity=mon.0 client_cookie=476a40e083eaf23f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:41.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7610830700 1 -- 172.21.15.41:0/2365795660 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d610 con 0x7f760c0699a0 2021-10-21T00:09:41.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7610830700 1 -- 172.21.15.41:0/2365795660 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc000e90 con 0x7f760c0699a0 2021-10-21T00:09:41.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7610830700 1 -- 172.21.15.41:0/2365795660 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d960 con 0x7f760c0699a0 2021-10-21T00:09:41.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- 172.21.15.41:0/2365795660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0699a0 msgr2=0x7f760c0ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 --2- 172.21.15.41:0/2365795660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0699a0 0x7f760c0ac9a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f75fc002f70 tx=0x7f75fc006df0).stop 2021-10-21T00:09:41.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- 172.21.15.41:0/2365795660 shutdown_connections 2021-10-21T00:09:41.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 --2- 172.21.15.41:0/2365795660 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0699a0 0x7f760c0ac9a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- 172.21.15.41:0/2365795660 >> 172.21.15.41:0/2365795660 conn(0x7f760c0639f0 msgr2=0x7f760c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:41.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- 172.21.15.41:0/2365795660 shutdown_connections 2021-10-21T00:09:41.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.285+0000 7f7612834700 1 -- 172.21.15.41:0/2365795660 wait complete. 2021-10-21T00:09:41.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 Processor -- start 2021-10-21T00:09:41.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- start start 2021-10-21T00:09:41.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f760c0699a0 0x7f760c0667a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:41.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f760c0af700 0x7f760c137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:41.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:41.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c13abe0 con 0x7f760c0b5f70 2021-10-21T00:09:41.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c13f400 con 0x7f760c0699a0 2021-10-21T00:09:41.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c13ae10 con 0x7f760c0af700 2021-10-21T00:09:41.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:41.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34150/0 (socket says 172.21.15.41:34150) 2021-10-21T00:09:41.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 -- 172.21.15.41:0/3506140782 learned_addr learned my addr 172.21.15.41:0/3506140782 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:41.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7611031700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f760c0af700 0x7f760c137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:41.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7611832700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f760c0699a0 0x7f760c0667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:41.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 -- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f760c0af700 msgr2=0x7f760c137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f760c0af700 0x7f760c137fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 -- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f760c0699a0 msgr2=0x7f760c0667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:41.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f760c0699a0 0x7f760c0667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:41.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 -- 172.21.15.41:0/3506140782 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc00b180 con 0x7f760c0b5f70 2021-10-21T00:09:41.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612033700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f7604001250 tx=0x7f7604007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:41.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604005c70 con 0x7f760c0b5f70 2021-10-21T00:09:41.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604005dd0 con 0x7f760c0b5f70 2021-10-21T00:09:41.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c13cab0 con 0x7f760c0b5f70 2021-10-21T00:09:41.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604004a90 con 0x7f760c0b5f70 2021-10-21T00:09:41.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c138980 con 0x7f760c0b5f70 2021-10-21T00:09:41.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7604004bf0 con 0x7f760c0b5f70 2021-10-21T00:09:41.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0b17e0 con 0x7f760c0b5f70 2021-10-21T00:09:41.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f75faffd700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 0x7f75ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:41.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f760406b710 con 0x7f760c0b5f70 2021-10-21T00:09:41.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f7611832700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 0x7f75ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:41.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.293+0000 7f7611832700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 0x7f75ec055b60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f760800b000 tx=0x7f7608009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:41.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.301+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76040427c0 con 0x7f760c0b5f70 2021-10-21T00:09:41.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:41.457+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f760c057350 con 0x7f760c0b5f70 2021-10-21T00:09:42.285 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:09:42.277+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:09:42.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.285+0000 7f75faffd700 1 -- 172.21.15.41:0/3506140782 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7604045de0 con 0x7f760c0b5f70 2021-10-21T00:09:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 msgr2=0x7f75ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 0x7f75ec055b60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f760800b000 tx=0x7f7608009040).stop 2021-10-21T00:09:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 msgr2=0x7f760c138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f7604001250 tx=0x7f7604007dc0).stop 2021-10-21T00:09:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 shutdown_connections 2021-10-21T00:09:42.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f75ec0536a0 0x7f75ec055b60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f760c0b5f70 0x7f760c138490 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f760c0af700 0x7f760c137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 --2- 172.21.15.41:0/3506140782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f760c0699a0 0x7f760c0667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 >> 172.21.15.41:0/3506140782 conn(0x7f760c0639f0 msgr2=0x7f760c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:42.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 shutdown_connections 2021-10-21T00:09:42.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.289+0000 7f7612834700 1 -- 172.21.15.41:0/3506140782 wait complete. 2021-10-21T00:09:42.301 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:09:42.314 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:42.323 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:09:42.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 Processor -- start 2021-10-21T00:09:42.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 -- start start 2021-10-21T00:09:42.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f900aebb0 0x7f9f901443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9f901448e0 0x7f9f9013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900b6350 con 0x7f9f900b5f70 2021-10-21T00:09:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900b13b0 con 0x7f9f901448e0 2021-10-21T00:09:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.405+0000 7f9f95085700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9005c830 con 0x7f9f900aebb0 2021-10-21T00:09:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9f901448e0 0x7f9f9013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f8ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9f900b5f70 0x7f9f90143ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60168/0 (socket says 172.21.15.41:60168) 2021-10-21T00:09:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9f901448e0 0x7f9f9013f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34170/0 (socket says 172.21.15.41:34170) 2021-10-21T00:09:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f8ffff700 1 -- 172.21.15.41:0/919827085 learned_addr learned my addr 172.21.15.41:0/919827085 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f87fff700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f900aebb0 0x7f9f901443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 -- 172.21.15.41:0/919827085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f900aebb0 msgr2=0x7f9f901443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f900aebb0 0x7f9f901443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 -- 172.21.15.41:0/919827085 >> v1:172.21.15.41:6789/0 conn(0x7f9f900b5f70 legacy=0x7f9f90143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 -- 172.21.15.41:0/919827085 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9005cad0 con 0x7f9f901448e0 2021-10-21T00:09:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f94884700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f901448e0 0x7f9f9013f6d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9f880032f0 tx=0x7f9f880091d0).ready entity=mon.0 client_cookie=71b452bea4792371 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f8f7fe700 1 -- 172.21.15.41:0/919827085 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8800b6c0 con 0x7f9f901448e0 2021-10-21T00:09:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f8f7fe700 1 -- 172.21.15.41:0/919827085 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800b820 con 0x7f9f901448e0 2021-10-21T00:09:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f8f7fe700 1 -- 172.21.15.41:0/919827085 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8800b990 con 0x7f9f901448e0 2021-10-21T00:09:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- 172.21.15.41:0/919827085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f901448e0 msgr2=0x7f9f9013f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f901448e0 0x7f9f9013f6d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9f880032f0 tx=0x7f9f880091d0).stop 2021-10-21T00:09:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- 172.21.15.41:0/919827085 shutdown_connections 2021-10-21T00:09:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f901448e0 0x7f9f9013f6d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 --2- 172.21.15.41:0/919827085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f900aebb0 0x7f9f901443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- 172.21.15.41:0/919827085 >> 172.21.15.41:0/919827085 conn(0x7f9f900639f0 msgr2=0x7f9f900b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- 172.21.15.41:0/919827085 shutdown_connections 2021-10-21T00:09:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- 172.21.15.41:0/919827085 wait complete. 2021-10-21T00:09:42.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 Processor -- start 2021-10-21T00:09:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.409+0000 7f9f95085700 1 -- start start 2021-10-21T00:09:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f900aebb0 0x7f9f900655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 0x7f9f90153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9010f460 con 0x7f9f900b5f70 2021-10-21T00:09:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9010f700 con 0x7f9f900aebb0 2021-10-21T00:09:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9010f9a0 con 0x7f9f901448e0 2021-10-21T00:09:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34174/0 (socket says 172.21.15.41:34174) 2021-10-21T00:09:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 -- 172.21.15.41:0/2988247733 learned_addr learned my addr 172.21.15.41:0/2988247733 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f8ffff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f900aebb0 0x7f9f900655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f94884700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 0x7f9f90153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 -- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 msgr2=0x7f9f90153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 0x7f9f90153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 -- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f900aebb0 msgr2=0x7f9f900655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f900aebb0 0x7f9f900655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 -- 172.21.15.41:0/2988247733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009470 con 0x7f9f900b5f70 2021-10-21T00:09:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f94884700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 0x7f9f90153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:09:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f87fff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f9f7800c000 tx=0x7f9f78006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f78010590 con 0x7f9f900b5f70 2021-10-21T00:09:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f780106f0 con 0x7f9f900b5f70 2021-10-21T00:09:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f900661f0 con 0x7f9f900b5f70 2021-10-21T00:09:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f78010a50 con 0x7f9f900b5f70 2021-10-21T00:09:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9010fe40 con 0x7f9f900b5f70 2021-10-21T00:09:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.413+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9010fb60 con 0x7f9f900b5f70 2021-10-21T00:09:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.417+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f78010bb0 con 0x7f9f900b5f70 2021-10-21T00:09:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.417+0000 7f9f8dffb700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 0x7f9f74055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.417+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9f7806bc50 con 0x7f9f900b5f70 2021-10-21T00:09:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.417+0000 7f9f8ffff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 0x7f9f74055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.417+0000 7f9f8ffff700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 0x7f9f74055a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f9f8000b000 tx=0x7f9f80009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.421+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f78042c20 con 0x7f9f900b5f70 2021-10-21T00:09:42.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.585+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f90067810 con 0x7f9f900b5f70 2021-10-21T00:09:42.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f8dffb700 1 -- 172.21.15.41:0/2988247733 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f9f78046240 con 0x7f9f900b5f70 2021-10-21T00:09:42.594 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:42.594 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:08:43.702897+0000","modified":"2021-10-21T00:09:42.282699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":71,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-10-21T00:09:42.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 msgr2=0x7f9f74055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 0x7f9f74055a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f9f8000b000 tx=0x7f9f80009040).stop 2021-10-21T00:09:42.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 msgr2=0x7f9f90065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f9f7800c000 tx=0x7f9f78006df0).stop 2021-10-21T00:09:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 shutdown_connections 2021-10-21T00:09:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f74053580 0x7f9f74055a40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f901448e0 0x7f9f90153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f900b5f70 0x7f9f90065d00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 --2- 172.21.15.41:0/2988247733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f900aebb0 0x7f9f900655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 >> 172.21.15.41:0/2988247733 conn(0x7f9f900639f0 msgr2=0x7f9f90144110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 shutdown_connections 2021-10-21T00:09:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.589+0000 7f9f95085700 1 -- 172.21.15.41:0/2988247733 wait complete. 2021-10-21T00:09:42.599 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 34 2021-10-21T00:09:42.606 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:09:42.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.753+0000 7f50b31ce700 1 Processor -- start 2021-10-21T00:09:42.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.753+0000 7f50b31ce700 1 -- start start 2021-10-21T00:09:42.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 0x7f50ac062190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac1479c0 con 0x7f50ac0b3a20 2021-10-21T00:09:42.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac147c60 con 0x7f50ac062680 2021-10-21T00:09:42.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac0b0d90 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b29cd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f50ac0b3a20 0x7f50ac05c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60186/0 (socket says 172.21.15.41:60186) 2021-10-21T00:09:42.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b29cd700 1 -- 172.21.15.41:0/3598163108 learned_addr learned my addr 172.21.15.41:0/3598163108 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:42.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b21cc700 1 --2- 172.21.15.41:0/3598163108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 0x7f50ac062190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861115764 0 0) 0x7f50ac1479c0 con 0x7f50ac0b3a20 2021-10-21T00:09:42.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5098003260 con 0x7f50ac0b3a20 2021-10-21T00:09:42.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854757440 0 0) 0x7f50ac147c60 con 0x7f50ac062680 2021-10-21T00:09:42.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ac1479c0 con 0x7f50ac062680 2021-10-21T00:09:42.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b21cc700 1 -- 172.21.15.41:0/3598163108 >> v1:172.21.15.62:6789/0 conn(0x7f50ac062680 legacy=0x7f50ac05bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b21cc700 1 -- 172.21.15.41:0/3598163108 >> v1:172.21.15.41:6789/0 conn(0x7f50ac0b3a20 legacy=0x7f50ac05c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1380324657 0 0) 0x7f5098003260 con 0x7f50ac0b3a20 2021-10-21T00:09:42.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b21cc700 1 -- 172.21.15.41:0/3598163108 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0b3f30 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b21cc700 1 --2- 172.21.15.41:0/3598163108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 0x7f50ac062190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f50a4001110 tx=0x7f509c006df0).ready entity=mon.2 client_cookie=9aee31172bfba1c2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50a4001660 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c000e90 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b11ca700 1 -- 172.21.15.41:0/3598163108 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c012460 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- 172.21.15.41:0/3598163108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 msgr2=0x7f50ac062190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 --2- 172.21.15.41:0/3598163108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 0x7f50ac062190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f50a4001110 tx=0x7f509c006df0).stop 2021-10-21T00:09:42.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- 172.21.15.41:0/3598163108 shutdown_connections 2021-10-21T00:09:42.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 --2- 172.21.15.41:0/3598163108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac0b2cf0 0x7f50ac062190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- 172.21.15.41:0/3598163108 >> 172.21.15.41:0/3598163108 conn(0x7f50ac0b9080 msgr2=0x7f50ac0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- 172.21.15.41:0/3598163108 shutdown_connections 2021-10-21T00:09:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 -- 172.21.15.41:0/3598163108 wait complete. 2021-10-21T00:09:42.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.757+0000 7f50b31ce700 1 Processor -- start 2021-10-21T00:09:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- start start 2021-10-21T00:09:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 0x7f50ac0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50ac0b2cf0 0x7f50ac13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac142670 con 0x7f50ac0b3a20 2021-10-21T00:09:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac142910 con 0x7f50ac0b2cf0 2021-10-21T00:09:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac142bb0 con 0x7f50ac062680 2021-10-21T00:09:42.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b19cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50ac0b2cf0 0x7f50ac13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34188/0 (socket says 172.21.15.41:34188) 2021-10-21T00:09:42.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 -- 172.21.15.41:0/2315361079 learned_addr learned my addr 172.21.15.41:0/2315361079 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:42.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b21cc700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 0x7f50ac0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 -- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 msgr2=0x7f50ac0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 0x7f50ac0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 -- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50ac0b2cf0 msgr2=0x7f50ac13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:42.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50ac0b2cf0 0x7f50ac13e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 -- 172.21.15.41:0/2315361079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c00b180 con 0x7f50ac0b3a20 2021-10-21T00:09:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b21cc700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 0x7f50ac0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b29cd700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f50a4001840 tx=0x7f50a40016c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50a4007170 con 0x7f50ac0b3a20 2021-10-21T00:09:42.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40072d0 con 0x7f50ac0b3a20 2021-10-21T00:09:42.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac142e50 con 0x7f50ac0b3a20 2021-10-21T00:09:42.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50a4004710 con 0x7f50ac0b3a20 2021-10-21T00:09:42.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.761+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac1432f0 con 0x7f50ac0b3a20 2021-10-21T00:09:42.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac14b2c0 con 0x7f50ac0b3a20 2021-10-21T00:09:42.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f50a4004870 con 0x7f50ac0b3a20 2021-10-21T00:09:42.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50a37fe700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 0x7f508c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:42.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f50a406b340 con 0x7f50ac0b3a20 2021-10-21T00:09:42.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50b21cc700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 0x7f508c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:42.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.765+0000 7f50b21cc700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 0x7f508c055a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f509c018000 tx=0x7f509c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:42.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.773+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50a4042420 con 0x7f50ac0b3a20 2021-10-21T00:09:42.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:42.933+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f50ac142fe0 con 0x7f50ac0b3a20 2021-10-21T00:09:43.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.533+0000 7f50a37fe700 1 -- 172.21.15.41:0/2315361079 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50a4045a40 con 0x7f50ac0b3a20 2021-10-21T00:09:43.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 msgr2=0x7f508c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 0x7f508c055a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f509c018000 tx=0x7f509c014000).stop 2021-10-21T00:09:43.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 msgr2=0x7f50ac13e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f50a4001840 tx=0x7f50a40016c0).stop 2021-10-21T00:09:43.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 shutdown_connections 2021-10-21T00:09:43.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f508c0535b0 0x7f508c055a70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f50ac0b3a20 0x7f50ac13e590 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f50ac0b2cf0 0x7f50ac13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 --2- 172.21.15.41:0/2315361079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f50ac062680 0x7f50ac0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 >> 172.21.15.41:0/2315361079 conn(0x7f50ac0b9080 msgr2=0x7f50ac13efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:43.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 shutdown_connections 2021-10-21T00:09:43.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.537+0000 7f50b31ce700 1 -- 172.21.15.41:0/2315361079 wait complete. 2021-10-21T00:09:43.562 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:09:43.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.669+0000 7f3e31730700 1 Processor -- start 2021-10-21T00:09:43.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.669+0000 7f3e31730700 1 -- start start 2021-10-21T00:09:43.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e31730700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 0x7f3e2c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:43.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e31730700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c142ad0 con 0x7f3e2c142f00 2021-10-21T00:09:43.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e31730700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c145f90 con 0x7f3e2c062330 2021-10-21T00:09:43.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e31730700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0b3520 con 0x7f3e2c13cc20 2021-10-21T00:09:43.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e30f2f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3e2c142f00 0x7f3e2c1433b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60198/0 (socket says 172.21.15.41:60198) 2021-10-21T00:09:43.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e30f2f700 1 -- 172.21.15.41:0/214246687 learned_addr learned my addr 172.21.15.41:0/214246687 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:43.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e237fe700 1 --2- 172.21.15.41:0/214246687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 0x7f3e2c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:43.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800248714 0 0) 0x7f3e2c142ad0 con 0x7f3e2c142f00 2021-10-21T00:09:43.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e10003260 con 0x7f3e2c142f00 2021-10-21T00:09:43.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854012501 0 0) 0x7f3e2c145f90 con 0x7f3e2c062330 2021-10-21T00:09:43.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e237fe700 1 -- 172.21.15.41:0/214246687 >> v1:172.21.15.62:6789/0 conn(0x7f3e2c062330 legacy=0x7f3e2c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e237fe700 1 -- 172.21.15.41:0/214246687 >> v1:172.21.15.41:6789/0 conn(0x7f3e2c142f00 legacy=0x7f3e2c1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e237fe700 1 -- 172.21.15.41:0/214246687 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c146230 con 0x7f3e2c13cc20 2021-10-21T00:09:43.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e237fe700 1 --2- 172.21.15.41:0/214246687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 0x7f3e2c0b4140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3e24001b80 tx=0x7f3e14006df0).ready entity=mon.2 client_cookie=966c15344a1a6484 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:43.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e240019e0 con 0x7f3e2c13cc20 2021-10-21T00:09:43.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14000e90 con 0x7f3e2c13cc20 2021-10-21T00:09:43.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.673+0000 7f3e2b7fe700 1 -- 172.21.15.41:0/214246687 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e1400d4a0 con 0x7f3e2c13cc20 2021-10-21T00:09:43.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- 172.21.15.41:0/214246687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 msgr2=0x7f3e2c0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 --2- 172.21.15.41:0/214246687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 0x7f3e2c0b4140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3e24001b80 tx=0x7f3e14006df0).stop 2021-10-21T00:09:43.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- 172.21.15.41:0/214246687 shutdown_connections 2021-10-21T00:09:43.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 --2- 172.21.15.41:0/214246687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c13cc20 0x7f3e2c0b4140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- 172.21.15.41:0/214246687 >> 172.21.15.41:0/214246687 conn(0x7f3e2c0b9080 msgr2=0x7f3e2c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:43.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- 172.21.15.41:0/214246687 shutdown_connections 2021-10-21T00:09:43.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- 172.21.15.41:0/214246687 wait complete. 2021-10-21T00:09:43.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 Processor -- start 2021-10-21T00:09:43.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.677+0000 7f3e31730700 1 -- start start 2021-10-21T00:09:43.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e2c062330 0x7f3e2c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:43.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 0x7f3e2c0ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:43.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:43.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ad610 con 0x7f3e2c0af430 2021-10-21T00:09:43.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c143e90 con 0x7f3e2c062330 2021-10-21T00:09:43.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ad7f0 con 0x7f3e2c142f00 2021-10-21T00:09:43.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:43.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34204/0 (socket says 172.21.15.41:34204) 2021-10-21T00:09:43.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 -- 172.21.15.41:0/3740355150 learned_addr learned my addr 172.21.15.41:0/3740355150 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:43.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e237fe700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 0x7f3e2c0ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:43.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e2bfff700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e2c062330 0x7f3e2c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:43.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 -- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 msgr2=0x7f3e2c0ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 0x7f3e2c0ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 -- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e2c062330 msgr2=0x7f3e2c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:43.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e2c062330 0x7f3e2c1454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:43.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 -- 172.21.15.41:0/3740355150 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1400b180 con 0x7f3e2c0af430 2021-10-21T00:09:43.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e237fe700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 0x7f3e2c0ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:43.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e30f2f700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f3e240016f0 tx=0x7f3e24001d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:43.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e24004ab0 con 0x7f3e2c0af430 2021-10-21T00:09:43.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e24004c10 con 0x7f3e2c0af430 2021-10-21T00:09:43.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c0ada90 con 0x7f3e2c0af430 2021-10-21T00:09:43.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e24007170 con 0x7f3e2c0af430 2021-10-21T00:09:43.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c0ae700 con 0x7f3e2c0af430 2021-10-21T00:09:43.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.681+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c063020 con 0x7f3e2c0af430 2021-10-21T00:09:43.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.685+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e24010070 con 0x7f3e2c0af430 2021-10-21T00:09:43.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.685+0000 7f3e29ffb700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 0x7f3e04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:43.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.685+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f3e2406b760 con 0x7f3e2c0af430 2021-10-21T00:09:43.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.685+0000 7f3e2bfff700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 0x7f3e04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:43.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.685+0000 7f3e2bfff700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 0x7f3e04055a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f3e1c00b000 tx=0x7f3e1c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:43.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.689+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e24042840 con 0x7f3e2c0af430 2021-10-21T00:09:43.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:43.817+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e2c057350 con 0x7f3e2c0af430 2021-10-21T00:09:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.557+0000 7f3e29ffb700 1 -- 172.21.15.41:0/3740355150 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3e24045e60 con 0x7f3e2c0af430 2021-10-21T00:09:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 msgr2=0x7f3e04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 0x7f3e04055a40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f3e1c00b000 tx=0x7f3e1c009040).stop 2021-10-21T00:09:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 msgr2=0x7f3e2c0ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f3e240016f0 tx=0x7f3e24001d00).stop 2021-10-21T00:09:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 shutdown_connections 2021-10-21T00:09:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e04053580 0x7f3e04055a40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e2c0af430 0x7f3e2c0ae210 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e2c142f00 0x7f3e2c0ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 --2- 172.21.15.41:0/3740355150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e2c062330 0x7f3e2c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 >> 172.21.15.41:0/3740355150 conn(0x7f3e2c0b9080 msgr2=0x7f3e2c146480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 shutdown_connections 2021-10-21T00:09:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.561+0000 7f3e31730700 1 -- 172.21.15.41:0/3740355150 wait complete. 2021-10-21T00:09:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:09:44.581 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:09:44.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.693+0000 7f3bb6636700 1 Processor -- start 2021-10-21T00:09:44.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.693+0000 7f3bb6636700 1 -- start start 2021-10-21T00:09:44.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bb0062330 0x7f3bb00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb0143610 0x7f3bb013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb0142ad0 con 0x7f3bb013c510 2021-10-21T00:09:44.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00b3520 con 0x7f3bb0062330 2021-10-21T00:09:44.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0143c40 con 0x7f3bb0143610 2021-10-21T00:09:44.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bb0062330 0x7f3bb00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bb0062330 0x7f3bb00b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34208/0 (socket says 172.21.15.41:34208) 2021-10-21T00:09:44.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 -- 172.21.15.41:0/2118217019 learned_addr learned my addr 172.21.15.41:0/2118217019 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:44.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5e35700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb0143610 0x7f3bb013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 -- 172.21.15.41:0/2118217019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb0143610 msgr2=0x7f3bb013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:44.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb0143610 0x7f3bb013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 -- 172.21.15.41:0/2118217019 >> v1:172.21.15.41:6789/0 conn(0x7f3bb013c510 legacy=0x7f3bb0142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 -- 172.21.15.41:0/2118217019 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb013ce60 con 0x7f3bb0062330 2021-10-21T00:09:44.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb5634700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0062330 0x7f3bb00b4140 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3bac002f70 tx=0x7f3bac006eb0).ready entity=mon.0 client_cookie=8df747c4133667d2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:44.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3b9ffff700 1 -- 172.21.15.41:0/2118217019 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bac00d5c0 con 0x7f3bb0062330 2021-10-21T00:09:44.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3b9ffff700 1 -- 172.21.15.41:0/2118217019 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac000e90 con 0x7f3bb0062330 2021-10-21T00:09:44.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3b9ffff700 1 -- 172.21.15.41:0/2118217019 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bac00d950 con 0x7f3bb0062330 2021-10-21T00:09:44.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- 172.21.15.41:0/2118217019 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0062330 msgr2=0x7f3bb00b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0062330 0x7f3bb00b4140 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3bac002f70 tx=0x7f3bac006eb0).stop 2021-10-21T00:09:44.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- 172.21.15.41:0/2118217019 shutdown_connections 2021-10-21T00:09:44.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb0143610 0x7f3bb013c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 --2- 172.21.15.41:0/2118217019 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0062330 0x7f3bb00b4140 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- 172.21.15.41:0/2118217019 >> 172.21.15.41:0/2118217019 conn(0x7f3bb00b9080 msgr2=0x7f3bb00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:44.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- 172.21.15.41:0/2118217019 shutdown_connections 2021-10-21T00:09:44.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.697+0000 7f3bb6636700 1 -- 172.21.15.41:0/2118217019 wait complete. 2021-10-21T00:09:44.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 Processor -- start 2021-10-21T00:09:44.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- start start 2021-10-21T00:09:44.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bb0062330 0x7f3bb0141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb013c510 0x7f3bb00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb013d4d0 con 0x7f3bb0143610 2021-10-21T00:09:44.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb01522c0 con 0x7f3bb0062330 2021-10-21T00:09:44.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0152560 con 0x7f3bb013c510 2021-10-21T00:09:44.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34218/0 (socket says 172.21.15.41:34218) 2021-10-21T00:09:44.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 -- 172.21.15.41:0/1833267828 learned_addr learned my addr 172.21.15.41:0/1833267828 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:44.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5634700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bb0062330 0x7f3bb0141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb4e33700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb013c510 0x7f3bb00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 -- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb013c510 msgr2=0x7f3bb00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb013c510 0x7f3bb00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 -- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bb0062330 msgr2=0x7f3bb0141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:44.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bb0062330 0x7f3bb0141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:44.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 -- 172.21.15.41:0/1833267828 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac00b1e0 con 0x7f3bb0143610 2021-10-21T00:09:44.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb5e35700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f3ba800a000 tx=0x7f3ba8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:44.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ba80127e0 con 0x7f3bb0143610 2021-10-21T00:09:44.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8012940 con 0x7f3bb0143610 2021-10-21T00:09:44.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ba8012ca0 con 0x7f3bb0143610 2021-10-21T00:09:44.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0152800 con 0x7f3bb0143610 2021-10-21T00:09:44.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.701+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00af290 con 0x7f3bb0143610 2021-10-21T00:09:44.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0152990 con 0x7f3bb0143610 2021-10-21T00:09:44.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ba8013480 con 0x7f3bb0143610 2021-10-21T00:09:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3b9e7fc700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 0x7f3b90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f3ba806bbd0 con 0x7f3bb0143610 2021-10-21T00:09:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3bb5634700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 0x7f3b90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:44.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.705+0000 7f3bb5634700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 0x7f3b90055ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f3bac01c000 tx=0x7f3bac015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:44.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.713+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ba8042cf0 con 0x7f3bb0143610 2021-10-21T00:09:44.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:44.841+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bb0145f90 con 0x7f3bb0143610 2021-10-21T00:09:45.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.565+0000 7f3b9e7fc700 1 -- 172.21.15.41:0/1833267828 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3ba8012e00 con 0x7f3bb0143610 2021-10-21T00:09:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 msgr2=0x7f3b90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 0x7f3b90055ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f3bac01c000 tx=0x7f3bac015000).stop 2021-10-21T00:09:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 msgr2=0x7f3bb00aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f3ba800a000 tx=0x7f3ba8008040).stop 2021-10-21T00:09:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 shutdown_connections 2021-10-21T00:09:45.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3b90053610 0x7f3b90055ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bb0143610 0x7f3bb00aeda0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bb013c510 0x7f3bb00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 --2- 172.21.15.41:0/1833267828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bb0062330 0x7f3bb0141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 >> 172.21.15.41:0/1833267828 conn(0x7f3bb00b9080 msgr2=0x7f3bb00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 shutdown_connections 2021-10-21T00:09:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.569+0000 7f3bb6636700 1 -- 172.21.15.41:0/1833267828 wait complete. 2021-10-21T00:09:45.579 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:09:45.592 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:09:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 Processor -- start 2021-10-21T00:09:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 -- start start 2021-10-21T00:09:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f72b80b9c20 0x7f72b80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80ba000 con 0x7f72b80b41a0 2021-10-21T00:09:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b805ccc0 con 0x7f72b80b9c20 2021-10-21T00:09:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bdafe700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8142ad0 con 0x7f72b805c860 2021-10-21T00:09:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bcafc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f72b80b9c20 0x7f72b80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bcafc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f72b80b9c20 0x7f72b80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34222/0 (socket says 172.21.15.41:34222) 2021-10-21T00:09:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bcafc700 1 -- 172.21.15.41:0/3793239316 learned_addr learned my addr 172.21.15.41:0/3793239316 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72b7fff700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.701+0000 7f72bd2fd700 1 --1- 172.21.15.41:0/3793239316 >> v1:172.21.15.62:6789/0 conn(0x7f72b80b41a0 0x7f72b8145f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40052/0 (socket says 172.21.15.41:40052) 2021-10-21T00:09:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 -- 172.21.15.41:0/3793239316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 msgr2=0x7f72b81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 -- 172.21.15.41:0/3793239316 >> v1:172.21.15.62:6789/0 conn(0x7f72b80b41a0 legacy=0x7f72b8145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 -- 172.21.15.41:0/3793239316 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8142d70 con 0x7f72b80b9c20 2021-10-21T00:09:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b80acd30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f72a8002f70 tx=0x7f72a8006eb0).ready entity=mon.0 client_cookie=4f4f5e888a5284e8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72b77fe700 1 -- 172.21.15.41:0/3793239316 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a800d5c0 con 0x7f72b80b9c20 2021-10-21T00:09:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72b77fe700 1 -- 172.21.15.41:0/3793239316 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8000e90 con 0x7f72b80b9c20 2021-10-21T00:09:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72b77fe700 1 -- 172.21.15.41:0/3793239316 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a800d950 con 0x7f72b80b9c20 2021-10-21T00:09:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- 172.21.15.41:0/3793239316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 msgr2=0x7f72b80acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b80acd30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f72a8002f70 tx=0x7f72a8006eb0).stop 2021-10-21T00:09:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- 172.21.15.41:0/3793239316 shutdown_connections 2021-10-21T00:09:45.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- 172.21.15.41:0/3793239316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b80acd30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- 172.21.15.41:0/3793239316 >> 172.21.15.41:0/3793239316 conn(0x7f72b8062f00 msgr2=0x7f72b80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:45.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- 172.21.15.41:0/3793239316 shutdown_connections 2021-10-21T00:09:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- 172.21.15.41:0/3793239316 wait complete. 2021-10-21T00:09:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 Processor -- start 2021-10-21T00:09:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- start start 2021-10-21T00:09:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 0x7f72b813d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80aecc0 con 0x7f72b80b9c20 2021-10-21T00:09:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80aef60 con 0x7f72b80b41a0 2021-10-21T00:09:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bdafe700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80af200 con 0x7f72b805c860 2021-10-21T00:09:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bd2fd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bd2fd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34230/0 (socket says 172.21.15.41:34230) 2021-10-21T00:09:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bd2fd700 1 -- 172.21.15.41:0/2497549063 learned_addr learned my addr 172.21.15.41:0/2497549063 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72bcafc700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.705+0000 7f72b7fff700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 0x7f72b813d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 -- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 msgr2=0x7f72b81473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 -- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 msgr2=0x7f72b813d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 0x7f72b813d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 -- 172.21.15.41:0/2497549063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a800b1e0 con 0x7f72b80b9c20 2021-10-21T00:09:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bcafc700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b7fff700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 0x7f72b813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bd2fd700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f72b80633e0 tx=0x7f72b0007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b0005ae0 con 0x7f72b80b9c20 2021-10-21T00:09:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0005c40 con 0x7f72b80b9c20 2021-10-21T00:09:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b80adbf0 con 0x7f72b80b9c20 2021-10-21T00:09:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72b00070d0 con 0x7f72b80b9c20 2021-10-21T00:09:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b8151b50 con 0x7f72b80b9c20 2021-10-21T00:09:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b8143010 con 0x7f72b80b9c20 2021-10-21T00:09:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f72b0010070 con 0x7f72b80b9c20 2021-10-21T00:09:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 0x7f729c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.709+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f72b006b160 con 0x7f72b80b9c20 2021-10-21T00:09:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.713+0000 7f72bcafc700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 0x7f729c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.713+0000 7f72bcafc700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 0x7f729c055b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f72a801a000 tx=0x7f72a8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.717+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f72b00424d0 con 0x7f72b80b9c20 2021-10-21T00:09:45.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.841+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f72b8057350 con 0x7f72b80b9c20 2021-10-21T00:09:45.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.849+0000 7f72b5ffb700 1 -- 172.21.15.41:0/2497549063 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72b0045af0 con 0x7f72b80b9c20 2021-10-21T00:09:45.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 msgr2=0x7f729c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 0x7f729c055b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f72a801a000 tx=0x7f72a8014000).stop 2021-10-21T00:09:45.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 msgr2=0x7f72b813ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f72b80633e0 tx=0x7f72b0007f40).stop 2021-10-21T00:09:45.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 shutdown_connections 2021-10-21T00:09:45.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f729c0536a0 0x7f729c055b60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72b80b9c20 0x7f72b813ddb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b80b41a0 0x7f72b813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 --2- 172.21.15.41:0/2497549063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b805c860 0x7f72b81473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 >> 172.21.15.41:0/2497549063 conn(0x7f72b8062f00 msgr2=0x7f72b80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:45.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 shutdown_connections 2021-10-21T00:09:45.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.853+0000 7f72bdafe700 1 -- 172.21.15.41:0/2497549063 wait complete. 2021-10-21T00:09:45.874 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-10-21T00:09:45.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 Processor -- start 2021-10-21T00:09:45.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 -- start start 2021-10-21T00:09:45.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 0x7fe3600609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3600abd10 con 0x7fe36009a450 2021-10-21T00:09:45.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36009a830 con 0x7fe36005fdc0 2021-10-21T00:09:45.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.973+0000 7fe36729b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600afed0 con 0x7fe3600ab880 2021-10-21T00:09:45.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe365037700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe36009a450 0x7fe36005f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60238/0 (socket says 172.21.15.41:60238) 2021-10-21T00:09:45.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe365037700 1 -- 172.21.15.41:0/330848134 learned_addr learned my addr 172.21.15.41:0/330848134 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:45.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe364836700 1 --2- 172.21.15.41:0/330848134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 0x7fe3600609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919988972 0 0) 0x7fe3600abd10 con 0x7fe36009a450 2021-10-21T00:09:45.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe344003260 con 0x7fe36009a450 2021-10-21T00:09:45.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330865676 0 0) 0x7fe36009a830 con 0x7fe36005fdc0 2021-10-21T00:09:45.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe364836700 1 -- 172.21.15.41:0/330848134 >> v1:172.21.15.62:6789/0 conn(0x7fe36005fdc0 legacy=0x7fe3600b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe364836700 1 -- 172.21.15.41:0/330848134 >> v1:172.21.15.41:6789/0 conn(0x7fe36009a450 legacy=0x7fe36005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe364836700 1 -- 172.21.15.41:0/330848134 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600b0170 con 0x7fe3600ab880 2021-10-21T00:09:45.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe364836700 1 --2- 172.21.15.41:0/330848134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 0x7fe3600609a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe35c002f70 tx=0x7fe35c006df0).ready entity=mon.2 client_cookie=db733e6e68460908 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:45.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35c00d570 con 0x7fe3600ab880 2021-10-21T00:09:45.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c000e90 con 0x7fe3600ab880 2021-10-21T00:09:45.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe357fff700 1 -- 172.21.15.41:0/330848134 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35c00d8c0 con 0x7fe3600ab880 2021-10-21T00:09:45.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 -- 172.21.15.41:0/330848134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 msgr2=0x7fe3600609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 --2- 172.21.15.41:0/330848134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 0x7fe3600609a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe35c002f70 tx=0x7fe35c006df0).stop 2021-10-21T00:09:45.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 -- 172.21.15.41:0/330848134 shutdown_connections 2021-10-21T00:09:45.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 --2- 172.21.15.41:0/330848134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3600ab880 0x7fe3600609a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 -- 172.21.15.41:0/330848134 >> 172.21.15.41:0/330848134 conn(0x7fe36005bca0 msgr2=0x7fe36005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:45.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 -- 172.21.15.41:0/330848134 shutdown_connections 2021-10-21T00:09:45.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.977+0000 7fe36729b700 1 -- 172.21.15.41:0/330848134 wait complete. 2021-10-21T00:09:45.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 Processor -- start 2021-10-21T00:09:45.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- start start 2021-10-21T00:09:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe36009a450 0x7fe360144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 0x7fe360144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360064a30 con 0x7fe36005fdc0 2021-10-21T00:09:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360145d30 con 0x7fe360066e70 2021-10-21T00:09:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600ad8f0 con 0x7fe36009a450 2021-10-21T00:09:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34242/0 (socket says 172.21.15.41:34242) 2021-10-21T00:09:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 -- 172.21.15.41:0/189510347 learned_addr learned my addr 172.21.15.41:0/189510347 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365838700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 0x7fe360144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe364836700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe36009a450 0x7fe360144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 -- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe36009a450 msgr2=0x7fe360144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe36009a450 0x7fe360144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 -- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 msgr2=0x7fe360144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 0x7fe360144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 -- 172.21.15.41:0/189510347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c00b180 con 0x7fe36005fdc0 2021-10-21T00:09:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365838700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 0x7fe360144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe365037700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fe350001110 tx=0x7fe350007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:46.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3500070d0 con 0x7fe36005fdc0 2021-10-21T00:09:46.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350007230 con 0x7fe36005fdc0 2021-10-21T00:09:46.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe350005610 con 0x7fe36005fdc0 2021-10-21T00:09:46.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe360065da0 con 0x7fe36005fdc0 2021-10-21T00:09:46.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.981+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3600662e0 con 0x7fe36005fdc0 2021-10-21T00:09:46.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe360065bc0 con 0x7fe36005fdc0 2021-10-21T00:09:46.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe350010070 con 0x7fe36005fdc0 2021-10-21T00:09:46.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe3567fc700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 0x7fe348055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe35006aca0 con 0x7fe36005fdc0 2021-10-21T00:09:46.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe364836700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 0x7fe348055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.985+0000 7fe364836700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 0x7fe348055b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fe35c018000 tx=0x7fe35c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:46.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:45.989+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe35006f070 con 0x7fe36005fdc0 2021-10-21T00:09:46.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.153+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fe360057350 con 0x7fe36005fdc0 2021-10-21T00:09:46.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.569+0000 7fe3567fc700 1 -- 172.21.15.41:0/189510347 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v290) v1 ==== 139+0+0 (secure 0 0 0) 0x7fe3500420b0 con 0x7fe36005fdc0 2021-10-21T00:09:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 msgr2=0x7fe348055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 0x7fe348055b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fe35c018000 tx=0x7fe35c014000).stop 2021-10-21T00:09:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 msgr2=0x7fe3600acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fe350001110 tx=0x7fe350007aa0).stop 2021-10-21T00:09:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 shutdown_connections 2021-10-21T00:09:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3480536a0 0x7fe348055b60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe360066e70 0x7fe360144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe36009a450 0x7fe360144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 --2- 172.21.15.41:0/189510347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe36005fdc0 0x7fe3600acc80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 >> 172.21.15.41:0/189510347 conn(0x7fe36005bca0 msgr2=0x7fe36005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:46.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 shutdown_connections 2021-10-21T00:09:46.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.573+0000 7fe36729b700 1 -- 172.21.15.41:0/189510347 wait complete. 2021-10-21T00:09:46.595 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:09:46.595 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:09:46.596 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-10-21T00:09:46.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 Processor -- start 2021-10-21T00:09:46.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 -- start start 2021-10-21T00:09:46.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241805fdd0 con 0x7f24180b3150 2021-10-21T00:09:46.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2418140400 con 0x7f24180b0730 2021-10-21T00:09:46.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241e3b0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24180b27c0 con 0x7f241805f9f0 2021-10-21T00:09:46.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241cbad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241cbad700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:46168/0 (socket says 172.21.15.41:46168) 2021-10-21T00:09:46.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241dbaf700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f24180b3150 0x7f2418142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40080/0 (socket says 172.21.15.41:40080) 2021-10-21T00:09:46.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241cbad700 1 -- 172.21.15.41:0/1454676217 learned_addr learned my addr 172.21.15.41:0/1454676217 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:46.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:52748/0 (socket says 172.21.15.41:52748) 2021-10-21T00:09:46.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 -- 172.21.15.41:0/1454676217 >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 msgr2=0x7f24180b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:46.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 --2- 172.21.15.41:0/1454676217 >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 -- 172.21.15.41:0/1454676217 >> v1:172.21.15.62:6789/0 conn(0x7f24180b3150 legacy=0x7f2418142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 -- 172.21.15.41:0/1454676217 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180b35a0 con 0x7f241805f9f0 2021-10-21T00:09:46.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241cbad700 1 --2- 172.21.15.41:0/1454676217 >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:46.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f241d3ae700 1 --2- 172.21.15.41:0/1454676217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2414002f70 tx=0x7f2414006d90).ready entity=mon.2 client_cookie=4824e803bd662c1c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:46.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.697+0000 7f240ffff700 1 -- 172.21.15.41:0/1454676217 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241400d4a0 con 0x7f241805f9f0 2021-10-21T00:09:46.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f240ffff700 1 -- 172.21.15.41:0/1454676217 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414000e90 con 0x7f241805f9f0 2021-10-21T00:09:46.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f240ffff700 1 -- 172.21.15.41:0/1454676217 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f241400d7f0 con 0x7f241805f9f0 2021-10-21T00:09:46.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- 172.21.15.41:0/1454676217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 msgr2=0x7f24180b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- 172.21.15.41:0/1454676217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2414002f70 tx=0x7f2414006d90).stop 2021-10-21T00:09:46.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- 172.21.15.41:0/1454676217 shutdown_connections 2021-10-21T00:09:46.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- 172.21.15.41:0/1454676217 >> v2:172.21.15.62:3300/0 conn(0x7f24180b0730 0x7f24180b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- 172.21.15.41:0/1454676217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f241805f9f0 0x7f24180b0e50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- 172.21.15.41:0/1454676217 >> 172.21.15.41:0/1454676217 conn(0x7f24180637b0 msgr2=0x7f2418063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:46.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- 172.21.15.41:0/1454676217 shutdown_connections 2021-10-21T00:09:46.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- 172.21.15.41:0/1454676217 wait complete. 2021-10-21T00:09:46.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 Processor -- start 2021-10-21T00:09:46.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- start start 2021-10-21T00:09:46.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 0x7f2418066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24180b3150 0x7f241813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418066730 con 0x7f24180b0730 2021-10-21T00:09:46.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241813f3f0 con 0x7f241805f9f0 2021-10-21T00:09:46.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241e3b0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2418066960 con 0x7f24180b3150 2021-10-21T00:09:46.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241cbad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241cbad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34258/0 (socket says 172.21.15.41:34258) 2021-10-21T00:09:46.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241cbad700 1 -- 172.21.15.41:0/792252042 learned_addr learned my addr 172.21.15.41:0/792252042 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:46.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241d3ae700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 0x7f2418066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.701+0000 7f241dbaf700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24180b3150 0x7f241813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 -- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24180b3150 msgr2=0x7f241813ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24180b3150 0x7f241813ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 -- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 msgr2=0x7f2418066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:46.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 0x7f2418066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:46.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 -- 172.21.15.41:0/792252042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240800b460 con 0x7f24180b0730 2021-10-21T00:09:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241d3ae700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 0x7f2418066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241cbad700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f240800e000 tx=0x7f2408006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f240800da50 con 0x7f24180b0730 2021-10-21T00:09:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800dbb0 con 0x7f24180b0730 2021-10-21T00:09:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241400b120 con 0x7f24180b0730 2021-10-21T00:09:46.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2408010440 con 0x7f24180b0730 2021-10-21T00:09:46.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241813ded0 con 0x7f24180b0730 2021-10-21T00:09:46.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2418140080 con 0x7f24180b0730 2021-10-21T00:09:46.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f24080105a0 con 0x7f24180b0730 2021-10-21T00:09:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 0x7f2400055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f240806c210 con 0x7f24180b0730 2021-10-21T00:09:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.705+0000 7f241d3ae700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 0x7f2400055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.709+0000 7f241d3ae700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 0x7f2400055ad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f2414018000 tx=0x7f2414014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.713+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24080434b0 con 0x7f24180b0730 2021-10-21T00:09:46.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:46.885+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f2418057350 con 0x7f24180b0730 2021-10-21T00:09:47.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.569+0000 7f240e7fc700 1 -- 172.21.15.41:0/792252042 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v291) v1 ==== 129+0+0 (secure 0 0 0) 0x7f2408046ad0 con 0x7f24180b0730 2021-10-21T00:09:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 msgr2=0x7f2400055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 0x7f2400055ad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f2414018000 tx=0x7f2414014000).stop 2021-10-21T00:09:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 msgr2=0x7f2418063ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f240800e000 tx=0x7f2408006f40).stop 2021-10-21T00:09:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 shutdown_connections 2021-10-21T00:09:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2400053610 0x7f2400055ad0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24180b3150 0x7f241813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f24180b0730 0x7f2418063ed0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 --2- 172.21.15.41:0/792252042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f241805f9f0 0x7f2418066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 >> 172.21.15.41:0/792252042 conn(0x7f24180637b0 msgr2=0x7f241805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 shutdown_connections 2021-10-21T00:09:47.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.573+0000 7f241e3b0700 1 -- 172.21.15.41:0/792252042 wait complete. 2021-10-21T00:09:47.600 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:09:47.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.709+0000 7f3ea257f700 1 Processor -- start 2021-10-21T00:09:47.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.709+0000 7f3ea257f700 1 -- start start 2021-10-21T00:09:47.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e9c0b9b10 0x7f3e9c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 0x7f3e9c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b5310 0x7f3e9c05bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0b5740 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0b4120 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea257f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0b46e0 con 0x7f3e9c0b5310 2021-10-21T00:09:47.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e9c0b9b10 0x7f3e9c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e9c0b9b10 0x7f3e9c146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34266/0 (socket says 172.21.15.41:34266) 2021-10-21T00:09:47.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 0x7f3e9c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3ea0b1c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b5310 0x7f3e9c05bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 -- 172.21.15.41:0/3113338687 learned_addr learned my addr 172.21.15.41:0/3113338687 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:47.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 -- 172.21.15.41:0/3113338687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b5310 msgr2=0x7f3e9c05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:47.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/3113338687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b5310 0x7f3e9c05bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 -- 172.21.15.41:0/3113338687 >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 msgr2=0x7f3e9c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/3113338687 >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 0x7f3e9c0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 -- 172.21.15.41:0/3113338687 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0b4980 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9b7fe700 1 --2- 172.21.15.41:0/3113338687 >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 0x7f3e9c0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:47.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/3113338687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b9b10 0x7f3e9c146d30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f3e8c002f70 tx=0x7f3e8c006eb0).ready entity=mon.0 client_cookie=aa4ee4081980be32 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:47.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9affd700 1 -- 172.21.15.41:0/3113338687 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8c00d570 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9affd700 1 -- 172.21.15.41:0/3113338687 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c000e90 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.713+0000 7f3e9affd700 1 -- 172.21.15.41:0/3113338687 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8c00d900 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- 172.21.15.41:0/3113338687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b9b10 msgr2=0x7f3e9c146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 --2- 172.21.15.41:0/3113338687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b9b10 0x7f3e9c146d30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f3e8c002f70 tx=0x7f3e8c006eb0).stop 2021-10-21T00:09:47.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- 172.21.15.41:0/3113338687 shutdown_connections 2021-10-21T00:09:47.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 --2- 172.21.15.41:0/3113338687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b5310 0x7f3e9c05bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 --2- 172.21.15.41:0/3113338687 >> v2:172.21.15.62:3300/0 conn(0x7f3e9c0b0ac0 0x7f3e9c0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 --2- 172.21.15.41:0/3113338687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b9b10 0x7f3e9c146d30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- 172.21.15.41:0/3113338687 >> 172.21.15.41:0/3113338687 conn(0x7f3e9c062ec0 msgr2=0x7f3e9c0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- 172.21.15.41:0/3113338687 shutdown_connections 2021-10-21T00:09:47.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- 172.21.15.41:0/3113338687 wait complete. 2021-10-21T00:09:47.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 Processor -- start 2021-10-21T00:09:47.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.717+0000 7f3ea257f700 1 -- start start 2021-10-21T00:09:47.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e9c0b5310 0x7f3e9c1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b9b10 0x7f3e9c115010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0ae1c0 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0aea70 con 0x7f3e9c0b5310 2021-10-21T00:09:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c152ce0 con 0x7f3e9c0b9b10 2021-10-21T00:09:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34272/0 (socket says 172.21.15.41:34272) 2021-10-21T00:09:47.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 -- 172.21.15.41:0/866852074 learned_addr learned my addr 172.21.15.41:0/866852074 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:47.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea0b1c700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b9b10 0x7f3e9c115010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9b7fe700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e9c0b5310 0x7f3e9c1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 -- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b9b10 msgr2=0x7f3e9c115010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b9b10 0x7f3e9c115010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 -- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e9c0b5310 msgr2=0x7f3e9c1527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e9c0b5310 0x7f3e9c1527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 -- 172.21.15.41:0/866852074 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8400b120 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e9bfff700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f3e8c002f70 tx=0x7f3e8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:47.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8c011950 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c011ab0 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c00b1e0 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8c011e10 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c1531e0 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c0af480 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.721+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3e8c025030 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.725+0000 7f3e997fa700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 0x7f3e80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:47.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.725+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3e8c06c850 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.725+0000 7f3e9b7fe700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 0x7f3e80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:47.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.725+0000 7f3e9b7fe700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 0x7f3e80055b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f3e84008000 tx=0x7f3e84008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:47.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.729+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3e8c043c60 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.853+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3e9c057350 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.861+0000 7f3e997fa700 1 -- 172.21.15.41:0/866852074 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e8c023020 con 0x7f3e9c0b0ac0 2021-10-21T00:09:47.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 msgr2=0x7f3e80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 0x7f3e80055b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f3e84008000 tx=0x7f3e84008040).stop 2021-10-21T00:09:47.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 msgr2=0x7f3e9c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:47.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f3e8c002f70 tx=0x7f3e8c015000).stop 2021-10-21T00:09:47.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 shutdown_connections 2021-10-21T00:09:47.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3e800536a0 0x7f3e80055b60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e9c0b9b10 0x7f3e9c115010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e9c0b5310 0x7f3e9c1527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 --2- 172.21.15.41:0/866852074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e9c0b0ac0 0x7f3e9c152300 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:47.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 >> 172.21.15.41:0/866852074 conn(0x7f3e9c062ec0 msgr2=0x7f3e9c13ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:47.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 shutdown_connections 2021-10-21T00:09:47.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:47.865+0000 7f3ea257f700 1 -- 172.21.15.41:0/866852074 wait complete. 2021-10-21T00:09:47.884 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:09:47.885 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:47.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:47.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:47.969 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:47.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:09:48.027 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:09:48.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:48.028 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:48.028 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:09:48.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:48.043 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:09:48.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:48.044 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:48.045 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:09:48.053 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:09:48.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:48.055 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:09:48.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:48.056 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:48.056 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:09:48.088 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:09:48.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:09:48.089 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:09:48.090 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:09:48.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.193+0000 7f9fefe9d700 1 Processor -- start 2021-10-21T00:09:48.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.193+0000 7f9fefe9d700 1 -- start start 2021-10-21T00:09:48.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9fe805f9f0 0x7f9fe814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80609d0 con 0x7f9fe80aa750 2021-10-21T00:09:48.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe805fdd0 con 0x7f9fe814b350 2021-10-21T00:09:48.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80b1620 con 0x7f9fe805f9f0 2021-10-21T00:09:48.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fed438700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9fe80aa750 0x7f9fe814ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60284/0 (socket says 172.21.15.41:60284) 2021-10-21T00:09:48.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fed438700 1 -- 172.21.15.41:0/1513661867 learned_addr learned my addr 172.21.15.41:0/1513661867 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:48.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fedc39700 1 --2- 172.21.15.41:0/1513661867 >> v2:172.21.15.62:3300/0 conn(0x7f9fe805f9f0 0x7f9fe814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fedc39700 1 -- 172.21.15.41:0/1513661867 >> v1:172.21.15.62:6789/0 conn(0x7f9fe814b350 legacy=0x7f9fe80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fedc39700 1 -- 172.21.15.41:0/1513661867 >> v1:172.21.15.41:6789/0 conn(0x7f9fe80aa750 legacy=0x7f9fe814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fecc37700 1 -- 172.21.15.41:0/1513661867 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347964806 0 0) 0x7f9fe80609d0 con 0x7f9fe80aa750 2021-10-21T00:09:48.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fedc39700 1 -- 172.21.15.41:0/1513661867 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80b1380 con 0x7f9fe805f9f0 2021-10-21T00:09:48.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fedc39700 1 --2- 172.21.15.41:0/1513661867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe805f9f0 0x7f9fe814a750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f9fe00032f0 tx=0x7f9fe00091d0).ready entity=mon.1 client_cookie=d407874aa46ba503 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fecc37700 1 -- 172.21.15.41:0/1513661867 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe0009ea0 con 0x7f9fe805f9f0 2021-10-21T00:09:48.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fecc37700 1 -- 172.21.15.41:0/1513661867 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000b8a0 con 0x7f9fe805f9f0 2021-10-21T00:09:48.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fecc37700 1 -- 172.21.15.41:0/1513661867 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe000ba10 con 0x7f9fe805f9f0 2021-10-21T00:09:48.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- 172.21.15.41:0/1513661867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe805f9f0 msgr2=0x7f9fe814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/1513661867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe805f9f0 0x7f9fe814a750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f9fe00032f0 tx=0x7f9fe00091d0).stop 2021-10-21T00:09:48.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- 172.21.15.41:0/1513661867 shutdown_connections 2021-10-21T00:09:48.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/1513661867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe805f9f0 0x7f9fe814a750 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- 172.21.15.41:0/1513661867 >> 172.21.15.41:0/1513661867 conn(0x7f9fe805bca0 msgr2=0x7f9fe805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:48.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- 172.21.15.41:0/1513661867 shutdown_connections 2021-10-21T00:09:48.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.197+0000 7f9fefe9d700 1 -- 172.21.15.41:0/1513661867 wait complete. 2021-10-21T00:09:48.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 Processor -- start 2021-10-21T00:09:48.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- start start 2021-10-21T00:09:48.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fe805f9f0 0x7f9fe809a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe814b350 0x7f9fe8140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8146d10 con 0x7f9fe80aa750 2021-10-21T00:09:48.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8062810 con 0x7f9fe814b350 2021-10-21T00:09:48.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe81467d0 con 0x7f9fe805f9f0 2021-10-21T00:09:48.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34288/0 (socket says 172.21.15.41:34288) 2021-10-21T00:09:48.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 -- 172.21.15.41:0/328172686 learned_addr learned my addr 172.21.15.41:0/328172686 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:48.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fee43a700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe814b350 0x7f9fe8140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fedc39700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fe805f9f0 0x7f9fe809a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 -- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fe805f9f0 msgr2=0x7f9fe809a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fe805f9f0 0x7f9fe809a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 -- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe814b350 msgr2=0x7f9fe8140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe814b350 0x7f9fe8140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 -- 172.21.15.41:0/328172686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0009470 con 0x7f9fe80aa750 2021-10-21T00:09:48.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fed438700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f9fd8000bc0 tx=0x7f9fd8007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd80070d0 con 0x7f9fe80aa750 2021-10-21T00:09:48.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe8146a70 con 0x7f9fe80aa750 2021-10-21T00:09:48.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8007230 con 0x7f9fe80aa750 2021-10-21T00:09:48.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fd8005610 con 0x7f9fe80aa750 2021-10-21T00:09:48.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.201+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe8062c70 con 0x7f9fe80aa750 2021-10-21T00:09:48.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80678f0 con 0x7f9fe80aa750 2021-10-21T00:09:48.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fd8010070 con 0x7f9fe80aa750 2021-10-21T00:09:48.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fd6ffd700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 0x7f9fc8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9fd806ad90 con 0x7f9fe80aa750 2021-10-21T00:09:48.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fedc39700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 0x7f9fc8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.205+0000 7f9fedc39700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 0x7f9fc8055ad0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9fe001b000 tx=0x7f9fe0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.213+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9fd8042100 con 0x7f9fe80aa750 2021-10-21T00:09:48.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.341+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9fe8057350 con 0x7f9fe80aa750 2021-10-21T00:09:48.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.341+0000 7f9fd6ffd700 1 -- 172.21.15.41:0/328172686 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v73) v1 ==== 81+0+28900 (secure 0 0 0) 0x7f9fd8045720 con 0x7f9fe80aa750 2021-10-21T00:09:48.349 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:48.349 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:09:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 73, 2021-10-21T00:09:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:09:48.350 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:09:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:09:45.554199+0000", 2021-10-21T00:09:48.351 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:09:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:09:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:09:48.352 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:09:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:09:48.353 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:09:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:09:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:09:48.354 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:09:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:09:48.355 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:09:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:09:48.356 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:09:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:09:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 14, 2021-10-21T00:09:48.357 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:09:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:09:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:09:48.358 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:09:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:09:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.359 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:09:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:09:48.360 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:09:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:48.361 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:48.362 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:09:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:09:48.363 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:09:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:09:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:09:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:48.364 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:48.365 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:48.366 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.366 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:09:48.366 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:48.366 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:48.367 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:48.367 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:48.367 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:48.367 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:48.367 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:48.368 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:48.368 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:48.368 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:48.368 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:48.369 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:48.369 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:48.369 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:48.370 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:48.370 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:48.370 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:48.370 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:48.371 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:48.371 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:48.371 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:48.371 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:48.371 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:48.372 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:48.372 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:48.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:48.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.373 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:48.373 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:48.373 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:48.374 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:48.374 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:48.374 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:48.374 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:48.375 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:48.375 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:48.375 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:48.375 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:48.375 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:09:48.376 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:09:48.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.376 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:48.376 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:09:48.377 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.377 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.377 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:09:48.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:09:48.378 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:09:48.378 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:09:48.378 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:09:48.378 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:09:48.379 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:09:48.379 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:09:48.380 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:09:48.380 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:09:48.380 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:09:48.381 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:09:48.381 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:09:48.382 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:09:48.383 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:09:48.383 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:09:48.383 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:09:48.383 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:09:48.384 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:09:48.384 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:09:48.384 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:09:48.384 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:09:48.385 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:09:48.385 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.385 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:09:48.386 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:09:48.386 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:09:48.386 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:09:48.386 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:09:48.387 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:09:48.387 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:09:48.387 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:09:48.387 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:09:48.387 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:09:48.388 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:09:48.388 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:09:48.388 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:09:48.388 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:09:48.388 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:09:48.389 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:09:48.389 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:09:48.389 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:09:48.389 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:09:48.390 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:09:48.390 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:09:48.390 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:09:48.391 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:09:48.391 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:09:48.391 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:09:48.391 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:09:48.392 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:09:48.392 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.392 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:09:48.392 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:09:48.393 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:09:48.393 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:09:48.393 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:09:48.393 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:09:48.393 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:09:48.394 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:09:48.394 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:09:48.394 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:09:48.394 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:09:48.394 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:09:48.395 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:09:48.395 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:09:48.395 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.395 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.396 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:48.396 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:09:48.396 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.396 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:09:48.396 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:09:48.397 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.397 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.397 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.397 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.397 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.398 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.398 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.398 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:48.398 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.399 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.399 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.399 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.399 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.400 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:09:48.400 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.400 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.400 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.401 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:09:48.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.401 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.401 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.402 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.402 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.402 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.402 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.403 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:09:48.403 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.403 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.403 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:09:48.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.404 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.404 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.405 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.405 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.405 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.405 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.406 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:09:48.406 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.406 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.406 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:09:48.407 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.407 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.407 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.408 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.408 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.408 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.408 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.408 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.409 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:09:48.409 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.409 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.409 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.409 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.410 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:09:48.410 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:09:48.410 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.410 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.411 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.411 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:09:48.411 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:09:48.411 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:09:48.411 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:09:48.412 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.412 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.412 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.412 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.412 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.413 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.413 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:09:48.413 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:09:48.413 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.413 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.414 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.414 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.414 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.414 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.415 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.415 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 56, 2021-10-21T00:09:48.415 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.415 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.416 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.416 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.416 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.416 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.416 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:09:48.417 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.417 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.417 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.417 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:09:48.418 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.418 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.418 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.418 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.419 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.419 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.419 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.419 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.419 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:09:48.420 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.420 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.420 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.420 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:09:48.421 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.421 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.421 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.421 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.421 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.422 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.422 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:09:48.423 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.423 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.423 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.423 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:09:48.424 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.424 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.424 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.424 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.425 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.425 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.425 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.425 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.426 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:09:48.426 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.426 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.426 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.427 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.427 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:09:48.428 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:09:48.428 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.428 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.429 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.429 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:09:48.429 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:09:48.429 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:09:48.430 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:09:48.430 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.430 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.430 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.431 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.431 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.431 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.431 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:09:48.432 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:09:48.432 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.432 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.432 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.432 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.433 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.433 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.433 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.433 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:48.433 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.434 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.434 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.434 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.434 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.435 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.436 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:09:48.436 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.436 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.436 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.437 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.437 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.437 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.437 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.437 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:09:48.438 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.438 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.438 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.439 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:09:48.439 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.439 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.439 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.440 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.440 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.440 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.440 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.441 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.441 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:09:48.441 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.441 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.441 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.442 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:09:48.442 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.442 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.442 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.443 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.443 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.443 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.443 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.443 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.444 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:09:48.444 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.444 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.444 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.445 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.445 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:09:48.445 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:09:48.445 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.445 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.446 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.446 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:09:48.446 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:09:48.446 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:09:48.446 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:09:48.447 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.447 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.447 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.447 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.447 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.448 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.448 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:09:48.448 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:09:48.448 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.449 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.449 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.449 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.449 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.449 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.450 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.450 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:48.450 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.450 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.450 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.451 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.451 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.451 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.451 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:09:48.452 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.452 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.452 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.452 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.452 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:09:48.453 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.453 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.453 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.453 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.453 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.454 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.454 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.454 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.454 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:09:48.455 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.455 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.455 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.455 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:09:48.456 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.456 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.456 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.457 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.457 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.457 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.457 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:09:48.458 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.458 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.458 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.459 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:09:48.459 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.459 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.459 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.460 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.460 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.460 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.460 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.460 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:09:48.461 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.461 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.461 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.462 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:09:48.462 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:09:48.462 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.462 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.462 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.463 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:09:48.463 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:09:48.463 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:09:48.463 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:09:48.463 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.464 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.464 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.464 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.464 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.465 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:09:48.465 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:09:48.465 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.465 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.466 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.466 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.466 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.466 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.466 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.467 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:09:48.467 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.467 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.467 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.467 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.468 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.468 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.468 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:09:48.468 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.469 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.469 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.469 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:09:48.469 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.470 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.470 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.470 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.470 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.471 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.471 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.471 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.471 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:09:48.471 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.472 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.472 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.472 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.472 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:09:48.472 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.473 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.473 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.473 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.474 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.474 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.474 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:09:48.474 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.475 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.475 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.475 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.475 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:09:48.475 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.476 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.476 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.476 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.476 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.476 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.477 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.477 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.477 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:09:48.477 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.477 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.478 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.478 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:09:48.478 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:09:48.479 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.479 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.479 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.479 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:09:48.480 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:09:48.480 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:09:48.480 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:09:48.480 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.480 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.481 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.481 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.481 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.481 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.482 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:09:48.482 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:09:48.482 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.482 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.483 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.483 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.483 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.483 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.484 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.484 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:48.484 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.484 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.485 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.485 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.485 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.485 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.486 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:09:48.486 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.486 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.487 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.487 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:09:48.487 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.487 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.487 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.488 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.488 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.488 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.488 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.488 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.489 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:09:48.489 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.489 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.489 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.490 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.490 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:09:48.490 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.490 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.490 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.491 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.491 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.491 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.491 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.491 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.492 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:09:48.492 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.492 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.492 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.492 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.493 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:09:48.493 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.493 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.493 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.494 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.494 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.494 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.494 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.494 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.495 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:09:48.495 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.495 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.495 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.495 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.496 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:09:48.496 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:09:48.496 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.496 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.497 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.497 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:09:48.497 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:09:48.497 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:09:48.497 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:09:48.498 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.498 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.498 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.499 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.499 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.499 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.499 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:09:48.499 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:09:48.500 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.500 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.500 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.500 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.500 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.501 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.501 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.501 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 66, 2021-10-21T00:09:48.501 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.501 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.502 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.502 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.502 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.502 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.503 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:09:48.503 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.503 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.503 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.503 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.504 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:09:48.504 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.504 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.504 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.505 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.505 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.505 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.505 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.505 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:09:48.506 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.506 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.506 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.506 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.507 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:09:48.507 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.507 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.507 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.507 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.508 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.508 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.508 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.508 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.508 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:09:48.509 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.509 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.509 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.509 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.510 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:09:48.510 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.510 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.510 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.510 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.511 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.511 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.511 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.511 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.511 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:09:48.512 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.512 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.512 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.512 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.513 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:09:48.513 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:09:48.513 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.513 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.514 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:09:48.514 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:09:48.514 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:09:48.514 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:09:48.514 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.515 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.515 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.515 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.516 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.516 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:09:48.516 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:09:48.516 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:09:48.516 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:09:48.517 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:09:48.517 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:09:48.517 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:09:48.517 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:09:48.517 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:09:48.518 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:09:48.518 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:09:48.518 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:09:48.518 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:09:48.518 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.519 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.519 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.519 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:09:48.519 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.520 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.520 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.520 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:09:48.520 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.521 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.521 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.521 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.521 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:09:48.522 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.522 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.522 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.522 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:09:48.522 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.523 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.523 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.523 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.523 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:09:48.523 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.524 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.524 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.524 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.524 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:09:48.525 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.525 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.525 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:09:48.525 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.526 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.526 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.526 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:09:48.527 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.527 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.527 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.527 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.527 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:09:48.528 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:09:48.528 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.528 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:09:48.528 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:09:48.528 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.529 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.529 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.529 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:09:48.529 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:09:48.529 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:09:48.530 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.530 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.530 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.530 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:09:48.531 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:09:48.531 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:09:48.531 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:09:48.531 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:09:48.531 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:09:48.532 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:09:48.532 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:48.532 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.532 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:48.533 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:09:48.533 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.533 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:09:48.533 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.534 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.534 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.534 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.534 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.534 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:09:48.535 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.535 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.535 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.535 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:09:48.535 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.536 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.536 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.536 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.536 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.536 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:09:48.537 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.537 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.537 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.537 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:09:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.538 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.539 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:09:48.539 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.539 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.539 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.540 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:09:48.540 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.540 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.540 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.540 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.541 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.541 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:09:48.541 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.541 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.542 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.542 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:09:48.542 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.542 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.542 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.543 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.543 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.543 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:09:48.543 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.543 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.544 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.544 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:09:48.544 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.544 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.545 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.545 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.545 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.545 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:09:48.545 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.546 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.546 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.546 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:09:48.546 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.547 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.547 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.547 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.547 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.547 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:09:48.548 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.548 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.548 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:48.548 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:09:48.549 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:09:48.549 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:09:48.549 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:09:48.549 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:09:48.549 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:09:48.550 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:09:48.550 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:09:48.550 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.550 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:09:48.551 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:09:48.551 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:09:48.551 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:09:48.551 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:09:48.551 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:09:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/2873838223": "2021-10-22T00:09:41.463616+0000", 2021-10-21T00:09:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/2873838223": "2021-10-22T00:09:41.463616+0000", 2021-10-21T00:09:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.71:0/3233948456": "2021-10-21T01:09:29.549499+0000" 2021-10-21T00:09:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.552 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:09:48.553 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:09:48.553 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:09:48.553 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:09:48.553 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:09:48.553 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:09:48.554 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:09:48.554 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:09:48.554 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:48.554 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:48.555 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:09:48.555 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:09:48.555 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:09:48.555 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:09:48.555 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:09:48.556 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:09:48.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 msgr2=0x7f9fc8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 0x7f9fc8055ad0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9fe001b000 tx=0x7f9fe0016000).stop 2021-10-21T00:09:48.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 msgr2=0x7f9fe8140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f9fd8000bc0 tx=0x7f9fd8007a60).stop 2021-10-21T00:09:48.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 shutdown_connections 2021-10-21T00:09:48.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9fc8053610 0x7f9fc8055ad0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fe814b350 0x7f9fe8140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9fe80aa750 0x7f9fe8140800 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 --2- 172.21.15.41:0/328172686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9fe805f9f0 0x7f9fe809a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 >> 172.21.15.41:0/328172686 conn(0x7f9fe805bca0 msgr2=0x7f9fe80b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:48.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 shutdown_connections 2021-10-21T00:09:48.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.345+0000 7f9fefe9d700 1 -- 172.21.15.41:0/328172686 wait complete. 2021-10-21T00:09:48.561 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:48.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 Processor -- start 2021-10-21T00:09:48.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 -- start start 2021-10-21T00:09:48.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58b80b4380 0x7f58b80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 0x7f58b8062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b80ae020 con 0x7f58b80b1830 2021-10-21T00:09:48.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b80ade00 con 0x7f58b80b4380 2021-10-21T00:09:48.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58be562700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b805fe50 con 0x7f58b81433e0 2021-10-21T00:09:48.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58b80b4380 0x7f58b80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bdd61700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 0x7f58b8062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bcd5f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f58b80b1830 0x7f58b805f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40120/0 (socket says 172.21.15.41:40120) 2021-10-21T00:09:48.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bcd5f700 1 -- 172.21.15.41:0/3973889761 learned_addr learned my addr 172.21.15.41:0/3973889761 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:48.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58affff700 1 -- 172.21.15.41:0/3973889761 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177323554 0 0) 0x7f58b80ae020 con 0x7f58b80b1830 2021-10-21T00:09:48.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58affff700 1 -- 172.21.15.41:0/3973889761 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a4003260 con 0x7f58b80b1830 2021-10-21T00:09:48.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 -- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 msgr2=0x7f58b8062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:48.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 0x7f58b8062940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 -- 172.21.15.41:0/3973889761 >> v1:172.21.15.62:6789/0 conn(0x7f58b80b1830 legacy=0x7f58b805f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 -- 172.21.15.41:0/3973889761 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80b4760 con 0x7f58b80b4380 2021-10-21T00:09:48.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bdd61700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 0x7f58b8062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:48.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58bd560700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b4380 0x7f58b80ad910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f58a8002f70 tx=0x7f58a8006df0).ready entity=mon.1 client_cookie=72cfd99c8c71bac0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58affff700 1 -- 172.21.15.41:0/3973889761 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a800d4a0 con 0x7f58b80b4380 2021-10-21T00:09:48.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58affff700 1 -- 172.21.15.41:0/3973889761 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a8000e90 con 0x7f58b80b4380 2021-10-21T00:09:48.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.669+0000 7f58affff700 1 -- 172.21.15.41:0/3973889761 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a800d7f0 con 0x7f58b80b4380 2021-10-21T00:09:48.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b4380 msgr2=0x7f58b80ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b4380 0x7f58b80ad910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f58a8002f70 tx=0x7f58a8006df0).stop 2021-10-21T00:09:48.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- 172.21.15.41:0/3973889761 shutdown_connections 2021-10-21T00:09:48.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b81433e0 0x7f58b8062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- 172.21.15.41:0/3973889761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b4380 0x7f58b80ad910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- 172.21.15.41:0/3973889761 >> 172.21.15.41:0/3973889761 conn(0x7f58b80b7910 msgr2=0x7f58b80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:48.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- 172.21.15.41:0/3973889761 shutdown_connections 2021-10-21T00:09:48.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- 172.21.15.41:0/3973889761 wait complete. 2021-10-21T00:09:48.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 Processor -- start 2021-10-21T00:09:48.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- start start 2021-10-21T00:09:48.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b1830 0x7f58b809a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b80b4380 0x7f58b81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8066250 con 0x7f58b81433e0 2021-10-21T00:09:48.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8066690 con 0x7f58b80b1830 2021-10-21T00:09:48.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58be562700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8066930 con 0x7f58b80b4380 2021-10-21T00:09:48.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34304/0 (socket says 172.21.15.41:34304) 2021-10-21T00:09:48.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 -- 172.21.15.41:0/393217170 learned_addr learned my addr 172.21.15.41:0/393217170 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:48.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bcd5f700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b80b4380 0x7f58b81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bd560700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b1830 0x7f58b809a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 -- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b80b4380 msgr2=0x7f58b81527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b80b4380 0x7f58b81527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 -- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b1830 msgr2=0x7f58b809a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b1830 0x7f58b809a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 -- 172.21.15.41:0/393217170 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b400b180 con 0x7f58b81433e0 2021-10-21T00:09:48.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.673+0000 7f58bdd61700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f58b400c000 tx=0x7f58b4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b4010780 con 0x7f58b81433e0 2021-10-21T00:09:48.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40108e0 con 0x7f58b81433e0 2021-10-21T00:09:48.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a800b180 con 0x7f58b81433e0 2021-10-21T00:09:48.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58b4010c40 con 0x7f58b81433e0 2021-10-21T00:09:48.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b8152350 con 0x7f58b81433e0 2021-10-21T00:09:48.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b8153370 con 0x7f58b81433e0 2021-10-21T00:09:48.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58b401c460 con 0x7f58b81433e0 2021-10-21T00:09:48.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 0x7f5898055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f58b406bbf0 con 0x7f58b81433e0 2021-10-21T00:09:48.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.677+0000 7f58bd560700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 0x7f5898055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.681+0000 7f58bd560700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 0x7f5898055ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f58a801a000 tx=0x7f58a8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.681+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58b4042e90 con 0x7f58b81433e0 2021-10-21T00:09:48.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.845+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b8066af0 con 0x7f58b81433e0 2021-10-21T00:09:48.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58ae7fc700 1 -- 172.21.15.41:0/393217170 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f58b8066af0 con 0x7f58b81433e0 2021-10-21T00:09:48.855 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:48.856 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6582,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/3649721443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3649721443},{"type":"v1","addr":"172.21.15.41:6833","nonce":3649721443}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[]} 2021-10-21T00:09:48.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 msgr2=0x7f5898055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 0x7f5898055ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f58a801a000 tx=0x7f58a8014000).stop 2021-10-21T00:09:48.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 msgr2=0x7f58b8152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f58b400c000 tx=0x7f58b4006df0).stop 2021-10-21T00:09:48.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 shutdown_connections 2021-10-21T00:09:48.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5898053610 0x7f5898055ad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f58b81433e0 0x7f58b8152ce0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58b80b4380 0x7f58b81527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 --2- 172.21.15.41:0/393217170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58b80b1830 0x7f58b809a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 >> 172.21.15.41:0/393217170 conn(0x7f58b80b7910 msgr2=0x7f58b8062ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:48.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 shutdown_connections 2021-10-21T00:09:48.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.849+0000 7f58be562700 1 -- 172.21.15.41:0/393217170 wait complete. 2021-10-21T00:09:48.860 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 36 2021-10-21T00:09:48.868 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:48.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.961+0000 7fd765952700 1 Processor -- start 2021-10-21T00:09:48.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.961+0000 7fd765952700 1 -- start start 2021-10-21T00:09:48.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.961+0000 7fd765952700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd7600b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76005bd40 con 0x7fd760062f70 2021-10-21T00:09:48.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76005bf70 con 0x7fd7600b3a20 2021-10-21T00:09:48.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd760142cb0 con 0x7fd760062330 2021-10-21T00:09:48.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd760062f70 0x7fd76005c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60310/0 (socket says 172.21.15.41:60310) 2021-10-21T00:09:48.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 -- 172.21.15.41:0/1877449808 learned_addr learned my addr 172.21.15.41:0/1877449808 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:48.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd764950700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd7600b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550773415 0 0) 0x7fd76005bd40 con 0x7fd760062f70 2021-10-21T00:09:48.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd74c003260 con 0x7fd760062f70 2021-10-21T00:09:48.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105056431 0 0) 0x7fd76005bf70 con 0x7fd7600b3a20 2021-10-21T00:09:48.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76005bd40 con 0x7fd7600b3a20 2021-10-21T00:09:48.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102282891 0 0) 0x7fd74c003260 con 0x7fd760062f70 2021-10-21T00:09:48.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 msgr2=0x7fd7600b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:48.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd7600b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 >> v1:172.21.15.62:6789/0 conn(0x7fd7600b3a20 legacy=0x7fd76013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760142950 con 0x7fd760062f70 2021-10-21T00:09:48.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fd750001660 con 0x7fd760062f70 2021-10-21T00:09:48.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd764950700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd7600b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:48.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 >> v1:172.21.15.41:6789/0 conn(0x7fd760062f70 legacy=0x7fd76005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd74c003910 0x7fd74c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd74c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd74c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760142cb0 con 0x7fd74c004500 2021-10-21T00:09:48.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c00b750 con 0x7fd74c003910 2021-10-21T00:09:48.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c00b910 con 0x7fd760062330 2021-10-21T00:09:48.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd74c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd764950700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd74c003910 0x7fd74c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765151700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd74c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 -- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 msgr2=0x7fd74c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:48.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd760062330 0x7fd74c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 -- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd74c003910 msgr2=0x7fd74c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:48.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd74c003910 0x7fd74c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 -- 172.21.15.41:0/1877449808 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c00b180 con 0x7fd74c004500 2021-10-21T00:09:48.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd757fff700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd74c004980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fd750001430 tx=0x7fd750001dd0).ready entity=mon.0 client_cookie=245694be4f24e17e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7500070d0 con 0x7fd74c004500 2021-10-21T00:09:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750007230 con 0x7fd74c004500 2021-10-21T00:09:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd7577fe700 1 -- 172.21.15.41:0/1877449808 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75000c8f0 con 0x7fd74c004500 2021-10-21T00:09:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- 172.21.15.41:0/1877449808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 msgr2=0x7fd74c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 --2- 172.21.15.41:0/1877449808 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd74c004980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fd750001430 tx=0x7fd750001dd0).stop 2021-10-21T00:09:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765151700 1 -- 172.21.15.41:0/1877449808 reap_dead start 2021-10-21T00:09:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- 172.21.15.41:0/1877449808 shutdown_connections 2021-10-21T00:09:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- 172.21.15.41:0/1877449808 >> 172.21.15.41:0/1877449808 conn(0x7fd7600b9080 msgr2=0x7fd7600b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:48.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- 172.21.15.41:0/1877449808 shutdown_connections 2021-10-21T00:09:48.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.965+0000 7fd765952700 1 -- 172.21.15.41:0/1877449808 wait complete. 2021-10-21T00:09:48.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 Processor -- start 2021-10-21T00:09:48.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- start start 2021-10-21T00:09:48.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 0x7fd76013eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7600ac890 0x7fd760141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013fe20 con 0x7fd74c004500 2021-10-21T00:09:48.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600af600 con 0x7fd76013e0b0 2021-10-21T00:09:48.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013f980 con 0x7fd7600ac890 2021-10-21T00:09:48.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34320/0 (socket says 172.21.15.41:34320) 2021-10-21T00:09:48.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 -- 172.21.15.41:0/1122683087 learned_addr learned my addr 172.21.15.41:0/1122683087 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:48.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd757fff700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 0x7fd76013eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765151700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7600ac890 0x7fd760141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 -- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7600ac890 msgr2=0x7fd760141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7600ac890 0x7fd760141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 -- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 msgr2=0x7fd76013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:48.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 0x7fd76013eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:48.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 -- 172.21.15.41:0/1122683087 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600af2f0 con 0x7fd74c004500 2021-10-21T00:09:48.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd757fff700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 0x7fd76013eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:48.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd764950700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fd75c00b000 tx=0x7fd75c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c00fa10 con 0x7fd74c004500 2021-10-21T00:09:48.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7601423c0 con 0x7fd74c004500 2021-10-21T00:09:48.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00fb70 con 0x7fd74c004500 2021-10-21T00:09:48.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c00fce0 con 0x7fd74c004500 2021-10-21T00:09:48.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.969+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd760146100 con 0x7fd74c004500 2021-10-21T00:09:48.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd75c024070 con 0x7fd74c004500 2021-10-21T00:09:48.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76013f7e0 con 0x7fd74c004500 2021-10-21T00:09:48.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd755ffb700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 0x7fd740055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:48.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd75c06c110 con 0x7fd74c004500 2021-10-21T00:09:48.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd757fff700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 0x7fd740055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:48.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.973+0000 7fd757fff700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 0x7fd740055b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd750019000 tx=0x7fd750015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:48.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:48.981+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd76013f7e0 con 0x7fd74c004500 2021-10-21T00:09:49.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.141+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd76013f7e0 con 0x7fd74c004500 2021-10-21T00:09:49.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.141+0000 7fd755ffb700 1 -- 172.21.15.41:0/1122683087 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fd76013f7e0 con 0x7fd74c004500 2021-10-21T00:09:49.150 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:49.150 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/2605633749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2605633749},{"type":"v1","addr":"172.21.15.62:6835","nonce":2605633749}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6582,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/3649721443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3649721443},{"type":"v1","addr":"172.21.15.41:6833","nonce":3649721443}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[]} 2021-10-21T00:09:49.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.141+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 msgr2=0x7fd740055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.141+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 0x7fd740055b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd750019000 tx=0x7fd750015000).stop 2021-10-21T00:09:49.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 msgr2=0x7fd7600b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fd75c00b000 tx=0x7fd75c006df0).stop 2021-10-21T00:09:49.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 shutdown_connections 2021-10-21T00:09:49.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd7400536d0 0x7fd740055b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd7600ac890 0x7fd760141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd76013e0b0 0x7fd76013eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 --2- 172.21.15.41:0/1122683087 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd74c004500 0x7fd7600b5180 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 >> 172.21.15.41:0/1122683087 conn(0x7fd7600b9080 msgr2=0x7fd7600b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:49.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 shutdown_connections 2021-10-21T00:09:49.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.145+0000 7fd765952700 1 -- 172.21.15.41:0/1122683087 wait complete. 2021-10-21T00:09:49.156 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 36 2021-10-21T00:09:49.162 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:09:49.162 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:09:49.163 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:09:49.163 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:09:49.164 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:09:49.164 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:09:49.165 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:09:49.165 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:09:49.177 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:09:49.177 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:09:49.181 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:09:49.182 DEBUG:teuthology.parallel:result is None 2021-10-21T00:09:49.184 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:09:49.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:09:49.187 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:09:49.187 DEBUG:teuthology.parallel:result is None 2021-10-21T00:09:49.187 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:09:49.250 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:09:49.263 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:09:49.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.285+0000 7fe384aac700 1 Processor -- start 2021-10-21T00:09:49.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.285+0000 7fe384aac700 1 -- start start 2021-10-21T00:09:49.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3800b2cf0 0x7fe380062190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe380062680 0x7fe38005bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3801479c0 con 0x7fe3800b3a20 2021-10-21T00:09:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800b0d90 con 0x7fe380062680 2021-10-21T00:09:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380147c60 con 0x7fe3800b2cf0 2021-10-21T00:09:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe380062680 0x7fe38005bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe3800b3a20 0x7fe38005c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60346/0 (socket says 172.21.15.41:60346) 2021-10-21T00:09:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37ffff700 1 -- 172.21.15.41:0/3222594875 learned_addr learned my addr 172.21.15.41:0/3222594875 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37f7fe700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3800b2cf0 0x7fe380062190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821958440 0 0) 0x7fe3801479c0 con 0x7fe3800b3a20 2021-10-21T00:09:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe36c003260 con 0x7fe3800b3a20 2021-10-21T00:09:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 -- 172.21.15.41:0/3222594875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3800b2cf0 msgr2=0x7fe380062190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3800b2cf0 0x7fe380062190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 -- 172.21.15.41:0/3222594875 >> v1:172.21.15.41:6789/0 conn(0x7fe3800b3a20 legacy=0x7fe38005c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473259360 0 0) 0x7fe36c003260 con 0x7fe3800b3a20 2021-10-21T00:09:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 -- 172.21.15.41:0/3222594875 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800b3f30 con 0x7fe380062680 2021-10-21T00:09:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37effd700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe380062680 0x7fe38005bed0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe378001b80 tx=0x7fe374006df0).ready entity=mon.0 client_cookie=f2ebe171ec904c44 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3780019e0 con 0x7fe380062680 2021-10-21T00:09:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374000e90 con 0x7fe380062680 2021-10-21T00:09:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe37e7fc700 1 -- 172.21.15.41:0/3222594875 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe374012460 con 0x7fe380062680 2021-10-21T00:09:49.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- 172.21.15.41:0/3222594875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe380062680 msgr2=0x7fe38005bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe380062680 0x7fe38005bed0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe378001b80 tx=0x7fe374006df0).stop 2021-10-21T00:09:49.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- 172.21.15.41:0/3222594875 shutdown_connections 2021-10-21T00:09:49.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe380062680 0x7fe38005bed0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 --2- 172.21.15.41:0/3222594875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3800b2cf0 0x7fe380062190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- 172.21.15.41:0/3222594875 >> 172.21.15.41:0/3222594875 conn(0x7fe3800b9080 msgr2=0x7fe3800b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- 172.21.15.41:0/3222594875 shutdown_connections 2021-10-21T00:09:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.289+0000 7fe384aac700 1 -- 172.21.15.41:0/3222594875 wait complete. 2021-10-21T00:09:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 Processor -- start 2021-10-21T00:09:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 -- start start 2021-10-21T00:09:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 0x7fe3801430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800b3a20 0x7fe380143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38014a0c0 con 0x7fe3800b2cf0 2021-10-21T00:09:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380141bd0 con 0x7fe3800b3a20 2021-10-21T00:09:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe384aac700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380141e70 con 0x7fe380062680 2021-10-21T00:09:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe37effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe37f7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 0x7fe3801430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe37effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34348/0 (socket says 172.21.15.41:34348) 2021-10-21T00:09:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe37effd700 1 -- 172.21.15.41:0/3782092299 learned_addr learned my addr 172.21.15.41:0/3782092299 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.293+0000 7fe37ffff700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800b3a20 0x7fe380143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 -- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 msgr2=0x7fe3801430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 0x7fe3801430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 -- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800b3a20 msgr2=0x7fe380143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800b3a20 0x7fe380143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 -- 172.21.15.41:0/3782092299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37400b180 con 0x7fe3800b2cf0 2021-10-21T00:09:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37f7fe700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 0x7fe3801430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37effd700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fe378001b80 tx=0x7fe374014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe374016070 con 0x7fe3800b2cf0 2021-10-21T00:09:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374013e40 con 0x7fe3800b2cf0 2021-10-21T00:09:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37400ddb0 con 0x7fe3800b2cf0 2021-10-21T00:09:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3801441a0 con 0x7fe3800b2cf0 2021-10-21T00:09:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380156820 con 0x7fe3800b2cf0 2021-10-21T00:09:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38005cad0 con 0x7fe3800b2cf0 2021-10-21T00:09:49.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe37400f030 con 0x7fe3800b2cf0 2021-10-21T00:09:49.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 0x7fe360055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:49.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.297+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe37406f190 con 0x7fe3800b2cf0 2021-10-21T00:09:49.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.301+0000 7fe37f7fe700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 0x7fe360055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:49.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.301+0000 7fe37f7fe700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 0x7fe360055a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe37000b000 tx=0x7fe370006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:49.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.305+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe374043910 con 0x7fe3800b2cf0 2021-10-21T00:09:49.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.437+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe380144330 con 0x7fe3800b2cf0 2021-10-21T00:09:49.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.869+0000 7fe37cff9700 1 -- 172.21.15.41:0/3782092299 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe374023030 con 0x7fe3800b2cf0 2021-10-21T00:09:49.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 msgr2=0x7fe360055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 0x7fe360055a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fe37000b000 tx=0x7fe370006df0).stop 2021-10-21T00:09:49.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 msgr2=0x7fe380142160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:49.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fe378001b80 tx=0x7fe374014000).stop 2021-10-21T00:09:49.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 shutdown_connections 2021-10-21T00:09:49.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe360053580 0x7fe360055a40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800b3a20 0x7fe380143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3800b2cf0 0x7fe380142160 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 --2- 172.21.15.41:0/3782092299 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe380062680 0x7fe3801430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:49.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 >> 172.21.15.41:0/3782092299 conn(0x7fe3800b9080 msgr2=0x7fe380146980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:49.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 shutdown_connections 2021-10-21T00:09:49.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:49.873+0000 7fe384aac700 1 -- 172.21.15.41:0/3782092299 wait complete. 2021-10-21T00:09:49.885 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:09:49.897 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:09:49.898 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:09:50.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 Processor -- start 2021-10-21T00:09:50.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 -- start start 2021-10-21T00:09:50.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 0x7f0474099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f04740a9d80 0x7f04740b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047409abc0 con 0x7f047405f6b0 2021-10-21T00:09:50.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047405cad0 con 0x7f04740a9d80 2021-10-21T00:09:50.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04796bf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0474099040 con 0x7f047405c6f0 2021-10-21T00:09:50.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f04740a9d80 0x7f04740b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04737fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f047405f6b0 0x7f047405fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60360/0 (socket says 172.21.15.41:60360) 2021-10-21T00:09:50.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04737fe700 1 -- 172.21.15.41:0/4284142884 learned_addr learned my addr 172.21.15.41:0/4284142884 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:50.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f0472ffd700 1 --2- 172.21.15.41:0/4284142884 >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 0x7f0474099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 -- 172.21.15.41:0/4284142884 >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 msgr2=0x7f0474099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:50.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 --2- 172.21.15.41:0/4284142884 >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 0x7f0474099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 -- 172.21.15.41:0/4284142884 >> v1:172.21.15.41:6789/0 conn(0x7f047405f6b0 legacy=0x7f047405fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 -- 172.21.15.41:0/4284142884 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740992e0 con 0x7f04740a9d80 2021-10-21T00:09:50.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f0472ffd700 1 --2- 172.21.15.41:0/4284142884 >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 0x7f0474099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:50.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f04727fc700 1 --2- 172.21.15.41:0/4284142884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f04740a9d80 0x7f04740b1120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f046c001110 tx=0x7f045c006df0).ready entity=mon.0 client_cookie=1109fb11085c990b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f0471ffb700 1 -- 172.21.15.41:0/4284142884 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c00d4a0 con 0x7f04740a9d80 2021-10-21T00:09:50.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f0471ffb700 1 -- 172.21.15.41:0/4284142884 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c000e90 con 0x7f04740a9d80 2021-10-21T00:09:50.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.001+0000 7f0471ffb700 1 -- 172.21.15.41:0/4284142884 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c00d7f0 con 0x7f04740a9d80 2021-10-21T00:09:50.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- 172.21.15.41:0/4284142884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f04740a9d80 msgr2=0x7f04740b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 --2- 172.21.15.41:0/4284142884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f04740a9d80 0x7f04740b1120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f046c001110 tx=0x7f045c006df0).stop 2021-10-21T00:09:50.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- 172.21.15.41:0/4284142884 shutdown_connections 2021-10-21T00:09:50.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 --2- 172.21.15.41:0/4284142884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f04740a9d80 0x7f04740b1120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 --2- 172.21.15.41:0/4284142884 >> v2:172.21.15.62:3300/0 conn(0x7f047405c6f0 0x7f0474099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- 172.21.15.41:0/4284142884 >> 172.21.15.41:0/4284142884 conn(0x7f04740b58f0 msgr2=0x7f047405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- 172.21.15.41:0/4284142884 shutdown_connections 2021-10-21T00:09:50.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- 172.21.15.41:0/4284142884 wait complete. 2021-10-21T00:09:50.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 Processor -- start 2021-10-21T00:09:50.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.005+0000 7f04796bf700 1 -- start start 2021-10-21T00:09:50.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f047405c6f0 0x7f04740ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04740a9d80 0x7f0474150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0474066510 con 0x7f047405f6b0 2021-10-21T00:09:50.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047413feb0 con 0x7f047405c6f0 2021-10-21T00:09:50.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047414fd40 con 0x7f04740a9d80 2021-10-21T00:09:50.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34362/0 (socket says 172.21.15.41:34362) 2021-10-21T00:09:50.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 -- 172.21.15.41:0/2420461021 learned_addr learned my addr 172.21.15.41:0/2420461021 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f0472ffd700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f047405c6f0 0x7f04740ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04737fe700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04740a9d80 0x7f0474150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 -- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04740a9d80 msgr2=0x7f0474150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04740a9d80 0x7f0474150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 -- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f047405c6f0 msgr2=0x7f04740ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f047405c6f0 0x7f04740ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 -- 172.21.15.41:0/2420461021 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464009470 con 0x7f047405f6b0 2021-10-21T00:09:50.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04727fc700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f046c001110 tx=0x7f045c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c012860 con 0x7f047405f6b0 2021-10-21T00:09:50.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c0129c0 con 0x7f047405f6b0 2021-10-21T00:09:50.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c00b180 con 0x7f047405f6b0 2021-10-21T00:09:50.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c012d20 con 0x7f047405f6b0 2021-10-21T00:09:50.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04740afbe0 con 0x7f047405f6b0 2021-10-21T00:09:50.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.009+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0474099580 con 0x7f047405f6b0 2021-10-21T00:09:50.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.013+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f045c01c070 con 0x7f047405f6b0 2021-10-21T00:09:50.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.013+0000 7f046bfff700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 0x7f0458055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.013+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f045c06c060 con 0x7f047405f6b0 2021-10-21T00:09:50.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.013+0000 7f0472ffd700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 0x7f0458055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.013+0000 7f0472ffd700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 0x7f0458055a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f046400b000 tx=0x7f04640091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.017+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f045c0434f0 con 0x7f047405f6b0 2021-10-21T00:09:50.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.185+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0474057350 con 0x7f047405f6b0 2021-10-21T00:09:50.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.185+0000 7f046bfff700 1 -- 172.21.15.41:0/2420461021 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f045c019020 con 0x7f047405f6b0 2021-10-21T00:09:50.198 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:50.198 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:09:50.198 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:09:50.199 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.199 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:09:50.199 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:09:50.200 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.200 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:09:50.200 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.200 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.200 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.201 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.201 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.201 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.201 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:09:50.202 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:09:50.202 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.202 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:09:50.202 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.202 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.203 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.203 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.203 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.203 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.204 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:09:50.204 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:09:50.204 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.204 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.204 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.205 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.205 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.205 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.205 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.205 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:09:50.206 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:09:50.206 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.207 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.207 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.208 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.208 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.208 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.208 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.209 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:09:50.209 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:09:50.209 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.209 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.210 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.210 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.210 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.210 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.211 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.211 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:09:50.211 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:09:50.211 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.212 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.212 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.212 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.212 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.212 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.213 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.213 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:09:50.213 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:09:50.213 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.214 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.214 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.214 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.214 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.215 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.215 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.215 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:09:50.215 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:09:50.215 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.216 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.216 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.216 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.216 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.217 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.217 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.217 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:09:50.217 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:09:50.218 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.218 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.218 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.218 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.219 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.219 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.219 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.219 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:09:50.220 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:09:50.220 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.220 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.220 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.221 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.221 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.221 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.222 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:09:50.222 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:09:50.222 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.222 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:09:50.223 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:09:50.223 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:09:50.223 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.223 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.224 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.224 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:09:50.224 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:09:50.224 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.225 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:09:50.225 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:09:50.225 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:09:50.225 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.226 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.226 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.226 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:09:50.228 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:09:50.228 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.228 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:09:50.228 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:09:50.229 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:09:50.229 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.229 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.229 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.229 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:09:50.230 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:09:50.230 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.230 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:09:50.230 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:09:50.231 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:09:50.231 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.231 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.231 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.232 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.232 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:09:50.232 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:09:50.232 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.232 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:09:50.233 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:09:50.233 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.233 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:50.233 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:50.234 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:09:50.234 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:09:50.234 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:09:50.234 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:09:50.235 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:09:50.235 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:09:50.235 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.235 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:50.236 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:09:50.236 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:09:50.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 msgr2=0x7f0458055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 0x7f0458055a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f046400b000 tx=0x7f04640091d0).stop 2021-10-21T00:09:50.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 msgr2=0x7f04740af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f046c001110 tx=0x7f045c014000).stop 2021-10-21T00:09:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 shutdown_connections 2021-10-21T00:09:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04580535b0 0x7f0458055a70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04740a9d80 0x7f0474150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f047405f6b0 0x7f04740af6f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 --2- 172.21.15.41:0/2420461021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f047405c6f0 0x7f04740ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 >> 172.21.15.41:0/2420461021 conn(0x7f04740b58f0 msgr2=0x7f04740aa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 shutdown_connections 2021-10-21T00:09:50.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.189+0000 7f04796bf700 1 -- 172.21.15.41:0/2420461021 wait complete. 2021-10-21T00:09:50.241 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:50.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.345+0000 7fd9e4e8b700 1 Processor -- start 2021-10-21T00:09:50.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.345+0000 7fd9e4e8b700 1 -- start start 2021-10-21T00:09:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd9e0062330 0x7fd9e00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e0062f70 0x7fd9e005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e005bd40 con 0x7fd9e00b3a20 2021-10-21T00:09:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e005bf70 con 0x7fd9e0062330 2021-10-21T00:09:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0142cb0 con 0x7fd9e0062f70 2021-10-21T00:09:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9dffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd9e00b3a20 0x7fd9e013c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60372/0 (socket says 172.21.15.41:60372) 2021-10-21T00:09:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9dffff700 1 -- 172.21.15.41:0/3526680174 learned_addr learned my addr 172.21.15.41:0/3526680174 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/3526680174 >> v2:172.21.15.41:3300/0 conn(0x7fd9e0062330 0x7fd9e00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9deffd700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e0062f70 0x7fd9e005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252706552 0 0) 0x7fd9e005bd40 con 0x7fd9e00b3a20 2021-10-21T00:09:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c0003260 con 0x7fd9e00b3a20 2021-10-21T00:09:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 -- 172.21.15.41:0/3526680174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e0062f70 msgr2=0x7fd9e005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e0062f70 0x7fd9e005c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919897719 0 0) 0x7fd9c0003260 con 0x7fd9e00b3a20 2021-10-21T00:09:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 -- 172.21.15.41:0/3526680174 >> v1:172.21.15.41:6789/0 conn(0x7fd9e00b3a20 legacy=0x7fd9e013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 -- 172.21.15.41:0/3526680174 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0142950 con 0x7fd9e0062330 2021-10-21T00:09:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062330 0x7fd9e00b3f30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd9d8001800 tx=0x7fd9d0006df0).ready entity=mon.0 client_cookie=1e8c03d2fa6e74fa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d8001660 con 0x7fd9e0062330 2021-10-21T00:09:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0000e90 con 0x7fd9e0062330 2021-10-21T00:09:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9de7fc700 1 -- 172.21.15.41:0/3526680174 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d0012460 con 0x7fd9e0062330 2021-10-21T00:09:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/3526680174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062330 msgr2=0x7fd9e00b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062330 0x7fd9e00b3f30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd9d8001800 tx=0x7fd9d0006df0).stop 2021-10-21T00:09:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/3526680174 shutdown_connections 2021-10-21T00:09:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e0062f70 0x7fd9e005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/3526680174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062330 0x7fd9e00b3f30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/3526680174 >> 172.21.15.41:0/3526680174 conn(0x7fd9e00b9080 msgr2=0x7fd9e00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/3526680174 shutdown_connections 2021-10-21T00:09:50.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/3526680174 wait complete. 2021-10-21T00:09:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.349+0000 7fd9e4e8b700 1 Processor -- start 2021-10-21T00:09:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- start start 2021-10-21T00:09:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9e0062330 0x7fd9e0113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e00b3a20 0x7fd9e0152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00af0f0 con 0x7fd9e0062f70 2021-10-21T00:09:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e01444a0 con 0x7fd9e0062330 2021-10-21T00:09:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0144740 con 0x7fd9e00b3a20 2021-10-21T00:09:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34374/0 (socket says 172.21.15.41:34374) 2021-10-21T00:09:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 -- 172.21.15.41:0/282790429 learned_addr learned my addr 172.21.15.41:0/282790429 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9dffff700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e00b3a20 0x7fd9e0152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9e0062330 0x7fd9e0113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 -- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e00b3a20 msgr2=0x7fd9e0152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e00b3a20 0x7fd9e0152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 -- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9e0062330 msgr2=0x7fd9e0113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9e0062330 0x7fd9e0113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 -- 172.21.15.41:0/282790429 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d000b180 con 0x7fd9e0062f70 2021-10-21T00:09:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9deffd700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd9c8006e00 tx=0x7fd9c80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c800c850 con 0x7fd9e0062f70 2021-10-21T00:09:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800c9b0 con 0x7fd9e0062f70 2021-10-21T00:09:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e01449e0 con 0x7fd9e0062f70 2021-10-21T00:09:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c800cd10 con 0x7fd9e0062f70 2021-10-21T00:09:50.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e0151eb0 con 0x7fd9e0062f70 2021-10-21T00:09:50.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.353+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e0057350 con 0x7fd9e0062f70 2021-10-21T00:09:50.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.357+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd9c8022070 con 0x7fd9e0062f70 2021-10-21T00:09:50.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.357+0000 7fd9dcff9700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 0x7fd9c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.357+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd9c806be90 con 0x7fd9e0062f70 2021-10-21T00:09:50.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.357+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 0x7fd9c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.357+0000 7fd9df7fe700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 0x7fd9c4055ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd9d0018000 tx=0x7fd9d0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.361+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9c8043210 con 0x7fd9e0062f70 2021-10-21T00:09:50.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e005d080 con 0x7fd9e0062f70 2021-10-21T00:09:50.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9dcff9700 1 -- 172.21.15.41:0/282790429 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+13182 (secure 0 0 0) 0x7fd9c806d090 con 0x7fd9e0062f70 2021-10-21T00:09:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:50.497 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":74,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:49.866679+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:50.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 msgr2=0x7fd9c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 0x7fd9c4055ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd9d0018000 tx=0x7fd9d0014000).stop 2021-10-21T00:09:50.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 msgr2=0x7fd9e00b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.489+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd9c8006e00 tx=0x7fd9c80091d0).stop 2021-10-21T00:09:50.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 shutdown_connections 2021-10-21T00:09:50.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd9c4053610 0x7fd9c4055ad0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9e00b3a20 0x7fd9e0152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd9e0062f70 0x7fd9e00b4ba0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 --2- 172.21.15.41:0/282790429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9e0062330 0x7fd9e0113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 >> 172.21.15.41:0/282790429 conn(0x7fd9e00b9080 msgr2=0x7fd9e013dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 shutdown_connections 2021-10-21T00:09:50.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.493+0000 7fd9e4e8b700 1 -- 172.21.15.41:0/282790429 wait complete. 2021-10-21T00:09:50.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:09:50.510 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:09:50.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 Processor -- start 2021-10-21T00:09:50.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 -- start start 2021-10-21T00:09:50.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f35440b9ca0 0x7f35440b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 0x7f35440b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35440ba080 con 0x7f35440b24b0 2021-10-21T00:09:50.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354405c670 con 0x7f35440b9ca0 2021-10-21T00:09:50.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354c4df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354405c8e0 con 0x7f35440b31e0 2021-10-21T00:09:50.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.613+0000 7f354a27b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f35440b9ca0 0x7f35440b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f35440b9ca0 0x7f35440b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34382/0 (socket says 172.21.15.41:34382) 2021-10-21T00:09:50.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 -- 172.21.15.41:0/3162770821 learned_addr learned my addr 172.21.15.41:0/3162770821 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f3549a7a700 1 --2- 172.21.15.41:0/3162770821 >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 0x7f35440b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 -- 172.21.15.41:0/3162770821 >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 msgr2=0x7f35440b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:50.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 --2- 172.21.15.41:0/3162770821 >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 0x7f35440b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 -- 172.21.15.41:0/3162770821 >> v1:172.21.15.62:6789/0 conn(0x7f35440b24b0 legacy=0x7f3544146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 -- 172.21.15.41:0/3162770821 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354405cb80 con 0x7f35440b9ca0 2021-10-21T00:09:50.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f3549a7a700 1 --2- 172.21.15.41:0/3162770821 >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 0x7f35440b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:50.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354a27b700 1 --2- 172.21.15.41:0/3162770821 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b9ca0 0x7f35440b0690 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f3538002f70 tx=0x7f3538006eb0).ready entity=mon.0 client_cookie=f3d2c86b57803a9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f3549279700 1 -- 172.21.15.41:0/3162770821 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353800d610 con 0x7f35440b9ca0 2021-10-21T00:09:50.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f3549279700 1 -- 172.21.15.41:0/3162770821 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538000e90 con 0x7f35440b9ca0 2021-10-21T00:09:50.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f3549279700 1 -- 172.21.15.41:0/3162770821 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353800d9a0 con 0x7f35440b9ca0 2021-10-21T00:09:50.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 -- 172.21.15.41:0/3162770821 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b9ca0 msgr2=0x7f35440b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 --2- 172.21.15.41:0/3162770821 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b9ca0 0x7f35440b0690 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f3538002f70 tx=0x7f3538006eb0).stop 2021-10-21T00:09:50.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 -- 172.21.15.41:0/3162770821 shutdown_connections 2021-10-21T00:09:50.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 --2- 172.21.15.41:0/3162770821 >> v2:172.21.15.62:3300/0 conn(0x7f35440b31e0 0x7f35440b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 --2- 172.21.15.41:0/3162770821 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b9ca0 0x7f35440b0690 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 -- 172.21.15.41:0/3162770821 >> 172.21.15.41:0/3162770821 conn(0x7f3544062f00 msgr2=0x7f35440b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 -- 172.21.15.41:0/3162770821 shutdown_connections 2021-10-21T00:09:50.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.617+0000 7f354c4df700 1 -- 172.21.15.41:0/3162770821 wait complete. 2021-10-21T00:09:50.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 Processor -- start 2021-10-21T00:09:50.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- start start 2021-10-21T00:09:50.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35440b24b0 0x7f35441461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 0x7f35441556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544144db0 con 0x7f35440b31e0 2021-10-21T00:09:50.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544145850 con 0x7f35440b24b0 2021-10-21T00:09:50.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35441447c0 con 0x7f35440b9ca0 2021-10-21T00:09:50.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34390/0 (socket says 172.21.15.41:34390) 2021-10-21T00:09:50.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 -- 172.21.15.41:0/447392732 learned_addr learned my addr 172.21.15.41:0/447392732 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354a27b700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35440b24b0 0x7f35441461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354aa7c700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 0x7f35441556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 -- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 msgr2=0x7f35441556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 0x7f35441556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 -- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35440b24b0 msgr2=0x7f35441461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35440b24b0 0x7f35441461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 -- 172.21.15.41:0/447392732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353800b1e0 con 0x7f35440b31e0 2021-10-21T00:09:50.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354aa7c700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 0x7f35441556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:50.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f3549a7a700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f3540006940 tx=0x7f3540008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3540011850 con 0x7f35440b31e0 2021-10-21T00:09:50.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35400119b0 con 0x7f35440b31e0 2021-10-21T00:09:50.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35441443c0 con 0x7f35440b31e0 2021-10-21T00:09:50.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3540011d10 con 0x7f35440b31e0 2021-10-21T00:09:50.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.621+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3544146850 con 0x7f35440b31e0 2021-10-21T00:09:50.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3544057350 con 0x7f35440b31e0 2021-10-21T00:09:50.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3540012420 con 0x7f35440b31e0 2021-10-21T00:09:50.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f35377fe700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 0x7f3524055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f354006b580 con 0x7f35440b31e0 2021-10-21T00:09:50.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f354a27b700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 0x7f3524055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.625+0000 7f354a27b700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 0x7f3524055b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f353801c000 tx=0x7f3538015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.633+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35400429b0 con 0x7f35440b31e0 2021-10-21T00:09:50.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.757+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3544145a20 con 0x7f35440b31e0 2021-10-21T00:09:50.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f35377fe700 1 -- 172.21.15.41:0/447392732 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v74) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3540045fd0 con 0x7f35440b31e0 2021-10-21T00:09:50.767 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:09:50.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 msgr2=0x7f3524055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 0x7f3524055b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f353801c000 tx=0x7f3538015000).stop 2021-10-21T00:09:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 msgr2=0x7f35441551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f3540006940 tx=0x7f3540008040).stop 2021-10-21T00:09:50.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 shutdown_connections 2021-10-21T00:09:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f35240536d0 0x7f3524055b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35440b9ca0 0x7f35441556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f35440b31e0 0x7f35441551f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 --2- 172.21.15.41:0/447392732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35440b24b0 0x7f35441461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 >> 172.21.15.41:0/447392732 conn(0x7f3544062f00 msgr2=0x7f35441419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 shutdown_connections 2021-10-21T00:09:50.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.761+0000 7f354c4df700 1 -- 172.21.15.41:0/447392732 wait complete. 2021-10-21T00:09:50.780 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:09:50.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 Processor -- start 2021-10-21T00:09:50.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 -- start start 2021-10-21T00:09:50.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efebc062330 0x7efebc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efebc062f70 0x7efebc05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc0b3a20 0x7efebc13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc05bd40 con 0x7efebc062f70 2021-10-21T00:09:50.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc05bf70 con 0x7efebc062330 2021-10-21T00:09:50.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec338c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc142cb0 con 0x7efebc0b3a20 2021-10-21T00:09:50.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec1b89700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efebc062f70 0x7efebc05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec1b89700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efebc062f70 0x7efebc05c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34398/0 (socket says 172.21.15.41:34398) 2021-10-21T00:09:50.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec1b89700 1 -- 172.21.15.41:0/2580391335 learned_addr learned my addr 172.21.15.41:0/2580391335 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.881+0000 7efec2b8b700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc0b3a20 0x7efebc13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec238a700 1 --2- 172.21.15.41:0/2580391335 >> v2:172.21.15.62:3300/0 conn(0x7efebc062330 0x7efebc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 -- 172.21.15.41:0/2580391335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc0b3a20 msgr2=0x7efebc13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:50.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc0b3a20 0x7efebc13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 -- 172.21.15.41:0/2580391335 >> v2:172.21.15.62:3300/0 conn(0x7efebc062330 msgr2=0x7efebc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:50.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 --2- 172.21.15.41:0/2580391335 >> v2:172.21.15.62:3300/0 conn(0x7efebc062330 0x7efebc0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 -- 172.21.15.41:0/2580391335 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc142950 con 0x7efebc062f70 2021-10-21T00:09:50.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1b89700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc062f70 0x7efebc05c410 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7efeb8002f70 tx=0x7efeb8006eb0).ready entity=mon.0 client_cookie=574ae91590eec0da server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1388700 1 -- 172.21.15.41:0/2580391335 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb800d570 con 0x7efebc062f70 2021-10-21T00:09:50.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1388700 1 -- 172.21.15.41:0/2580391335 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8000e90 con 0x7efebc062f70 2021-10-21T00:09:50.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec1388700 1 -- 172.21.15.41:0/2580391335 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb800d900 con 0x7efebc062f70 2021-10-21T00:09:50.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- 172.21.15.41:0/2580391335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc062f70 msgr2=0x7efebc05c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc062f70 0x7efebc05c410 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7efeb8002f70 tx=0x7efeb8006eb0).stop 2021-10-21T00:09:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- 172.21.15.41:0/2580391335 shutdown_connections 2021-10-21T00:09:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc062f70 0x7efebc05c410 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 --2- 172.21.15.41:0/2580391335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc0b3a20 0x7efebc13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 --2- 172.21.15.41:0/2580391335 >> v2:172.21.15.62:3300/0 conn(0x7efebc062330 0x7efebc0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- 172.21.15.41:0/2580391335 >> 172.21.15.41:0/2580391335 conn(0x7efebc0b9080 msgr2=0x7efebc0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- 172.21.15.41:0/2580391335 shutdown_connections 2021-10-21T00:09:50.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- 172.21.15.41:0/2580391335 wait complete. 2021-10-21T00:09:50.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 Processor -- start 2021-10-21T00:09:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.885+0000 7efec338c700 1 -- start start 2021-10-21T00:09:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 0x7efebc143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc062f70 0x7efebc146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc114b20 con 0x7efebc0b3a20 2021-10-21T00:09:50.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0ae0e0 con 0x7efebc062330 2021-10-21T00:09:50.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0ae380 con 0x7efebc062f70 2021-10-21T00:09:50.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34406/0 (socket says 172.21.15.41:34406) 2021-10-21T00:09:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 -- 172.21.15.41:0/560232568 learned_addr learned my addr 172.21.15.41:0/560232568 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec1b89700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc062f70 0x7efebc146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec238a700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 0x7efebc143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 -- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc062f70 msgr2=0x7efebc146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc062f70 0x7efebc146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 -- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 msgr2=0x7efebc143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:50.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 0x7efebc143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:50.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 -- 172.21.15.41:0/560232568 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb800b1e0 con 0x7efebc0b3a20 2021-10-21T00:09:50.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec238a700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 0x7efebc143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:50.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec2b8b700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7efeb400c000 tx=0x7efeb40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb400c610 con 0x7efebc0b3a20 2021-10-21T00:09:50.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc146cc0 con 0x7efebc0b3a20 2021-10-21T00:09:50.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400c770 con 0x7efebc0b3a20 2021-10-21T00:09:50.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb400cad0 con 0x7efebc0b3a20 2021-10-21T00:09:50.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc114890 con 0x7efebc0b3a20 2021-10-21T00:09:50.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.889+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0ae540 con 0x7efebc0b3a20 2021-10-21T00:09:50.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.893+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efeb4022070 con 0x7efebc0b3a20 2021-10-21T00:09:50.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.893+0000 7efeab7fe700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 0x7efe9c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:50.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.893+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efeb406bba0 con 0x7efebc0b3a20 2021-10-21T00:09:50.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.893+0000 7efec238a700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 0x7efe9c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:50.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.893+0000 7efec238a700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 0x7efe9c055b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7efeac00c000 tx=0x7efeac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:50.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:50.897+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efeb4043030 con 0x7efebc0b3a20 2021-10-21T00:09:51.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efebc057350 con 0x7efebc0b3a20 2021-10-21T00:09:51.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efeab7fe700 1 -- 172.21.15.41:0/560232568 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7efeb4016020 con 0x7efebc0b3a20 2021-10-21T00:09:51.032 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:51.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 msgr2=0x7efe9c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 0x7efe9c055b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7efeac00c000 tx=0x7efeac008040).stop 2021-10-21T00:09:51.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 msgr2=0x7efebc1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.025+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7efeb400c000 tx=0x7efeb40091d0).stop 2021-10-21T00:09:51.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 shutdown_connections 2021-10-21T00:09:51.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efe9c053640 0x7efe9c055b00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efebc0b3a20 0x7efebc1514e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efebc062f70 0x7efebc146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 --2- 172.21.15.41:0/560232568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efebc062330 0x7efebc143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 >> 172.21.15.41:0/560232568 conn(0x7efebc0b9080 msgr2=0x7efebc13f060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:51.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 shutdown_connections 2021-10-21T00:09:51.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.029+0000 7efec338c700 1 -- 172.21.15.41:0/560232568 wait complete. 2021-10-21T00:09:51.046 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:09:51.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 Processor -- start 2021-10-21T00:09:51.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 -- start start 2021-10-21T00:09:51.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe65405f9f0 0x7fe65414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe65414b350 0x7fe6540af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6540609d0 con 0x7fe6540aa750 2021-10-21T00:09:51.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540b1620 con 0x7fe65405f9f0 2021-10-21T00:09:51.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe65a083700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65405fdd0 con 0x7fe65414b350 2021-10-21T00:09:51.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6537fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe65405f9f0 0x7fe65414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe6540aa750 0x7fe65414ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60412/0 (socket says 172.21.15.41:60412) 2021-10-21T00:09:51.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 -- 172.21.15.41:0/1743501109 learned_addr learned my addr 172.21.15.41:0/1743501109 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:51.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe653fff700 1 --2- 172.21.15.41:0/1743501109 >> v2:172.21.15.62:3300/0 conn(0x7fe65414b350 0x7fe6540af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330542584 0 0) 0x7fe6540609d0 con 0x7fe6540aa750 2021-10-21T00:09:51.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe640003260 con 0x7fe6540aa750 2021-10-21T00:09:51.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456496478 0 0) 0x7fe640003260 con 0x7fe6540aa750 2021-10-21T00:09:51.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 >> v2:172.21.15.62:3300/0 conn(0x7fe65414b350 msgr2=0x7fe6540af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:51.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 --2- 172.21.15.41:0/1743501109 >> v2:172.21.15.62:3300/0 conn(0x7fe65414b350 0x7fe6540af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 >> v2:172.21.15.41:3300/0 conn(0x7fe65405f9f0 msgr2=0x7fe65414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 --2- 172.21.15.41:0/1743501109 >> v2:172.21.15.41:3300/0 conn(0x7fe65405f9f0 0x7fe65414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540b1380 con 0x7fe6540aa750 2021-10-21T00:09:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fe6440019e0 con 0x7fe6540aa750 2021-10-21T00:09:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 >> v1:172.21.15.41:6789/0 conn(0x7fe6540aa750 legacy=0x7fe65414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe640003750 0x7fe640003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe640004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe640004e70 0x7fe64000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540b1620 con 0x7fe640004500 2021-10-21T00:09:51.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65405fdd0 con 0x7fe640004e70 2021-10-21T00:09:51.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64000bc40 con 0x7fe640003750 2021-10-21T00:09:51.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe640004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe6537fe700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe640003750 0x7fe640003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe653fff700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe640004e70 0x7fe64000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 -- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe640003750 msgr2=0x7fe640003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:51.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe640003750 0x7fe640003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 -- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe640004e70 msgr2=0x7fe64000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:51.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe640004e70 0x7fe64000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 -- 172.21.15.41:0/1743501109 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640003260 con 0x7fe640004500 2021-10-21T00:09:51.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe653fff700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe640004e70 0x7fe64000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:51.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe653fff700 1 -- 172.21.15.41:0/1743501109 reap_dead start 2021-10-21T00:09:51.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.145+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe640004980 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fe6440016f0 tx=0x7fe6540b1510).ready entity=mon.0 client_cookie=502b88527358f82e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64400cd40 con 0x7fe640004500 2021-10-21T00:09:51.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe644005990 con 0x7fe640004500 2021-10-21T00:09:51.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6527fc700 1 -- 172.21.15.41:0/1743501109 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64400cea0 con 0x7fe640004500 2021-10-21T00:09:51.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 msgr2=0x7fe640004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe640004980 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fe6440016f0 tx=0x7fe6540b1510).stop 2021-10-21T00:09:51.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- 172.21.15.41:0/1743501109 shutdown_connections 2021-10-21T00:09:51.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 --2- 172.21.15.41:0/1743501109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe640004980 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- 172.21.15.41:0/1743501109 >> 172.21.15.41:0/1743501109 conn(0x7fe65405bca0 msgr2=0x7fe65405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- 172.21.15.41:0/1743501109 shutdown_connections 2021-10-21T00:09:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- 172.21.15.41:0/1743501109 wait complete. 2021-10-21T00:09:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 Processor -- start 2021-10-21T00:09:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- start start 2021-10-21T00:09:51.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe654145ff0 0x7fe654143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6540aef50 0x7fe6540ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654098ec0 con 0x7fe640004500 2021-10-21T00:09:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654099160 con 0x7fe654145ff0 2021-10-21T00:09:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe65a083700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe654146650 con 0x7fe6540aef50 2021-10-21T00:09:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34422/0 (socket says 172.21.15.41:34422) 2021-10-21T00:09:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe6537fe700 1 -- 172.21.15.41:0/1888202733 learned_addr learned my addr 172.21.15.41:0/1888202733 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe653fff700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6540aef50 0x7fe6540ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.149+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe654145ff0 0x7fe654143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 -- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6540aef50 msgr2=0x7fe6540ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6540aef50 0x7fe6540ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 -- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe654145ff0 msgr2=0x7fe654143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe654145ff0 0x7fe654143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 -- 172.21.15.41:0/1888202733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654098bb0 con 0x7fe640004500 2021-10-21T00:09:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe6537fe700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fe64800b000 tx=0x7fe648006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe648011e70 con 0x7fe640004500 2021-10-21T00:09:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64800f940 con 0x7fe640004500 2021-10-21T00:09:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6540acec0 con 0x7fe640004500 2021-10-21T00:09:51.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64800fca0 con 0x7fe640004500 2021-10-21T00:09:51.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6540ad390 con 0x7fe640004500 2021-10-21T00:09:51.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe654099320 con 0x7fe640004500 2021-10-21T00:09:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe648014440 con 0x7fe640004500 2021-10-21T00:09:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 0x7fe634055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe64806c090 con 0x7fe640004500 2021-10-21T00:09:51.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.153+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 0x7fe634055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.157+0000 7fe652ffd700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 0x7fe634055b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fe644019000 tx=0x7fe644013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.161+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6480434c0 con 0x7fe640004500 2021-10-21T00:09:51.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.285+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe6540678f0 con 0x7fe640004500 2021-10-21T00:09:51.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.285+0000 7fe650ff9700 1 -- 172.21.15.41:0/1888202733 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe648018070 con 0x7fe640004500 2021-10-21T00:09:51.293 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:51.294 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:09:51.294 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:51.294 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:09:51.294 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:09:51.295 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:09:51.295 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:09:51.295 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:09:51.295 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:09:51.295 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:09:51.296 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:09:51.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 msgr2=0x7fe634055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 0x7fe634055b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fe644019000 tx=0x7fe644013000).stop 2021-10-21T00:09:51.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 msgr2=0x7fe654099600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fe64800b000 tx=0x7fe648006df0).stop 2021-10-21T00:09:51.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 shutdown_connections 2021-10-21T00:09:51.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe6340536a0 0x7fe634055b60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe6540aef50 0x7fe6540ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe654145ff0 0x7fe654143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 --2- 172.21.15.41:0/1888202733 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe640004500 0x7fe654099600 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 >> 172.21.15.41:0/1888202733 conn(0x7fe65405bca0 msgr2=0x7fe6540b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:51.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 shutdown_connections 2021-10-21T00:09:51.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.289+0000 7fe65a083700 1 -- 172.21.15.41:0/1888202733 wait complete. 2021-10-21T00:09:51.306 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:09:51.307 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:09:51.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 Processor -- start 2021-10-21T00:09:51.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 -- start start 2021-10-21T00:09:51.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 0x7fdf6405beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640b65b0 con 0x7fdf64144790 2021-10-21T00:09:51.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf64067b60 con 0x7fdf640b0cc0 2021-10-21T00:09:51.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf63fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf641409e0 con 0x7fdf640b61d0 2021-10-21T00:09:51.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf637fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdf64144790 0x7fdf6413f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60436/0 (socket says 172.21.15.41:60436) 2021-10-21T00:09:51.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf637fe700 1 -- 172.21.15.41:0/4086444624 learned_addr learned my addr 172.21.15.41:0/4086444624 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:51.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf62ffd700 1 --2- 172.21.15.41:0/4086444624 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 0x7fdf6405beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957419783 0 0) 0x7fdf640b65b0 con 0x7fdf64144790 2021-10-21T00:09:51.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf44003260 con 0x7fdf64144790 2021-10-21T00:09:51.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816172162 0 0) 0x7fdf64067b60 con 0x7fdf640b0cc0 2021-10-21T00:09:51.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf640b65b0 con 0x7fdf640b0cc0 2021-10-21T00:09:51.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf62ffd700 1 -- 172.21.15.41:0/4086444624 >> v1:172.21.15.62:6789/0 conn(0x7fdf640b0cc0 legacy=0x7fdf64144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606228766 0 0) 0x7fdf44003260 con 0x7fdf64144790 2021-10-21T00:09:51.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf62ffd700 1 -- 172.21.15.41:0/4086444624 >> v1:172.21.15.41:6789/0 conn(0x7fdf64144790 legacy=0x7fdf6413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.417+0000 7fdf62ffd700 1 -- 172.21.15.41:0/4086444624 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6405c7f0 con 0x7fdf640b61d0 2021-10-21T00:09:51.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf62ffd700 1 --2- 172.21.15.41:0/4086444624 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 0x7fdf6405beb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdf5c001490 tx=0x7fdf54006df0).ready entity=mon.2 client_cookie=db486b1b71c179de server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf5c0019e0 con 0x7fdf640b61d0 2021-10-21T00:09:51.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54000e90 con 0x7fdf640b61d0 2021-10-21T00:09:51.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf627fc700 1 -- 172.21.15.41:0/4086444624 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf54012460 con 0x7fdf640b61d0 2021-10-21T00:09:51.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- 172.21.15.41:0/4086444624 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 msgr2=0x7fdf6405beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 --2- 172.21.15.41:0/4086444624 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 0x7fdf6405beb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdf5c001490 tx=0x7fdf54006df0).stop 2021-10-21T00:09:51.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- 172.21.15.41:0/4086444624 shutdown_connections 2021-10-21T00:09:51.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 --2- 172.21.15.41:0/4086444624 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf640b61d0 0x7fdf6405beb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- 172.21.15.41:0/4086444624 >> 172.21.15.41:0/4086444624 conn(0x7fdf64063b80 msgr2=0x7fdf640b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:51.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- 172.21.15.41:0/4086444624 shutdown_connections 2021-10-21T00:09:51.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- 172.21.15.41:0/4086444624 wait complete. 2021-10-21T00:09:51.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 Processor -- start 2021-10-21T00:09:51.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- start start 2021-10-21T00:09:51.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf64144790 0x7fdf640ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 0x7fdf64138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64143be0 con 0x7fdf640b61d0 2021-10-21T00:09:51.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64143e80 con 0x7fdf64144790 2021-10-21T00:09:51.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf63fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64144120 con 0x7fdf6413bc60 2021-10-21T00:09:51.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf62ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf62ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34436/0 (socket says 172.21.15.41:34436) 2021-10-21T00:09:51.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf62ffd700 1 -- 172.21.15.41:0/938278402 learned_addr learned my addr 172.21.15.41:0/938278402 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:51.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 0x7fdf64138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf5bfff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf64144790 0x7fdf640ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 -- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf64144790 msgr2=0x7fdf640ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf64144790 0x7fdf640ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 -- 172.21.15.41:0/938278402 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 msgr2=0x7fdf6413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:51.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:51.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf637fe700 1 -- 172.21.15.41:0/938278402 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5400b180 con 0x7fdf6413bc60 2021-10-21T00:09:51.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.421+0000 7fdf62ffd700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:51.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf637fe700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 0x7fdf64138fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdf5c001360 tx=0x7fdf5c001a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf5c004ab0 con 0x7fdf6413bc60 2021-10-21T00:09:51.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c004c10 con 0x7fdf6413bc60 2021-10-21T00:09:51.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6413cff0 con 0x7fdf6413bc60 2021-10-21T00:09:51.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf5c007170 con 0x7fdf6413bc60 2021-10-21T00:09:51.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf641394d0 con 0x7fdf6413bc60 2021-10-21T00:09:51.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf64139af0 con 0x7fdf6413bc60 2021-10-21T00:09:51.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdf5c01b070 con 0x7fdf6413bc60 2021-10-21T00:09:51.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 0x7fdf48055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:51.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdf5c06adc0 con 0x7fdf6413bc60 2021-10-21T00:09:51.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.425+0000 7fdf62ffd700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 0x7fdf48055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:51.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.429+0000 7fdf62ffd700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 0x7fdf48055ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fdf5401a000 tx=0x7fdf54014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:51.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.433+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf64139af0 con 0x7fdf6413bc60 2021-10-21T00:09:51.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:51.565+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fdf64139af0 con 0x7fdf6413bc60 2021-10-21T00:09:52.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.293+0000 7fdf60ff9700 1 -- 172.21.15.41:0/938278402 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v75) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdf64139af0 con 0x7fdf6413bc60 2021-10-21T00:09:52.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 msgr2=0x7fdf48055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 0x7fdf48055ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fdf5401a000 tx=0x7fdf54014000).stop 2021-10-21T00:09:52.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 msgr2=0x7fdf64138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 0x7fdf64138fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdf5c001360 tx=0x7fdf5c001a20).stop 2021-10-21T00:09:52.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 shutdown_connections 2021-10-21T00:09:52.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdf48053610 0x7fdf48055ad0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdf6413bc60 0x7fdf64138fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf64144790 0x7fdf640ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 --2- 172.21.15.41:0/938278402 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdf640b61d0 0x7fdf6413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 >> 172.21.15.41:0/938278402 conn(0x7fdf64063b80 msgr2=0x7fdf64141150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:52.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 shutdown_connections 2021-10-21T00:09:52.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.297+0000 7fdf63fff700 1 -- 172.21.15.41:0/938278402 wait complete. 2021-10-21T00:09:52.307 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:09:52.321 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:09:52.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.421+0000 7f7c39e51700 1 Processor -- start 2021-10-21T00:09:52.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.421+0000 7f7c39e51700 1 -- start start 2021-10-21T00:09:52.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7c3405bfe0 0x7f7c341461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:52.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3405c3c0 con 0x7f7c3405c6b0 2021-10-21T00:09:52.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340b27a0 con 0x7f7c34067a00 2021-10-21T00:09:52.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340b1920 con 0x7f7c3405bfe0 2021-10-21T00:09:52.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7c3405bfe0 0x7f7c341461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:52.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7c3405bfe0 0x7f7c341461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34444/0 (socket says 172.21.15.41:34444) 2021-10-21T00:09:52.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 -- 172.21.15.41:0/2846957272 learned_addr learned my addr 172.21.15.41:0/2846957272 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:52.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258832659 0 0) 0x7f7c340b27a0 con 0x7f7c34067a00 2021-10-21T00:09:52.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c18003260 con 0x7f7c34067a00 2021-10-21T00:09:52.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721027324 0 0) 0x7f7c3405c3c0 con 0x7f7c3405c6b0 2021-10-21T00:09:52.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 -- 172.21.15.41:0/2846957272 >> v1:172.21.15.62:6789/0 conn(0x7f7c34067a00 legacy=0x7f7c341466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 -- 172.21.15.41:0/2846957272 >> v1:172.21.15.41:6789/0 conn(0x7f7c3405c6b0 legacy=0x7f7c34141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 -- 172.21.15.41:0/2846957272 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340b2a40 con 0x7f7c3405bfe0 2021-10-21T00:09:52.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c38e4f700 1 --2- 172.21.15.41:0/2846957272 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405bfe0 0x7f7c341461c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7c28002f70 tx=0x7f7c28006e50).ready entity=mon.0 client_cookie=9d28adb13ea6768f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:52.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2800d660 con 0x7f7c3405bfe0 2021-10-21T00:09:52.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28000e90 con 0x7f7c3405bfe0 2021-10-21T00:09:52.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c337fe700 1 -- 172.21.15.41:0/2846957272 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2800d9b0 con 0x7f7c3405bfe0 2021-10-21T00:09:52.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- 172.21.15.41:0/2846957272 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405bfe0 msgr2=0x7f7c341461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 --2- 172.21.15.41:0/2846957272 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405bfe0 0x7f7c341461c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f7c28002f70 tx=0x7f7c28006e50).stop 2021-10-21T00:09:52.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- 172.21.15.41:0/2846957272 shutdown_connections 2021-10-21T00:09:52.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 --2- 172.21.15.41:0/2846957272 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405bfe0 0x7f7c341461c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- 172.21.15.41:0/2846957272 >> 172.21.15.41:0/2846957272 conn(0x7f7c340637b0 msgr2=0x7f7c34063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:52.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- 172.21.15.41:0/2846957272 shutdown_connections 2021-10-21T00:09:52.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.425+0000 7f7c39e51700 1 -- 172.21.15.41:0/2846957272 wait complete. 2021-10-21T00:09:52.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 Processor -- start 2021-10-21T00:09:52.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 -- start start 2021-10-21T00:09:52.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 0x7f7c341404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:52.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:52.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c34067a00 0x7f7c341139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:52.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34065310 con 0x7f7c3405c6b0 2021-10-21T00:09:52.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340656d0 con 0x7f7c3405bfe0 2021-10-21T00:09:52.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39e51700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34064620 con 0x7f7c34067a00 2021-10-21T00:09:52.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:52.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34450/0 (socket says 172.21.15.41:34450) 2021-10-21T00:09:52.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 -- 172.21.15.41:0/1016606533 learned_addr learned my addr 172.21.15.41:0/1016606533 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:52.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c39650700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c34067a00 0x7f7c341139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:52.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c38e4f700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 0x7f7c341404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:52.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 -- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c34067a00 msgr2=0x7f7c341139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c34067a00 0x7f7c341139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 -- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 msgr2=0x7f7c341404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:52.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 0x7f7c341404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:52.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 -- 172.21.15.41:0/1016606533 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2800b1e0 con 0x7f7c3405c6b0 2021-10-21T00:09:52.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c38e4f700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 0x7f7c341404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:52.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c33fff700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7c20001110 tx=0x7f7c20007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:52.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.429+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c20012400 con 0x7f7c3405c6b0 2021-10-21T00:09:52.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c341415e0 con 0x7f7c3405c6b0 2021-10-21T00:09:52.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c34065900 con 0x7f7c3405c6b0 2021-10-21T00:09:52.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20012560 con 0x7f7c3405c6b0 2021-10-21T00:09:52.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c200128c0 con 0x7f7c3405c6b0 2021-10-21T00:09:52.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c34064a20 con 0x7f7c3405c6b0 2021-10-21T00:09:52.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c20010070 con 0x7f7c3405c6b0 2021-10-21T00:09:52.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c31ffb700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 0x7f7c14055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:52.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7c2006ac00 con 0x7f7c3405c6b0 2021-10-21T00:09:52.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c38e4f700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 0x7f7c14055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:52.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.433+0000 7f7c38e4f700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 0x7f7c14055a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7c2801a000 tx=0x7f7c28014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:52.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.441+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c20070020 con 0x7f7c3405c6b0 2021-10-21T00:09:52.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:52.573+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7c340b11e0 con 0x7f7c3405c6b0 2021-10-21T00:09:53.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.261+0000 7f7c31ffb700 1 -- 172.21.15.41:0/1016606533 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v76) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7c20041e90 con 0x7f7c3405c6b0 2021-10-21T00:09:53.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 msgr2=0x7f7c14055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 0x7f7c14055a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7c2801a000 tx=0x7f7c28014000).stop 2021-10-21T00:09:53.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 msgr2=0x7f7c34155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f7c20001110 tx=0x7f7c20007ae0).stop 2021-10-21T00:09:53.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 shutdown_connections 2021-10-21T00:09:53.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7c140535b0 0x7f7c14055a70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7c34067a00 0x7f7c341139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7c3405c6b0 0x7f7c34155b80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 --2- 172.21.15.41:0/1016606533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c3405bfe0 0x7f7c341404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 >> 172.21.15.41:0/1016606533 conn(0x7f7c340637b0 msgr2=0x7f7c341429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 shutdown_connections 2021-10-21T00:09:53.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.269+0000 7f7c39e51700 1 -- 172.21.15.41:0/1016606533 wait complete. 2021-10-21T00:09:53.281 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:09:53.291 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:09:53.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.393+0000 7fa49b27e700 1 Processor -- start 2021-10-21T00:09:53.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.393+0000 7fa49b27e700 1 -- start start 2021-10-21T00:09:53.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa49405f850 0x7fa4940ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494146980 0x7fa4940ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940ac6e0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940ac980 con 0x7fa49405f850 2021-10-21T00:09:53.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49405fc30 con 0x7fa494146980 2021-10-21T00:09:53.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa498819700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa4940b2bf0 0x7fa494146270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60462/0 (socket says 172.21.15.41:60462) 2021-10-21T00:09:53.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa498819700 1 -- 172.21.15.41:0/352268599 learned_addr learned my addr 172.21.15.41:0/352268599 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:53.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 --2- 172.21.15.41:0/352268599 >> v2:172.21.15.41:3300/0 conn(0x7fa49405f850 0x7fa4940ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49981b700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494146980 0x7fa4940ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa483fff700 1 -- 172.21.15.41:0/352268599 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842437829 0 0) 0x7fa4940ac6e0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa483fff700 1 -- 172.21.15.41:0/352268599 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa47c003260 con 0x7fa4940b2bf0 2021-10-21T00:09:53.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 -- 172.21.15.41:0/352268599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494146980 msgr2=0x7fa4940ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:53.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494146980 0x7fa4940ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 -- 172.21.15.41:0/352268599 >> v1:172.21.15.41:6789/0 conn(0x7fa4940b2bf0 legacy=0x7fa494146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 -- 172.21.15.41:0/352268599 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49405fda0 con 0x7fa49405f850 2021-10-21T00:09:53.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49901a700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49405f850 0x7fa4940ad0c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fa490002f70 tx=0x7fa490006df0).ready entity=mon.0 client_cookie=fe97944aa8b715f7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa483fff700 1 -- 172.21.15.41:0/352268599 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49000d4a0 con 0x7fa49405f850 2021-10-21T00:09:53.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa483fff700 1 -- 172.21.15.41:0/352268599 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa490000e90 con 0x7fa49405f850 2021-10-21T00:09:53.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa483fff700 1 -- 172.21.15.41:0/352268599 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49000d7f0 con 0x7fa49405f850 2021-10-21T00:09:53.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- 172.21.15.41:0/352268599 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49405f850 msgr2=0x7fa4940ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49405f850 0x7fa4940ad0c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fa490002f70 tx=0x7fa490006df0).stop 2021-10-21T00:09:53.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- 172.21.15.41:0/352268599 shutdown_connections 2021-10-21T00:09:53.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa494146980 0x7fa4940ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 --2- 172.21.15.41:0/352268599 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa49405f850 0x7fa4940ad0c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- 172.21.15.41:0/352268599 >> 172.21.15.41:0/352268599 conn(0x7fa4940b7030 msgr2=0x7fa4940b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- 172.21.15.41:0/352268599 shutdown_connections 2021-10-21T00:09:53.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.397+0000 7fa49b27e700 1 -- 172.21.15.41:0/352268599 wait complete. 2021-10-21T00:09:53.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 Processor -- start 2021-10-21T00:09:53.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 -- start start 2021-10-21T00:09:53.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49405f850 0x7fa4940b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494146980 0x7fa4940aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49409a3e0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49409a940 con 0x7fa494146980 2021-10-21T00:09:53.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49b27e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49409a060 con 0x7fa49405f850 2021-10-21T00:09:53.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34466/0 (socket says 172.21.15.41:34466) 2021-10-21T00:09:53.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 -- 172.21.15.41:0/1682592098 learned_addr learned my addr 172.21.15.41:0/1682592098 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:53.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49901a700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49405f850 0x7fa4940b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa49981b700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494146980 0x7fa4940aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 -- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49405f850 msgr2=0x7fa4940b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49405f850 0x7fa4940b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 -- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494146980 msgr2=0x7fa4940aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494146980 0x7fa4940aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 -- 172.21.15.41:0/1682592098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49000b180 con 0x7fa4940b2bf0 2021-10-21T00:09:53.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa498819700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fa484001110 tx=0x7fa484007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.401+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48400ce20 con 0x7fa4940b2bf0 2021-10-21T00:09:53.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840072e0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa494066a30 con 0x7fa4940b2bf0 2021-10-21T00:09:53.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa484005800 con 0x7fa4940b2bf0 2021-10-21T00:09:53.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940af390 con 0x7fa4940b2bf0 2021-10-21T00:09:53.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940b33b0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa484010070 con 0x7fa4940b2bf0 2021-10-21T00:09:53.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa4827fc700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 0x7fa4740559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fa48406aff0 con 0x7fa4940b2bf0 2021-10-21T00:09:53.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.405+0000 7fa49901a700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 0x7fa4740559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.409+0000 7fa49901a700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 0x7fa4740559e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa49001a000 tx=0x7fa490014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.413+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa484042110 con 0x7fa4940b2bf0 2021-10-21T00:09:53.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.577+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa494057350 con 0x7fa4940b2bf0 2021-10-21T00:09:53.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa4827fc700 1 -- 172.21.15.41:0/1682592098 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v38) v1 ==== 189+0+0 (secure 0 0 0) 0x7fa484045730 con 0x7fa4940b2bf0 2021-10-21T00:09:53.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 msgr2=0x7fa4740559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 0x7fa4740559e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa49001a000 tx=0x7fa490014000).stop 2021-10-21T00:09:53.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 msgr2=0x7fa4940ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fa484001110 tx=0x7fa484007ad0).stop 2021-10-21T00:09:53.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 shutdown_connections 2021-10-21T00:09:53.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa474053520 0x7fa4740559e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa494146980 0x7fa4940aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4940b2bf0 0x7fa4940ae9b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 --2- 172.21.15.41:0/1682592098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa49405f850 0x7fa4940b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 >> 172.21.15.41:0/1682592098 conn(0x7fa4940b7030 msgr2=0x7fa494146180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 shutdown_connections 2021-10-21T00:09:53.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.589+0000 7fa49b27e700 1 -- 172.21.15.41:0/1682592098 wait complete. 2021-10-21T00:09:53.600 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 15 and data pool 16 2021-10-21T00:09:53.613 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:53.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.697+0000 7f02b88c4700 1 Processor -- start 2021-10-21T00:09:53.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.697+0000 7f02b88c4700 1 -- start start 2021-10-21T00:09:53.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02b405f9f0 0x7f02b40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f02b40b0730 0x7f02b40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b405fdd0 con 0x7f02b40b3150 2021-10-21T00:09:53.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b4140400 con 0x7f02b40b0730 2021-10-21T00:09:53.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40b27c0 con 0x7f02b405f9f0 2021-10-21T00:09:53.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b359e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f02b40b3150 0x7f02b4142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60480/0 (socket says 172.21.15.41:60480) 2021-10-21T00:09:53.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b359e700 1 -- 172.21.15.41:0/1608932969 learned_addr learned my addr 172.21.15.41:0/1608932969 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:53.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 --2- 172.21.15.41:0/1608932969 >> v2:172.21.15.41:3300/0 conn(0x7f02b40b0730 0x7f02b40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b2d9d700 1 --2- 172.21.15.41:0/1608932969 >> v2:172.21.15.62:3300/0 conn(0x7f02b405f9f0 0x7f02b40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b259c700 1 -- 172.21.15.41:0/1608932969 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365678278 0 0) 0x7f02b405fdd0 con 0x7f02b40b3150 2021-10-21T00:09:53.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b259c700 1 -- 172.21.15.41:0/1608932969 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0294003260 con 0x7f02b40b3150 2021-10-21T00:09:53.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 -- 172.21.15.41:0/1608932969 >> v2:172.21.15.62:3300/0 conn(0x7f02b405f9f0 msgr2=0x7f02b40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:53.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 --2- 172.21.15.41:0/1608932969 >> v2:172.21.15.62:3300/0 conn(0x7f02b405f9f0 0x7f02b40b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 -- 172.21.15.41:0/1608932969 >> v1:172.21.15.41:6789/0 conn(0x7f02b40b3150 legacy=0x7f02b4142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 -- 172.21.15.41:0/1608932969 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40b35a0 con 0x7f02b40b0730 2021-10-21T00:09:53.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02abfff700 1 --2- 172.21.15.41:0/1608932969 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b40b0730 0x7f02b40b2c60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f02b413f630 tx=0x7f029c006df0).ready entity=mon.0 client_cookie=31f2b92d24ec448a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b259c700 1 -- 172.21.15.41:0/1608932969 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c00d4f0 con 0x7f02b40b0730 2021-10-21T00:09:53.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b259c700 1 -- 172.21.15.41:0/1608932969 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c000e90 con 0x7f02b40b0730 2021-10-21T00:09:53.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b259c700 1 -- 172.21.15.41:0/1608932969 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c00d840 con 0x7f02b40b0730 2021-10-21T00:09:53.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- 172.21.15.41:0/1608932969 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b40b0730 msgr2=0x7f02b40b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 --2- 172.21.15.41:0/1608932969 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b40b0730 0x7f02b40b2c60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f02b413f630 tx=0x7f029c006df0).stop 2021-10-21T00:09:53.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- 172.21.15.41:0/1608932969 shutdown_connections 2021-10-21T00:09:53.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 --2- 172.21.15.41:0/1608932969 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b40b0730 0x7f02b40b2c60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 --2- 172.21.15.41:0/1608932969 >> v2:172.21.15.62:3300/0 conn(0x7f02b405f9f0 0x7f02b40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- 172.21.15.41:0/1608932969 >> 172.21.15.41:0/1608932969 conn(0x7f02b40637b0 msgr2=0x7f02b4063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- 172.21.15.41:0/1608932969 shutdown_connections 2021-10-21T00:09:53.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.701+0000 7f02b88c4700 1 -- 172.21.15.41:0/1608932969 wait complete. 2021-10-21T00:09:53.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 Processor -- start 2021-10-21T00:09:53.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- start start 2021-10-21T00:09:53.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b40b0730 0x7f02b4065e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02b40b3150 0x7f02b4067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4066320 con 0x7f02b405f9f0 2021-10-21T00:09:53.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4066b70 con 0x7f02b40b0730 2021-10-21T00:09:53.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4066da0 con 0x7f02b40b3150 2021-10-21T00:09:53.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34480/0 (socket says 172.21.15.41:34480) 2021-10-21T00:09:53.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 -- 172.21.15.41:0/209114607 learned_addr learned my addr 172.21.15.41:0/209114607 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:53.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02abfff700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b40b0730 0x7f02b4065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b359e700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02b40b3150 0x7f02b4067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 -- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02b40b3150 msgr2=0x7f02b4067240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02b40b3150 0x7f02b4067240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 -- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b40b0730 msgr2=0x7f02b4065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b40b0730 0x7f02b4065e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 -- 172.21.15.41:0/209114607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c00b180 con 0x7f02b405f9f0 2021-10-21T00:09:53.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b2d9d700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f02a400c000 tx=0x7f02a4006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a40104c0 con 0x7f02b405f9f0 2021-10-21T00:09:53.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a4010620 con 0x7f02b405f9f0 2021-10-21T00:09:53.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b4066540 con 0x7f02b405f9f0 2021-10-21T00:09:53.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a4010980 con 0x7f02b405f9f0 2021-10-21T00:09:53.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.705+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b4138460 con 0x7f02b405f9f0 2021-10-21T00:09:53.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f02a401a030 con 0x7f02b405f9f0 2021-10-21T00:09:53.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b4066fa0 con 0x7f02b405f9f0 2021-10-21T00:09:53.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02b0d99700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 0x7f02980559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02a406b440 con 0x7f02b405f9f0 2021-10-21T00:09:53.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02abfff700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 0x7f02980559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.709+0000 7f02abfff700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 0x7f02980559b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f029c01a000 tx=0x7f029c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.713+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02b4066fa0 con 0x7f02b405f9f0 2021-10-21T00:09:53.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.841+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02b4066fa0 con 0x7f02b405f9f0 2021-10-21T00:09:53.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.841+0000 7f02b0d99700 1 -- 172.21.15.41:0/209114607 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f02b4066fa0 con 0x7f02b405f9f0 2021-10-21T00:09:53.849 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:53.850 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":78,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:53.582263+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:09:51.626316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-21T00:09:52.630268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:53.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 msgr2=0x7f02980559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 0x7f02980559b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f029c01a000 tx=0x7f029c014000).stop 2021-10-21T00:09:53.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 msgr2=0x7f02b40af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f02a400c000 tx=0x7f02a4006d90).stop 2021-10-21T00:09:53.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 shutdown_connections 2021-10-21T00:09:53.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02980534f0 0x7f02980559b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02b40b3150 0x7f02b4067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b40b0730 0x7f02b4065e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 --2- 172.21.15.41:0/209114607 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02b405f9f0 0x7f02b40af8d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 >> 172.21.15.41:0/209114607 conn(0x7f02b40637b0 msgr2=0x7f02b413ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 shutdown_connections 2021-10-21T00:09:53.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.845+0000 7f02b88c4700 1 -- 172.21.15.41:0/209114607 wait complete. 2021-10-21T00:09:53.867 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:53.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 Processor -- start 2021-10-21T00:09:53.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 -- start start 2021-10-21T00:09:53.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc062330 0x7febcc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7febcc062f70 0x7febcc05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febcc0b3a20 0x7febcc13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc05bd40 con 0x7febcc062f70 2021-10-21T00:09:53.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc05bf70 con 0x7febcc0b3a20 2021-10-21T00:09:53.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd20d2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc142cb0 con 0x7febcc062330 2021-10-21T00:09:53.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7febcc062f70 0x7febcc05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7febcc062f70 0x7febcc05c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34490/0 (socket says 172.21.15.41:34490) 2021-10-21T00:09:53.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 -- 172.21.15.41:0/1285704312 learned_addr learned my addr 172.21.15.41:0/1285704312 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:53.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd10d0700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc062330 0x7febcc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd18d1700 1 --2- 172.21.15.41:0/1285704312 >> v2:172.21.15.62:3300/0 conn(0x7febcc0b3a20 0x7febcc13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 -- 172.21.15.41:0/1285704312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc062330 msgr2=0x7febcc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:53.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc062330 0x7febcc0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 -- 172.21.15.41:0/1285704312 >> v2:172.21.15.62:3300/0 conn(0x7febcc0b3a20 msgr2=0x7febcc13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:53.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 --2- 172.21.15.41:0/1285704312 >> v2:172.21.15.62:3300/0 conn(0x7febcc0b3a20 0x7febcc13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 -- 172.21.15.41:0/1285704312 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc142950 con 0x7febcc062f70 2021-10-21T00:09:53.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febd08cf700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc05c410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7febc00032f0 tx=0x7febc0009290).ready entity=mon.0 client_cookie=3fda99fb51fcf9ff server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febcbfff700 1 -- 172.21.15.41:0/1285704312 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000b870 con 0x7febcc062f70 2021-10-21T00:09:53.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febcbfff700 1 -- 172.21.15.41:0/1285704312 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000b9d0 con 0x7febcc062f70 2021-10-21T00:09:53.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.965+0000 7febcbfff700 1 -- 172.21.15.41:0/1285704312 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000bb40 con 0x7febcc062f70 2021-10-21T00:09:53.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/1285704312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 msgr2=0x7febcc05c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc05c410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7febc00032f0 tx=0x7febc0009290).stop 2021-10-21T00:09:53.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/1285704312 shutdown_connections 2021-10-21T00:09:53.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc05c410 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- 172.21.15.41:0/1285704312 >> v2:172.21.15.62:3300/0 conn(0x7febcc0b3a20 0x7febcc13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- 172.21.15.41:0/1285704312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc062330 0x7febcc0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/1285704312 >> 172.21.15.41:0/1285704312 conn(0x7febcc0b9080 msgr2=0x7febcc0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:53.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/1285704312 shutdown_connections 2021-10-21T00:09:53.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/1285704312 wait complete. 2021-10-21T00:09:53.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 Processor -- start 2021-10-21T00:09:53.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- start start 2021-10-21T00:09:53.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febcc062330 0x7febcc0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc0b3a20 0x7febcc152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc152f30 con 0x7febcc062f70 2021-10-21T00:09:53.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc140bb0 con 0x7febcc062330 2021-10-21T00:09:53.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc140e50 con 0x7febcc0b3a20 2021-10-21T00:09:53.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34496/0 (socket says 172.21.15.41:34496) 2021-10-21T00:09:53.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 -- 172.21.15.41:0/725482297 learned_addr learned my addr 172.21.15.41:0/725482297 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:53.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd10d0700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febcc062330 0x7febcc0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd18d1700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc0b3a20 0x7febcc152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 -- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc0b3a20 msgr2=0x7febcc152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc0b3a20 0x7febcc152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 -- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febcc062330 msgr2=0x7febcc0acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:53.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febcc062330 0x7febcc0acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:53.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 -- 172.21.15.41:0/725482297 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0009530 con 0x7febcc062f70 2021-10-21T00:09:53.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd08cf700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7febc00032f0 tx=0x7febc0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000b870 con 0x7febcc062f70 2021-10-21T00:09:53.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc00107a0 con 0x7febcc062f70 2021-10-21T00:09:53.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc1410f0 con 0x7febcc062f70 2021-10-21T00:09:53.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc0010b00 con 0x7febcc062f70 2021-10-21T00:09:53.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.969+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc151d90 con 0x7febcc062f70 2021-10-21T00:09:53.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc057350 con 0x7febcc062f70 2021-10-21T00:09:53.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7febc0029070 con 0x7febcc062f70 2021-10-21T00:09:53.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febca7fc700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 0x7febac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:53.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febc006cbb0 con 0x7febcc062f70 2021-10-21T00:09:53.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febd10d0700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 0x7febac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:53.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.973+0000 7febd10d0700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 0x7febac055b60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7febbc00c000 tx=0x7febbc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:53.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:53.977+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febc0043c10 con 0x7febcc062f70 2021-10-21T00:09:54.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.105+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febcc152f30 con 0x7febcc062f70 2021-10-21T00:09:54.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febca7fc700 1 -- 172.21.15.41:0/725482297 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16054 (secure 0 0 0) 0x7febc0015030 con 0x7febcc062f70 2021-10-21T00:09:54.116 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:54.116 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":78,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:53.582263+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:09:51.626316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-21T00:09:52.630268+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:54.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 msgr2=0x7febac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 0x7febac055b60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7febbc00c000 tx=0x7febbc008040).stop 2021-10-21T00:09:54.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 msgr2=0x7febcc152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7febc00032f0 tx=0x7febc0016000).stop 2021-10-21T00:09:54.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 shutdown_connections 2021-10-21T00:09:54.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7febac0536a0 0x7febac055b60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febcc0b3a20 0x7febcc152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7febcc062f70 0x7febcc152550 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 --2- 172.21.15.41:0/725482297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febcc062330 0x7febcc0acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 >> 172.21.15.41:0/725482297 conn(0x7febcc0b9080 msgr2=0x7febcc0b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:54.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 shutdown_connections 2021-10-21T00:09:54.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.109+0000 7febd20d2700 1 -- 172.21.15.41:0/725482297 wait complete. 2021-10-21T00:09:54.130 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:09:54.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 Processor -- start 2021-10-21T00:09:54.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- start start 2021-10-21T00:09:54.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 0x7f105c05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.243 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f105c0b3a20 0x7f105c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c05bd40 con 0x7f105c062330 2021-10-21T00:09:54.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c05bf70 con 0x7f105c0b3a20 2021-10-21T00:09:54.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c142cb0 con 0x7f105c062f70 2021-10-21T00:09:54.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1061e9f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f105c062330 0x7f105c0b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60504/0 (socket says 172.21.15.41:60504) 2021-10-21T00:09:54.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1061e9f700 1 -- 172.21.15.41:0/1891233623 learned_addr learned my addr 172.21.15.41:0/1891233623 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:54.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 --2- 172.21.15.41:0/1891233623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 0x7f105c05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f10626a0700 1 --2- 172.21.15.41:0/1891233623 >> v2:172.21.15.62:3300/0 conn(0x7f105c0b3a20 0x7f105c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1060e9d700 1 -- 172.21.15.41:0/1891233623 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068912911 0 0) 0x7f105c05bd40 con 0x7f105c062330 2021-10-21T00:09:54.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1060e9d700 1 -- 172.21.15.41:0/1891233623 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1044003260 con 0x7f105c062330 2021-10-21T00:09:54.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 -- 172.21.15.41:0/1891233623 >> v2:172.21.15.62:3300/0 conn(0x7f105c0b3a20 msgr2=0x7f105c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:54.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 --2- 172.21.15.41:0/1891233623 >> v2:172.21.15.62:3300/0 conn(0x7f105c0b3a20 0x7f105c13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 -- 172.21.15.41:0/1891233623 >> v1:172.21.15.41:6789/0 conn(0x7f105c062330 legacy=0x7f105c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 -- 172.21.15.41:0/1891233623 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c142950 con 0x7f105c062f70 2021-10-21T00:09:54.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f106169e700 1 --2- 172.21.15.41:0/1891233623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 0x7f105c05c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f10540032f0 tx=0x7f10540091d0).ready entity=mon.2 client_cookie=4c30e3fa0acc2904 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1060e9d700 1 -- 172.21.15.41:0/1891233623 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105400b600 con 0x7f105c062f70 2021-10-21T00:09:54.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1060e9d700 1 -- 172.21.15.41:0/1891233623 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105400b760 con 0x7f105c062f70 2021-10-21T00:09:54.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1060e9d700 1 -- 172.21.15.41:0/1891233623 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f105400b8d0 con 0x7f105c062f70 2021-10-21T00:09:54.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- 172.21.15.41:0/1891233623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 msgr2=0x7f105c05c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 --2- 172.21.15.41:0/1891233623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 0x7f105c05c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f10540032f0 tx=0x7f10540091d0).stop 2021-10-21T00:09:54.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- 172.21.15.41:0/1891233623 shutdown_connections 2021-10-21T00:09:54.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 --2- 172.21.15.41:0/1891233623 >> v2:172.21.15.62:3300/0 conn(0x7f105c0b3a20 0x7f105c13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 --2- 172.21.15.41:0/1891233623 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062f70 0x7f105c05c410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- 172.21.15.41:0/1891233623 >> 172.21.15.41:0/1891233623 conn(0x7f105c0b9080 msgr2=0x7f105c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:54.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- 172.21.15.41:0/1891233623 shutdown_connections 2021-10-21T00:09:54.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.233+0000 7f1062ea1700 1 -- 172.21.15.41:0/1891233623 wait complete. 2021-10-21T00:09:54.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 Processor -- start 2021-10-21T00:09:54.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- start start 2021-10-21T00:09:54.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062330 0x7f105c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 0x7f105c112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0aedd0 con 0x7f105c0b3a20 2021-10-21T00:09:54.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0af070 con 0x7f105c062f70 2021-10-21T00:09:54.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0af310 con 0x7f105c062330 2021-10-21T00:09:54.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34512/0 (socket says 172.21.15.41:34512) 2021-10-21T00:09:54.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 -- 172.21.15.41:0/3214657998 learned_addr learned my addr 172.21.15.41:0/3214657998 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:54.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1061e9f700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062330 0x7f105c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f106169e700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 0x7f105c112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 -- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062330 msgr2=0x7f105c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062330 0x7f105c155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 -- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 msgr2=0x7f105c112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 0x7f105c112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 -- 172.21.15.41:0/3214657998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009470 con 0x7f105c0b3a20 2021-10-21T00:09:54.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f106169e700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 0x7f105c112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:54.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f10626a0700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f105800c000 tx=0x7f1058006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1058011750 con 0x7f105c0b3a20 2021-10-21T00:09:54.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580118b0 con 0x7f105c0b3a20 2021-10-21T00:09:54.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c146ce0 con 0x7f105c0b3a20 2021-10-21T00:09:54.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1058011c10 con 0x7f105c0b3a20 2021-10-21T00:09:54.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.237+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c0ae9a0 con 0x7f105c0b3a20 2021-10-21T00:09:54.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c057350 con 0x7f105c0b3a20 2021-10-21T00:09:54.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1058011d70 con 0x7f105c0b3a20 2021-10-21T00:09:54.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f104effd700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 0x7f103c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f105806bd80 con 0x7f105c0b3a20 2021-10-21T00:09:54.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f1061e9f700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 0x7f103c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.241+0000 7f1061e9f700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 0x7f103c055a40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f105000d000 tx=0x7f1050009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.245+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1058042e40 con 0x7f105c0b3a20 2021-10-21T00:09:54.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.413+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f105c156100 con 0x7f105c0b3a20 2021-10-21T00:09:54.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.597+0000 7f104effd700 1 -- 172.21.15.41:0/3214657998 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f105806d020 con 0x7f105c0b3a20 2021-10-21T00:09:54.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 msgr2=0x7f103c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 0x7f103c055a40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f105000d000 tx=0x7f1050009040).stop 2021-10-21T00:09:54.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 msgr2=0x7f105c114150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f105800c000 tx=0x7f1058006df0).stop 2021-10-21T00:09:54.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 shutdown_connections 2021-10-21T00:09:54.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f103c053580 0x7f103c055a40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f105c0b3a20 0x7f105c114150 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f105c062f70 0x7f105c112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 --2- 172.21.15.41:0/3214657998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f105c062330 0x7f105c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 >> 172.21.15.41:0/3214657998 conn(0x7f105c0b9080 msgr2=0x7f105c13efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:54.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 shutdown_connections 2021-10-21T00:09:54.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.601+0000 7f1062ea1700 1 -- 172.21.15.41:0/3214657998 wait complete. 2021-10-21T00:09:54.626 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:54.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 Processor -- start 2021-10-21T00:09:54.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 -- start start 2021-10-21T00:09:54.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b6c0b2170 0x7f4b6c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b6c0abb50 0x7f4b6c14a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0b0b50 con 0x7f4b6c0abb50 2021-10-21T00:09:54.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0b2550 con 0x7f4b6c0b2170 2021-10-21T00:09:54.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b715cf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0b0d90 con 0x7f4b6c0af620 2021-10-21T00:09:54.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b6c0abb50 0x7f4b6c14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b6c0abb50 0x7f4b6c14a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34520/0 (socket says 172.21.15.41:34520) 2021-10-21T00:09:54.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 -- 172.21.15.41:0/2655356478 learned_addr learned my addr 172.21.15.41:0/2655356478 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:54.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b6bfff700 1 --2- 172.21.15.41:0/2655356478 >> v2:172.21.15.62:3300/0 conn(0x7f4b6c0b2170 0x7f4b6c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b6b7fe700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 -- 172.21.15.41:0/2655356478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 msgr2=0x7f4b6c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:54.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 -- 172.21.15.41:0/2655356478 >> v2:172.21.15.62:3300/0 conn(0x7f4b6c0b2170 msgr2=0x7f4b6c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:54.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 --2- 172.21.15.41:0/2655356478 >> v2:172.21.15.62:3300/0 conn(0x7f4b6c0b2170 0x7f4b6c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.728+0000 7f4b70dce700 1 -- 172.21.15.41:0/2655356478 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0b1030 con 0x7f4b6c0abb50 2021-10-21T00:09:54.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b70dce700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c14a410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f4b640032f0 tx=0x7f4b64009290).ready entity=mon.0 client_cookie=4857d0ead94bb416 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b6affd700 1 -- 172.21.15.41:0/2655356478 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400b680 con 0x7f4b6c0abb50 2021-10-21T00:09:54.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b6affd700 1 -- 172.21.15.41:0/2655356478 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400b7e0 con 0x7f4b6c0abb50 2021-10-21T00:09:54.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b6affd700 1 -- 172.21.15.41:0/2655356478 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400b950 con 0x7f4b6c0abb50 2021-10-21T00:09:54.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 -- 172.21.15.41:0/2655356478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0abb50 msgr2=0x7f4b6c14a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c14a410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f4b640032f0 tx=0x7f4b64009290).stop 2021-10-21T00:09:54.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 -- 172.21.15.41:0/2655356478 shutdown_connections 2021-10-21T00:09:54.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c14a410 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 --2- 172.21.15.41:0/2655356478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 --2- 172.21.15.41:0/2655356478 >> v2:172.21.15.62:3300/0 conn(0x7f4b6c0b2170 0x7f4b6c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 -- 172.21.15.41:0/2655356478 >> 172.21.15.41:0/2655356478 conn(0x7f4b6c0b5700 msgr2=0x7f4b6c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:54.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 -- 172.21.15.41:0/2655356478 shutdown_connections 2021-10-21T00:09:54.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.732+0000 7f4b715cf700 1 -- 172.21.15.41:0/2655356478 wait complete. 2021-10-21T00:09:54.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 Processor -- start 2021-10-21T00:09:54.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 -- start start 2021-10-21T00:09:54.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c065560 con 0x7f4b6c0b2170 2021-10-21T00:09:54.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c063bb0 con 0x7f4b6c0abb50 2021-10-21T00:09:54.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0ae0e0 con 0x7f4b6c0af620 2021-10-21T00:09:54.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34526/0 (socket says 172.21.15.41:34526) 2021-10-21T00:09:54.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 -- 172.21.15.41:0/1123958909 learned_addr learned my addr 172.21.15.41:0/1123958909 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:54.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b6b7fe700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b6bfff700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 -- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 msgr2=0x7f4b6c0636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 -- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 msgr2=0x7f4b6c066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c066e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 -- 172.21.15.41:0/1123958909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b64009530 con 0x7f4b6c0b2170 2021-10-21T00:09:54.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b6bfff700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:54.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b70dce700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f4b640032f0 tx=0x7f4b64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b64020070 con 0x7f4b6c0b2170 2021-10-21T00:09:54.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64011e80 con 0x7f4b6c0b2170 2021-10-21T00:09:54.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c148680 con 0x7f4b6c0b2170 2021-10-21T00:09:54.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.736+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400b680 con 0x7f4b6c0b2170 2021-10-21T00:09:54.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c08f560 con 0x7f4b6c0b2170 2021-10-21T00:09:54.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c0643e0 con 0x7f4b6c0b2170 2021-10-21T00:09:54.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b6400f070 con 0x7f4b6c0b2170 2021-10-21T00:09:54.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b697fa700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 0x7f4b4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:54.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b6406d0a0 con 0x7f4b6c0b2170 2021-10-21T00:09:54.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b6bfff700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 0x7f4b4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:54.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.740+0000 7f4b6bfff700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 0x7f4b4c055a40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f4b6000b000 tx=0x7f4b60008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:54.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.748+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b64044070 con 0x7f4b6c0b2170 2021-10-21T00:09:54.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b6c0b12d0 con 0x7f4b6c0b2170 2021-10-21T00:09:54.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b697fa700 1 -- 172.21.15.41:0/1123958909 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f4b64047690 con 0x7f4b6c0b2170 2021-10-21T00:09:54.916 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:54.916 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:09:54.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 msgr2=0x7f4b4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 0x7f4b4c055a40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f4b6000b000 tx=0x7f4b60008040).stop 2021-10-21T00:09:54.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 msgr2=0x7f4b6c1597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:54.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f4b640032f0 tx=0x7f4b64017000).stop 2021-10-21T00:09:54.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 shutdown_connections 2021-10-21T00:09:54.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b4c053580 0x7f4b4c055a40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b6c0b2170 0x7f4b6c1597b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b6c0af620 0x7f4b6c0636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 --2- 172.21.15.41:0/1123958909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b6c0abb50 0x7f4b6c066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:54.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 >> 172.21.15.41:0/1123958909 conn(0x7f4b6c0b5700 msgr2=0x7f4b6c05c560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:54.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 shutdown_connections 2021-10-21T00:09:54.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:54.908+0000 7f4b715cf700 1 -- 172.21.15.41:0/1123958909 wait complete. 2021-10-21T00:09:54.921 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:09:54.929 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:55.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 Processor -- start 2021-10-21T00:09:55.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 -- start start 2021-10-21T00:09:55.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7effa0062330 0x7effa00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa005bd40 con 0x7effa0062f70 2021-10-21T00:09:55.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa005bf70 con 0x7effa00b3a20 2021-10-21T00:09:55.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa651a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa0142cb0 con 0x7effa0062330 2021-10-21T00:09:55.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa4d17700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7effa0062f70 0x7effa005c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60534/0 (socket says 172.21.15.41:60534) 2021-10-21T00:09:55.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa4d17700 1 -- 172.21.15.41:0/125059470 learned_addr learned my addr 172.21.15.41:0/125059470 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:55.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.024+0000 7effa5518700 1 --2- 172.21.15.41:0/125059470 >> v2:172.21.15.62:3300/0 conn(0x7effa0062330 0x7effa00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7eff8ffff700 1 -- 172.21.15.41:0/125059470 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143173035 0 0) 0x7effa005bd40 con 0x7effa0062f70 2021-10-21T00:09:55.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7eff8ffff700 1 -- 172.21.15.41:0/125059470 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff88003260 con 0x7effa0062f70 2021-10-21T00:09:55.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa5518700 1 -- 172.21.15.41:0/125059470 >> v1:172.21.15.62:6789/0 conn(0x7effa00b3a20 legacy=0x7effa013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa5518700 1 -- 172.21.15.41:0/125059470 >> v1:172.21.15.41:6789/0 conn(0x7effa0062f70 legacy=0x7effa005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa5518700 1 -- 172.21.15.41:0/125059470 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0142950 con 0x7effa0062330 2021-10-21T00:09:55.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa5518700 1 --2- 172.21.15.41:0/125059470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00b3f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7eff9c002f70 tx=0x7eff9c006df0).ready entity=mon.1 client_cookie=4eefb58e7b33be42 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7eff8ffff700 1 -- 172.21.15.41:0/125059470 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff9c00d610 con 0x7effa0062330 2021-10-21T00:09:55.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7eff8ffff700 1 -- 172.21.15.41:0/125059470 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c000e90 con 0x7effa0062330 2021-10-21T00:09:55.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7eff8ffff700 1 -- 172.21.15.41:0/125059470 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff9c00d960 con 0x7effa0062330 2021-10-21T00:09:55.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 -- 172.21.15.41:0/125059470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 msgr2=0x7effa00b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 --2- 172.21.15.41:0/125059470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00b3f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7eff9c002f70 tx=0x7eff9c006df0).stop 2021-10-21T00:09:55.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 -- 172.21.15.41:0/125059470 shutdown_connections 2021-10-21T00:09:55.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 --2- 172.21.15.41:0/125059470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00b3f30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 -- 172.21.15.41:0/125059470 >> 172.21.15.41:0/125059470 conn(0x7effa00b9080 msgr2=0x7effa00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 -- 172.21.15.41:0/125059470 shutdown_connections 2021-10-21T00:09:55.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.028+0000 7effa651a700 1 -- 172.21.15.41:0/125059470 wait complete. 2021-10-21T00:09:55.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 Processor -- start 2021-10-21T00:09:55.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 -- start start 2021-10-21T00:09:55.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effa0062f70 0x7effa0155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0156240 con 0x7effa00b3a20 2021-10-21T00:09:55.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0155300 con 0x7effa0062330 2021-10-21T00:09:55.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa0146b90 con 0x7effa0062f70 2021-10-21T00:09:55.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34540/0 (socket says 172.21.15.41:34540) 2021-10-21T00:09:55.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 -- 172.21.15.41:0/2791773638 learned_addr learned my addr 172.21.15.41:0/2791773638 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:55.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5518700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa4d17700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effa0062f70 0x7effa0155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 -- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effa0062f70 msgr2=0x7effa0155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effa0062f70 0x7effa0155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 -- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 msgr2=0x7effa00ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 -- 172.21.15.41:0/2791773638 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c00b180 con 0x7effa00b3a20 2021-10-21T00:09:55.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa5d19700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7effa00b6d90 tx=0x7eff980013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff98006aa0 con 0x7effa00b3a20 2021-10-21T00:09:55.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98006c00 con 0x7effa00b3a20 2021-10-21T00:09:55.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa0146df0 con 0x7effa00b3a20 2021-10-21T00:09:55.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.032+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff98007030 con 0x7effa00b3a20 2021-10-21T00:09:55.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa01451b0 con 0x7effa00b3a20 2021-10-21T00:09:55.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0057350 con 0x7effa00b3a20 2021-10-21T00:09:55.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff98010030 con 0x7effa00b3a20 2021-10-21T00:09:55.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7eff8e7fc700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 0x7eff80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7eff9806b7e0 con 0x7effa00b3a20 2021-10-21T00:09:55.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7effa5518700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 0x7eff80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.036+0000 7effa5518700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 0x7eff80055b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7eff9c01a000 tx=0x7eff9c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.040+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff98042830 con 0x7effa00b3a20 2021-10-21T00:09:55.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.168+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effa005d080 con 0x7effa00b3a20 2021-10-21T00:09:55.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7eff8e7fc700 1 -- 172.21.15.41:0/2791773638 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16041 (secure 0 0 0) 0x7eff98045e50 con 0x7effa00b3a20 2021-10-21T00:09:55.179 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:55.179 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":79,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:54.585571+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:09:51.626316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-21T00:09:52.630268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:55.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 msgr2=0x7eff80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 0x7eff80055b60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7eff9c01a000 tx=0x7eff9c014000).stop 2021-10-21T00:09:55.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 msgr2=0x7effa0155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7effa00b6d90 tx=0x7eff980013a0).stop 2021-10-21T00:09:55.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 shutdown_connections 2021-10-21T00:09:55.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff800536a0 0x7eff80055b60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effa00b3a20 0x7effa0155d50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effa0062f70 0x7effa0155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 --2- 172.21.15.41:0/2791773638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effa0062330 0x7effa00ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 >> 172.21.15.41:0/2791773638 conn(0x7effa00b9080 msgr2=0x7effa013eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 shutdown_connections 2021-10-21T00:09:55.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.172+0000 7effa651a700 1 -- 172.21.15.41:0/2791773638 wait complete. 2021-10-21T00:09:55.193 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:09:55.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 Processor -- start 2021-10-21T00:09:55.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 -- start start 2021-10-21T00:09:55.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf580624d0 0x7fcf5805bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf5805c8a0 0x7fcf58146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580afef0 con 0x7fcf580b3a20 2021-10-21T00:09:55.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf58148090 con 0x7fcf580624d0 2021-10-21T00:09:55.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ded3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580628b0 con 0x7fcf5805c8a0 2021-10-21T00:09:55.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf57fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcf580b3a20 0x7fcf5805c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60548/0 (socket says 172.21.15.41:60548) 2021-10-21T00:09:55.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf57fff700 1 -- 172.21.15.41:0/3341072058 learned_addr learned my addr 172.21.15.41:0/3341072058 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:55.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/3341072058 >> v2:172.21.15.62:3300/0 conn(0x7fcf580624d0 0x7fcf5805bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5d6d2700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf5805c8a0 0x7fcf58146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf577fe700 1 -- 172.21.15.41:0/3341072058 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433907589 0 0) 0x7fcf580afef0 con 0x7fcf580b3a20 2021-10-21T00:09:55.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf577fe700 1 -- 172.21.15.41:0/3341072058 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44003260 con 0x7fcf580b3a20 2021-10-21T00:09:55.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 -- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf5805c8a0 msgr2=0x7fcf58146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:55.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf5805c8a0 0x7fcf58146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 -- 172.21.15.41:0/3341072058 >> v1:172.21.15.41:6789/0 conn(0x7fcf580b3a20 legacy=0x7fcf5805c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 -- 172.21.15.41:0/3341072058 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5814b300 con 0x7fcf580624d0 2021-10-21T00:09:55.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.304+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf580624d0 0x7fcf5805bca0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fcf4c002f70 tx=0x7fcf4c006df0).ready entity=mon.1 client_cookie=7799b1d5b86facc9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf577fe700 1 -- 172.21.15.41:0/3341072058 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c00d4a0 con 0x7fcf580624d0 2021-10-21T00:09:55.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf577fe700 1 -- 172.21.15.41:0/3341072058 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c000e90 con 0x7fcf580624d0 2021-10-21T00:09:55.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf577fe700 1 -- 172.21.15.41:0/3341072058 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c00d7f0 con 0x7fcf580624d0 2021-10-21T00:09:55.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf580624d0 msgr2=0x7fcf5805bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf580624d0 0x7fcf5805bca0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fcf4c002f70 tx=0x7fcf4c006df0).stop 2021-10-21T00:09:55.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- 172.21.15.41:0/3341072058 shutdown_connections 2021-10-21T00:09:55.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf5805c8a0 0x7fcf58146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/3341072058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf580624d0 0x7fcf5805bca0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- 172.21.15.41:0/3341072058 >> 172.21.15.41:0/3341072058 conn(0x7fcf580b9080 msgr2=0x7fcf580b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- 172.21.15.41:0/3341072058 shutdown_connections 2021-10-21T00:09:55.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- 172.21.15.41:0/3341072058 wait complete. 2021-10-21T00:09:55.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 Processor -- start 2021-10-21T00:09:55.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.308+0000 7fcf5ded3700 1 -- start start 2021-10-21T00:09:55.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5805c8a0 0x7fcf580aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580b3a20 0x7fcf580645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ad040 con 0x7fcf580624d0 2021-10-21T00:09:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580acde0 con 0x7fcf5805c8a0 2021-10-21T00:09:55.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ae200 con 0x7fcf580b3a20 2021-10-21T00:09:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34552/0 (socket says 172.21.15.41:34552) 2021-10-21T00:09:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 -- 172.21.15.41:0/1133512553 learned_addr learned my addr 172.21.15.41:0/1133512553 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:55.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5805c8a0 0x7fcf580aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5d6d2700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580b3a20 0x7fcf580645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 -- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580b3a20 msgr2=0x7fcf580645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580b3a20 0x7fcf580645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 -- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5805c8a0 msgr2=0x7fcf580aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5805c8a0 0x7fcf580aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 -- 172.21.15.41:0/1133512553 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c00b180 con 0x7fcf580624d0 2021-10-21T00:09:55.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf57fff700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fcf48001110 tx=0x7fcf48007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf480070d0 con 0x7fcf580624d0 2021-10-21T00:09:55.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48007230 con 0x7fcf580624d0 2021-10-21T00:09:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58145320 con 0x7fcf580624d0 2021-10-21T00:09:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf48005610 con 0x7fcf580624d0 2021-10-21T00:09:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.312+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf580ad570 con 0x7fcf580624d0 2021-10-21T00:09:55.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.316+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf580afc50 con 0x7fcf580624d0 2021-10-21T00:09:55.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.320+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf48010070 con 0x7fcf580624d0 2021-10-21T00:09:55.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.320+0000 7fcf55ffb700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 0x7fcf38055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.320+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf4806af90 con 0x7fcf580624d0 2021-10-21T00:09:55.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.320+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 0x7fcf38055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.320+0000 7fcf5ced1700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 0x7fcf38055b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fcf4c01a000 tx=0x7fcf4c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.328+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf48041fe0 con 0x7fcf580624d0 2021-10-21T00:09:55.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.496+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcf58057350 con 0x7fcf580624d0 2021-10-21T00:09:55.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf55ffb700 1 -- 172.21.15.41:0/1133512553 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcf48045600 con 0x7fcf580624d0 2021-10-21T00:09:55.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 msgr2=0x7fcf38055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 0x7fcf38055b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fcf4c01a000 tx=0x7fcf4c014000).stop 2021-10-21T00:09:55.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 msgr2=0x7fcf58144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fcf48001110 tx=0x7fcf48007ad0).stop 2021-10-21T00:09:55.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 shutdown_connections 2021-10-21T00:09:55.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcf380536d0 0x7fcf38055b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580b3a20 0x7fcf580645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf580624d0 0x7fcf58144e30 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 --2- 172.21.15.41:0/1133512553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5805c8a0 0x7fcf580aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 >> 172.21.15.41:0/1133512553 conn(0x7fcf580b9080 msgr2=0x7fcf580b8950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 shutdown_connections 2021-10-21T00:09:55.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.504+0000 7fcf5ded3700 1 -- 172.21.15.41:0/1133512553 wait complete. 2021-10-21T00:09:55.517 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:09:55.529 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:09:55.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 Processor -- start 2021-10-21T00:09:55.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 -- start start 2021-10-21T00:09:55.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 0x7f0070143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00700b3bc0 0x7f0070143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0070142bc0 con 0x7f0070143a00 2021-10-21T00:09:55.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00701429a0 con 0x7f00700b3bc0 2021-10-21T00:09:55.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f0074ecc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00700ba050 con 0x7f00700b9c70 2021-10-21T00:09:55.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006dd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00700b3bc0 0x7f0070143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 0x7f0070143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0070143a00 0x7f007005bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40388/0 (socket says 172.21.15.41:40388) 2021-10-21T00:09:55.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006ed9d700 1 -- 172.21.15.41:0/1063120391 learned_addr learned my addr 172.21.15.41:0/1063120391 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:55.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006d59a700 1 -- 172.21.15.41:0/1063120391 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639007499 0 0) 0x7f0070142bc0 con 0x7f0070143a00 2021-10-21T00:09:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006d59a700 1 -- 172.21.15.41:0/1063120391 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0050003260 con 0x7f0070143a00 2021-10-21T00:09:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 -- 172.21.15.41:0/1063120391 >> v2:172.21.15.62:3300/0 conn(0x7f00700b3bc0 msgr2=0x7f0070143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 --2- 172.21.15.41:0/1063120391 >> v2:172.21.15.62:3300/0 conn(0x7f00700b3bc0 0x7f0070143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 -- 172.21.15.41:0/1063120391 >> v1:172.21.15.62:6789/0 conn(0x7f0070143a00 legacy=0x7f007005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 -- 172.21.15.41:0/1063120391 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00701463c0 con 0x7f00700b9c70 2021-10-21T00:09:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.636+0000 7f006e59c700 1 --2- 172.21.15.41:0/1063120391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 0x7f0070143020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f00700b1ab0 tx=0x7f0060006df0).ready entity=mon.2 client_cookie=bcb726f845e707b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f006d59a700 1 -- 172.21.15.41:0/1063120391 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006000d570 con 0x7f00700b9c70 2021-10-21T00:09:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f006d59a700 1 -- 172.21.15.41:0/1063120391 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060000e90 con 0x7f00700b9c70 2021-10-21T00:09:55.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f006d59a700 1 -- 172.21.15.41:0/1063120391 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006000d8c0 con 0x7f00700b9c70 2021-10-21T00:09:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- 172.21.15.41:0/1063120391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 msgr2=0x7f0070143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 --2- 172.21.15.41:0/1063120391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 0x7f0070143020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f00700b1ab0 tx=0x7f0060006df0).stop 2021-10-21T00:09:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- 172.21.15.41:0/1063120391 shutdown_connections 2021-10-21T00:09:55.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 --2- 172.21.15.41:0/1063120391 >> v2:172.21.15.62:3300/0 conn(0x7f00700b3bc0 0x7f0070143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 --2- 172.21.15.41:0/1063120391 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b9c70 0x7f0070143020 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- 172.21.15.41:0/1063120391 >> 172.21.15.41:0/1063120391 conn(0x7f0070062e80 msgr2=0x7f00700b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- 172.21.15.41:0/1063120391 shutdown_connections 2021-10-21T00:09:55.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- 172.21.15.41:0/1063120391 wait complete. 2021-10-21T00:09:55.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 Processor -- start 2021-10-21T00:09:55.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.640+0000 7f0074ecc700 1 -- start start 2021-10-21T00:09:55.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 0x7f0070114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 0x7f0070155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00700af640 con 0x7f0070143a00 2021-10-21T00:09:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070113c30 con 0x7f00700b9c70 2021-10-21T00:09:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070114a80 con 0x7f00700b3bc0 2021-10-21T00:09:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 0x7f0070155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006e59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 0x7f0070114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:46484/0 (socket says 172.21.15.41:46484) 2021-10-21T00:09:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006dd9b700 1 -- 172.21.15.41:0/3335067341 learned_addr learned my addr 172.21.15.41:0/3335067341 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006e59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 0x7f0070114590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:53062/0 (socket says 172.21.15.41:53062) 2021-10-21T00:09:55.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 -- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 msgr2=0x7f0070114590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 0x7f0070114590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 -- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 msgr2=0x7f00700ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 -- 172.21.15.41:0/3335067341 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006000b180 con 0x7f0070143a00 2021-10-21T00:09:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006dd9b700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f006ed9d700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 0x7f0070155420 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f0070113d70 tx=0x7f0068007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006800ce30 con 0x7f0070143a00 2021-10-21T00:09:55.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068005ba0 con 0x7f0070143a00 2021-10-21T00:09:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070113e50 con 0x7f0070143a00 2021-10-21T00:09:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00680070d0 con 0x7f0070143a00 2021-10-21T00:09:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.644+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00700acee0 con 0x7f0070143a00 2021-10-21T00:09:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070146120 con 0x7f0070143a00 2021-10-21T00:09:55.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0068010070 con 0x7f0070143a00 2021-10-21T00:09:55.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f00677fe700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 0x7f0054055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f006806b070 con 0x7f0070143a00 2021-10-21T00:09:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f006e59c700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 0x7f0054055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.648+0000 7f006e59c700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 0x7f0054055a70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f006001a000 tx=0x7f0060014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.656+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00680421d0 con 0x7f0070143a00 2021-10-21T00:09:55.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.828+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f00701405b0 con 0x7f0070143a00 2021-10-21T00:09:55.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f00677fe700 1 -- 172.21.15.41:0/3335067341 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f00680457f0 con 0x7f0070143a00 2021-10-21T00:09:55.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 msgr2=0x7f0054055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 0x7f0054055a70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f006001a000 tx=0x7f0060014000).stop 2021-10-21T00:09:55.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 msgr2=0x7f0070155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 0x7f0070155420 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f0070113d70 tx=0x7f0068007d40).stop 2021-10-21T00:09:55.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 shutdown_connections 2021-10-21T00:09:55.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f00540535b0 0x7f0054055a70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0070143a00 0x7f0070155420 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00700b9c70 0x7f00700ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 --2- 172.21.15.41:0/3335067341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00700b3bc0 0x7f0070114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 >> 172.21.15.41:0/3335067341 conn(0x7f0070062e80 msgr2=0x7f00700b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:55.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 shutdown_connections 2021-10-21T00:09:55.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.836+0000 7f0074ecc700 1 -- 172.21.15.41:0/3335067341 wait complete. 2021-10-21T00:09:55.850 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:09:55.858 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:09:55.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 Processor -- start 2021-10-21T00:09:55.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 -- start start 2021-10-21T00:09:55.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fed740b9c70 0x7fed74143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 0x7fed74143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 0x7fed7405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:55.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed741429a0 con 0x7fed740b9c70 2021-10-21T00:09:55.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed74142bc0 con 0x7fed740b3bc0 2021-10-21T00:09:55.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed7a27a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740ba050 con 0x7fed74143a00 2021-10-21T00:09:55.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fed740b9c70 0x7fed74143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fed740b9c70 0x7fed74143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34572/0 (socket says 172.21.15.41:34572) 2021-10-21T00:09:55.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 -- 172.21.15.41:0/1786405723 learned_addr learned my addr 172.21.15.41:0/1786405723 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:55.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed78817700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 0x7fed7405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed6b7fe700 1 --2- 172.21.15.41:0/1786405723 >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 0x7fed74143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:55.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 -- 172.21.15.41:0/1786405723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 msgr2=0x7fed7405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:55.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 0x7fed7405bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 -- 172.21.15.41:0/1786405723 >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 msgr2=0x7fed74143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:55.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 --2- 172.21.15.41:0/1786405723 >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 0x7fed74143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:55.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 -- 172.21.15.41:0/1786405723 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed741463c0 con 0x7fed740b9c70 2021-10-21T00:09:55.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed78817700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 0x7fed7405bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:55.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed6b7fe700 1 --2- 172.21.15.41:0/1786405723 >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 0x7fed74143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:55.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed73fff700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed740b9c70 0x7fed74143020 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fed64002f70 tx=0x7fed64006eb0).ready entity=mon.0 client_cookie=bbd7aff4ab6609b1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:55.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed737fe700 1 -- 172.21.15.41:0/1786405723 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6400d570 con 0x7fed740b9c70 2021-10-21T00:09:55.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed737fe700 1 -- 172.21.15.41:0/1786405723 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64000e90 con 0x7fed740b9c70 2021-10-21T00:09:55.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.972+0000 7fed737fe700 1 -- 172.21.15.41:0/1786405723 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6400d900 con 0x7fed740b9c70 2021-10-21T00:09:55.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- 172.21.15.41:0/1786405723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed740b9c70 msgr2=0x7fed74143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:55.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed740b9c70 0x7fed74143020 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fed64002f70 tx=0x7fed64006eb0).stop 2021-10-21T00:09:55.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- 172.21.15.41:0/1786405723 shutdown_connections 2021-10-21T00:09:56.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed74143a00 0x7fed7405bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- 172.21.15.41:0/1786405723 >> v2:172.21.15.62:3300/0 conn(0x7fed740b3bc0 0x7fed74143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- 172.21.15.41:0/1786405723 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed740b9c70 0x7fed74143020 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- 172.21.15.41:0/1786405723 >> 172.21.15.41:0/1786405723 conn(0x7fed74062e80 msgr2=0x7fed740b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:56.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- 172.21.15.41:0/1786405723 shutdown_connections 2021-10-21T00:09:56.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- 172.21.15.41:0/1786405723 wait complete. 2021-10-21T00:09:56.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 Processor -- start 2021-10-21T00:09:56.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- start start 2021-10-21T00:09:56.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed740b3bc0 0x7fed740ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed740b9c70 0x7fed7413e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740af520 con 0x7fed74143a00 2021-10-21T00:09:56.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740afa10 con 0x7fed740b9c70 2021-10-21T00:09:56.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed7a27a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed741129b0 con 0x7fed740b3bc0 2021-10-21T00:09:56.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.976+0000 7fed78817700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed6b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed740b9c70 0x7fed7413e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34582/0 (socket says 172.21.15.41:34582) 2021-10-21T00:09:56.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 -- 172.21.15.41:0/3020808406 learned_addr learned my addr 172.21.15.41:0/3020808406 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:56.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed73fff700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed740b3bc0 0x7fed740ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 -- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed740b3bc0 msgr2=0x7fed740ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed740b3bc0 0x7fed740ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 -- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed740b9c70 msgr2=0x7fed7413e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed740b9c70 0x7fed7413e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 -- 172.21.15.41:0/3020808406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c00b180 con 0x7fed74143a00 2021-10-21T00:09:56.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed78817700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fed74113d60 tx=0x7fed6c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c00ee90 con 0x7fed74143a00 2021-10-21T00:09:56.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c00c850 con 0x7fed74143a00 2021-10-21T00:09:56.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c009470 con 0x7fed74143a00 2021-10-21T00:09:56.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6c00cbb0 con 0x7fed74143a00 2021-10-21T00:09:56.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6400b1e0 con 0x7fed74143a00 2021-10-21T00:09:56.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74112b70 con 0x7fed74143a00 2021-10-21T00:09:56.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.980+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed6c022070 con 0x7fed74143a00 2021-10-21T00:09:56.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.984+0000 7fed71ffb700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 0x7fed580559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.984+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fed6c06c0e0 con 0x7fed74143a00 2021-10-21T00:09:56.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.984+0000 7fed73fff700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 0x7fed580559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.984+0000 7fed73fff700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 0x7fed580559b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fed6401c000 tx=0x7fed64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:55.988+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed74112b70 con 0x7fed74143a00 2021-10-21T00:09:56.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.156+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fed74112b70 con 0x7fed74143a00 2021-10-21T00:09:56.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.164+0000 7fed71ffb700 1 -- 172.21.15.41:0/3020808406 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7fed74112b70 con 0x7fed74143a00 2021-10-21T00:09:56.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 msgr2=0x7fed580559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 0x7fed580559b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fed6401c000 tx=0x7fed64015000).stop 2021-10-21T00:09:56.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 msgr2=0x7fed740b7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fed74113d60 tx=0x7fed6c0091d0).stop 2021-10-21T00:09:56.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 shutdown_connections 2021-10-21T00:09:56.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fed580534f0 0x7fed580559b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fed74143a00 0x7fed740b7fe0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed740b9c70 0x7fed7413e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 --2- 172.21.15.41:0/3020808406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fed740b3bc0 0x7fed740ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 >> 172.21.15.41:0/3020808406 conn(0x7fed74062e80 msgr2=0x7fed7413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:56.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 shutdown_connections 2021-10-21T00:09:56.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.168+0000 7fed7a27a700 1 -- 172.21.15.41:0/3020808406 wait complete. 2021-10-21T00:09:56.180 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:09:56.194 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:56.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 Processor -- start 2021-10-21T00:09:56.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 -- start start 2021-10-21T00:09:56.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e5414da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e54142bc0 con 0x7f0e540b3bc0 2021-10-21T00:09:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e540ba050 con 0x7f0e540b9c70 2021-10-21T00:09:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e5b5ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541429a0 con 0x7f0e5414b620 2021-10-21T00:09:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e58b85700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0e540b3bc0 0x7f0e54143730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60590/0 (socket says 172.21.15.41:60590) 2021-10-21T00:09:56.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e58b85700 1 -- 172.21.15.41:0/1757107532 learned_addr learned my addr 172.21.15.41:0/1757107532 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e59b87700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e5414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.292+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262042391 0 0) 0x7f0e54142bc0 con 0x7f0e540b3bc0 2021-10-21T00:09:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e38003260 con 0x7f0e540b3bc0 2021-10-21T00:09:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370593821 0 0) 0x7f0e38003260 con 0x7f0e540b3bc0 2021-10-21T00:09:56.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 msgr2=0x7f0e5414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e5414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 >> v1:172.21.15.62:6789/0 conn(0x7f0e540b9c70 legacy=0x7f0e54143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e541463c0 con 0x7f0e540b3bc0 2021-10-21T00:09:56.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f0e44001680 con 0x7f0e540b3bc0 2021-10-21T00:09:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e59b87700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e5414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 >> v1:172.21.15.41:6789/0 conn(0x7f0e540b3bc0 legacy=0x7f0e54143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e38003780 0x7f0e38003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e38004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e38004e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541429a0 con 0x7f0e38004500 2021-10-21T00:09:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800b800 con 0x7f0e38003780 2021-10-21T00:09:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800b990 con 0x7f0e5414b620 2021-10-21T00:09:56.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e38004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e59386700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e38003780 0x7f0e38003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e59b87700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e38004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 -- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 msgr2=0x7f0e38004e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e5414b620 0x7f0e38004e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 -- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e38003780 msgr2=0x7f0e38003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e38003780 0x7f0e38003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 -- 172.21.15.41:0/1757107532 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c00b180 con 0x7f0e38004500 2021-10-21T00:09:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e58b85700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e38004980 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f0e380054d0 tx=0x7f0e44001d80).ready entity=mon.0 client_cookie=741c98de327fcb2a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e44007170 con 0x7f0e38004500 2021-10-21T00:09:56.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440072d0 con 0x7f0e38004500 2021-10-21T00:09:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e4bfff700 1 -- 172.21.15.41:0/1757107532 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e4400c8b0 con 0x7f0e38004500 2021-10-21T00:09:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/1757107532 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 msgr2=0x7f0e38004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/1757107532 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e38004980 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f0e380054d0 tx=0x7f0e44001d80).stop 2021-10-21T00:09:56.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e59b87700 1 -- 172.21.15.41:0/1757107532 reap_dead start 2021-10-21T00:09:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/1757107532 shutdown_connections 2021-10-21T00:09:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/1757107532 >> 172.21.15.41:0/1757107532 conn(0x7f0e54062e80 msgr2=0x7f0e540b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/1757107532 shutdown_connections 2021-10-21T00:09:56.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.296+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/1757107532 wait complete. 2021-10-21T00:09:56.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 Processor -- start 2021-10-21T00:09:56.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- start start 2021-10-21T00:09:56.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e5413f640 0x7f0e5405c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e54137c60 0x7f0e541380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541385d0 con 0x7f0e38004500 2021-10-21T00:09:56.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54140e60 con 0x7f0e5413f640 2021-10-21T00:09:56.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54141100 con 0x7f0e54137c60 2021-10-21T00:09:56.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34598/0 (socket says 172.21.15.41:34598) 2021-10-21T00:09:56.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 -- 172.21.15.41:0/851334818 learned_addr learned my addr 172.21.15.41:0/851334818 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:56.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e58b85700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e5413f640 0x7f0e5405c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59b87700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e54137c60 0x7f0e541380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 -- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e54137c60 msgr2=0x7f0e541380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e54137c60 0x7f0e541380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 -- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e5413f640 msgr2=0x7f0e5405c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e5413f640 0x7f0e5405c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 -- 172.21.15.41:0/851334818 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540b8e90 con 0x7f0e38004500 2021-10-21T00:09:56.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e59386700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f0e5000d000 tx=0x7f0e50007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e50002540 con 0x7f0e38004500 2021-10-21T00:09:56.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50001640 con 0x7f0e38004500 2021-10-21T00:09:56.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e54140ae0 con 0x7f0e38004500 2021-10-21T00:09:56.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e500019a0 con 0x7f0e38004500 2021-10-21T00:09:56.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.300+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e54141770 con 0x7f0e38004500 2021-10-21T00:09:56.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e54146120 con 0x7f0e38004500 2021-10-21T00:09:56.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e50001b00 con 0x7f0e38004500 2021-10-21T00:09:56.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e4a7fc700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 0x7f0e3c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e5006be60 con 0x7f0e38004500 2021-10-21T00:09:56.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e58b85700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 0x7f0e3c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.304+0000 7f0e58b85700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 0x7f0e3c055b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f0e4401b000 tx=0x7f0e44015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.308+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e50042fc0 con 0x7f0e38004500 2021-10-21T00:09:56.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.472+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e54057350 con 0x7f0e38004500 2021-10-21T00:09:56.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e4a7fc700 1 -- 172.21.15.41:0/851334818 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f0e500465e0 con 0x7f0e38004500 2021-10-21T00:09:56.483 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:56.483 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:09:56.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 msgr2=0x7f0e3c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 0x7f0e3c055b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f0e4401b000 tx=0x7f0e44015000).stop 2021-10-21T00:09:56.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 msgr2=0x7f0e540b9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f0e5000d000 tx=0x7f0e50007d80).stop 2021-10-21T00:09:56.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 shutdown_connections 2021-10-21T00:09:56.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0e3c053640 0x7f0e3c055b00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e54137c60 0x7f0e541380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e5413f640 0x7f0e5405c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 --2- 172.21.15.41:0/851334818 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0e38004500 0x7f0e540b9330 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 >> 172.21.15.41:0/851334818 conn(0x7f0e54062e80 msgr2=0x7f0e540b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:56.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 shutdown_connections 2021-10-21T00:09:56.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.476+0000 7f0e5b5ea700 1 -- 172.21.15.41:0/851334818 wait complete. 2021-10-21T00:09:56.489 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:09:56.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:09:53.582620+0000', 'modified': '2021-10-21T00:09:54.586575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6663}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6663': {'gid': 6663, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/1888649335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 1888649335}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 1888649335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:09:56.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:09:56.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:09:56.818 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6663,"want_state":"up:active","state":"up:active","rank_uptime":3.220072746,"mdsmap_epoch":39,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":7.5436450170000002} 2021-10-21T00:09:56.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6663, "mdsmap_epoch": 39, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 3.220072746, "state": "up:active", "uptime": 7.543645017, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:09:56.820 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:56.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 Processor -- start 2021-10-21T00:09:56.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 -- start start 2021-10-21T00:09:56.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95940b2170 0x7f95940b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9594141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940b2550 con 0x7f95940ab600 2021-10-21T00:09:56.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95940aba40 con 0x7f95940b2170 2021-10-21T00:09:56.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f959a2d5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b1350 con 0x7f95940604f0 2021-10-21T00:09:56.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f9598ad2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f95940ab600 0x7f959405fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60608/0 (socket says 172.21.15.41:60608) 2021-10-21T00:09:56.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.924+0000 7f9598ad2700 1 -- 172.21.15.41:0/3071999411 learned_addr learned my addr 172.21.15.41:0/3071999411 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:56.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f95992d3700 1 --2- 172.21.15.41:0/3071999411 >> v2:172.21.15.62:3300/0 conn(0x7f95940b2170 0x7f95940b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9599ad4700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9594141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768104063 0 0) 0x7f95940b2550 con 0x7f95940ab600 2021-10-21T00:09:56.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9578003260 con 0x7f95940ab600 2021-10-21T00:09:56.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1942064893 0 0) 0x7f9578003260 con 0x7f95940ab600 2021-10-21T00:09:56.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 msgr2=0x7f9594141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9594141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 >> v2:172.21.15.62:3300/0 conn(0x7f95940b2170 msgr2=0x7f95940b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 --2- 172.21.15.41:0/3071999411 >> v2:172.21.15.62:3300/0 conn(0x7f95940b2170 0x7f95940b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959405f940 con 0x7f95940ab600 2021-10-21T00:09:56.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f9584001660 con 0x7f95940ab600 2021-10-21T00:09:56.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 >> v1:172.21.15.41:6789/0 conn(0x7f95940ab600 legacy=0x7f959405fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9578003750 0x7f9578003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9578004500 0x7f9578004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9578004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940aba40 con 0x7f9578004500 2021-10-21T00:09:56.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940b1350 con 0x7f9578003750 2021-10-21T00:09:56.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957800b750 con 0x7f95940604f0 2021-10-21T00:09:56.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9578004500 0x7f9578004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f95992d3700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9578003750 0x7f9578003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9599ad4700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9578004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 -- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 msgr2=0x7f9578004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95940604f0 0x7f9578004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 -- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9578003750 msgr2=0x7f9578003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:56.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9578003750 0x7f9578003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 -- 172.21.15.41:0/3071999411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578003260 con 0x7f9578004500 2021-10-21T00:09:56.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9598ad2700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9578004500 0x7f9578004980 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9584001370 tx=0x7f9584001e50).ready entity=mon.0 client_cookie=7b95eea2f2762b21 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95840070d0 con 0x7f9578004500 2021-10-21T00:09:56.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584007230 con 0x7f9578004500 2021-10-21T00:09:56.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f958bfff700 1 -- 172.21.15.41:0/3071999411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f958400c9c0 con 0x7f9578004500 2021-10-21T00:09:56.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 -- 172.21.15.41:0/3071999411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9578004500 msgr2=0x7f9578004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 --2- 172.21.15.41:0/3071999411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9578004500 0x7f9578004980 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f9584001370 tx=0x7f9584001e50).stop 2021-10-21T00:09:56.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f9599ad4700 1 -- 172.21.15.41:0/3071999411 reap_dead start 2021-10-21T00:09:56.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 -- 172.21.15.41:0/3071999411 shutdown_connections 2021-10-21T00:09:56.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 -- 172.21.15.41:0/3071999411 >> 172.21.15.41:0/3071999411 conn(0x7f95940b5700 msgr2=0x7f95940b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:56.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 -- 172.21.15.41:0/3071999411 shutdown_connections 2021-10-21T00:09:56.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.928+0000 7f959a2d5700 1 -- 172.21.15.41:0/3071999411 wait complete. 2021-10-21T00:09:56.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 Processor -- start 2021-10-21T00:09:56.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 -- start start 2021-10-21T00:09:56.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9578004500 0x7f95940aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 0x7f9594151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 0x7f95941523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940ae880 con 0x7f95940ac0c0 2021-10-21T00:09:56.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959413e180 con 0x7f959413f780 2021-10-21T00:09:56.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f959a2d5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9594152010 con 0x7f9578004500 2021-10-21T00:09:56.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9599ad4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 0x7f95941523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 0x7f9594151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9599ad4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 0x7f95941523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34622/0 (socket says 172.21.15.41:34622) 2021-10-21T00:09:56.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f95992d3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9578004500 0x7f95940aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9599ad4700 1 -- 172.21.15.41:0/328850177 learned_addr learned my addr 172.21.15.41:0/328850177 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:56.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 -- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9578004500 msgr2=0x7f95940aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9578004500 0x7f95940aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 -- 172.21.15.41:0/328850177 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 msgr2=0x7f95941523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:56.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 0x7f95941523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:56.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 -- 172.21.15.41:0/328850177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940ae5e0 con 0x7f959413f780 2021-10-21T00:09:56.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.932+0000 7f9598ad2700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 0x7f9594151b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9594147ea0 tx=0x7f9584015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9584004710 con 0x7f959413f780 2021-10-21T00:09:56.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9594155200 con 0x7f959413f780 2021-10-21T00:09:56.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584004870 con 0x7f959413f780 2021-10-21T00:09:56.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9584004bd0 con 0x7f959413f780 2021-10-21T00:09:56.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9594152af0 con 0x7f959413f780 2021-10-21T00:09:56.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9594155390 con 0x7f959413f780 2021-10-21T00:09:56.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9584027070 con 0x7f959413f780 2021-10-21T00:09:56.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 0x7f957c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:56.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f958406c610 con 0x7f959413f780 2021-10-21T00:09:56.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.936+0000 7f95992d3700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 0x7f957c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:56.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.940+0000 7f95992d3700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 0x7f957c055a40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f959000b000 tx=0x7f9590006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:56.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:56.944+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9584043770 con 0x7f959413f780 2021-10-21T00:09:57.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.072+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9594057350 con 0x7f959413f780 2021-10-21T00:09:57.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.072+0000 7f958a7fc700 1 -- 172.21.15.41:0/328850177 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9584040ec0 con 0x7f959413f780 2021-10-21T00:09:57.081 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:57.082 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":79,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:54.585571+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:09:51.626316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-21T00:09:52.630268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:57.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 msgr2=0x7f957c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 0x7f957c055a40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f959000b000 tx=0x7f9590006df0).stop 2021-10-21T00:09:57.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 msgr2=0x7f9594151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 0x7f9594151b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9594147ea0 tx=0x7f9584015000).stop 2021-10-21T00:09:57.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 shutdown_connections 2021-10-21T00:09:57.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f957c053580 0x7f957c055a40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95940ac0c0 0x7f95941523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f959413f780 0x7f9594151b20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 --2- 172.21.15.41:0/328850177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9578004500 0x7f95940aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 >> 172.21.15.41:0/328850177 conn(0x7f95940b5700 msgr2=0x7f95940aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 shutdown_connections 2021-10-21T00:09:57.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.076+0000 7f959a2d5700 1 -- 172.21.15.41:0/328850177 wait complete. 2021-10-21T00:09:57.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:09:51.626316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:09:52.630268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:09:57.096 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:09:57.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 Processor -- start 2021-10-21T00:09:57.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 -- start start 2021-10-21T00:09:57.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d2c0b2170 0x7f1d2c099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c09ab50 0x7f1d2c13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0b1560 con 0x7f1d2c0af620 2021-10-21T00:09:57.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0b2550 con 0x7f1d2c0b2170 2021-10-21T00:09:57.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d32d20700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c09a170 con 0x7f1d2c09ab50 2021-10-21T00:09:57.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d2c0b2170 0x7f1d2c099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d3251f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1d2c0af620 0x7f1d2c13fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60630/0 (socket says 172.21.15.41:60630) 2021-10-21T00:09:57.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d3251f700 1 -- 172.21.15.41:0/1603335543 learned_addr learned my addr 172.21.15.41:0/1603335543 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:57.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d3151d700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c09ab50 0x7f1d2c13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d30d1c700 1 -- 172.21.15.41:0/1603335543 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528215560 0 0) 0x7f1d2c0b1560 con 0x7f1d2c0af620 2021-10-21T00:09:57.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d30d1c700 1 -- 172.21.15.41:0/1603335543 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d14003260 con 0x7f1d2c0af620 2021-10-21T00:09:57.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 -- 172.21.15.41:0/1603335543 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c09ab50 msgr2=0x7f1d2c13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:57.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c09ab50 0x7f1d2c13fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 -- 172.21.15.41:0/1603335543 >> v1:172.21.15.41:6789/0 conn(0x7f1d2c0af620 legacy=0x7f1d2c13fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 -- 172.21.15.41:0/1603335543 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c09a410 con 0x7f1d2c0b2170 2021-10-21T00:09:57.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.204+0000 7f1d31d1e700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c099b40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f1d28002f70 tx=0x7f1d28006df0).ready entity=mon.0 client_cookie=34cdb09c84d5dc33 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d30d1c700 1 -- 172.21.15.41:0/1603335543 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2800d4a0 con 0x7f1d2c0b2170 2021-10-21T00:09:57.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d30d1c700 1 -- 172.21.15.41:0/1603335543 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28000e90 con 0x7f1d2c0b2170 2021-10-21T00:09:57.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d30d1c700 1 -- 172.21.15.41:0/1603335543 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2800d7f0 con 0x7f1d2c0b2170 2021-10-21T00:09:57.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 -- 172.21.15.41:0/1603335543 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0b2170 msgr2=0x7f1d2c099b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c099b40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f1d28002f70 tx=0x7f1d28006df0).stop 2021-10-21T00:09:57.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 -- 172.21.15.41:0/1603335543 shutdown_connections 2021-10-21T00:09:57.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c09ab50 0x7f1d2c13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 --2- 172.21.15.41:0/1603335543 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c099b40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 -- 172.21.15.41:0/1603335543 >> 172.21.15.41:0/1603335543 conn(0x7f1d2c0b5700 msgr2=0x7f1d2c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 -- 172.21.15.41:0/1603335543 shutdown_connections 2021-10-21T00:09:57.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 -- 172.21.15.41:0/1603335543 wait complete. 2021-10-21T00:09:57.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.208+0000 7f1d32d20700 1 Processor -- start 2021-10-21T00:09:57.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- start start 2021-10-21T00:09:57.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c1504d0 0x7f1d2c090ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0902e0 con 0x7f1d2c0af620 2021-10-21T00:09:57.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c097560 con 0x7f1d2c0b2170 2021-10-21T00:09:57.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c066190 con 0x7f1d2c1504d0 2021-10-21T00:09:57.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34632/0 (socket says 172.21.15.41:34632) 2021-10-21T00:09:57.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 -- 172.21.15.41:0/571287133 learned_addr learned my addr 172.21.15.41:0/571287133 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:57.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d3151d700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d3251f700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c1504d0 0x7f1d2c090ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 -- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c1504d0 msgr2=0x7f1d2c090ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c1504d0 0x7f1d2c090ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 -- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d2c0b2170 msgr2=0x7f1d2c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 -- 172.21.15.41:0/571287133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2800b180 con 0x7f1d2c0af620 2021-10-21T00:09:57.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d31d1e700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f1d2c0655e0 tx=0x7f1d28014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d280138f0 con 0x7f1d2c0af620 2021-10-21T00:09:57.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28013a50 con 0x7f1d2c0af620 2021-10-21T00:09:57.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d28013db0 con 0x7f1d2c0af620 2021-10-21T00:09:57.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c067760 con 0x7f1d2c0af620 2021-10-21T00:09:57.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.212+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c067510 con 0x7f1d2c0af620 2021-10-21T00:09:57.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c067c00 con 0x7f1d2c0af620 2021-10-21T00:09:57.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d28025030 con 0x7f1d2c0af620 2021-10-21T00:09:57.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d1affd700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 0x7f1d0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d2806c670 con 0x7f1d2c0af620 2021-10-21T00:09:57.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d3151d700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 0x7f1d0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.216+0000 7f1d3151d700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 0x7f1d0c055ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1d1c00b000 tx=0x7f1d1c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.224+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d2c067c00 con 0x7f1d2c0af620 2021-10-21T00:09:57.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.352+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1d2c067c00 con 0x7f1d2c0af620 2021-10-21T00:09:57.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.352+0000 7f1d1affd700 1 -- 172.21.15.41:0/571287133 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1d2c067c00 con 0x7f1d2c0af620 2021-10-21T00:09:57.362 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:09:57.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 msgr2=0x7f1d0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 0x7f1d0c055ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1d1c00b000 tx=0x7f1d1c006df0).stop 2021-10-21T00:09:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 msgr2=0x7f1d2c08f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f1d2c0655e0 tx=0x7f1d28014000).stop 2021-10-21T00:09:57.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 shutdown_connections 2021-10-21T00:09:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d0c053610 0x7f1d0c055ad0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d2c1504d0 0x7f1d2c090ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d2c0b2170 0x7f1d2c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 --2- 172.21.15.41:0/571287133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d2c0af620 0x7f1d2c08f700 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 >> 172.21.15.41:0/571287133 conn(0x7f1d2c0b5700 msgr2=0x7f1d2c0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 shutdown_connections 2021-10-21T00:09:57.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.356+0000 7f1d32d20700 1 -- 172.21.15.41:0/571287133 wait complete. 2021-10-21T00:09:57.375 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:09:57.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 Processor -- start 2021-10-21T00:09:57.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 -- start start 2021-10-21T00:09:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 0x7f21f80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80ba080 con 0x7f21f80b26d0 2021-10-21T00:09:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f805c670 con 0x7f21f80b31e0 2021-10-21T00:09:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.476+0000 7f21fce71700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f805c8e0 con 0x7f21f80b9ca0 2021-10-21T00:09:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f6d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f21f80b26d0 0x7f21f8141bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60646/0 (socket says 172.21.15.41:60646) 2021-10-21T00:09:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f6d9d700 1 -- 172.21.15.41:0/1327955462 learned_addr learned my addr 172.21.15.41:0/1327955462 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f659c700 1 --2- 172.21.15.41:0/1327955462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 0x7f21f80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055831157 0 0) 0x7f21f80ba080 con 0x7f21f80b26d0 2021-10-21T00:09:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21dc003260 con 0x7f21f80b26d0 2021-10-21T00:09:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750476207 0 0) 0x7f21f805c670 con 0x7f21f80b31e0 2021-10-21T00:09:57.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f80ba080 con 0x7f21f80b31e0 2021-10-21T00:09:57.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f659c700 1 -- 172.21.15.41:0/1327955462 >> v1:172.21.15.62:6789/0 conn(0x7f21f80b31e0 legacy=0x7f21f80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f659c700 1 -- 172.21.15.41:0/1327955462 >> v1:172.21.15.41:6789/0 conn(0x7f21f80b26d0 legacy=0x7f21f8141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303183052 0 0) 0x7f21dc003260 con 0x7f21f80b26d0 2021-10-21T00:09:57.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f659c700 1 -- 172.21.15.41:0/1327955462 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f805cb80 con 0x7f21f80b9ca0 2021-10-21T00:09:57.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f659c700 1 --2- 172.21.15.41:0/1327955462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 0x7f21f80b0690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f21f0001490 tx=0x7f21e8006df0).ready entity=mon.2 client_cookie=5bcedb2363efe788 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21f00019e0 con 0x7f21f80b9ca0 2021-10-21T00:09:57.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8000e90 con 0x7f21f80b9ca0 2021-10-21T00:09:57.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21f559a700 1 -- 172.21.15.41:0/1327955462 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21e8012460 con 0x7f21f80b9ca0 2021-10-21T00:09:57.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- 172.21.15.41:0/1327955462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 msgr2=0x7f21f80b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 --2- 172.21.15.41:0/1327955462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 0x7f21f80b0690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f21f0001490 tx=0x7f21e8006df0).stop 2021-10-21T00:09:57.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- 172.21.15.41:0/1327955462 shutdown_connections 2021-10-21T00:09:57.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 --2- 172.21.15.41:0/1327955462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b9ca0 0x7f21f80b0690 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- 172.21.15.41:0/1327955462 >> 172.21.15.41:0/1327955462 conn(0x7f21f8062f00 msgr2=0x7f21f80b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- 172.21.15.41:0/1327955462 shutdown_connections 2021-10-21T00:09:57.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- 172.21.15.41:0/1327955462 wait complete. 2021-10-21T00:09:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 Processor -- start 2021-10-21T00:09:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.480+0000 7f21fce71700 1 -- start start 2021-10-21T00:09:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b26d0 0x7f21f80b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21f80b9ca0 0x7f21f813cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f813f840 con 0x7f21f80b31e0 2021-10-21T00:09:57.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8151c20 con 0x7f21f80b9ca0 2021-10-21T00:09:57.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f813ff70 con 0x7f21f80b26d0 2021-10-21T00:09:57.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f659c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b26d0 0x7f21f80b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34648/0 (socket says 172.21.15.41:34648) 2021-10-21T00:09:57.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 -- 172.21.15.41:0/2510646728 learned_addr learned my addr 172.21.15.41:0/2510646728 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:57.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f6d9d700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21f80b9ca0 0x7f21f813cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 -- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b26d0 msgr2=0x7f21f80b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b26d0 0x7f21f80b81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 -- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21f80b9ca0 msgr2=0x7f21f813cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21f80b9ca0 0x7f21f813cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 -- 172.21.15.41:0/2510646728 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e800b180 con 0x7f21f80b31e0 2021-10-21T00:09:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21f5d9b700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f21ec001110 tx=0x7f21ec007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ec012400 con 0x7f21f80b31e0 2021-10-21T00:09:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec012560 con 0x7f21f80b31e0 2021-10-21T00:09:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f813fa30 con 0x7f21f80b31e0 2021-10-21T00:09:57.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ec0128c0 con 0x7f21f80b31e0 2021-10-21T00:09:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80ad390 con 0x7f21f80b31e0 2021-10-21T00:09:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.484+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8155370 con 0x7f21f80b31e0 2021-10-21T00:09:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.488+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f21ec019030 con 0x7f21f80b31e0 2021-10-21T00:09:57.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.488+0000 7f21e77fe700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 0x7f21d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.488+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21ec06abf0 con 0x7f21f80b31e0 2021-10-21T00:09:57.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.488+0000 7f21f659c700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 0x7f21d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.488+0000 7f21f659c700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 0x7f21d4055b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f21e801a000 tx=0x7f21e8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.492+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21ec041d50 con 0x7f21f80b31e0 2021-10-21T00:09:57.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.616+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21f8057350 con 0x7f21f80b31e0 2021-10-21T00:09:57.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21e77fe700 1 -- 172.21.15.41:0/2510646728 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21ec045370 con 0x7f21f80b31e0 2021-10-21T00:09:57.627 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 msgr2=0x7f21d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 0x7f21d4055b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f21e801a000 tx=0x7f21e8014000).stop 2021-10-21T00:09:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 msgr2=0x7f21f813c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f21ec001110 tx=0x7f21ec007ae0).stop 2021-10-21T00:09:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 shutdown_connections 2021-10-21T00:09:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f21d4053640 0x7f21d4055b00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21f80b9ca0 0x7f21f813cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21f80b31e0 0x7f21f813c6e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 --2- 172.21.15.41:0/2510646728 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21f80b26d0 0x7f21f80b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 >> 172.21.15.41:0/2510646728 conn(0x7f21f8062f00 msgr2=0x7f21f8142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 shutdown_connections 2021-10-21T00:09:57.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.620+0000 7f21fce71700 1 -- 172.21.15.41:0/2510646728 wait complete. 2021-10-21T00:09:57.639 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:09:57.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.744+0000 7fd04885b700 1 Processor -- start 2021-10-21T00:09:57.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.744+0000 7fd04885b700 1 -- start start 2021-10-21T00:09:57.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440b61d0 0x7fd0440af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd0440677e0 0x7fd0440af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 0x7fd044138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440afe90 con 0x7fd0440677e0 2021-10-21T00:09:57.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440b65b0 con 0x7fd0440afa00 2021-10-21T00:09:57.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044143db0 con 0x7fd0440b61d0 2021-10-21T00:09:57.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd0440677e0 0x7fd0440af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd043fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 0x7fd044138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd0440677e0 0x7fd0440af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34656/0 (socket says 172.21.15.41:34656) 2021-10-21T00:09:57.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 -- 172.21.15.41:0/3162613400 learned_addr learned my addr 172.21.15.41:0/3162613400 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:57.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd0437fe700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440b61d0 0x7fd0440af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 -- 172.21.15.41:0/3162613400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440b61d0 msgr2=0x7fd0440af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:57.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440b61d0 0x7fd0440af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 -- 172.21.15.41:0/3162613400 >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 msgr2=0x7fd044138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:57.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 --2- 172.21.15.41:0/3162613400 >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 0x7fd044138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 -- 172.21.15.41:0/3162613400 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440b18f0 con 0x7fd0440677e0 2021-10-21T00:09:57.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd043fff700 1 --2- 172.21.15.41:0/3162613400 >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 0x7fd044138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:09:57.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd03bfff700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440677e0 0x7fd0440af510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c006f40).ready entity=mon.0 client_cookie=bb62d828bf324441 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd042ffd700 1 -- 172.21.15.41:0/3162613400 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c00da80 con 0x7fd0440677e0 2021-10-21T00:09:57.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd042ffd700 1 -- 172.21.15.41:0/3162613400 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c000e90 con 0x7fd0440677e0 2021-10-21T00:09:57.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd042ffd700 1 -- 172.21.15.41:0/3162613400 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c00de10 con 0x7fd0440677e0 2021-10-21T00:09:57.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- 172.21.15.41:0/3162613400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440677e0 msgr2=0x7fd0440af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440677e0 0x7fd0440af510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c006f40).stop 2021-10-21T00:09:57.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- 172.21.15.41:0/3162613400 shutdown_connections 2021-10-21T00:09:57.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440677e0 0x7fd0440af510 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- 172.21.15.41:0/3162613400 >> v2:172.21.15.62:3300/0 conn(0x7fd0440afa00 0x7fd044138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 --2- 172.21.15.41:0/3162613400 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440b61d0 0x7fd0440af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- 172.21.15.41:0/3162613400 >> 172.21.15.41:0/3162613400 conn(0x7fd044063b80 msgr2=0x7fd0440b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- 172.21.15.41:0/3162613400 shutdown_connections 2021-10-21T00:09:57.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.748+0000 7fd04885b700 1 -- 172.21.15.41:0/3162613400 wait complete. 2021-10-21T00:09:57.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 Processor -- start 2021-10-21T00:09:57.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 -- start start 2021-10-21T00:09:57.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440677e0 0x7fd04413af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0440afa00 0x7fd044138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04413acb0 con 0x7fd0440b61d0 2021-10-21T00:09:57.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04413bd00 con 0x7fd0440afa00 2021-10-21T00:09:57.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd04885b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04413bfa0 con 0x7fd0440677e0 2021-10-21T00:09:57.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34664/0 (socket says 172.21.15.41:34664) 2021-10-21T00:09:57.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 -- 172.21.15.41:0/2186279298 learned_addr learned my addr 172.21.15.41:0/2186279298 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:57.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd03bfff700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0440afa00 0x7fd044138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd0437fe700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440677e0 0x7fd04413af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 -- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440677e0 msgr2=0x7fd04413af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440677e0 0x7fd04413af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 -- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0440afa00 msgr2=0x7fd044138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0440afa00 0x7fd044138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.752+0000 7fd043fff700 1 -- 172.21.15.41:0/2186279298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c009470 con 0x7fd0440b61d0 2021-10-21T00:09:57.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd043fff700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fd03c00c000 tx=0x7fd03c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03c00c850 con 0x7fd0440b61d0 2021-10-21T00:09:57.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00c9b0 con 0x7fd0440b61d0 2021-10-21T00:09:57.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c00b460 con 0x7fd0440b61d0 2021-10-21T00:09:57.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03c00cd10 con 0x7fd0440b61d0 2021-10-21T00:09:57.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04413c660 con 0x7fd0440b61d0 2021-10-21T00:09:57.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04413c160 con 0x7fd0440b61d0 2021-10-21T00:09:57.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd03c0123f0 con 0x7fd0440b61d0 2021-10-21T00:09:57.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 0x7fd028055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:57.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd03c06be00 con 0x7fd0440b61d0 2021-10-21T00:09:57.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.756+0000 7fd0437fe700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 0x7fd028055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:57.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.760+0000 7fd0437fe700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 0x7fd028055ad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fd03400c000 tx=0x7fd034008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:57.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.764+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd03c042df0 con 0x7fd0440b61d0 2021-10-21T00:09:57.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.888+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0440b1b90 con 0x7fd0440b61d0 2021-10-21T00:09:57.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd0417fa700 1 -- 172.21.15.41:0/2186279298 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd03c0160a0 con 0x7fd0440b61d0 2021-10-21T00:09:57.900 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:57.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 msgr2=0x7fd028055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 0x7fd028055ad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fd03400c000 tx=0x7fd034008040).stop 2021-10-21T00:09:57.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 msgr2=0x7fd044141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:57.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7fd03c00c000 tx=0x7fd03c0091d0).stop 2021-10-21T00:09:57.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 shutdown_connections 2021-10-21T00:09:57.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd028053610 0x7fd028055ad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd0440b61d0 0x7fd044141e00 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0440afa00 0x7fd044138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 --2- 172.21.15.41:0/2186279298 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0440677e0 0x7fd04413af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:57.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 >> 172.21.15.41:0/2186279298 conn(0x7fd044063b80 msgr2=0x7fd044138270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:57.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 shutdown_connections 2021-10-21T00:09:57.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:57.892+0000 7fd04885b700 1 -- 172.21.15.41:0/2186279298 wait complete. 2021-10-21T00:09:57.912 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:09:58.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 Processor -- start 2021-10-21T00:09:58.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 -- start start 2021-10-21T00:09:58.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 0x7f5650146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500ba080 con 0x7f56500b3e00 2021-10-21T00:09:58.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500b4b30 con 0x7f56500b9ca0 2021-10-21T00:09:58.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f5655a47700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500b11f0 con 0x7f56500b5270 2021-10-21T00:09:58.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f56500b3e00 0x7f56500b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60672/0 (socket says 172.21.15.41:60672) 2021-10-21T00:09:58.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564f7fe700 1 -- 172.21.15.41:0/1628606558 learned_addr learned my addr 172.21.15.41:0/1628606558 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:58.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f56467fc700 1 --2- 172.21.15.41:0/1628606558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 0x7f5650146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374103598 0 0) 0x7f56500ba080 con 0x7f56500b3e00 2021-10-21T00:09:58.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5630003260 con 0x7f56500b3e00 2021-10-21T00:09:58.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771001095 0 0) 0x7f56500b4b30 con 0x7f56500b9ca0 2021-10-21T00:09:58.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.016+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56500ba080 con 0x7f56500b9ca0 2021-10-21T00:09:58.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f56467fc700 1 -- 172.21.15.41:0/1628606558 >> v1:172.21.15.62:6789/0 conn(0x7f56500b9ca0 legacy=0x7f5650146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157283853 0 0) 0x7f5630003260 con 0x7f56500b3e00 2021-10-21T00:09:58.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f56467fc700 1 -- 172.21.15.41:0/1628606558 >> v1:172.21.15.41:6789/0 conn(0x7f56500b3e00 legacy=0x7f56500b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f56467fc700 1 -- 172.21.15.41:0/1628606558 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500b4dd0 con 0x7f56500b5270 2021-10-21T00:09:58.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f56467fc700 1 --2- 172.21.15.41:0/1628606558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 0x7f5650146ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).ready entity=mon.2 client_cookie=f32ffe455b00dc2d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d5c0 con 0x7f56500b5270 2021-10-21T00:09:58.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638000e90 con 0x7f56500b5270 2021-10-21T00:09:58.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f564e7fc700 1 -- 172.21.15.41:0/1628606558 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d910 con 0x7f56500b5270 2021-10-21T00:09:58.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- 172.21.15.41:0/1628606558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 msgr2=0x7f5650146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 --2- 172.21.15.41:0/1628606558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 0x7f5650146ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).stop 2021-10-21T00:09:58.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- 172.21.15.41:0/1628606558 shutdown_connections 2021-10-21T00:09:58.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 --2- 172.21.15.41:0/1628606558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b5270 0x7f5650146ca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- 172.21.15.41:0/1628606558 >> 172.21.15.41:0/1628606558 conn(0x7f5650062f00 msgr2=0x7f56500b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:58.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- 172.21.15.41:0/1628606558 shutdown_connections 2021-10-21T00:09:58.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- 172.21.15.41:0/1628606558 wait complete. 2021-10-21T00:09:58.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 Processor -- start 2021-10-21T00:09:58.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.020+0000 7f5655a47700 1 -- start start 2021-10-21T00:09:58.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56500b5270 0x7f56500b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 0x7f56500ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500af1f0 con 0x7f56500b3e00 2021-10-21T00:09:58.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34674/0 (socket says 172.21.15.41:34674) 2021-10-21T00:09:58.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500adda0 con 0x7f56500b5270 2021-10-21T00:09:58.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 -- 172.21.15.41:0/1020749283 learned_addr learned my addr 172.21.15.41:0/1020749283 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500ace10 con 0x7f56500b9ca0 2021-10-21T00:09:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f56467fc700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56500b5270 0x7f56500b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564f7fe700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 0x7f56500ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 -- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 msgr2=0x7f56500ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 0x7f56500ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 -- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56500b5270 msgr2=0x7f56500b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56500b5270 0x7f56500b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800b180 con 0x7f56500b3e00 2021-10-21T00:09:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564f7fe700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 0x7f56500ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564effd700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f5640001110 tx=0x7f5640007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5640012400 con 0x7f56500b3e00 2021-10-21T00:09:58.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5640012560 con 0x7f56500b3e00 2021-10-21T00:09:58.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56500ae020 con 0x7f56500b3e00 2021-10-21T00:09:58.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56400128c0 con 0x7f56500b3e00 2021-10-21T00:09:58.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500ac890 con 0x7f56500b3e00 2021-10-21T00:09:58.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.024+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56500b2610 con 0x7f56500b3e00 2021-10-21T00:09:58.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.028+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5640019030 con 0x7f56500b3e00 2021-10-21T00:09:58.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.028+0000 7f564cff9700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 0x7f5634055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.028+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f564006ad20 con 0x7f56500b3e00 2021-10-21T00:09:58.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.028+0000 7f56467fc700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 0x7f5634055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.028+0000 7f56467fc700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 0x7f5634055b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f563801a000 tx=0x7f5638014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.032+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5640041e80 con 0x7f56500b3e00 2021-10-21T00:09:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.160+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56500b4790 con 0x7f56500b3e00 2021-10-21T00:09:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.160+0000 7f564cff9700 1 -- 172.21.15.41:0/1020749283 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f56400454a0 con 0x7f56500b3e00 2021-10-21T00:09:58.169 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:09:58.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 msgr2=0x7f5634055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 0x7f5634055b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f563801a000 tx=0x7f5638014000).stop 2021-10-21T00:09:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 msgr2=0x7f5650067090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f5640001110 tx=0x7f5640007ae0).stop 2021-10-21T00:09:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 shutdown_connections 2021-10-21T00:09:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f56340536a0 0x7f5634055b60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56500b9ca0 0x7f56500ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56500b5270 0x7f56500b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 --2- 172.21.15.41:0/1020749283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56500b3e00 0x7f5650067090 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 >> 172.21.15.41:0/1020749283 conn(0x7f5650062f00 msgr2=0x7f56500b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 shutdown_connections 2021-10-21T00:09:58.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.164+0000 7f5655a47700 1 -- 172.21.15.41:0/1020749283 wait complete. 2021-10-21T00:09:58.182 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:09:58.183 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:09:58.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 Processor -- start 2021-10-21T00:09:58.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 -- start start 2021-10-21T00:09:58.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f08300b2170 0x7f08300ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300af620 0x7f08300ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08300b0b50 con 0x7f08300abb50 2021-10-21T00:09:58.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08300b2550 con 0x7f08300b2170 2021-10-21T00:09:58.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f0834c4c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300b0d90 con 0x7f08300af620 2021-10-21T00:09:58.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f08300b2170 0x7f08300ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f08300b2170 0x7f08300ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34682/0 (socket says 172.21.15.41:34682) 2021-10-21T00:09:58.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 -- 172.21.15.41:0/3380954859 learned_addr learned my addr 172.21.15.41:0/3380954859 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:58.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082effd700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300af620 0x7f08300ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 -- 172.21.15.41:0/3380954859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300af620 msgr2=0x7f08300ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:58.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300af620 0x7f08300ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082e7fc700 1 -- 172.21.15.41:0/3380954859 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812061599 0 0) 0x7f0820001110 con 0x7f08300abb50 2021-10-21T00:09:58.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 -- 172.21.15.41:0/3380954859 >> v1:172.21.15.41:6789/0 conn(0x7f08300abb50 legacy=0x7f083014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 -- 172.21.15.41:0/3380954859 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300b1030 con 0x7f08300b2170 2021-10-21T00:09:58.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082f7fe700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f08300ab170 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f08280032f0 tx=0x7f0828009290).ready entity=mon.0 client_cookie=979ceef621a79dd1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082e7fc700 1 -- 172.21.15.41:0/3380954859 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082800b8a0 con 0x7f08300b2170 2021-10-21T00:09:58.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082e7fc700 1 -- 172.21.15.41:0/3380954859 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082800ba00 con 0x7f08300b2170 2021-10-21T00:09:58.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.280+0000 7f082e7fc700 1 -- 172.21.15.41:0/3380954859 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082800bb70 con 0x7f08300b2170 2021-10-21T00:09:58.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- 172.21.15.41:0/3380954859 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 msgr2=0x7f08300ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f08300ab170 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f08280032f0 tx=0x7f0828009290).stop 2021-10-21T00:09:58.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- 172.21.15.41:0/3380954859 shutdown_connections 2021-10-21T00:09:58.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300af620 0x7f08300ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 --2- 172.21.15.41:0/3380954859 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f08300ab170 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- 172.21.15.41:0/3380954859 >> 172.21.15.41:0/3380954859 conn(0x7f08300b5700 msgr2=0x7f08300b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:58.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- 172.21.15.41:0/3380954859 shutdown_connections 2021-10-21T00:09:58.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- 172.21.15.41:0/3380954859 wait complete. 2021-10-21T00:09:58.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 Processor -- start 2021-10-21T00:09:58.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.284+0000 7f0834c4c700 1 -- start start 2021-10-21T00:09:58.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300abb50 0x7f08300ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08300af620 0x7f0830146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08301597f0 con 0x7f08300b2170 2021-10-21T00:09:58.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830148b80 con 0x7f08300af620 2021-10-21T00:09:58.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300adda0 con 0x7f08300abb50 2021-10-21T00:09:58.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082f7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300abb50 0x7f08300ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08300af620 0x7f0830146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34692/0 (socket says 172.21.15.41:34692) 2021-10-21T00:09:58.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 -- 172.21.15.41:0/1399028190 learned_addr learned my addr 172.21.15.41:0/1399028190 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:58.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 -- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300abb50 msgr2=0x7f08300ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300abb50 0x7f08300ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 -- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08300af620 msgr2=0x7f0830146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08300af620 0x7f0830146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 -- 172.21.15.41:0/1399028190 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828009530 con 0x7f08300b2170 2021-10-21T00:09:58.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082ffff700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f0820000ed0 tx=0x7f0820007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0820001d70 con 0x7f08300b2170 2021-10-21T00:09:58.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820007030 con 0x7f08300b2170 2021-10-21T00:09:58.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830159a20 con 0x7f08300b2170 2021-10-21T00:09:58.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0820007390 con 0x7f08300b2170 2021-10-21T00:09:58.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0830147200 con 0x7f08300b2170 2021-10-21T00:09:58.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.288+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08300b12d0 con 0x7f08300b2170 2021-10-21T00:09:58.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.292+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0820010030 con 0x7f08300b2170 2021-10-21T00:09:58.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.292+0000 7f082cff9700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 0x7f0814055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:58.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.292+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f082006b250 con 0x7f08300b2170 2021-10-21T00:09:58.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.292+0000 7f082f7fe700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 0x7f0814055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:58.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.292+0000 7f082f7fe700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 0x7f0814055b60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f082801b000 tx=0x7f0828016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:58.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.296+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08200423b0 con 0x7f08300b2170 2021-10-21T00:09:58.310 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:58.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:58.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:58.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:58.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:09:58.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.464+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08300b0b50 con 0x7f08300b2170 2021-10-21T00:09:58.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.464+0000 7f082cff9700 1 -- 172.21.15.41:0/1399028190 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f08300b0b50 con 0x7f08300b2170 2021-10-21T00:09:58.474 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:58.474 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:09:58.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 msgr2=0x7f0814055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 0x7f0814055b60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f082801b000 tx=0x7f0828016000).stop 2021-10-21T00:09:58.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 msgr2=0x7f0830159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f0820000ed0 tx=0x7f0820007c00).stop 2021-10-21T00:09:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 shutdown_connections 2021-10-21T00:09:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f08140536a0 0x7f0814055b60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08300b2170 0x7f0830159ec0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08300af620 0x7f0830146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 --2- 172.21.15.41:0/1399028190 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08300abb50 0x7f08300ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:58.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 >> 172.21.15.41:0/1399028190 conn(0x7f08300b5700 msgr2=0x7f08301491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:58.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 shutdown_connections 2021-10-21T00:09:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:58.468+0000 7f0834c4c700 1 -- 172.21.15.41:0/1399028190 wait complete. 2021-10-21T00:09:58.479 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:09:58.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:09:53.582620+0000', 'modified': '2021-10-21T00:09:54.586575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6663}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6663': {'gid': 6663, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/1888649335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 1888649335}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 1888649335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:09:58.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:09:58.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:09:58.804 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6663,"want_state":"up:active","state":"up:active","rank_uptime":5.2059122389999999,"mdsmap_epoch":39,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":9.5294847140000005} 2021-10-21T00:09:58.805 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6663, "mdsmap_epoch": 39, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 5.205912239, "state": "up:active", "uptime": 9.529484714, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:09:58.805 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:09:58.806 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:09:58.806 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:09:58.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:58.807 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:58.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:09:58.873 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:09:58.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:09:58.885 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:09:58.885 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:09:58.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:58.887 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:09:58.893 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:09:58.893 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:58.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:09:58.914 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:09:58.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:09:58.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:09:58.961+0000 7f1c3922a080 -1 init, newargv = 0x55842ae6e910 newargc=9 2021-10-21T00:09:58.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14638]: starting ceph client 2021-10-21T00:09:58.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14638]: starting fuse 2021-10-21T00:09:58.977 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:09:58.979 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:09:58.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:58.980 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:09:58.986 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:09:58.987 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:09:58.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:58.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:09:58.988 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:09:58.988 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:09:58.989 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:09:58.989 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:09:58.990 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:58.990 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:09:58.991 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:09:58.991 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:09:58.992 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:58.992 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:09:58.993 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:09:58.993 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:09:58.993 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:09:58.994 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:58.994 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:09:58.995 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:09:58.995 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:09:58.995 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:09:58.996 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:09:58.996 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:09:58.997 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:09:58.997 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:09:59.038 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14638.asok 2021-10-21T00:09:59.044 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14638.asok 2021-10-21T00:09:59.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:59.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14638.asok status 2021-10-21T00:09:59.174 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:09:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:09:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:09:59.175 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:09:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:09:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:09:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:09:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14638", 2021-10-21T00:09:59.176 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:09:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:09:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:09:59.177 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 6134, 2021-10-21T00:09:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:09:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:09:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:09:59.178 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 6134 2021-10-21T00:09:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:09:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:09:59.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:09:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 78573834 2021-10-21T00:09:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:09:59.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:59.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:09:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:09:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:09:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 78573834 2021-10-21T00:09:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:09:59.183 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.6134 172.21.15.71:0/78573834", 2021-10-21T00:09:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/78573834", 2021-10-21T00:09:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:09:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 39, 2021-10-21T00:09:59.184 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 79, 2021-10-21T00:09:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:09:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:09:59.185 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:09:59.186 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:09:59.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:59.188 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:09:59.188 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:59.196 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:09:59.197 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:09:59.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:09:59.198 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:09:59.218 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:09:59.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 Processor -- start 2021-10-21T00:09:59.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 -- start start 2021-10-21T00:09:59.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9128062330 0x7f91280b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9128062f70 0x7f912805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912805bd40 con 0x7f91280b3a20 2021-10-21T00:09:59.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912805bf70 con 0x7f9128062f70 2021-10-21T00:09:59.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912f452700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9128142cb0 con 0x7f9128062330 2021-10-21T00:09:59.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912ec51700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f91280b3a20 0x7f912813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60702/0 (socket says 172.21.15.41:60702) 2021-10-21T00:09:59.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912ec51700 1 -- 172.21.15.41:0/1712785120 learned_addr learned my addr 172.21.15.41:0/1712785120 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:59.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912dc4f700 1 --2- 172.21.15.41:0/1712785120 >> v2:172.21.15.62:3300/0 conn(0x7f9128062f70 0x7f912805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912e450700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9128062330 0x7f91280b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912d44e700 1 -- 172.21.15.41:0/1712785120 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772572489 0 0) 0x7f912805bd40 con 0x7f91280b3a20 2021-10-21T00:09:59.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912d44e700 1 -- 172.21.15.41:0/1712785120 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9110003260 con 0x7f91280b3a20 2021-10-21T00:09:59.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912dc4f700 1 -- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9128062330 msgr2=0x7f91280b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:59.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912dc4f700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9128062330 0x7f91280b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912dc4f700 1 -- 172.21.15.41:0/1712785120 >> v1:172.21.15.41:6789/0 conn(0x7f91280b3a20 legacy=0x7f912813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.324+0000 7f912dc4f700 1 -- 172.21.15.41:0/1712785120 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128142950 con 0x7f9128062f70 2021-10-21T00:09:59.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912dc4f700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062f70 0x7f912805c410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9124002f70 tx=0x7f9124006df0).ready entity=mon.1 client_cookie=2e25b764a3c0232f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912d44e700 1 -- 172.21.15.41:0/1712785120 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f912400d4a0 con 0x7f9128062f70 2021-10-21T00:09:59.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912d44e700 1 -- 172.21.15.41:0/1712785120 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124000e90 con 0x7f9128062f70 2021-10-21T00:09:59.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912d44e700 1 -- 172.21.15.41:0/1712785120 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f912400d7f0 con 0x7f9128062f70 2021-10-21T00:09:59.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 -- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062f70 msgr2=0x7f912805c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062f70 0x7f912805c410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f9124002f70 tx=0x7f9124006df0).stop 2021-10-21T00:09:59.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 -- 172.21.15.41:0/1712785120 shutdown_connections 2021-10-21T00:09:59.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062f70 0x7f912805c410 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 --2- 172.21.15.41:0/1712785120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9128062330 0x7f91280b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 -- 172.21.15.41:0/1712785120 >> 172.21.15.41:0/1712785120 conn(0x7f91280b9080 msgr2=0x7f91280b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:59.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 -- 172.21.15.41:0/1712785120 shutdown_connections 2021-10-21T00:09:59.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.328+0000 7f912f452700 1 -- 172.21.15.41:0/1712785120 wait complete. 2021-10-21T00:09:59.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 Processor -- start 2021-10-21T00:09:59.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 -- start start 2021-10-21T00:09:59.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062330 0x7f9128148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91280b3a20 0x7f912813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128142520 con 0x7f9128062f70 2021-10-21T00:09:59.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280aca10 con 0x7f9128062330 2021-10-21T00:09:59.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912f452700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280aceb0 con 0x7f91280b3a20 2021-10-21T00:09:59.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912e450700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062330 0x7f9128148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34704/0 (socket says 172.21.15.41:34704) 2021-10-21T00:09:59.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 -- 172.21.15.41:0/3589652469 learned_addr learned my addr 172.21.15.41:0/3589652469 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:59.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912ec51700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91280b3a20 0x7f912813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 -- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91280b3a20 msgr2=0x7f912813c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91280b3a20 0x7f912813c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 -- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062330 msgr2=0x7f9128148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062330 0x7f9128148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 -- 172.21.15.41:0/3589652469 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912400b180 con 0x7f9128062f70 2021-10-21T00:09:59.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.332+0000 7f912dc4f700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f9124002f70 tx=0x7f9124014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9124016070 con 0x7f9128062f70 2021-10-21T00:09:59.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240138d0 con 0x7f9128062f70 2021-10-21T00:09:59.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9124013c30 con 0x7f9128062f70 2021-10-21T00:09:59.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9128142150 con 0x7f9128062f70 2021-10-21T00:09:59.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280af760 con 0x7f9128062f70 2021-10-21T00:09:59.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9128142690 con 0x7f9128062f70 2021-10-21T00:09:59.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f912400f030 con 0x7f9128062f70 2021-10-21T00:09:59.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 0x7f9108055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f912406c5f0 con 0x7f9128062f70 2021-10-21T00:09:59.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f912e450700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 0x7f9108055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.336+0000 7f912e450700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 0x7f9108055b60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f911800b000 tx=0x7f9118006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.344+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9124043750 con 0x7f9128062f70 2021-10-21T00:09:59.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.468+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9128057350 con 0x7f9128062f70 2021-10-21T00:09:59.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.468+0000 7f91177fe700 1 -- 172.21.15.41:0/3589652469 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9124023020 con 0x7f9128062f70 2021-10-21T00:09:59.477 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:09:59.478 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":79,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:09:54.585571+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:09:51.626316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-10-21T00:09:52.630268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:09:59.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 msgr2=0x7f9108055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 0x7f9108055b60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f911800b000 tx=0x7f9118006df0).stop 2021-10-21T00:09:59.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 msgr2=0x7f912813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f9124002f70 tx=0x7f9124014000).stop 2021-10-21T00:09:59.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 shutdown_connections 2021-10-21T00:09:59.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f91080536a0 0x7f9108055b60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91280b3a20 0x7f912813c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9128062f70 0x7f912813c2c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 --2- 172.21.15.41:0/3589652469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9128062330 0x7f9128148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 >> 172.21.15.41:0/3589652469 conn(0x7f91280b9080 msgr2=0x7f91280b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:59.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 shutdown_connections 2021-10-21T00:09:59.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.472+0000 7f912f452700 1 -- 172.21.15.41:0/3589652469 wait complete. 2021-10-21T00:09:59.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:09:51.626316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:09:52.630268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:09:59.495 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:09:59.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 Processor -- start 2021-10-21T00:09:59.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 -- start start 2021-10-21T00:09:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8ec0af620 0x7fb8ec0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0b0b50 con 0x7fb8ec0abb50 2021-10-21T00:09:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ec0b2550 con 0x7fb8ec0af620 2021-10-21T00:09:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.596+0000 7fb8f08bb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0b0d90 con 0x7fb8ec0b2170 2021-10-21T00:09:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8ec0af620 0x7fb8ec0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8ebfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8ec0abb50 0x7fb8ec14a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40540/0 (socket says 172.21.15.41:40540) 2021-10-21T00:09:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8ebfff700 1 -- 172.21.15.41:0/277126045 learned_addr learned my addr 172.21.15.41:0/277126045 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:09:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 -- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 msgr2=0x7fb8ec0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 --2- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 -- 172.21.15.41:0/277126045 >> v1:172.21.15.62:6789/0 conn(0x7fb8ec0abb50 legacy=0x7fb8ec14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 -- 172.21.15.41:0/277126045 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0b1030 con 0x7fb8ec0af620 2021-10-21T00:09:59.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8eaffd700 1 --2- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec0ab660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fb8dc0032f0 tx=0x7fb8dc0091d0).ready entity=mon.1 client_cookie=5e9133a4236782a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8ea7fc700 1 -- 172.21.15.41:0/277126045 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8dc00b6c0 con 0x7fb8ec0af620 2021-10-21T00:09:59.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8ea7fc700 1 -- 172.21.15.41:0/277126045 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00b820 con 0x7fb8ec0af620 2021-10-21T00:09:59.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8ea7fc700 1 -- 172.21.15.41:0/277126045 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8dc00b990 con 0x7fb8ec0af620 2021-10-21T00:09:59.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 msgr2=0x7fb8ec0ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec0ab660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fb8dc0032f0 tx=0x7fb8dc0091d0).stop 2021-10-21T00:09:59.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- 172.21.15.41:0/277126045 shutdown_connections 2021-10-21T00:09:59.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec0ab660 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/277126045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- 172.21.15.41:0/277126045 >> 172.21.15.41:0/277126045 conn(0x7fb8ec0b5700 msgr2=0x7fb8ec0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:59.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- 172.21.15.41:0/277126045 shutdown_connections 2021-10-21T00:09:59.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- 172.21.15.41:0/277126045 wait complete. 2021-10-21T00:09:59.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 Processor -- start 2021-10-21T00:09:59.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.600+0000 7fb8f08bb700 1 -- start start 2021-10-21T00:09:59.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0aced0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0ad170 con 0x7fb8ec0af620 2021-10-21T00:09:59.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0645d0 con 0x7fb8ec0b2170 2021-10-21T00:09:59.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34716/0 (socket says 172.21.15.41:34716) 2021-10-21T00:09:59.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 -- 172.21.15.41:0/1498924458 learned_addr learned my addr 172.21.15.41:0/1498924458 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:59.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eaffd700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8ebfff700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 -- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 msgr2=0x7fb8ec147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 -- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 msgr2=0x7fb8ec146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 -- 172.21.15.41:0/1498924458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc009470 con 0x7fb8ec0abb50 2021-10-21T00:09:59.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8eb7fe700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fb8e000c000 tx=0x7fb8e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e0010780 con 0x7fb8ec0abb50 2021-10-21T00:09:59.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e00108e0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec064870 con 0x7fb8ec0abb50 2021-10-21T00:09:59.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec0ac2e0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e0010c40 con 0x7fb8ec0abb50 2021-10-21T00:09:59.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec0b12d0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8e00123f0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.604+0000 7fb8e8ff9700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 0x7fb8cc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.608+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8e006be50 con 0x7fb8ec0abb50 2021-10-21T00:09:59.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.608+0000 7fb8eaffd700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 0x7fb8cc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.608+0000 7fb8eaffd700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 0x7fb8cc055b00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fb8dc01b000 tx=0x7fb8dc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.612+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8e0042eb0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.736+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb8ec057350 con 0x7fb8ec0abb50 2021-10-21T00:09:59.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8e8ff9700 1 -- 172.21.15.41:0/1498924458 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb8e00464d0 con 0x7fb8ec0abb50 2021-10-21T00:09:59.747 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:09:59.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 msgr2=0x7fb8cc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 0x7fb8cc055b00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fb8dc01b000 tx=0x7fb8dc016000).stop 2021-10-21T00:09:59.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 msgr2=0x7fb8ec05bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fb8e000c000 tx=0x7fb8e0006df0).stop 2021-10-21T00:09:59.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 shutdown_connections 2021-10-21T00:09:59.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb8cc053640 0x7fb8cc055b00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8ec0b2170 0x7fb8ec147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8ec0af620 0x7fb8ec146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 --2- 172.21.15.41:0/1498924458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8ec0abb50 0x7fb8ec05bfe0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 >> 172.21.15.41:0/1498924458 conn(0x7fb8ec0b5700 msgr2=0x7fb8ec149a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:59.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 shutdown_connections 2021-10-21T00:09:59.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.740+0000 7fb8f08bb700 1 -- 172.21.15.41:0/1498924458 wait complete. 2021-10-21T00:09:59.760 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:09:59.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 Processor -- start 2021-10-21T00:09:59.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- start start 2021-10-21T00:09:59.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1b0062330 0x7fb1b00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b00b3a20 0x7fb1b013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b005bd40 con 0x7fb1b0062f70 2021-10-21T00:09:59.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b005bf70 con 0x7fb1b0062330 2021-10-21T00:09:59.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0142cb0 con 0x7fb1b00b3a20 2021-10-21T00:09:59.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1b0062330 0x7fb1b00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb1b0062330 0x7fb1b00b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34724/0 (socket says 172.21.15.41:34724) 2021-10-21T00:09:59.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/265057548 learned_addr learned my addr 172.21.15.41:0/265057548 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:59.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b53aa700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b00b3a20 0x7fb1b013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/265057548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b00b3a20 msgr2=0x7fb1b013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:09:59.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b00b3a20 0x7fb1b013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/265057548 >> v1:172.21.15.62:6789/0 conn(0x7fb1b0062f70 legacy=0x7fb1b005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/265057548 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0142950 con 0x7fb1b0062330 2021-10-21T00:09:59.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b4ba9700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b00b3f30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fb1ac002f70 tx=0x7fb1ac006eb0).ready entity=mon.0 client_cookie=a63f5a7cf9a0d6da server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1a77fe700 1 -- 172.21.15.41:0/265057548 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ac00d570 con 0x7fb1b0062330 2021-10-21T00:09:59.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1a77fe700 1 -- 172.21.15.41:0/265057548 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac000e90 con 0x7fb1b0062330 2021-10-21T00:09:59.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1a77fe700 1 -- 172.21.15.41:0/265057548 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ac00d900 con 0x7fb1b0062330 2021-10-21T00:09:59.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- 172.21.15.41:0/265057548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 msgr2=0x7fb1b00b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b00b3f30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fb1ac002f70 tx=0x7fb1ac006eb0).stop 2021-10-21T00:09:59.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- 172.21.15.41:0/265057548 shutdown_connections 2021-10-21T00:09:59.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b00b3a20 0x7fb1b013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/265057548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b00b3f30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- 172.21.15.41:0/265057548 >> 172.21.15.41:0/265057548 conn(0x7fb1b00b9080 msgr2=0x7fb1b00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:09:59.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- 172.21.15.41:0/265057548 shutdown_connections 2021-10-21T00:09:59.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.864+0000 7fb1b5bab700 1 -- 172.21.15.41:0/265057548 wait complete. 2021-10-21T00:09:59.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 Processor -- start 2021-10-21T00:09:59.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 -- start start 2021-10-21T00:09:59.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 0x7fb1b0146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 0x7fb1b00adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0145730 con 0x7fb1b0062330 2021-10-21T00:09:59.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01459d0 con 0x7fb1b00b3a20 2021-10-21T00:09:59.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b5bab700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0145c70 con 0x7fb1b0062f70 2021-10-21T00:09:59.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34730/0 (socket says 172.21.15.41:34730) 2021-10-21T00:09:59.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/3056156037 learned_addr learned my addr 172.21.15.41:0/3056156037 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:09:59.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b53aa700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 0x7fb1b00adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1a7fff700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 0x7fb1b0146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 msgr2=0x7fb1b0146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 0x7fb1b0146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 msgr2=0x7fb1b00adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:09:59.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 0x7fb1b00adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:09:59.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.868+0000 7fb1b4ba9700 1 -- 172.21.15.41:0/3056156037 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac00b1e0 con 0x7fb1b0062330 2021-10-21T00:09:59.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a7fff700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 0x7fb1b0146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:59.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1b53aa700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 0x7fb1b00adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:09:59.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1b4ba9700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fb1ac002f70 tx=0x7fb1ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ac006b40 con 0x7fb1b0062330 2021-10-21T00:09:59.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00d8f0 con 0x7fb1b0062330 2021-10-21T00:09:59.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b01453b0 con 0x7fb1b0062330 2021-10-21T00:09:59.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1ac01e460 con 0x7fb1b0062330 2021-10-21T00:09:59.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b00ae650 con 0x7fb1b0062330 2021-10-21T00:09:59.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b0145e70 con 0x7fb1b0062330 2021-10-21T00:09:59.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1ac01a040 con 0x7fb1b0062330 2021-10-21T00:09:59.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:09:59.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1ac06c9b0 con 0x7fb1b0062330 2021-10-21T00:09:59.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.872+0000 7fb1a7fff700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:09:59.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.876+0000 7fb1a7fff700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 0x7fb190055ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fb1a000b000 tx=0x7fb1a0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:09:59.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:09:59.880+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1b0145e70 con 0x7fb1b0062330 2021-10-21T00:10:00.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.004+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1b01455a0 con 0x7fb1b0062330 2021-10-21T00:10:00.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1a5ffb700 1 -- 172.21.15.41:0/3056156037 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1ac023020 con 0x7fb1b0062330 2021-10-21T00:10:00.015 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:00.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 msgr2=0x7fb190055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 0x7fb190055ad0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fb1a000b000 tx=0x7fb1a0009040).stop 2021-10-21T00:10:00.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 msgr2=0x7fb1b0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fb1ac002f70 tx=0x7fb1ac015000).stop 2021-10-21T00:10:00.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 shutdown_connections 2021-10-21T00:10:00.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1b00b3a20 0x7fb1b00adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1b0062f70 0x7fb1b0146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 --2- 172.21.15.41:0/3056156037 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb1b0062330 0x7fb1b0151e60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 >> 172.21.15.41:0/3056156037 conn(0x7fb1b00b9080 msgr2=0x7fb1b005c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 shutdown_connections 2021-10-21T00:10:00.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.008+0000 7fb1b5bab700 1 -- 172.21.15.41:0/3056156037 wait complete. 2021-10-21T00:10:00.028 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:10:00.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 Processor -- start 2021-10-21T00:10:00.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- start start 2021-10-21T00:10:00.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec6c0b1b40 0x7fec6c0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 0x7fec6c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0aff30 con 0x7fec6c0b0d40 2021-10-21T00:10:00.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c0aca60 con 0x7fec6c0b1b40 2021-10-21T00:10:00.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0b1f20 con 0x7fec6c0b1350 2021-10-21T00:10:00.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec71c8c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fec6c0b0d40 0x7fec6c145e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60742/0 (socket says 172.21.15.41:60742) 2021-10-21T00:10:00.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec71c8c700 1 -- 172.21.15.41:0/829169413 learned_addr learned my addr 172.21.15.41:0/829169413 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:00.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 --2- 172.21.15.41:0/829169413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 0x7fec6c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7148b700 1 --2- 172.21.15.41:0/829169413 >> v2:172.21.15.62:3300/0 conn(0x7fec6c0b1b40 0x7fec6c0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec6bfff700 1 -- 172.21.15.41:0/829169413 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111143914 0 0) 0x7fec6c0aff30 con 0x7fec6c0b0d40 2021-10-21T00:10:00.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec6bfff700 1 -- 172.21.15.41:0/829169413 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec58003260 con 0x7fec6c0b0d40 2021-10-21T00:10:00.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 -- 172.21.15.41:0/829169413 >> v2:172.21.15.62:3300/0 conn(0x7fec6c0b1b40 msgr2=0x7fec6c0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:00.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 --2- 172.21.15.41:0/829169413 >> v2:172.21.15.62:3300/0 conn(0x7fec6c0b1b40 0x7fec6c0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 -- 172.21.15.41:0/829169413 >> v1:172.21.15.41:6789/0 conn(0x7fec6c0b0d40 legacy=0x7fec6c145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 -- 172.21.15.41:0/829169413 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c14a310 con 0x7fec6c0b1350 2021-10-21T00:10:00.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec70c8a700 1 --2- 172.21.15.41:0/829169413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 0x7fec6c0b0850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fec640032f0 tx=0x7fec640091d0).ready entity=mon.2 client_cookie=c81a958cf239bf81 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec6bfff700 1 -- 172.21.15.41:0/829169413 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400b600 con 0x7fec6c0b1350 2021-10-21T00:10:00.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec6bfff700 1 -- 172.21.15.41:0/829169413 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6400b760 con 0x7fec6c0b1350 2021-10-21T00:10:00.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec6bfff700 1 -- 172.21.15.41:0/829169413 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400b8d0 con 0x7fec6c0b1350 2021-10-21T00:10:00.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- 172.21.15.41:0/829169413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 msgr2=0x7fec6c0b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 --2- 172.21.15.41:0/829169413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 0x7fec6c0b0850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fec640032f0 tx=0x7fec640091d0).stop 2021-10-21T00:10:00.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- 172.21.15.41:0/829169413 shutdown_connections 2021-10-21T00:10:00.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 --2- 172.21.15.41:0/829169413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b1350 0x7fec6c0b0850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 --2- 172.21.15.41:0/829169413 >> v2:172.21.15.62:3300/0 conn(0x7fec6c0b1b40 0x7fec6c0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- 172.21.15.41:0/829169413 >> 172.21.15.41:0/829169413 conn(0x7fec6c0627b0 msgr2=0x7fec6c062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- 172.21.15.41:0/829169413 shutdown_connections 2021-10-21T00:10:00.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.124+0000 7fec7248d700 1 -- 172.21.15.41:0/829169413 wait complete. 2021-10-21T00:10:00.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 Processor -- start 2021-10-21T00:10:00.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 -- start start 2021-10-21T00:10:00.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b0d40 0x7fec6c110ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec6c0b1b40 0x7fec6c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c14e5f0 con 0x7fec6c0b1350 2021-10-21T00:10:00.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c14d5b0 con 0x7fec6c0b1b40 2021-10-21T00:10:00.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7248d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c14bf20 con 0x7fec6c0b0d40 2021-10-21T00:10:00.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec7148b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b0d40 0x7fec6c110ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34744/0 (socket says 172.21.15.41:34744) 2021-10-21T00:10:00.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 -- 172.21.15.41:0/1521548541 learned_addr learned my addr 172.21.15.41:0/1521548541 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:00.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec71c8c700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec6c0b1b40 0x7fec6c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 -- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b0d40 msgr2=0x7fec6c110ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b0d40 0x7fec6c110ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 -- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec6c0b1b40 msgr2=0x7fec6c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec6c0b1b40 0x7fec6c14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 -- 172.21.15.41:0/1521548541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009470 con 0x7fec6c0b1350 2021-10-21T00:10:00.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.128+0000 7fec70c8a700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fec640032f0 tx=0x7fec64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400b8d0 con 0x7fec6c0b1350 2021-10-21T00:10:00.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6401f3f0 con 0x7fec6c0b1350 2021-10-21T00:10:00.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c14c1c0 con 0x7fec6c0b1350 2021-10-21T00:10:00.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec6400b600 con 0x7fec6c0b1350 2021-10-21T00:10:00.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c145420 con 0x7fec6c0b1350 2021-10-21T00:10:00.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec48003410 con 0x7fec6c0b1350 2021-10-21T00:10:00.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec64026030 con 0x7fec6c0b1350 2021-10-21T00:10:00.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 0x7fec4c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec6406c4a0 con 0x7fec6c0b1350 2021-10-21T00:10:00.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.132+0000 7fec7148b700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 0x7fec4c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.136+0000 7fec7148b700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 0x7fec4c055ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fec6000b000 tx=0x7fec60006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.140+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec640434f0 con 0x7fec6c0b1350 2021-10-21T00:10:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.264+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec48003c40 con 0x7fec6c0b1350 2021-10-21T00:10:00.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.264+0000 7fec6a7fc700 1 -- 172.21.15.41:0/1521548541 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7fec64046b10 con 0x7fec6c0b1350 2021-10-21T00:10:00.274 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:00.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 msgr2=0x7fec4c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 0x7fec4c055ad0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fec6000b000 tx=0x7fec60006df0).stop 2021-10-21T00:10:00.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 msgr2=0x7fec6c14a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fec640032f0 tx=0x7fec64016000).stop 2021-10-21T00:10:00.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 shutdown_connections 2021-10-21T00:10:00.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fec4c053610 0x7fec4c055ad0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec6c0b1b40 0x7fec6c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fec6c0b1350 0x7fec6c14a7c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 --2- 172.21.15.41:0/1521548541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec6c0b0d40 0x7fec6c110ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 >> 172.21.15.41:0/1521548541 conn(0x7fec6c0627b0 msgr2=0x7fec6c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 shutdown_connections 2021-10-21T00:10:00.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.268+0000 7fec7248d700 1 -- 172.21.15.41:0/1521548541 wait complete. 2021-10-21T00:10:00.288 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:10:00.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 Processor -- start 2021-10-21T00:10:00.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 -- start start 2021-10-21T00:10:00.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 0x7f45d80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45d80b31e0 0x7f45d80b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80ba080 con 0x7f45d80b24b0 2021-10-21T00:10:00.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d805c670 con 0x7f45d80b31e0 2021-10-21T00:10:00.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45dd76d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d805c8e0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d77fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f45d80b24b0 0x7f45d8146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60756/0 (socket says 172.21.15.41:60756) 2021-10-21T00:10:00.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d77fe700 1 -- 172.21.15.41:0/4166846237 learned_addr learned my addr 172.21.15.41:0/4166846237 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:00.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 --2- 172.21.15.41:0/4166846237 >> v2:172.21.15.62:3300/0 conn(0x7f45d80b31e0 0x7f45d80b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d6ffd700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 0x7f45d80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d67fc700 1 -- 172.21.15.41:0/4166846237 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526772837 0 0) 0x7f45d80ba080 con 0x7f45d80b24b0 2021-10-21T00:10:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d67fc700 1 -- 172.21.15.41:0/4166846237 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b8003260 con 0x7f45d80b24b0 2021-10-21T00:10:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 -- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 msgr2=0x7f45d80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 0x7f45d80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 -- 172.21.15.41:0/4166846237 >> v1:172.21.15.41:6789/0 conn(0x7f45d80b24b0 legacy=0x7f45d8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 -- 172.21.15.41:0/4166846237 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d805cb80 con 0x7f45d80b31e0 2021-10-21T00:10:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d6ffd700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 0x7f45d80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45cffff700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b31e0 0x7f45d80b1fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f45c0002f70 tx=0x7f45c0006df0).ready entity=mon.1 client_cookie=3e1ad05fac621ec1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d67fc700 1 -- 172.21.15.41:0/4166846237 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c000d4a0 con 0x7f45d80b31e0 2021-10-21T00:10:00.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d67fc700 1 -- 172.21.15.41:0/4166846237 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0000e90 con 0x7f45d80b31e0 2021-10-21T00:10:00.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.388+0000 7f45d67fc700 1 -- 172.21.15.41:0/4166846237 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c000d7f0 con 0x7f45d80b31e0 2021-10-21T00:10:00.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b31e0 msgr2=0x7f45d80b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b31e0 0x7f45d80b1fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f45c0002f70 tx=0x7f45c0006df0).stop 2021-10-21T00:10:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- 172.21.15.41:0/4166846237 shutdown_connections 2021-10-21T00:10:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b31e0 0x7f45d80b1fc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- 172.21.15.41:0/4166846237 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b9ca0 0x7f45d80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- 172.21.15.41:0/4166846237 >> 172.21.15.41:0/4166846237 conn(0x7f45d8062f00 msgr2=0x7f45d80b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- 172.21.15.41:0/4166846237 shutdown_connections 2021-10-21T00:10:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- 172.21.15.41:0/4166846237 wait complete. 2021-10-21T00:10:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 Processor -- start 2021-10-21T00:10:00.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- start start 2021-10-21T00:10:00.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b24b0 0x7f45d80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b31e0 0x7f45d813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81131d0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8112ea0 con 0x7f45d80b24b0 2021-10-21T00:10:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.392+0000 7f45dd76d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8140470 con 0x7f45d80b31e0 2021-10-21T00:10:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34760/0 (socket says 172.21.15.41:34760) 2021-10-21T00:10:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 -- 172.21.15.41:0/764207031 learned_addr learned my addr 172.21.15.41:0/764207031 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:00.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d6ffd700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b24b0 0x7f45d80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45cffff700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b31e0 0x7f45d813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 -- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b31e0 msgr2=0x7f45d813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b31e0 0x7f45d813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 -- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b24b0 msgr2=0x7f45d80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b24b0 0x7f45d80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 -- 172.21.15.41:0/764207031 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c800b180 con 0x7f45d80b9ca0 2021-10-21T00:10:00.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d77fe700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f45d0001490 tx=0x7f45d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d0005ba0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0005d00 con 0x7f45d80b9ca0 2021-10-21T00:10:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c000b180 con 0x7f45d80b9ca0 2021-10-21T00:10:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d00072c0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d80acda0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8146ed0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45d0010070 con 0x7f45d80b9ca0 2021-10-21T00:10:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.396+0000 7f45d4ff9700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 0x7f45bc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.400+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45d006b440 con 0x7f45d80b9ca0 2021-10-21T00:10:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.400+0000 7f45d6ffd700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 0x7f45bc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.400+0000 7f45d6ffd700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 0x7f45bc055b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f45c800b000 tx=0x7f45c8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.404+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45d8146ed0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45d8146ea0 con 0x7f45d80b9ca0 2021-10-21T00:10:00.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45d4ff9700 1 -- 172.21.15.41:0/764207031 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f45d0042500 con 0x7f45d80b9ca0 2021-10-21T00:10:00.536 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:00.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 msgr2=0x7f45bc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 0x7f45bc055b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f45c800b000 tx=0x7f45c8008040).stop 2021-10-21T00:10:00.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 msgr2=0x7f45d813ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f45d0001490 tx=0x7f45d0007e00).stop 2021-10-21T00:10:00.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 shutdown_connections 2021-10-21T00:10:00.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45bc0536d0 0x7f45bc055b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45d80b9ca0 0x7f45d813ff80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45d80b31e0 0x7f45d813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 --2- 172.21.15.41:0/764207031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d80b24b0 0x7f45d80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.528+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 >> 172.21.15.41:0/764207031 conn(0x7f45d8062f00 msgr2=0x7f45d80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.532+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 shutdown_connections 2021-10-21T00:10:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.532+0000 7f45dd76d700 1 -- 172.21.15.41:0/764207031 wait complete. 2021-10-21T00:10:00.550 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:10:00.550 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:00.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.644+0000 7fcf1df70700 1 Processor -- start 2021-10-21T00:10:00.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.644+0000 7fcf1df70700 1 -- start start 2021-10-21T00:10:00.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf180b9c70 0x7fcf18143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf18142bc0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180ba050 con 0x7fcf181418f0 2021-10-21T00:10:00.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf181429a0 con 0x7fcf180b9c70 2021-10-21T00:10:00.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf180b9c70 0x7fcf18143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcf180b9c70 0x7fcf18143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34764/0 (socket says 172.21.15.41:34764) 2021-10-21T00:10:00.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 -- 172.21.15.41:0/4257489887 learned_addr learned my addr 172.21.15.41:0/4257489887 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:00.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 -- 172.21.15.41:0/4257489887 >> v1:172.21.15.62:6789/0 conn(0x7fcf181418f0 legacy=0x7fcf18141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:00.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 -- 172.21.15.41:0/4257489887 >> v1:172.21.15.41:6789/0 conn(0x7fcf180b3bc0 legacy=0x7fcf18143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 -- 172.21.15.41:0/4257489887 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf181463c0 con 0x7fcf180b9c70 2021-10-21T00:10:00.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf177fe700 1 --2- 172.21.15.41:0/4257489887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b9c70 0x7fcf18143020 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fcf18063290 tx=0x7fcf10009290).ready entity=mon.0 client_cookie=7ce18ea40532efbf server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf167fc700 1 -- 172.21.15.41:0/4257489887 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1000b860 con 0x7fcf180b9c70 2021-10-21T00:10:00.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf167fc700 1 -- 172.21.15.41:0/4257489887 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000b9c0 con 0x7fcf180b9c70 2021-10-21T00:10:00.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf167fc700 1 -- 172.21.15.41:0/4257489887 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1000bb30 con 0x7fcf180b9c70 2021-10-21T00:10:00.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- 172.21.15.41:0/4257489887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b9c70 msgr2=0x7fcf18143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 --2- 172.21.15.41:0/4257489887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b9c70 0x7fcf18143020 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fcf18063290 tx=0x7fcf10009290).stop 2021-10-21T00:10:00.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- 172.21.15.41:0/4257489887 shutdown_connections 2021-10-21T00:10:00.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 --2- 172.21.15.41:0/4257489887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b9c70 0x7fcf18143020 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- 172.21.15.41:0/4257489887 >> 172.21.15.41:0/4257489887 conn(0x7fcf18062e80 msgr2=0x7fcf180b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- 172.21.15.41:0/4257489887 shutdown_connections 2021-10-21T00:10:00.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- 172.21.15.41:0/4257489887 wait complete. 2021-10-21T00:10:00.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 Processor -- start 2021-10-21T00:10:00.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.648+0000 7fcf1df70700 1 -- start start 2021-10-21T00:10:00.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf180b9c70 0x7fcf180b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf181418f0 0x7fcf180ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180af4f0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180af250 con 0x7fcf180b9c70 2021-10-21T00:10:00.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18112520 con 0x7fcf181418f0 2021-10-21T00:10:00.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34770/0 (socket says 172.21.15.41:34770) 2021-10-21T00:10:00.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 -- 172.21.15.41:0/3166788435 learned_addr learned my addr 172.21.15.41:0/3166788435 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:00.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf16ffd700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf180b9c70 0x7fcf180b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf17fff700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf181418f0 0x7fcf180ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 -- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf181418f0 msgr2=0x7fcf180ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf181418f0 0x7fcf180ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 -- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf180b9c70 msgr2=0x7fcf180b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf180b9c70 0x7fcf180b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 -- 172.21.15.41:0/3166788435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009530 con 0x7fcf180b3bc0 2021-10-21T00:10:00.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf177fe700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcf18063290 tx=0x7fcf10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1001f3f0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1001f550 con 0x7fcf180b3bc0 2021-10-21T00:10:00.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1001f8b0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf180acd80 con 0x7fcf180b3bc0 2021-10-21T00:10:00.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf18112cb0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.652+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf18143c20 con 0x7fcf180b3bc0 2021-10-21T00:10:00.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.656+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf10026030 con 0x7fcf180b3bc0 2021-10-21T00:10:00.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.656+0000 7fcf14ff9700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:00.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.656+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf1006cbd0 con 0x7fcf180b3bc0 2021-10-21T00:10:00.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.656+0000 7fcf16ffd700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:00.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.656+0000 7fcf16ffd700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 0x7fcefc055ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fcf0000d000 tx=0x7fcf00000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:00.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.660+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf10043d30 con 0x7fcf180b3bc0 2021-10-21T00:10:00.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.824+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf18057350 con 0x7fcf180b3bc0 2021-10-21T00:10:00.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf14ff9700 1 -- 172.21.15.41:0/3166788435 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fcf10024070 con 0x7fcf180b3bc0 2021-10-21T00:10:00.837 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:00.837 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:10:00.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 msgr2=0x7fcefc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 0x7fcefc055ad0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fcf0000d000 tx=0x7fcf00000bc0).stop 2021-10-21T00:10:00.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 msgr2=0x7fcf18114d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:00.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fcf18063290 tx=0x7fcf10016000).stop 2021-10-21T00:10:00.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 shutdown_connections 2021-10-21T00:10:00.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcefc053610 0x7fcefc055ad0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf181418f0 0x7fcf180ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf180b9c70 0x7fcf180b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 --2- 172.21.15.41:0/3166788435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcf180b3bc0 0x7fcf18114d00 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:00.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 >> 172.21.15.41:0/3166788435 conn(0x7fcf18062e80 msgr2=0x7fcf181410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:00.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 shutdown_connections 2021-10-21T00:10:00.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:00.828+0000 7fcf1df70700 1 -- 172.21.15.41:0/3166788435 wait complete. 2021-10-21T00:10:00.841 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:10:01.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:09:53.582620+0000', 'modified': '2021-10-21T00:09:54.586575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6663}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6663': {'gid': 6663, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/1888649335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 1888649335}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 1888649335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:01.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:01.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:10:01.172 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":6663,"want_state":"up:active","state":"up:active","rank_uptime":7.5717186319999996,"mdsmap_epoch":39,"osdmap_epoch":79,"osdmap_epoch_barrier":79,"uptime":11.895291297} 2021-10-21T00:10:01.172 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 6663, "mdsmap_epoch": 39, "osdmap_epoch": 79, "osdmap_epoch_barrier": 79, "rank_uptime": 7.571718632, "state": "up:active", "uptime": 11.895291297, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:01.173 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:10:01.173 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:10:01.174 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:10:01.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.175 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:01.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:01.203 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:01.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:01.260 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:01.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:01.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.263 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:01.270 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:10:01.271 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:01.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:01.298 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:01.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:01.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:10:01.340+0000 7f13523c0080 -1 init, newargv = 0x5574dec88890 newargc=9ceph-fuse[14057]: starting ceph client 2021-10-21T00:10:01.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr: 2021-10-21T00:10:01.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14057]: starting fuse 2021-10-21T00:10:01.358 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:01.359 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:01.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.362 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:01.367 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:10:01.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:10:01.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:10:01.369 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:10:01.372 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:10:01.373 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:10:01.373 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:10:01.374 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:01.374 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:10:01.375 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:10:01.375 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:10:01.376 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:01.377 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:10:01.377 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:10:01.379 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:10:01.380 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:10:01.383 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:01.383 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:10:01.384 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:10:01.384 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:10:01.385 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:10:01.385 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:10:01.385 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:01.386 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:10:01.386 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:10:01.455 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14057.asok 2021-10-21T00:10:01.460 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14057.asok 2021-10-21T00:10:01.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14057.asok status 2021-10-21T00:10:01.553 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:10:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:10:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:10:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:10:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:10:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:10:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:10:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14057", 2021-10-21T00:10:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:10:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:10:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:10:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6763, 2021-10-21T00:10:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:10:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:10:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:10:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 6763 2021-10-21T00:10:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1488806968 2021-10-21T00:10:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:10:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1488806968 2021-10-21T00:10:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.6763 172.21.15.99:0/1488806968", 2021-10-21T00:10:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/1488806968", 2021-10-21T00:10:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:10:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 39, 2021-10-21T00:10:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 79, 2021-10-21T00:10:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:10:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:10:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:10:01.561 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:10:01.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.563 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:01.563 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:01.570 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:01.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:01.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:01.572 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:01.631 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:01.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 Processor -- start 2021-10-21T00:10:01.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 -- start start 2021-10-21T00:10:01.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 0x7fea6c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:01.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c05f6b0 con 0x7fea6c09b220 2021-10-21T00:10:01.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c09d070 con 0x7fea6c0b2bf0 2021-10-21T00:10:01.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c099b70 con 0x7fea6c09cc90 2021-10-21T00:10:01.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fea6c09b220 0x7fea6c140380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60780/0 (socket says 172.21.15.41:60780) 2021-10-21T00:10:01.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6b7fe700 1 -- 172.21.15.41:0/1777235780 learned_addr learned my addr 172.21.15.41:0/1777235780 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:01.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6bfff700 1 --2- 172.21.15.41:0/1777235780 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 0x7fea6c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:01.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001256430 0 0) 0x7fea6c05f6b0 con 0x7fea6c09b220 2021-10-21T00:10:01.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003260 con 0x7fea6c09b220 2021-10-21T00:10:01.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141183310 0 0) 0x7fea6c09d070 con 0x7fea6c0b2bf0 2021-10-21T00:10:01.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea6c05f6b0 con 0x7fea6c0b2bf0 2021-10-21T00:10:01.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6bfff700 1 -- 172.21.15.41:0/1777235780 >> v1:172.21.15.62:6789/0 conn(0x7fea6c0b2bf0 legacy=0x7fea6c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6bfff700 1 -- 172.21.15.41:0/1777235780 >> v1:172.21.15.41:6789/0 conn(0x7fea6c09b220 legacy=0x7fea6c140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640603976 0 0) 0x7fea58003260 con 0x7fea6c09b220 2021-10-21T00:10:01.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6bfff700 1 -- 172.21.15.41:0/1777235780 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c05f910 con 0x7fea6c09cc90 2021-10-21T00:10:01.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6bfff700 1 --2- 172.21.15.41:0/1777235780 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 0x7fea6c13fe90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fea5c001110 tx=0x7fea60006df0).ready entity=mon.2 client_cookie=e278396bfc2697a8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:01.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5c001660 con 0x7fea6c09cc90 2021-10-21T00:10:01.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60000e90 con 0x7fea6c09cc90 2021-10-21T00:10:01.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea6affd700 1 -- 172.21.15.41:0/1777235780 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea60012460 con 0x7fea6c09cc90 2021-10-21T00:10:01.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 -- 172.21.15.41:0/1777235780 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 msgr2=0x7fea6c13fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.736+0000 7fea728f3700 1 --2- 172.21.15.41:0/1777235780 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 0x7fea6c13fe90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fea5c001110 tx=0x7fea60006df0).stop 2021-10-21T00:10:01.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- 172.21.15.41:0/1777235780 shutdown_connections 2021-10-21T00:10:01.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 --2- 172.21.15.41:0/1777235780 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c09cc90 0x7fea6c13fe90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- 172.21.15.41:0/1777235780 >> 172.21.15.41:0/1777235780 conn(0x7fea6c0b7030 msgr2=0x7fea6c0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:01.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- 172.21.15.41:0/1777235780 shutdown_connections 2021-10-21T00:10:01.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- 172.21.15.41:0/1777235780 wait complete. 2021-10-21T00:10:01.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 Processor -- start 2021-10-21T00:10:01.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- start start 2021-10-21T00:10:01.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:01.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c09cc90 0x7fea6c0617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:01.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0b2bf0 0x7fea6c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:01.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0993e0 con 0x7fea6c09b220 2021-10-21T00:10:01.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0628d0 con 0x7fea6c09cc90 2021-10-21T00:10:01.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c062170 con 0x7fea6c0b2bf0 2021-10-21T00:10:01.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:01.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34782/0 (socket says 172.21.15.41:34782) 2021-10-21T00:10:01.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 -- 172.21.15.41:0/1256206387 learned_addr learned my addr 172.21.15.41:0/1256206387 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:01.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea70e90700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0b2bf0 0x7fea6c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:01.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6b7fe700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c09cc90 0x7fea6c0617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:01.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 -- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0b2bf0 msgr2=0x7fea6c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0b2bf0 0x7fea6c0af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 -- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c09cc90 msgr2=0x7fea6c0617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c09cc90 0x7fea6c0617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 -- 172.21.15.41:0/1256206387 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6000b180 con 0x7fea6c09b220 2021-10-21T00:10:01.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea6bfff700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fea5c001110 tx=0x7fea60014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:01.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6000d7d0 con 0x7fea6c09b220 2021-10-21T00:10:01.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60017070 con 0x7fea6c09b220 2021-10-21T00:10:01.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6000db20 con 0x7fea6c09b220 2021-10-21T00:10:01.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.740+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c062410 con 0x7fea6c09b220 2021-10-21T00:10:01.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c0afc60 con 0x7fea6c09b220 2021-10-21T00:10:01.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c057350 con 0x7fea6c09b220 2021-10-21T00:10:01.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea60025020 con 0x7fea6c09b220 2021-10-21T00:10:01.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea697fa700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 0x7fea4c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea6006caa0 con 0x7fea6c09b220 2021-10-21T00:10:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea6b7fe700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 0x7fea4c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.744+0000 7fea6b7fe700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 0x7fea4c055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fea5c00d000 tx=0x7fea5c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.752+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea60043af0 con 0x7fea6c09b220 2021-10-21T00:10:01.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.920+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea6c145060 con 0x7fea6c09b220 2021-10-21T00:10:01.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.920+0000 7fea697fa700 1 -- 172.21.15.41:0/1256206387 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fea60047110 con 0x7fea6c09b220 2021-10-21T00:10:01.929 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:01.929 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:10:01.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 msgr2=0x7fea4c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 0x7fea4c055ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fea5c00d000 tx=0x7fea5c000bc0).stop 2021-10-21T00:10:01.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 msgr2=0x7fea6c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:01.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fea5c001110 tx=0x7fea60014000).stop 2021-10-21T00:10:01.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 shutdown_connections 2021-10-21T00:10:01.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea4c053610 0x7fea4c055ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6c0b2bf0 0x7fea6c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c09cc90 0x7fea6c0617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 --2- 172.21.15.41:0/1256206387 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea6c09b220 0x7fea6c0b07f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:01.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 >> 172.21.15.41:0/1256206387 conn(0x7fea6c0b7030 msgr2=0x7fea6c1400a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:01.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 shutdown_connections 2021-10-21T00:10:01.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:01.924+0000 7fea728f3700 1 -- 172.21.15.41:0/1256206387 wait complete. 2021-10-21T00:10:01.936 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:10:01.947 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1 2021-10-21T00:10:02.064 INFO:teuthology.orchestra.run.smithi062.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-10-21T00:09:59.210617+0000","btime":"2021-10-21T00:09:53.588328+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-10-21T00:09:53.588328+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-10-21T00:09:59.210617+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-10-21T00:09:53.588328+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6134,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6763,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-10-21T00:10:02.064 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-10-21T00:09:53.588328+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-10-21T00:09:53.588328+0000", "change_attr": 1, "client_caps": [ { "client_id": 6134, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6763, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-10-21T00:09:59.210617+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-10-21T00:09:53.588328+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-10-21T00:09:59.210617+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-10-21T00:10:02.065 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:02.065 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:02.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:02.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:02.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:02.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:02.174 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:02.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:02.175 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:02.175 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:02.185 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:10:02.186 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:02.187 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:10:02.188 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:02.188 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:02.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14638]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:02.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:02.207 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:02.208 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:02.255 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:10:02.256 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:02.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:02.367 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:02.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:02.376 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:02.377 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:02.385 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:02.386 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:02.387 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:10:02.387 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:02.388 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:02.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14057]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:02.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:02.447 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:02.448 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:02.454 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:10:02.456 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:02.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:02.544 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:02.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:02.553 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:02.554 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:02.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:02.562 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:02.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:02.566 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:02.577 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:02.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:02.579 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:02.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 Processor -- start 2021-10-21T00:10:02.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 -- start start 2021-10-21T00:10:02.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6581468b0 0x7ff658146d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580b2500 con 0x7ff6580b3270 2021-10-21T00:10:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580b27a0 con 0x7ff65805bfe0 2021-10-21T00:10:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff65cc70700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65805c3c0 con 0x7ff6581468b0 2021-10-21T00:10:02.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff6580b3270 0x7ff6581461a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60792/0 (socket says 172.21.15.41:60792) 2021-10-21T00:10:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 -- 172.21.15.41:0/3032174512 learned_addr learned my addr 172.21.15.41:0/3032174512 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff657fff700 1 --2- 172.21.15.41:0/3032174512 >> v2:172.21.15.62:3300/0 conn(0x7ff6581468b0 0x7ff658146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247171118 0 0) 0x7ff6580b2500 con 0x7ff6580b3270 2021-10-21T00:10:02.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff638003260 con 0x7ff6580b3270 2021-10-21T00:10:02.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008291549 0 0) 0x7ff638003260 con 0x7ff6580b3270 2021-10-21T00:10:02.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 >> v2:172.21.15.62:3300/0 conn(0x7ff6581468b0 msgr2=0x7ff658146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:02.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 --2- 172.21.15.41:0/3032174512 >> v2:172.21.15.62:3300/0 conn(0x7ff6581468b0 0x7ff658146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 >> v1:172.21.15.62:6789/0 conn(0x7ff65805bfe0 legacy=0x7ff65814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:02.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580b29d0 con 0x7ff6580b3270 2021-10-21T00:10:02.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7ff648001660 con 0x7ff6580b3270 2021-10-21T00:10:02.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 >> v1:172.21.15.41:6789/0 conn(0x7ff6580b3270 legacy=0x7ff6581461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:02.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638003750 0x7ff638003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 0x7ff638004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff638004e70 0x7ff63800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65805c3c0 con 0x7ff638004500 2021-10-21T00:10:02.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63800bdd0 con 0x7ff638003750 2021-10-21T00:10:02.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63800bf60 con 0x7ff638004e70 2021-10-21T00:10:02.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 0x7ff638004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff6577fe700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638003750 0x7ff638003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff657fff700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff638004e70 0x7ff63800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 -- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff638004e70 msgr2=0x7ff63800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:02.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff638004e70 0x7ff63800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 -- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638003750 msgr2=0x7ff638003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:02.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.680+0000 7ff656ffd700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638003750 0x7ff638003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff656ffd700 1 -- 172.21.15.41:0/3032174512 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638003260 con 0x7ff638004500 2021-10-21T00:10:02.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff657fff700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff638004e70 0x7ff63800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:02.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff657fff700 1 -- 172.21.15.41:0/3032174512 reap_dead start 2021-10-21T00:10:02.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff656ffd700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 0x7ff638004980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7ff648001370 tx=0x7ff6580b2b60).ready entity=mon.0 client_cookie=dfc42ce211b056fe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:02.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6480070d0 con 0x7ff638004500 2021-10-21T00:10:02.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648007230 con 0x7ff638004500 2021-10-21T00:10:02.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff6567fc700 1 -- 172.21.15.41:0/3032174512 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff64800c8f0 con 0x7ff638004500 2021-10-21T00:10:02.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 msgr2=0x7ff638004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:02.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 0x7ff638004980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7ff648001370 tx=0x7ff6580b2b60).stop 2021-10-21T00:10:02.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- 172.21.15.41:0/3032174512 shutdown_connections 2021-10-21T00:10:02.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 --2- 172.21.15.41:0/3032174512 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff638004500 0x7ff638004980 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- 172.21.15.41:0/3032174512 >> 172.21.15.41:0/3032174512 conn(0x7ff6580637b0 msgr2=0x7ff658063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:02.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- 172.21.15.41:0/3032174512 shutdown_connections 2021-10-21T00:10:02.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- 172.21.15.41:0/3032174512 wait complete. 2021-10-21T00:10:02.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 Processor -- start 2021-10-21T00:10:02.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- start start 2021-10-21T00:10:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638004500 0x7ff65814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff65814b9c0 0x7ff658144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814c020 con 0x7ff65814afa0 2021-10-21T00:10:02.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814c280 con 0x7ff638004500 2021-10-21T00:10:02.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff65cc70700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814c520 con 0x7ff65814b9c0 2021-10-21T00:10:02.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff657fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff657fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34806/0 (socket says 172.21.15.41:34806) 2021-10-21T00:10:02.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff657fff700 1 -- 172.21.15.41:0/1770625352 learned_addr learned my addr 172.21.15.41:0/1770625352 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:02.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff6577fe700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638004500 0x7ff65814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.684+0000 7ff656ffd700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff65814b9c0 0x7ff658144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 -- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff65814b9c0 msgr2=0x7ff658144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:02.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff65814b9c0 0x7ff658144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 -- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638004500 msgr2=0x7ff65814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:02.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638004500 0x7ff65814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 -- 172.21.15.41:0/1770625352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65814aae0 con 0x7ff65814afa0 2021-10-21T00:10:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff657fff700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff65000b000 tx=0x7ff650008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff650011e60 con 0x7ff65814afa0 2021-10-21T00:10:02.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6500145f0 con 0x7ff65814afa0 2021-10-21T00:10:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65814e620 con 0x7ff65814afa0 2021-10-21T00:10:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff650014950 con 0x7ff65814afa0 2021-10-21T00:10:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658156540 con 0x7ff65814afa0 2021-10-21T00:10:02.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65814e810 con 0x7ff65814afa0 2021-10-21T00:10:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff650012040 con 0x7ff65814afa0 2021-10-21T00:10:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 0x7ff63c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.688+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff65006bf60 con 0x7ff65814afa0 2021-10-21T00:10:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.692+0000 7ff6577fe700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 0x7ff63c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:02.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.692+0000 7ff6577fe700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 0x7ff63c055ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7ff640003000 tx=0x7ff640007a50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:02.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.696+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff650043060 con 0x7ff65814afa0 2021-10-21T00:10:02.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.824+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff65814a3a0 con 0x7ff65814afa0 2021-10-21T00:10:02.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff654ff9700 1 -- 172.21.15.41:0/1770625352 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v79) v1 ==== 81+0+33648 (secure 0 0 0) 0x7ff650046680 con 0x7ff65814afa0 2021-10-21T00:10:02.836 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:02.837 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:02.837 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 79, 2021-10-21T00:10:02.837 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:02.837 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:02.838 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:09:54.585571+0000", 2021-10-21T00:10:02.838 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:02.838 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:02.838 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:02.839 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:02.839 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:02.839 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:02.839 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:02.839 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:02.840 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:02.840 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:02.840 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:02.840 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:02.841 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:02.841 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:02.841 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:02.841 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 16, 2021-10-21T00:10:02.842 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:02.842 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:02.842 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:02.842 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:02.843 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:02.843 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.843 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:02.843 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:02.844 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:02.844 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:02.844 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:02.845 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:02.845 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:02.845 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:02.846 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:02.846 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:02.846 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:02.847 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:02.848 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:02.848 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:02.848 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:02.848 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:02.849 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:02.849 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:02.850 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:02.850 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:02.850 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:02.850 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:02.851 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:02.851 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.851 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:02.851 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:02.852 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:02.852 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:02.852 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:02.852 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:02.852 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:02.853 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:02.853 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:02.853 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:02.853 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:02.854 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:02.854 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:02.854 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:02.854 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:02.855 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:02.855 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:02.855 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:02.855 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:02.855 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:02.856 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:02.856 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:02.856 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:02.857 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:02.857 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:02.857 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:02.857 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:02.857 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.858 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:02.858 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:02.858 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:02.858 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:02.859 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:02.859 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:02.859 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:02.859 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:02.859 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:02.860 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:02.860 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:02.860 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:02.860 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:02.861 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.861 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:02.861 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:02.861 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.861 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.862 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.862 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:02.862 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:02.862 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:02.862 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:02.863 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:02.863 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:02.863 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:02.863 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:02.864 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:02.864 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:02.864 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:02.864 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:02.864 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:02.865 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:02.865 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:02.865 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:02.865 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:02.866 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:02.866 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:02.866 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:02.866 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:02.866 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:02.867 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:02.867 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.867 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:02.867 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:02.868 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:02.868 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:02.868 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:02.868 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:02.868 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:02.869 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:02.869 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:02.869 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:02.869 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:02.870 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:02.871 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:02.871 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:02.871 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:02.872 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:02.872 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:02.872 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:02.872 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:02.873 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:02.873 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:02.873 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:02.873 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:02.873 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:02.874 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:02.874 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:02.874 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:02.874 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.875 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:02.875 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:02.875 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:02.875 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:02.875 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:02.876 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:02.876 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:02.876 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:02.876 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:02.877 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:02.877 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:02.877 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:02.877 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:02.877 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:02.878 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.878 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.878 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.878 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 15, 2021-10-21T00:10:02.879 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:10:02.879 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:09:51.626316+0000", 2021-10-21T00:10:02.879 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:02.879 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:02.879 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:02.880 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:02.880 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:02.880 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:02.880 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:02.880 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:02.881 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:02.881 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:02.881 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:02.881 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:02.882 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:02.882 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:02.882 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:02.882 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:02.882 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:02.883 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:02.883 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:02.883 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:02.883 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.884 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "78", 2021-10-21T00:10:02.884 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:02.884 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:02.884 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:02.884 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:02.885 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:02.885 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:02.885 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:02.885 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:02.885 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:02.886 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:02.886 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:02.886 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:02.886 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:02.887 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:02.887 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:02.887 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:02.887 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:02.887 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:02.888 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:02.888 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:02.888 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:02.888 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:02.889 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:02.889 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:02.889 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:02.889 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:02.889 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.890 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:02.890 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:02.890 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:02.890 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:02.890 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:02.891 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:02.891 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:02.891 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:02.891 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:02.892 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:02.892 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:02.892 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:02.892 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:10:02.892 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:10:02.893 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:10:02.893 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.893 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:02.893 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:02.894 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:10:02.894 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.894 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.895 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.895 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.895 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 16, 2021-10-21T00:10:02.895 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:10:02.895 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:09:52.630268+0000", 2021-10-21T00:10:02.896 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:02.896 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:02.896 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:02.896 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:02.897 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:02.897 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:02.897 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:02.897 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:02.897 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:02.898 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:02.898 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:02.898 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:02.898 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:02.899 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:02.899 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:02.899 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:02.899 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:02.899 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:02.900 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:02.900 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:02.900 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.900 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "79", 2021-10-21T00:10:02.901 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:02.901 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:02.901 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:02.901 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:02.901 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:02.902 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:02.902 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:02.902 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:02.902 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:02.903 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:02.903 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:02.903 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:02.903 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:02.903 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:02.904 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:02.904 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:02.904 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:02.904 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:02.905 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:02.905 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:02.905 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:02.905 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:02.906 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:02.906 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:02.906 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:02.906 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:02.907 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.907 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:02.907 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:02.907 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:02.907 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:02.908 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:02.908 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:02.908 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:02.908 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:02.909 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:02.909 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:02.909 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:02.909 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:02.909 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:02.910 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:02.910 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:10:02.910 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.910 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.911 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.911 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:02.911 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:02.911 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.911 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:02.912 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:02.912 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.912 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:02.912 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:02.913 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:02.913 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:02.913 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:02.913 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:02.913 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:02.914 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:02.914 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:02.914 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:02.914 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.915 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.915 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.915 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:02.915 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.915 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.916 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.916 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.916 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:02.916 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.916 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.917 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.917 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.917 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:02.917 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.918 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.918 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.918 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:02.918 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.918 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.919 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.919 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.919 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:02.919 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.920 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.920 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.920 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.920 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:02.920 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.921 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.921 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.921 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:02.921 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.921 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.922 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.922 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.922 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:02.922 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.923 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.923 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.923 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.923 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:02.923 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.924 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.924 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.924 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:02.924 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.925 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.925 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.925 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.925 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:02.925 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:02.926 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.926 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.926 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.926 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:02.927 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:02.927 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:02.927 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:02.927 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:02.927 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:02.928 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:02.928 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.928 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.928 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.929 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:02.929 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:02.929 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.929 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:02.930 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:02.930 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:02.930 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:02.930 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:02.931 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:02.931 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 75, 2021-10-21T00:10:02.931 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:02.931 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:02.931 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:02.932 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.932 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.932 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.932 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:02.932 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.933 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.933 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.933 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.933 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:02.934 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.934 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.934 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.934 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.934 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:02.935 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.935 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.935 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.936 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:02.936 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.936 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.936 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.936 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.937 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:02.937 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.937 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.937 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.938 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.938 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:02.938 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.938 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.938 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.939 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:02.939 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.939 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.939 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.940 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.940 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:02.940 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.940 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.941 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.941 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.941 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:02.941 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.941 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.942 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.942 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:02.942 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.942 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.943 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.943 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.943 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:02.943 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:02.943 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.944 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.944 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.944 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:02.944 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:02.944 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:02.945 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:02.945 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:02.945 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:02.945 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:02.946 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.946 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.946 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.946 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:02.946 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:02.947 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.947 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:02.947 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:02.947 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:02.948 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:02.948 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:02.948 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:02.948 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:02.948 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:02.949 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:02.949 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:02.949 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.949 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.949 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.950 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:02.950 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.950 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.950 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.951 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.951 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:02.951 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.951 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.951 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.952 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.952 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:02.952 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.952 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.953 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.953 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:02.953 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.953 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.953 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.954 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.954 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:02.954 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.954 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.955 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.955 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.955 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:02.955 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.955 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.956 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.956 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:02.956 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.956 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.957 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.957 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.957 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:02.958 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.958 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.958 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.958 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.958 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:02.959 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.959 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.959 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.959 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:02.960 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.960 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.960 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.960 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.961 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:02.961 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:02.961 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.961 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.961 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.962 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:02.962 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:02.962 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:02.962 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:02.963 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:02.963 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:02.963 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:02.963 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.963 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.964 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.964 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:02.964 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:02.964 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.965 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:02.965 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:02.965 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:02.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:02.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:02.966 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:02.966 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:02.966 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:02.966 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:02.967 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:02.967 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.967 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.967 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.967 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:02.968 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.968 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.968 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.968 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.968 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:02.969 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.969 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.969 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.969 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.970 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:02.970 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.971 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.971 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.971 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:02.971 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.972 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.972 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.972 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.972 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:02.973 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.973 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.973 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.973 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.973 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:02.974 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.974 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.974 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.974 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:02.975 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.975 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.975 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.975 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.975 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:02.976 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.976 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.976 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.976 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.976 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:02.977 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.977 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.977 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.977 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:02.978 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.978 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.978 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.978 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.978 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:02.979 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:02.979 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.979 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.979 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.979 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:02.980 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:02.980 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:02.980 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:02.980 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:02.981 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:02.981 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:02.981 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.981 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.981 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.982 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:02.982 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:02.982 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.982 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:02.983 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:02.983 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:02.983 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:02.983 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:02.983 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:02.984 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:02.984 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:02.984 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:02.984 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:02.984 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.985 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.985 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.985 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:02.985 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.985 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.986 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.986 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.986 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:02.986 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.987 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.987 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.987 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:02.987 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.988 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.988 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.988 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:02.988 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.989 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.989 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.989 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.989 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:02.989 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.990 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.990 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.990 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.990 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:02.990 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.991 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.991 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.991 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:02.991 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.992 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.992 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.992 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.992 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:02.992 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.993 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.993 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.993 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.993 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:02.993 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:02.994 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.994 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:02.994 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:02.994 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.995 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.995 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.995 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:02.995 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:02.995 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:02.996 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:02.996 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.996 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.996 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:02.996 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:02.997 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:02.997 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:02.997 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:02.998 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:02.998 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:02.998 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:02.998 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:02.998 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:02.999 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:02.999 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:02.999 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:02.999 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:03.000 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:03.000 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:03.000 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:03.000 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:03.000 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:03.001 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:03.001 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:03.001 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:03.001 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:03.001 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.002 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.002 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.002 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:03.002 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.003 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.003 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.003 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.003 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:03.003 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.004 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.004 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.004 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.004 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:03.004 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.005 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.005 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.006 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:03.006 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.006 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.006 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.006 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.007 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:03.007 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.008 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.008 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.009 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.009 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:03.009 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.009 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.009 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.010 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:03.010 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.010 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.010 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.011 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.011 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:03.011 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.011 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.011 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.012 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.012 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:03.012 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.012 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.013 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.013 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:03.013 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.013 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.013 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.014 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.014 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:03.014 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:03.014 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.014 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.015 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.015 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:03.015 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:03.015 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:03.016 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:03.016 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:03.016 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:03.016 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:03.016 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.017 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.017 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.017 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:03.017 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:03.017 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:03.018 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:03.018 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:03.018 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:03.018 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:03.019 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:03.019 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:03.019 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:03.019 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:03.019 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:03.020 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:03.020 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.020 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.020 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.020 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:03.021 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.021 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.021 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.021 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.022 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:03.022 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.022 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.022 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.022 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.023 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:03.023 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.023 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.023 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.023 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:03.024 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.024 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.024 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.024 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.025 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:03.025 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.025 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.025 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.025 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.026 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:03.026 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.026 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.026 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.026 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:03.027 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.027 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.027 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.027 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.028 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:03.028 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.028 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.028 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.028 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.029 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:03.029 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.029 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.029 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.029 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:03.030 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.030 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.030 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.030 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.031 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:03.031 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:03.031 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.031 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.031 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.032 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:03.032 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:03.032 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:03.032 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:03.032 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:03.033 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:03.033 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:03.033 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.033 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.034 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.034 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:03.034 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:03.034 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:03.034 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:03.035 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:03.035 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:03.035 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:03.035 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:03.035 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:03.036 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:10:03.036 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:03.036 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:03.036 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:03.037 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.037 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.037 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.037 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:03.037 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.038 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.038 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.038 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.038 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:03.038 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.039 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.039 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.039 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.039 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:03.040 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.040 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.040 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.040 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:03.040 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.041 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.041 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.041 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.041 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:03.042 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.042 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.042 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.042 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.042 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:03.043 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.043 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.043 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.043 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:03.043 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.044 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.044 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.044 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.044 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:03.045 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.045 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.045 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.045 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.045 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:03.046 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:03.046 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.046 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:03.046 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:03.046 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.047 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.047 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.047 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:03.047 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:03.048 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:03.048 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.048 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.048 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.048 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:03.049 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:03.049 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:03.049 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:03.049 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:03.049 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:03.050 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:03.050 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:03.050 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.050 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:03.051 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:03.051 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.051 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:03.051 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.051 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.052 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.052 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.052 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.052 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:03.052 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.053 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.053 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.053 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:03.053 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.053 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.054 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.054 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.054 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.054 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:03.055 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.055 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.055 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.055 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:03.055 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.056 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.056 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.056 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.056 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.056 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:03.057 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.057 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.057 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.057 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:03.058 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.058 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.058 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.058 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.058 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.059 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:03.059 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.059 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.059 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.059 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:03.060 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.060 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.060 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.060 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.061 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.061 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:03.061 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.061 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.061 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.062 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:03.062 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.062 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.062 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.062 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.063 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.063 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:03.063 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.063 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.064 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.064 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:03.064 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.064 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.064 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.065 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.065 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.065 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:03.065 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.065 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.066 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:03.066 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:03.066 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:03.066 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:03.067 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:03.067 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:03.067 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:03.067 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:03.067 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:03.068 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.068 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:03.068 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:03.068 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:03.068 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:03.069 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:03.069 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:10:03.069 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:03.069 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:03.070 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:03.070 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:03.070 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:03.070 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:03.070 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:03.071 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:03.071 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:03.071 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:03.071 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:03.071 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:03.072 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:03.072 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:03.072 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:03.072 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:03.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 msgr2=0x7ff63c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 0x7ff63c055ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7ff640003000 tx=0x7ff640007a50).stop 2021-10-21T00:10:03.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 msgr2=0x7ff658145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7ff65000b000 tx=0x7ff650008040).stop 2021-10-21T00:10:03.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 shutdown_connections 2021-10-21T00:10:03.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff63c053610 0x7ff63c055ad0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff65814afa0 0x7ff658145320 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff65814b9c0 0x7ff658144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 --2- 172.21.15.41:0/1770625352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff638004500 0x7ff65814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 >> 172.21.15.41:0/1770625352 conn(0x7ff6580637b0 msgr2=0x7ff6580b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:03.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 shutdown_connections 2021-10-21T00:10:03.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:02.828+0000 7ff65cc70700 1 -- 172.21.15.41:0/1770625352 wait complete. 2021-10-21T00:10:03.077 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:03.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 Processor -- start 2021-10-21T00:10:03.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 -- start start 2021-10-21T00:10:03.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a580ac640 0x7f4a580b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580acae0 con 0x7f4a5805f850 2021-10-21T00:10:03.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580acd80 con 0x7f4a580b25d0 2021-10-21T00:10:03.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580ad020 con 0x7f4a580ac640 2021-10-21T00:10:03.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a56ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a580ac640 0x7f4a580b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a577fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4a5805f850 0x7f4a580b19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60812/0 (socket says 172.21.15.41:60812) 2021-10-21T00:10:03.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a577fe700 1 -- 172.21.15.41:0/3369447118 learned_addr learned my addr 172.21.15.41:0/3369447118 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:03.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a56ffd700 1 -- 172.21.15.41:0/3369447118 >> v1:172.21.15.62:6789/0 conn(0x7f4a580b25d0 legacy=0x7f4a58147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a56ffd700 1 -- 172.21.15.41:0/3369447118 >> v1:172.21.15.41:6789/0 conn(0x7f4a5805f850 legacy=0x7f4a580b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a56ffd700 1 -- 172.21.15.41:0/3369447118 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5805fc30 con 0x7f4a580ac640 2021-10-21T00:10:03.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a56ffd700 1 --2- 172.21.15.41:0/3369447118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580b20e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f4a48002f70 tx=0x7f4a48006df0).ready entity=mon.0 client_cookie=3cb7151e3cbb77e5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a567fc700 1 -- 172.21.15.41:0/3369447118 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4800d610 con 0x7f4a580ac640 2021-10-21T00:10:03.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a567fc700 1 -- 172.21.15.41:0/3369447118 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48000e90 con 0x7f4a580ac640 2021-10-21T00:10:03.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a567fc700 1 -- 172.21.15.41:0/3369447118 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4800d960 con 0x7f4a580ac640 2021-10-21T00:10:03.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.184+0000 7f4a5dea6700 1 -- 172.21.15.41:0/3369447118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 msgr2=0x7f4a580b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/3369447118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580b20e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f4a48002f70 tx=0x7f4a48006df0).stop 2021-10-21T00:10:03.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- 172.21.15.41:0/3369447118 shutdown_connections 2021-10-21T00:10:03.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/3369447118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580b20e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- 172.21.15.41:0/3369447118 >> 172.21.15.41:0/3369447118 conn(0x7f4a580b7030 msgr2=0x7f4a580b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:03.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- 172.21.15.41:0/3369447118 shutdown_connections 2021-10-21T00:10:03.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- 172.21.15.41:0/3369447118 wait complete. 2021-10-21T00:10:03.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 Processor -- start 2021-10-21T00:10:03.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- start start 2021-10-21T00:10:03.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5805f850 0x7f4a5809c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a580b25d0 0x7f4a580b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5809be20 con 0x7f4a580ac640 2021-10-21T00:10:03.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58065f60 con 0x7f4a580b25d0 2021-10-21T00:10:03.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a5dea6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5809c050 con 0x7f4a5805f850 2021-10-21T00:10:03.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34818/0 (socket says 172.21.15.41:34818) 2021-10-21T00:10:03.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 -- 172.21.15.41:0/2037318117 learned_addr learned my addr 172.21.15.41:0/2037318117 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:03.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a577fe700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5805f850 0x7f4a5809c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a57fff700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a580b25d0 0x7f4a580b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 -- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5805f850 msgr2=0x7f4a5809c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5805f850 0x7f4a5809c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 -- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a580b25d0 msgr2=0x7f4a580b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a580b25d0 0x7f4a580b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.188+0000 7f4a56ffd700 1 -- 172.21.15.41:0/2037318117 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4800b180 con 0x7f4a580ac640 2021-10-21T00:10:03.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a56ffd700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4a48002f70 tx=0x7f4a48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4800de90 con 0x7f4a580ac640 2021-10-21T00:10:03.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48006a60 con 0x7f4a580ac640 2021-10-21T00:10:03.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a58147dd0 con 0x7f4a580ac640 2021-10-21T00:10:03.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a48011d70 con 0x7f4a580ac640 2021-10-21T00:10:03.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a58065b60 con 0x7f4a580ac640 2021-10-21T00:10:03.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a48025030 con 0x7f4a580ac640 2021-10-21T00:10:03.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58057350 con 0x7f4a580ac640 2021-10-21T00:10:03.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 0x7f4a3c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.192+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a4806cd10 con 0x7f4a580ac640 2021-10-21T00:10:03.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.196+0000 7f4a577fe700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 0x7f4a3c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.196+0000 7f4a577fe700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 0x7f4a3c055b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f4a4000d000 tx=0x7f4a40007be0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.200+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a48072020 con 0x7f4a580ac640 2021-10-21T00:10:03.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.364+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a580686c0 con 0x7f4a580ac640 2021-10-21T00:10:03.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a54ff9700 1 -- 172.21.15.41:0/2037318117 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f4a48023090 con 0x7f4a580ac640 2021-10-21T00:10:03.601 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:03.601 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:09:54.586575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6663},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6663":{"gid":6663,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1888649335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1888649335},{"type":"v1","addr":"172.21.15.62:6835","nonce":1888649335}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:10:03.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 msgr2=0x7f4a3c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 0x7f4a3c055b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f4a4000d000 tx=0x7f4a40007be0).stop 2021-10-21T00:10:03.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 msgr2=0x7f4a580ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4a48002f70 tx=0x7f4a48015000).stop 2021-10-21T00:10:03.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 shutdown_connections 2021-10-21T00:10:03.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536a0 0x7f4a3c055b60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a580b25d0 0x7f4a580b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a580ac640 0x7f4a580ae7b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 --2- 172.21.15.41:0/2037318117 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5805f850 0x7f4a5809c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 >> 172.21.15.41:0/2037318117 conn(0x7f4a580b7030 msgr2=0x7f4a58149e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:03.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 shutdown_connections 2021-10-21T00:10:03.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.368+0000 7f4a5dea6700 1 -- 172.21.15.41:0/2037318117 wait complete. 2021-10-21T00:10:03.606 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 39 2021-10-21T00:10:03.606 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:10:03.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 Processor -- start 2021-10-21T00:10:03.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 -- start start 2021-10-21T00:10:03.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb9c005f850 0x7fb9c00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00ac640 0x7fb9c00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c00acae0 con 0x7fb9c00b2bf0 2021-10-21T00:10:03.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c00acd80 con 0x7fb9c005f850 2021-10-21T00:10:03.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9c5fd4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00ad020 con 0x7fb9c00ac640 2021-10-21T00:10:03.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb9c005f850 0x7fb9c00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb9c005f850 0x7fb9c00b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34824/0 (socket says 172.21.15.41:34824) 2021-10-21T00:10:03.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb9c00b2bf0 0x7fb9c0146680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60830/0 (socket says 172.21.15.41:60830) 2021-10-21T00:10:03.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/2196098406 learned_addr learned my addr 172.21.15.41:0/2196098406 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:03.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9beffd700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00ac640 0x7fb9c00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/2196098406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00ac640 msgr2=0x7fb9c00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:03.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00ac640 0x7fb9c00b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/2196098406 >> v1:172.21.15.41:6789/0 conn(0x7fb9c00b2bf0 legacy=0x7fb9c0146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/2196098406 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c005fc30 con 0x7fb9c005f850 2021-10-21T00:10:03.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.716+0000 7fb9be7fc700 1 -- 172.21.15.41:0/2196098406 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282136341 0 0) 0x7fb9c00acae0 con 0x7fb9c00b2bf0 2021-10-21T00:10:03.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9bf7fe700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c00b19d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fb9b0002f70 tx=0x7fb9b0006eb0).ready entity=mon.0 client_cookie=a8e8a2d1de934127 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9be7fc700 1 -- 172.21.15.41:0/2196098406 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b000d570 con 0x7fb9c005f850 2021-10-21T00:10:03.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9be7fc700 1 -- 172.21.15.41:0/2196098406 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0000e90 con 0x7fb9c005f850 2021-10-21T00:10:03.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9be7fc700 1 -- 172.21.15.41:0/2196098406 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b000d8c0 con 0x7fb9c005f850 2021-10-21T00:10:03.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/2196098406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 msgr2=0x7fb9c00b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c00b19d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fb9b0002f70 tx=0x7fb9b0006eb0).stop 2021-10-21T00:10:03.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/2196098406 shutdown_connections 2021-10-21T00:10:03.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00ac640 0x7fb9c00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/2196098406 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c00b19d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/2196098406 >> 172.21.15.41:0/2196098406 conn(0x7fb9c00b7030 msgr2=0x7fb9c00b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:03.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/2196098406 shutdown_connections 2021-10-21T00:10:03.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/2196098406 wait complete. 2021-10-21T00:10:03.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.720+0000 7fb9c5fd4700 1 Processor -- start 2021-10-21T00:10:03.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- start start 2021-10-21T00:10:03.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c00ac640 0x7fb9c009bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 0x7fb9c0066c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00b1290 con 0x7fb9c005f850 2021-10-21T00:10:03.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0099a80 con 0x7fb9c00ac640 2021-10-21T00:10:03.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00b14c0 con 0x7fb9c00b2bf0 2021-10-21T00:10:03.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34830/0 (socket says 172.21.15.41:34830) 2021-10-21T00:10:03.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/796314699 learned_addr learned my addr 172.21.15.41:0/796314699 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:03.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bffff700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 0x7fb9c0066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9beffd700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c00ac640 0x7fb9c009bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 msgr2=0x7fb9c0066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 0x7fb9c0066c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c00ac640 msgr2=0x7fb9c009bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:03.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c00ac640 0x7fb9c009bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:03.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 -- 172.21.15.41:0/796314699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b000b1e0 con 0x7fb9c005f850 2021-10-21T00:10:03.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bffff700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 0x7fb9c0066c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:03.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bf7fe700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fb9b0002f70 tx=0x7fb9b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b00117e0 con 0x7fb9c005f850 2021-10-21T00:10:03.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0011940 con 0x7fb9c005f850 2021-10-21T00:10:03.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c009c1e0 con 0x7fb9c005f850 2021-10-21T00:10:03.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9b0011ca0 con 0x7fb9c005f850 2021-10-21T00:10:03.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0067180 con 0x7fb9c005f850 2021-10-21T00:10:03.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.724+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c00b1680 con 0x7fb9c005f850 2021-10-21T00:10:03.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.728+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9b0025030 con 0x7fb9c005f850 2021-10-21T00:10:03.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.728+0000 7fb9bcff9700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 0x7fb9a0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:03.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.728+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9b006cb50 con 0x7fb9c005f850 2021-10-21T00:10:03.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.728+0000 7fb9beffd700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 0x7fb9a0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:03.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.728+0000 7fb9beffd700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 0x7fb9a0055a40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb9b400b000 tx=0x7fb9b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:03.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.732+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9b0043c10 con 0x7fb9c005f850 2021-10-21T00:10:03.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:03.896+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb9c0057350 con 0x7fb9c005f850 2021-10-21T00:10:04.378 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:10:04.368+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:10:04.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.380+0000 7fb9bcff9700 1 -- 172.21.15.41:0/796314699 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb9b0023020 con 0x7fb9c005f850 2021-10-21T00:10:04.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 msgr2=0x7fb9a0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 0x7fb9a0055a40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb9b400b000 tx=0x7fb9b4008040).stop 2021-10-21T00:10:04.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 msgr2=0x7fb9c0099590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fb9b0002f70 tx=0x7fb9b0015000).stop 2021-10-21T00:10:04.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 shutdown_connections 2021-10-21T00:10:04.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb9a0053580 0x7fb9a0055a40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9c00b2bf0 0x7fb9c0066c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9c00ac640 0x7fb9c009bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 --2- 172.21.15.41:0/796314699 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb9c005f850 0x7fb9c0099590 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.384+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 >> 172.21.15.41:0/796314699 conn(0x7fb9c00b7030 msgr2=0x7fb9c00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:04.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.388+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 shutdown_connections 2021-10-21T00:10:04.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.388+0000 7fb9c5fd4700 1 -- 172.21.15.41:0/796314699 wait complete. 2021-10-21T00:10:04.399 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:10:04.411 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:04.417 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:10:04.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 Processor -- start 2021-10-21T00:10:04.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 -- start start 2021-10-21T00:10:04.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06400b3bc0 0x7f0640143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06401418f0 0x7f0640141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0640142bc0 con 0x7f06400b9c70 2021-10-21T00:10:04.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06401429a0 con 0x7f06400b3bc0 2021-10-21T00:10:04.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f0644ceb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06400ba050 con 0x7f06401418f0 2021-10-21T00:10:04.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06400b3bc0 0x7f0640143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06400b3bc0 0x7f0640143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34838/0 (socket says 172.21.15.41:34838) 2021-10-21T00:10:04.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 -- 172.21.15.41:0/815333937 learned_addr learned my addr 172.21.15.41:0/815333937 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:04.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063ed9d700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06401418f0 0x7f0640141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 -- 172.21.15.41:0/815333937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06401418f0 msgr2=0x7f0640141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:04.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06401418f0 0x7f0640141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 -- 172.21.15.41:0/815333937 >> v1:172.21.15.62:6789/0 conn(0x7f06400b9c70 legacy=0x7f0640143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 -- 172.21.15.41:0/815333937 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06401463c0 con 0x7f06400b3bc0 2021-10-21T00:10:04.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063dd9b700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06400b3bc0 0x7f0640143730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f0630002f70 tx=0x7f0630006eb0).ready entity=mon.0 client_cookie=3067b92b11bd3c61 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063d59a700 1 -- 172.21.15.41:0/815333937 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063000d5c0 con 0x7f06400b3bc0 2021-10-21T00:10:04.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063d59a700 1 -- 172.21.15.41:0/815333937 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630000e90 con 0x7f06400b3bc0 2021-10-21T00:10:04.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.512+0000 7f063d59a700 1 -- 172.21.15.41:0/815333937 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063000d950 con 0x7f06400b3bc0 2021-10-21T00:10:04.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- 172.21.15.41:0/815333937 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06400b3bc0 msgr2=0x7f0640143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06400b3bc0 0x7f0640143730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f0630002f70 tx=0x7f0630006eb0).stop 2021-10-21T00:10:04.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- 172.21.15.41:0/815333937 shutdown_connections 2021-10-21T00:10:04.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06401418f0 0x7f0640141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 --2- 172.21.15.41:0/815333937 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06400b3bc0 0x7f0640143730 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- 172.21.15.41:0/815333937 >> 172.21.15.41:0/815333937 conn(0x7f0640062e80 msgr2=0x7f06400b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:04.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- 172.21.15.41:0/815333937 shutdown_connections 2021-10-21T00:10:04.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- 172.21.15.41:0/815333937 wait complete. 2021-10-21T00:10:04.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 Processor -- start 2021-10-21T00:10:04.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.516+0000 7f0644ceb700 1 -- start start 2021-10-21T00:10:04.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 0x7f0640145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 0x7f064013f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640144c30 con 0x7f06401418f0 2021-10-21T00:10:04.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640145ea0 con 0x7f06400b3bc0 2021-10-21T00:10:04.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0640144990 con 0x7f06400b9c70 2021-10-21T00:10:04.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34848/0 (socket says 172.21.15.41:34848) 2021-10-21T00:10:04.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 -- 172.21.15.41:0/3548113885 learned_addr learned my addr 172.21.15.41:0/3548113885 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:04.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063dd9b700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 0x7f064013f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063e59c700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 0x7f0640145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 -- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 msgr2=0x7f064013f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 0x7f064013f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 -- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 msgr2=0x7f0640145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 0x7f0640145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 -- 172.21.15.41:0/3548113885 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063000b1e0 con 0x7f06401418f0 2021-10-21T00:10:04.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063dd9b700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 0x7f064013f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:04.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063e59c700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 0x7f0640145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:04.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f063ed9d700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f063800a000 tx=0x7f0638008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06380127e0 con 0x7f06401418f0 2021-10-21T00:10:04.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638012940 con 0x7f06401418f0 2021-10-21T00:10:04.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0640140340 con 0x7f06401418f0 2021-10-21T00:10:04.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0638012ca0 con 0x7f06401418f0 2021-10-21T00:10:04.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06400b8990 con 0x7f06401418f0 2021-10-21T00:10:04.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.520+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400ad7e0 con 0x7f06401418f0 2021-10-21T00:10:04.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.524+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0638013480 con 0x7f06401418f0 2021-10-21T00:10:04.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.524+0000 7f062f7fe700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 0x7f061c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.524+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f063806c220 con 0x7f06401418f0 2021-10-21T00:10:04.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.524+0000 7f063e59c700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 0x7f061c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.524+0000 7f063e59c700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 0x7f061c055a70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f063400b000 tx=0x7f0634009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.532+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06380431c0 con 0x7f06401418f0 2021-10-21T00:10:04.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0640146120 con 0x7f06401418f0 2021-10-21T00:10:04.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f062f7fe700 1 -- 172.21.15.41:0/3548113885 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f0638012e00 con 0x7f06401418f0 2021-10-21T00:10:04.707 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:04.708 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:09:53.582620+0000","modified":"2021-10-21T00:10:04.374698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-10-21T00:10:04.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 msgr2=0x7f061c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 0x7f061c055a70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f063400b000 tx=0x7f0634009040).stop 2021-10-21T00:10:04.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 msgr2=0x7f064013d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f063800a000 tx=0x7f0638008040).stop 2021-10-21T00:10:04.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 shutdown_connections 2021-10-21T00:10:04.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f061c0535b0 0x7f061c055a70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06401418f0 0x7f064013d6c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06400b9c70 0x7f064013f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 --2- 172.21.15.41:0/3548113885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06400b3bc0 0x7f0640145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 >> 172.21.15.41:0/3548113885 conn(0x7f0640062e80 msgr2=0x7f0640140e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:04.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 shutdown_connections 2021-10-21T00:10:04.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.700+0000 7f0644ceb700 1 -- 172.21.15.41:0/3548113885 wait complete. 2021-10-21T00:10:04.712 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 40 2021-10-21T00:10:04.721 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:10:04.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.820+0000 7fdb00f2b700 1 Processor -- start 2021-10-21T00:10:04.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.820+0000 7fdb00f2b700 1 -- start start 2021-10-21T00:10:04.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdafc14b620 0x7fdafc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc142bc0 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0ba050 con 0x7fdafc0b9c70 2021-10-21T00:10:04.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc1429a0 con 0x7fdafc14b620 2021-10-21T00:10:04.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf9d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdafc0b3bc0 0x7fdafc143730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60856/0 (socket says 172.21.15.41:60856) 2021-10-21T00:10:04.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf9d9b700 1 -- 172.21.15.41:0/2576471503 learned_addr learned my addr 172.21.15.41:0/2576471503 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:04.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafad9d700 1 --2- 172.21.15.41:0/2576471503 >> v2:172.21.15.62:3300/0 conn(0x7fdafc14b620 0x7fdafc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314404432 0 0) 0x7fdafc142bc0 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdadc003260 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707131018 0 0) 0x7fdadc003260 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 >> v2:172.21.15.62:3300/0 conn(0x7fdafc14b620 msgr2=0x7fdafc14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:04.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 --2- 172.21.15.41:0/2576471503 >> v2:172.21.15.62:3300/0 conn(0x7fdafc14b620 0x7fdafc14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 >> v1:172.21.15.62:6789/0 conn(0x7fdafc0b9c70 legacy=0x7fdafc143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc1463c0 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fdae4001680 con 0x7fdafc0b3bc0 2021-10-21T00:10:04.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 >> v1:172.21.15.41:6789/0 conn(0x7fdafc0b3bc0 legacy=0x7fdafc143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 0x7fdadc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdadc004500 0x7fdadc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc004e70 0x7fdadc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc1429a0 con 0x7fdadc003750 2021-10-21T00:10:04.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00bdd0 con 0x7fdadc004500 2021-10-21T00:10:04.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00bf60 con 0x7fdadc004e70 2021-10-21T00:10:04.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 0x7fdadc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf9d9b700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdadc004500 0x7fdadc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafad9d700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc004e70 0x7fdadc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 -- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc004e70 msgr2=0x7fdadc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:04.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc004e70 0x7fdadc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 -- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdadc004500 msgr2=0x7fdadc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:04.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdadc004500 0x7fdadc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 -- 172.21.15.41:0/2576471503 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc003260 con 0x7fdadc003750 2021-10-21T00:10:04.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafad9d700 1 -- 172.21.15.41:0/2576471503 reap_dead start 2021-10-21T00:10:04.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdafa59c700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 0x7fdadc003b70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fdafc063290 tx=0x7fdaec007a00).ready entity=mon.0 client_cookie=1dc18e6aa5d44c1b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec007d10 con 0x7fdadc003750 2021-10-21T00:10:04.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec007030 con 0x7fdadc003750 2021-10-21T00:10:04.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdaf959a700 1 -- 172.21.15.41:0/2576471503 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec007390 con 0x7fdadc003750 2021-10-21T00:10:04.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 msgr2=0x7fdadc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 0x7fdadc003b70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fdafc063290 tx=0x7fdaec007a00).stop 2021-10-21T00:10:04.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- 172.21.15.41:0/2576471503 shutdown_connections 2021-10-21T00:10:04.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/2576471503 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdadc003750 0x7fdadc003b70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- 172.21.15.41:0/2576471503 >> 172.21.15.41:0/2576471503 conn(0x7fdafc062e80 msgr2=0x7fdafc0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:04.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- 172.21.15.41:0/2576471503 shutdown_connections 2021-10-21T00:10:04.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.824+0000 7fdb00f2b700 1 -- 172.21.15.41:0/2576471503 wait complete. 2021-10-21T00:10:04.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 Processor -- start 2021-10-21T00:10:04.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- start start 2021-10-21T00:10:04.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc003750 0x7fdafc0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdafc0b8d80 0x7fdafc1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b9210 con 0x7fdafc0ac890 2021-10-21T00:10:04.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b7a80 con 0x7fdafc0b8d80 2021-10-21T00:10:04.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b7d20 con 0x7fdadc003750 2021-10-21T00:10:04.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34868/0 (socket says 172.21.15.41:34868) 2021-10-21T00:10:04.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 -- 172.21.15.41:0/1844591791 learned_addr learned my addr 172.21.15.41:0/1844591791 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:04.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdaf9d9b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdafc0b8d80 0x7fdafc1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafa59c700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc003750 0x7fdafc0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 -- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc003750 msgr2=0x7fdafc0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc003750 0x7fdafc0af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 -- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdafc0b8d80 msgr2=0x7fdafc1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:04.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdafc0b8d80 0x7fdafc1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:04.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 -- 172.21.15.41:0/1844591791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc152ea0 con 0x7fdafc0ac890 2021-10-21T00:10:04.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdafad9d700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fdaf400b000 tx=0x7fdaf40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf4019070 con 0x7fdafc0ac890 2021-10-21T00:10:04.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400f910 con 0x7fdafc0ac890 2021-10-21T00:10:04.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc0acf60 con 0x7fdafc0ac890 2021-10-21T00:10:04.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf400fc70 con 0x7fdafc0ac890 2021-10-21T00:10:04.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.828+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc0ae110 con 0x7fdafc0ac890 2021-10-21T00:10:04.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc146120 con 0x7fdafc0ac890 2021-10-21T00:10:04.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdaf4014440 con 0x7fdafc0ac890 2021-10-21T00:10:04.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdaf37fe700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 0x7fdae0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:04.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdaf406c2a0 con 0x7fdafc0ac890 2021-10-21T00:10:04.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdafa59c700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 0x7fdae0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:04.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.832+0000 7fdafa59c700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 0x7fdae0055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fdaec019000 tx=0x7fdaec015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:04.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.836+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdaf4043350 con 0x7fdafc0ac890 2021-10-21T00:10:05.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:04.996+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdafc057350 con 0x7fdafc0ac890 2021-10-21T00:10:05.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.392+0000 7fdaf37fe700 1 -- 172.21.15.41:0/1844591791 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdaf4046970 con 0x7fdafc0ac890 2021-10-21T00:10:05.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 msgr2=0x7fdae0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 0x7fdae0055ad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fdaec019000 tx=0x7fdaec015000).stop 2021-10-21T00:10:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 msgr2=0x7fdafc1529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fdaf400b000 tx=0x7fdaf40091d0).stop 2021-10-21T00:10:05.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 shutdown_connections 2021-10-21T00:10:05.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdae0053610 0x7fdae0055ad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdafc0ac890 0x7fdafc1529b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdafc0b8d80 0x7fdafc1524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 --2- 172.21.15.41:0/1844591791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdadc003750 0x7fdafc0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 >> 172.21.15.41:0/1844591791 conn(0x7fdafc062e80 msgr2=0x7fdafc13b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:05.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 shutdown_connections 2021-10-21T00:10:05.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.396+0000 7fdb00f2b700 1 -- 172.21.15.41:0/1844591791 wait complete. 2021-10-21T00:10:05.421 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:10:05.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.532+0000 7f48e5a95700 1 Processor -- start 2021-10-21T00:10:05.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.532+0000 7f48e5a95700 1 -- start start 2021-10-21T00:10:05.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e00b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:05.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0142ad0 con 0x7f48e0062330 2021-10-21T00:10:05.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0145f90 con 0x7f48e013cc20 2021-10-21T00:10:05.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00b3520 con 0x7f48e0143610 2021-10-21T00:10:05.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e4a93700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f48e0062330 0x7f48e013c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60876/0 (socket says 172.21.15.41:60876) 2021-10-21T00:10:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e4a93700 1 -- 172.21.15.41:0/3973327330 learned_addr learned my addr 172.21.15.41:0/3973327330 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5294700 1 --2- 172.21.15.41:0/3973327330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e00b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326738470 0 0) 0x7f48e0142ad0 con 0x7f48e0062330 2021-10-21T00:10:05.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c4003260 con 0x7f48e0062330 2021-10-21T00:10:05.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279493620 0 0) 0x7f48e0145f90 con 0x7f48e013cc20 2021-10-21T00:10:05.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e0142ad0 con 0x7f48e013cc20 2021-10-21T00:10:05.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5294700 1 -- 172.21.15.41:0/3973327330 >> v1:172.21.15.62:6789/0 conn(0x7f48e013cc20 legacy=0x7f48e0142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5294700 1 -- 172.21.15.41:0/3973327330 >> v1:172.21.15.41:6789/0 conn(0x7f48e0062330 legacy=0x7f48e013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5294700 1 -- 172.21.15.41:0/3973327330 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0146230 con 0x7f48e0143610 2021-10-21T00:10:05.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5294700 1 --2- 172.21.15.41:0/3973327330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e00b4140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f48d80032f0 tx=0x7f48d80091d0).ready entity=mon.2 client_cookie=f3f4404201802573 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:05.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800b640 con 0x7f48e0143610 2021-10-21T00:10:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800b7a0 con 0x7f48e0143610 2021-10-21T00:10:05.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48df7fe700 1 -- 172.21.15.41:0/3973327330 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800b910 con 0x7f48e0143610 2021-10-21T00:10:05.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- 172.21.15.41:0/3973327330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 msgr2=0x7f48e00b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 --2- 172.21.15.41:0/3973327330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e00b4140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f48d80032f0 tx=0x7f48d80091d0).stop 2021-10-21T00:10:05.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- 172.21.15.41:0/3973327330 shutdown_connections 2021-10-21T00:10:05.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 --2- 172.21.15.41:0/3973327330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e00b4140 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- 172.21.15.41:0/3973327330 >> 172.21.15.41:0/3973327330 conn(0x7f48e00b9080 msgr2=0x7f48e00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:05.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- 172.21.15.41:0/3973327330 shutdown_connections 2021-10-21T00:10:05.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.536+0000 7f48e5a95700 1 -- 172.21.15.41:0/3973327330 wait complete. 2021-10-21T00:10:05.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.540+0000 7f48e5a95700 1 Processor -- start 2021-10-21T00:10:05.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.540+0000 7f48e5a95700 1 -- start start 2021-10-21T00:10:05.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48e0062330 0x7f48e0144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:05.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e0141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:05.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:05.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0142080 con 0x7f48e0151b80 2021-10-21T00:10:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0152520 con 0x7f48e0062330 2021-10-21T00:10:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0155ce0 con 0x7f48e0143610 2021-10-21T00:10:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:05.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34882/0 (socket says 172.21.15.41:34882) 2021-10-21T00:10:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 -- 172.21.15.41:0/2226728546 learned_addr learned my addr 172.21.15.41:0/2226728546 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:05.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e4a93700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48e0062330 0x7f48e0144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48dffff700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e0141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 -- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 msgr2=0x7f48e0141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e0141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 -- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48e0062330 msgr2=0x7f48e0144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48e0062330 0x7f48e0144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 -- 172.21.15.41:0/2226728546 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8009470 con 0x7f48e0151b80 2021-10-21T00:10:05.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5294700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f48d80032f0 tx=0x7f48d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800b910 con 0x7f48e0151b80 2021-10-21T00:10:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8020400 con 0x7f48e0151b80 2021-10-21T00:10:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0155f80 con 0x7f48e0151b80 2021-10-21T00:10:05.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800b640 con 0x7f48e0151b80 2021-10-21T00:10:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.544+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e0145250 con 0x7f48e0151b80 2021-10-21T00:10:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0063020 con 0x7f48e0151b80 2021-10-21T00:10:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48d8027030 con 0x7f48e0151b80 2021-10-21T00:10:05.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48ddffb700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 0x7f48c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:05.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f48d806c6b0 con 0x7f48e0151b80 2021-10-21T00:10:05.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48e4a93700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 0x7f48c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:05.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.548+0000 7f48e4a93700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 0x7f48c0055ad0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f48d400d000 tx=0x7f48d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:05.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.556+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48d80437c0 con 0x7f48e0151b80 2021-10-21T00:10:05.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:05.688+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48e0057350 con 0x7f48e0151b80 2021-10-21T00:10:06.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.400+0000 7f48ddffb700 1 -- 172.21.15.41:0/2226728546 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 185+0+0 (secure 0 0 0) 0x7f48d80150e0 con 0x7f48e0151b80 2021-10-21T00:10:06.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 msgr2=0x7f48c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 0x7f48c0055ad0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f48d400d000 tx=0x7f48d4009040).stop 2021-10-21T00:10:06.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 msgr2=0x7f48e0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f48d80032f0 tx=0x7f48d8016000).stop 2021-10-21T00:10:06.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 shutdown_connections 2021-10-21T00:10:06.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48c0053610 0x7f48c0055ad0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48e0151b80 0x7f48e0152030 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48e0143610 0x7f48e0141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 --2- 172.21.15.41:0/2226728546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48e0062330 0x7f48e0144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 >> 172.21.15.41:0/2226728546 conn(0x7f48e00b9080 msgr2=0x7f48e00b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:06.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 shutdown_connections 2021-10-21T00:10:06.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.404+0000 7f48e5a95700 1 -- 172.21.15.41:0/2226728546 wait complete. 2021-10-21T00:10:06.415 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:10:06.426 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:10:06.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.532+0000 7fd54bfff700 1 Processor -- start 2021-10-21T00:10:06.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.532+0000 7fd54bfff700 1 -- start start 2021-10-21T00:10:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd54c05fed0 0x7fd54c063070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0b4760 con 0x7fd54c0b1830 2021-10-21T00:10:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c062930 con 0x7fd54c0b4380 2021-10-21T00:10:06.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0b24e0 con 0x7fd54c05fed0 2021-10-21T00:10:06.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54a7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd54c0b1830 0x7fd54c141d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60890/0 (socket says 172.21.15.41:60890) 2021-10-21T00:10:06.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd54c05fed0 0x7fd54c063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:06.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54a7fc700 1 -- 172.21.15.41:0/3419378081 learned_addr learned my addr 172.21.15.41:0/3419378081 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:06.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd549ffb700 1 -- 172.21.15.41:0/3419378081 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536606742 0 0) 0x7fd54c0b4760 con 0x7fd54c0b1830 2021-10-21T00:10:06.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd549ffb700 1 -- 172.21.15.41:0/3419378081 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52c003260 con 0x7fd54c0b1830 2021-10-21T00:10:06.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54b7fe700 1 -- 172.21.15.41:0/3419378081 >> v1:172.21.15.62:6789/0 conn(0x7fd54c0b4380 legacy=0x7fd54c05f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54b7fe700 1 -- 172.21.15.41:0/3419378081 >> v1:172.21.15.41:6789/0 conn(0x7fd54c0b1830 legacy=0x7fd54c141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54b7fe700 1 -- 172.21.15.41:0/3419378081 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c062bd0 con 0x7fd54c05fed0 2021-10-21T00:10:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54b7fe700 1 --2- 172.21.15.41:0/3419378081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c05fed0 0x7fd54c063070 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fd5440032f0 tx=0x7fd5440091d0).ready entity=mon.0 client_cookie=6a46b35c6639e37f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd549ffb700 1 -- 172.21.15.41:0/3419378081 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54400b710 con 0x7fd54c05fed0 2021-10-21T00:10:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd549ffb700 1 -- 172.21.15.41:0/3419378081 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400b870 con 0x7fd54c05fed0 2021-10-21T00:10:06.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd549ffb700 1 -- 172.21.15.41:0/3419378081 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54400b9e0 con 0x7fd54c05fed0 2021-10-21T00:10:06.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- 172.21.15.41:0/3419378081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c05fed0 msgr2=0x7fd54c063070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 --2- 172.21.15.41:0/3419378081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c05fed0 0x7fd54c063070 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fd5440032f0 tx=0x7fd5440091d0).stop 2021-10-21T00:10:06.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- 172.21.15.41:0/3419378081 shutdown_connections 2021-10-21T00:10:06.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 --2- 172.21.15.41:0/3419378081 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c05fed0 0x7fd54c063070 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- 172.21.15.41:0/3419378081 >> 172.21.15.41:0/3419378081 conn(0x7fd54c0b7960 msgr2=0x7fd54c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:06.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- 172.21.15.41:0/3419378081 shutdown_connections 2021-10-21T00:10:06.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.536+0000 7fd54bfff700 1 -- 172.21.15.41:0/3419378081 wait complete. 2021-10-21T00:10:06.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 Processor -- start 2021-10-21T00:10:06.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- start start 2021-10-21T00:10:06.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c05fed0 0x7fd54c147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:06.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd54c0b1830 0x7fd54c09abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:06.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:06.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0af330 con 0x7fd54c0b4380 2021-10-21T00:10:06.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0af090 con 0x7fd54c05fed0 2021-10-21T00:10:06.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1552c0 con 0x7fd54c0b1830 2021-10-21T00:10:06.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:06.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34892/0 (socket says 172.21.15.41:34892) 2021-10-21T00:10:06.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 -- 172.21.15.41:0/46503726 learned_addr learned my addr 172.21.15.41:0/46503726 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:06.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54a7fc700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd54c0b1830 0x7fd54c09abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:06.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54affd700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c05fed0 0x7fd54c147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:06.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 -- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd54c0b1830 msgr2=0x7fd54c09abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd54c0b1830 0x7fd54c09abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 -- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c05fed0 msgr2=0x7fd54c147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:06.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c05fed0 0x7fd54c147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:06.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 -- 172.21.15.41:0/46503726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009470 con 0x7fd54c0b4380 2021-10-21T00:10:06.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54b7fe700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fd5440032f0 tx=0x7fd544016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:06.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54400b710 con 0x7fd54c0b4380 2021-10-21T00:10:06.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544021630 con 0x7fd54c0b4380 2021-10-21T00:10:06.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd544021990 con 0x7fd54c0b4380 2021-10-21T00:10:06.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c099f20 con 0x7fd54c0b4380 2021-10-21T00:10:06.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.540+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0676d0 con 0x7fd54c0b4380 2021-10-21T00:10:06.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c155480 con 0x7fd54c0b4380 2021-10-21T00:10:06.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd544029070 con 0x7fd54c0b4380 2021-10-21T00:10:06.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd543fff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:06.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fd54406c7d0 con 0x7fd54c0b4380 2021-10-21T00:10:06.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd54affd700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:06.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.544+0000 7fd54affd700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 0x7fd5300559b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fd53400d000 tx=0x7fd534007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:06.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.552+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd544043a90 con 0x7fd54c0b4380 2021-10-21T00:10:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:06.676+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd54c0aeec0 con 0x7fd54c0b4380 2021-10-21T00:10:07.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.412+0000 7fd543fff700 1 -- 172.21.15.41:0/46503726 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd5440470b0 con 0x7fd54c0b4380 2021-10-21T00:10:07.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 msgr2=0x7fd5300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 0x7fd5300559b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fd53400d000 tx=0x7fd534007b90).stop 2021-10-21T00:10:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 msgr2=0x7fd54c155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fd5440032f0 tx=0x7fd544016000).stop 2021-10-21T00:10:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 shutdown_connections 2021-10-21T00:10:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5300534f0 0x7fd5300559b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd54c0b4380 0x7fd54c155760 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd54c0b1830 0x7fd54c09abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 --2- 172.21.15.41:0/46503726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c05fed0 0x7fd54c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 >> 172.21.15.41:0/46503726 conn(0x7fd54c0b7960 msgr2=0x7fd54c05f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 shutdown_connections 2021-10-21T00:10:07.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.416+0000 7fd54bfff700 1 -- 172.21.15.41:0/46503726 wait complete. 2021-10-21T00:10:07.427 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:10:07.440 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:10:07.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 Processor -- start 2021-10-21T00:10:07.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 -- start start 2021-10-21T00:10:07.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3fb80b1350 0x7f3fb80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb80aff30 con 0x7f3fb8145e90 2021-10-21T00:10:07.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb80b0f60 con 0x7f3fb80b1b40 2021-10-21T00:10:07.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe804700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80aca60 con 0x7f3fb80b1350 2021-10-21T00:10:07.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3fb80b1350 0x7f3fb80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3fb80b1350 0x7f3fb80b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34900/0 (socket says 172.21.15.41:34900) 2021-10-21T00:10:07.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 -- 172.21.15.41:0/452413960 learned_addr learned my addr 172.21.15.41:0/452413960 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:07.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbe003700 1 --1- 172.21.15.41:0/452413960 >> v1:172.21.15.41:6789/0 conn(0x7f3fb8145e90 0x7f3fb8146320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60904/0 (socket says 172.21.15.41:60904) 2021-10-21T00:10:07.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 -- 172.21.15.41:0/452413960 >> v1:172.21.15.62:6789/0 conn(0x7f3fb80b1b40 legacy=0x7f3fb80b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 -- 172.21.15.41:0/452413960 >> v1:172.21.15.41:6789/0 conn(0x7f3fb8145e90 legacy=0x7f3fb8146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 -- 172.21.15.41:0/452413960 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80b1f20 con 0x7f3fb80b1350 2021-10-21T00:10:07.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbd001700 1 --2- 172.21.15.41:0/452413960 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb80b0a70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3fa8002f70 tx=0x7f3fa8006eb0).ready entity=mon.0 client_cookie=b1e586bfe04ff72b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbc800700 1 -- 172.21.15.41:0/452413960 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800d660 con 0x7f3fb80b1350 2021-10-21T00:10:07.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbc800700 1 -- 172.21.15.41:0/452413960 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8000e90 con 0x7f3fb80b1350 2021-10-21T00:10:07.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.552+0000 7f3fbc800700 1 -- 172.21.15.41:0/452413960 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800d9f0 con 0x7f3fb80b1350 2021-10-21T00:10:07.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- 172.21.15.41:0/452413960 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 msgr2=0x7f3fb80b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 --2- 172.21.15.41:0/452413960 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb80b0a70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f3fa8002f70 tx=0x7f3fa8006eb0).stop 2021-10-21T00:10:07.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- 172.21.15.41:0/452413960 shutdown_connections 2021-10-21T00:10:07.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 --2- 172.21.15.41:0/452413960 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb80b0a70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- 172.21.15.41:0/452413960 >> 172.21.15.41:0/452413960 conn(0x7f3fb80627b0 msgr2=0x7f3fb8062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:07.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- 172.21.15.41:0/452413960 shutdown_connections 2021-10-21T00:10:07.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- 172.21.15.41:0/452413960 wait complete. 2021-10-21T00:10:07.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 Processor -- start 2021-10-21T00:10:07.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.556+0000 7f3fbe804700 1 -- start start 2021-10-21T00:10:07.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fb80b1b40 0x7f3fb814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fb8145e90 0x7f3fb814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb810e7a0 con 0x7f3fb80b1350 2021-10-21T00:10:07.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81107c0 con 0x7f3fb8145e90 2021-10-21T00:10:07.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb810e060 con 0x7f3fb80b1b40 2021-10-21T00:10:07.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34904/0 (socket says 172.21.15.41:34904) 2021-10-21T00:10:07.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 -- 172.21.15.41:0/3437659831 learned_addr learned my addr 172.21.15.41:0/3437659831 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:07.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd001700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fb80b1b40 0x7f3fb814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe003700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fb8145e90 0x7f3fb814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 -- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fb80b1b40 msgr2=0x7f3fb814a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fb80b1b40 0x7f3fb814a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 -- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fb8145e90 msgr2=0x7f3fb814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fb8145e90 0x7f3fb814aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 -- 172.21.15.41:0/3437659831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa800b1e0 con 0x7f3fb80b1350 2021-10-21T00:10:07.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbd802700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f3fb80b2960 tx=0x7f3fb4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb400ce30 con 0x7f3fb80b1350 2021-10-21T00:10:07.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400f470 con 0x7f3fb80b1350 2021-10-21T00:10:07.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb810e300 con 0x7f3fb80b1350 2021-10-21T00:10:07.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb400f7d0 con 0x7f3fb80b1350 2021-10-21T00:10:07.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb814c290 con 0x7f3fb80b1350 2021-10-21T00:10:07.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb814bc20 con 0x7f3fb80b1350 2021-10-21T00:10:07.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3fb4019030 con 0x7f3fb80b1350 2021-10-21T00:10:07.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.560+0000 7f3fa6ffd700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 0x7f3f98055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.564+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3fb406ab10 con 0x7f3fb80b1350 2021-10-21T00:10:07.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.564+0000 7f3fbd001700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 0x7f3f98055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.564+0000 7f3fbd001700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 0x7f3f98055a70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f3fa801a000 tx=0x7f3fa8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.568+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fb814bc20 con 0x7f3fb80b1350 2021-10-21T00:10:07.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.696+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3fb814bc20 con 0x7f3fb80b1350 2021-10-21T00:10:07.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.704+0000 7f3fa6ffd700 1 -- 172.21.15.41:0/3437659831 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3fb814bc20 con 0x7f3fb80b1350 2021-10-21T00:10:07.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 msgr2=0x7f3f98055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 0x7f3f98055a70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f3fa801a000 tx=0x7f3fa8015000).stop 2021-10-21T00:10:07.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 msgr2=0x7f3fb8134840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f3fb80b2960 tx=0x7f3fb4007c50).stop 2021-10-21T00:10:07.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 shutdown_connections 2021-10-21T00:10:07.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f980535b0 0x7f3f98055a70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fb8145e90 0x7f3fb814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fb80b1b40 0x7f3fb814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 --2- 172.21.15.41:0/3437659831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3fb80b1350 0x7f3fb8134840 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 >> 172.21.15.41:0/3437659831 conn(0x7f3fb80627b0 msgr2=0x7f3fb80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:07.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 shutdown_connections 2021-10-21T00:10:07.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.708+0000 7f3fbe804700 1 -- 172.21.15.41:0/3437659831 wait complete. 2021-10-21T00:10:07.731 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-10-21T00:10:07.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 Processor -- start 2021-10-21T00:10:07.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 -- start start 2021-10-21T00:10:07.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc1740af620 0x7fc1740ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc174149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740b0b50 con 0x7fc1740b2170 2021-10-21T00:10:07.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740b2550 con 0x7fc1740af620 2021-10-21T00:10:07.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.824+0000 7fc17359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b0d90 con 0x7fc174067a80 2021-10-21T00:10:07.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc1740b2170 0x7fc1740ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60914/0 (socket says 172.21.15.41:60914) 2021-10-21T00:10:07.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17259c700 1 -- 172.21.15.41:0/593189953 learned_addr learned my addr 172.21.15.41:0/593189953 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:07.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc171d9b700 1 --2- 172.21.15.41:0/593189953 >> v2:172.21.15.41:3300/0 conn(0x7fc1740af620 0x7fc1740ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 --2- 172.21.15.41:0/593189953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc174149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17159a700 1 -- 172.21.15.41:0/593189953 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237248163 0 0) 0x7fc16c001490 con 0x7fc1740b2170 2021-10-21T00:10:07.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17159a700 1 -- 172.21.15.41:0/593189953 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc154003260 con 0x7fc1740b2170 2021-10-21T00:10:07.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 -- 172.21.15.41:0/593189953 >> v2:172.21.15.41:3300/0 conn(0x7fc1740af620 msgr2=0x7fc1740ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:07.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 --2- 172.21.15.41:0/593189953 >> v2:172.21.15.41:3300/0 conn(0x7fc1740af620 0x7fc1740ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 -- 172.21.15.41:0/593189953 >> v1:172.21.15.41:6789/0 conn(0x7fc1740b2170 legacy=0x7fc1740ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 -- 172.21.15.41:0/593189953 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740b1030 con 0x7fc174067a80 2021-10-21T00:10:07.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc172d9d700 1 --2- 172.21.15.41:0/593189953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc174149320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc164002f70 tx=0x7fc164006df0).ready entity=mon.2 client_cookie=e993eb6c363e12f2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17159a700 1 -- 172.21.15.41:0/593189953 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16400d4a0 con 0x7fc174067a80 2021-10-21T00:10:07.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17159a700 1 -- 172.21.15.41:0/593189953 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164000e90 con 0x7fc174067a80 2021-10-21T00:10:07.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17159a700 1 -- 172.21.15.41:0/593189953 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16400d7f0 con 0x7fc174067a80 2021-10-21T00:10:07.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- 172.21.15.41:0/593189953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 msgr2=0x7fc174149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 --2- 172.21.15.41:0/593189953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc174149320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc164002f70 tx=0x7fc164006df0).stop 2021-10-21T00:10:07.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- 172.21.15.41:0/593189953 shutdown_connections 2021-10-21T00:10:07.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 --2- 172.21.15.41:0/593189953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc174149320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 --2- 172.21.15.41:0/593189953 >> v2:172.21.15.41:3300/0 conn(0x7fc1740af620 0x7fc1740ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- 172.21.15.41:0/593189953 >> 172.21.15.41:0/593189953 conn(0x7fc1740b5700 msgr2=0x7fc1740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:07.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- 172.21.15.41:0/593189953 shutdown_connections 2021-10-21T00:10:07.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- 172.21.15.41:0/593189953 wait complete. 2021-10-21T00:10:07.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 Processor -- start 2021-10-21T00:10:07.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.828+0000 7fc17359e700 1 -- start start 2021-10-21T00:10:07.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc17415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1740af620 0x7fc1740acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740ad240 con 0x7fc1740b2170 2021-10-21T00:10:07.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740ad4e0 con 0x7fc1740af620 2021-10-21T00:10:07.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174146a00 con 0x7fc174067a80 2021-10-21T00:10:07.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34922/0 (socket says 172.21.15.41:34922) 2021-10-21T00:10:07.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 -- 172.21.15.41:0/1629883653 learned_addr learned my addr 172.21.15.41:0/1629883653 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:07.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17259c700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc17415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc171d9b700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1740af620 0x7fc1740acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 -- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 msgr2=0x7fc17415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc17415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 -- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1740af620 msgr2=0x7fc1740acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:07.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1740af620 0x7fc1740acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:07.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 -- 172.21.15.41:0/1629883653 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16400b180 con 0x7fc1740b2170 2021-10-21T00:10:07.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc172d9d700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fc164002f70 tx=0x7fc164014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164016070 con 0x7fc1740b2170 2021-10-21T00:10:07.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164013850 con 0x7fc1740b2170 2021-10-21T00:10:07.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc164013bb0 con 0x7fc1740b2170 2021-10-21T00:10:07.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17409a0a0 con 0x7fc1740b2170 2021-10-21T00:10:07.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.832+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174066ec0 con 0x7fc1740b2170 2021-10-21T00:10:07.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740674e0 con 0x7fc1740b2170 2021-10-21T00:10:07.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc16400f030 con 0x7fc1740b2170 2021-10-21T00:10:07.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc16b7fe700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 0x7fc158055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:07.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc16406c2d0 con 0x7fc1740b2170 2021-10-21T00:10:07.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc17259c700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 0x7fc158055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:07.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.836+0000 7fc17259c700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 0x7fc158055b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fc16c00d000 tx=0x7fc16c000f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:07.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:07.844+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc164043710 con 0x7fc1740b2170 2021-10-21T00:10:08.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.012+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fc1740ad6a0 con 0x7fc1740b2170 2021-10-21T00:10:08.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.412+0000 7fc16b7fe700 1 -- 172.21.15.41:0/1629883653 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v311) v1 ==== 126+0+0 (secure 0 0 0) 0x7fc164046d30 con 0x7fc1740b2170 2021-10-21T00:10:08.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 msgr2=0x7fc158055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 0x7fc158055b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fc16c00d000 tx=0x7fc16c000f40).stop 2021-10-21T00:10:08.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 msgr2=0x7fc174099bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fc164002f70 tx=0x7fc164014000).stop 2021-10-21T00:10:08.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 shutdown_connections 2021-10-21T00:10:08.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc1580536a0 0x7fc158055b60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc1740b2170 0x7fc174099bb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1740af620 0x7fc1740acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 --2- 172.21.15.41:0/1629883653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc174067a80 0x7fc17415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 >> 172.21.15.41:0/1629883653 conn(0x7fc1740b5700 msgr2=0x7fc17414c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:08.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 shutdown_connections 2021-10-21T00:10:08.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.416+0000 7fc17359e700 1 -- 172.21.15.41:0/1629883653 wait complete. 2021-10-21T00:10:08.444 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:10:08.444 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:10:08.445 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-10-21T00:10:08.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 Processor -- start 2021-10-21T00:10:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 -- start start 2021-10-21T00:10:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 0x7f25300ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f25300af620 0x7f25300ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300b0b50 con 0x7f25300abb50 2021-10-21T00:10:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300b2550 con 0x7f25300af620 2021-10-21T00:10:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f2535509700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300b0d90 con 0x7f25300b2170 2021-10-21T00:10:08.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f25300af620 0x7f25300ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f25300af620 0x7f25300ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34926/0 (socket says 172.21.15.41:34926) 2021-10-21T00:10:08.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 -- 172.21.15.41:0/2303901549 learned_addr learned my addr 172.21.15.41:0/2303901549 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:08.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 -- 172.21.15.41:0/2303901549 >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 msgr2=0x7f25300ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:08.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252ffff700 1 --2- 172.21.15.41:0/2303901549 >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 0x7f25300ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 --2- 172.21.15.41:0/2303901549 >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 0x7f25300ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 -- 172.21.15.41:0/2303901549 >> v1:172.21.15.41:6789/0 conn(0x7f25300abb50 legacy=0x7f253014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 -- 172.21.15.41:0/2303901549 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300b1030 con 0x7f25300af620 2021-10-21T00:10:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252ffff700 1 --2- 172.21.15.41:0/2303901549 >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 0x7f25300ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.564+0000 7f252f7fe700 1 --2- 172.21.15.41:0/2303901549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300ab660 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f25200032f0 tx=0x7f2520009290).ready entity=mon.0 client_cookie=6f5cb7002273a079 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f252effd700 1 -- 172.21.15.41:0/2303901549 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252000b870 con 0x7f25300af620 2021-10-21T00:10:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f252effd700 1 -- 172.21.15.41:0/2303901549 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252000b9d0 con 0x7f25300af620 2021-10-21T00:10:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f252effd700 1 -- 172.21.15.41:0/2303901549 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252000bb40 con 0x7f25300af620 2021-10-21T00:10:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- 172.21.15.41:0/2303901549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 msgr2=0x7f25300ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 --2- 172.21.15.41:0/2303901549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300ab660 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f25200032f0 tx=0x7f2520009290).stop 2021-10-21T00:10:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- 172.21.15.41:0/2303901549 shutdown_connections 2021-10-21T00:10:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 --2- 172.21.15.41:0/2303901549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300ab660 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 --2- 172.21.15.41:0/2303901549 >> v2:172.21.15.62:3300/0 conn(0x7f25300b2170 0x7f25300ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- 172.21.15.41:0/2303901549 >> 172.21.15.41:0/2303901549 conn(0x7f25300b5700 msgr2=0x7f25300b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:08.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- 172.21.15.41:0/2303901549 shutdown_connections 2021-10-21T00:10:08.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- 172.21.15.41:0/2303901549 wait complete. 2021-10-21T00:10:08.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 Processor -- start 2021-10-21T00:10:08.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.568+0000 7f2535509700 1 -- start start 2021-10-21T00:10:08.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25300abb50 0x7f25300ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25300b2170 0x7f25300ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300ae9e0 con 0x7f25300af620 2021-10-21T00:10:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530144860 con 0x7f25300b2170 2021-10-21T00:10:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300ae710 con 0x7f25300abb50 2021-10-21T00:10:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25300abb50 0x7f25300ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34934/0 (socket says 172.21.15.41:34934) 2021-10-21T00:10:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 -- 172.21.15.41:0/3611483189 learned_addr learned my addr 172.21.15.41:0/3611483189 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2534d08700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25300b2170 0x7f25300ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 -- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25300abb50 msgr2=0x7f25300ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25300abb50 0x7f25300ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 -- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25300b2170 msgr2=0x7f25300ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:08.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25300b2170 0x7f25300ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:08.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 -- 172.21.15.41:0/3611483189 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520009530 con 0x7f25300af620 2021-10-21T00:10:08.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252f7fe700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f25200032f0 tx=0x7f2520016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:08.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2520021440 con 0x7f25300af620 2021-10-21T00:10:08.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200215a0 con 0x7f25300af620 2021-10-21T00:10:08.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2530144570 con 0x7f25300af620 2021-10-21T00:10:08.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2520021900 con 0x7f25300af620 2021-10-21T00:10:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.572+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300ad320 con 0x7f25300af620 2021-10-21T00:10:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25300ada30 con 0x7f25300af620 2021-10-21T00:10:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2520027020 con 0x7f25300af620 2021-10-21T00:10:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f252d7fa700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 0x7f2510055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f252006d180 con 0x7f25300af620 2021-10-21T00:10:08.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f252ffff700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 0x7f2510055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:08.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.576+0000 7f252ffff700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 0x7f2510055a40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f252400d000 tx=0x7f2524008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:08.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.580+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25300ada30 con 0x7f25300af620 2021-10-21T00:10:08.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:08.752+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f25300ada30 con 0x7f25300af620 2021-10-21T00:10:09.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.424+0000 7f252d7fa700 1 -- 172.21.15.41:0/3611483189 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v312) v1 ==== 141+0+0 (secure 0 0 0) 0x7f25300ada30 con 0x7f25300af620 2021-10-21T00:10:09.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.424+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 msgr2=0x7f2510055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.424+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 0x7f2510055a40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f252400d000 tx=0x7f2524008040).stop 2021-10-21T00:10:09.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.424+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 msgr2=0x7f25300add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.424+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f25200032f0 tx=0x7f2520016000).stop 2021-10-21T00:10:09.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 shutdown_connections 2021-10-21T00:10:09.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2510053580 0x7f2510055a40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25300b2170 0x7f25300ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f25300af620 0x7f25300add30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 --2- 172.21.15.41:0/3611483189 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25300abb50 0x7f25300ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 >> 172.21.15.41:0/3611483189 conn(0x7f25300b5700 msgr2=0x7f25300b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:09.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 shutdown_connections 2021-10-21T00:10:09.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.428+0000 7f2535509700 1 -- 172.21.15.41:0/3611483189 wait complete. 2021-10-21T00:10:09.450 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:10:09.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 Processor -- start 2021-10-21T00:10:09.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 -- start start 2021-10-21T00:10:09.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f948c146d30 0x7f948c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:09.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0b4120 con 0x7f948c0b9b10 2021-10-21T00:10:09.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0b46e0 con 0x7f948c0b0ac0 2021-10-21T00:10:09.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9493a88700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c0b4980 con 0x7f948c146d30 2021-10-21T00:10:09.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9491824700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f948c0b9b10 0x7f948c0b4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60942/0 (socket says 172.21.15.41:60942) 2021-10-21T00:10:09.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9491824700 1 -- 172.21.15.41:0/1909269921 learned_addr learned my addr 172.21.15.41:0/1909269921 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:09.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.556+0000 7f9492025700 1 --2- 172.21.15.41:0/1909269921 >> v2:172.21.15.41:3300/0 conn(0x7f948c146d30 0x7f948c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:09.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947426072 0 0) 0x7f948c0b4120 con 0x7f948c0b9b10 2021-10-21T00:10:09.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f946c003260 con 0x7f948c0b9b10 2021-10-21T00:10:09.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9492025700 1 -- 172.21.15.41:0/1909269921 >> v1:172.21.15.62:6789/0 conn(0x7f948c0b0ac0 legacy=0x7f948c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9492025700 1 -- 172.21.15.41:0/1909269921 >> v1:172.21.15.41:6789/0 conn(0x7f948c0b9b10 legacy=0x7f948c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593720040 0 0) 0x7f946c003260 con 0x7f948c0b9b10 2021-10-21T00:10:09.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9492025700 1 -- 172.21.15.41:0/1909269921 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0b5530 con 0x7f948c146d30 2021-10-21T00:10:09.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9492025700 1 --2- 172.21.15.41:0/1909269921 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c146d30 0x7f948c1433f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f9484001800 tx=0x7f9474006df0).ready entity=mon.0 client_cookie=3aa23218f28605ab server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:09.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484001660 con 0x7f948c146d30 2021-10-21T00:10:09.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9474000e90 con 0x7f948c146d30 2021-10-21T00:10:09.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9490822700 1 -- 172.21.15.41:0/1909269921 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947400d4f0 con 0x7f948c146d30 2021-10-21T00:10:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 -- 172.21.15.41:0/1909269921 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c146d30 msgr2=0x7f948c1433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 --2- 172.21.15.41:0/1909269921 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c146d30 0x7f948c1433f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f9484001800 tx=0x7f9474006df0).stop 2021-10-21T00:10:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 -- 172.21.15.41:0/1909269921 shutdown_connections 2021-10-21T00:10:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 --2- 172.21.15.41:0/1909269921 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c146d30 0x7f948c1433f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 -- 172.21.15.41:0/1909269921 >> 172.21.15.41:0/1909269921 conn(0x7f948c062ec0 msgr2=0x7f948c0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:09.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 -- 172.21.15.41:0/1909269921 shutdown_connections 2021-10-21T00:10:09.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.560+0000 7f9493a88700 1 -- 172.21.15.41:0/1909269921 wait complete. 2021-10-21T00:10:09.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 Processor -- start 2021-10-21T00:10:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- start start 2021-10-21T00:10:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 0x7f948c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 0x7f948c1163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1530e0 con 0x7f948c0b0ac0 2021-10-21T00:10:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1134b0 con 0x7f948c0b9b10 2021-10-21T00:10:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1532c0 con 0x7f948c146d30 2021-10-21T00:10:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:09.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34946/0 (socket says 172.21.15.41:34946) 2021-10-21T00:10:09.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 -- 172.21.15.41:0/2750623133 learned_addr learned my addr 172.21.15.41:0/2750623133 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:09.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491023700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 0x7f948c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:09.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 -- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 msgr2=0x7f948c1163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9492025700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 0x7f948c1163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:09.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 0x7f948c1163b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 -- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 msgr2=0x7f948c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 0x7f948c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 -- 172.21.15.41:0/2750623133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947400b180 con 0x7f948c0b0ac0 2021-10-21T00:10:09.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491023700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 0x7f948c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9492025700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 0x7f948c1163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9491824700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f948c0af7b0 tx=0x7f9484001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484007170 con 0x7f948c0b0ac0 2021-10-21T00:10:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840072d0 con 0x7f948c0b0ac0 2021-10-21T00:10:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c112a40 con 0x7f948c0b0ac0 2021-10-21T00:10:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484004920 con 0x7f948c0b0ac0 2021-10-21T00:10:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.564+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c1168a0 con 0x7f948c0b0ac0 2021-10-21T00:10:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c057350 con 0x7f948c0b0ac0 2021-10-21T00:10:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f948401b070 con 0x7f948c0b0ac0 2021-10-21T00:10:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f948affd700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 0x7f9470055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f948406aef0 con 0x7f948c0b0ac0 2021-10-21T00:10:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f9491023700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 0x7f9470055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.568+0000 7f9491023700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 0x7f9470055b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f947c00b000 tx=0x7f947c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.576+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9484042220 con 0x7f948c0b0ac0 2021-10-21T00:10:09.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.708+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f948c113620 con 0x7f948c0b0ac0 2021-10-21T00:10:09.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.712+0000 7f948affd700 1 -- 172.21.15.41:0/2750623133 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9484019020 con 0x7f948c0b0ac0 2021-10-21T00:10:09.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.712+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 msgr2=0x7f9470055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 0x7f9470055b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f947c00b000 tx=0x7f947c009040).stop 2021-10-21T00:10:09.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 msgr2=0x7f948c152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:09.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f948c0af7b0 tx=0x7f9484001230).stop 2021-10-21T00:10:09.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 shutdown_connections 2021-10-21T00:10:09.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f94700536a0 0x7f9470055b60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f948c146d30 0x7f948c1163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f948c0b9b10 0x7f948c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 --2- 172.21.15.41:0/2750623133 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f948c0b0ac0 0x7f948c152700 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:09.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 >> 172.21.15.41:0/2750623133 conn(0x7f948c062ec0 msgr2=0x7f948c05c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:09.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 shutdown_connections 2021-10-21T00:10:09.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:09.716+0000 7f9493a88700 1 -- 172.21.15.41:0/2750623133 wait complete. 2021-10-21T00:10:09.738 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:09.738 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:09.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:09.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:09.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:09.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:09.844 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:09.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:09.845 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:09.846 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:09.860 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:10:09.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:09.862 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:09.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:09.863 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:09.864 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:09.871 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:10:09.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:09.873 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:09.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:09.874 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:09.875 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:09.893 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:09.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:09.894 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:09.895 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:10.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 Processor -- start 2021-10-21T00:10:10.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 -- start start 2021-10-21T00:10:10.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbca4062330 0x7fbca40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbca4062f70 0x7fbca405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca405bd40 con 0x7fbca40b3a20 2021-10-21T00:10:10.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca405bf70 con 0x7fbca4062330 2021-10-21T00:10:10.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca9db6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca4142cb0 con 0x7fbca4062f70 2021-10-21T00:10:10.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.004+0000 7fbca8db4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbca4062330 0x7fbca40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbca4062330 0x7fbca40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34954/0 (socket says 172.21.15.41:34954) 2021-10-21T00:10:10.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 -- 172.21.15.41:0/2696749444 learned_addr learned my addr 172.21.15.41:0/2696749444 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:10.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca3fff700 1 --2- 172.21.15.41:0/2696749444 >> v2:172.21.15.62:3300/0 conn(0x7fbca4062f70 0x7fbca405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 -- 172.21.15.41:0/2696749444 >> v2:172.21.15.62:3300/0 conn(0x7fbca4062f70 msgr2=0x7fbca405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:10.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 --2- 172.21.15.41:0/2696749444 >> v2:172.21.15.62:3300/0 conn(0x7fbca4062f70 0x7fbca405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 -- 172.21.15.41:0/2696749444 >> v1:172.21.15.62:6789/0 conn(0x7fbca40b3a20 legacy=0x7fbca413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 -- 172.21.15.41:0/2696749444 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4142950 con 0x7fbca4062330 2021-10-21T00:10:10.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca8db4700 1 --2- 172.21.15.41:0/2696749444 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca4062330 0x7fbca40b3f30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fbc94002f70 tx=0x7fbc94006eb0).ready entity=mon.0 client_cookie=66bd3af087e05d3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca37fe700 1 -- 172.21.15.41:0/2696749444 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9400d610 con 0x7fbca4062330 2021-10-21T00:10:10.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca37fe700 1 -- 172.21.15.41:0/2696749444 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94000e90 con 0x7fbca4062330 2021-10-21T00:10:10.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca37fe700 1 -- 172.21.15.41:0/2696749444 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9400d9a0 con 0x7fbca4062330 2021-10-21T00:10:10.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- 172.21.15.41:0/2696749444 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca4062330 msgr2=0x7fbca40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2696749444 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca4062330 0x7fbca40b3f30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fbc94002f70 tx=0x7fbc94006eb0).stop 2021-10-21T00:10:10.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- 172.21.15.41:0/2696749444 shutdown_connections 2021-10-21T00:10:10.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2696749444 >> v2:172.21.15.62:3300/0 conn(0x7fbca4062f70 0x7fbca405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2696749444 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca4062330 0x7fbca40b3f30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- 172.21.15.41:0/2696749444 >> 172.21.15.41:0/2696749444 conn(0x7fbca40b9080 msgr2=0x7fbca40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- 172.21.15.41:0/2696749444 shutdown_connections 2021-10-21T00:10:10.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- 172.21.15.41:0/2696749444 wait complete. 2021-10-21T00:10:10.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 Processor -- start 2021-10-21T00:10:10.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.008+0000 7fbca9db6700 1 -- start start 2021-10-21T00:10:10.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbca4062330 0x7fbca41138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbca4062f70 0x7fbca4143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40af390 con 0x7fbca40b3a20 2021-10-21T00:10:10.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4151e90 con 0x7fbca4062f70 2021-10-21T00:10:10.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b2400 con 0x7fbca4062330 2021-10-21T00:10:10.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34960/0 (socket says 172.21.15.41:34960) 2021-10-21T00:10:10.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 -- 172.21.15.41:0/2579639332 learned_addr learned my addr 172.21.15.41:0/2579639332 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:10.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca3fff700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbca4062f70 0x7fbca4143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca8db4700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbca4062330 0x7fbca41138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 -- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbca4062330 msgr2=0x7fbca41138d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbca4062330 0x7fbca41138d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 -- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbca4062f70 msgr2=0x7fbca4143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbca4062f70 0x7fbca4143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 -- 172.21.15.41:0/2579639332 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9400b1e0 con 0x7fbca40b3a20 2021-10-21T00:10:10.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca95b5700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fbca40b6d50 tx=0x7fbc9c0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c006aa0 con 0x7fbca40b3a20 2021-10-21T00:10:10.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c006c00 con 0x7fbca40b3a20 2021-10-21T00:10:10.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c007030 con 0x7fbca40b3a20 2021-10-21T00:10:10.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca40af0f0 con 0x7fbca40b3a20 2021-10-21T00:10:10.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca40b8bc0 con 0x7fbca40b3a20 2021-10-21T00:10:10.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.012+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca4057350 con 0x7fbca40b3a20 2021-10-21T00:10:10.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.016+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc9c010030 con 0x7fbca40b3a20 2021-10-21T00:10:10.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.016+0000 7fbca1ffb700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 0x7fbc7c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.016+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbc9c06b550 con 0x7fbca40b3a20 2021-10-21T00:10:10.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.016+0000 7fbca8db4700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 0x7fbc7c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.016+0000 7fbca8db4700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 0x7fbc7c055b60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fbc9401a000 tx=0x7fbc94015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.020+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc9c042990 con 0x7fbca40b3a20 2021-10-21T00:10:10.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.152+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbca405d080 con 0x7fbca40b3a20 2021-10-21T00:10:10.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca1ffb700 1 -- 172.21.15.41:0/2579639332 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v82) v1 ==== 81+0+28828 (secure 0 0 0) 0x7fbc9c045fb0 con 0x7fbca40b3a20 2021-10-21T00:10:10.163 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:10.163 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:10.163 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 82, 2021-10-21T00:10:10.164 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:10.164 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:10.164 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:10:07.399574+0000", 2021-10-21T00:10:10.164 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:10.165 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:10.165 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:10.165 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:10.166 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:10.166 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:10.167 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:10.167 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:10.167 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:10.167 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:10.167 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:10.168 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:10.169 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:10.169 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:10.169 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:10.169 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 16, 2021-10-21T00:10:10.170 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:10.170 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:10.171 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:10.172 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:10.172 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:10.172 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.172 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:10.173 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:10.174 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:10.174 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:10.174 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:10.174 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:10.175 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:10.175 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:10.175 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:10.175 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:10.175 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:10.176 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:10.176 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:10.176 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:10.176 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:10.177 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:10.177 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:10.177 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:10.177 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:10.178 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:10.178 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:10.178 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:10.178 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:10.178 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.179 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:10.179 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:10.180 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:10.180 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:10.180 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:10.180 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:10.181 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:10.181 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:10.181 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:10.182 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:10.182 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:10.182 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:10.182 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:10.183 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:10.183 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:10.183 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:10.183 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:10.184 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:10.184 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:10.184 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:10.184 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:10.184 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:10.185 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:10.185 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:10.185 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:10.185 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:10.186 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:10.186 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.186 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:10.186 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:10.186 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:10.187 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:10.187 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:10.187 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:10.187 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:10.188 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:10.188 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:10.188 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:10.188 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:10.188 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:10.189 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:10.189 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.189 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:10.189 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:10.190 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.190 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.190 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.190 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:10.190 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:10.191 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:10.191 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:10.191 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:10.191 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:10.192 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:10.192 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:10.192 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:10.192 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:10.192 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:10.193 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:10.193 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:10.193 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:10.193 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:10.193 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:10.194 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:10.194 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:10.194 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:10.194 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:10.194 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:10.195 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:10.195 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:10.195 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.195 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:10.196 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:10.196 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:10.196 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:10.196 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:10.197 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:10.197 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:10.197 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:10.197 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:10.197 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:10.198 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:10.198 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:10.198 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:10.198 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:10.199 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:10.199 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:10.199 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:10.199 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:10.199 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:10.200 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:10.200 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:10.200 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:10.200 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:10.200 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:10.201 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:10.201 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:10.201 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:10.201 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.201 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:10.202 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:10.202 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:10.202 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:10.202 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:10.203 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:10.203 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:10.203 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:10.204 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:10.204 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:10.205 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:10.205 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:10.205 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:10.205 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:10.206 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.206 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.206 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:10.207 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:10.207 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.207 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:10.207 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:10.207 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.208 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.208 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.208 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.208 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.208 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.209 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.209 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.209 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.210 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.210 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.210 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.210 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.210 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:10.211 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.211 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.211 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.212 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.212 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:10.212 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.212 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.212 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.213 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.213 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.213 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.213 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.213 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.214 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:10.214 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.214 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.214 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.215 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.215 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:10.215 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.215 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.215 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.216 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.216 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.216 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.216 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.217 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:10.217 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.217 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.217 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.218 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.218 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:10.218 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.218 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.218 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.219 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.219 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.219 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.219 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.220 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.220 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:10.220 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.220 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.220 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.221 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:10.221 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:10.221 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.221 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.222 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.222 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:10.222 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:10.222 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:10.223 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:10.223 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.223 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.223 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.223 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.224 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.224 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.224 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:10.224 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:10.225 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.225 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.225 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.225 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.225 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.226 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.226 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.226 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 75, 2021-10-21T00:10:10.226 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.226 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.227 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.227 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.227 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:10.228 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.228 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.228 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.228 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.228 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:10.229 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.229 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.229 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.229 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.229 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.230 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.230 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:10.231 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.231 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.231 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.231 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:10.232 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.232 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.232 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.233 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.233 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.233 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.233 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.234 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:10.234 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.234 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.234 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.235 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.235 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:10.235 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.235 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.235 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.236 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.236 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.236 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.236 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.236 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.237 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:10.237 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.237 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.237 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.237 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.238 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:10.238 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:10.238 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.238 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.238 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.239 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:10.239 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:10.239 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:10.239 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:10.240 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.240 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.240 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.240 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.241 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.241 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.241 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:10.241 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:10.241 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.242 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.242 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.242 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.243 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.243 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.244 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.244 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.244 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.245 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.245 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.245 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.246 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.246 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:10.246 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.247 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.247 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.247 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.247 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:10.248 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.248 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.248 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.249 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.249 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.250 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.250 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.251 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:10.251 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.252 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.252 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.252 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.252 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:10.252 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.253 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.253 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.253 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.254 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.254 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.254 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.254 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.255 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:10.255 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.255 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.255 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.256 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.256 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:10.256 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.257 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.257 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.257 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.257 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.258 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:10.259 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.259 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.259 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.259 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.260 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:10.260 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:10.261 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.261 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.262 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:10.262 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:10.263 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:10.263 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:10.264 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.264 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.265 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.265 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.265 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.266 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.266 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:10.267 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:10.267 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.267 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.268 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.268 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.268 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.269 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.269 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.269 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.269 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.270 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.270 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.270 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.270 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:10.270 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.271 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.271 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.272 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.272 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:10.272 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.273 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.273 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.273 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.274 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.274 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.274 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.274 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.275 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:10.275 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.275 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.275 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.276 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.276 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:10.276 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.276 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.276 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.277 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.277 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.277 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.278 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:10.278 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.279 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.279 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.279 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.279 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:10.280 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.280 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.280 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.281 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.281 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.281 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.282 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:10.282 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.282 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.283 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.283 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:10.283 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:10.284 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.284 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.284 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.284 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:10.285 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:10.285 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:10.285 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:10.285 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.285 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.286 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.286 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.286 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.286 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.287 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:10.287 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:10.287 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.287 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.288 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.288 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.289 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.289 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.289 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.290 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.290 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.291 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.291 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.291 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.292 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.292 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.292 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:10.293 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.293 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.293 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.294 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.294 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:10.295 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.295 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.295 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.296 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.296 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.296 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.297 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.297 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.297 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:10.297 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.298 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.298 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.298 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:10.299 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.299 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.299 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.299 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.300 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.300 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.300 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.300 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.301 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:10.301 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.301 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.302 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.302 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.302 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:10.303 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.303 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.303 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.304 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.304 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.305 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.305 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.305 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.306 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:10.306 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.307 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.307 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.307 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.308 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:10.308 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:10.308 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.309 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.309 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.309 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:10.309 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:10.310 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:10.310 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:10.310 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.310 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.311 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.311 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.311 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.311 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.311 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:10.312 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:10.312 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.312 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.312 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.313 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.314 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.314 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.314 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.314 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.315 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.315 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.315 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.315 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:10.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.316 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.317 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.317 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:10.318 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.318 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.319 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.319 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.319 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.320 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.320 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:10.320 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.321 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.321 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.321 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.321 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:10.322 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.322 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.323 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.323 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.324 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.325 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.325 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.325 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.325 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:10.326 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.326 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.326 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.326 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.327 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:10.327 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.327 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.327 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.328 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.328 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.328 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.328 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.328 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.329 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:10.329 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.330 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.331 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.331 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.331 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:10.331 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:10.332 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.332 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.332 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.332 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:10.333 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:10.333 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:10.333 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:10.333 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.334 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.335 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.335 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.335 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.335 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.336 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:10.336 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:10.336 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.336 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.337 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.337 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.337 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.337 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.338 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.338 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:10.338 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.338 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.338 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.339 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:10.340 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.341 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.341 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.341 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.341 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:10.342 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.342 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.342 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.342 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.342 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.343 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.343 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.343 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.343 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:10.344 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.344 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.344 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.344 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.344 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:10.345 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.345 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.345 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.345 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.345 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.346 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.346 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.346 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:10.346 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.347 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.347 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.347 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.347 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:10.348 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.348 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.348 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.348 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.348 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.349 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.349 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:10.349 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.350 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.350 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.350 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.350 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:10.358 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:10.358 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.358 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.358 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.359 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:10.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:10.359 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:10.359 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:10.360 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.360 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.360 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.360 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.361 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.361 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:10.361 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:10.361 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:10.362 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:10.362 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:10.362 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:10.362 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:10.362 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:10.363 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:10.363 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 65, 2021-10-21T00:10:10.363 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:10.363 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:10.364 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:10.364 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.364 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.364 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:10.365 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.365 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.365 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.365 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.366 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:10.366 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.366 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.366 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.367 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.367 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:10.367 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.367 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.367 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.368 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:10.368 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.368 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.368 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.368 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.369 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:10.369 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.369 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.369 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.370 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.370 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:10.370 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.370 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:10.371 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.371 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.371 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.372 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:10.372 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.373 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.373 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.373 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:10.373 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:10.374 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.374 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:10.374 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:10.374 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.375 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.375 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:10.375 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:10.376 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:10.376 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.376 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.377 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:10.377 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:10.377 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:10.377 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:10.377 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:10.378 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:10.378 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:10.378 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:10.378 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.379 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:10.379 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:10.379 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.379 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:10.380 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.380 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.380 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.380 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.381 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.381 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:10.381 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.381 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.382 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.382 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:10.382 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.382 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.382 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.383 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.383 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.383 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:10.383 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.384 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.384 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.384 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:10.384 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.384 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.385 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.385 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.385 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.385 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:10.386 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.386 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.386 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.386 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:10.387 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.387 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.387 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.387 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.387 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.388 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:10.388 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.388 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.388 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.389 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:10.389 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.389 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.389 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.390 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.390 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.390 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:10.390 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.390 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.391 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.391 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:10.391 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.391 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.391 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.392 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.392 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.392 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:10.392 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.392 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.393 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.393 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:10.393 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.393 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.394 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.394 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.394 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.394 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:10.395 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.395 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.395 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:10.395 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:10.395 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:10.396 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:10.396 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:10.396 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:10.396 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:10.396 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:10.397 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:10.397 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.397 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:10.397 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:10.397 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:10.398 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:10.398 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:10.398 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:10:10.398 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/1888649335": "2021-10-22T00:10:03.900981+0000", 2021-10-21T00:10:10.399 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/1888649335": "2021-10-22T00:10:03.900981+0000" 2021-10-21T00:10:10.399 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.399 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:10.399 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:10.400 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:10.400 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:10.400 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:10.400 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:10.400 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:10.401 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:10.401 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:10.401 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:10.401 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:10.401 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:10.402 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:10.402 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:10.402 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:10.402 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:10.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 msgr2=0x7fbc7c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 0x7fbc7c055b60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fbc9401a000 tx=0x7fbc94015000).stop 2021-10-21T00:10:10.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 msgr2=0x7fbca40b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fbca40b6d50 tx=0x7fbc9c0013a0).stop 2021-10-21T00:10:10.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 shutdown_connections 2021-10-21T00:10:10.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbc7c0536a0 0x7fbc7c055b60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbca40b3a20 0x7fbca40b86d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbca4062f70 0x7fbca4143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 --2- 172.21.15.41:0/2579639332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbca4062330 0x7fbca41138d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 >> 172.21.15.41:0/2579639332 conn(0x7fbca40b9080 msgr2=0x7fbca413f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 shutdown_connections 2021-10-21T00:10:10.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.156+0000 7fbca9db6700 1 -- 172.21.15.41:0/2579639332 wait complete. 2021-10-21T00:10:10.408 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:10.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.508+0000 7f13fb4f6700 1 Processor -- start 2021-10-21T00:10:10.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.508+0000 7f13fb4f6700 1 -- start start 2021-10-21T00:10:10.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13f40b4380 0x7f13f40ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f13f40b1830 0x7f13f405f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40ae020 con 0x7f13f41433e0 2021-10-21T00:10:10.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40ade00 con 0x7f13f40b1830 2021-10-21T00:10:10.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40b4760 con 0x7f13f40b4380 2021-10-21T00:10:10.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f13f40b1830 0x7f13f405f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13facf5700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f13f41433e0 0x7f13f4062940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:60974/0 (socket says 172.21.15.41:60974) 2021-10-21T00:10:10.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13facf5700 1 -- 172.21.15.41:0/774438828 learned_addr learned my addr 172.21.15.41:0/774438828 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:10.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fa4f4700 1 --2- 172.21.15.41:0/774438828 >> v2:172.21.15.62:3300/0 conn(0x7f13f40b4380 0x7f13f40ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f94f2700 1 -- 172.21.15.41:0/774438828 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252464225 0 0) 0x7f13f40ae020 con 0x7f13f41433e0 2021-10-21T00:10:10.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 -- 172.21.15.41:0/774438828 >> v2:172.21.15.62:3300/0 conn(0x7f13f40b4380 msgr2=0x7f13f40ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:10.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 --2- 172.21.15.41:0/774438828 >> v2:172.21.15.62:3300/0 conn(0x7f13f40b4380 0x7f13f40ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 -- 172.21.15.41:0/774438828 >> v1:172.21.15.41:6789/0 conn(0x7f13f41433e0 legacy=0x7f13f4062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 -- 172.21.15.41:0/774438828 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4142ca0 con 0x7f13f40b1830 2021-10-21T00:10:10.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f9cf3700 1 --2- 172.21.15.41:0/774438828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f40b1830 0x7f13f405f740 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f13f0002f70 tx=0x7f13f0006df0).ready entity=mon.0 client_cookie=93f9cc3919b896ce server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f94f2700 1 -- 172.21.15.41:0/774438828 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13f000d570 con 0x7f13f40b1830 2021-10-21T00:10:10.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f94f2700 1 -- 172.21.15.41:0/774438828 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f0000e90 con 0x7f13f40b1830 2021-10-21T00:10:10.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13f94f2700 1 -- 172.21.15.41:0/774438828 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13f000d8c0 con 0x7f13f40b1830 2021-10-21T00:10:10.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- 172.21.15.41:0/774438828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f40b1830 msgr2=0x7f13f405f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/774438828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f40b1830 0x7f13f405f740 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f13f0002f70 tx=0x7f13f0006df0).stop 2021-10-21T00:10:10.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- 172.21.15.41:0/774438828 shutdown_connections 2021-10-21T00:10:10.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/774438828 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f40b1830 0x7f13f405f740 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/774438828 >> v2:172.21.15.62:3300/0 conn(0x7f13f40b4380 0x7f13f40ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- 172.21.15.41:0/774438828 >> 172.21.15.41:0/774438828 conn(0x7f13f40b7910 msgr2=0x7f13f40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- 172.21.15.41:0/774438828 shutdown_connections 2021-10-21T00:10:10.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.512+0000 7f13fb4f6700 1 -- 172.21.15.41:0/774438828 wait complete. 2021-10-21T00:10:10.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 Processor -- start 2021-10-21T00:10:10.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- start start 2021-10-21T00:10:10.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13f40b1830 0x7f13f409c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f40b4380 0x7f13f40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f409c1c0 con 0x7f13f41433e0 2021-10-21T00:10:10.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f409c420 con 0x7f13f40b4380 2021-10-21T00:10:10.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40b0160 con 0x7f13f40b1830 2021-10-21T00:10:10.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34978/0 (socket says 172.21.15.41:34978) 2021-10-21T00:10:10.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 -- 172.21.15.41:0/3998714770 learned_addr learned my addr 172.21.15.41:0/3998714770 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:10.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13f9cf3700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f40b4380 0x7f13f40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fa4f4700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13f40b1830 0x7f13f409c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 -- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13f40b1830 msgr2=0x7f13f409c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13f40b1830 0x7f13f409c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 -- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f40b4380 msgr2=0x7f13f40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f40b4380 0x7f13f40af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 -- 172.21.15.41:0/3998714770 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f000b180 con 0x7f13f41433e0 2021-10-21T00:10:10.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13facf5700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f13ec001250 tx=0x7f13ec001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13ec005c70 con 0x7f13f41433e0 2021-10-21T00:10:10.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec005dd0 con 0x7f13f41433e0 2021-10-21T00:10:10.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f409ba80 con 0x7f13f41433e0 2021-10-21T00:10:10.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13ec004a90 con 0x7f13f41433e0 2021-10-21T00:10:10.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.516+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f4146d90 con 0x7f13f41433e0 2021-10-21T00:10:10.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f409c680 con 0x7f13f41433e0 2021-10-21T00:10:10.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f13ec004bf0 con 0x7f13f41433e0 2021-10-21T00:10:10.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13e37fe700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 0x7f13d4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f13ec06b300 con 0x7f13f41433e0 2021-10-21T00:10:10.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13fa4f4700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 0x7f13d4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.520+0000 7f13fa4f4700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 0x7f13d4055a70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f13e400b000 tx=0x7f13e4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.528+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13f409c680 con 0x7f13f41433e0 2021-10-21T00:10:10.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.684+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13f409c680 con 0x7f13f41433e0 2021-10-21T00:10:10.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13e37fe700 1 -- 172.21.15.41:0/3998714770 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f13f409c680 con 0x7f13f41433e0 2021-10-21T00:10:10.695 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:10.695 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6793,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3839816137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3839816137},{"type":"v1","addr":"172.21.15.62:6835","nonce":3839816137}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[]} 2021-10-21T00:10:10.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 msgr2=0x7f13d4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 0x7f13d4055a70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f13e400b000 tx=0x7f13e4006df0).stop 2021-10-21T00:10:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 msgr2=0x7f13f4145370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f13ec001250 tx=0x7f13ec001360).stop 2021-10-21T00:10:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 shutdown_connections 2021-10-21T00:10:10.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f13d40535b0 0x7f13d4055a70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f13f41433e0 0x7f13f4145370 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13f40b4380 0x7f13f40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 --2- 172.21.15.41:0/3998714770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f13f40b1830 0x7f13f409c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 >> 172.21.15.41:0/3998714770 conn(0x7f13f40b7910 msgr2=0x7f13f40b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 shutdown_connections 2021-10-21T00:10:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.688+0000 7f13fb4f6700 1 -- 172.21.15.41:0/3998714770 wait complete. 2021-10-21T00:10:10.700 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 42 2021-10-21T00:10:10.707 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:10.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.800+0000 7fe5a2733700 1 Processor -- start 2021-10-21T00:10:10.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.800+0000 7fe5a2733700 1 -- start start 2021-10-21T00:10:10.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe59c05f9f0 0x7fe59c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c0aa750 0x7fe59c14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0609d0 con 0x7fe59c14b130 2021-10-21T00:10:10.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0b1620 con 0x7fe59c05f9f0 2021-10-21T00:10:10.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c05fdd0 con 0x7fe59c0aa750 2021-10-21T00:10:10.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe59c05f9f0 0x7fe59c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe59c05f9f0 0x7fe59c14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34982/0 (socket says 172.21.15.41:34982) 2021-10-21T00:10:10.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 -- 172.21.15.41:0/1814485489 learned_addr learned my addr 172.21.15.41:0/1814485489 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:10.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59b7fe700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c0aa750 0x7fe59c14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 -- 172.21.15.41:0/1814485489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c0aa750 msgr2=0x7fe59c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:10.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c0aa750 0x7fe59c14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 -- 172.21.15.41:0/1814485489 >> v1:172.21.15.62:6789/0 conn(0x7fe59c14b130 legacy=0x7fe59c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 -- 172.21.15.41:0/1814485489 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0b1380 con 0x7fe59c05f9f0 2021-10-21T00:10:10.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59bfff700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c14a750 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fe5940032f0 tx=0x7fe594009290).ready entity=mon.0 client_cookie=ba63d741780589d0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59affd700 1 -- 172.21.15.41:0/1814485489 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe59400b8a0 con 0x7fe59c05f9f0 2021-10-21T00:10:10.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59affd700 1 -- 172.21.15.41:0/1814485489 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59400ba00 con 0x7fe59c05f9f0 2021-10-21T00:10:10.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe59affd700 1 -- 172.21.15.41:0/1814485489 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe59400bb70 con 0x7fe59c05f9f0 2021-10-21T00:10:10.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- 172.21.15.41:0/1814485489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 msgr2=0x7fe59c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c14a750 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fe5940032f0 tx=0x7fe594009290).stop 2021-10-21T00:10:10.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- 172.21.15.41:0/1814485489 shutdown_connections 2021-10-21T00:10:10.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c0aa750 0x7fe59c14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 --2- 172.21.15.41:0/1814485489 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c14a750 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- 172.21.15.41:0/1814485489 >> 172.21.15.41:0/1814485489 conn(0x7fe59c05bca0 msgr2=0x7fe59c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- 172.21.15.41:0/1814485489 shutdown_connections 2021-10-21T00:10:10.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- 172.21.15.41:0/1814485489 wait complete. 2021-10-21T00:10:10.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 Processor -- start 2021-10-21T00:10:10.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.804+0000 7fe5a2733700 1 -- start start 2021-10-21T00:10:10.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59c0aa750 0x7fe59c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 0x7fe59c146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0add70 con 0x7fe59c05f9f0 2021-10-21T00:10:10.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0ad830 con 0x7fe59c0aa750 2021-10-21T00:10:10.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0adad0 con 0x7fe59c14b130 2021-10-21T00:10:10.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:34988/0 (socket says 172.21.15.41:34988) 2021-10-21T00:10:10.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 -- 172.21.15.41:0/2367376403 learned_addr learned my addr 172.21.15.41:0/2367376403 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:10.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59b7fe700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59c0aa750 0x7fe59c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a0cd0700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 0x7fe59c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 -- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 msgr2=0x7fe59c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 0x7fe59c146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 -- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59c0aa750 msgr2=0x7fe59c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59c0aa750 0x7fe59c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 -- 172.21.15.41:0/2367376403 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594009530 con 0x7fe59c05f9f0 2021-10-21T00:10:10.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a0cd0700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 0x7fe59c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:10.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe59bfff700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fe5940032f0 tx=0x7fe594016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594021630 con 0x7fe59c05f9f0 2021-10-21T00:10:10.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594021790 con 0x7fe59c05f9f0 2021-10-21T00:10:10.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c14bce0 con 0x7fe59c05f9f0 2021-10-21T00:10:10.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594021af0 con 0x7fe59c05f9f0 2021-10-21T00:10:10.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c159890 con 0x7fe59c05f9f0 2021-10-21T00:10:10.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c0aeb10 con 0x7fe59c05f9f0 2021-10-21T00:10:10.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe594027020 con 0x7fe59c05f9f0 2021-10-21T00:10:10.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.808+0000 7fe5997fa700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 0x7fe57c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:10.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.812+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe59406ce00 con 0x7fe59c05f9f0 2021-10-21T00:10:10.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.812+0000 7fe59b7fe700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 0x7fe57c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:10.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.812+0000 7fe59b7fe700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 0x7fe57c055a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe59000b000 tx=0x7fe590008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:10.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.816+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe59c0aeb10 con 0x7fe59c05f9f0 2021-10-21T00:10:10.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.976+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe59c0aeb10 con 0x7fe59c05f9f0 2021-10-21T00:10:10.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.976+0000 7fe5997fa700 1 -- 172.21.15.41:0/2367376403 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fe59c0aeb10 con 0x7fe59c05f9f0 2021-10-21T00:10:10.987 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:10.987 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5999,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2200197596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2200197596},{"type":"v1","addr":"172.21.15.41:6833","nonce":2200197596}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37},{"gid":6793,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6835/3839816137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3839816137},{"type":"v1","addr":"172.21.15.62:6835","nonce":3839816137}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":42}],"filesystems":[]} 2021-10-21T00:10:10.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 msgr2=0x7fe57c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 0x7fe57c055a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe59000b000 tx=0x7fe590008040).stop 2021-10-21T00:10:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 msgr2=0x7fe59c05c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fe5940032f0 tx=0x7fe594016000).stop 2021-10-21T00:10:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 shutdown_connections 2021-10-21T00:10:10.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe57c053580 0x7fe57c055a40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe59c14b130 0x7fe59c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59c0aa750 0x7fe59c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 --2- 172.21.15.41:0/2367376403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe59c05f9f0 0x7fe59c05c3c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:10.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 >> 172.21.15.41:0/2367376403 conn(0x7fe59c05bca0 msgr2=0x7fe59c0b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:10.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 shutdown_connections 2021-10-21T00:10:10.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:10.980+0000 7fe5a2733700 1 -- 172.21.15.41:0/2367376403 wait complete. 2021-10-21T00:10:10.992 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 42 2021-10-21T00:10:11.004 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:10:11.004 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:10:11.004 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:10:11.005 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:11.005 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:10:11.005 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:10:11.006 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:10:11.006 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:11.018 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:10:11.019 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:10:11.021 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:10:11.021 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:11.023 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:10:11.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:10:11.027 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:10:11.028 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:11.028 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:10:11.096 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:10:11.103 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:10:11.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 Processor -- start 2021-10-21T00:10:11.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- start start 2021-10-21T00:10:11.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53b00b5f70 0x7f53b005c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b00b6350 con 0x7f53b0142300 2021-10-21T00:10:11.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b0067d00 con 0x7f53b00b5f70 2021-10-21T00:10:11.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b005cee0 con 0x7f53b00b1a50 2021-10-21T00:10:11.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53ae59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53b00b5f70 0x7f53b005c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53aed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f53b0142300 0x7f53b0145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40836/0 (socket says 172.21.15.41:40836) 2021-10-21T00:10:11.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:53506/0 (socket says 172.21.15.41:53506) 2021-10-21T00:10:11.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53aed9d700 1 -- 172.21.15.41:0/3734804330 learned_addr learned my addr 172.21.15.41:0/3734804330 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:11.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 -- 172.21.15.41:0/3734804330 >> v2:172.21.15.62:3300/0 conn(0x7f53b00b5f70 msgr2=0x7f53b005c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:11.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 --2- 172.21.15.41:0/3734804330 >> v2:172.21.15.62:3300/0 conn(0x7f53b00b5f70 0x7f53b005c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:11.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 -- 172.21.15.41:0/3734804330 >> v1:172.21.15.62:6789/0 conn(0x7f53b0142300 legacy=0x7f53b0145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:11.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 -- 172.21.15.41:0/3734804330 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b005d180 con 0x7f53b00b1a50 2021-10-21T00:10:11.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53add9b700 1 --2- 172.21.15.41:0/3734804330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f53a0002f70 tx=0x7f53a0006df0).ready entity=mon.2 client_cookie=a3adba87b6adf6c0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:11.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53ad59a700 1 -- 172.21.15.41:0/3734804330 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a000d570 con 0x7f53b00b1a50 2021-10-21T00:10:11.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53ad59a700 1 -- 172.21.15.41:0/3734804330 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0000e90 con 0x7f53b00b1a50 2021-10-21T00:10:11.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53ad59a700 1 -- 172.21.15.41:0/3734804330 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a000d8c0 con 0x7f53b00b1a50 2021-10-21T00:10:11.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- 172.21.15.41:0/3734804330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 msgr2=0x7f53b0141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:11.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/3734804330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f53a0002f70 tx=0x7f53a0006df0).stop 2021-10-21T00:10:11.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- 172.21.15.41:0/3734804330 shutdown_connections 2021-10-21T00:10:11.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/3734804330 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b1a50 0x7f53b0141e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:11.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/3734804330 >> v2:172.21.15.62:3300/0 conn(0x7f53b00b5f70 0x7f53b005c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:11.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- 172.21.15.41:0/3734804330 >> 172.21.15.41:0/3734804330 conn(0x7f53b00639f0 msgr2=0x7f53b00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:11.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- 172.21.15.41:0/3734804330 shutdown_connections 2021-10-21T00:10:11.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.124+0000 7f53af59e700 1 -- 172.21.15.41:0/3734804330 wait complete. 2021-10-21T00:10:11.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 Processor -- start 2021-10-21T00:10:11.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- start start 2021-10-21T00:10:11.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b00b1a50 0x7f53b0147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b5f70 0x7f53b00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0141cf0 con 0x7f53b0142300 2021-10-21T00:10:11.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0141290 con 0x7f53b00b1a50 2021-10-21T00:10:11.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01417b0 con 0x7f53b00b5f70 2021-10-21T00:10:11.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35018/0 (socket says 172.21.15.41:35018) 2021-10-21T00:10:11.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 -- 172.21.15.41:0/2180490581 learned_addr learned my addr 172.21.15.41:0/2180490581 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:11.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53add9b700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b5f70 0x7f53b00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53ae59c700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b00b1a50 0x7f53b0147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 -- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b5f70 msgr2=0x7f53b00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:11.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b5f70 0x7f53b00b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:11.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 -- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b00b1a50 msgr2=0x7f53b0147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:11.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b00b1a50 0x7f53b0147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:11.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 -- 172.21.15.41:0/2180490581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a000b180 con 0x7f53b0142300 2021-10-21T00:10:11.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53aed9d700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f53b006a4d0 tx=0x7f53a80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:11.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a8005ba0 con 0x7f53b0142300 2021-10-21T00:10:11.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8005d00 con 0x7f53b0142300 2021-10-21T00:10:11.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b0141a50 con 0x7f53b0142300 2021-10-21T00:10:11.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a80072c0 con 0x7f53b0142300 2021-10-21T00:10:11.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.128+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b0141520 con 0x7f53b0142300 2021-10-21T00:10:11.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b0064e60 con 0x7f53b0142300 2021-10-21T00:10:11.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53a8010070 con 0x7f53b0142300 2021-10-21T00:10:11.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f539f7fe700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 0x7f538c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:11.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f53a806afa0 con 0x7f53b0142300 2021-10-21T00:10:11.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f53ae59c700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 0x7f538c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:11.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.132+0000 7f53ae59c700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 0x7f538c055b60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f53a400b000 tx=0x7f53a4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:11.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.136+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53a8042340 con 0x7f53b0142300 2021-10-21T00:10:11.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:11.272+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f53b0057350 con 0x7f53b0142300 2021-10-21T00:10:12.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.120+0000 7f539f7fe700 1 -- 172.21.15.41:0/2180490581 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53a8045960 con 0x7f53b0142300 2021-10-21T00:10:12.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 msgr2=0x7f538c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 0x7f538c055b60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f53a400b000 tx=0x7f53a4006df0).stop 2021-10-21T00:10:12.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 msgr2=0x7f53b013ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f53b006a4d0 tx=0x7f53a80013a0).stop 2021-10-21T00:10:12.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 shutdown_connections 2021-10-21T00:10:12.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f538c0536a0 0x7f538c055b60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f53b0142300 0x7f53b013ddd0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53b00b5f70 0x7f53b00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 --2- 172.21.15.41:0/2180490581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b00b1a50 0x7f53b0147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 >> 172.21.15.41:0/2180490581 conn(0x7f53b00639f0 msgr2=0x7f53b01481f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 shutdown_connections 2021-10-21T00:10:12.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.124+0000 7f53af59e700 1 -- 172.21.15.41:0/2180490581 wait complete. 2021-10-21T00:10:12.141 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:10:12.150 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:10:12.151 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:10:12.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 Processor -- start 2021-10-21T00:10:12.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 -- start start 2021-10-21T00:10:12.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06e4062330 0x7f06e40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f06e40b3a20 0x7f06e413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e405bd40 con 0x7f06e4062f70 2021-10-21T00:10:12.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e405bf70 con 0x7f06e4062330 2021-10-21T00:10:12.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06ea459700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e4142cb0 con 0x7f06e40b3a20 2021-10-21T00:10:12.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06e9457700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06e4062330 0x7f06e40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06e9457700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f06e4062330 0x7f06e40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35022/0 (socket says 172.21.15.41:35022) 2021-10-21T00:10:12.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06e9457700 1 -- 172.21.15.41:0/1638288090 learned_addr learned my addr 172.21.15.41:0/1638288090 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:12.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.252+0000 7f06e9c58700 1 --2- 172.21.15.41:0/1638288090 >> v2:172.21.15.62:3300/0 conn(0x7f06e40b3a20 0x7f06e413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06e9457700 1 -- 172.21.15.41:0/1638288090 >> v2:172.21.15.62:3300/0 conn(0x7f06e40b3a20 msgr2=0x7f06e413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:12.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06e9457700 1 --2- 172.21.15.41:0/1638288090 >> v2:172.21.15.62:3300/0 conn(0x7f06e40b3a20 0x7f06e413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06e9457700 1 -- 172.21.15.41:0/1638288090 >> v1:172.21.15.62:6789/0 conn(0x7f06e4062f70 legacy=0x7f06e405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06e9457700 1 -- 172.21.15.41:0/1638288090 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4142950 con 0x7f06e4062330 2021-10-21T00:10:12.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06e9457700 1 --2- 172.21.15.41:0/1638288090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e40b3f30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006eb0).ready entity=mon.0 client_cookie=df59e22b8ebb5a50 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06dbfff700 1 -- 172.21.15.41:0/1638288090 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d5c0 con 0x7f06e4062330 2021-10-21T00:10:12.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06dbfff700 1 -- 172.21.15.41:0/1638288090 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0000e90 con 0x7f06e4062330 2021-10-21T00:10:12.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06dbfff700 1 -- 172.21.15.41:0/1638288090 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e000d950 con 0x7f06e4062330 2021-10-21T00:10:12.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 -- 172.21.15.41:0/1638288090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 msgr2=0x7f06e40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 --2- 172.21.15.41:0/1638288090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e40b3f30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0006eb0).stop 2021-10-21T00:10:12.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 -- 172.21.15.41:0/1638288090 shutdown_connections 2021-10-21T00:10:12.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 --2- 172.21.15.41:0/1638288090 >> v2:172.21.15.62:3300/0 conn(0x7f06e40b3a20 0x7f06e413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 --2- 172.21.15.41:0/1638288090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e40b3f30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 -- 172.21.15.41:0/1638288090 >> 172.21.15.41:0/1638288090 conn(0x7f06e40b9080 msgr2=0x7f06e40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 -- 172.21.15.41:0/1638288090 shutdown_connections 2021-10-21T00:10:12.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.256+0000 7f06ea459700 1 -- 172.21.15.41:0/1638288090 wait complete. 2021-10-21T00:10:12.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 Processor -- start 2021-10-21T00:10:12.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- start start 2021-10-21T00:10:12.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 0x7f06e41459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e40b3a20 0x7f06e4112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4153170 con 0x7f06e4062330 2021-10-21T00:10:12.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e413d420 con 0x7f06e4062f70 2021-10-21T00:10:12.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4113730 con 0x7f06e40b3a20 2021-10-21T00:10:12.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35028/0 (socket says 172.21.15.41:35028) 2021-10-21T00:10:12.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 -- 172.21.15.41:0/3300000278 learned_addr learned my addr 172.21.15.41:0/3300000278 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:12.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e8c56700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 0x7f06e41459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9c58700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e40b3a20 0x7f06e4112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 -- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e40b3a20 msgr2=0x7f06e4112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e40b3a20 0x7f06e4112ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 -- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 msgr2=0x7f06e41459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 0x7f06e41459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 -- 172.21.15.41:0/3300000278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e000b1e0 con 0x7f06e4062330 2021-10-21T00:10:12.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e8c56700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 0x7f06e41459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:12.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06e9457700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e00116e0 con 0x7f06e4062330 2021-10-21T00:10:12.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0011840 con 0x7f06e4062330 2021-10-21T00:10:12.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e4113960 con 0x7f06e4062330 2021-10-21T00:10:12.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06e0011ba0 con 0x7f06e4062330 2021-10-21T00:10:12.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.260+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e4143f90 con 0x7f06e4062330 2021-10-21T00:10:12.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4146200 con 0x7f06e4062330 2021-10-21T00:10:12.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06e0025030 con 0x7f06e4062330 2021-10-21T00:10:12.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06da7fc700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 0x7f06cc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f06e006c680 con 0x7f06e4062330 2021-10-21T00:10:12.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06e8c56700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 0x7f06cc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.264+0000 7f06e8c56700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 0x7f06cc055b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f06d400d000 tx=0x7f06d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.272+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06e0043b10 con 0x7f06e4062330 2021-10-21T00:10:12.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.436+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f06e4057350 con 0x7f06e4062330 2021-10-21T00:10:12.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.440+0000 7f06da7fc700 1 -- 172.21.15.41:0/3300000278 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f06e0023070 con 0x7f06e4062330 2021-10-21T00:10:12.450 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:12.450 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:12.450 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:10:12.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.451 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:10:12.451 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:10:12.451 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.451 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:12.452 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.452 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.452 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.452 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.453 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.453 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.453 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:10:12.453 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:10:12.453 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.454 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:12.454 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.454 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.454 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.455 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.455 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.455 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:10:12.456 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:10:12.456 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.456 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.457 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.457 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.457 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:10:12.458 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:10:12.458 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.458 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.459 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.460 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.460 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:10:12.460 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:10:12.463 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.463 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.464 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.464 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.464 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.466 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:10:12.466 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:10:12.466 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.466 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.467 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.467 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.467 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.470 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.470 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:10:12.471 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:10:12.471 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.471 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.471 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.472 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.472 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.472 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.472 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.473 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:10:12.473 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:10:12.473 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.473 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.473 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.474 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.475 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.476 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.479 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.480 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:10:12.480 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:10:12.481 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.481 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.481 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.482 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.482 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.482 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.482 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.483 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:10:12.483 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:10:12.483 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.483 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.483 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.484 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.484 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.484 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.484 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.485 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:10:12.485 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:10:12.485 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.485 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:12.486 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:12.486 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:12.486 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.487 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.487 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:10:12.487 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:10:12.487 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.488 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:12.488 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:12.488 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:12.488 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.489 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.489 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.489 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:10:12.489 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:10:12.490 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.490 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:12.490 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:12.490 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:12.491 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.491 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.491 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.491 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:10:12.491 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:10:12.492 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.492 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:12.492 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:12.492 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:12.493 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.493 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.493 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.493 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.493 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:10:12.494 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:10:12.494 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.494 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:12.494 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:10:12.495 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.495 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.495 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:12.496 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:12.496 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:10:12.496 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:10:12.496 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:12.496 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:12.497 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:10:12.497 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:12.497 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.497 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:12.498 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:12.498 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:12.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 msgr2=0x7f06cc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 0x7f06cc055b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f06d400d000 tx=0x7f06d4009040).stop 2021-10-21T00:10:12.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 msgr2=0x7f06e4144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f06e0002f70 tx=0x7f06e0015000).stop 2021-10-21T00:10:12.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 shutdown_connections 2021-10-21T00:10:12.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f06cc0536d0 0x7f06cc055b90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f06e40b3a20 0x7f06e4112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06e4062f70 0x7f06e41459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 --2- 172.21.15.41:0/3300000278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f06e4062330 0x7f06e4144520 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 >> 172.21.15.41:0/3300000278 conn(0x7f06e40b9080 msgr2=0x7f06e413de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 shutdown_connections 2021-10-21T00:10:12.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.444+0000 7f06ea459700 1 -- 172.21.15.41:0/3300000278 wait complete. 2021-10-21T00:10:12.503 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:12.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.604+0000 7f85df59e700 1 Processor -- start 2021-10-21T00:10:12.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.604+0000 7f85df59e700 1 -- start start 2021-10-21T00:10:12.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85e0067a80 0x7f85e00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00b0b50 con 0x7f85e00af620 2021-10-21T00:10:12.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00b2550 con 0x7f85e00b2170 2021-10-21T00:10:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00b0d90 con 0x7f85e0067a80 2021-10-21T00:10:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ddd9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f85e00af620 0x7f85e0149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32806/0 (socket says 172.21.15.41:32806) 2021-10-21T00:10:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ddd9b700 1 -- 172.21.15.41:0/1933301 learned_addr learned my addr 172.21.15.41:0/1933301 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ded9d700 1 --2- 172.21.15.41:0/1933301 >> v2:172.21.15.62:3300/0 conn(0x7f85e0067a80 0x7f85e00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297247823 0 0) 0x7f85d0001490 con 0x7f85e00af620 2021-10-21T00:10:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c0003260 con 0x7f85e00af620 2021-10-21T00:10:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209062379 0 0) 0x7f85e00b2550 con 0x7f85e00b2170 2021-10-21T00:10:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d0001490 con 0x7f85e00b2170 2021-10-21T00:10:12.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ded9d700 1 -- 172.21.15.41:0/1933301 >> v1:172.21.15.62:6789/0 conn(0x7f85e00b2170 legacy=0x7f85e00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ded9d700 1 -- 172.21.15.41:0/1933301 >> v1:172.21.15.41:6789/0 conn(0x7f85e00af620 legacy=0x7f85e0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ded9d700 1 -- 172.21.15.41:0/1933301 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00b1030 con 0x7f85e0067a80 2021-10-21T00:10:12.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85ded9d700 1 --2- 172.21.15.41:0/1933301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e0067a80 0x7f85e00ab880 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f85e00aafa0 tx=0x7f85d8006df0).ready entity=mon.1 client_cookie=6b2d9a685133903e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d800d610 con 0x7f85e0067a80 2021-10-21T00:10:12.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8000e90 con 0x7f85e0067a80 2021-10-21T00:10:12.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85dd59a700 1 -- 172.21.15.41:0/1933301 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d800d960 con 0x7f85e0067a80 2021-10-21T00:10:12.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- 172.21.15.41:0/1933301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e0067a80 msgr2=0x7f85e00ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 --2- 172.21.15.41:0/1933301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e0067a80 0x7f85e00ab880 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f85e00aafa0 tx=0x7f85d8006df0).stop 2021-10-21T00:10:12.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- 172.21.15.41:0/1933301 shutdown_connections 2021-10-21T00:10:12.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 --2- 172.21.15.41:0/1933301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e0067a80 0x7f85e00ab880 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- 172.21.15.41:0/1933301 >> 172.21.15.41:0/1933301 conn(0x7f85e00b5700 msgr2=0x7f85e00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- 172.21.15.41:0/1933301 shutdown_connections 2021-10-21T00:10:12.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.608+0000 7f85df59e700 1 -- 172.21.15.41:0/1933301 wait complete. 2021-10-21T00:10:12.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 Processor -- start 2021-10-21T00:10:12.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- start start 2021-10-21T00:10:12.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 0x7f85e0064d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85e00b2170 0x7f85e0065280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0065bd0 con 0x7f85e0067a80 2021-10-21T00:10:12.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0063ba0 con 0x7f85e00af620 2021-10-21T00:10:12.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e008f460 con 0x7f85e00b2170 2021-10-21T00:10:12.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35042/0 (socket says 172.21.15.41:35042) 2021-10-21T00:10:12.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 -- 172.21.15.41:0/4228291717 learned_addr learned my addr 172.21.15.41:0/4228291717 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:12.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85ddd9b700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 0x7f85e0064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85ded9d700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85e00b2170 0x7f85e0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 -- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85e00b2170 msgr2=0x7f85e0065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85e00b2170 0x7f85e0065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 -- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 msgr2=0x7f85e0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 0x7f85e0064d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 -- 172.21.15.41:0/4228291717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d800b180 con 0x7f85e0067a80 2021-10-21T00:10:12.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85ddd9b700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 0x7f85e0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:12.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85de59c700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f85e00ae5e0 tx=0x7f85c8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c8012400 con 0x7f85e0067a80 2021-10-21T00:10:12.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00645f0 con 0x7f85e0067a80 2021-10-21T00:10:12.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8012560 con 0x7f85e0067a80 2021-10-21T00:10:12.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c80128c0 con 0x7f85e0067a80 2021-10-21T00:10:12.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.612+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e008f6c0 con 0x7f85e0067a80 2021-10-21T00:10:12.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e00647b0 con 0x7f85e0067a80 2021-10-21T00:10:12.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85c8019030 con 0x7f85e0067a80 2021-10-21T00:10:12.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85d77fe700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 0x7f85c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f85c806aab0 con 0x7f85e0067a80 2021-10-21T00:10:12.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85ddd9b700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 0x7f85c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.616+0000 7f85ddd9b700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 0x7f85c4055b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f85d000b000 tx=0x7f85d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.624+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85c8041ea0 con 0x7f85e0067a80 2021-10-21T00:10:12.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.748+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e00b12d0 con 0x7f85e0067a80 2021-10-21T00:10:12.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.748+0000 7f85d77fe700 1 -- 172.21.15.41:0/4228291717 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f85c80454c0 con 0x7f85e0067a80 2021-10-21T00:10:12.757 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:12.757 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":84,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:12.116954+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:12.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 msgr2=0x7f85c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 0x7f85c4055b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f85d000b000 tx=0x7f85d0009040).stop 2021-10-21T00:10:12.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 msgr2=0x7f85e00ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f85e00ae5e0 tx=0x7f85c8007a90).stop 2021-10-21T00:10:12.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 shutdown_connections 2021-10-21T00:10:12.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85c40536a0 0x7f85c4055b60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85e00b2170 0x7f85e0065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85e00af620 0x7f85e0064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 --2- 172.21.15.41:0/4228291717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85e0067a80 0x7f85e00ac4c0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 >> 172.21.15.41:0/4228291717 conn(0x7f85e00b5700 msgr2=0x7f85e005f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 shutdown_connections 2021-10-21T00:10:12.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.752+0000 7f85df59e700 1 -- 172.21.15.41:0/4228291717 wait complete. 2021-10-21T00:10:12.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:10:12.775 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:12.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 Processor -- start 2021-10-21T00:10:12.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- start start 2021-10-21T00:10:12.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f350c0b9ca0 0x7f350c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f350c0b26d0 0x7f350c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0ba080 con 0x7f350c0b31e0 2021-10-21T00:10:12.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c05c670 con 0x7f350c0b9ca0 2021-10-21T00:10:12.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c05c8e0 con 0x7f350c0b26d0 2021-10-21T00:10:12.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f350c0b9ca0 0x7f350c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f350c0b9ca0 0x7f350c0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35050/0 (socket says 172.21.15.41:35050) 2021-10-21T00:10:12.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 -- 172.21.15.41:0/1720528926 learned_addr learned my addr 172.21.15.41:0/1720528926 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:12.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350bfff700 1 --2- 172.21.15.41:0/1720528926 >> v2:172.21.15.62:3300/0 conn(0x7f350c0b26d0 0x7f350c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 -- 172.21.15.41:0/1720528926 >> v2:172.21.15.62:3300/0 conn(0x7f350c0b26d0 msgr2=0x7f350c141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:12.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 --2- 172.21.15.41:0/1720528926 >> v2:172.21.15.62:3300/0 conn(0x7f350c0b26d0 0x7f350c141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 -- 172.21.15.41:0/1720528926 >> v1:172.21.15.62:6789/0 conn(0x7f350c0b31e0 legacy=0x7f350c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 -- 172.21.15.41:0/1720528926 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c05cb80 con 0x7f350c0b9ca0 2021-10-21T00:10:12.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350b7fe700 1 --2- 172.21.15.41:0/1720528926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c0b0690 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f34fc002f70 tx=0x7f34fc006eb0).ready entity=mon.0 client_cookie=6bc78dfe45597aa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350affd700 1 -- 172.21.15.41:0/1720528926 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34fc00d5c0 con 0x7f350c0b9ca0 2021-10-21T00:10:12.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350affd700 1 -- 172.21.15.41:0/1720528926 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc000e90 con 0x7f350c0b9ca0 2021-10-21T00:10:12.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f350affd700 1 -- 172.21.15.41:0/1720528926 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34fc00d950 con 0x7f350c0b9ca0 2021-10-21T00:10:12.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- 172.21.15.41:0/1720528926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 msgr2=0x7f350c0b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 --2- 172.21.15.41:0/1720528926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c0b0690 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f34fc002f70 tx=0x7f34fc006eb0).stop 2021-10-21T00:10:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- 172.21.15.41:0/1720528926 shutdown_connections 2021-10-21T00:10:12.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 --2- 172.21.15.41:0/1720528926 >> v2:172.21.15.62:3300/0 conn(0x7f350c0b26d0 0x7f350c141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 --2- 172.21.15.41:0/1720528926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c0b0690 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- 172.21.15.41:0/1720528926 >> 172.21.15.41:0/1720528926 conn(0x7f350c062f00 msgr2=0x7f350c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:12.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- 172.21.15.41:0/1720528926 shutdown_connections 2021-10-21T00:10:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.884+0000 7f35121ce700 1 -- 172.21.15.41:0/1720528926 wait complete. 2021-10-21T00:10:12.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 Processor -- start 2021-10-21T00:10:12.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 -- start start 2021-10-21T00:10:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f350c0b31e0 0x7f350c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0ad710 con 0x7f350c0b9ca0 2021-10-21T00:10:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1124b0 con 0x7f350c0b26d0 2021-10-21T00:10:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f35121ce700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0ad940 con 0x7f350c0b31e0 2021-10-21T00:10:12.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f350bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f350b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f350b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:46974/0 (socket says 172.21.15.41:46974) 2021-10-21T00:10:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f350bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35060/0 (socket says 172.21.15.41:35060) 2021-10-21T00:10:12.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f350b7fe700 1 -- 172.21.15.41:0/304995611 learned_addr learned my addr 172.21.15.41:0/304995611 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.888+0000 7f3502ffd700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f350c0b31e0 0x7f350c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 -- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f350c0b31e0 msgr2=0x7f350c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f350c0b31e0 0x7f350c1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 -- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 msgr2=0x7f350c144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:12.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:12.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 -- 172.21.15.41:0/304995611 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc00b1e0 con 0x7f350c0b9ca0 2021-10-21T00:10:12.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350b7fe700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:12.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350bfff700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f350400c000 tx=0x7f35040091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3504012600 con 0x7f350c0b9ca0 2021-10-21T00:10:12.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504012760 con 0x7f350c0b9ca0 2021-10-21T00:10:12.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0ac890 con 0x7f350c0b9ca0 2021-10-21T00:10:12.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3504012ac0 con 0x7f350c0b9ca0 2021-10-21T00:10:12.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c146c40 con 0x7f350c0b9ca0 2021-10-21T00:10:12.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c112620 con 0x7f350c0b9ca0 2021-10-21T00:10:12.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3504022070 con 0x7f350c0b9ca0 2021-10-21T00:10:12.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 0x7f34f0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:12.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f350406bba0 con 0x7f350c0b9ca0 2021-10-21T00:10:12.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.892+0000 7f350b7fe700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 0x7f34f0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:12.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.896+0000 7f350b7fe700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 0x7f34f0055b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f34fc01c000 tx=0x7f34fc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:12.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:12.900+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3504043030 con 0x7f350c0b9ca0 2021-10-21T00:10:13.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f350c057350 con 0x7f350c0b9ca0 2021-10-21T00:10:13.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35097fa700 1 -- 172.21.15.41:0/304995611 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35040160b0 con 0x7f350c0b9ca0 2021-10-21T00:10:13.037 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:13.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 msgr2=0x7f34f0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 0x7f34f0055b90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f34fc01c000 tx=0x7f34fc015000).stop 2021-10-21T00:10:13.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 msgr2=0x7f350c112910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f350400c000 tx=0x7f35040091d0).stop 2021-10-21T00:10:13.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 shutdown_connections 2021-10-21T00:10:13.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34f00536d0 0x7f34f0055b90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f350c0b9ca0 0x7f350c112910 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f350c0b31e0 0x7f350c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 --2- 172.21.15.41:0/304995611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f350c0b26d0 0x7f350c144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 >> 172.21.15.41:0/304995611 conn(0x7f350c062f00 msgr2=0x7f350c0b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 shutdown_connections 2021-10-21T00:10:13.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.028+0000 7f35121ce700 1 -- 172.21.15.41:0/304995611 wait complete. 2021-10-21T00:10:13.051 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:13.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.156+0000 7f0808f6b700 1 Processor -- start 2021-10-21T00:10:13.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.156+0000 7f0808f6b700 1 -- start start 2021-10-21T00:10:13.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0808f6b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f080405c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0808f6b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f08040b1a50 0x7f0804141e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0808f6b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040b6350 con 0x7f0804142300 2021-10-21T00:10:13.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0808f6b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0804067d00 con 0x7f08040b1a50 2021-10-21T00:10:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0808f6b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080405cee0 con 0x7f08040b5f70 2021-10-21T00:10:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0804142300 0x7f0804145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32838/0 (socket says 172.21.15.41:32838) 2021-10-21T00:10:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 -- 172.21.15.41:0/3268205635 learned_addr learned my addr 172.21.15.41:0/3268205635 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f07faffd700 1 --2- 172.21.15.41:0/3268205635 >> v2:172.21.15.41:3300/0 conn(0x7f08040b1a50 0x7f0804141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f08037fe700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f080405c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291404517 0 0) 0x7f08040b6350 con 0x7f0804142300 2021-10-21T00:10:13.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4003260 con 0x7f0804142300 2021-10-21T00:10:13.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3220088794 0 0) 0x7f07e4003260 con 0x7f0804142300 2021-10-21T00:10:13.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 msgr2=0x7f080405c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:13.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f080405c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 >> v2:172.21.15.41:3300/0 conn(0x7f08040b1a50 msgr2=0x7f0804141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:13.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 --2- 172.21.15.41:0/3268205635 >> v2:172.21.15.41:3300/0 conn(0x7f08040b1a50 0x7f0804141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080405d180 con 0x7f0804142300 2021-10-21T00:10:13.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f07fc0019e0 con 0x7f0804142300 2021-10-21T00:10:13.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 >> v1:172.21.15.41:6789/0 conn(0x7f0804142300 legacy=0x7f0804145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f07e4003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e4003c80 0x7f07e4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e40049f0 0x7f07e4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804067d00 con 0x7f07e40049f0 2021-10-21T00:10:13.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080405cee0 con 0x7f07e4003c80 2021-10-21T00:10:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e400b750 con 0x7f08040b5f70 2021-10-21T00:10:13.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e40049f0 0x7f07e4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f08037fe700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f07e4003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 -- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 msgr2=0x7f07e4003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08040b5f70 0x7f07e4003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 -- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e4003c80 msgr2=0x7f07e4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e4003c80 0x7f07e4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-10-21T00:10:13.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 -- 172.21.15.41:0/3268205635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4003260 con 0x7f07e40049f0 2021-10-21T00:10:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0803fff700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e40049f0 0x7f07e4004e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f07e40054d0 tx=0x7f080405d310).ready entity=mon.0 client_cookie=dec942e2e36af3a1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc00cd90 con 0x7f07e40049f0 2021-10-21T00:10:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc005990 con 0x7f07e40049f0 2021-10-21T00:10:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.160+0000 7f0802ffd700 1 -- 172.21.15.41:0/3268205635 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07fc005cf0 con 0x7f07e40049f0 2021-10-21T00:10:13.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- 172.21.15.41:0/3268205635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e40049f0 msgr2=0x7f07e4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 --2- 172.21.15.41:0/3268205635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e40049f0 0x7f07e4004e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f07e40054d0 tx=0x7f080405d310).stop 2021-10-21T00:10:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0803fff700 1 -- 172.21.15.41:0/3268205635 reap_dead start 2021-10-21T00:10:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- 172.21.15.41:0/3268205635 shutdown_connections 2021-10-21T00:10:13.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- 172.21.15.41:0/3268205635 >> 172.21.15.41:0/3268205635 conn(0x7f08040639f0 msgr2=0x7f08040b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- 172.21.15.41:0/3268205635 shutdown_connections 2021-10-21T00:10:13.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- 172.21.15.41:0/3268205635 wait complete. 2021-10-21T00:10:13.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 Processor -- start 2021-10-21T00:10:13.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.164+0000 7f0808f6b700 1 -- start start 2021-10-21T00:10:13.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e40049f0 0x7f0804065ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 0x7f0804155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804144000 con 0x7f08040657b0 2021-10-21T00:10:13.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08041442a0 con 0x7f0804155660 2021-10-21T00:10:13.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804144540 con 0x7f07e40049f0 2021-10-21T00:10:13.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35078/0 (socket says 172.21.15.41:35078) 2021-10-21T00:10:13.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 -- 172.21.15.41:0/1073136945 learned_addr learned my addr 172.21.15.41:0/1073136945 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:13.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0803fff700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 0x7f0804155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f08037fe700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e40049f0 0x7f0804065ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 -- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e40049f0 msgr2=0x7f0804065ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e40049f0 0x7f0804065ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 -- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 msgr2=0x7f0804155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 0x7f0804155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 -- 172.21.15.41:0/1073136945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08041551c0 con 0x7f08040657b0 2021-10-21T00:10:13.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0803fff700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 0x7f0804155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:13.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f07faffd700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f07ec00c000 tx=0x7f07ec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec016070 con 0x7f08040657b0 2021-10-21T00:10:13.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec000e90 con 0x7f08040657b0 2021-10-21T00:10:13.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804155fd0 con 0x7f08040657b0 2021-10-21T00:10:13.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec011940 con 0x7f08040657b0 2021-10-21T00:10:13.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804064110 con 0x7f08040657b0 2021-10-21T00:10:13.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0804155350 con 0x7f08040657b0 2021-10-21T00:10:13.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.168+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07ec011aa0 con 0x7f08040657b0 2021-10-21T00:10:13.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.172+0000 7f08017fa700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 0x7f07e8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.172+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f07ec06b5f0 con 0x7f08040657b0 2021-10-21T00:10:13.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.172+0000 7f08037fe700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 0x7f07e8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.172+0000 7f08037fe700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 0x7f07e8055b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f07f400b000 tx=0x7f07f4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.180+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07ec042a80 con 0x7f08040657b0 2021-10-21T00:10:13.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f080405d8f0 con 0x7f08040657b0 2021-10-21T00:10:13.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f08017fa700 1 -- 172.21.15.41:0/1073136945 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07ec0460a0 con 0x7f08040657b0 2021-10-21T00:10:13.316 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:13.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 msgr2=0x7f07e8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 0x7f07e8055b90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f07f400b000 tx=0x7f07f4008040).stop 2021-10-21T00:10:13.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 msgr2=0x7f08040b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f07ec00c000 tx=0x7f07ec006df0).stop 2021-10-21T00:10:13.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 shutdown_connections 2021-10-21T00:10:13.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07e80536d0 0x7f07e8055b90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0804155660 0x7f0804155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f08040657b0 0x7f08040b4720 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 --2- 172.21.15.41:0/1073136945 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e40049f0 0x7f0804065ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 >> 172.21.15.41:0/1073136945 conn(0x7f08040639f0 msgr2=0x7f080405c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 shutdown_connections 2021-10-21T00:10:13.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.308+0000 7f0808f6b700 1 -- 172.21.15.41:0/1073136945 wait complete. 2021-10-21T00:10:13.330 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:10:13.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 Processor -- start 2021-10-21T00:10:13.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 -- start start 2021-10-21T00:10:13.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f705005f9f0 0x7f705014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 0x7f70500af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500609d0 con 0x7f70500aa750 2021-10-21T00:10:13.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70500b1620 con 0x7f705005f9f0 2021-10-21T00:10:13.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f705866b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705005fdd0 con 0x7f705014b350 2021-10-21T00:10:13.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f705005f9f0 0x7f705014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7055c06700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f70500aa750 0x7f705014ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32854/0 (socket says 172.21.15.41:32854) 2021-10-21T00:10:13.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7055c06700 1 -- 172.21.15.41:0/3520278446 learned_addr learned my addr 172.21.15.41:0/3520278446 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:13.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056c08700 1 --2- 172.21.15.41:0/3520278446 >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 0x7f70500af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7055405700 1 -- 172.21.15.41:0/3520278446 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259312648 0 0) 0x7f70500609d0 con 0x7f70500aa750 2021-10-21T00:10:13.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7055405700 1 -- 172.21.15.41:0/3520278446 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7038003260 con 0x7f70500aa750 2021-10-21T00:10:13.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 -- 172.21.15.41:0/3520278446 >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 msgr2=0x7f70500af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:13.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 --2- 172.21.15.41:0/3520278446 >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 0x7f70500af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 -- 172.21.15.41:0/3520278446 >> v1:172.21.15.41:6789/0 conn(0x7f70500aa750 legacy=0x7f705014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 -- 172.21.15.41:0/3520278446 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500b1380 con 0x7f705005f9f0 2021-10-21T00:10:13.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056c08700 1 --2- 172.21.15.41:0/3520278446 >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 0x7f70500af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.424+0000 7f7056407700 1 --2- 172.21.15.41:0/3520278446 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f705014a750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7040002f70 tx=0x7f7040006df0).ready entity=mon.0 client_cookie=6bb7cb493028d4d6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f7055405700 1 -- 172.21.15.41:0/3520278446 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704000d4f0 con 0x7f705005f9f0 2021-10-21T00:10:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f7055405700 1 -- 172.21.15.41:0/3520278446 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040000e90 con 0x7f705005f9f0 2021-10-21T00:10:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f7055405700 1 -- 172.21.15.41:0/3520278446 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704000d840 con 0x7f705005f9f0 2021-10-21T00:10:13.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- 172.21.15.41:0/3520278446 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 msgr2=0x7f705014a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 --2- 172.21.15.41:0/3520278446 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f705014a750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7040002f70 tx=0x7f7040006df0).stop 2021-10-21T00:10:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- 172.21.15.41:0/3520278446 shutdown_connections 2021-10-21T00:10:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 --2- 172.21.15.41:0/3520278446 >> v2:172.21.15.62:3300/0 conn(0x7f705014b350 0x7f70500af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 --2- 172.21.15.41:0/3520278446 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f705014a750 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- 172.21.15.41:0/3520278446 >> 172.21.15.41:0/3520278446 conn(0x7f705005bca0 msgr2=0x7f705005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- 172.21.15.41:0/3520278446 shutdown_connections 2021-10-21T00:10:13.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- 172.21.15.41:0/3520278446 wait complete. 2021-10-21T00:10:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 Processor -- start 2021-10-21T00:10:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.428+0000 7f705866b700 1 -- start start 2021-10-21T00:10:13.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70500aa750 0x7f7050156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 0x7f7050156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70500ad780 con 0x7f705005f9f0 2021-10-21T00:10:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70501573f0 con 0x7f705014b350 2021-10-21T00:10:13.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70501561e0 con 0x7f70500aa750 2021-10-21T00:10:13.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35090/0 (socket says 172.21.15.41:35090) 2021-10-21T00:10:13.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 -- 172.21.15.41:0/154578127 learned_addr learned my addr 172.21.15.41:0/154578127 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:13.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056c08700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 0x7f7050156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7055c06700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70500aa750 0x7f7050156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 -- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70500aa750 msgr2=0x7f7050156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70500aa750 0x7f7050156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 -- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 msgr2=0x7f7050156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 0x7f7050156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 -- 172.21.15.41:0/154578127 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048009470 con 0x7f705005f9f0 2021-10-21T00:10:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056c08700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 0x7f7050156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f7056407700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7040002f70 tx=0x7f7040014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7040016070 con 0x7f705005f9f0 2021-10-21T00:10:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70400139c0 con 0x7f705005f9f0 2021-10-21T00:10:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7040013d20 con 0x7f705005f9f0 2021-10-21T00:10:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704000b180 con 0x7f705005f9f0 2021-10-21T00:10:13.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.432+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70500ae0c0 con 0x7f705005f9f0 2021-10-21T00:10:13.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f704000f030 con 0x7f705005f9f0 2021-10-21T00:10:13.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70500678f0 con 0x7f705005f9f0 2021-10-21T00:10:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f703f7fe700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 0x7f7030055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f704006c390 con 0x7f705005f9f0 2021-10-21T00:10:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f7055c06700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 0x7f7030055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.436+0000 7f7055c06700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 0x7f7030055b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f704c00b000 tx=0x7f704c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.440+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7040043710 con 0x7f705005f9f0 2021-10-21T00:10:13.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.568+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f70500af160 con 0x7f705005f9f0 2021-10-21T00:10:13.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.568+0000 7f703f7fe700 1 -- 172.21.15.41:0/154578127 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7040023020 con 0x7f705005f9f0 2021-10-21T00:10:13.578 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:13.579 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:10:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:13.579 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:10:13.580 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:10:13.580 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:13.581 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:13.581 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:10:13.581 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:10:13.582 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:13.582 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:10:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 msgr2=0x7f7030055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 0x7f7030055b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f704c00b000 tx=0x7f704c009040).stop 2021-10-21T00:10:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 msgr2=0x7f70500981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7040002f70 tx=0x7f7040014000).stop 2021-10-21T00:10:13.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 shutdown_connections 2021-10-21T00:10:13.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f70300536a0 0x7f7030055b60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f705014b350 0x7f7050156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f70500aa750 0x7f7050156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 --2- 172.21.15.41:0/154578127 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f705005f9f0 0x7f70500981e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 >> 172.21.15.41:0/154578127 conn(0x7f705005bca0 msgr2=0x7f705009a430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 shutdown_connections 2021-10-21T00:10:13.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.572+0000 7f705866b700 1 -- 172.21.15.41:0/154578127 wait complete. 2021-10-21T00:10:13.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:10:13.592 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:10:13.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 Processor -- start 2021-10-21T00:10:13.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- start start 2021-10-21T00:10:13.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ccc0aa770 0x7f5ccc147f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc05cad0 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0b0e30 con 0x7f5ccc0608b0 2021-10-21T00:10:13.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0b10d0 con 0x7f5ccc0aa770 2021-10-21T00:10:13.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccb7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5ccc0aa770 0x7f5ccc147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccbfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5ccc05c6f0 0x7f5ccc147830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32868/0 (socket says 172.21.15.41:32868) 2021-10-21T00:10:13.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccbfff700 1 -- 172.21.15.41:0/1741799548 learned_addr learned my addr 172.21.15.41:0/1741799548 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:13.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccaffd700 1 -- 172.21.15.41:0/1741799548 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375993847 0 0) 0x7f5ccc05cad0 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccaffd700 1 -- 172.21.15.41:0/1741799548 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb8003260 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccb7fe700 1 -- 172.21.15.41:0/1741799548 >> v1:172.21.15.62:6789/0 conn(0x7f5ccc0608b0 legacy=0x7f5ccc0af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccb7fe700 1 -- 172.21.15.41:0/1741799548 >> v1:172.21.15.41:6789/0 conn(0x7f5ccc05c6f0 legacy=0x7f5ccc147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccb7fe700 1 -- 172.21.15.41:0/1741799548 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0b1370 con 0x7f5ccc0aa770 2021-10-21T00:10:13.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccb7fe700 1 --2- 172.21.15.41:0/1741799548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc147f40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f5cc0002f70 tx=0x7f5cc0006df0).ready entity=mon.0 client_cookie=a3648e18afca515f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccaffd700 1 -- 172.21.15.41:0/1741799548 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc000d610 con 0x7f5ccc0aa770 2021-10-21T00:10:13.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccaffd700 1 -- 172.21.15.41:0/1741799548 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc0000e90 con 0x7f5ccc0aa770 2021-10-21T00:10:13.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5ccaffd700 1 -- 172.21.15.41:0/1741799548 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc000d960 con 0x7f5ccc0aa770 2021-10-21T00:10:13.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- 172.21.15.41:0/1741799548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 msgr2=0x7f5ccc147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/1741799548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc147f40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f5cc0002f70 tx=0x7f5cc0006df0).stop 2021-10-21T00:10:13.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- 172.21.15.41:0/1741799548 shutdown_connections 2021-10-21T00:10:13.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/1741799548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc147f40 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- 172.21.15.41:0/1741799548 >> 172.21.15.41:0/1741799548 conn(0x7f5ccc0b2380 msgr2=0x7f5ccc05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:13.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- 172.21.15.41:0/1741799548 shutdown_connections 2021-10-21T00:10:13.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.700+0000 7f5cd22b1700 1 -- 172.21.15.41:0/1741799548 wait complete. 2021-10-21T00:10:13.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 Processor -- start 2021-10-21T00:10:13.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 -- start start 2021-10-21T00:10:13.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 0x7f5ccc097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ccc0608b0 0x7f5ccc099270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc09a200 con 0x7f5ccc0aa770 2021-10-21T00:10:13.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0631c0 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd22b1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0633f0 con 0x7f5ccc0608b0 2021-10-21T00:10:13.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd084e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 0x7f5ccc097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd084e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35108/0 (socket says 172.21.15.41:35108) 2021-10-21T00:10:13.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd084e700 1 -- 172.21.15.41:0/3004087554 learned_addr learned my addr 172.21.15.41:0/3004087554 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:13.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccb7fe700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ccc0608b0 0x7f5ccc099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 -- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ccc0608b0 msgr2=0x7f5ccc099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ccc0608b0 0x7f5ccc099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 -- 172.21.15.41:0/3004087554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 msgr2=0x7f5ccc099760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:13.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:13.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5ccbfff700 1 -- 172.21.15.41:0/3004087554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc000b180 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.704+0000 7f5cd084e700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:13.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5ccbfff700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 0x7f5ccc097de0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f5cbc001110 tx=0x7f5cbc007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc00ce80 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0070d0 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc007430 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc0aee80 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc098890 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5cbc010070 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc0635b0 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 0x7f5cac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:13.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5cbc06ac40 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.708+0000 7f5ccb7fe700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 0x7f5cac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:13.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.712+0000 7f5ccb7fe700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 0x7f5cac055ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5cc001a000 tx=0x7f5cc0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:13.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.720+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5cbc042030 con 0x7f5ccc05c6f0 2021-10-21T00:10:13.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:13.848+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5ccc057350 con 0x7f5ccc05c6f0 2021-10-21T00:10:14.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.460+0000 7f5cc97fa700 1 -- 172.21.15.41:0/3004087554 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v85) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5cbc045650 con 0x7f5ccc05c6f0 2021-10-21T00:10:14.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 msgr2=0x7f5cac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 0x7f5cac055ad0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5cc001a000 tx=0x7f5cc0014000).stop 2021-10-21T00:10:14.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 msgr2=0x7f5ccc097de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 0x7f5ccc097de0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f5cbc001110 tx=0x7f5cbc007a20).stop 2021-10-21T00:10:14.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 shutdown_connections 2021-10-21T00:10:14.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5cac053610 0x7f5cac055ad0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ccc0aa770 0x7f5ccc099760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ccc0608b0 0x7f5ccc099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 --2- 172.21.15.41:0/3004087554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ccc05c6f0 0x7f5ccc097de0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 >> 172.21.15.41:0/3004087554 conn(0x7f5ccc0b2380 msgr2=0x7f5ccc1487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:14.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 shutdown_connections 2021-10-21T00:10:14.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.464+0000 7f5cd22b1700 1 -- 172.21.15.41:0/3004087554 wait complete. 2021-10-21T00:10:14.476 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:10:14.490 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:10:14.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.592+0000 7f9c09a7d700 1 Processor -- start 2021-10-21T00:10:14.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.592+0000 7f9c09a7d700 1 -- start start 2021-10-21T00:10:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c09a7d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c040b6130 0x7f9c0405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c09a7d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040672c0 0x7f9c0405c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c09a7d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c04147250 con 0x7f9c040677c0 2021-10-21T00:10:14.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c09a7d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040ad110 con 0x7f9c040b6130 2021-10-21T00:10:14.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c09a7d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0405d130 con 0x7f9c040672c0 2021-10-21T00:10:14.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c040b6130 0x7f9c0405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c02ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040672c0 0x7f9c0405c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c040b6130 0x7f9c0405bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47030/0 (socket says 172.21.15.41:47030) 2021-10-21T00:10:14.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c03fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9c040677c0 0x7f9c04141c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:40942/0 (socket says 172.21.15.41:40942) 2021-10-21T00:10:14.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 -- 172.21.15.41:0/954203456 learned_addr learned my addr 172.21.15.41:0/954203456 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:14.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 -- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040672c0 msgr2=0x7f9c0405c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 --2- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040672c0 0x7f9c0405c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c027fc700 1 -- 172.21.15.41:0/954203456 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150124885 0 0) 0x7f9c04147250 con 0x7f9c040677c0 2021-10-21T00:10:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 -- 172.21.15.41:0/954203456 >> v1:172.21.15.62:6789/0 conn(0x7f9c040677c0 legacy=0x7f9c04141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 -- 172.21.15.41:0/954203456 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04146df0 con 0x7f9c040b6130 2021-10-21T00:10:14.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c037fe700 1 --2- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c0405bca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f9bf4002f70 tx=0x7f9bf4006eb0).ready entity=mon.1 client_cookie=cf8a6f84d518b0d2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c027fc700 1 -- 172.21.15.41:0/954203456 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf400d570 con 0x7f9c040b6130 2021-10-21T00:10:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c027fc700 1 -- 172.21.15.41:0/954203456 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4000e90 con 0x7f9c040b6130 2021-10-21T00:10:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.596+0000 7f9c027fc700 1 -- 172.21.15.41:0/954203456 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf400d8c0 con 0x7f9c040b6130 2021-10-21T00:10:14.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 msgr2=0x7f9c0405bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c0405bca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f9bf4002f70 tx=0x7f9bf4006eb0).stop 2021-10-21T00:10:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- 172.21.15.41:0/954203456 shutdown_connections 2021-10-21T00:10:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040672c0 0x7f9c0405c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/954203456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c0405bca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- 172.21.15.41:0/954203456 >> 172.21.15.41:0/954203456 conn(0x7f9c04063b40 msgr2=0x7f9c040b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- 172.21.15.41:0/954203456 shutdown_connections 2021-10-21T00:10:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- 172.21.15.41:0/954203456 wait complete. 2021-10-21T00:10:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 Processor -- start 2021-10-21T00:10:14.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.600+0000 7f9c09a7d700 1 -- start start 2021-10-21T00:10:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 0x7f9c04066a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c04151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04064df0 con 0x7f9c040672c0 2021-10-21T00:10:14.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04066570 con 0x7f9c040b6130 2021-10-21T00:10:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04064a70 con 0x7f9c040677c0 2021-10-21T00:10:14.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35118/0 (socket says 172.21.15.41:35118) 2021-10-21T00:10:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 -- 172.21.15.41:0/1553753905 learned_addr learned my addr 172.21.15.41:0/1553753905 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c03fff700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c04151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c02ffd700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 0x7f9c04066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 -- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 msgr2=0x7f9c04066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 0x7f9c04066a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 -- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 msgr2=0x7f9c04151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:14.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c04151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 -- 172.21.15.41:0/1553753905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf400b1e0 con 0x7f9c040672c0 2021-10-21T00:10:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c02ffd700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 0x7f9c04066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c03fff700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c04151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c037fe700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f9bf4002f70 tx=0x7f9bf4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:14.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf4011860 con 0x7f9c040672c0 2021-10-21T00:10:14.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40119c0 con 0x7f9c040672c0 2021-10-21T00:10:14.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c040a2240 con 0x7f9c040672c0 2021-10-21T00:10:14.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf4011d20 con 0x7f9c040672c0 2021-10-21T00:10:14.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.604+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04146460 con 0x7f9c040672c0 2021-10-21T00:10:14.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c040663c0 con 0x7f9c040672c0 2021-10-21T00:10:14.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9bf4025030 con 0x7f9c040672c0 2021-10-21T00:10:14.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c00ff9700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 0x7f9be4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:14.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f9bf406cb60 con 0x7f9c040672c0 2021-10-21T00:10:14.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c02ffd700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 0x7f9be4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:14.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.608+0000 7f9c02ffd700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 0x7f9be4055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f9bf800b000 tx=0x7f9bf8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:14.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.616+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9bf4043d80 con 0x7f9c040672c0 2021-10-21T00:10:14.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:14.748+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9c04064c30 con 0x7f9c040672c0 2021-10-21T00:10:15.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.104+0000 7f9c00ff9700 1 -- 172.21.15.41:0/1553753905 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v86) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9bf4023070 con 0x7f9c040672c0 2021-10-21T00:10:15.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 msgr2=0x7f9be4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 0x7f9be4055b60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f9bf800b000 tx=0x7f9bf8008040).stop 2021-10-21T00:10:15.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 msgr2=0x7f9c04142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f9bf4002f70 tx=0x7f9bf4015000).stop 2021-10-21T00:10:15.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 shutdown_connections 2021-10-21T00:10:15.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9be40536a0 0x7f9be4055b60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c040b6130 0x7f9c04151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9c040677c0 0x7f9c04066a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 --2- 172.21.15.41:0/1553753905 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9c040672c0 0x7f9c04142280 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 >> 172.21.15.41:0/1553753905 conn(0x7f9c04063b40 msgr2=0x7f9c040aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 shutdown_connections 2021-10-21T00:10:15.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.112+0000 7f9c09a7d700 1 -- 172.21.15.41:0/1553753905 wait complete. 2021-10-21T00:10:15.124 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:10:15.134 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:10:15.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.236+0000 7f791d4e6700 1 Processor -- start 2021-10-21T00:10:15.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.236+0000 7f791d4e6700 1 -- start start 2021-10-21T00:10:15.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.236+0000 7f791d4e6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79180b0a70 0x7f791805bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.236+0000 7f791d4e6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f791805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791805cad0 con 0x7f791805c190 2021-10-21T00:10:15.248 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180b0e50 con 0x7f79180b0a70 2021-10-21T00:10:15.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791805c830 con 0x7f79180b26f0 2021-10-21T00:10:15.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79180b0a70 0x7f791805bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f79180b0a70 0x7f791805bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35126/0 (socket says 172.21.15.41:35126) 2021-10-21T00:10:15.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 -- 172.21.15.41:0/823091876 learned_addr learned my addr 172.21.15.41:0/823091876 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f79177fe700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f791805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 -- 172.21.15.41:0/823091876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 msgr2=0x7f791805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:15.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f791805f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 -- 172.21.15.41:0/823091876 >> v1:172.21.15.62:6789/0 conn(0x7f791805c190 legacy=0x7f791805fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 -- 172.21.15.41:0/823091876 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918067c30 con 0x7f79180b0a70 2021-10-21T00:10:15.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7916ffd700 1 -- 172.21.15.41:0/823091876 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612436560 0 0) 0x7f791805cad0 con 0x7f791805c190 2021-10-21T00:10:15.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7917fff700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79180b0a70 0x7f791805bca0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f7908002f70 tx=0x7f7908006eb0).ready entity=mon.0 client_cookie=d7c447fd4f96f597 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7916ffd700 1 -- 172.21.15.41:0/823091876 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790800d570 con 0x7f79180b0a70 2021-10-21T00:10:15.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7916ffd700 1 -- 172.21.15.41:0/823091876 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908000e90 con 0x7f79180b0a70 2021-10-21T00:10:15.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f7916ffd700 1 -- 172.21.15.41:0/823091876 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f790800d8c0 con 0x7f79180b0a70 2021-10-21T00:10:15.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- 172.21.15.41:0/823091876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79180b0a70 msgr2=0x7f791805bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79180b0a70 0x7f791805bca0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f7908002f70 tx=0x7f7908006eb0).stop 2021-10-21T00:10:15.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- 172.21.15.41:0/823091876 shutdown_connections 2021-10-21T00:10:15.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f791805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 --2- 172.21.15.41:0/823091876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f79180b0a70 0x7f791805bca0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- 172.21.15.41:0/823091876 >> 172.21.15.41:0/823091876 conn(0x7f79180637b0 msgr2=0x7f7918063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- 172.21.15.41:0/823091876 shutdown_connections 2021-10-21T00:10:15.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.240+0000 7f791d4e6700 1 -- 172.21.15.41:0/823091876 wait complete. 2021-10-21T00:10:15.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 Processor -- start 2021-10-21T00:10:15.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 -- start start 2021-10-21T00:10:15.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79180b0a70 0x7f79180ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f7918152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918154f40 con 0x7f791805c190 2021-10-21T00:10:15.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180af700 con 0x7f79180b0a70 2021-10-21T00:10:15.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791d4e6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180af9a0 con 0x7f79180b26f0 2021-10-21T00:10:15.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f7917fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f7917fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35132/0 (socket says 172.21.15.41:35132) 2021-10-21T00:10:15.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f7917fff700 1 -- 172.21.15.41:0/253434460 learned_addr learned my addr 172.21.15.41:0/253434460 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f79177fe700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79180b0a70 0x7f79180ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.244+0000 7f791cce5700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f7918152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 -- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 msgr2=0x7f7918152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f7918152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 -- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79180b0a70 msgr2=0x7f79180ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79180b0a70 0x7f79180ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 -- 172.21.15.41:0/253434460 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790800b1e0 con 0x7f791805c190 2021-10-21T00:10:15.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f7917fff700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f7908002f70 tx=0x7f7908015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7908011760 con 0x7f791805c190 2021-10-21T00:10:15.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080118c0 con 0x7f791805c190 2021-10-21T00:10:15.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918148e00 con 0x7f791805c190 2021-10-21T00:10:15.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7908011c20 con 0x7f791805c190 2021-10-21T00:10:15.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79180ad860 con 0x7f791805c190 2021-10-21T00:10:15.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79181550b0 con 0x7f791805c190 2021-10-21T00:10:15.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.248+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7908025030 con 0x7f791805c190 2021-10-21T00:10:15.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.252+0000 7f79157fa700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 0x7f78f8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.252+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f790806ca60 con 0x7f791805c190 2021-10-21T00:10:15.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.252+0000 7f79177fe700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 0x7f78f8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.252+0000 7f79177fe700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 0x7f78f8055a40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f790c00b000 tx=0x7f790c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.260+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79181550b0 con 0x7f791805c190 2021-10-21T00:10:15.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.424+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7918155080 con 0x7f791805c190 2021-10-21T00:10:15.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.436+0000 7f79157fa700 1 -- 172.21.15.41:0/253434460 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v44) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7908023020 con 0x7f791805c190 2021-10-21T00:10:15.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 msgr2=0x7f78f8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 0x7f78f8055a40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f790c00b000 tx=0x7f790c006df0).stop 2021-10-21T00:10:15.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 msgr2=0x7f7918151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f7908002f70 tx=0x7f7908015000).stop 2021-10-21T00:10:15.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 shutdown_connections 2021-10-21T00:10:15.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f78f8053580 0x7f78f8055a40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f79180b26f0 0x7f7918152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79180b0a70 0x7f79180ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 --2- 172.21.15.41:0/253434460 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f791805c190 0x7f7918151970 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.440+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 >> 172.21.15.41:0/253434460 conn(0x7f79180637b0 msgr2=0x7f7918140a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.444+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 shutdown_connections 2021-10-21T00:10:15.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.444+0000 7f791d4e6700 1 -- 172.21.15.41:0/253434460 wait complete. 2021-10-21T00:10:15.457 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 17 and data pool 18 2021-10-21T00:10:15.465 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:15.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 Processor -- start 2021-10-21T00:10:15.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 -- start start 2021-10-21T00:10:15.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f013814a3b0 0x7f013814af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f013805f780 0x7f0138064ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013805c3c0 con 0x7f013805bfe0 2021-10-21T00:10:15.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0138141370 con 0x7f013814a3b0 2021-10-21T00:10:15.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f013df69700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380b0c40 con 0x7f013805f780 2021-10-21T00:10:15.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f013814a3b0 0x7f013814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f013814a3b0 0x7f013814af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35152/0 (socket says 172.21.15.41:35152) 2021-10-21T00:10:15.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 -- 172.21.15.41:0/3955695700 learned_addr learned my addr 172.21.15.41:0/3955695700 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0137fff700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f013805f780 0x7f0138064ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 -- 172.21.15.41:0/3955695700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f013805f780 msgr2=0x7f0138064ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:15.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f013805f780 0x7f0138064ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 -- 172.21.15.41:0/3955695700 >> v1:172.21.15.62:6789/0 conn(0x7f013805bfe0 legacy=0x7f013814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 -- 172.21.15.41:0/3955695700 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380b0ee0 con 0x7f013814a3b0 2021-10-21T00:10:15.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f0136ffd700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013814a3b0 0x7f013814af80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f01300032f0 tx=0x7f0130009290).ready entity=mon.0 client_cookie=c6cdbe3e3fd61455 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f01367fc700 1 -- 172.21.15.41:0/3955695700 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013000b8a0 con 0x7f013814a3b0 2021-10-21T00:10:15.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f01367fc700 1 -- 172.21.15.41:0/3955695700 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013000ba00 con 0x7f013814a3b0 2021-10-21T00:10:15.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.552+0000 7f01367fc700 1 -- 172.21.15.41:0/3955695700 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013000bb70 con 0x7f013814a3b0 2021-10-21T00:10:15.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- 172.21.15.41:0/3955695700 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013814a3b0 msgr2=0x7f013814af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013814a3b0 0x7f013814af80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f01300032f0 tx=0x7f0130009290).stop 2021-10-21T00:10:15.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- 172.21.15.41:0/3955695700 shutdown_connections 2021-10-21T00:10:15.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f013805f780 0x7f0138064ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 --2- 172.21.15.41:0/3955695700 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013814a3b0 0x7f013814af80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- 172.21.15.41:0/3955695700 >> 172.21.15.41:0/3955695700 conn(0x7f01380639f0 msgr2=0x7f0138063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- 172.21.15.41:0/3955695700 shutdown_connections 2021-10-21T00:10:15.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- 172.21.15.41:0/3955695700 wait complete. 2021-10-21T00:10:15.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 Processor -- start 2021-10-21T00:10:15.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.556+0000 7f013df69700 1 -- start start 2021-10-21T00:10:15.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f013805bfe0 0x7f0138064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0138144130 0x7f0138066960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01381562a0 con 0x7f013805f780 2021-10-21T00:10:15.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0138156490 con 0x7f013805bfe0 2021-10-21T00:10:15.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380664c0 con 0x7f0138144130 2021-10-21T00:10:15.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35158/0 (socket says 172.21.15.41:35158) 2021-10-21T00:10:15.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 -- 172.21.15.41:0/1223910350 learned_addr learned my addr 172.21.15.41:0/1223910350 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f01377fe700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f013805bfe0 0x7f0138064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0137fff700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0138144130 0x7f0138066960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 -- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0138144130 msgr2=0x7f0138066960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0138144130 0x7f0138066960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 -- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f013805bfe0 msgr2=0x7f0138064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f013805bfe0 0x7f0138064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 -- 172.21.15.41:0/1223910350 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009530 con 0x7f013805f780 2021-10-21T00:10:15.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0136ffd700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f01300032f0 tx=0x7f0130016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0130021440 con 0x7f013805f780 2021-10-21T00:10:15.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300215a0 con 0x7f013805f780 2021-10-21T00:10:15.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01381573d0 con 0x7f013805f780 2021-10-21T00:10:15.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0130021900 con 0x7f013805f780 2021-10-21T00:10:15.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.560+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01380679a0 con 0x7f013805f780 2021-10-21T00:10:15.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01380b1180 con 0x7f013805f780 2021-10-21T00:10:15.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0130027020 con 0x7f013805f780 2021-10-21T00:10:15.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f0134ff9700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 0x7f011c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f013006d2f0 con 0x7f013805f780 2021-10-21T00:10:15.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f01377fe700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 0x7f011c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.564+0000 7f01377fe700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 0x7f011c055b60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f012000d000 tx=0x7f0120007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.572+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0130044340 con 0x7f013805f780 2021-10-21T00:10:15.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.696+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0138066680 con 0x7f013805f780 2021-10-21T00:10:15.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.696+0000 7f0134ff9700 1 -- 172.21.15.41:0/1223910350 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f0130015070 con 0x7f013805f780 2021-10-21T00:10:15.707 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:15.707 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":87,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:15.430040+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:13.910039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:14.803889+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:15.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 msgr2=0x7f011c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 0x7f011c055b60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f012000d000 tx=0x7f0120007b90).stop 2021-10-21T00:10:15.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 msgr2=0x7f0138143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f01300032f0 tx=0x7f0130016000).stop 2021-10-21T00:10:15.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 shutdown_connections 2021-10-21T00:10:15.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f011c0536a0 0x7f011c055b60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0138144130 0x7f0138066960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f013805f780 0x7f0138143260 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 --2- 172.21.15.41:0/1223910350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f013805bfe0 0x7f0138064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 >> 172.21.15.41:0/1223910350 conn(0x7f01380639f0 msgr2=0x7f01380b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 shutdown_connections 2021-10-21T00:10:15.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.700+0000 7f013df69700 1 -- 172.21.15.41:0/1223910350 wait complete. 2021-10-21T00:10:15.719 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:15.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 Processor -- start 2021-10-21T00:10:15.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 -- start start 2021-10-21T00:10:15.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f699014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f699014b350 0x7f69900af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69900609d0 con 0x7f699005f9f0 2021-10-21T00:10:15.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69900b1620 con 0x7f699014b350 2021-10-21T00:10:15.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f6998271700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699005fdd0 con 0x7f69900aa750 2021-10-21T00:10:15.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f699014b350 0x7f69900af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f699014b350 0x7f69900af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35168/0 (socket says 172.21.15.41:35168) 2021-10-21T00:10:15.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 -- 172.21.15.41:0/956216832 learned_addr learned my addr 172.21.15.41:0/956216832 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699580c700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f699014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 -- 172.21.15.41:0/956216832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 msgr2=0x7f699014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:15.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f699014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 -- 172.21.15.41:0/956216832 >> v1:172.21.15.62:6789/0 conn(0x7f699005f9f0 legacy=0x7f699014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699680e700 1 -- 172.21.15.41:0/956216832 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900b1380 con 0x7f699014b350 2021-10-21T00:10:15.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.812+0000 7f699500b700 1 -- 172.21.15.41:0/956216832 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685186273 0 0) 0x7f69900609d0 con 0x7f699005f9f0 2021-10-21T00:10:15.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f699680e700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699014b350 0x7f69900af7c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f69880032f0 tx=0x7f6988009290).ready entity=mon.0 client_cookie=560e821fccc95c1f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f699500b700 1 -- 172.21.15.41:0/956216832 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698800b8a0 con 0x7f699014b350 2021-10-21T00:10:15.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f699500b700 1 -- 172.21.15.41:0/956216832 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800ba00 con 0x7f699014b350 2021-10-21T00:10:15.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f699500b700 1 -- 172.21.15.41:0/956216832 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698800bb70 con 0x7f699014b350 2021-10-21T00:10:15.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 -- 172.21.15.41:0/956216832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699014b350 msgr2=0x7f69900af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699014b350 0x7f69900af7c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f69880032f0 tx=0x7f6988009290).stop 2021-10-21T00:10:15.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 -- 172.21.15.41:0/956216832 shutdown_connections 2021-10-21T00:10:15.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699014b350 0x7f69900af7c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 --2- 172.21.15.41:0/956216832 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f699014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 -- 172.21.15.41:0/956216832 >> 172.21.15.41:0/956216832 conn(0x7f699005bca0 msgr2=0x7f699005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 -- 172.21.15.41:0/956216832 shutdown_connections 2021-10-21T00:10:15.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 -- 172.21.15.41:0/956216832 wait complete. 2021-10-21T00:10:15.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.816+0000 7f6998271700 1 Processor -- start 2021-10-21T00:10:15.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- start start 2021-10-21T00:10:15.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f6990147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f699014b350 0x7f69900ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990098600 con 0x7f699005f9f0 2021-10-21T00:10:15.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990099580 con 0x7f699014b350 2021-10-21T00:10:15.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69900987f0 con 0x7f69900aa750 2021-10-21T00:10:15.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35170/0 (socket says 172.21.15.41:35170) 2021-10-21T00:10:15.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 -- 172.21.15.41:0/1403697004 learned_addr learned my addr 172.21.15.41:0/1403697004 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:15.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699580c700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f6990147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699680e700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f699014b350 0x7f69900ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 -- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 msgr2=0x7f6990147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f6990147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 -- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f699014b350 msgr2=0x7f69900ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f699014b350 0x7f69900ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 -- 172.21.15.41:0/1403697004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6988009530 con 0x7f699005f9f0 2021-10-21T00:10:15.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f699600d700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f6980000ed0 tx=0x7f6980007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6980012400 con 0x7f699005f9f0 2021-10-21T00:10:15.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980012560 con 0x7f699005f9f0 2021-10-21T00:10:15.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69800128c0 con 0x7f699005f9f0 2021-10-21T00:10:15.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69900997b0 con 0x7f699005f9f0 2021-10-21T00:10:15.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.820+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6990146690 con 0x7f699005f9f0 2021-10-21T00:10:15.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69900678f0 con 0x7f699005f9f0 2021-10-21T00:10:15.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6980019030 con 0x7f699005f9f0 2021-10-21T00:10:15.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f697f7fe700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 0x7f6970055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:15.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f698006ada0 con 0x7f699005f9f0 2021-10-21T00:10:15.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f699580c700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 0x7f6970055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:15.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.824+0000 7f699580c700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 0x7f6970055ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f698c00b000 tx=0x7f698c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:15.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.832+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6980041e40 con 0x7f699005f9f0 2021-10-21T00:10:15.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.960+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6990057350 con 0x7f699005f9f0 2021-10-21T00:10:15.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f697f7fe700 1 -- 172.21.15.41:0/1403697004 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f6980045460 con 0x7f699005f9f0 2021-10-21T00:10:15.971 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:15.971 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":87,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:15.430040+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:13.910039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:14.803889+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:15.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 msgr2=0x7f6970055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 0x7f6970055ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f698c00b000 tx=0x7f698c006df0).stop 2021-10-21T00:10:15.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 msgr2=0x7f6990097e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:15.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f6980000ed0 tx=0x7f6980007ab0).stop 2021-10-21T00:10:15.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 shutdown_connections 2021-10-21T00:10:15.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6970053610 0x7f6970055ad0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f699014b350 0x7f69900ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69900aa750 0x7f6990147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 --2- 172.21.15.41:0/1403697004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f699005f9f0 0x7f6990097e30 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:15.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 >> 172.21.15.41:0/1403697004 conn(0x7f699005bca0 msgr2=0x7f69900b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:15.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 shutdown_connections 2021-10-21T00:10:15.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:15.964+0000 7f6998271700 1 -- 172.21.15.41:0/1403697004 wait complete. 2021-10-21T00:10:15.983 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:10:16.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.088+0000 7f0b8d1ae700 1 Processor -- start 2021-10-21T00:10:16.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.088+0000 7f0b8d1ae700 1 -- start start 2021-10-21T00:10:16.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b880b0b40 0x7f0b880a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b880aa190 0x7f0b88097f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8813f560 con 0x7f0b880b1fd0 2021-10-21T00:10:16.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8813cfd0 con 0x7f0b880b0b40 2021-10-21T00:10:16.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8813f790 con 0x7f0b880aa190 2021-10-21T00:10:16.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b880b0b40 0x7f0b880a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b880b0b40 0x7f0b880a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35180/0 (socket says 172.21.15.41:35180) 2021-10-21T00:10:16.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 -- 172.21.15.41:0/4056440486 learned_addr learned my addr 172.21.15.41:0/4056440486 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b87fff700 1 --1- 172.21.15.41:0/4056440486 >> v1:172.21.15.41:6789/0 conn(0x7f0b880b1fd0 0x7f0b8813fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32948/0 (socket says 172.21.15.41:32948) 2021-10-21T00:10:16.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8c9ad700 1 --2- 172.21.15.41:0/4056440486 >> v2:172.21.15.62:3300/0 conn(0x7f0b880aa190 0x7f0b88097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 -- 172.21.15.41:0/4056440486 >> v2:172.21.15.62:3300/0 conn(0x7f0b880aa190 msgr2=0x7f0b88097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:16.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 --2- 172.21.15.41:0/4056440486 >> v2:172.21.15.62:3300/0 conn(0x7f0b880aa190 0x7f0b88097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 -- 172.21.15.41:0/4056440486 >> v1:172.21.15.41:6789/0 conn(0x7f0b880b1fd0 legacy=0x7f0b8813fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 -- 172.21.15.41:0/4056440486 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8813fa30 con 0x7f0b880b0b40 2021-10-21T00:10:16.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b7ffff700 1 --2- 172.21.15.41:0/4056440486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880a9ca0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f0b70002f70 tx=0x7f0b70006eb0).ready entity=mon.0 client_cookie=2d966feda8c39536 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b877fe700 1 -- 172.21.15.41:0/4056440486 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000f9c0 con 0x7f0b880b0b40 2021-10-21T00:10:16.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b877fe700 1 -- 172.21.15.41:0/4056440486 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70000e90 con 0x7f0b880b0b40 2021-10-21T00:10:16.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b877fe700 1 -- 172.21.15.41:0/4056440486 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000fd50 con 0x7f0b880b0b40 2021-10-21T00:10:16.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/4056440486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 msgr2=0x7f0b880a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/4056440486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880a9ca0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f0b70002f70 tx=0x7f0b70006eb0).stop 2021-10-21T00:10:16.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/4056440486 shutdown_connections 2021-10-21T00:10:16.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/4056440486 >> v2:172.21.15.62:3300/0 conn(0x7f0b880aa190 0x7f0b88097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/4056440486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880a9ca0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/4056440486 >> 172.21.15.41:0/4056440486 conn(0x7f0b880b5700 msgr2=0x7f0b880b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:16.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/4056440486 shutdown_connections 2021-10-21T00:10:16.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.092+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/4056440486 wait complete. 2021-10-21T00:10:16.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 Processor -- start 2021-10-21T00:10:16.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 -- start start 2021-10-21T00:10:16.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b880aa190 0x7f0b8809a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b880b1fd0 0x7f0b880ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880ad010 con 0x7f0b880b0b40 2021-10-21T00:10:16.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88151210 con 0x7f0b880b1fd0 2021-10-21T00:10:16.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88150f70 con 0x7f0b880aa190 2021-10-21T00:10:16.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35186/0 (socket says 172.21.15.41:35186) 2021-10-21T00:10:16.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 -- 172.21.15.41:0/117955562 learned_addr learned my addr 172.21.15.41:0/117955562 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b87fff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b880aa190 0x7f0b8809a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8c9ad700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b880b1fd0 0x7f0b880ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 -- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b880aa190 msgr2=0x7f0b8809a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b880aa190 0x7f0b8809a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 -- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b880b1fd0 msgr2=0x7f0b880ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b880b1fd0 0x7f0b880ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 -- 172.21.15.41:0/117955562 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7000b1e0 con 0x7f0b880b0b40 2021-10-21T00:10:16.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b7ffff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f0b70002f70 tx=0x7f0b70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b70020070 con 0x7f0b880b0b40 2021-10-21T00:10:16.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b700068b0 con 0x7f0b880b0b40 2021-10-21T00:10:16.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880acb70 con 0x7f0b880b0b40 2021-10-21T00:10:16.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.096+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7001a670 con 0x7f0b880b0b40 2021-10-21T00:10:16.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b880ade50 con 0x7f0b880b0b40 2021-10-21T00:10:16.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880ae0a0 con 0x7f0b880b0b40 2021-10-21T00:10:16.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b7001a7d0 con 0x7f0b880b0b40 2021-10-21T00:10:16.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b85ffb700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 0x7f0b6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b7006ec30 con 0x7f0b880b0b40 2021-10-21T00:10:16.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b87fff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 0x7f0b6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.100+0000 7f0b87fff700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 0x7f0b6c055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0b7800b000 tx=0x7f0b78007160).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.104+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b70045c20 con 0x7f0b880b0b40 2021-10-21T00:10:16.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.272+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b880b1130 con 0x7f0b880b0b40 2021-10-21T00:10:16.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.436+0000 7f0b85ffb700 1 -- 172.21.15.41:0/117955562 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b70049240 con 0x7f0b880b0b40 2021-10-21T00:10:16.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 msgr2=0x7f0b6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 0x7f0b6c055a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0b7800b000 tx=0x7f0b78007160).stop 2021-10-21T00:10:16.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 msgr2=0x7f0b880ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f0b70002f70 tx=0x7f0b70017000).stop 2021-10-21T00:10:16.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 shutdown_connections 2021-10-21T00:10:16.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c053580 0x7f0b6c055a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b880b1fd0 0x7f0b880ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b880b0b40 0x7f0b880ad470 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 --2- 172.21.15.41:0/117955562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b880aa190 0x7f0b8809a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 >> 172.21.15.41:0/117955562 conn(0x7f0b880b5700 msgr2=0x7f0b8805f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:16.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 shutdown_connections 2021-10-21T00:10:16.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.440+0000 7f0b8d1ae700 1 -- 172.21.15.41:0/117955562 wait complete. 2021-10-21T00:10:16.464 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:16.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 Processor -- start 2021-10-21T00:10:16.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 -- start start 2021-10-21T00:10:16.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39700b2170 0x7f3970099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 0x7f397013fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39700b1560 con 0x7f39700af620 2021-10-21T00:10:16.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700b2550 con 0x7f39700b2170 2021-10-21T00:10:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f397657b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397009a170 con 0x7f397009ab50 2021-10-21T00:10:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f3975579700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39700b2170 0x7f3970099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f3975579700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f39700b2170 0x7f3970099b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35194/0 (socket says 172.21.15.41:35194) 2021-10-21T00:10:16.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f3975579700 1 -- 172.21.15.41:0/3104298325 learned_addr learned my addr 172.21.15.41:0/3104298325 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.568+0000 7f3974d78700 1 --2- 172.21.15.41:0/3104298325 >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 0x7f397013fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3975579700 1 -- 172.21.15.41:0/3104298325 >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 msgr2=0x7f397013fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3975579700 1 --2- 172.21.15.41:0/3104298325 >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 0x7f397013fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3975579700 1 -- 172.21.15.41:0/3104298325 >> v1:172.21.15.62:6789/0 conn(0x7f39700af620 legacy=0x7f397013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3975579700 1 -- 172.21.15.41:0/3104298325 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397009a410 con 0x7f39700b2170 2021-10-21T00:10:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3974d78700 1 --2- 172.21.15.41:0/3104298325 >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 0x7f397013fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f3975579700 1 --2- 172.21.15.41:0/3104298325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f3970099b40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f396c002f70 tx=0x7f396c006eb0).ready entity=mon.0 client_cookie=ae35162805b19f72 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f395ffff700 1 -- 172.21.15.41:0/3104298325 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396c00d5c0 con 0x7f39700b2170 2021-10-21T00:10:16.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f395ffff700 1 -- 172.21.15.41:0/3104298325 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c000e90 con 0x7f39700b2170 2021-10-21T00:10:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f395ffff700 1 -- 172.21.15.41:0/3104298325 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396c00d950 con 0x7f39700b2170 2021-10-21T00:10:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- 172.21.15.41:0/3104298325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 msgr2=0x7f3970099b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 --2- 172.21.15.41:0/3104298325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f3970099b40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f396c002f70 tx=0x7f396c006eb0).stop 2021-10-21T00:10:16.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- 172.21.15.41:0/3104298325 shutdown_connections 2021-10-21T00:10:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 --2- 172.21.15.41:0/3104298325 >> v2:172.21.15.62:3300/0 conn(0x7f397009ab50 0x7f397013fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 --2- 172.21.15.41:0/3104298325 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f3970099b40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- 172.21.15.41:0/3104298325 >> 172.21.15.41:0/3104298325 conn(0x7f39700b5700 msgr2=0x7f39700b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:16.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- 172.21.15.41:0/3104298325 shutdown_connections 2021-10-21T00:10:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- 172.21.15.41:0/3104298325 wait complete. 2021-10-21T00:10:16.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 Processor -- start 2021-10-21T00:10:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.572+0000 7f397657b700 1 -- start start 2021-10-21T00:10:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39700af620 0x7f3970146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39700ad2d0 0x7f39700937d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700aec70 con 0x7f39700b2170 2021-10-21T00:10:16.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700aef10 con 0x7f39700ad2d0 2021-10-21T00:10:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700aaeb0 con 0x7f39700af620 2021-10-21T00:10:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35200/0 (socket says 172.21.15.41:35200) 2021-10-21T00:10:16.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 -- 172.21.15.41:0/1587996355 learned_addr learned my addr 172.21.15.41:0/1587996355 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3975579700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39700af620 0x7f3970146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3975d7a700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39700ad2d0 0x7f39700937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 -- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39700af620 msgr2=0x7f3970146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39700af620 0x7f3970146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 -- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39700ad2d0 msgr2=0x7f39700937d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39700ad2d0 0x7f39700937d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 -- 172.21.15.41:0/1587996355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396000b180 con 0x7f39700b2170 2021-10-21T00:10:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f3974d78700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f396000c000 tx=0x7f3960006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000c5f0 con 0x7f39700b2170 2021-10-21T00:10:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000c750 con 0x7f39700b2170 2021-10-21T00:10:16.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c00b1e0 con 0x7f39700b2170 2021-10-21T00:10:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000cab0 con 0x7f39700b2170 2021-10-21T00:10:16.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970151df0 con 0x7f39700b2170 2021-10-21T00:10:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.576+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397009a6b0 con 0x7f39700b2170 2021-10-21T00:10:16.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.580+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f396000cc10 con 0x7f39700b2170 2021-10-21T00:10:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.580+0000 7f395e7fc700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 0x7f3950055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.580+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f396006bed0 con 0x7f39700b2170 2021-10-21T00:10:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.580+0000 7f3975579700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 0x7f3950055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.580+0000 7f3975579700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 0x7f3950055ad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f396c01c000 tx=0x7f396c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.588+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3960042f20 con 0x7f39700b2170 2021-10-21T00:10:16.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.756+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3970057350 con 0x7f39700b2170 2021-10-21T00:10:16.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.756+0000 7f395e7fc700 1 -- 172.21.15.41:0/1587996355 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f3960046540 con 0x7f39700b2170 2021-10-21T00:10:16.764 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:16.764 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.756+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 msgr2=0x7f3950055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.756+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 0x7f3950055ad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f396c01c000 tx=0x7f396c015000).stop 2021-10-21T00:10:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 msgr2=0x7f39700ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f396000c000 tx=0x7f3960006df0).stop 2021-10-21T00:10:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 shutdown_connections 2021-10-21T00:10:16.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3950053610 0x7f3950055ad0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39700ad2d0 0x7f39700937d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f39700b2170 0x7f39700ac250 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 --2- 172.21.15.41:0/1587996355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39700af620 0x7f3970146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 >> 172.21.15.41:0/1587996355 conn(0x7f39700b5700 msgr2=0x7f39700b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:16.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 shutdown_connections 2021-10-21T00:10:16.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.760+0000 7f397657b700 1 -- 172.21.15.41:0/1587996355 wait complete. 2021-10-21T00:10:16.770 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:16.781 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.876+0000 7feadd15e700 1 Processor -- start 2021-10-21T00:10:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.876+0000 7feadd15e700 1 -- start start 2021-10-21T00:10:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fead805f9f0 0x7fead814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 0x7fead814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80609d0 con 0x7fead814b130 2021-10-21T00:10:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80b1620 con 0x7fead805f9f0 2021-10-21T00:10:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead805fdd0 con 0x7fead80aa750 2021-10-21T00:10:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fead805f9f0 0x7fead814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fead805f9f0 0x7fead814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35206/0 (socket says 172.21.15.41:35206) 2021-10-21T00:10:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 -- 172.21.15.41:0/3984638815 learned_addr learned my addr 172.21.15.41:0/3984638815 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead759e700 1 --1- 172.21.15.41:0/3984638815 >> v1:172.21.15.41:6789/0 conn(0x7fead814b130 0x7fead81495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:32980/0 (socket says 172.21.15.41:32980) 2021-10-21T00:10:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead659c700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 0x7fead814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 -- 172.21.15.41:0/3984638815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 msgr2=0x7fead814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 0x7fead814ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 -- 172.21.15.41:0/3984638815 >> v1:172.21.15.41:6789/0 conn(0x7fead814b130 legacy=0x7fead81495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead5d9b700 1 -- 172.21.15.41:0/3984638815 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997350606 0 0) 0x7fead80609d0 con 0x7fead814b130 2021-10-21T00:10:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 -- 172.21.15.41:0/3984638815 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80b1380 con 0x7fead805f9f0 2021-10-21T00:10:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead659c700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 0x7fead814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead6d9d700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead805f9f0 0x7fead814a750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fead00032f0 tx=0x7fead0009290).ready entity=mon.0 client_cookie=4fe80c49575e824f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead5d9b700 1 -- 172.21.15.41:0/3984638815 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead000b8a0 con 0x7fead805f9f0 2021-10-21T00:10:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead5d9b700 1 -- 172.21.15.41:0/3984638815 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000ba00 con 0x7fead805f9f0 2021-10-21T00:10:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7fead5d9b700 1 -- 172.21.15.41:0/3984638815 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead000bb70 con 0x7fead805f9f0 2021-10-21T00:10:16.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- 172.21.15.41:0/3984638815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead805f9f0 msgr2=0x7fead814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead805f9f0 0x7fead814a750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fead00032f0 tx=0x7fead0009290).stop 2021-10-21T00:10:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- 172.21.15.41:0/3984638815 shutdown_connections 2021-10-21T00:10:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead80aa750 0x7fead814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 --2- 172.21.15.41:0/3984638815 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead805f9f0 0x7fead814a750 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- 172.21.15.41:0/3984638815 >> 172.21.15.41:0/3984638815 conn(0x7fead805bca0 msgr2=0x7fead805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- 172.21.15.41:0/3984638815 shutdown_connections 2021-10-21T00:10:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- 172.21.15.41:0/3984638815 wait complete. 2021-10-21T00:10:16.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 Processor -- start 2021-10-21T00:10:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.880+0000 7feadd15e700 1 -- start start 2021-10-21T00:10:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fead805f9f0 0x7fead8098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead814b130 0x7fead8064800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80ada00 con 0x7fead80aa750 2021-10-21T00:10:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead815a7d0 con 0x7fead805f9f0 2021-10-21T00:10:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80adc30 con 0x7fead814b130 2021-10-21T00:10:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35214/0 (socket says 172.21.15.41:35214) 2021-10-21T00:10:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 -- 172.21.15.41:0/624298702 learned_addr learned my addr 172.21.15.41:0/624298702 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead759e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead814b130 0x7fead8064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead6d9d700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fead805f9f0 0x7fead8098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 -- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead814b130 msgr2=0x7fead8064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead814b130 0x7fead8064800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 -- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fead805f9f0 msgr2=0x7fead8098dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fead805f9f0 0x7fead8098dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:16.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 -- 172.21.15.41:0/624298702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009530 con 0x7fead80aa750 2021-10-21T00:10:16.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7fead659c700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7feac0007000 tx=0x7feac0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac0010580 con 0x7fead80aa750 2021-10-21T00:10:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac00106e0 con 0x7fead80aa750 2021-10-21T00:10:16.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead80aded0 con 0x7fead80aa750 2021-10-21T00:10:16.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feac0010a40 con 0x7fead80aa750 2021-10-21T00:10:16.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead8099b70 con 0x7fead80aa750 2021-10-21T00:10:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.884+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead80ae060 con 0x7fead80aa750 2021-10-21T00:10:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.888+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feac0010ba0 con 0x7fead80aa750 2021-10-21T00:10:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.888+0000 7feacffff700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 0x7feabc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:16.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.888+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feac006b8f0 con 0x7fead80aa750 2021-10-21T00:10:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.888+0000 7fead6d9d700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 0x7feabc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.888+0000 7fead6d9d700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 0x7feabc055b00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fead001b000 tx=0x7fead0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:16.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:16.892+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feac0042a50 con 0x7fead80aa750 2021-10-21T00:10:17.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.024+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fead814b550 con 0x7fead80aa750 2021-10-21T00:10:17.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.024+0000 7feacffff700 1 -- 172.21.15.41:0/624298702 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7feac0046070 con 0x7fead80aa750 2021-10-21T00:10:17.034 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:17.034 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":88,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:16.434078+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:13.910039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:14.803889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:17.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 msgr2=0x7feabc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 0x7feabc055b00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fead001b000 tx=0x7fead0016000).stop 2021-10-21T00:10:17.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 msgr2=0x7fead8146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7feac0007000 tx=0x7feac0008040).stop 2021-10-21T00:10:17.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 shutdown_connections 2021-10-21T00:10:17.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7feabc053640 0x7feabc055b00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fead814b130 0x7fead8064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fead80aa750 0x7fead8146490 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 --2- 172.21.15.41:0/624298702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fead805f9f0 0x7fead8098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 >> 172.21.15.41:0/624298702 conn(0x7fead805bca0 msgr2=0x7fead8148a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 shutdown_connections 2021-10-21T00:10:17.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.028+0000 7feadd15e700 1 -- 172.21.15.41:0/624298702 wait complete. 2021-10-21T00:10:17.047 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:17.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 Processor -- start 2021-10-21T00:10:17.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 -- start start 2021-10-21T00:10:17.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f971c097920 0x7f971c05c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 0x7f971c0ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0ace30 con 0x7f971c0ac560 2021-10-21T00:10:17.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c097e00 con 0x7f971c097920 2021-10-21T00:10:17.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f972398e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0ad5b0 con 0x7f971c0968b0 2021-10-21T00:10:17.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f971c097920 0x7f971c05c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9721f2b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 0x7f971c0ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f971c097920 0x7f971c05c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47140/0 (socket says 172.21.15.41:47140) 2021-10-21T00:10:17.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 -- 172.21.15.41:0/1321688820 learned_addr learned my addr 172.21.15.41:0/1321688820 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:17.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 -- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 msgr2=0x7f971c0ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 0x7f971c0ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 -- 172.21.15.41:0/1321688820 >> v1:172.21.15.62:6789/0 conn(0x7f971c0ac560 legacy=0x7f971c05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 -- 172.21.15.41:0/1321688820 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0b2ba0 con 0x7f971c097920 2021-10-21T00:10:17.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9721f2b700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 0x7f971c0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f9720f29700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c097920 0x7f971c05c3b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9710002f70 tx=0x7f9710006eb0).ready entity=mon.1 client_cookie=694e76eb978a96d6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.152+0000 7f970ffff700 1 -- 172.21.15.41:0/1321688820 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971000d570 con 0x7f971c097920 2021-10-21T00:10:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f970ffff700 1 -- 172.21.15.41:0/1321688820 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710000e90 con 0x7f971c097920 2021-10-21T00:10:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f970ffff700 1 -- 172.21.15.41:0/1321688820 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971000d900 con 0x7f971c097920 2021-10-21T00:10:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c097920 msgr2=0x7f971c05c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c097920 0x7f971c05c3b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f9710002f70 tx=0x7f9710006eb0).stop 2021-10-21T00:10:17.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/1321688820 shutdown_connections 2021-10-21T00:10:17.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0968b0 0x7f971c0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- 172.21.15.41:0/1321688820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c097920 0x7f971c05c3b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/1321688820 >> 172.21.15.41:0/1321688820 conn(0x7f971c0b45c0 msgr2=0x7f971c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/1321688820 shutdown_connections 2021-10-21T00:10:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/1321688820 wait complete. 2021-10-21T00:10:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 Processor -- start 2021-10-21T00:10:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- start start 2021-10-21T00:10:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c0968b0 0x7f971c0af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0ac560 0x7f971c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c067930 con 0x7f971c097920 2021-10-21T00:10:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c09ba90 con 0x7f971c0968b0 2021-10-21T00:10:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c067b60 con 0x7f971c0ac560 2021-10-21T00:10:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35226/0 (socket says 172.21.15.41:35226) 2021-10-21T00:10:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 -- 172.21.15.41:0/3029793004 learned_addr learned my addr 172.21.15.41:0/3029793004 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972172a700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c0968b0 0x7f971c0af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9721f2b700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0ac560 0x7f971c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 -- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0ac560 msgr2=0x7f971c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0ac560 0x7f971c0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 -- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c0968b0 msgr2=0x7f971c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c0968b0 0x7f971c0af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 -- 172.21.15.41:0/3029793004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009470 con 0x7f971c097920 2021-10-21T00:10:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f9720f29700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9710002f70 tx=0x7f9710015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97100068b0 con 0x7f971c097920 2021-10-21T00:10:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971000de30 con 0x7f971c097920 2021-10-21T00:10:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971000b1e0 con 0x7f971c097920 2021-10-21T00:10:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.156+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9710011d70 con 0x7f971c097920 2021-10-21T00:10:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c0962e0 con 0x7f971c097920 2021-10-21T00:10:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c09c980 con 0x7f971c097920 2021-10-21T00:10:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9710025030 con 0x7f971c097920 2021-10-21T00:10:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f970effd700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 0x7f96f8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f971006c900 con 0x7f971c097920 2021-10-21T00:10:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.160+0000 7f972172a700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 0x7f96f8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.164+0000 7f972172a700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 0x7f96f8055b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f971800d000 tx=0x7f9718007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.168+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9710043a60 con 0x7f971c097920 2021-10-21T00:10:17.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.332+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f971c0b37a0 con 0x7f971c097920 2021-10-21T00:10:17.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.336+0000 7f970effd700 1 -- 172.21.15.41:0/3029793004 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f97100230e0 con 0x7f971c097920 2021-10-21T00:10:17.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 msgr2=0x7f96f8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 0x7f96f8055b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f971800d000 tx=0x7f9718007b70).stop 2021-10-21T00:10:17.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 msgr2=0x7f971c064c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9710002f70 tx=0x7f9710015000).stop 2021-10-21T00:10:17.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 shutdown_connections 2021-10-21T00:10:17.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f96f8053640 0x7f96f8055b00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f971c0ac560 0x7f971c0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f971c097920 0x7f971c064c20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 --2- 172.21.15.41:0/3029793004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f971c0968b0 0x7f971c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 >> 172.21.15.41:0/3029793004 conn(0x7f971c0b45c0 msgr2=0x7f971c0b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 shutdown_connections 2021-10-21T00:10:17.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.340+0000 7f972398e700 1 -- 172.21.15.41:0/3029793004 wait complete. 2021-10-21T00:10:17.350 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:10:17.361 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:17.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 Processor -- start 2021-10-21T00:10:17.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 -- start start 2021-10-21T00:10:17.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f518c062330 0x7f518c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f518c13c510 0x7f518c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c142f00 0x7f518c143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c0b3520 con 0x7f518c062330 2021-10-21T00:10:17.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c143c40 con 0x7f518c13c510 2021-10-21T00:10:17.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519303b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c142ad0 con 0x7f518c142f00 2021-10-21T00:10:17.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f5192039700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f518c062330 0x7f518c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f5192039700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f518c062330 0x7f518c0b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35234/0 (socket says 172.21.15.41:35234) 2021-10-21T00:10:17.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f5192039700 1 -- 172.21.15.41:0/1280892530 learned_addr learned my addr 172.21.15.41:0/1280892530 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:17.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.472+0000 7f519283a700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c142f00 0x7f518c143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5191838700 1 --2- 172.21.15.41:0/1280892530 >> v2:172.21.15.62:3300/0 conn(0x7f518c13c510 0x7f518c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 -- 172.21.15.41:0/1280892530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c142f00 msgr2=0x7f518c143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c142f00 0x7f518c143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 -- 172.21.15.41:0/1280892530 >> v2:172.21.15.62:3300/0 conn(0x7f518c13c510 msgr2=0x7f518c13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 --2- 172.21.15.41:0/1280892530 >> v2:172.21.15.62:3300/0 conn(0x7f518c13c510 0x7f518c13c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 -- 172.21.15.41:0/1280892530 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c13ce60 con 0x7f518c062330 2021-10-21T00:10:17.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5192039700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c062330 0x7f518c0b4140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f518c0b17c0 tx=0x7f517c009290).ready entity=mon.0 client_cookie=f42cf00b93d7126c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5191037700 1 -- 172.21.15.41:0/1280892530 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c00b680 con 0x7f518c062330 2021-10-21T00:10:17.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5191037700 1 -- 172.21.15.41:0/1280892530 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c00b7e0 con 0x7f518c062330 2021-10-21T00:10:17.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f5191037700 1 -- 172.21.15.41:0/1280892530 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c00b950 con 0x7f518c062330 2021-10-21T00:10:17.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 -- 172.21.15.41:0/1280892530 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c062330 msgr2=0x7f518c0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c062330 0x7f518c0b4140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f518c0b17c0 tx=0x7f517c009290).stop 2021-10-21T00:10:17.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 -- 172.21.15.41:0/1280892530 shutdown_connections 2021-10-21T00:10:17.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c142f00 0x7f518c143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 --2- 172.21.15.41:0/1280892530 >> v2:172.21.15.62:3300/0 conn(0x7f518c13c510 0x7f518c13c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 --2- 172.21.15.41:0/1280892530 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c062330 0x7f518c0b4140 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 -- 172.21.15.41:0/1280892530 >> 172.21.15.41:0/1280892530 conn(0x7f518c0b9080 msgr2=0x7f518c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 -- 172.21.15.41:0/1280892530 shutdown_connections 2021-10-21T00:10:17.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.476+0000 7f519303b700 1 -- 172.21.15.41:0/1280892530 wait complete. 2021-10-21T00:10:17.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 Processor -- start 2021-10-21T00:10:17.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- start start 2021-10-21T00:10:17.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c062330 0x7f518c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c142f00 0x7f518c13ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c148bd0 con 0x7f518c13c510 2021-10-21T00:10:17.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c13a4a0 con 0x7f518c142f00 2021-10-21T00:10:17.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c144bb0 con 0x7f518c062330 2021-10-21T00:10:17.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35240/0 (socket says 172.21.15.41:35240) 2021-10-21T00:10:17.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 -- 172.21.15.41:0/2483650414 learned_addr learned my addr 172.21.15.41:0/2483650414 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:17.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5192039700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c062330 0x7f518c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519283a700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c142f00 0x7f518c13ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 -- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c062330 msgr2=0x7f518c151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c062330 0x7f518c151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 -- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c142f00 msgr2=0x7f518c13ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c142f00 0x7f518c13ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 -- 172.21.15.41:0/2483650414 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009530 con 0x7f518c13c510 2021-10-21T00:10:17.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f5191838700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f518000c000 tx=0x7f5180006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5180010780 con 0x7f518c13c510 2021-10-21T00:10:17.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51800108e0 con 0x7f518c13c510 2021-10-21T00:10:17.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c13a730 con 0x7f518c13c510 2021-10-21T00:10:17.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5180010c40 con 0x7f518c13c510 2021-10-21T00:10:17.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.480+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c152310 con 0x7f518c13c510 2021-10-21T00:10:17.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.484+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c057350 con 0x7f518c13c510 2021-10-21T00:10:17.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.484+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f518001c460 con 0x7f518c13c510 2021-10-21T00:10:17.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.484+0000 7f518b7fe700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 0x7f516c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.484+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f518006bc80 con 0x7f518c13c510 2021-10-21T00:10:17.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.484+0000 7f5192039700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 0x7f516c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.488+0000 7f5192039700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 0x7f516c055b00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f517c01b000 tx=0x7f517c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.488+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5180042ce0 con 0x7f518c13c510 2021-10-21T00:10:17.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.656+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f518c145f70 con 0x7f518c13c510 2021-10-21T00:10:17.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.664+0000 7f518b7fe700 1 -- 172.21.15.41:0/2483650414 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5180046300 con 0x7f518c13c510 2021-10-21T00:10:17.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.664+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 msgr2=0x7f516c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.664+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 0x7f516c055b00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f517c01b000 tx=0x7f517c016000).stop 2021-10-21T00:10:17.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.664+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 msgr2=0x7f518c148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.664+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f518000c000 tx=0x7f5180006df0).stop 2021-10-21T00:10:17.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 shutdown_connections 2021-10-21T00:10:17.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f516c053640 0x7f516c055b00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c142f00 0x7f518c13ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f518c13c510 0x7f518c148140 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 --2- 172.21.15.41:0/2483650414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f518c062330 0x7f518c151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 >> 172.21.15.41:0/2483650414 conn(0x7f518c0b9080 msgr2=0x7f518c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 shutdown_connections 2021-10-21T00:10:17.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.668+0000 7f519303b700 1 -- 172.21.15.41:0/2483650414 wait complete. 2021-10-21T00:10:17.685 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:10:17.687 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:17.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 Processor -- start 2021-10-21T00:10:17.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 -- start start 2021-10-21T00:10:17.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6adc0b1090 0x7f6adc142140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc05cad0 con 0x7f6adc0b26f0 2021-10-21T00:10:17.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0b0e50 con 0x7f6adc0b0a70 2021-10-21T00:10:17.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae2341700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc05c830 con 0x7f6adc0b1090 2021-10-21T00:10:17.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.792+0000 7f6ae0b3e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f6adc0b26f0 0x7f6adc141a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33018/0 (socket says 172.21.15.41:33018) 2021-10-21T00:10:17.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae0b3e700 1 -- 172.21.15.41:0/358846701 learned_addr learned my addr 172.21.15.41:0/358846701 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:17.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/358846701 >> v2:172.21.15.62:3300/0 conn(0x7f6adc0b1090 0x7f6adc142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887852335 0 0) 0x7f6adc05cad0 con 0x7f6adc0b26f0 2021-10-21T00:10:17.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac4003260 con 0x7f6adc0b26f0 2021-10-21T00:10:17.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460622199 0 0) 0x7f6ac4003260 con 0x7f6adc0b26f0 2021-10-21T00:10:17.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 >> v2:172.21.15.62:3300/0 conn(0x7f6adc0b1090 msgr2=0x7f6adc142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 --2- 172.21.15.41:0/358846701 >> v2:172.21.15.62:3300/0 conn(0x7f6adc0b1090 0x7f6adc142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 >> v1:172.21.15.62:6789/0 conn(0x7f6adc0b0a70 legacy=0x7f6adc05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc067c30 con 0x7f6adc0b26f0 2021-10-21T00:10:17.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f6ad8001660 con 0x7f6adc0b26f0 2021-10-21T00:10:17.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 >> v1:172.21.15.41:6789/0 conn(0x7f6adc0b26f0 legacy=0x7f6adc141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac4003750 0x7f6ac4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004500 0x7f6ac4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 0x7f6ac400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc05c830 con 0x7f6ac4004e70 2021-10-21T00:10:17.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400bc70 con 0x7f6ac4003750 2021-10-21T00:10:17.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400be30 con 0x7f6ac4004500 2021-10-21T00:10:17.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 0x7f6ac400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae133f700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac4003750 0x7f6ac4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae0b3e700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004500 0x7f6ac4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 -- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004500 msgr2=0x7f6ac4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004500 0x7f6ac4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 -- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac4003750 msgr2=0x7f6ac4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:17.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ac4003750 0x7f6ac4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 -- 172.21.15.41:0/358846701 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4003260 con 0x7f6ac4004e70 2021-10-21T00:10:17.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 -- 172.21.15.41:0/358846701 reap_dead start 2021-10-21T00:10:17.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 0x7f6ac400b750 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f6ad400c000 tx=0x7f6ad40091d0).ready entity=mon.0 client_cookie=84f1dc8e31cc147 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad400e7e0 con 0x7f6ac4004e70 2021-10-21T00:10:17.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400e940 con 0x7f6ac4004e70 2021-10-21T00:10:17.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6acffff700 1 -- 172.21.15.41:0/358846701 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad400eca0 con 0x7f6ac4004e70 2021-10-21T00:10:17.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 -- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 msgr2=0x7f6ac400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 0x7f6ac400b750 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f6ad400c000 tx=0x7f6ad40091d0).stop 2021-10-21T00:10:17.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 -- 172.21.15.41:0/358846701 shutdown_connections 2021-10-21T00:10:17.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 --2- 172.21.15.41:0/358846701 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ac4004e70 0x7f6ac400b750 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 -- 172.21.15.41:0/358846701 >> 172.21.15.41:0/358846701 conn(0x7f6adc0637b0 msgr2=0x7f6adc063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:17.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 -- 172.21.15.41:0/358846701 shutdown_connections 2021-10-21T00:10:17.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.796+0000 7f6ae2341700 1 -- 172.21.15.41:0/358846701 wait complete. 2021-10-21T00:10:17.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 Processor -- start 2021-10-21T00:10:17.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 -- start start 2021-10-21T00:10:17.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 0x7f6adc1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0afdd0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0adeb0 con 0x7f6adc152490 2021-10-21T00:10:17.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae2341700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ad2b0 con 0x7f6ac4004e70 2021-10-21T00:10:17.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae0b3e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae1b40700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae0b3e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35260/0 (socket says 172.21.15.41:35260) 2021-10-21T00:10:17.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae1b40700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47180/0 (socket says 172.21.15.41:47180) 2021-10-21T00:10:17.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae0b3e700 1 -- 172.21.15.41:0/2850316075 learned_addr learned my addr 172.21.15.41:0/2850316075 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:17.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.800+0000 7f6ae133f700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 0x7f6adc1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 -- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 msgr2=0x7f6adc1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 0x7f6adc1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 -- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 msgr2=0x7f6adc13d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 -- 172.21.15.41:0/2850316075 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0ae0e0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae1b40700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:17.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae133f700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 0x7f6adc1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:17.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae0b3e700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6adc155e30 tx=0x7f6ad8001db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad80116b0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8011810 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc155ab0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ad8011b70 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc144390 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc155c40 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ad801b030 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 0x7f6abc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:17.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.804+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6ad806b2c0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.808+0000 7f6ae133f700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 0x7f6abc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:17.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.808+0000 7f6ae133f700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 0x7f6abc055b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f6ad0003000 tx=0x7f6ad00079e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:17.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.812+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ad8042420 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.980+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6adc146cc0 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ace7fc700 1 -- 172.21.15.41:0/2850316075 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6ad8019030 con 0x7f6adc0ad4c0 2021-10-21T00:10:17.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 msgr2=0x7f6abc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 0x7f6abc055b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f6ad0003000 tx=0x7f6ad00079e0).stop 2021-10-21T00:10:17.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 msgr2=0x7f6adc143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:17.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6adc155e30 tx=0x7f6ad8001db0).stop 2021-10-21T00:10:17.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 shutdown_connections 2021-10-21T00:10:17.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6abc0536d0 0x7f6abc055b90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6adc152490 0x7f6adc13d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6adc0ad4c0 0x7f6adc143ea0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 --2- 172.21.15.41:0/2850316075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ac4004e70 0x7f6adc1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:17.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 >> 172.21.15.41:0/2850316075 conn(0x7f6adc0637b0 msgr2=0x7f6adc063b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:18.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 shutdown_connections 2021-10-21T00:10:18.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:17.988+0000 7f6ae2341700 1 -- 172.21.15.41:0/2850316075 wait complete. 2021-10-21T00:10:18.000 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:10:18.010 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:18.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.104+0000 7f051e315700 1 Processor -- start 2021-10-21T00:10:18.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.104+0000 7f051e315700 1 -- start start 2021-10-21T00:10:18.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 0x7f051814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 0x7f05180af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05180609d0 con 0x7f05180aa750 2021-10-21T00:10:18.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180b1620 con 0x7f051805f9f0 2021-10-21T00:10:18.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051805fdd0 con 0x7f051814b350 2021-10-21T00:10:18.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0517fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 0x7f051814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f05177fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f05180aa750 0x7f051814ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41092/0 (socket says 172.21.15.41:41092) 2021-10-21T00:10:18.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f05177fe700 1 -- 172.21.15.41:0/1562043025 learned_addr learned my addr 172.21.15.41:0/1562043025 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:18.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0517fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 0x7f051814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35270/0 (socket says 172.21.15.41:35270) 2021-10-21T00:10:18.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 --2- 172.21.15.41:0/1562043025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 0x7f05180af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0516ffd700 1 -- 172.21.15.41:0/1562043025 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058390533 0 0) 0x7f05180609d0 con 0x7f05180aa750 2021-10-21T00:10:18.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0516ffd700 1 -- 172.21.15.41:0/1562043025 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0504003260 con 0x7f05180aa750 2021-10-21T00:10:18.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 -- 172.21.15.41:0/1562043025 >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 msgr2=0x7f051814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:18.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 --2- 172.21.15.41:0/1562043025 >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 0x7f051814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 -- 172.21.15.41:0/1562043025 >> v1:172.21.15.62:6789/0 conn(0x7f05180aa750 legacy=0x7f051814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 -- 172.21.15.41:0/1562043025 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180b1380 con 0x7f051814b350 2021-10-21T00:10:18.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051c8b2700 1 --2- 172.21.15.41:0/1562043025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 0x7f05180af7c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f05100032f0 tx=0x7f05100091d0).ready entity=mon.2 client_cookie=ec206022529135d1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0516ffd700 1 -- 172.21.15.41:0/1562043025 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f051000b600 con 0x7f051814b350 2021-10-21T00:10:18.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0516ffd700 1 -- 172.21.15.41:0/1562043025 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000b760 con 0x7f051814b350 2021-10-21T00:10:18.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f0516ffd700 1 -- 172.21.15.41:0/1562043025 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f051000b8d0 con 0x7f051814b350 2021-10-21T00:10:18.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- 172.21.15.41:0/1562043025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 msgr2=0x7f05180af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 --2- 172.21.15.41:0/1562043025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 0x7f05180af7c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f05100032f0 tx=0x7f05100091d0).stop 2021-10-21T00:10:18.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- 172.21.15.41:0/1562043025 shutdown_connections 2021-10-21T00:10:18.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 --2- 172.21.15.41:0/1562043025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f051814b350 0x7f05180af7c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 --2- 172.21.15.41:0/1562043025 >> v2:172.21.15.41:3300/0 conn(0x7f051805f9f0 0x7f051814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- 172.21.15.41:0/1562043025 >> 172.21.15.41:0/1562043025 conn(0x7f051805bca0 msgr2=0x7f051805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:18.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- 172.21.15.41:0/1562043025 shutdown_connections 2021-10-21T00:10:18.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.108+0000 7f051e315700 1 -- 172.21.15.41:0/1562043025 wait complete. 2021-10-21T00:10:18.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 Processor -- start 2021-10-21T00:10:18.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- start start 2021-10-21T00:10:18.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 0x7f0518064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 0x7f051815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051809a7c0 con 0x7f051805f9f0 2021-10-21T00:10:18.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518064770 con 0x7f051814b350 2021-10-21T00:10:18.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0518159700 con 0x7f05180aa750 2021-10-21T00:10:18.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35272/0 (socket says 172.21.15.41:35272) 2021-10-21T00:10:18.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 -- 172.21.15.41:0/1321627465 learned_addr learned my addr 172.21.15.41:0/1321627465 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:18.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051c8b2700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 0x7f051815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f05177fe700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 0x7f0518064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 -- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 msgr2=0x7f0518064280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 0x7f0518064280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 -- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 msgr2=0x7f051815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 0x7f051815a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 -- 172.21.15.41:0/1321627465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510009470 con 0x7f051805f9f0 2021-10-21T00:10:18.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051c8b2700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 0x7f051815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:18.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f05177fe700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 0x7f0518064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:18.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f0517fff700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f050c00c000 tx=0x7f050c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c010780 con 0x7f051805f9f0 2021-10-21T00:10:18.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0108e0 con 0x7f051805f9f0 2021-10-21T00:10:18.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05181599a0 con 0x7f051805f9f0 2021-10-21T00:10:18.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c010c40 con 0x7f051805f9f0 2021-10-21T00:10:18.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.112+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051815a5d0 con 0x7f051805f9f0 2021-10-21T00:10:18.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05180adac0 con 0x7f051805f9f0 2021-10-21T00:10:18.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f050c01c460 con 0x7f051805f9f0 2021-10-21T00:10:18.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f05157fa700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 0x7f04f8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f050c06be40 con 0x7f051805f9f0 2021-10-21T00:10:18.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f05177fe700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 0x7f04f8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.116+0000 7f05177fe700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 0x7f04f8055b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f0508008000 tx=0x7f0508009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.124+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05180adac0 con 0x7f051805f9f0 2021-10-21T00:10:18.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05180adac0 con 0x7f051805f9f0 2021-10-21T00:10:18.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f05157fa700 1 -- 172.21.15.41:0/1321627465 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f05180adac0 con 0x7f051805f9f0 2021-10-21T00:10:18.300 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:18.300 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:18.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 msgr2=0x7f04f8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 0x7f04f8055b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f0508008000 tx=0x7f0508009040).stop 2021-10-21T00:10:18.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 msgr2=0x7f0518148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f050c00c000 tx=0x7f050c006df0).stop 2021-10-21T00:10:18.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 shutdown_connections 2021-10-21T00:10:18.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04f8053640 0x7f04f8055b00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f051814b350 0x7f051815a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05180aa750 0x7f0518064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 --2- 172.21.15.41:0/1321627465 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f051805f9f0 0x7f0518148960 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 >> 172.21.15.41:0/1321627465 conn(0x7f051805bca0 msgr2=0x7f051805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:18.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 shutdown_connections 2021-10-21T00:10:18.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.292+0000 7f051e315700 1 -- 172.21.15.41:0/1321627465 wait complete. 2021-10-21T00:10:18.304 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:18.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:15.430405+0000', 'modified': '2021-10-21T00:10:16.433450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7008}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7008': {'gid': 7008, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3653268088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3653268088}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3653268088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:18.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:18.525 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:10:18.644 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7008,"want_state":"up:active","state":"up:active","rank_uptime":3.197573985,"mdsmap_epoch":45,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":7.5367272290000002} 2021-10-21T00:10:18.645 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7008, "mdsmap_epoch": 45, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 3.197573985, "state": "up:active", "uptime": 7.536727229, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:18.646 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:18.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 Processor -- start 2021-10-21T00:10:18.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 -- start start 2021-10-21T00:10:18.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9864062330 0x7f98640b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98640b3a20 0x7f986413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986405bd40 con 0x7f9864062f70 2021-10-21T00:10:18.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986405bf70 con 0x7f9864062330 2021-10-21T00:10:18.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9868f35700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9864142cb0 con 0x7f98640b3a20 2021-10-21T00:10:18.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9864062330 0x7f98640b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9864062330 0x7f98640b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35282/0 (socket says 172.21.15.41:35282) 2021-10-21T00:10:18.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 -- 172.21.15.41:0/472423522 learned_addr learned my addr 172.21.15.41:0/472423522 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:18.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f9863fff700 1 --2- 172.21.15.41:0/472423522 >> v2:172.21.15.62:3300/0 conn(0x7f98640b3a20 0x7f986413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 -- 172.21.15.41:0/472423522 >> v2:172.21.15.62:3300/0 conn(0x7f98640b3a20 msgr2=0x7f986413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:18.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 --2- 172.21.15.41:0/472423522 >> v2:172.21.15.62:3300/0 conn(0x7f98640b3a20 0x7f986413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 -- 172.21.15.41:0/472423522 >> v1:172.21.15.62:6789/0 conn(0x7f9864062f70 legacy=0x7f986405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.744+0000 7f98637fe700 1 -- 172.21.15.41:0/472423522 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864142950 con 0x7f9864062330 2021-10-21T00:10:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f98637fe700 1 --2- 172.21.15.41:0/472423522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f98640b3f30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f9854002f70 tx=0x7f9854006eb0).ready entity=mon.0 client_cookie=c1f5779b2d2c3b3f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f98627fc700 1 -- 172.21.15.41:0/472423522 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f985400d610 con 0x7f9864062330 2021-10-21T00:10:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f98627fc700 1 -- 172.21.15.41:0/472423522 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854000e90 con 0x7f9864062330 2021-10-21T00:10:18.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f98627fc700 1 -- 172.21.15.41:0/472423522 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f985400d9a0 con 0x7f9864062330 2021-10-21T00:10:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 -- 172.21.15.41:0/472423522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 msgr2=0x7f98640b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 --2- 172.21.15.41:0/472423522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f98640b3f30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f9854002f70 tx=0x7f9854006eb0).stop 2021-10-21T00:10:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 -- 172.21.15.41:0/472423522 shutdown_connections 2021-10-21T00:10:18.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 --2- 172.21.15.41:0/472423522 >> v2:172.21.15.62:3300/0 conn(0x7f98640b3a20 0x7f986413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 --2- 172.21.15.41:0/472423522 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f98640b3f30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 -- 172.21.15.41:0/472423522 >> 172.21.15.41:0/472423522 conn(0x7f98640b9080 msgr2=0x7f98640b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:18.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 -- 172.21.15.41:0/472423522 shutdown_connections 2021-10-21T00:10:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.748+0000 7f9868f35700 1 -- 172.21.15.41:0/472423522 wait complete. 2021-10-21T00:10:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 Processor -- start 2021-10-21T00:10:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- start start 2021-10-21T00:10:18.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9864062f70 0x7f9864144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98640b3a20 0x7f9864155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98641469a0 con 0x7f9864062330 2021-10-21T00:10:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864113070 con 0x7f98640b3a20 2021-10-21T00:10:18.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9864113310 con 0x7f9864062f70 2021-10-21T00:10:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35286/0 (socket says 172.21.15.41:35286) 2021-10-21T00:10:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 -- 172.21.15.41:0/4289102842 learned_addr learned my addr 172.21.15.41:0/4289102842 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:18.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9863fff700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98640b3a20 0x7f9864155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9862ffd700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9864062f70 0x7f9864144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 -- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9864062f70 msgr2=0x7f9864144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9864062f70 0x7f9864144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 -- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98640b3a20 msgr2=0x7f9864155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98640b3a20 0x7f9864155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 -- 172.21.15.41:0/4289102842 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985400b1e0 con 0x7f9864062330 2021-10-21T00:10:18.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f98637fe700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f9854002f70 tx=0x7f9854015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f985400d290 con 0x7f9864062330 2021-10-21T00:10:18.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854006b40 con 0x7f9864062330 2021-10-21T00:10:18.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98641135b0 con 0x7f9864062330 2021-10-21T00:10:18.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9854011d70 con 0x7f9864062330 2021-10-21T00:10:18.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.752+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98640af250 con 0x7f9864062330 2021-10-21T00:10:18.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9864057350 con 0x7f9864062330 2021-10-21T00:10:18.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9854025030 con 0x7f9864062330 2021-10-21T00:10:18.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9860ff9700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 0x7f9848055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:18.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f985406cad0 con 0x7f9864062330 2021-10-21T00:10:18.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9862ffd700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 0x7f9848055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:18.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.756+0000 7f9862ffd700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 0x7f9848055a40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f984c00d000 tx=0x7f984c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:18.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.764+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9854043c30 con 0x7f9864062330 2021-10-21T00:10:18.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.892+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f986405d080 con 0x7f9864062330 2021-10-21T00:10:18.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.892+0000 7f9860ff9700 1 -- 172.21.15.41:0/4289102842 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9854023020 con 0x7f9864062330 2021-10-21T00:10:18.902 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:18.903 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":88,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:16.434078+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:13.910039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:14.803889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:18.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 msgr2=0x7f9848055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 0x7f9848055a40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f984c00d000 tx=0x7f984c000bc0).stop 2021-10-21T00:10:18.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 msgr2=0x7f9864113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:18.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f9854002f70 tx=0x7f9854015000).stop 2021-10-21T00:10:18.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 shutdown_connections 2021-10-21T00:10:18.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9848053580 0x7f9848055a40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98640b3a20 0x7f9864155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9864062f70 0x7f9864144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 --2- 172.21.15.41:0/4289102842 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9864062330 0x7f9864113a50 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:18.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 >> 172.21.15.41:0/4289102842 conn(0x7f98640b9080 msgr2=0x7f98640b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:18.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 shutdown_connections 2021-10-21T00:10:18.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:18.896+0000 7f9868f35700 1 -- 172.21.15.41:0/4289102842 wait complete. 2021-10-21T00:10:18.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:10:13.910039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:10:14.803889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:10:18.916 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:19.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.024+0000 7f119384e700 1 Processor -- start 2021-10-21T00:10:19.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.024+0000 7f119384e700 1 -- start start 2021-10-21T00:10:19.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f118c0b9ca0 0x7f118c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f118c0b26d0 0x7f118c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0ba080 con 0x7f118c0b31e0 2021-10-21T00:10:19.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c05c670 con 0x7f118c0b26d0 2021-10-21T00:10:19.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c05c8e0 con 0x7f118c0b9ca0 2021-10-21T00:10:19.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f118c0b26d0 0x7f118c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1190de9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f118c0b31e0 0x7f118c0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33064/0 (socket says 172.21.15.41:33064) 2021-10-21T00:10:19.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1190de9700 1 -- 172.21.15.41:0/2920019044 learned_addr learned my addr 172.21.15.41:0/2920019044 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:19.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f11915ea700 1 --2- 172.21.15.41:0/2920019044 >> v2:172.21.15.62:3300/0 conn(0x7f118c0b9ca0 0x7f118c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 -- 172.21.15.41:0/2920019044 >> v2:172.21.15.62:3300/0 conn(0x7f118c0b9ca0 msgr2=0x7f118c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:19.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1177fff700 1 -- 172.21.15.41:0/2920019044 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432223152 0 0) 0x7f118c0ba080 con 0x7f118c0b31e0 2021-10-21T00:10:19.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 --2- 172.21.15.41:0/2920019044 >> v2:172.21.15.62:3300/0 conn(0x7f118c0b9ca0 0x7f118c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 -- 172.21.15.41:0/2920019044 >> v1:172.21.15.41:6789/0 conn(0x7f118c0b31e0 legacy=0x7f118c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 -- 172.21.15.41:0/2920019044 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c05cb80 con 0x7f118c0b26d0 2021-10-21T00:10:19.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1191deb700 1 --2- 172.21.15.41:0/2920019044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c141bc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f11840032f0 tx=0x7f11840091d0).ready entity=mon.0 client_cookie=81060b13636c3c61 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1177fff700 1 -- 172.21.15.41:0/2920019044 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118400b680 con 0x7f118c0b26d0 2021-10-21T00:10:19.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1177fff700 1 -- 172.21.15.41:0/2920019044 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400b7e0 con 0x7f118c0b26d0 2021-10-21T00:10:19.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f1177fff700 1 -- 172.21.15.41:0/2920019044 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118400b950 con 0x7f118c0b26d0 2021-10-21T00:10:19.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- 172.21.15.41:0/2920019044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 msgr2=0x7f118c141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 --2- 172.21.15.41:0/2920019044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c141bc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f11840032f0 tx=0x7f11840091d0).stop 2021-10-21T00:10:19.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- 172.21.15.41:0/2920019044 shutdown_connections 2021-10-21T00:10:19.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 --2- 172.21.15.41:0/2920019044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c141bc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 --2- 172.21.15.41:0/2920019044 >> v2:172.21.15.62:3300/0 conn(0x7f118c0b9ca0 0x7f118c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- 172.21.15.41:0/2920019044 >> 172.21.15.41:0/2920019044 conn(0x7f118c062f00 msgr2=0x7f118c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- 172.21.15.41:0/2920019044 shutdown_connections 2021-10-21T00:10:19.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.028+0000 7f119384e700 1 -- 172.21.15.41:0/2920019044 wait complete. 2021-10-21T00:10:19.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 Processor -- start 2021-10-21T00:10:19.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- start start 2021-10-21T00:10:19.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f118c0b31e0 0x7f118c140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f118c0b9ca0 0x7f118c141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0ae300 con 0x7f118c0b26d0 2021-10-21T00:10:19.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c152230 con 0x7f118c0b9ca0 2021-10-21T00:10:19.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1524d0 con 0x7f118c0b31e0 2021-10-21T00:10:19.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35300/0 (socket says 172.21.15.41:35300) 2021-10-21T00:10:19.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 -- 172.21.15.41:0/50725662 learned_addr learned my addr 172.21.15.41:0/50725662 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f1191deb700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f118c0b9ca0 0x7f118c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f1190de9700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f118c0b31e0 0x7f118c140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 -- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f118c0b31e0 msgr2=0x7f118c140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f118c0b31e0 0x7f118c140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 -- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f118c0b9ca0 msgr2=0x7f118c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f118c0b9ca0 0x7f118c141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 -- 172.21.15.41:0/50725662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009470 con 0x7f118c0b26d0 2021-10-21T00:10:19.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f11915ea700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f118800c000 tx=0x7f1188006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1188011750 con 0x7f118c0b26d0 2021-10-21T00:10:19.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11880118b0 con 0x7f118c0b26d0 2021-10-21T00:10:19.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c152770 con 0x7f118c0b26d0 2021-10-21T00:10:19.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1188011c10 con 0x7f118c0b26d0 2021-10-21T00:10:19.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c152c10 con 0x7f118c0b26d0 2021-10-21T00:10:19.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.032+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c057350 con 0x7f118c0b26d0 2021-10-21T00:10:19.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.036+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1188011d70 con 0x7f118c0b26d0 2021-10-21T00:10:19.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.036+0000 7f117effd700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 0x7f1168055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.036+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f118806be20 con 0x7f118c0b26d0 2021-10-21T00:10:19.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.036+0000 7f1190de9700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 0x7f1168055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.036+0000 7f1190de9700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 0x7f1168055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f118000d000 tx=0x7f11800011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.044+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1188042e70 con 0x7f118c0b26d0 2021-10-21T00:10:19.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.168+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f118c149110 con 0x7f118c0b26d0 2021-10-21T00:10:19.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.168+0000 7f117effd700 1 -- 172.21.15.41:0/50725662 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1188046490 con 0x7f118c0b26d0 2021-10-21T00:10:19.178 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:19.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 msgr2=0x7f1168055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 0x7f1168055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f118000d000 tx=0x7f11800011a0).stop 2021-10-21T00:10:19.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 msgr2=0x7f118c0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f118800c000 tx=0x7f1188006df0).stop 2021-10-21T00:10:19.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 shutdown_connections 2021-10-21T00:10:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1168053610 0x7f1168055ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f118c0b9ca0 0x7f118c141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f118c0b31e0 0x7f118c140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 --2- 172.21.15.41:0/50725662 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f118c0b26d0 0x7f118c0aeed0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 >> 172.21.15.41:0/50725662 conn(0x7f118c062f00 msgr2=0x7f118c142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 shutdown_connections 2021-10-21T00:10:19.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.172+0000 7f119384e700 1 -- 172.21.15.41:0/50725662 wait complete. 2021-10-21T00:10:19.195 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:19.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 Processor -- start 2021-10-21T00:10:19.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 -- start start 2021-10-21T00:10:19.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a980b0eb0 0x7f6a9805ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a98060440 0x7f6a9813c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9805c430 con 0x7f6a980639e0 2021-10-21T00:10:19.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9805fb60 con 0x7f6a980b0eb0 2021-10-21T00:10:19.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9e6fb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9805c6d0 con 0x7f6a98060440 2021-10-21T00:10:19.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a980b0eb0 0x7f6a9805ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6a980b0eb0 0x7f6a9805ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35308/0 (socket says 172.21.15.41:35308) 2021-10-21T00:10:19.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 -- 172.21.15.41:0/509961372 learned_addr learned my addr 172.21.15.41:0/509961372 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a97fff700 1 --1- 172.21.15.41:0/509961372 >> v1:172.21.15.41:6789/0 conn(0x7f6a980639e0 0x7f6a98142bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33076/0 (socket says 172.21.15.41:33076) 2021-10-21T00:10:19.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a9cc98700 1 --2- 172.21.15.41:0/509961372 >> v2:172.21.15.62:3300/0 conn(0x7f6a98060440 0x7f6a9813c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 -- 172.21.15.41:0/509961372 >> v2:172.21.15.62:3300/0 conn(0x7f6a98060440 msgr2=0x7f6a9813c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:19.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 --2- 172.21.15.41:0/509961372 >> v2:172.21.15.62:3300/0 conn(0x7f6a98060440 0x7f6a9813c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 -- 172.21.15.41:0/509961372 >> v1:172.21.15.41:6789/0 conn(0x7f6a980639e0 legacy=0x7f6a98142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 -- 172.21.15.41:0/509961372 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9805c970 con 0x7f6a980b0eb0 2021-10-21T00:10:19.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a977fe700 1 --2- 172.21.15.41:0/509961372 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980b0eb0 0x7f6a9805ff50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88006eb0).ready entity=mon.0 client_cookie=f7c4cd68d403eba3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a96ffd700 1 -- 172.21.15.41:0/509961372 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8800d610 con 0x7f6a980b0eb0 2021-10-21T00:10:19.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a96ffd700 1 -- 172.21.15.41:0/509961372 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88000e90 con 0x7f6a980b0eb0 2021-10-21T00:10:19.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.296+0000 7f6a96ffd700 1 -- 172.21.15.41:0/509961372 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8800d9a0 con 0x7f6a980b0eb0 2021-10-21T00:10:19.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/509961372 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980b0eb0 msgr2=0x7f6a9805ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/509961372 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980b0eb0 0x7f6a9805ff50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88006eb0).stop 2021-10-21T00:10:19.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/509961372 shutdown_connections 2021-10-21T00:10:19.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/509961372 >> v2:172.21.15.62:3300/0 conn(0x7f6a98060440 0x7f6a9813c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/509961372 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980b0eb0 0x7f6a9805ff50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/509961372 >> 172.21.15.41:0/509961372 conn(0x7f6a98061e00 msgr2=0x7f6a98069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/509961372 shutdown_connections 2021-10-21T00:10:19.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/509961372 wait complete. 2021-10-21T00:10:19.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 Processor -- start 2021-10-21T00:10:19.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.300+0000 7f6a9e6fb700 1 -- start start 2021-10-21T00:10:19.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98060440 0x7f6a9813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a980b0eb0 0x7f6a98142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98146690 con 0x7f6a980639e0 2021-10-21T00:10:19.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98146d60 con 0x7f6a98060440 2021-10-21T00:10:19.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98144c60 con 0x7f6a980b0eb0 2021-10-21T00:10:19.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35314/0 (socket says 172.21.15.41:35314) 2021-10-21T00:10:19.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 -- 172.21.15.41:0/2665087283 learned_addr learned my addr 172.21.15.41:0/2665087283 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a97fff700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98060440 0x7f6a9813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9cc98700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a980b0eb0 0x7f6a98142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 -- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a980b0eb0 msgr2=0x7f6a98142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a980b0eb0 0x7f6a98142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 -- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98060440 msgr2=0x7f6a9813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98060440 0x7f6a9813e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 -- 172.21.15.41:0/2665087283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8800b1e0 con 0x7f6a980639e0 2021-10-21T00:10:19.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a977fe700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a88011760 con 0x7f6a980639e0 2021-10-21T00:10:19.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880118c0 con 0x7f6a980639e0 2021-10-21T00:10:19.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981468c0 con 0x7f6a980639e0 2021-10-21T00:10:19.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a88011c20 con 0x7f6a980639e0 2021-10-21T00:10:19.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981447c0 con 0x7f6a980639e0 2021-10-21T00:10:19.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.304+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a98144e20 con 0x7f6a980639e0 2021-10-21T00:10:19.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.308+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a88025030 con 0x7f6a980639e0 2021-10-21T00:10:19.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.308+0000 7f6a957fa700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 0x7f6a78055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.308+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a8806cb00 con 0x7f6a980639e0 2021-10-21T00:10:19.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.308+0000 7f6a97fff700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 0x7f6a78055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.308+0000 7f6a97fff700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 0x7f6a78055b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f6a8c00d000 tx=0x7f6a8c007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.312+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a98144e20 con 0x7f6a980639e0 2021-10-21T00:10:19.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.440+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a98144e20 con 0x7f6a980639e0 2021-10-21T00:10:19.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a957fa700 1 -- 172.21.15.41:0/2665087283 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a98144e20 con 0x7f6a980639e0 2021-10-21T00:10:19.458 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:19.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 msgr2=0x7f6a78055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 0x7f6a78055b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f6a8c00d000 tx=0x7f6a8c007b80).stop 2021-10-21T00:10:19.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 msgr2=0x7f6a9813e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88015000).stop 2021-10-21T00:10:19.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 shutdown_connections 2021-10-21T00:10:19.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6a780536a0 0x7f6a78055b60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a980b0eb0 0x7f6a98142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6a980639e0 0x7f6a9813e5d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 --2- 172.21.15.41:0/2665087283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98060440 0x7f6a9813e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 >> 172.21.15.41:0/2665087283 conn(0x7f6a98061e00 msgr2=0x7f6a9813cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 shutdown_connections 2021-10-21T00:10:19.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.444+0000 7f6a9e6fb700 1 -- 172.21.15.41:0/2665087283 wait complete. 2021-10-21T00:10:19.464 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:10:19.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 Processor -- start 2021-10-21T00:10:19.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 -- start start 2021-10-21T00:10:19.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60480b1800 0x7f60480b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f604813c670 0x7f6048142940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604805caf0 con 0x7f60480af770 2021-10-21T00:10:19.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6048146e00 con 0x7f604813c670 2021-10-21T00:10:19.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.564+0000 7f6047fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604805bfb0 con 0x7f60480b1800 2021-10-21T00:10:19.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60480b1800 0x7f60480b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f604813c670 0x7f6048142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60467fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f60480af770 0x7f60481466f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41148/0 (socket says 172.21.15.41:41148) 2021-10-21T00:10:19.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60467fc700 1 -- 172.21.15.41:0/3493470501 learned_addr learned my addr 172.21.15.41:0/3493470501 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:19.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 -- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60480b1800 msgr2=0x7f60480b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:19.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 --2- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60480b1800 0x7f60480b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 -- 172.21.15.41:0/3493470501 >> v1:172.21.15.62:6789/0 conn(0x7f60480af770 legacy=0x7f60481466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 -- 172.21.15.41:0/3493470501 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048145fb0 con 0x7f604813c670 2021-10-21T00:10:19.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f60477fe700 1 --2- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604813c670 0x7f6048142940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f60400032f0 tx=0x7f60400091d0).ready entity=mon.1 client_cookie=1b0fa400d3759e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6045ffb700 1 -- 172.21.15.41:0/3493470501 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604000b6c0 con 0x7f604813c670 2021-10-21T00:10:19.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6045ffb700 1 -- 172.21.15.41:0/3493470501 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000b820 con 0x7f604813c670 2021-10-21T00:10:19.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6045ffb700 1 -- 172.21.15.41:0/3493470501 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604000b990 con 0x7f604813c670 2021-10-21T00:10:19.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604813c670 msgr2=0x7f6048142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 --2- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604813c670 0x7f6048142940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f60400032f0 tx=0x7f60400091d0).stop 2021-10-21T00:10:19.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- 172.21.15.41:0/3493470501 shutdown_connections 2021-10-21T00:10:19.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 --2- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604813c670 0x7f6048142940 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 --2- 172.21.15.41:0/3493470501 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60480b1800 0x7f60480b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- 172.21.15.41:0/3493470501 >> 172.21.15.41:0/3493470501 conn(0x7f60480627b0 msgr2=0x7f6048062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- 172.21.15.41:0/3493470501 shutdown_connections 2021-10-21T00:10:19.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- 172.21.15.41:0/3493470501 wait complete. 2021-10-21T00:10:19.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 Processor -- start 2021-10-21T00:10:19.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.568+0000 7f6047fff700 1 -- start start 2021-10-21T00:10:19.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 0x7f6048148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f604813c670 0x7f6048155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604813ca80 con 0x7f60480af770 2021-10-21T00:10:19.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048155240 con 0x7f60480b1800 2021-10-21T00:10:19.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604813ccb0 con 0x7f604813c670 2021-10-21T00:10:19.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f60467fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 0x7f6048148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f60477fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f604813c670 0x7f6048155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35330/0 (socket says 172.21.15.41:35330) 2021-10-21T00:10:19.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 -- 172.21.15.41:0/730005773 learned_addr learned my addr 172.21.15.41:0/730005773 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 -- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f604813c670 msgr2=0x7f6048155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f604813c670 0x7f6048155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 -- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 msgr2=0x7f6048148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 0x7f6048148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 -- 172.21.15.41:0/730005773 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009470 con 0x7f60480af770 2021-10-21T00:10:19.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f60467fc700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 0x7f6048148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:19.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6046ffd700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f6048153030 tx=0x7f6038006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6038010780 con 0x7f60480af770 2021-10-21T00:10:19.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380108e0 con 0x7f60480af770 2021-10-21T00:10:19.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604813cf50 con 0x7f60480af770 2021-10-21T00:10:19.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6038010c40 con 0x7f60480af770 2021-10-21T00:10:19.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.572+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604813d350 con 0x7f60480af770 2021-10-21T00:10:19.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f603801c460 con 0x7f60480af770 2021-10-21T00:10:19.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604813e1f0 con 0x7f60480af770 2021-10-21T00:10:19.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f603ffff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 0x7f602c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f603806bce0 con 0x7f60480af770 2021-10-21T00:10:19.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f60467fc700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 0x7f602c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.576+0000 7f60467fc700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 0x7f602c055ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f603000d000 tx=0x7f6030007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.580+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f604813e1f0 con 0x7f60480af770 2021-10-21T00:10:19.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f604813e1f0 con 0x7f60480af770 2021-10-21T00:10:19.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f603ffff700 1 -- 172.21.15.41:0/730005773 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7f604813e1f0 con 0x7f60480af770 2021-10-21T00:10:19.716 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:19.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 msgr2=0x7f602c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 0x7f602c055ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f603000d000 tx=0x7f6030007b80).stop 2021-10-21T00:10:19.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 msgr2=0x7f6048151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f6048153030 tx=0x7f6038006df0).stop 2021-10-21T00:10:19.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 shutdown_connections 2021-10-21T00:10:19.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f602c053610 0x7f602c055ad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f604813c670 0x7f6048155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60480b1800 0x7f6048148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 --2- 172.21.15.41:0/730005773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60480af770 0x7f6048151cd0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 >> 172.21.15.41:0/730005773 conn(0x7f60480627b0 msgr2=0x7f60480b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 shutdown_connections 2021-10-21T00:10:19.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.708+0000 7f6047fff700 1 -- 172.21.15.41:0/730005773 wait complete. 2021-10-21T00:10:19.730 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:10:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.832+0000 7fc69b3c2700 1 Processor -- start 2021-10-21T00:10:19.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.832+0000 7fc69b3c2700 1 -- start start 2021-10-21T00:10:19.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6940b5f70 0x7fc694143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc6940aebb0 0x7fc6941441d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6940b6350 con 0x7fc69405cd60 2021-10-21T00:10:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6940b13b0 con 0x7fc6940aebb0 2021-10-21T00:10:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69405c830 con 0x7fc6940b5f70 2021-10-21T00:10:19.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc6940aebb0 0x7fc6941441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc6940aebb0 0x7fc6941441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35336/0 (socket says 172.21.15.41:35336) 2021-10-21T00:10:19.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 -- 172.21.15.41:0/348469504 learned_addr learned my addr 172.21.15.41:0/348469504 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69a3c0700 1 --2- 172.21.15.41:0/348469504 >> v2:172.21.15.62:3300/0 conn(0x7fc6940b5f70 0x7fc694143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 -- 172.21.15.41:0/348469504 >> v2:172.21.15.62:3300/0 conn(0x7fc6940b5f70 msgr2=0x7fc694143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 --2- 172.21.15.41:0/348469504 >> v2:172.21.15.62:3300/0 conn(0x7fc6940b5f70 0x7fc694143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 -- 172.21.15.41:0/348469504 >> v1:172.21.15.62:6789/0 conn(0x7fc69405cd60 legacy=0x7fc6940afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 -- 172.21.15.41:0/348469504 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69405cad0 con 0x7fc6940aebb0 2021-10-21T00:10:19.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc699bbf700 1 --2- 172.21.15.41:0/348469504 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc6941441d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fc690002f70 tx=0x7fc690006eb0).ready entity=mon.0 client_cookie=103b212d731231f4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc6993be700 1 -- 172.21.15.41:0/348469504 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69000d5c0 con 0x7fc6940aebb0 2021-10-21T00:10:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc6993be700 1 -- 172.21.15.41:0/348469504 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc690000e90 con 0x7fc6940aebb0 2021-10-21T00:10:19.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc6993be700 1 -- 172.21.15.41:0/348469504 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69000d950 con 0x7fc6940aebb0 2021-10-21T00:10:19.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- 172.21.15.41:0/348469504 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 msgr2=0x7fc6941441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/348469504 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc6941441d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fc690002f70 tx=0x7fc690006eb0).stop 2021-10-21T00:10:19.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- 172.21.15.41:0/348469504 shutdown_connections 2021-10-21T00:10:19.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/348469504 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc6941441d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/348469504 >> v2:172.21.15.62:3300/0 conn(0x7fc6940b5f70 0x7fc694143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- 172.21.15.41:0/348469504 >> 172.21.15.41:0/348469504 conn(0x7fc6940639f0 msgr2=0x7fc6940b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- 172.21.15.41:0/348469504 shutdown_connections 2021-10-21T00:10:19.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.836+0000 7fc69b3c2700 1 -- 172.21.15.41:0/348469504 wait complete. 2021-10-21T00:10:19.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 Processor -- start 2021-10-21T00:10:19.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- start start 2021-10-21T00:10:19.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6940b5f70 0x7fc694138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694144090 con 0x7fc6940aebb0 2021-10-21T00:10:19.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694065dd0 con 0x7fc69405cd60 2021-10-21T00:10:19.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940646e0 con 0x7fc6940b5f70 2021-10-21T00:10:19.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69a3c0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35342/0 (socket says 172.21.15.41:35342) 2021-10-21T00:10:19.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69a3c0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47258/0 (socket says 172.21.15.41:47258) 2021-10-21T00:10:19.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 -- 172.21.15.41:0/47661750 learned_addr learned my addr 172.21.15.41:0/47661750 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:19.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69abc1700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6940b5f70 0x7fc694138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 -- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6940b5f70 msgr2=0x7fc694138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6940b5f70 0x7fc694138d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 -- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 msgr2=0x7fc6940641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 -- 172.21.15.41:0/47661750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69000b1e0 con 0x7fc6940aebb0 2021-10-21T00:10:19.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69a3c0700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:19.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc699bbf700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fc690002f70 tx=0x7fc690015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc690011760 con 0x7fc6940aebb0 2021-10-21T00:10:19.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900118c0 con 0x7fc6940aebb0 2021-10-21T00:10:19.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc694152550 con 0x7fc6940aebb0 2021-10-21T00:10:19.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc690011c20 con 0x7fc6940aebb0 2021-10-21T00:10:19.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.840+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6941436c0 con 0x7fc6940aebb0 2021-10-21T00:10:19.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.844+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6941526e0 con 0x7fc6940aebb0 2021-10-21T00:10:19.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.844+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc69001a040 con 0x7fc6940aebb0 2021-10-21T00:10:19.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.844+0000 7fc6877fe700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 0x7fc674055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:19.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.844+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc69006c730 con 0x7fc6940aebb0 2021-10-21T00:10:19.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.844+0000 7fc69a3c0700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 0x7fc674055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:19.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.848+0000 7fc69a3c0700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 0x7fc674055b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc68800b000 tx=0x7fc688006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:19.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.852+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc690043880 con 0x7fc6940aebb0 2021-10-21T00:10:19.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.976+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc694067810 con 0x7fc6940aebb0 2021-10-21T00:10:19.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.976+0000 7fc6877fe700 1 -- 172.21.15.41:0/47661750 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc6900230a0 con 0x7fc6940aebb0 2021-10-21T00:10:19.986 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:19.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 msgr2=0x7fc674055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 0x7fc674055b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc68800b000 tx=0x7fc688006df0).stop 2021-10-21T00:10:19.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 msgr2=0x7fc694152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:19.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fc690002f70 tx=0x7fc690015000).stop 2021-10-21T00:10:19.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 shutdown_connections 2021-10-21T00:10:19.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6740536d0 0x7fc674055b90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6940b5f70 0x7fc694138d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc6940aebb0 0x7fc694152060 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 --2- 172.21.15.41:0/47661750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc69405cd60 0x7fc6940641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:19.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 >> 172.21.15.41:0/47661750 conn(0x7fc6940639f0 msgr2=0x7fc69413c620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:19.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 shutdown_connections 2021-10-21T00:10:19.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:19.980+0000 7fc69b3c2700 1 -- 172.21.15.41:0/47661750 wait complete. 2021-10-21T00:10:19.999 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:10:19.999 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:20.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.092+0000 7f694f8f4700 1 Processor -- start 2021-10-21T00:10:20.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.092+0000 7f694f8f4700 1 -- start start 2021-10-21T00:10:20.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 0x7f6948152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480609d0 con 0x7f69480aa750 2021-10-21T00:10:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694805fdd0 con 0x7f694805f9f0 2021-10-21T00:10:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b1620 con 0x7f694814fc90 2021-10-21T00:10:20.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694ce8f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f69480aa750 0x7f694814ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33120/0 (socket says 172.21.15.41:33120) 2021-10-21T00:10:20.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694ce8f700 1 -- 172.21.15.41:0/507660657 learned_addr learned my addr 172.21.15.41:0/507660657 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:20.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694de91700 1 --2- 172.21.15.41:0/507660657 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 0x7f6948152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:20.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635463004 0 0) 0x7f69480609d0 con 0x7f69480aa750 2021-10-21T00:10:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6934003260 con 0x7f69480aa750 2021-10-21T00:10:20.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694de91700 1 -- 172.21.15.41:0/507660657 >> v1:172.21.15.62:6789/0 conn(0x7f694805f9f0 legacy=0x7f694814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694de91700 1 -- 172.21.15.41:0/507660657 >> v1:172.21.15.41:6789/0 conn(0x7f69480aa750 legacy=0x7f694814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141988938 0 0) 0x7f694805fdd0 con 0x7f694805f9f0 2021-10-21T00:10:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694de91700 1 -- 172.21.15.41:0/507660657 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694814b570 con 0x7f694814fc90 2021-10-21T00:10:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694de91700 1 --2- 172.21.15.41:0/507660657 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 0x7f6948152080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6938002f70 tx=0x7f6938006df0).ready entity=mon.2 client_cookie=ec12d4afe04b4f2a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:20.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693800d570 con 0x7f694814fc90 2021-10-21T00:10:20.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938000e90 con 0x7f694814fc90 2021-10-21T00:10:20.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f6947fff700 1 -- 172.21.15.41:0/507660657 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693800d8c0 con 0x7f694814fc90 2021-10-21T00:10:20.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- 172.21.15.41:0/507660657 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 msgr2=0x7f6948152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 --2- 172.21.15.41:0/507660657 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 0x7f6948152080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6938002f70 tx=0x7f6938006df0).stop 2021-10-21T00:10:20.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- 172.21.15.41:0/507660657 shutdown_connections 2021-10-21T00:10:20.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 --2- 172.21.15.41:0/507660657 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f694814fc90 0x7f6948152080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- 172.21.15.41:0/507660657 >> 172.21.15.41:0/507660657 conn(0x7f694805bca0 msgr2=0x7f694805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:20.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- 172.21.15.41:0/507660657 shutdown_connections 2021-10-21T00:10:20.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.096+0000 7f694f8f4700 1 -- 172.21.15.41:0/507660657 wait complete. 2021-10-21T00:10:20.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 Processor -- start 2021-10-21T00:10:20.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- start start 2021-10-21T00:10:20.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f694805f9f0 0x7f6948159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:20.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 0x7f69480b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:20.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:20.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948147390 con 0x7f694814fc90 2021-10-21T00:10:20.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480ae7a0 con 0x7f694805f9f0 2021-10-21T00:10:20.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69481481b0 con 0x7f69480aa750 2021-10-21T00:10:20.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694de91700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:20.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694de91700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35356/0 (socket says 172.21.15.41:35356) 2021-10-21T00:10:20.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694de91700 1 -- 172.21.15.41:0/1237237031 learned_addr learned my addr 172.21.15.41:0/1237237031 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:20.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 0x7f69480b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:20.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694d690700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f694805f9f0 0x7f6948159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:20.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 -- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f694805f9f0 msgr2=0x7f6948159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f694805f9f0 0x7f6948159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 -- 172.21.15.41:0/1237237031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 msgr2=0x7f6948149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 -- 172.21.15.41:0/1237237031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693800b180 con 0x7f69480aa750 2021-10-21T00:10:20.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694de91700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:20.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694ce8f700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 0x7f69480b46c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f693c001110 tx=0x7f693c0079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:20.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693c00cda0 con 0x7f69480aa750 2021-10-21T00:10:20.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c007110 con 0x7f69480aa750 2021-10-21T00:10:20.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693c007470 con 0x7f69480aa750 2021-10-21T00:10:20.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694814b7d0 con 0x7f69480aa750 2021-10-21T00:10:20.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.100+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69480af180 con 0x7f69480aa750 2021-10-21T00:10:20.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69480ae9a0 con 0x7f69480aa750 2021-10-21T00:10:20.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f693c01b070 con 0x7f69480aa750 2021-10-21T00:10:20.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f69467fc700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 0x7f6928055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:20.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f693c06aee0 con 0x7f69480aa750 2021-10-21T00:10:20.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f694d690700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 0x7f6928055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:20.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.104+0000 7f694d690700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 0x7f6928055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f694000d000 tx=0x7f6940007d80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:20.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.112+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f693c041eb0 con 0x7f69480aa750 2021-10-21T00:10:20.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.276+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6948148340 con 0x7f69480aa750 2021-10-21T00:10:20.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f69467fc700 1 -- 172.21.15.41:0/1237237031 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f693c0454d0 con 0x7f69480aa750 2021-10-21T00:10:20.288 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:20.288 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:20.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 msgr2=0x7f6928055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 0x7f6928055b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f694000d000 tx=0x7f6940007d80).stop 2021-10-21T00:10:20.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 msgr2=0x7f69480b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:20.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 0x7f69480b46c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f693c001110 tx=0x7f693c0079e0).stop 2021-10-21T00:10:20.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 shutdown_connections 2021-10-21T00:10:20.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f69280536a0 0x7f6928055b60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f694814fc90 0x7f6948149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f69480aa750 0x7f69480b46c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 --2- 172.21.15.41:0/1237237031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f694805f9f0 0x7f6948159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:20.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 >> 172.21.15.41:0/1237237031 conn(0x7f694805bca0 msgr2=0x7f69480b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:20.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 shutdown_connections 2021-10-21T00:10:20.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:20.280+0000 7f694f8f4700 1 -- 172.21.15.41:0/1237237031 wait complete. 2021-10-21T00:10:20.293 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:20.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:15.430405+0000', 'modified': '2021-10-21T00:10:16.433450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7008}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7008': {'gid': 7008, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3653268088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3653268088}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3653268088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:20.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:20.504 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:10:20.623 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7008,"want_state":"up:active","state":"up:active","rank_uptime":5.1740030199999998,"mdsmap_epoch":45,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":9.5131633210000004} 2021-10-21T00:10:20.624 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7008, "mdsmap_epoch": 45, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 5.17400302, "state": "up:active", "uptime": 9.513163321, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:20.624 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:10:20.625 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:10:20.625 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:10:20.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:20.626 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:20.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:10:20.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:20.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:20.712 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:20.714 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:20.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:20.716 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:10:20.721 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:10:20.721 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:20.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:10:20.739 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:20.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:20.795 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:20.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:20.796 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:10:20.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:10:20.793+0000 7f0e6b9f9080 -1 init, newargv = 0x55a47122ad20 newargc=9 2021-10-21T00:10:20.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14716]: starting ceph client 2021-10-21T00:10:20.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14716]: starting fuse 2021-10-21T00:10:21.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:10:21.925 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:21.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:21.981 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:21.983 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:21.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:21.985 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:10:21.991 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:10:21.992 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:10:21.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:21.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:10:21.994 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:10:21.995 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:10:21.996 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:10:21.998 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:10:21.999 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:22.000 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:10:22.000 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:10:22.001 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:10:22.002 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:22.003 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:10:22.003 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:10:22.004 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:10:22.006 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:10:22.006 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:22.007 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:10:22.009 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:10:22.009 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:10:22.010 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:10:22.012 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:10:22.013 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:22.013 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:10:22.014 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:10:22.059 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14716.asok 2021-10-21T00:10:22.064 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14716.asok 2021-10-21T00:10:22.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:22.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14716.asok status 2021-10-21T00:10:22.199 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:10:22.200 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:10:22.200 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:10:22.200 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:10:22.201 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:10:22.201 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:10:22.202 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:10:22.205 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14716", 2021-10-21T00:10:22.205 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:10:22.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:22.206 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:10:22.207 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:10:22.207 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7176, 2021-10-21T00:10:22.207 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:10:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:10:22.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:10:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 7176 2021-10-21T00:10:22.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:22.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:10:22.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:10:22.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:10:22.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1878225401 2021-10-21T00:10:22.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:10:22.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:22.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:10:22.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:10:22.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:10:22.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1878225401 2021-10-21T00:10:22.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:22.216 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.7176 172.21.15.71:0/1878225401", 2021-10-21T00:10:22.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/1878225401", 2021-10-21T00:10:22.217 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:10:22.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 45, 2021-10-21T00:10:22.217 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 88, 2021-10-21T00:10:22.217 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:10:22.218 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:10:22.218 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:10:22.218 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:10:22.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:22.221 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:22.221 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:22.234 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:10:22.235 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:22.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:22.237 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:22.298 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:22.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.400+0000 7f095c889700 1 Processor -- start 2021-10-21T00:10:22.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.400+0000 7f095c889700 1 -- start start 2021-10-21T00:10:22.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09580b2170 0x7f09580ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0958067a80 0x7f0958149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580b0b50 con 0x7f09580af620 2021-10-21T00:10:22.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580b2550 con 0x7f09580b2170 2021-10-21T00:10:22.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580b0d90 con 0x7f0958067a80 2021-10-21T00:10:22.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09580b2170 0x7f09580ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f09580af620 0x7f09580ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41188/0 (socket says 172.21.15.41:41188) 2021-10-21T00:10:22.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095659c700 1 -- 172.21.15.41:0/1328245363 learned_addr learned my addr 172.21.15.41:0/1328245363 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:22.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095759e700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0958067a80 0x7f0958149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0955d9b700 1 -- 172.21.15.41:0/1328245363 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722500722 0 0) 0x7f0950001490 con 0x7f09580af620 2021-10-21T00:10:22.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0955d9b700 1 -- 172.21.15.41:0/1328245363 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f093c003260 con 0x7f09580af620 2021-10-21T00:10:22.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 -- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0958067a80 msgr2=0x7f0958149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:22.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0958067a80 0x7f0958149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 -- 172.21.15.41:0/1328245363 >> v1:172.21.15.62:6789/0 conn(0x7f09580af620 legacy=0x7f09580ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 -- 172.21.15.41:0/1328245363 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580b1030 con 0x7f09580b2170 2021-10-21T00:10:22.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0956d9d700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09580b2170 0x7f09580ab170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f094c002f70 tx=0x7f094c006df0).ready entity=mon.1 client_cookie=f548da532ecba460 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0955d9b700 1 -- 172.21.15.41:0/1328245363 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c00d4a0 con 0x7f09580b2170 2021-10-21T00:10:22.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0955d9b700 1 -- 172.21.15.41:0/1328245363 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c000e90 con 0x7f09580b2170 2021-10-21T00:10:22.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f0955d9b700 1 -- 172.21.15.41:0/1328245363 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c00d7f0 con 0x7f09580b2170 2021-10-21T00:10:22.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 -- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09580b2170 msgr2=0x7f09580ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.404+0000 7f095c889700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09580b2170 0x7f09580ab170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f094c002f70 tx=0x7f094c006df0).stop 2021-10-21T00:10:22.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- 172.21.15.41:0/1328245363 shutdown_connections 2021-10-21T00:10:22.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0958067a80 0x7f0958149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 --2- 172.21.15.41:0/1328245363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09580b2170 0x7f09580ab170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- 172.21.15.41:0/1328245363 >> 172.21.15.41:0/1328245363 conn(0x7f09580b5700 msgr2=0x7f09580b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:22.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- 172.21.15.41:0/1328245363 shutdown_connections 2021-10-21T00:10:22.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- 172.21.15.41:0/1328245363 wait complete. 2021-10-21T00:10:22.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 Processor -- start 2021-10-21T00:10:22.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- start start 2021-10-21T00:10:22.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0958067a80 0x7f0958144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 0x7f09580ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958145100 con 0x7f09580af620 2021-10-21T00:10:22.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958145340 con 0x7f0958067a80 2021-10-21T00:10:22.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095c889700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0958156f60 con 0x7f09580b2170 2021-10-21T00:10:22.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35370/0 (socket says 172.21.15.41:35370) 2021-10-21T00:10:22.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.408+0000 7f095659c700 1 -- 172.21.15.41:0/1364374893 learned_addr learned my addr 172.21.15.41:0/1364374893 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:22.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f0956d9d700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0958067a80 0x7f0958144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095759e700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 0x7f09580ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 -- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 msgr2=0x7f09580ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 0x7f09580ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 -- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0958067a80 msgr2=0x7f0958144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0958067a80 0x7f0958144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 -- 172.21.15.41:0/1364374893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c00b180 con 0x7f09580af620 2021-10-21T00:10:22.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095759e700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 0x7f09580ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:22.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095659c700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f0950001620 tx=0x7f0950007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0950005ba0 con 0x7f09580af620 2021-10-21T00:10:22.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950005d00 con 0x7f09580af620 2021-10-21T00:10:22.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0958148d20 con 0x7f09580af620 2021-10-21T00:10:22.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09500072c0 con 0x7f09580af620 2021-10-21T00:10:22.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09580aca20 con 0x7f09580af620 2021-10-21T00:10:22.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0958145500 con 0x7f09580af620 2021-10-21T00:10:22.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.412+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0950010070 con 0x7f09580af620 2021-10-21T00:10:22.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.416+0000 7f0947fff700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 0x7f0934055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.416+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f095006b2c0 con 0x7f09580af620 2021-10-21T00:10:22.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.416+0000 7f0956d9d700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 0x7f0934055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.416+0000 7f0956d9d700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 0x7f0934055b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f094c01a000 tx=0x7f094c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.424+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0950042290 con 0x7f09580af620 2021-10-21T00:10:22.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.548+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09580b0b30 con 0x7f09580af620 2021-10-21T00:10:22.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f0947fff700 1 -- 172.21.15.41:0/1364374893 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f0950018070 con 0x7f09580af620 2021-10-21T00:10:22.559 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:22.560 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":88,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:16.434078+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:13.910039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:14.803889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:22.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 msgr2=0x7f0934055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 0x7f0934055b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f094c01a000 tx=0x7f094c014000).stop 2021-10-21T00:10:22.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 msgr2=0x7f09580ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f0950001620 tx=0x7f0950007c60).stop 2021-10-21T00:10:22.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 shutdown_connections 2021-10-21T00:10:22.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09340536a0 0x7f0934055b60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09580b2170 0x7f09580ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09580af620 0x7f09580ae3d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 --2- 172.21.15.41:0/1364374893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0958067a80 0x7f0958144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 >> 172.21.15.41:0/1364374893 conn(0x7f09580b5700 msgr2=0x7f095805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:22.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 shutdown_connections 2021-10-21T00:10:22.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.552+0000 7f095c889700 1 -- 172.21.15.41:0/1364374893 wait complete. 2021-10-21T00:10:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:10:13.910039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:10:14.803889+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:10:22.574 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:22.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 Processor -- start 2021-10-21T00:10:22.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 -- start start 2021-10-21T00:10:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97dc0b26d0 0x7f97dc141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0ba080 con 0x7f97dc0b9ca0 2021-10-21T00:10:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc05c670 con 0x7f97dc0b26d0 2021-10-21T00:10:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e4248700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc05c8e0 con 0x7f97dc0b0690 2021-10-21T00:10:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.672+0000 7f97e1fe4700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f97dc0b9ca0 0x7f97dc0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33146/0 (socket says 172.21.15.41:33146) 2021-10-21T00:10:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e1fe4700 1 -- 172.21.15.41:0/4287827103 learned_addr learned my addr 172.21.15.41:0/4287827103 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 --2- 172.21.15.41:0/4287827103 >> v2:172.21.15.62:3300/0 conn(0x7f97dc0b26d0 0x7f97dc141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e17e3700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e0fe2700 1 -- 172.21.15.41:0/4287827103 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642258715 0 0) 0x7f97dc0ba080 con 0x7f97dc0b9ca0 2021-10-21T00:10:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e0fe2700 1 -- 172.21.15.41:0/4287827103 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c4003260 con 0x7f97dc0b9ca0 2021-10-21T00:10:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 -- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 msgr2=0x7f97dc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 -- 172.21.15.41:0/4287827103 >> v1:172.21.15.41:6789/0 conn(0x7f97dc0b9ca0 legacy=0x7f97dc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 -- 172.21.15.41:0/4287827103 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc05cb80 con 0x7f97dc0b26d0 2021-10-21T00:10:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e27e5700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b26d0 0x7f97dc141bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f97d40032f0 tx=0x7f97d40091d0).ready entity=mon.1 client_cookie=92615fa524197663 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e0fe2700 1 -- 172.21.15.41:0/4287827103 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d400b600 con 0x7f97dc0b26d0 2021-10-21T00:10:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e0fe2700 1 -- 172.21.15.41:0/4287827103 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400b760 con 0x7f97dc0b26d0 2021-10-21T00:10:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e0fe2700 1 -- 172.21.15.41:0/4287827103 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d400b8d0 con 0x7f97dc0b26d0 2021-10-21T00:10:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 -- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b26d0 msgr2=0x7f97dc141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b26d0 0x7f97dc141bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f97d40032f0 tx=0x7f97d40091d0).stop 2021-10-21T00:10:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 -- 172.21.15.41:0/4287827103 shutdown_connections 2021-10-21T00:10:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b26d0 0x7f97dc141bc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 --2- 172.21.15.41:0/4287827103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 -- 172.21.15.41:0/4287827103 >> 172.21.15.41:0/4287827103 conn(0x7f97dc062f00 msgr2=0x7f97dc0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:22.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 -- 172.21.15.41:0/4287827103 shutdown_connections 2021-10-21T00:10:22.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.676+0000 7f97e4248700 1 -- 172.21.15.41:0/4287827103 wait complete. 2021-10-21T00:10:22.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 Processor -- start 2021-10-21T00:10:22.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 -- start start 2021-10-21T00:10:22.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 0x7f97dc140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0ac890 con 0x7f97dc0b26d0 2021-10-21T00:10:22.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0af8c0 con 0x7f97dc0b9ca0 2021-10-21T00:10:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e4248700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0afb60 con 0x7f97dc0b0690 2021-10-21T00:10:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e17e3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e17e3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35384/0 (socket says 172.21.15.41:35384) 2021-10-21T00:10:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e17e3700 1 -- 172.21.15.41:0/740519129 learned_addr learned my addr 172.21.15.41:0/740519129 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e1fe4700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.680+0000 7f97e27e5700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 0x7f97dc140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 -- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 msgr2=0x7f97dc146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 -- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 msgr2=0x7f97dc140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 0x7f97dc140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 -- 172.21.15.41:0/740519129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009470 con 0x7f97dc0b26d0 2021-10-21T00:10:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e27e5700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 0x7f97dc140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e17e3700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f97d800c000 tx=0x7f97d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d8010780 con 0x7f97dc0b26d0 2021-10-21T00:10:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80108e0 con 0x7f97dc0b26d0 2021-10-21T00:10:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc0afe00 con 0x7f97dc0b26d0 2021-10-21T00:10:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97d8010c40 con 0x7f97dc0b26d0 2021-10-21T00:10:22.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1414a0 con 0x7f97dc0b26d0 2021-10-21T00:10:22.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc057350 con 0x7f97dc0b26d0 2021-10-21T00:10:22.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97d801c460 con 0x7f97dc0b26d0 2021-10-21T00:10:22.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 0x7f97bc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.684+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f97d806bdb0 con 0x7f97dc0b26d0 2021-10-21T00:10:22.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.688+0000 7f97e1fe4700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 0x7f97bc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.688+0000 7f97e1fe4700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 0x7f97bc055b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f97cc00d000 tx=0x7f97cc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.688+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97d8042e10 con 0x7f97dc0b26d0 2021-10-21T00:10:22.825 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.816+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97dc1418f0 con 0x7f97dc0b26d0 2021-10-21T00:10:22.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.816+0000 7f97caffd700 1 -- 172.21.15.41:0/740519129 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f97d8046430 con 0x7f97dc0b26d0 2021-10-21T00:10:22.826 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:22.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 msgr2=0x7f97bc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 0x7f97bc055b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f97cc00d000 tx=0x7f97cc009040).stop 2021-10-21T00:10:22.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 msgr2=0x7f97dc140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f97d800c000 tx=0x7f97d8006df0).stop 2021-10-21T00:10:22.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 shutdown_connections 2021-10-21T00:10:22.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97bc053640 0x7f97bc055b00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0b9ca0 0x7f97dc140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97dc0b26d0 0x7f97dc140ac0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 --2- 172.21.15.41:0/740519129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97dc0b0690 0x7f97dc146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 >> 172.21.15.41:0/740519129 conn(0x7f97dc062f00 msgr2=0x7f97dc0b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:22.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 shutdown_connections 2021-10-21T00:10:22.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.820+0000 7f97e4248700 1 -- 172.21.15.41:0/740519129 wait complete. 2021-10-21T00:10:22.839 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:22.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 Processor -- start 2021-10-21T00:10:22.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 -- start start 2021-10-21T00:10:22.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f75b80b9ca0 0x7f75b80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b26d0 0x7f75b8141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80ba080 con 0x7f75b80b31e0 2021-10-21T00:10:22.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b805c670 con 0x7f75b80b9ca0 2021-10-21T00:10:22.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.940+0000 7f75bf0e0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b805c8e0 con 0x7f75b80b26d0 2021-10-21T00:10:22.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f75b80b9ca0 0x7f75b80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f75b80b31e0 0x7f75b80b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33162/0 (socket says 172.21.15.41:33162) 2021-10-21T00:10:22.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b7fff700 1 -- 172.21.15.41:0/2265990129 learned_addr learned my addr 172.21.15.41:0/2265990129 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:22.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bd67d700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b26d0 0x7f75b8141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b77fe700 1 -- 172.21.15.41:0/2265990129 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165200054 0 0) 0x7f75b80ba080 con 0x7f75b80b31e0 2021-10-21T00:10:22.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b77fe700 1 -- 172.21.15.41:0/2265990129 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003260 con 0x7f75b80b31e0 2021-10-21T00:10:22.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 -- 172.21.15.41:0/2265990129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b26d0 msgr2=0x7f75b8141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:22.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b26d0 0x7f75b8141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 -- 172.21.15.41:0/2265990129 >> v1:172.21.15.41:6789/0 conn(0x7f75b80b31e0 legacy=0x7f75b80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 -- 172.21.15.41:0/2265990129 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b805cb80 con 0x7f75b80b9ca0 2021-10-21T00:10:22.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bce7c700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b80b9ca0 0x7f75b80b0690 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac006df0).ready entity=mon.0 client_cookie=e7c7c9e2bc1302db server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b77fe700 1 -- 172.21.15.41:0/2265990129 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac00d4a0 con 0x7f75b80b9ca0 2021-10-21T00:10:22.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b77fe700 1 -- 172.21.15.41:0/2265990129 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac000e90 con 0x7f75b80b9ca0 2021-10-21T00:10:22.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75b77fe700 1 -- 172.21.15.41:0/2265990129 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac00d7f0 con 0x7f75b80b9ca0 2021-10-21T00:10:22.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2265990129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b80b9ca0 msgr2=0x7f75b80b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b80b9ca0 0x7f75b80b0690 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f75ac002f70 tx=0x7f75ac006df0).stop 2021-10-21T00:10:22.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2265990129 shutdown_connections 2021-10-21T00:10:22.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b26d0 0x7f75b8141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2265990129 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b80b9ca0 0x7f75b80b0690 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2265990129 >> 172.21.15.41:0/2265990129 conn(0x7f75b8062f00 msgr2=0x7f75b80b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:22.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2265990129 shutdown_connections 2021-10-21T00:10:22.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.944+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2265990129 wait complete. 2021-10-21T00:10:22.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 Processor -- start 2021-10-21T00:10:22.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- start start 2021-10-21T00:10:22.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b26d0 0x7f75b8149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b31e0 0x7f75b8155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80ad110 con 0x7f75b8145520 2021-10-21T00:10:22.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8144110 con 0x7f75b80b26d0 2021-10-21T00:10:22.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81443b0 con 0x7f75b80b31e0 2021-10-21T00:10:22.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35400/0 (socket says 172.21.15.41:35400) 2021-10-21T00:10:22.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 -- 172.21.15.41:0/2581600392 learned_addr learned my addr 172.21.15.41:0/2581600392 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:22.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bce7c700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b26d0 0x7f75b8149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75b7fff700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b31e0 0x7f75b8155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 -- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b31e0 msgr2=0x7f75b8155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b31e0 0x7f75b8155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 -- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b26d0 msgr2=0x7f75b8149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:22.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b26d0 0x7f75b8149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:22.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 -- 172.21.15.41:0/2581600392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac00b180 con 0x7f75b8145520 2021-10-21T00:10:22.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bd67d700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f75b0006e00 tx=0x7f75b00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b000c640 con 0x7f75b8145520 2021-10-21T00:10:22.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000c7a0 con 0x7f75b8145520 2021-10-21T00:10:22.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b8144650 con 0x7f75b8145520 2021-10-21T00:10:22.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b000cb00 con 0x7f75b8145520 2021-10-21T00:10:22.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.948+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b80ada30 con 0x7f75b8145520 2021-10-21T00:10:22.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75b000cc60 con 0x7f75b8145520 2021-10-21T00:10:22.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75b5ffb700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 0x7f7598055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:22.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75b006bbe0 con 0x7f75b8145520 2021-10-21T00:10:22.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8057350 con 0x7f75b8145520 2021-10-21T00:10:22.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75bce7c700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 0x7f7598055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:22.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.952+0000 7f75bce7c700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 0x7f7598055ad0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f75ac01a000 tx=0x7f75ac014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:22.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:22.956+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75b0042d40 con 0x7f75b8145520 2021-10-21T00:10:23.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.080+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75b8067c90 con 0x7f75b8145520 2021-10-21T00:10:23.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.080+0000 7f75b5ffb700 1 -- 172.21.15.41:0/2581600392 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75b0046360 con 0x7f75b8145520 2021-10-21T00:10:23.090 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 msgr2=0x7f7598055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 0x7f7598055ad0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f75ac01a000 tx=0x7f75ac014000).stop 2021-10-21T00:10:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 msgr2=0x7f75b80ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f75b0006e00 tx=0x7f75b00091d0).stop 2021-10-21T00:10:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 shutdown_connections 2021-10-21T00:10:23.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7598053610 0x7f7598055ad0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75b8145520 0x7f75b80ad540 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75b80b31e0 0x7f75b8155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 --2- 172.21.15.41:0/2581600392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75b80b26d0 0x7f75b8149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 >> 172.21.15.41:0/2581600392 conn(0x7f75b8062f00 msgr2=0x7f75b8148b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 shutdown_connections 2021-10-21T00:10:23.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.084+0000 7f75bf0e0700 1 -- 172.21.15.41:0/2581600392 wait complete. 2021-10-21T00:10:23.108 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:10:23.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 Processor -- start 2021-10-21T00:10:23.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 -- start start 2021-10-21T00:10:23.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f664c0b1b70 0x7f664c13a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f664c13a940 0x7f664c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0b4110 con 0x7f664c0b3d30 2021-10-21T00:10:23.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c0675a0 con 0x7f664c0b1b70 2021-10-21T00:10:23.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f664b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c067840 con 0x7f664c13a940 2021-10-21T00:10:23.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.208+0000 7f6649d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f664c0b1b70 0x7f664c13a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f664c0b1b70 0x7f664c13a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35406/0 (socket says 172.21.15.41:35406) 2021-10-21T00:10:23.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 -- 172.21.15.41:0/4100703978 learned_addr learned my addr 172.21.15.41:0/4100703978 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:23.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664ad9d700 1 --2- 172.21.15.41:0/4100703978 >> v2:172.21.15.62:3300/0 conn(0x7f664c13a940 0x7f664c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 -- 172.21.15.41:0/4100703978 >> v2:172.21.15.62:3300/0 conn(0x7f664c13a940 msgr2=0x7f664c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:23.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 --2- 172.21.15.41:0/4100703978 >> v2:172.21.15.62:3300/0 conn(0x7f664c13a940 0x7f664c140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 -- 172.21.15.41:0/4100703978 >> v1:172.21.15.62:6789/0 conn(0x7f664c0b3d30 legacy=0x7f664c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 -- 172.21.15.41:0/4100703978 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c1409a0 con 0x7f664c0b1b70 2021-10-21T00:10:23.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f6649d9b700 1 --2- 172.21.15.41:0/4100703978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c0b1b70 0x7f664c13a450 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f6634002f70 tx=0x7f6634006eb0).ready entity=mon.0 client_cookie=bdd0a588a307c47f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664959a700 1 -- 172.21.15.41:0/4100703978 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663400d5c0 con 0x7f664c0b1b70 2021-10-21T00:10:23.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664959a700 1 -- 172.21.15.41:0/4100703978 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6634000e90 con 0x7f664c0b1b70 2021-10-21T00:10:23.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664959a700 1 -- 172.21.15.41:0/4100703978 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663400d950 con 0x7f664c0b1b70 2021-10-21T00:10:23.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 -- 172.21.15.41:0/4100703978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c0b1b70 msgr2=0x7f664c13a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 --2- 172.21.15.41:0/4100703978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c0b1b70 0x7f664c13a450 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f6634002f70 tx=0x7f6634006eb0).stop 2021-10-21T00:10:23.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 -- 172.21.15.41:0/4100703978 shutdown_connections 2021-10-21T00:10:23.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 --2- 172.21.15.41:0/4100703978 >> v2:172.21.15.62:3300/0 conn(0x7f664c13a940 0x7f664c140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 --2- 172.21.15.41:0/4100703978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c0b1b70 0x7f664c13a450 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 -- 172.21.15.41:0/4100703978 >> 172.21.15.41:0/4100703978 conn(0x7f664c0649c0 msgr2=0x7f664c064dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 -- 172.21.15.41:0/4100703978 shutdown_connections 2021-10-21T00:10:23.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 -- 172.21.15.41:0/4100703978 wait complete. 2021-10-21T00:10:23.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.212+0000 7f664b59e700 1 Processor -- start 2021-10-21T00:10:23.227 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- start start 2021-10-21T00:10:23.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f664c0b1b70 0x7f664c1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f664c0b3d30 0x7f664c139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c13a4b0 con 0x7f664c13a940 2021-10-21T00:10:23.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c0b0f30 con 0x7f664c0b3d30 2021-10-21T00:10:23.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c13d510 con 0x7f664c0b1b70 2021-10-21T00:10:23.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35414/0 (socket says 172.21.15.41:35414) 2021-10-21T00:10:23.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 -- 172.21.15.41:0/2601646175 learned_addr learned my addr 172.21.15.41:0/2601646175 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:23.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f6649d9b700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f664c0b3d30 0x7f664c139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664a59c700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f664c0b1b70 0x7f664c1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 -- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f664c0b1b70 msgr2=0x7f664c1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f664c0b1b70 0x7f664c1421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 -- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f664c0b3d30 msgr2=0x7f664c139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.233 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f664c0b3d30 0x7f664c139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 -- 172.21.15.41:0/2601646175 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663400b1e0 con 0x7f664c13a940 2021-10-21T00:10:23.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664ad9d700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f6644006e00 tx=0x7f66440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664400c670 con 0x7f664c13a940 2021-10-21T00:10:23.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400c7d0 con 0x7f664c13a940 2021-10-21T00:10:23.234 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664400cb30 con 0x7f664c13a940 2021-10-21T00:10:23.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c13d7b0 con 0x7f664c13a940 2021-10-21T00:10:23.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.216+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c0af500 con 0x7f664c13a940 2021-10-21T00:10:23.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c0662a0 con 0x7f664c13a940 2021-10-21T00:10:23.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f664400cc90 con 0x7f664c13a940 2021-10-21T00:10:23.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f66437fe700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 0x7f6630055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f664406bd00 con 0x7f664c13a940 2021-10-21T00:10:23.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f664a59c700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 0x7f6630055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.220+0000 7f664a59c700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 0x7f6630055b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f663c00b000 tx=0x7f663c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.224+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6644042cd0 con 0x7f664c13a940 2021-10-21T00:10:23.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f664c057350 con 0x7f664c13a940 2021-10-21T00:10:23.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f66437fe700 1 -- 172.21.15.41:0/2601646175 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7f66440462f0 con 0x7f664c13a940 2021-10-21T00:10:23.361 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:23.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 msgr2=0x7f6630055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 0x7f6630055b60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f663c00b000 tx=0x7f663c009040).stop 2021-10-21T00:10:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 msgr2=0x7f664c139fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f6644006e00 tx=0x7f66440091d0).stop 2021-10-21T00:10:23.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 shutdown_connections 2021-10-21T00:10:23.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f66300536a0 0x7f6630055b60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f664c13a940 0x7f664c139fc0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f664c0b3d30 0x7f664c139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 --2- 172.21.15.41:0/2601646175 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f664c0b1b70 0x7f664c1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 >> 172.21.15.41:0/2601646175 conn(0x7f664c0649c0 msgr2=0x7f664c0b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 shutdown_connections 2021-10-21T00:10:23.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.352+0000 7f664b59e700 1 -- 172.21.15.41:0/2601646175 wait complete. 2021-10-21T00:10:23.373 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:10:23.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 Processor -- start 2021-10-21T00:10:23.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 -- start start 2021-10-21T00:10:23.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa44405f6b0 0x7fa44413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa444144400 con 0x7fa4440b2370 2021-10-21T00:10:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440b3770 con 0x7fa4440af720 2021-10-21T00:10:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.476+0000 7fa4497ea700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440afb00 con 0x7fa44405f6b0 2021-10-21T00:10:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa43bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa4440b2370 0x7fa4440b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33190/0 (socket says 172.21.15.41:33190) 2021-10-21T00:10:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa43bfff700 1 -- 172.21.15.41:0/1752087680 learned_addr learned my addr 172.21.15.41:0/1752087680 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa448fe9700 1 --2- 172.21.15.41:0/1752087680 >> v2:172.21.15.62:3300/0 conn(0x7fa44405f6b0 0x7fa44413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4437fe700 1 -- 172.21.15.41:0/1752087680 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106542194 0 0) 0x7fa444144400 con 0x7fa4440b2370 2021-10-21T00:10:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4437fe700 1 -- 172.21.15.41:0/1752087680 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa428003260 con 0x7fa4440b2370 2021-10-21T00:10:23.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa448fe9700 1 -- 172.21.15.41:0/1752087680 >> v1:172.21.15.62:6789/0 conn(0x7fa4440af720 legacy=0x7fa444143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa448fe9700 1 -- 172.21.15.41:0/1752087680 >> v1:172.21.15.41:6789/0 conn(0x7fa4440b2370 legacy=0x7fa4440b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa448fe9700 1 -- 172.21.15.41:0/1752087680 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440afdf0 con 0x7fa44405f6b0 2021-10-21T00:10:23.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa448fe9700 1 --2- 172.21.15.41:0/1752087680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413d6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c0091d0).ready entity=mon.1 client_cookie=10495668bc6ac610 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4437fe700 1 -- 172.21.15.41:0/1752087680 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c00b6c0 con 0x7fa44405f6b0 2021-10-21T00:10:23.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4437fe700 1 -- 172.21.15.41:0/1752087680 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00b820 con 0x7fa44405f6b0 2021-10-21T00:10:23.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4437fe700 1 -- 172.21.15.41:0/1752087680 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c00b990 con 0x7fa44405f6b0 2021-10-21T00:10:23.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 -- 172.21.15.41:0/1752087680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 msgr2=0x7fa44413d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 --2- 172.21.15.41:0/1752087680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413d6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c0091d0).stop 2021-10-21T00:10:23.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 -- 172.21.15.41:0/1752087680 shutdown_connections 2021-10-21T00:10:23.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 --2- 172.21.15.41:0/1752087680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413d6c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 -- 172.21.15.41:0/1752087680 >> 172.21.15.41:0/1752087680 conn(0x7fa4440637b0 msgr2=0x7fa444063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 -- 172.21.15.41:0/1752087680 shutdown_connections 2021-10-21T00:10:23.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.480+0000 7fa4497ea700 1 -- 172.21.15.41:0/1752087680 wait complete. 2021-10-21T00:10:23.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 Processor -- start 2021-10-21T00:10:23.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 -- start start 2021-10-21T00:10:23.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4440af720 0x7fa444139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444140120 con 0x7fa4440b2370 2021-10-21T00:10:23.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44413f740 con 0x7fa44405f6b0 2021-10-21T00:10:23.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa4497ea700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44413f9e0 con 0x7fa4440af720 2021-10-21T00:10:23.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa448fe9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa448fe9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35428/0 (socket says 172.21.15.41:35428) 2021-10-21T00:10:23.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa448fe9700 1 -- 172.21.15.41:0/3111999375 learned_addr learned my addr 172.21.15.41:0/3111999375 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:23.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa43bfff700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4440af720 0x7fa444139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.484+0000 7fa443fff700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 -- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4440af720 msgr2=0x7fa444139f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4440af720 0x7fa444139f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 -- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 msgr2=0x7fa44413be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 -- 172.21.15.41:0/3111999375 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009470 con 0x7fa4440b2370 2021-10-21T00:10:23.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa448fe9700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c00b6c0 con 0x7fa4440b2370 2021-10-21T00:10:23.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c021630 con 0x7fa4440b2370 2021-10-21T00:10:23.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44413fc80 con 0x7fa4440b2370 2021-10-21T00:10:23.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c021990 con 0x7fa4440b2370 2021-10-21T00:10:23.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa444148280 con 0x7fa4440b2370 2021-10-21T00:10:23.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4440b0090 con 0x7fa4440b2370 2021-10-21T00:10:23.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa43c027020 con 0x7fa4440b2370 2021-10-21T00:10:23.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 0x7fa41c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa43c06cd20 con 0x7fa4440b2370 2021-10-21T00:10:23.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.488+0000 7fa443fff700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 0x7fa41c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.492+0000 7fa443fff700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 0x7fa41c055a70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa43400d000 tx=0x7fa434007b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.500+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa43c043de0 con 0x7fa4440b2370 2021-10-21T00:10:23.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.624+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa444057350 con 0x7fa4440b2370 2021-10-21T00:10:23.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.624+0000 7fa441ffb700 1 -- 172.21.15.41:0/3111999375 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa43c015020 con 0x7fa4440b2370 2021-10-21T00:10:23.633 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:23.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 msgr2=0x7fa41c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 0x7fa41c055a70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa43400d000 tx=0x7fa434007b60).stop 2021-10-21T00:10:23.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 msgr2=0x7fa44413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c016000).stop 2021-10-21T00:10:23.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 shutdown_connections 2021-10-21T00:10:23.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa41c0535b0 0x7fa41c055a70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa4440b2370 0x7fa44413a440 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4440af720 0x7fa444139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 --2- 172.21.15.41:0/3111999375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa44405f6b0 0x7fa44413be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 >> 172.21.15.41:0/3111999375 conn(0x7fa4440637b0 msgr2=0x7fa44413b440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 shutdown_connections 2021-10-21T00:10:23.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.628+0000 7fa4497ea700 1 -- 172.21.15.41:0/3111999375 wait complete. 2021-10-21T00:10:23.647 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:10:23.647 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:23.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.736+0000 7f20b759e700 1 Processor -- start 2021-10-21T00:10:23.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.736+0000 7f20b759e700 1 -- start start 2021-10-21T00:10:23.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20b8062330 0x7f20b80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b8062f70 0x7f20b805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b805bd40 con 0x7f20b80b3a20 2021-10-21T00:10:23.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b805bf70 con 0x7f20b8062330 2021-10-21T00:10:23.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8142cb0 con 0x7f20b8062f70 2021-10-21T00:10:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b6d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f20b80b3a20 0x7f20b813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33206/0 (socket says 172.21.15.41:33206) 2021-10-21T00:10:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b6d9d700 1 -- 172.21.15.41:0/2920999492 learned_addr learned my addr 172.21.15.41:0/2920999492 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 --2- 172.21.15.41:0/2920999492 >> v2:172.21.15.62:3300/0 conn(0x7f20b8062330 0x7f20b80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b5d9b700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b8062f70 0x7f20b805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b559a700 1 -- 172.21.15.41:0/2920999492 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275564587 0 0) 0x7f20b805bd40 con 0x7f20b80b3a20 2021-10-21T00:10:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b559a700 1 -- 172.21.15.41:0/2920999492 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f209c003260 con 0x7f20b80b3a20 2021-10-21T00:10:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 -- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b8062f70 msgr2=0x7f20b805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b8062f70 0x7f20b805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 -- 172.21.15.41:0/2920999492 >> v1:172.21.15.41:6789/0 conn(0x7f20b80b3a20 legacy=0x7f20b813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 -- 172.21.15.41:0/2920999492 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8142950 con 0x7f20b8062330 2021-10-21T00:10:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b659c700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b80b3f30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f20a8002f70 tx=0x7f20a8006df0).ready entity=mon.1 client_cookie=29f1266f06609768 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b559a700 1 -- 172.21.15.41:0/2920999492 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a800d4a0 con 0x7f20b8062330 2021-10-21T00:10:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b559a700 1 -- 172.21.15.41:0/2920999492 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8000e90 con 0x7f20b8062330 2021-10-21T00:10:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b559a700 1 -- 172.21.15.41:0/2920999492 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a800d7f0 con 0x7f20b8062330 2021-10-21T00:10:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 msgr2=0x7f20b80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b80b3f30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f20a8002f70 tx=0x7f20a8006df0).stop 2021-10-21T00:10:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- 172.21.15.41:0/2920999492 shutdown_connections 2021-10-21T00:10:23.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b8062f70 0x7f20b805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 --2- 172.21.15.41:0/2920999492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b80b3f30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- 172.21.15.41:0/2920999492 >> 172.21.15.41:0/2920999492 conn(0x7f20b80b9080 msgr2=0x7f20b80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- 172.21.15.41:0/2920999492 shutdown_connections 2021-10-21T00:10:23.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.740+0000 7f20b759e700 1 -- 172.21.15.41:0/2920999492 wait complete. 2021-10-21T00:10:23.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 Processor -- start 2021-10-21T00:10:23.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- start start 2021-10-21T00:10:23.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b80b3a20 0x7f20b813f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b81441f0 con 0x7f20b8062f70 2021-10-21T00:10:23.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8144490 con 0x7f20b8062330 2021-10-21T00:10:23.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80acfa0 con 0x7f20b80b3a20 2021-10-21T00:10:23.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35440/0 (socket says 172.21.15.41:35440) 2021-10-21T00:10:23.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 -- 172.21.15.41:0/4284124924 learned_addr learned my addr 172.21.15.41:0/4284124924 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:23.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b6d9d700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b80b3a20 0x7f20b813f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 -- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b80b3a20 msgr2=0x7f20b813f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b80b3a20 0x7f20b813f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 -- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 msgr2=0x7f20b81555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b81555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 -- 172.21.15.41:0/4284124924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a800b180 con 0x7f20b8062f70 2021-10-21T00:10:23.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b5d9b700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f20ac00c000 tx=0x7f20ac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20ac010780 con 0x7f20b8062f70 2021-10-21T00:10:23.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0108e0 con 0x7f20b8062f70 2021-10-21T00:10:23.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b8143e70 con 0x7f20b8062f70 2021-10-21T00:10:23.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20ac010c40 con 0x7f20b8062f70 2021-10-21T00:10:23.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.744+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b8145a20 con 0x7f20b8062f70 2021-10-21T00:10:23.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b8144600 con 0x7f20b8062f70 2021-10-21T00:10:23.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f20ac01c460 con 0x7f20b8062f70 2021-10-21T00:10:23.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20a77fe700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 0x7f2094055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:23.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f20ac06bd70 con 0x7f20b8062f70 2021-10-21T00:10:23.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20b659c700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 0x7f2094055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:23.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.748+0000 7f20b659c700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 0x7f2094055b60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f20a801a000 tx=0x7f20a8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:23.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.756+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20ac042dd0 con 0x7f20b8062f70 2021-10-21T00:10:23.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.916+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20b8144060 con 0x7f20b8062f70 2021-10-21T00:10:23.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20a77fe700 1 -- 172.21.15.41:0/4284124924 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f20ac0463f0 con 0x7f20b8062f70 2021-10-21T00:10:23.927 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:23.927 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:23.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 msgr2=0x7f2094055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 0x7f2094055b60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f20a801a000 tx=0x7f20a8014000).stop 2021-10-21T00:10:23.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 msgr2=0x7f20b80acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:23.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f20ac00c000 tx=0x7f20ac006df0).stop 2021-10-21T00:10:23.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 shutdown_connections 2021-10-21T00:10:23.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f20940536a0 0x7f2094055b60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20b80b3a20 0x7f20b813f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f20b8062f70 0x7f20b80acab0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 --2- 172.21.15.41:0/4284124924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20b8062330 0x7f20b81555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:23.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 >> 172.21.15.41:0/4284124924 conn(0x7f20b80b9080 msgr2=0x7f20b8141eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:23.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 shutdown_connections 2021-10-21T00:10:23.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:23.920+0000 7f20b759e700 1 -- 172.21.15.41:0/4284124924 wait complete. 2021-10-21T00:10:23.932 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:24.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:15.430405+0000', 'modified': '2021-10-21T00:10:16.433450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7008}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7008': {'gid': 7008, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/3653268088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 3653268088}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 3653268088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:24.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:24.144 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:10:24.260 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7008,"want_state":"up:active","state":"up:active","rank_uptime":8.8136015449999991,"mdsmap_epoch":45,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":13.152756052000001} 2021-10-21T00:10:24.261 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7008, "mdsmap_epoch": 45, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 8.813601545, "state": "up:active", "uptime": 13.152756052, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:24.261 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:10:24.262 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:10:24.262 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:10:24.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:24.263 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:24.272 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:24.288 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:24.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:24.301 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:24.302 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:24.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:24.304 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:24.351 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:10:24.352 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:24.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:24.372 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:24.372 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:24.384 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:24.385 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:24.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:24.386 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:24.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:10:24.424+0000 7f0342725080 -1 init, newargv = 0x55e3ebbfa800 newargc=9ceph-fuse[14137 2021-10-21T00:10:24.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:]: starting ceph client 2021-10-21T00:10:24.438 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14137]: starting fuse 2021-10-21T00:10:25.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:25.557 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:25.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:25.617 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:25.618 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:25.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:25.619 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:25.627 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:10:25.628 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:10:25.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:25.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:10:25.629 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:10:25.630 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:10:25.630 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:10:25.630 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:10:25.631 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:25.632 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:10:25.632 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:10:25.632 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:10:25.633 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:25.633 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:10:25.634 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:10:25.634 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:10:25.634 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:10:25.635 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:25.635 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:10:25.636 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:10:25.636 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:10:25.636 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:10:25.637 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:10:25.637 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:25.638 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:10:25.638 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:10:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14137.asok 2021-10-21T00:10:25.687 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14137.asok 2021-10-21T00:10:25.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:25.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14137.asok status 2021-10-21T00:10:25.823 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:10:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:10:25.823 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:10:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:10:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:10:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:10:25.824 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:10:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14137", 2021-10-21T00:10:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:10:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:25.825 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:10:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:10:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6386, 2021-10-21T00:10:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:10:25.826 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:10:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:10:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 6386 2021-10-21T00:10:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:25.827 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1048754433 2021-10-21T00:10:25.828 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:10:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:25.829 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1048754433 2021-10-21T00:10:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.6386 172.21.15.99:0/1048754433", 2021-10-21T00:10:25.830 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/1048754433", 2021-10-21T00:10:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:10:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 45, 2021-10-21T00:10:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 88, 2021-10-21T00:10:25.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:10:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:10:25.832 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:10:25.832 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:10:25.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:25.834 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:25.835 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:25.841 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:25.842 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:25.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:25.843 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:25.860 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-21T00:10:25.861 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-10-21T00:10:25.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:10:25.890 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:10:25.891 DEBUG:teuthology.orchestra.run.smithi071:> import stat 2021-10-21T00:10:25.891 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:25.892 DEBUG:teuthology.orchestra.run.smithi071:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-10-21T00:10:25.892 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:10:26.010 INFO:teuthology.orchestra.run.smithi071.stdout:1099511627776 2021-10-21T00:10:26.200 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:26.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.300+0000 7f1790953700 1 Processor -- start 2021-10-21T00:10:26.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.300+0000 7f1790953700 1 -- start start 2021-10-21T00:10:26.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f178c0b2170 0x7f178c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f178c067a80 0x7f178c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c0b0b50 con 0x7f178c0af620 2021-10-21T00:10:26.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0b2550 con 0x7f178c0b2170 2021-10-21T00:10:26.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0b0d90 con 0x7f178c067a80 2021-10-21T00:10:26.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f178c0b2170 0x7f178c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f178c067a80 0x7f178c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f178c0af620 0x7f178c0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41272/0 (socket says 172.21.15.41:41272) 2021-10-21T00:10:26.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178a59c700 1 -- 172.21.15.41:0/1781025970 learned_addr learned my addr 172.21.15.41:0/1781025970 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:26.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1789d9b700 1 -- 172.21.15.41:0/1781025970 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749695069 0 0) 0x7f177c001490 con 0x7f178c0af620 2021-10-21T00:10:26.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1789d9b700 1 -- 172.21.15.41:0/1781025970 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1770003260 con 0x7f178c0af620 2021-10-21T00:10:26.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 -- 172.21.15.41:0/1781025970 >> v2:172.21.15.62:3300/0 conn(0x7f178c067a80 msgr2=0x7f178c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:26.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 --2- 172.21.15.41:0/1781025970 >> v2:172.21.15.62:3300/0 conn(0x7f178c067a80 0x7f178c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 -- 172.21.15.41:0/1781025970 >> v1:172.21.15.62:6789/0 conn(0x7f178c0af620 legacy=0x7f178c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 -- 172.21.15.41:0/1781025970 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0b1030 con 0x7f178c0b2170 2021-10-21T00:10:26.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f178ad9d700 1 --2- 172.21.15.41:0/1781025970 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0b2170 0x7f178c0ab170 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f178c0aafa0 tx=0x7f1780006df0).ready entity=mon.0 client_cookie=d64a0e3356afe1af server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:26.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1789d9b700 1 -- 172.21.15.41:0/1781025970 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178000d4f0 con 0x7f178c0b2170 2021-10-21T00:10:26.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1789d9b700 1 -- 172.21.15.41:0/1781025970 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1780000e90 con 0x7f178c0b2170 2021-10-21T00:10:26.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1789d9b700 1 -- 172.21.15.41:0/1781025970 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178000d840 con 0x7f178c0b2170 2021-10-21T00:10:26.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- 172.21.15.41:0/1781025970 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0b2170 msgr2=0x7f178c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 --2- 172.21.15.41:0/1781025970 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0b2170 0x7f178c0ab170 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f178c0aafa0 tx=0x7f1780006df0).stop 2021-10-21T00:10:26.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- 172.21.15.41:0/1781025970 shutdown_connections 2021-10-21T00:10:26.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 --2- 172.21.15.41:0/1781025970 >> v2:172.21.15.62:3300/0 conn(0x7f178c067a80 0x7f178c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 --2- 172.21.15.41:0/1781025970 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0b2170 0x7f178c0ab170 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- 172.21.15.41:0/1781025970 >> 172.21.15.41:0/1781025970 conn(0x7f178c0b5700 msgr2=0x7f178c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:26.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- 172.21.15.41:0/1781025970 shutdown_connections 2021-10-21T00:10:26.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.304+0000 7f1790953700 1 -- 172.21.15.41:0/1781025970 wait complete. 2021-10-21T00:10:26.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 Processor -- start 2021-10-21T00:10:26.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- start start 2021-10-21T00:10:26.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 0x7f178c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f178c0b2170 0x7f178c1466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0aeb40 con 0x7f178c0af620 2021-10-21T00:10:26.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0ad970 con 0x7f178c067a80 2021-10-21T00:10:26.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0ac7e0 con 0x7f178c0b2170 2021-10-21T00:10:26.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35454/0 (socket says 172.21.15.41:35454) 2021-10-21T00:10:26.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 -- 172.21.15.41:0/737700076 learned_addr learned my addr 172.21.15.41:0/737700076 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:26.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178ad9d700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 0x7f178c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178b59e700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f178c0b2170 0x7f178c1466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 -- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f178c0b2170 msgr2=0x7f178c1466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f178c0b2170 0x7f178c1466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 -- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 msgr2=0x7f178c14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 0x7f178c14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 -- 172.21.15.41:0/737700076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178000b180 con 0x7f178c0af620 2021-10-21T00:10:26.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178ad9d700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 0x7f178c14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:26.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f178a59c700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f177c001620 tx=0x7f177c007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:26.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c005ba0 con 0x7f178c0af620 2021-10-21T00:10:26.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c005d00 con 0x7f178c0af620 2021-10-21T00:10:26.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c007300 con 0x7f178c0af620 2021-10-21T00:10:26.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0adba0 con 0x7f178c0af620 2021-10-21T00:10:26.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.308+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c146be0 con 0x7f178c0af620 2021-10-21T00:10:26.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0b12d0 con 0x7f178c0af620 2021-10-21T00:10:26.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f177c010030 con 0x7f178c0af620 2021-10-21T00:10:26.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f177bfff700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 0x7f1768055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:26.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f177c06b8d0 con 0x7f178c0af620 2021-10-21T00:10:26.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f178ad9d700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 0x7f1768055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:26.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.312+0000 7f178ad9d700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 0x7f1768055ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1780018000 tx=0x7f1780014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:26.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.320+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f177c042920 con 0x7f178c0af620 2021-10-21T00:10:26.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f178c0b0b50 con 0x7f178c0af620 2021-10-21T00:10:26.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f177bfff700 1 -- 172.21.15.41:0/737700076 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f178c0b0b50 con 0x7f178c0af620 2021-10-21T00:10:26.493 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:26.493 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:26.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 msgr2=0x7f1768055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 0x7f1768055ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1780018000 tx=0x7f1780014000).stop 2021-10-21T00:10:26.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 msgr2=0x7f178c146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:26.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f177c001620 tx=0x7f177c007ca0).stop 2021-10-21T00:10:26.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 shutdown_connections 2021-10-21T00:10:26.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.484+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1768053610 0x7f1768055ad0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f178c0b2170 0x7f178c1466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f178c0af620 0x7f178c146200 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 --2- 172.21.15.41:0/737700076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c067a80 0x7f178c14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:26.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 >> 172.21.15.41:0/737700076 conn(0x7f178c0b5700 msgr2=0x7f178c149260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:26.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 shutdown_connections 2021-10-21T00:10:26.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:26.488+0000 7f1790953700 1 -- 172.21.15.41:0/737700076 wait complete. 2021-10-21T00:10:26.498 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:26.506 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2021-10-21T00:10:26.611 INFO:teuthology.orchestra.run.smithi041.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-10-21T00:10:25.878699+0000","btime":"2021-10-21T00:10:25.878699+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-10-21T00:10:25.878699+0000","atime":"2021-10-21T00:10:25.878699+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7176,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7176,"want_loner":7176,"mds_caps_wanted":[]} 2021-10-21T00:10:26.612 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-10-21T00:10:25.878699+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-10-21T00:10:25.878699+0000", "change_attr": 0, "client_caps": [ { "client_id": 7176, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-10-21T00:10:25.878699+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7176, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-10-21T00:10:25.878699+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 7176, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-10-21T00:10:26.612 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:26.613 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:26.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:26.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:26.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:26.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:26.719 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:26.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:26.720 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:26.720 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:26.728 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:10:26.730 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:26.730 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:10:26.731 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:26.731 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:26.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14716]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:26.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:26.790 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:26.791 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:26.797 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:10:26.798 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:26.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:26.916 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:26.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:26.925 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:26.925 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:26.933 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:26.934 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:26.935 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:10:26.935 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:26.935 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:26.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14137]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:26.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:26.994 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:26.994 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:27.001 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:10:27.002 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:27.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:27.026 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:27.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:27.034 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:27.035 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:27.042 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:27.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:27.044 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:27.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:27.045 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:27.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:27.053 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:27.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 Processor -- start 2021-10-21T00:10:27.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 -- start start 2021-10-21T00:10:27.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac005f9f0 0x7f8ac00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8ac00b3370 0x7f8ac0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac005fdd0 con 0x7f8ac00b0730 2021-10-21T00:10:27.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac0140400 con 0x7f8ac00b3370 2021-10-21T00:10:27.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6b89700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00b27c0 con 0x7f8ac005f9f0 2021-10-21T00:10:27.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac6388700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8ac00b3370 0x7f8ac0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac5386700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8ac00b0730 0x7f8ac00b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33230/0 (socket says 172.21.15.41:33230) 2021-10-21T00:10:27.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac5386700 1 -- 172.21.15.41:0/1694474451 learned_addr learned my addr 172.21.15.41:0/1694474451 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:27.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.156+0000 7f8ac5b87700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac005f9f0 0x7f8ac00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6388700 1 -- 172.21.15.41:0/1694474451 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac005f9f0 msgr2=0x7f8ac00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:27.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6388700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac005f9f0 0x7f8ac00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6388700 1 -- 172.21.15.41:0/1694474451 >> v1:172.21.15.41:6789/0 conn(0x7f8ac00b0730 legacy=0x7f8ac00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6388700 1 -- 172.21.15.41:0/1694474451 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0140080 con 0x7f8ac00b3370 2021-10-21T00:10:27.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac4b85700 1 -- 172.21.15.41:0/1694474451 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120323749 0 0) 0x7f8ac005fdd0 con 0x7f8ac00b0730 2021-10-21T00:10:27.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6388700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0138b60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f8ab80032f0 tx=0x7f8ab80091d0).ready entity=mon.0 client_cookie=ddceb5e264d6eefb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac4b85700 1 -- 172.21.15.41:0/1694474451 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab800b6c0 con 0x7f8ac00b3370 2021-10-21T00:10:27.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac4b85700 1 -- 172.21.15.41:0/1694474451 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800b820 con 0x7f8ac00b3370 2021-10-21T00:10:27.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac4b85700 1 -- 172.21.15.41:0/1694474451 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab800b990 con 0x7f8ac00b3370 2021-10-21T00:10:27.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- 172.21.15.41:0/1694474451 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 msgr2=0x7f8ac0138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0138b60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f8ab80032f0 tx=0x7f8ab80091d0).stop 2021-10-21T00:10:27.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- 172.21.15.41:0/1694474451 shutdown_connections 2021-10-21T00:10:27.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0138b60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/1694474451 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac005f9f0 0x7f8ac00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- 172.21.15.41:0/1694474451 >> 172.21.15.41:0/1694474451 conn(0x7f8ac00637b0 msgr2=0x7f8ac0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:27.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- 172.21.15.41:0/1694474451 shutdown_connections 2021-10-21T00:10:27.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- 172.21.15.41:0/1694474451 wait complete. 2021-10-21T00:10:27.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 Processor -- start 2021-10-21T00:10:27.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- start start 2021-10-21T00:10:27.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ac005f9f0 0x7f8ac00af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac00b0730 0x7f8ac0137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00669d0 con 0x7f8ac00b3370 2021-10-21T00:10:27.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0066730 con 0x7f8ac005f9f0 2021-10-21T00:10:27.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.160+0000 7f8ac6b89700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac013cd60 con 0x7f8ac00b0730 2021-10-21T00:10:27.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35468/0 (socket says 172.21.15.41:35468) 2021-10-21T00:10:27.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 -- 172.21.15.41:0/450691938 learned_addr learned my addr 172.21.15.41:0/450691938 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:27.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac5386700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac00b0730 0x7f8ac0137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac5b87700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ac005f9f0 0x7f8ac00af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 -- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac00b0730 msgr2=0x7f8ac0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac00b0730 0x7f8ac0137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 -- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ac005f9f0 msgr2=0x7f8ac00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ac005f9f0 0x7f8ac00af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 -- 172.21.15.41:0/450691938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009470 con 0x7f8ac00b3370 2021-10-21T00:10:27.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6388700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f8ab80032f0 tx=0x7f8ab8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab800b6c0 con 0x7f8ac00b3370 2021-10-21T00:10:27.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8021630 con 0x7f8ac00b3370 2021-10-21T00:10:27.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00aff40 con 0x7f8ac00b3370 2021-10-21T00:10:27.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab8021990 con 0x7f8ac00b3370 2021-10-21T00:10:27.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0138190 con 0x7f8ac00b3370 2021-10-21T00:10:27.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.164+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac013cf20 con 0x7f8ac00b3370 2021-10-21T00:10:27.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.168+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ab8027020 con 0x7f8ac00b3370 2021-10-21T00:10:27.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.168+0000 7f8aaeffd700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 0x7f8aa0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.168+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8ab806cc20 con 0x7f8ac00b3370 2021-10-21T00:10:27.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.168+0000 7f8ac5b87700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 0x7f8aa0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.168+0000 7f8ac5b87700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 0x7f8aa0055a40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8abc006000 tx=0x7f8abc006d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.172+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ab8043e00 con 0x7f8ac00b3370 2021-10-21T00:10:27.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.296+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8ac013e9f0 con 0x7f8ac00b3370 2021-10-21T00:10:27.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8aaeffd700 1 -- 172.21.15.41:0/450691938 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v88) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f8ab8015020 con 0x7f8ac00b3370 2021-10-21T00:10:27.312 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:27.312 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:27.312 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 88, 2021-10-21T00:10:27.313 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:27.313 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:27.313 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:10:16.434078+0000", 2021-10-21T00:10:27.313 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:27.313 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:27.314 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:27.314 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:27.314 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:27.314 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:27.315 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:27.315 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:27.315 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:27.315 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:27.315 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:27.316 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:27.316 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:27.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:27.316 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:27.317 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 18, 2021-10-21T00:10:27.317 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:27.317 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:27.317 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:27.317 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:27.318 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:27.318 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.319 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:27.319 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:27.319 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:27.319 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:27.319 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:27.320 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:27.320 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:27.320 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:27.320 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:27.321 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:27.321 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:27.321 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:27.321 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:27.321 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:27.322 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:27.322 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:27.322 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:27.322 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:27.323 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:27.323 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:27.323 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:27.323 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:27.323 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:27.324 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:27.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:27.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:27.325 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:27.325 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:27.325 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:27.325 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:27.325 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:27.326 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:27.326 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:27.326 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:27.326 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:27.327 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:27.327 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:27.327 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:27.327 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:27.327 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:27.328 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:27.328 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:27.328 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:27.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:27.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:27.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:27.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:27.330 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:27.330 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:27.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:27.330 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:27.331 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:27.332 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:27.332 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:27.332 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:27.332 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:27.333 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:27.333 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:27.335 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:27.335 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:27.335 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:27.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.336 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:27.336 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:27.336 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.337 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.337 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.337 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:27.337 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:27.337 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:27.338 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:27.338 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:27.338 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:27.338 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:27.339 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:27.339 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:27.339 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:27.339 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:27.339 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:27.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:27.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:27.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:27.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:27.341 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:27.341 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:27.341 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:27.342 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:27.342 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:27.342 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:27.342 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:27.343 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.343 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:27.343 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:27.343 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:27.344 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:27.344 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:27.344 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:27.344 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:27.344 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:27.345 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:27.345 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:27.345 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:27.345 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:27.346 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:27.346 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:27.346 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:27.346 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:27.347 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:27.347 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:27.347 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:27.347 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:27.347 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:27.348 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:27.348 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:27.348 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:27.348 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:27.349 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:27.349 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:27.349 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.350 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:27.350 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:27.350 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:27.350 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:27.351 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:27.351 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:27.351 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:27.351 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:27.352 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:27.353 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:27.353 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.353 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.354 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 17, 2021-10-21T00:10:27.354 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:10:27.354 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:10:13.910039+0000", 2021-10-21T00:10:27.355 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:27.355 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:27.355 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:27.355 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:27.356 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:27.356 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:27.356 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:27.356 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:27.356 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:27.357 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:27.357 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:27.357 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:27.358 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:27.359 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:27.359 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:27.359 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:27.359 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:27.360 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:27.361 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:27.361 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:27.362 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.362 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "87", 2021-10-21T00:10:27.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:27.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:27.363 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:27.363 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:27.364 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:27.364 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:27.364 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:27.364 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:27.365 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:27.365 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:27.365 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:27.365 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:27.366 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:27.366 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:27.366 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:27.366 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:27.366 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:27.367 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:27.367 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:27.367 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:27.367 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:27.368 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:27.368 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:27.368 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:27.368 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:27.368 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:27.369 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.369 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:27.369 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:27.369 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:27.370 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:27.370 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:27.370 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:27.370 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:27.370 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:27.371 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:27.371 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:27.371 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:27.371 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:27.372 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:10:27.372 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:10:27.372 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:10:27.372 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.372 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:27.373 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:27.373 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:10:27.373 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.373 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.374 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.374 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.374 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 18, 2021-10-21T00:10:27.374 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:10:27.374 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:10:14.803889+0000", 2021-10-21T00:10:27.375 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:27.375 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:27.375 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:27.375 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:27.376 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:27.376 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:27.376 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:27.376 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:27.376 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:27.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:27.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:27.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:27.377 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:27.378 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:27.378 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:27.378 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:27.378 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:27.379 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:27.379 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:27.379 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:27.379 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.379 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "88", 2021-10-21T00:10:27.380 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:27.380 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:27.380 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:27.380 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:27.380 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:27.381 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:27.381 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:27.381 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:27.381 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:27.382 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:27.382 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:27.382 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:27.382 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:27.382 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:27.383 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:27.383 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:27.383 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:27.384 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:27.384 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:27.384 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:27.384 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:27.386 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:27.386 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:27.386 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:27.386 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:27.386 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:27.387 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.387 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:27.387 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:27.387 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:27.388 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:27.388 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:27.388 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:27.388 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:27.388 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:27.389 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:27.389 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:27.389 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:27.389 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:27.390 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:27.390 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:27.390 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:10:27.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.391 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.391 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:27.391 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:27.391 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.392 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:27.392 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:27.392 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.392 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.392 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.393 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.393 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.393 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.393 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.394 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:27.394 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.394 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.394 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.395 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.395 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.395 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.396 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:27.396 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.396 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.396 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.397 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.397 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:27.397 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.397 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.398 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.398 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.398 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.399 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.399 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:27.400 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.400 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.401 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.401 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:27.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.401 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.402 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.402 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.402 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.402 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.403 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.403 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:27.403 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.404 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.404 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:27.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.404 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.405 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.405 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.405 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.406 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.406 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.406 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:27.406 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.407 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.407 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:27.407 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:27.408 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.408 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.408 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.408 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:27.409 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:27.409 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:27.409 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:27.409 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.410 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.410 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.410 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.411 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.411 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.411 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:27.411 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:27.412 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.412 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.412 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.412 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.413 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.413 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:27.413 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.414 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.414 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.414 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.414 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.415 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.415 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:27.415 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.415 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.415 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.416 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.416 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:27.416 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.416 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.417 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.417 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.417 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.417 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.418 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:27.418 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.418 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.419 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.419 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.419 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:27.419 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.419 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.420 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.420 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.420 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.421 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.421 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.421 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:27.421 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.421 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.422 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.422 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:27.422 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.423 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.423 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.423 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.423 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.424 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.424 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.424 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:27.424 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.425 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.425 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.425 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.425 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:27.425 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:27.426 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.426 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.426 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.426 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:27.427 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:27.427 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:27.427 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:27.427 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.427 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.428 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.428 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.428 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.428 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.429 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:27.429 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:27.429 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.429 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.429 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.430 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.430 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.430 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.430 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.431 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:27.431 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.431 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.431 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.431 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.432 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.432 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.432 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:27.432 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.433 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.433 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.433 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.433 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:27.433 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.434 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.434 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.434 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.435 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:27.435 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.436 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.436 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.436 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:27.437 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.437 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.437 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.437 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.437 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.438 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.438 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:27.439 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.439 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.439 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:27.440 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.440 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.440 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.440 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.441 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.441 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.441 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.441 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:27.442 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.442 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.442 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.442 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.443 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:27.443 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:27.443 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.443 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.444 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.444 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:27.444 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:27.444 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:27.444 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:27.445 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.445 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.445 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.445 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.446 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.446 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.446 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:27.446 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:27.447 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.447 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.447 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.447 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.447 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.448 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.448 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.448 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:27.448 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.448 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.449 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.449 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.449 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.449 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.450 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:27.450 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.450 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.451 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.451 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.451 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:27.451 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.451 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.452 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.452 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.452 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.452 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.453 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.453 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.453 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:27.453 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.453 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.454 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.454 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.454 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:27.454 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.455 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.455 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.455 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.455 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.455 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.456 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.456 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.456 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:27.456 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.457 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.457 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:27.457 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.458 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.458 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.458 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.458 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.459 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.459 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.459 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.459 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:27.459 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.460 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.460 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.460 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.461 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:27.461 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:27.461 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.462 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.462 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.462 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:27.462 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:27.463 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:27.463 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:27.463 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.464 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.464 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.464 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.465 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:27.466 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:27.466 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.466 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.466 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.466 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.467 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.467 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.467 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.467 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 85, 2021-10-21T00:10:27.468 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.468 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.468 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.468 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.468 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.469 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.469 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:27.469 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.470 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.470 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.470 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:27.470 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.470 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.471 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.471 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.471 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.471 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.472 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.472 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.472 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:27.472 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.472 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.473 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.473 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.473 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:27.473 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.474 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.474 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.474 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.474 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.475 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.475 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.475 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.475 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:27.475 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.476 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.476 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.476 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.476 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:27.476 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.477 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.477 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.477 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.477 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.478 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.478 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:27.479 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.479 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.479 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.479 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.479 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:27.480 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:27.480 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.480 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.480 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.481 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:27.481 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:27.481 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:27.481 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:27.481 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.482 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.482 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.482 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.482 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.483 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.483 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:27.483 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:27.483 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.483 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.484 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.484 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.484 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.484 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.484 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.485 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:27.485 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.485 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.485 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.486 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.486 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.486 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.486 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:27.486 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.487 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.487 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.487 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.487 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:27.488 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.488 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.488 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.488 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.488 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.489 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.489 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.489 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.489 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:27.490 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.490 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.490 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.490 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.490 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:27.491 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.491 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.491 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.491 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.492 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.492 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.492 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.492 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.492 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:27.493 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.493 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.493 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.493 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.494 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:27.494 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.494 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.494 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.494 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.495 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.495 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.495 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.495 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.496 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:27.496 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.496 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.496 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.496 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.497 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:27.497 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:27.497 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.497 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.498 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.498 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:27.498 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:27.498 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:27.498 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:27.499 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.499 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.499 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.499 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.500 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.500 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.500 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:27.500 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:27.500 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.501 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.501 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.501 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.501 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.501 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.502 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.502 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 85, 2021-10-21T00:10:27.502 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.502 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.503 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.503 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.503 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.503 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.503 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:27.504 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.504 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.504 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.505 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:27.505 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.505 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.505 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.505 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.506 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.506 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.506 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.506 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.507 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:27.507 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.507 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.507 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.507 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.508 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:27.508 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.508 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.508 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.509 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.509 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.509 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.509 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.509 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.510 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:27.510 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.510 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.510 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.511 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.511 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:27.511 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.511 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.512 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.512 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.512 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.512 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.512 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.513 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.513 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:27.513 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.514 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.514 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.514 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:27.514 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:27.514 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.515 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.515 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:27.515 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:27.516 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:27.516 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:27.516 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.516 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.516 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.517 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.517 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.517 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.517 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:27.518 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:27.518 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:27.518 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:27.518 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:27.518 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:27.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:27.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:27.519 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:27.519 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:27.520 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:27.520 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:27.520 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:27.520 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.520 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.521 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.521 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:27.521 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.521 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.521 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.522 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.522 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:27.522 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.522 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.523 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.523 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.523 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:27.523 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.523 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.524 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.524 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:27.524 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.524 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.525 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.525 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:27.525 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.525 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.526 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.526 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:27.526 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.527 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.527 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.527 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:27.527 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.527 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.528 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.528 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.528 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:27.528 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.529 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.529 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.529 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.529 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:27.529 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:27.530 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.530 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:27.530 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:27.530 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.531 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.531 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.531 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:27.531 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:27.531 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:27.532 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.532 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.532 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.532 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:27.532 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:27.533 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:27.533 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:27.533 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:27.533 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:27.534 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:27.534 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:27.534 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.534 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:27.534 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:27.535 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.535 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:27.535 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.535 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.536 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.536 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.536 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.536 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:27.536 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.537 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.537 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.537 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:27.537 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.538 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.538 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.538 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.538 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.538 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:27.539 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.539 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.539 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.539 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:27.540 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.540 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.540 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.540 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.540 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.541 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:27.541 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.541 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.541 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.542 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:27.542 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.542 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.542 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.542 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.543 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.543 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:27.543 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.543 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.544 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.544 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:27.544 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.544 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.544 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.545 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.545 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.545 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:27.546 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.546 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.546 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.546 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:27.547 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.547 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.547 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.547 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.548 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.548 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:27.548 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.549 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.549 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.549 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:27.549 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.550 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.550 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.550 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.550 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.551 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:27.551 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.551 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.551 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:27.552 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:27.552 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:27.552 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:27.552 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:27.553 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:27.553 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:27.553 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:27.553 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:27.553 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.554 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:27.554 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:27.554 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:27.554 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:27.555 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:27.555 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:10:27.555 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:27.555 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:27.555 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:27.556 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:27.556 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:27.556 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:27.556 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:27.557 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:27.557 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:27.557 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:27.557 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:27.557 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:27.558 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:27.558 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:27.558 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:27.558 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:27.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 msgr2=0x7f8aa0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 0x7f8aa0055a40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8abc006000 tx=0x7f8abc006d90).stop 2021-10-21T00:10:27.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 msgr2=0x7f8ac0063b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f8ab80032f0 tx=0x7f8ab8016000).stop 2021-10-21T00:10:27.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 shutdown_connections 2021-10-21T00:10:27.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8aa0053580 0x7f8aa0055a40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ac00b3370 0x7f8ac0063b90 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ac00b0730 0x7f8ac0137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 --2- 172.21.15.41:0/450691938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ac005f9f0 0x7f8ac00af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 >> 172.21.15.41:0/450691938 conn(0x7f8ac00637b0 msgr2=0x7f8ac00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:27.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 shutdown_connections 2021-10-21T00:10:27.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.304+0000 7f8ac6b89700 1 -- 172.21.15.41:0/450691938 wait complete. 2021-10-21T00:10:27.564 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:27.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 Processor -- start 2021-10-21T00:10:27.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- start start 2021-10-21T00:10:27.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4980aaaa0 0x7fd498140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4980aa290 con 0x7fd4980b0c10 2021-10-21T00:10:27.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4980b0ff0 con 0x7fd49809a990 2021-10-21T00:10:27.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980aa4f0 con 0x7fd4980aaaa0 2021-10-21T00:10:27.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49ddda700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd4980b0c10 0x7fd4980ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33242/0 (socket says 172.21.15.41:33242) 2021-10-21T00:10:27.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49ddda700 1 -- 172.21.15.41:0/4214998064 learned_addr learned my addr 172.21.15.41:0/4214998064 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:27.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49e5db700 1 --2- 172.21.15.41:0/4214998064 >> v2:172.21.15.41:3300/0 conn(0x7fd4980aaaa0 0x7fd498140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311400895 0 0) 0x7fd4980aa290 con 0x7fd4980b0c10 2021-10-21T00:10:27.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003260 con 0x7fd4980b0c10 2021-10-21T00:10:27.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638264279 0 0) 0x7fd4980b0ff0 con 0x7fd49809a990 2021-10-21T00:10:27.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49e5db700 1 -- 172.21.15.41:0/4214998064 >> v1:172.21.15.62:6789/0 conn(0x7fd49809a990 legacy=0x7fd498098fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49e5db700 1 -- 172.21.15.41:0/4214998064 >> v1:172.21.15.41:6789/0 conn(0x7fd4980b0c10 legacy=0x7fd4980ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49e5db700 1 -- 172.21.15.41:0/4214998064 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980aaf70 con 0x7fd4980aaaa0 2021-10-21T00:10:27.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49e5db700 1 --2- 172.21.15.41:0/4214998064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980aaaa0 0x7fd498140230 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fd490002f70 tx=0x7fd490006df0).ready entity=mon.0 client_cookie=8ebaa6c1c54bd807 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49000d610 con 0x7fd4980aaaa0 2021-10-21T00:10:27.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490000e90 con 0x7fd4980aaaa0 2021-10-21T00:10:27.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd49cdd8700 1 -- 172.21.15.41:0/4214998064 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49000d960 con 0x7fd4980aaaa0 2021-10-21T00:10:27.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- 172.21.15.41:0/4214998064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980aaaa0 msgr2=0x7fd498140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4214998064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980aaaa0 0x7fd498140230 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fd490002f70 tx=0x7fd490006df0).stop 2021-10-21T00:10:27.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- 172.21.15.41:0/4214998064 shutdown_connections 2021-10-21T00:10:27.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4214998064 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980aaaa0 0x7fd498140230 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- 172.21.15.41:0/4214998064 >> 172.21.15.41:0/4214998064 conn(0x7fd49805bca0 msgr2=0x7fd49805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:27.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- 172.21.15.41:0/4214998064 shutdown_connections 2021-10-21T00:10:27.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.672+0000 7fd4a003e700 1 -- 172.21.15.41:0/4214998064 wait complete. 2021-10-21T00:10:27.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 Processor -- start 2021-10-21T00:10:27.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- start start 2021-10-21T00:10:27.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49809a990 0x7fd4980adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4980aaaa0 0x7fd498062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980669d0 con 0x7fd4980b0c10 2021-10-21T00:10:27.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd498062690 con 0x7fd49809a990 2021-10-21T00:10:27.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814fa70 con 0x7fd4980aaaa0 2021-10-21T00:10:27.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35482/0 (socket says 172.21.15.41:35482) 2021-10-21T00:10:27.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 -- 172.21.15.41:0/4103678104 learned_addr learned my addr 172.21.15.41:0/4103678104 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:27.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49ddda700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49809a990 0x7fd4980adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49d5d9700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4980aaaa0 0x7fd498062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 -- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4980aaaa0 msgr2=0x7fd498062ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4980aaaa0 0x7fd498062ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 -- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49809a990 msgr2=0x7fd4980adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49809a990 0x7fd4980adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 -- 172.21.15.41:0/4103678104 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49000b180 con 0x7fd4980b0c10 2021-10-21T00:10:27.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd49e5db700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fd490002f70 tx=0x7fd490014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd490013de0 con 0x7fd4980b0c10 2021-10-21T00:10:27.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000d290 con 0x7fd4980b0c10 2021-10-21T00:10:27.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49814fd10 con 0x7fd4980b0c10 2021-10-21T00:10:27.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49001e5f0 con 0x7fd4980b0c10 2021-10-21T00:10:27.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.676+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4980634a0 con 0x7fd4980b0c10 2021-10-21T00:10:27.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd490025030 con 0x7fd4980b0c10 2021-10-21T00:10:27.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4980a9fb0 con 0x7fd4980b0c10 2021-10-21T00:10:27.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd486ffd700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 0x7fd478055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd49006c520 con 0x7fd4980b0c10 2021-10-21T00:10:27.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd49ddda700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 0x7fd478055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.680+0000 7fd49ddda700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 0x7fd478055b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fd49400d000 tx=0x7fd494009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.688+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd490043680 con 0x7fd4980b0c10 2021-10-21T00:10:27.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.852+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4980ab210 con 0x7fd4980b0c10 2021-10-21T00:10:27.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.852+0000 7fd486ffd700 1 -- 172.21.15.41:0/4103678104 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fd490023090 con 0x7fd4980b0c10 2021-10-21T00:10:27.863 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:27.864 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:16.433450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7008":{"gid":7008,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/3653268088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3653268088},{"type":"v1","addr":"172.21.15.41:6833","nonce":3653268088}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:27.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 msgr2=0x7fd478055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 0x7fd478055b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fd49400d000 tx=0x7fd494009040).stop 2021-10-21T00:10:27.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 msgr2=0x7fd498062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fd490002f70 tx=0x7fd490014000).stop 2021-10-21T00:10:27.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 shutdown_connections 2021-10-21T00:10:27.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4780536d0 0x7fd478055b90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4980b0c10 0x7fd498062fb0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4980aaaa0 0x7fd498062ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 --2- 172.21.15.41:0/4103678104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd49809a990 0x7fd4980adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 >> 172.21.15.41:0/4103678104 conn(0x7fd49805bca0 msgr2=0x7fd498099840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:27.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 shutdown_connections 2021-10-21T00:10:27.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.856+0000 7fd4a003e700 1 -- 172.21.15.41:0/4103678104 wait complete. 2021-10-21T00:10:27.870 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 45 2021-10-21T00:10:27.880 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:10:27.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 Processor -- start 2021-10-21T00:10:27.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 -- start start 2021-10-21T00:10:27.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 0x7fd398142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd3980af9d0 0x7fd39805fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980abc50 con 0x7fd398066ec0 2021-10-21T00:10:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980672a0 con 0x7fd3980af9d0 2021-10-21T00:10:27.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd3a01e7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981431a0 con 0x7fd3980609a0 2021-10-21T00:10:27.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39e784700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd3980af9d0 0x7fd39805fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39df83700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd398066ec0 0x7fd39813fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41312/0 (socket says 172.21.15.41:41312) 2021-10-21T00:10:27.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 0x7fd398142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:27.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39df83700 1 -- 172.21.15.41:0/2154626546 learned_addr learned my addr 172.21.15.41:0/2154626546 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:27.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 -- 172.21.15.41:0/2154626546 >> v2:172.21.15.41:3300/0 conn(0x7fd3980af9d0 msgr2=0x7fd39805fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:27.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 --2- 172.21.15.41:0/2154626546 >> v2:172.21.15.41:3300/0 conn(0x7fd3980af9d0 0x7fd39805fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 -- 172.21.15.41:0/2154626546 >> v1:172.21.15.62:6789/0 conn(0x7fd398066ec0 legacy=0x7fd39813fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 -- 172.21.15.41:0/2154626546 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980b16c0 con 0x7fd3980609a0 2021-10-21T00:10:27.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39cf81700 1 -- 172.21.15.41:0/2154626546 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017328841 0 0) 0x7fd3980abc50 con 0x7fd398066ec0 2021-10-21T00:10:27.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39d782700 1 --2- 172.21.15.41:0/2154626546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 0x7fd398142cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd388002f70 tx=0x7fd388006df0).ready entity=mon.2 client_cookie=308239b5a92d4405 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:27.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39cf81700 1 -- 172.21.15.41:0/2154626546 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38800d570 con 0x7fd3980609a0 2021-10-21T00:10:27.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39cf81700 1 -- 172.21.15.41:0/2154626546 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388000e90 con 0x7fd3980609a0 2021-10-21T00:10:27.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.980+0000 7fd39cf81700 1 -- 172.21.15.41:0/2154626546 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38800d8c0 con 0x7fd3980609a0 2021-10-21T00:10:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2154626546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 msgr2=0x7fd398142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2154626546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 0x7fd398142cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd388002f70 tx=0x7fd388006df0).stop 2021-10-21T00:10:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2154626546 shutdown_connections 2021-10-21T00:10:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2154626546 >> v2:172.21.15.41:3300/0 conn(0x7fd3980af9d0 0x7fd39805fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2154626546 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3980609a0 0x7fd398142cb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:27.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2154626546 >> 172.21.15.41:0/2154626546 conn(0x7fd39805bca0 msgr2=0x7fd39805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:27.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2154626546 shutdown_connections 2021-10-21T00:10:27.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2154626546 wait complete. 2021-10-21T00:10:27.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 Processor -- start 2021-10-21T00:10:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- start start 2021-10-21T00:10:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3980609a0 0x7fd3980ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd398066ec0 0x7fd398145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae230 con 0x7fd3980af9d0 2021-10-21T00:10:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae4d0 con 0x7fd3980609a0 2021-10-21T00:10:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd3a01e7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae770 con 0x7fd398066ec0 2021-10-21T00:10:28.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd39e784700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd39e784700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35496/0 (socket says 172.21.15.41:35496) 2021-10-21T00:10:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd39e784700 1 -- 172.21.15.41:0/2124056613 learned_addr learned my addr 172.21.15.41:0/2124056613 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd39df83700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3980609a0 0x7fd3980ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.984+0000 7fd39d782700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd398066ec0 0x7fd398145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 -- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd398066ec0 msgr2=0x7fd398145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd398066ec0 0x7fd398145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 -- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3980609a0 msgr2=0x7fd3980ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3980609a0 0x7fd3980ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 -- 172.21.15.41:0/2124056613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38800b180 con 0x7fd3980af9d0 2021-10-21T00:10:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd39e784700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fd390006e00 tx=0x7fd3900091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd390012600 con 0x7fd3980af9d0 2021-10-21T00:10:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390012760 con 0x7fd3980af9d0 2021-10-21T00:10:28.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd390012ac0 con 0x7fd3980af9d0 2021-10-21T00:10:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980af130 con 0x7fd3980af9d0 2021-10-21T00:10:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980aee30 con 0x7fd3980af9d0 2021-10-21T00:10:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd398146150 con 0x7fd3980af9d0 2021-10-21T00:10:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd390022070 con 0x7fd3980af9d0 2021-10-21T00:10:28.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.988+0000 7fd386ffd700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 0x7fd378055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.992+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd39006be90 con 0x7fd3980af9d0 2021-10-21T00:10:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.992+0000 7fd39df83700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 0x7fd378055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.992+0000 7fd39df83700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 0x7fd378055ad0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fd39400d000 tx=0x7fd3940011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:27.996+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd390042f50 con 0x7fd3980af9d0 2021-10-21T00:10:28.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.156+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3980ae930 con 0x7fd3980af9d0 2021-10-21T00:10:28.312 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:10:28.308+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:10:28.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.312+0000 7fd386ffd700 1 -- 172.21.15.41:0/2124056613 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd390016090 con 0x7fd3980af9d0 2021-10-21T00:10:28.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 msgr2=0x7fd378055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 0x7fd378055ad0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fd39400d000 tx=0x7fd3940011a0).stop 2021-10-21T00:10:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 msgr2=0x7fd3980ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fd390006e00 tx=0x7fd3900091d0).stop 2021-10-21T00:10:28.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 shutdown_connections 2021-10-21T00:10:28.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd378053610 0x7fd378055ad0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3980af9d0 0x7fd3980ac260 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd398066ec0 0x7fd398145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 --2- 172.21.15.41:0/2124056613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3980609a0 0x7fd3980ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 >> 172.21.15.41:0/2124056613 conn(0x7fd39805bca0 msgr2=0x7fd398140d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:28.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 shutdown_connections 2021-10-21T00:10:28.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.316+0000 7fd3a01e7700 1 -- 172.21.15.41:0/2124056613 wait complete. 2021-10-21T00:10:28.327 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:10:28.340 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:28.345 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:10:28.374 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:28.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:28.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:28.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:28.386 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:28.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.428+0000 7f2ab2e2d700 1 Processor -- start 2021-10-21T00:10:28.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- start start 2021-10-21T00:10:28.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2aac0b5f70 0x7f2aac05c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac141e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0b6350 con 0x7f2aac142300 2021-10-21T00:10:28.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac067d00 con 0x7f2aac0b5f70 2021-10-21T00:10:28.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac05cee0 con 0x7f2aac0b1a50 2021-10-21T00:10:28.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2aac0b5f70 0x7f2aac05c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2aac0b5f70 0x7f2aac05c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35512/0 (socket says 172.21.15.41:35512) 2021-10-21T00:10:28.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 -- 172.21.15.41:0/4009814777 learned_addr learned my addr 172.21.15.41:0/4009814777 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:28.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab262c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2aac142300 0x7f2aac145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33286/0 (socket says 172.21.15.41:33286) 2021-10-21T00:10:28.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab162a700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 -- 172.21.15.41:0/4009814777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 msgr2=0x7f2aac141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:28.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 -- 172.21.15.41:0/4009814777 >> v1:172.21.15.41:6789/0 conn(0x7f2aac142300 legacy=0x7f2aac145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 -- 172.21.15.41:0/4009814777 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac05d180 con 0x7f2aac0b5f70 2021-10-21T00:10:28.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab0e29700 1 -- 172.21.15.41:0/4009814777 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092866836 0 0) 0x7f2aac0b6350 con 0x7f2aac142300 2021-10-21T00:10:28.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab1e2b700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac05c7c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f2aa8002f70 tx=0x7f2aa8006eb0).ready entity=mon.0 client_cookie=8e54556acc18cf78 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab0e29700 1 -- 172.21.15.41:0/4009814777 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa800d570 con 0x7f2aac0b5f70 2021-10-21T00:10:28.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab0e29700 1 -- 172.21.15.41:0/4009814777 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8000e90 con 0x7f2aac0b5f70 2021-10-21T00:10:28.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab0e29700 1 -- 172.21.15.41:0/4009814777 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa800d8c0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/4009814777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 msgr2=0x7f2aac05c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac05c7c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f2aa8002f70 tx=0x7f2aa8006eb0).stop 2021-10-21T00:10:28.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/4009814777 shutdown_connections 2021-10-21T00:10:28.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/4009814777 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac05c7c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.432+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/4009814777 >> 172.21.15.41:0/4009814777 conn(0x7f2aac0639f0 msgr2=0x7f2aac0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:28.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/4009814777 shutdown_connections 2021-10-21T00:10:28.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/4009814777 wait complete. 2021-10-21T00:10:28.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 Processor -- start 2021-10-21T00:10:28.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- start start 2021-10-21T00:10:28.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac13f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac142300 0x7f2aac064b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0646f0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac145f50 con 0x7f2aac142300 2021-10-21T00:10:28.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab2e2d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0670b0 con 0x7f2aac0b1a50 2021-10-21T00:10:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35520/0 (socket says 172.21.15.41:35520) 2021-10-21T00:10:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 -- 172.21.15.41:0/3066188228 learned_addr learned my addr 172.21.15.41:0/3066188228 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab1e2b700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab262c700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac142300 0x7f2aac064b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 -- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 msgr2=0x7f2aac13f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac13f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 -- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac142300 msgr2=0x7f2aac064b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac142300 0x7f2aac064b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.436+0000 7f2ab162a700 1 -- 172.21.15.41:0/3066188228 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa800b1e0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2ab162a700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f2a9c00c000 tx=0x7f2a9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c010780 con 0x7f2aac0b5f70 2021-10-21T00:10:28.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c0108e0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c010c40 con 0x7f2aac0b5f70 2021-10-21T00:10:28.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac1461f0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac155520 con 0x7f2aac0b5f70 2021-10-21T00:10:28.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac057350 con 0x7f2aac0b5f70 2021-10-21T00:10:28.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a9c01c460 con 0x7f2aac0b5f70 2021-10-21T00:10:28.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 0x7f2a8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2a9c06bff0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.440+0000 7f2ab1e2b700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 0x7f2a8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.444+0000 7f2ab1e2b700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 0x7f2a8c055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f2aa801a000 tx=0x7f2aa8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.448+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a9c042f50 con 0x7f2aac0b5f70 2021-10-21T00:10:28.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.616+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aac05d8f0 con 0x7f2aac0b5f70 2021-10-21T00:10:28.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2a9affd700 1 -- 172.21.15.41:0/3066188228 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f2a9c046570 con 0x7f2aac0b5f70 2021-10-21T00:10:28.627 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:28.628 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:15.430405+0000","modified":"2021-10-21T00:10:28.308594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-10-21T00:10:28.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 msgr2=0x7f2a8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 0x7f2a8c055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f2aa801a000 tx=0x7f2aa8015000).stop 2021-10-21T00:10:28.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 msgr2=0x7f2aac155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f2a9c00c000 tx=0x7f2a9c006df0).stop 2021-10-21T00:10:28.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 shutdown_connections 2021-10-21T00:10:28.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2a8c053610 0x7f2a8c055ad0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac142300 0x7f2aac064b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2aac0b5f70 0x7f2aac155030 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 --2- 172.21.15.41:0/3066188228 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2aac0b1a50 0x7f2aac13f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 >> 172.21.15.41:0/3066188228 conn(0x7f2aac0639f0 msgr2=0x7f2aac0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:28.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 shutdown_connections 2021-10-21T00:10:28.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.620+0000 7f2ab2e2d700 1 -- 172.21.15.41:0/3066188228 wait complete. 2021-10-21T00:10:28.632 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 46 2021-10-21T00:10:28.640 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:10:28.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 Processor -- start 2021-10-21T00:10:28.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 -- start start 2021-10-21T00:10:28.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28a00b9c70 0x7f28a0143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a0143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a0142bc0 con 0x7f28a0143a00 2021-10-21T00:10:28.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a01429a0 con 0x7f28a00b9c70 2021-10-21T00:10:28.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a76ba700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00ba050 con 0x7f28a00b3bc0 2021-10-21T00:10:28.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5456700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28a00b9c70 0x7f28a0143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a4c55700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5c57700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f28a0143a00 0x7f28a005bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41356/0 (socket says 172.21.15.41:41356) 2021-10-21T00:10:28.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5c57700 1 -- 172.21.15.41:0/425639864 learned_addr learned my addr 172.21.15.41:0/425639864 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:28.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f2897fff700 1 -- 172.21.15.41:0/425639864 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440654848 0 0) 0x7f28a0142bc0 con 0x7f28a0143a00 2021-10-21T00:10:28.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5456700 1 -- 172.21.15.41:0/425639864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 msgr2=0x7f28a0143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:28.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5456700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a0143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5456700 1 -- 172.21.15.41:0/425639864 >> v1:172.21.15.62:6789/0 conn(0x7f28a0143a00 legacy=0x7f28a005bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a5456700 1 -- 172.21.15.41:0/425639864 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a01463c0 con 0x7f28a00b9c70 2021-10-21T00:10:28.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.788+0000 7f28a4c55700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a0143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:28.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a5456700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0143020 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f28a00b1ab0 tx=0x7f2890006df0).ready entity=mon.0 client_cookie=63b462d720ba45aa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f2897fff700 1 -- 172.21.15.41:0/425639864 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289000d570 con 0x7f28a00b9c70 2021-10-21T00:10:28.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f2897fff700 1 -- 172.21.15.41:0/425639864 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890000e90 con 0x7f28a00b9c70 2021-10-21T00:10:28.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f2897fff700 1 -- 172.21.15.41:0/425639864 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289000d8c0 con 0x7f28a00b9c70 2021-10-21T00:10:28.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- 172.21.15.41:0/425639864 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 msgr2=0x7f28a0143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0143020 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f28a00b1ab0 tx=0x7f2890006df0).stop 2021-10-21T00:10:28.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- 172.21.15.41:0/425639864 shutdown_connections 2021-10-21T00:10:28.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a0143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 --2- 172.21.15.41:0/425639864 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0143020 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- 172.21.15.41:0/425639864 >> 172.21.15.41:0/425639864 conn(0x7f28a0062e80 msgr2=0x7f28a00b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:28.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- 172.21.15.41:0/425639864 shutdown_connections 2021-10-21T00:10:28.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- 172.21.15.41:0/425639864 wait complete. 2021-10-21T00:10:28.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 Processor -- start 2021-10-21T00:10:28.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.792+0000 7f28a76ba700 1 -- start start 2021-10-21T00:10:28.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a01156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 0x7f28a0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0113aa0 con 0x7f28a00b9c70 2021-10-21T00:10:28.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0114d80 con 0x7f28a0143a00 2021-10-21T00:10:28.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00af410 con 0x7f28a00b3bc0 2021-10-21T00:10:28.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35534/0 (socket says 172.21.15.41:35534) 2021-10-21T00:10:28.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 -- 172.21.15.41:0/3862772284 learned_addr learned my addr 172.21.15.41:0/3862772284 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:28.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a5456700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a01156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a5c57700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 0x7f28a0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 -- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 msgr2=0x7f28a01156e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a01156e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 -- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 msgr2=0x7f28a0155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:28.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 0x7f28a0155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:28.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 -- 172.21.15.41:0/3862772284 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c00b180 con 0x7f28a00b9c70 2021-10-21T00:10:28.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a5456700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a01156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:28.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a5c57700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 0x7f28a0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:28.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a4c55700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f28a0114ec0 tx=0x7f289c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c00c850 con 0x7f28a00b9c70 2021-10-21T00:10:28.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c00c9b0 con 0x7f28a00b9c70 2021-10-21T00:10:28.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289000b180 con 0x7f28a00b9c70 2021-10-21T00:10:28.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289c00cd10 con 0x7f28a00b9c70 2021-10-21T00:10:28.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0115240 con 0x7f28a00b9c70 2021-10-21T00:10:28.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f289c01c460 con 0x7f28a00b9c70 2021-10-21T00:10:28.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a0115400 con 0x7f28a00b9c70 2021-10-21T00:10:28.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 0x7f28880559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:28.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f289c06c000 con 0x7f28a00b9c70 2021-10-21T00:10:28.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.796+0000 7f28a5456700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 0x7f28880559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:28.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.800+0000 7f28a5456700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 0x7f28880559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f2890015000 tx=0x7f2890014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:28.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.808+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f289c043010 con 0x7f28a00b9c70 2021-10-21T00:10:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:28.972+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f28a00b4660 con 0x7f28a00b9c70 2021-10-21T00:10:29.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.328+0000 7f28967fc700 1 -- 172.21.15.41:0/3862772284 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7f289c046630 con 0x7f28a00b9c70 2021-10-21T00:10:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 msgr2=0x7f28880559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 0x7f28880559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f2890015000 tx=0x7f2890014000).stop 2021-10-21T00:10:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 msgr2=0x7f28a0112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f28a0114ec0 tx=0x7f289c006df0).stop 2021-10-21T00:10:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 shutdown_connections 2021-10-21T00:10:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f28880534f0 0x7f28880559b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28a0143a00 0x7f28a0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28a00b9c70 0x7f28a0112fa0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 --2- 172.21.15.41:0/3862772284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28a00b3bc0 0x7f28a01156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 >> 172.21.15.41:0/3862772284 conn(0x7f28a0062e80 msgr2=0x7f28a005c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 shutdown_connections 2021-10-21T00:10:29.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.332+0000 7f28a76ba700 1 -- 172.21.15.41:0/3862772284 wait complete. 2021-10-21T00:10:29.357 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:10:29.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.464+0000 7f02d1862700 1 Processor -- start 2021-10-21T00:10:29.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.464+0000 7f02d1862700 1 -- start start 2021-10-21T00:10:29.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc05f850 0x7f02cc0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f02cc146980 0x7f02cc0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc0ac6e0 con 0x7f02cc0b2bf0 2021-10-21T00:10:29.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0ac980 con 0x7f02cc146980 2021-10-21T00:10:29.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc05fc30 con 0x7f02cc05f850 2021-10-21T00:10:29.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f02cc146980 0x7f02cc0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02ca7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f02cc0b2bf0 0x7f02cc146270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33314/0 (socket says 172.21.15.41:33314) 2021-10-21T00:10:29.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02ca7fc700 1 -- 172.21.15.41:0/671484321 learned_addr learned my addr 172.21.15.41:0/671484321 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:29.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02caffd700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc05f850 0x7f02cc0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 -- 172.21.15.41:0/671484321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc05f850 msgr2=0x7f02cc0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:29.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc05f850 0x7f02cc0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 -- 172.21.15.41:0/671484321 >> v1:172.21.15.41:6789/0 conn(0x7f02cc0b2bf0 legacy=0x7f02cc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02c9ffb700 1 -- 172.21.15.41:0/671484321 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093971373 0 0) 0x7f02cc0ac6e0 con 0x7f02cc0b2bf0 2021-10-21T00:10:29.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 -- 172.21.15.41:0/671484321 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc05fda0 con 0x7f02cc146980 2021-10-21T00:10:29.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02cb7fe700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc146980 0x7f02cc0ad630 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f02c4002f70 tx=0x7f02c4006df0).ready entity=mon.0 client_cookie=69258aa31acd3037 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:29.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02c9ffb700 1 -- 172.21.15.41:0/671484321 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c400d570 con 0x7f02cc146980 2021-10-21T00:10:29.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02c9ffb700 1 -- 172.21.15.41:0/671484321 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4000e90 con 0x7f02cc146980 2021-10-21T00:10:29.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02c9ffb700 1 -- 172.21.15.41:0/671484321 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c400d8c0 con 0x7f02cc146980 2021-10-21T00:10:29.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- 172.21.15.41:0/671484321 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc146980 msgr2=0x7f02cc0ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc146980 0x7f02cc0ad630 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f02c4002f70 tx=0x7f02c4006df0).stop 2021-10-21T00:10:29.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- 172.21.15.41:0/671484321 shutdown_connections 2021-10-21T00:10:29.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc146980 0x7f02cc0ad630 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 --2- 172.21.15.41:0/671484321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc05f850 0x7f02cc0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- 172.21.15.41:0/671484321 >> 172.21.15.41:0/671484321 conn(0x7f02cc0b7030 msgr2=0x7f02cc0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:29.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- 172.21.15.41:0/671484321 shutdown_connections 2021-10-21T00:10:29.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.468+0000 7f02d1862700 1 -- 172.21.15.41:0/671484321 wait complete. 2021-10-21T00:10:29.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 Processor -- start 2021-10-21T00:10:29.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 -- start start 2021-10-21T00:10:29.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc0b2bf0 0x7f02cc152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02cc146980 0x7f02cc152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc09c1c0 con 0x7f02cc05f850 2021-10-21T00:10:29.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc146280 con 0x7f02cc146980 2021-10-21T00:10:29.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02d1862700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc145d40 con 0x7f02cc0b2bf0 2021-10-21T00:10:29.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35546/0 (socket says 172.21.15.41:35546) 2021-10-21T00:10:29.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 -- 172.21.15.41:0/2018831137 learned_addr learned my addr 172.21.15.41:0/2018831137 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:29.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02ca7fc700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc0b2bf0 0x7f02cc152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02cb7fe700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02cc146980 0x7f02cc152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 -- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc0b2bf0 msgr2=0x7f02cc152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc0b2bf0 0x7f02cc152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 -- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02cc146980 msgr2=0x7f02cc152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:29.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02cc146980 0x7f02cc152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:29.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 -- 172.21.15.41:0/2018831137 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c400b180 con 0x7f02cc05f850 2021-10-21T00:10:29.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.472+0000 7f02caffd700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f02cc1457b0 tx=0x7f02bc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:29.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02bc00ee60 con 0x7f02cc05f850 2021-10-21T00:10:29.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc00c850 con 0x7f02cc05f850 2021-10-21T00:10:29.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02bc00cbb0 con 0x7f02cc05f850 2021-10-21T00:10:29.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc145fe0 con 0x7f02cc05f850 2021-10-21T00:10:29.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc0aee40 con 0x7f02cc05f850 2021-10-21T00:10:29.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc0b33b0 con 0x7f02cc05f850 2021-10-21T00:10:29.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f02bc022070 con 0x7f02cc05f850 2021-10-21T00:10:29.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.476+0000 7f02c3fff700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 0x7f02b0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:29.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.480+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f02bc06c070 con 0x7f02cc05f850 2021-10-21T00:10:29.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.480+0000 7f02ca7fc700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 0x7f02b0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:29.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.480+0000 7f02ca7fc700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 0x7f02b0055a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f02b400d000 tx=0x7f02b4007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:29.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.488+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02bc043070 con 0x7f02cc05f850 2021-10-21T00:10:29.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:29.616+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02cc057350 con 0x7f02cc05f850 2021-10-21T00:10:30.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.336+0000 7f02c3fff700 1 -- 172.21.15.41:0/2018831137 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 185+0+0 (secure 0 0 0) 0x7f02bc046690 con 0x7f02cc05f850 2021-10-21T00:10:30.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 msgr2=0x7f02b0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 0x7f02b0055a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f02b400d000 tx=0x7f02b4007a00).stop 2021-10-21T00:10:30.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 msgr2=0x7f02cc141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f02cc1457b0 tx=0x7f02bc0091d0).stop 2021-10-21T00:10:30.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 shutdown_connections 2021-10-21T00:10:30.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f02b0053580 0x7f02b0055a40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02cc146980 0x7f02cc152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02cc0b2bf0 0x7f02cc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 --2- 172.21.15.41:0/2018831137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f02cc05f850 0x7f02cc141ba0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 >> 172.21.15.41:0/2018831137 conn(0x7f02cc0b7030 msgr2=0x7f02cc061470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:30.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 shutdown_connections 2021-10-21T00:10:30.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.340+0000 7f02d1862700 1 -- 172.21.15.41:0/2018831137 wait complete. 2021-10-21T00:10:30.351 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:10:30.362 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:10:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 Processor -- start 2021-10-21T00:10:30.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 -- start start 2021-10-21T00:10:30.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e1805f9f0 0x7f2e180af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 0x7f2e180b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1805fdd0 con 0x7f2e18067a90 2021-10-21T00:10:30.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e180ae3c0 con 0x7f2e1805f9f0 2021-10-21T00:10:30.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1d625700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180ae660 con 0x7f2e180b0730 2021-10-21T00:10:30.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e0ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2e18067a90 0x7f2e180b2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33326/0 (socket says 172.21.15.41:33326) 2021-10-21T00:10:30.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e0ffff700 1 -- 172.21.15.41:0/365296201 learned_addr learned my addr 172.21.15.41:0/365296201 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:30.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e17fff700 1 --2- 172.21.15.41:0/365296201 >> v2:172.21.15.62:3300/0 conn(0x7f2e1805f9f0 0x7f2e180af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/365296201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 0x7f2e180b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e177fe700 1 -- 172.21.15.41:0/365296201 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939785363 0 0) 0x7f2e1805fdd0 con 0x7f2e18067a90 2021-10-21T00:10:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e177fe700 1 -- 172.21.15.41:0/365296201 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df8003260 con 0x7f2e18067a90 2021-10-21T00:10:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 -- 172.21.15.41:0/365296201 >> v2:172.21.15.62:3300/0 conn(0x7f2e1805f9f0 msgr2=0x7f2e180af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/365296201 >> v2:172.21.15.62:3300/0 conn(0x7f2e1805f9f0 0x7f2e180af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 -- 172.21.15.41:0/365296201 >> v1:172.21.15.41:6789/0 conn(0x7f2e18067a90 legacy=0x7f2e180b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 -- 172.21.15.41:0/365296201 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180ae900 con 0x7f2e180b0730 2021-10-21T00:10:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.476+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/365296201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 0x7f2e180b2d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f2e100032f0 tx=0x7f2e100091d0).ready entity=mon.2 client_cookie=6361ac52356b73e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e177fe700 1 -- 172.21.15.41:0/365296201 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1000b600 con 0x7f2e180b0730 2021-10-21T00:10:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e177fe700 1 -- 172.21.15.41:0/365296201 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000b760 con 0x7f2e180b0730 2021-10-21T00:10:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e177fe700 1 -- 172.21.15.41:0/365296201 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1000b8d0 con 0x7f2e180b0730 2021-10-21T00:10:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 -- 172.21.15.41:0/365296201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 msgr2=0x7f2e180b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 --2- 172.21.15.41:0/365296201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 0x7f2e180b2d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f2e100032f0 tx=0x7f2e100091d0).stop 2021-10-21T00:10:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 -- 172.21.15.41:0/365296201 shutdown_connections 2021-10-21T00:10:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 --2- 172.21.15.41:0/365296201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e180b0730 0x7f2e180b2d50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 --2- 172.21.15.41:0/365296201 >> v2:172.21.15.62:3300/0 conn(0x7f2e1805f9f0 0x7f2e180af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 -- 172.21.15.41:0/365296201 >> 172.21.15.41:0/365296201 conn(0x7f2e180637b0 msgr2=0x7f2e18063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 -- 172.21.15.41:0/365296201 shutdown_connections 2021-10-21T00:10:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.480+0000 7f2e1d625700 1 -- 172.21.15.41:0/365296201 wait complete. 2021-10-21T00:10:30.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 Processor -- start 2021-10-21T00:10:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- start start 2021-10-21T00:10:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1805f9f0 0x7f2e1813dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e18067a90 0x7f2e1813a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1810f7d0 con 0x7f2e180b0730 2021-10-21T00:10:30.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18066030 con 0x7f2e1805f9f0 2021-10-21T00:10:30.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1810f090 con 0x7f2e18067a90 2021-10-21T00:10:30.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e0ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e18067a90 0x7f2e1813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35564/0 (socket says 172.21.15.41:35564) 2021-10-21T00:10:30.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e17fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1805f9f0 0x7f2e1813dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 -- 172.21.15.41:0/2452460641 learned_addr learned my addr 172.21.15.41:0/2452460641 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:30.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 -- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e18067a90 msgr2=0x7f2e1813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e18067a90 0x7f2e1813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 -- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1805f9f0 msgr2=0x7f2e1813dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:30.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1805f9f0 0x7f2e1813dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:30.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 -- 172.21.15.41:0/2452460641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10009470 con 0x7f2e180b0730 2021-10-21T00:10:30.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1ce24700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f2e1810f910 tx=0x7f2e10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:30.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1000b8d0 con 0x7f2e180b0730 2021-10-21T00:10:30.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100205e0 con 0x7f2e180b0730 2021-10-21T00:10:30.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1810f330 con 0x7f2e180b0730 2021-10-21T00:10:30.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1000b600 con 0x7f2e180b0730 2021-10-21T00:10:30.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.484+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e18064d60 con 0x7f2e180b0730 2021-10-21T00:10:30.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e18065e50 con 0x7f2e180b0730 2021-10-21T00:10:30.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e1001e070 con 0x7f2e180b0730 2021-10-21T00:10:30.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e15ffb700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:30.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f2e1006c740 con 0x7f2e180b0730 2021-10-21T00:10:30.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e17fff700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:30.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.488+0000 7f2e17fff700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 0x7f2dfc055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f2e0800b000 tx=0x7f2e08006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:30.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.492+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e100439a0 con 0x7f2e180b0730 2021-10-21T00:10:30.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:30.624+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e1810f4c0 con 0x7f2e180b0730 2021-10-21T00:10:31.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.343+0000 7f2e15ffb700 1 -- 172.21.15.41:0/2452460641 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2e100150d0 con 0x7f2e180b0730 2021-10-21T00:10:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 msgr2=0x7f2dfc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 0x7f2dfc055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f2e0800b000 tx=0x7f2e08006df0).stop 2021-10-21T00:10:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 msgr2=0x7f2e1813ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f2e1810f910 tx=0x7f2e10016000).stop 2021-10-21T00:10:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 shutdown_connections 2021-10-21T00:10:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2dfc053610 0x7f2dfc055ad0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2e180b0730 0x7f2e1813ab60 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e18067a90 0x7f2e1813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 --2- 172.21.15.41:0/2452460641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e1805f9f0 0x7f2e1813dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 >> 172.21.15.41:0/2452460641 conn(0x7f2e180637b0 msgr2=0x7f2e1813ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 shutdown_connections 2021-10-21T00:10:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.347+0000 7f2e1d625700 1 -- 172.21.15.41:0/2452460641 wait complete. 2021-10-21T00:10:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:10:31.368 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:10:31.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 Processor -- start 2021-10-21T00:10:31.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 -- start start 2021-10-21T00:10:31.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b280acd30 0x7f4b2805c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280b41a0 0x7f4b280b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280ba000 con 0x7f4b280b9c20 2021-10-21T00:10:31.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b28143bc0 con 0x7f4b280acd30 2021-10-21T00:10:31.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b2d533700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28142ad0 con 0x7f4b280b41a0 2021-10-21T00:10:31.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.471+0000 7f4b277fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b280acd30 0x7f4b2805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b280acd30 0x7f4b2805c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35570/0 (socket says 172.21.15.41:35570) 2021-10-21T00:10:31.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 -- 172.21.15.41:0/2206284482 learned_addr learned my addr 172.21.15.41:0/2206284482 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:31.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2cd32700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280b41a0 0x7f4b280b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 -- 172.21.15.41:0/2206284482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280b41a0 msgr2=0x7f4b280b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:31.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280b41a0 0x7f4b280b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 -- 172.21.15.41:0/2206284482 >> v1:172.21.15.41:6789/0 conn(0x7f4b280b9c20 legacy=0x7f4b281434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 -- 172.21.15.41:0/2206284482 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28142d70 con 0x7f4b280acd30 2021-10-21T00:10:31.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280acd30 0x7f4b2805c860 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10006eb0).ready entity=mon.0 client_cookie=974313d68c8ce634 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b26ffd700 1 -- 172.21.15.41:0/2206284482 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1000d5c0 con 0x7f4b280acd30 2021-10-21T00:10:31.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b26ffd700 1 -- 172.21.15.41:0/2206284482 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10000e90 con 0x7f4b280acd30 2021-10-21T00:10:31.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b26ffd700 1 -- 172.21.15.41:0/2206284482 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1000d950 con 0x7f4b280acd30 2021-10-21T00:10:31.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- 172.21.15.41:0/2206284482 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280acd30 msgr2=0x7f4b2805c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280acd30 0x7f4b2805c860 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10006eb0).stop 2021-10-21T00:10:31.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- 172.21.15.41:0/2206284482 shutdown_connections 2021-10-21T00:10:31.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280b41a0 0x7f4b280b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- 172.21.15.41:0/2206284482 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280acd30 0x7f4b2805c860 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- 172.21.15.41:0/2206284482 >> 172.21.15.41:0/2206284482 conn(0x7f4b28062f00 msgr2=0x7f4b280b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:31.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- 172.21.15.41:0/2206284482 shutdown_connections 2021-10-21T00:10:31.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- 172.21.15.41:0/2206284482 wait complete. 2021-10-21T00:10:31.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 Processor -- start 2021-10-21T00:10:31.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- start start 2021-10-21T00:10:31.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 0x7f4b280adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 0x7f4b2813f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b280b9c20 0x7f4b2813e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2813ff80 con 0x7f4b280b41a0 2021-10-21T00:10:31.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280b05d0 con 0x7f4b280b9c20 2021-10-21T00:10:31.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2d533700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280af4c0 con 0x7f4b280acd30 2021-10-21T00:10:31.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 0x7f4b2813f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 0x7f4b2813f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35576/0 (socket says 172.21.15.41:35576) 2021-10-21T00:10:31.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b277fe700 1 -- 172.21.15.41:0/762237114 learned_addr learned my addr 172.21.15.41:0/762237114 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:31.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b27fff700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 0x7f4b280adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.475+0000 7f4b2cd32700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b280b9c20 0x7f4b2813e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 -- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b280b9c20 msgr2=0x7f4b2813e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b280b9c20 0x7f4b2813e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 -- 172.21.15.41:0/762237114 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 msgr2=0x7f4b2813f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 0x7f4b2813f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 -- 172.21.15.41:0/762237114 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1000b1e0 con 0x7f4b280acd30 2021-10-21T00:10:31.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b27fff700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 0x7f4b280adb20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4b280b6c80 tx=0x7f4b18007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b18013450 con 0x7f4b280acd30 2021-10-21T00:10:31.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b180135b0 con 0x7f4b280acd30 2021-10-21T00:10:31.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b18013910 con 0x7f4b280acd30 2021-10-21T00:10:31.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b280af0c0 con 0x7f4b280acd30 2021-10-21T00:10:31.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b280b1560 con 0x7f4b280acd30 2021-10-21T00:10:31.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28143010 con 0x7f4b280acd30 2021-10-21T00:10:31.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b18010070 con 0x7f4b280acd30 2021-10-21T00:10:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 0x7f4b0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4b1806b1b0 con 0x7f4b280acd30 2021-10-21T00:10:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.479+0000 7f4b277fe700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 0x7f4b0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.483+0000 7f4b277fe700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 0x7f4b0c055ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4b1001c000 tx=0x7f4b10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.487+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b18042590 con 0x7f4b280acd30 2021-10-21T00:10:31.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.619+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4b28057350 con 0x7f4b280acd30 2021-10-21T00:10:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.627+0000 7f4b257fa700 1 -- 172.21.15.41:0/762237114 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b18045bb0 con 0x7f4b280acd30 2021-10-21T00:10:31.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 msgr2=0x7f4b0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 0x7f4b0c055ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4b1001c000 tx=0x7f4b10015000).stop 2021-10-21T00:10:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 msgr2=0x7f4b280adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 0x7f4b280adb20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4b280b6c80 tx=0x7f4b18007b70).stop 2021-10-21T00:10:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 shutdown_connections 2021-10-21T00:10:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b0c053610 0x7f4b0c055ad0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b280b9c20 0x7f4b2813e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b280b41a0 0x7f4b2813f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 --2- 172.21.15.41:0/762237114 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b280acd30 0x7f4b280adb20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 >> 172.21.15.41:0/762237114 conn(0x7f4b28062f00 msgr2=0x7f4b281473c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:31.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 shutdown_connections 2021-10-21T00:10:31.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.631+0000 7f4b2d533700 1 -- 172.21.15.41:0/762237114 wait complete. 2021-10-21T00:10:31.653 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-10-21T00:10:31.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 Processor -- start 2021-10-21T00:10:31.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- start start 2021-10-21T00:10:31.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 0x7fea8805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fea880b3a20 0x7fea8813c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8805bd40 con 0x7fea88062330 2021-10-21T00:10:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8805bf70 con 0x7fea880b3a20 2021-10-21T00:10:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88142cb0 con 0x7fea88062f70 2021-10-21T00:10:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fea880b3a20 0x7fea8813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8dbfb700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fea88062330 0x7fea880b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33352/0 (socket says 172.21.15.41:33352) 2021-10-21T00:10:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8dbfb700 1 -- 172.21.15.41:0/1540101318 learned_addr learned my addr 172.21.15.41:0/1540101318 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:31.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8d3fa700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 0x7fea8805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 -- 172.21.15.41:0/1540101318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 msgr2=0x7fea8805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:31.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 0x7fea8805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 -- 172.21.15.41:0/1540101318 >> v1:172.21.15.41:6789/0 conn(0x7fea88062330 legacy=0x7fea880b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 -- 172.21.15.41:0/1540101318 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88142950 con 0x7fea880b3a20 2021-10-21T00:10:31.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8d3fa700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 0x7fea8805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:31.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8e3fc700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea880b3a20 0x7fea8813c510 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fea800032f0 tx=0x7fea800091d0).ready entity=mon.0 client_cookie=684f8af6db1f992 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8cbf9700 1 -- 172.21.15.41:0/1540101318 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea80009ea0 con 0x7fea880b3a20 2021-10-21T00:10:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8cbf9700 1 -- 172.21.15.41:0/1540101318 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8000b8a0 con 0x7fea880b3a20 2021-10-21T00:10:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8cbf9700 1 -- 172.21.15.41:0/1540101318 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea8000ba10 con 0x7fea880b3a20 2021-10-21T00:10:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1540101318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea880b3a20 msgr2=0x7fea8813c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea880b3a20 0x7fea8813c510 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fea800032f0 tx=0x7fea800091d0).stop 2021-10-21T00:10:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1540101318 shutdown_connections 2021-10-21T00:10:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea880b3a20 0x7fea8813c510 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1540101318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea88062f70 0x7fea8805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1540101318 >> 172.21.15.41:0/1540101318 conn(0x7fea880b9080 msgr2=0x7fea880b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.751+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1540101318 shutdown_connections 2021-10-21T00:10:31.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1540101318 wait complete. 2021-10-21T00:10:31.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 Processor -- start 2021-10-21T00:10:31.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 -- start start 2021-10-21T00:10:31.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea88062f70 0x7fea88141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea880b3a20 0x7fea88141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88152910 con 0x7fea88062330 2021-10-21T00:10:31.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88152bb0 con 0x7fea88062f70 2021-10-21T00:10:31.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8ebfd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8813b1c0 con 0x7fea880b3a20 2021-10-21T00:10:31.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35588/0 (socket says 172.21.15.41:35588) 2021-10-21T00:10:31.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8e3fc700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea880b3a20 0x7fea88141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 -- 172.21.15.41:0/1766001900 learned_addr learned my addr 172.21.15.41:0/1766001900 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:31.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8d3fa700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea88062f70 0x7fea88141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 -- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea880b3a20 msgr2=0x7fea88141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea880b3a20 0x7fea88141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 -- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea88062f70 msgr2=0x7fea88141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:31.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea88062f70 0x7fea88141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:31.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.755+0000 7fea8dbfb700 1 -- 172.21.15.41:0/1766001900 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80009470 con 0x7fea88062330 2021-10-21T00:10:31.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea8dbfb700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fea880b6d90 tx=0x7fea84007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea840070d0 con 0x7fea88062330 2021-10-21T00:10:31.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea84007230 con 0x7fea88062330 2021-10-21T00:10:31.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8813e280 con 0x7fea88062330 2021-10-21T00:10:31.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea84005610 con 0x7fea88062330 2021-10-21T00:10:31.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea88145d20 con 0x7fea88062330 2021-10-21T00:10:31.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88152db0 con 0x7fea88062330 2021-10-21T00:10:31.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea84010070 con 0x7fea88062330 2021-10-21T00:10:31.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 0x7fea68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:31.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fea8406aad0 con 0x7fea88062330 2021-10-21T00:10:31.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.759+0000 7fea8d3fa700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 0x7fea68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:31.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.763+0000 7fea8d3fa700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 0x7fea68055ad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fea7800c000 tx=0x7fea78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:31.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.767+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea84041f10 con 0x7fea88062330 2021-10-21T00:10:31.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:31.931+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fea88057350 con 0x7fea88062330 2021-10-21T00:10:32.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.343+0000 7fea76ffd700 1 -- 172.21.15.41:0/1766001900 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v333) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea84045530 con 0x7fea88062330 2021-10-21T00:10:32.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.347+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 msgr2=0x7fea68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.347+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 0x7fea68055ad0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fea7800c000 tx=0x7fea78008040).stop 2021-10-21T00:10:32.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.347+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 msgr2=0x7fea88143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.347+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fea880b6d90 tx=0x7fea84007c40).stop 2021-10-21T00:10:32.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 shutdown_connections 2021-10-21T00:10:32.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fea68053610 0x7fea68055ad0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea880b3a20 0x7fea88141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea88062f70 0x7fea88141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 --2- 172.21.15.41:0/1766001900 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea88062330 0x7fea88143e70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 >> 172.21.15.41:0/1766001900 conn(0x7fea880b9080 msgr2=0x7fea880b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:32.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 shutdown_connections 2021-10-21T00:10:32.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.351+0000 7fea8ebfd700 1 -- 172.21.15.41:0/1766001900 wait complete. 2021-10-21T00:10:32.376 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:10:32.377 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:10:32.378 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-10-21T00:10:32.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 Processor -- start 2021-10-21T00:10:32.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 -- start start 2021-10-21T00:10:32.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 0x7fd14c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c0b0b50 con 0x7fd14c0af620 2021-10-21T00:10:32.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c0b2550 con 0x7fd14c067a80 2021-10-21T00:10:32.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1510d6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0b0d90 con 0x7fd14c0b2170 2021-10-21T00:10:32.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd14c0af620 0x7fd14c0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33366/0 (socket says 172.21.15.41:33366) 2021-10-21T00:10:32.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14b7fe700 1 -- 172.21.15.41:0/1709190749 learned_addr learned my addr 172.21.15.41:0/1709190749 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:32.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 --2- 172.21.15.41:0/1709190749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1508d5700 1 --2- 172.21.15.41:0/1709190749 >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 0x7fd14c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14affd700 1 -- 172.21.15.41:0/1709190749 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866079379 0 0) 0x7fd13c001110 con 0x7fd14c0af620 2021-10-21T00:10:32.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14affd700 1 -- 172.21.15.41:0/1709190749 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd138003260 con 0x7fd14c0af620 2021-10-21T00:10:32.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 -- 172.21.15.41:0/1709190749 >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 msgr2=0x7fd14c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:32.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 --2- 172.21.15.41:0/1709190749 >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 0x7fd14c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 -- 172.21.15.41:0/1709190749 >> v1:172.21.15.41:6789/0 conn(0x7fd14c0af620 legacy=0x7fd14c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 -- 172.21.15.41:0/1709190749 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0b1030 con 0x7fd14c0b2170 2021-10-21T00:10:32.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd1508d5700 1 --2- 172.21.15.41:0/1709190749 >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 0x7fd14c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:32.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.479+0000 7fd14bfff700 1 --2- 172.21.15.41:0/1709190749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ab170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd140002f70 tx=0x7fd140006df0).ready entity=mon.2 client_cookie=58d8b81a94dc28e4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:32.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd14affd700 1 -- 172.21.15.41:0/1709190749 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000d4a0 con 0x7fd14c0b2170 2021-10-21T00:10:32.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd14affd700 1 -- 172.21.15.41:0/1709190749 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140000e90 con 0x7fd14c0b2170 2021-10-21T00:10:32.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd14affd700 1 -- 172.21.15.41:0/1709190749 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000d7f0 con 0x7fd14c0b2170 2021-10-21T00:10:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- 172.21.15.41:0/1709190749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 msgr2=0x7fd14c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 --2- 172.21.15.41:0/1709190749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ab170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd140002f70 tx=0x7fd140006df0).stop 2021-10-21T00:10:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- 172.21.15.41:0/1709190749 shutdown_connections 2021-10-21T00:10:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 --2- 172.21.15.41:0/1709190749 >> v2:172.21.15.62:3300/0 conn(0x7fd14c067a80 0x7fd14c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 --2- 172.21.15.41:0/1709190749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ab170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- 172.21.15.41:0/1709190749 >> 172.21.15.41:0/1709190749 conn(0x7fd14c0b5700 msgr2=0x7fd14c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- 172.21.15.41:0/1709190749 shutdown_connections 2021-10-21T00:10:32.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- 172.21.15.41:0/1709190749 wait complete. 2021-10-21T00:10:32.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 Processor -- start 2021-10-21T00:10:32.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.483+0000 7fd1510d6700 1 -- start start 2021-10-21T00:10:32.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd14c067a80 0x7fd14c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 0x7fd14c0ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c156ca0 con 0x7fd14c0af620 2021-10-21T00:10:32.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0aec00 con 0x7fd14c067a80 2021-10-21T00:10:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c1453a0 con 0x7fd14c0b2170 2021-10-21T00:10:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd14b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 0x7fd14c0ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd14c067a80 0x7fd14c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd14b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 0x7fd14c0ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35604/0 (socket says 172.21.15.41:35604) 2021-10-21T00:10:32.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd14b7fe700 1 -- 172.21.15.41:0/2843481392 learned_addr learned my addr 172.21.15.41:0/2843481392 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:32.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 -- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd14c067a80 msgr2=0x7fd14c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd14c067a80 0x7fd14c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 -- 172.21.15.41:0/2843481392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 msgr2=0x7fd14c0ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 0x7fd14c0ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:32.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 -- 172.21.15.41:0/2843481392 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144009470 con 0x7fd14c0b2170 2021-10-21T00:10:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1508d5700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ae710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd14c143950 tx=0x7fd1440091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:32.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14400c670 con 0x7fd14c0b2170 2021-10-21T00:10:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400c7d0 con 0x7fd14c0b2170 2021-10-21T00:10:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14000b180 con 0x7fd14c0b2170 2021-10-21T00:10:32.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14400cb30 con 0x7fd14c0b2170 2021-10-21T00:10:32.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c157160 con 0x7fd14c0b2170 2021-10-21T00:10:32.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.487+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c0b12d0 con 0x7fd14c0b2170 2021-10-21T00:10:32.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.491+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd144022070 con 0x7fd14c0b2170 2021-10-21T00:10:32.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.491+0000 7fd1497fa700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 0x7fd12c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:32.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.491+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd14406bcb0 con 0x7fd14c0b2170 2021-10-21T00:10:32.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.491+0000 7fd14bfff700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 0x7fd12c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:32.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.491+0000 7fd14bfff700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 0x7fd12c055b60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd14001a000 tx=0x7fd140014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:32.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.499+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd144043050 con 0x7fd14c0b2170 2021-10-21T00:10:32.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:32.679+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fd14c057350 con 0x7fd14c0b2170 2021-10-21T00:10:33.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.355+0000 7fd1497fa700 1 -- 172.21.15.41:0/2843481392 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v334) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd144016030 con 0x7fd14c0b2170 2021-10-21T00:10:33.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 msgr2=0x7fd12c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 0x7fd12c055b60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd14001a000 tx=0x7fd140014000).stop 2021-10-21T00:10:33.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 msgr2=0x7fd14c0ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ae710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd14c143950 tx=0x7fd1440091d0).stop 2021-10-21T00:10:33.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 shutdown_connections 2021-10-21T00:10:33.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd12c0536a0 0x7fd12c055b60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd14c0b2170 0x7fd14c0ae710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd14c0af620 0x7fd14c0ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 --2- 172.21.15.41:0/2843481392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd14c067a80 0x7fd14c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 >> 172.21.15.41:0/2843481392 conn(0x7fd14c0b5700 msgr2=0x7fd14c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:33.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 shutdown_connections 2021-10-21T00:10:33.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.359+0000 7fd1510d6700 1 -- 172.21.15.41:0/2843481392 wait complete. 2021-10-21T00:10:33.383 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:10:33.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.487+0000 7f4f6f951700 1 Processor -- start 2021-10-21T00:10:33.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.487+0000 7f4f6f951700 1 -- start start 2021-10-21T00:10:33.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b3150 0x7f4f68061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4f680b19f0 0x7f4f68061fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f680b38b0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f680ad200 con 0x7f4f680b19f0 2021-10-21T00:10:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68061660 con 0x7f4f680b3150 2021-10-21T00:10:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4f680b19f0 0x7f4f68061fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6d6ed700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4f6805f9f0 0x7f4f681435d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33382/0 (socket says 172.21.15.41:33382) 2021-10-21T00:10:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6d6ed700 1 -- 172.21.15.41:0/204367137 learned_addr learned my addr 172.21.15.41:0/204367137 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6ceec700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b3150 0x7f4f68061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 -- 172.21.15.41:0/204367137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b3150 msgr2=0x7f4f68061ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b3150 0x7f4f68061ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 -- 172.21.15.41:0/204367137 >> v1:172.21.15.41:6789/0 conn(0x7f4f6805f9f0 legacy=0x7f4f681435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 -- 172.21.15.41:0/204367137 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6805fdd0 con 0x7f4f680b19f0 2021-10-21T00:10:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f5ffff700 1 -- 172.21.15.41:0/204367137 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697344986 0 0) 0x7f4f680b38b0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6deee700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f680b19f0 0x7f4f68061fb0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f4f600032f0 tx=0x7f4f600091d0).ready entity=mon.0 client_cookie=c0d0d32d9870a9ec server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f5ffff700 1 -- 172.21.15.41:0/204367137 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f60009ea0 con 0x7f4f680b19f0 2021-10-21T00:10:33.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f5ffff700 1 -- 172.21.15.41:0/204367137 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000b8a0 con 0x7f4f680b19f0 2021-10-21T00:10:33.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f5ffff700 1 -- 172.21.15.41:0/204367137 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f6000ba10 con 0x7f4f680b19f0 2021-10-21T00:10:33.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- 172.21.15.41:0/204367137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f680b19f0 msgr2=0x7f4f68061fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f680b19f0 0x7f4f68061fb0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f4f600032f0 tx=0x7f4f600091d0).stop 2021-10-21T00:10:33.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- 172.21.15.41:0/204367137 shutdown_connections 2021-10-21T00:10:33.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f680b19f0 0x7f4f68061fb0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 --2- 172.21.15.41:0/204367137 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b3150 0x7f4f68061ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- 172.21.15.41:0/204367137 >> 172.21.15.41:0/204367137 conn(0x7f4f680b3af0 msgr2=0x7f4f680b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:33.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- 172.21.15.41:0/204367137 shutdown_connections 2021-10-21T00:10:33.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.491+0000 7f4f6f951700 1 -- 172.21.15.41:0/204367137 wait complete. 2021-10-21T00:10:33.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 Processor -- start 2021-10-21T00:10:33.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- start start 2021-10-21T00:10:33.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 0x7f4f68066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f680b3150 0x7f4f6809c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f681460a0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68144360 con 0x7f4f680b3150 2021-10-21T00:10:33.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68145e00 con 0x7f4f680b19f0 2021-10-21T00:10:33.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35618/0 (socket says 172.21.15.41:35618) 2021-10-21T00:10:33.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 -- 172.21.15.41:0/3432781810 learned_addr learned my addr 172.21.15.41:0/3432781810 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:33.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6deee700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f680b3150 0x7f4f6809c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6ceec700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 0x7f4f68066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 -- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 msgr2=0x7f4f68066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 0x7f4f68066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 -- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f680b3150 msgr2=0x7f4f6809c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f680b3150 0x7f4f6809c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 -- 172.21.15.41:0/3432781810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60009470 con 0x7f4f6805f9f0 2021-10-21T00:10:33.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6ceec700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 0x7f4f68066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:33.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6d6ed700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f4f58000ed0 tx=0x7f4f58007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f580070d0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f58007230 con 0x7f4f6805f9f0 2021-10-21T00:10:33.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6809c0e0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f58005610 con 0x7f4f6805f9f0 2021-10-21T00:10:33.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.495+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f68067040 con 0x7f4f6805f9f0 2021-10-21T00:10:33.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f68145c30 con 0x7f4f6805f9f0 2021-10-21T00:10:33.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f5801a060 con 0x7f4f6805f9f0 2021-10-21T00:10:33.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f5e7fc700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 0x7f4f50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4f5806aee0 con 0x7f4f6805f9f0 2021-10-21T00:10:33.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f6ceec700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 0x7f4f50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.499+0000 7f4f6ceec700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 0x7f4f50055ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f4f6400c000 tx=0x7f4f64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.503+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f58042210 con 0x7f4f6805f9f0 2021-10-21T00:10:33.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.631+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4f6809c270 con 0x7f4f6805f9f0 2021-10-21T00:10:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.639+0000 7f4f5e7fc700 1 -- 172.21.15.41:0/3432781810 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f58018030 con 0x7f4f6805f9f0 2021-10-21T00:10:33.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 msgr2=0x7f4f50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 0x7f4f50055ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f4f6400c000 tx=0x7f4f64008040).stop 2021-10-21T00:10:33.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 msgr2=0x7f4f68143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f4f58000ed0 tx=0x7f4f58007ac0).stop 2021-10-21T00:10:33.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 shutdown_connections 2021-10-21T00:10:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4f50053610 0x7f4f50055ad0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f680b3150 0x7f4f6809c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f680b19f0 0x7f4f68066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 --2- 172.21.15.41:0/3432781810 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4f6805f9f0 0x7f4f68143e70 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 >> 172.21.15.41:0/3432781810 conn(0x7f4f680b3af0 msgr2=0x7f4f680b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:33.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 shutdown_connections 2021-10-21T00:10:33.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.643+0000 7f4f6f951700 1 -- 172.21.15.41:0/3432781810 wait complete. 2021-10-21T00:10:33.667 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:33.668 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:33.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:33.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:33.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:33.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:33.778 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:33.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:33.779 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:33.780 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:33.787 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:10:33.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:33.788 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:33.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:33.789 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:33.790 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:10:33.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:33.806 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:33.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:33.807 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:33.809 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:33.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:33.818 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:33.819 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:33.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 Processor -- start 2021-10-21T00:10:33.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 -- start start 2021-10-21T00:10:33.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7848062330 0x7f78480b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f78480b3a20 0x7f784813c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784805bd40 con 0x7f7848062f70 2021-10-21T00:10:33.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784805bf70 con 0x7f78480b3a20 2021-10-21T00:10:33.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784e413700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848142cb0 con 0x7f7848062330 2021-10-21T00:10:33.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f78480b3a20 0x7f784813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f78480b3a20 0x7f784813c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35630/0 (socket says 172.21.15.41:35630) 2021-10-21T00:10:33.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 -- 172.21.15.41:0/980473658 learned_addr learned my addr 172.21.15.41:0/980473658 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:33.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784d411700 1 --2- 172.21.15.41:0/980473658 >> v2:172.21.15.62:3300/0 conn(0x7f7848062330 0x7f78480b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f783bfff700 1 -- 172.21.15.41:0/980473658 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285457603 0 0) 0x7f784805bd40 con 0x7f7848062f70 2021-10-21T00:10:33.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 -- 172.21.15.41:0/980473658 >> v2:172.21.15.62:3300/0 conn(0x7f7848062330 msgr2=0x7f78480b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:33.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 --2- 172.21.15.41:0/980473658 >> v2:172.21.15.62:3300/0 conn(0x7f7848062330 0x7f78480b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 -- 172.21.15.41:0/980473658 >> v1:172.21.15.62:6789/0 conn(0x7f7848062f70 legacy=0x7f784805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 -- 172.21.15.41:0/980473658 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848142950 con 0x7f78480b3a20 2021-10-21T00:10:33.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f784dc12700 1 --2- 172.21.15.41:0/980473658 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f784813c510 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f78400032f0 tx=0x7f7840009290).ready entity=mon.0 client_cookie=44f987f320b3f297 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f783bfff700 1 -- 172.21.15.41:0/980473658 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784000b870 con 0x7f78480b3a20 2021-10-21T00:10:33.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f783bfff700 1 -- 172.21.15.41:0/980473658 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000b9d0 con 0x7f78480b3a20 2021-10-21T00:10:33.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.923+0000 7f783bfff700 1 -- 172.21.15.41:0/980473658 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784000bb40 con 0x7f78480b3a20 2021-10-21T00:10:33.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- 172.21.15.41:0/980473658 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 msgr2=0x7f784813c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- 172.21.15.41:0/980473658 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f784813c510 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f78400032f0 tx=0x7f7840009290).stop 2021-10-21T00:10:33.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- 172.21.15.41:0/980473658 shutdown_connections 2021-10-21T00:10:33.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- 172.21.15.41:0/980473658 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f784813c510 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- 172.21.15.41:0/980473658 >> v2:172.21.15.62:3300/0 conn(0x7f7848062330 0x7f78480b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- 172.21.15.41:0/980473658 >> 172.21.15.41:0/980473658 conn(0x7f78480b9080 msgr2=0x7f78480b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:33.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- 172.21.15.41:0/980473658 shutdown_connections 2021-10-21T00:10:33.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- 172.21.15.41:0/980473658 wait complete. 2021-10-21T00:10:33.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 Processor -- start 2021-10-21T00:10:33.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- start start 2021-10-21T00:10:33.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 0x7f7848144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 0x7f78480ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784813e6f0 con 0x7f78480b3a20 2021-10-21T00:10:33.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848113350 con 0x7f7848062f70 2021-10-21T00:10:33.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.927+0000 7f784e413700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848145130 con 0x7f7848062330 2021-10-21T00:10:33.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35636/0 (socket says 172.21.15.41:35636) 2021-10-21T00:10:33.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784cc10700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 0x7f78480ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 -- 172.21.15.41:0/996921666 learned_addr learned my addr 172.21.15.41:0/996921666 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:33.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784d411700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 0x7f7848144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 -- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 msgr2=0x7f7848144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 0x7f7848144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 -- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 msgr2=0x7f78480ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:33.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 0x7f78480ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:33.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 -- 172.21.15.41:0/996921666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009530 con 0x7f78480b3a20 2021-10-21T00:10:33.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784d411700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 0x7f7848144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:33.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784cc10700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 0x7f78480ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:33.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784dc12700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f78400032f0 tx=0x7f7840016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784000b870 con 0x7f78480b3a20 2021-10-21T00:10:33.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840021630 con 0x7f78480b3a20 2021-10-21T00:10:33.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7848145390 con 0x7f78480b3a20 2021-10-21T00:10:33.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7840021990 con 0x7f78480b3a20 2021-10-21T00:10:33.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480aee90 con 0x7f78480b3a20 2021-10-21T00:10:33.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.931+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848151f20 con 0x7f78480b3a20 2021-10-21T00:10:33.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.935+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7840029070 con 0x7f78480b3a20 2021-10-21T00:10:33.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.935+0000 7f783affd700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 0x7f7824055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:33.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.935+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f784006c5c0 con 0x7f78480b3a20 2021-10-21T00:10:33.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.935+0000 7f784d411700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 0x7f7824055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:33.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.935+0000 7f784d411700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 0x7f7824055a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f784400b000 tx=0x7f7844006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:33.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:33.943+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7840043960 con 0x7f78480b3a20 2021-10-21T00:10:34.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.067+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7848057350 con 0x7f78480b3a20 2021-10-21T00:10:34.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f783affd700 1 -- 172.21.15.41:0/996921666 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v91) v1 ==== 81+0+28828 (secure 0 0 0) 0x7f7840015070 con 0x7f78480b3a20 2021-10-21T00:10:34.080 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:34.080 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:34.081 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 91, 2021-10-21T00:10:34.081 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:34.081 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:34.081 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:10:31.334536+0000", 2021-10-21T00:10:34.082 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:34.082 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:34.082 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:34.082 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:34.082 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:34.083 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:34.083 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:34.083 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:34.083 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:34.084 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:34.084 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:34.084 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:34.084 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:34.085 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:34.085 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:34.085 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 18, 2021-10-21T00:10:34.085 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:34.085 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:34.086 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:34.086 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:34.086 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:34.087 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.087 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:34.087 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:34.088 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:34.089 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:34.089 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:34.089 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:34.089 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:34.090 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:34.090 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:34.091 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:34.091 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:34.091 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:34.091 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:34.092 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:34.092 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:34.093 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:34.093 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:34.093 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:34.093 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:34.093 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:34.094 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:34.094 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:34.094 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:34.094 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.095 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:34.095 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:34.095 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:34.095 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:34.096 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:34.096 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:34.096 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:34.096 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:34.096 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:34.097 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:34.097 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:34.097 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:34.097 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:34.098 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:34.098 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:34.098 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:34.098 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:34.098 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:34.099 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:34.099 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:34.099 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:34.099 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:34.100 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:34.100 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:34.100 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:34.100 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:34.101 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:34.101 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.101 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:34.101 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:34.102 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:34.102 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:34.102 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:34.102 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:34.103 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:34.103 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:34.104 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:34.104 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:34.105 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:34.105 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:34.105 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:34.105 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.106 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:34.106 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:34.106 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.106 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.107 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.107 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:34.107 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:34.107 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:34.107 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:34.108 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:34.108 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:34.108 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:34.108 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:34.109 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:34.109 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:34.109 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:34.109 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:34.109 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:34.110 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:34.110 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:34.110 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:34.110 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:34.111 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:34.111 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:34.111 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:34.111 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:34.111 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:34.112 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:34.112 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.112 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:34.112 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:34.113 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:34.113 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:34.113 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:34.113 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:34.113 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:34.114 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:34.114 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:34.114 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:34.114 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:34.115 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:34.115 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:34.115 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:34.115 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:34.115 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:34.116 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:34.116 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:34.116 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:34.116 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:34.117 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:34.117 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:34.117 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:34.117 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:34.117 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:34.118 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:34.118 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:34.118 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.118 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:34.119 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:34.119 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:34.119 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:34.119 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:34.119 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:34.120 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:34.120 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:34.120 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:34.120 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:34.121 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:34.121 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:34.121 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:34.121 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:34.121 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.122 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.122 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:34.122 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:34.122 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.123 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:34.123 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:34.123 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.123 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.123 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.124 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.124 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.124 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.124 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.125 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:34.125 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.125 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.125 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.125 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.126 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.126 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.126 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:34.126 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.127 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.127 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.127 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.127 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:34.127 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.128 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.128 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.128 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.128 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.129 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.129 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.129 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.129 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:34.129 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.130 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.130 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.130 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.130 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:34.131 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.131 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.131 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.131 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.131 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.132 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.132 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.132 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.132 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:34.132 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.133 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.133 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.133 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.133 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:34.134 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.134 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.134 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.134 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.134 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.135 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.135 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.135 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.135 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:34.136 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.136 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.136 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.136 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.136 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:34.137 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:34.137 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.137 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.137 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.138 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:34.138 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:34.138 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:34.138 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:34.138 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.139 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.139 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.139 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.139 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.140 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.140 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:34.140 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:34.140 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.140 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.141 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.141 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.141 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.141 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.142 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.142 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:34.142 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.142 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.142 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.143 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.143 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.143 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.143 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:34.144 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.144 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.144 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.144 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.144 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:34.145 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.145 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.145 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.145 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.145 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.146 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.146 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.146 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.146 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:34.147 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.147 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.147 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.147 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.147 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:34.148 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.148 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.148 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.148 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.149 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.149 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.149 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.149 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.149 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:34.150 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.150 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.150 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.150 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.151 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:34.151 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.151 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.151 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.151 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.152 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.152 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.152 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.152 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.153 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:34.153 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.153 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.153 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.153 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.154 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:34.154 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:34.154 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.154 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.155 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.155 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:34.155 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:34.155 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:34.155 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:34.156 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.156 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.156 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.156 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.157 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.157 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.157 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:34.157 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:34.157 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.158 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.158 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.158 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.158 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.159 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.159 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.159 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:34.159 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.159 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.160 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.160 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.160 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.160 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.161 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:34.161 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.161 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.161 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.161 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.162 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:34.162 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.162 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.162 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.163 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.163 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.163 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.163 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.163 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.164 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:34.164 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.164 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.164 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.165 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.165 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:34.165 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.165 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.165 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.166 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.166 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.166 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.166 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.167 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.167 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:34.167 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.167 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.167 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.168 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.168 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:34.168 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.168 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.168 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.169 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.169 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.169 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.169 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.170 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.170 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:34.170 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.170 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.170 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.171 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.171 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:34.171 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:34.171 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.172 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.172 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.172 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:34.172 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:34.172 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:34.173 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:34.173 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.173 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.173 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.174 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.174 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.174 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.174 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:34.174 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:34.175 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.175 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.175 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.175 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.176 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.176 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.176 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.176 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:34.176 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.177 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.177 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.177 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.177 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.178 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.178 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:34.178 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.178 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.178 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.179 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.179 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:34.179 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.179 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.180 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.180 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.180 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.180 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.180 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.181 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.181 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:34.181 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.181 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.182 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.182 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.182 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:34.182 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.182 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.183 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.183 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.183 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.183 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.183 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.184 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.184 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:34.184 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.184 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.185 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.185 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.185 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:34.185 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.185 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.186 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.186 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.186 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.186 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.187 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.187 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.187 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:34.187 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.187 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.188 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.188 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.188 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:34.188 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:34.189 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.189 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.189 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.189 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:34.189 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:34.190 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:34.190 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:34.190 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.190 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.190 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.191 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.191 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.191 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.191 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:34.192 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:34.192 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.192 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.192 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.192 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.193 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.193 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.193 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.193 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 85, 2021-10-21T00:10:34.194 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.194 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.194 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.194 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.194 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.195 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.195 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:34.195 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.195 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.195 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.196 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.196 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:34.196 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.196 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.197 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.197 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.197 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.197 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.197 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.198 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.198 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:34.198 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.198 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.199 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.199 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.199 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:34.199 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.199 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.200 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.200 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.200 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.200 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.201 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.201 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.201 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:34.201 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.201 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.202 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.202 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.202 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:34.202 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.203 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.203 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.203 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.203 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.203 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.204 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.204 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.204 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:34.204 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.205 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.205 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.205 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.205 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:34.205 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:34.206 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.206 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.206 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.206 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:34.207 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:34.207 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:34.207 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:34.207 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.207 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.208 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.208 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.208 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.208 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.208 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:34.209 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:34.209 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.209 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.209 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.210 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.210 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.210 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.210 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.210 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 76, 2021-10-21T00:10:34.211 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.211 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.211 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.212 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.212 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.212 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:34.212 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.212 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.213 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.213 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.213 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:34.213 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.214 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.214 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.214 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.214 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.214 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.215 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.215 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.215 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:34.215 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.216 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.216 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.216 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.216 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:34.216 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.217 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.217 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.217 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.217 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.218 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.218 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.218 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:34.218 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.219 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.219 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.219 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.219 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:34.220 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.220 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.220 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.220 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.220 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.221 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.221 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:34.221 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.222 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.222 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.222 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.222 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:34.223 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:34.223 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.223 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.223 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.223 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:34.224 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:34.224 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:34.224 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:34.224 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.225 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.225 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.225 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.225 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.225 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.226 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:34.226 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:34.226 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.226 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.227 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.227 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.227 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.227 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.227 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 85, 2021-10-21T00:10:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.228 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.229 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.229 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.229 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:34.229 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.230 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.230 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.230 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:34.230 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.231 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.231 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.231 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.231 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.232 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.232 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:34.232 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.233 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.233 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.233 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:34.234 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.234 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.234 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.234 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.234 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.235 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.235 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.235 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.235 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:34.236 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.236 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.236 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.236 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.236 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:34.237 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.237 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.237 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.237 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.237 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.238 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.238 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.238 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.238 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:34.239 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.239 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.239 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.239 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.239 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:34.240 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:34.240 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.240 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.240 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.241 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:34.241 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:34.241 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:34.241 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:34.241 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.242 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.242 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.242 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.242 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.243 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.243 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:34.243 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:34.243 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:34.243 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:34.244 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:34.244 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:34.244 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:34.244 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:34.244 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:34.245 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 86, 2021-10-21T00:10:34.245 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:34.245 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:34.245 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:34.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.246 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.246 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:34.246 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.247 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.247 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.247 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.247 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:34.248 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.248 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.248 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.248 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.248 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:34.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.249 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.250 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.250 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:34.250 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.250 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.251 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.251 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.252 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:34.252 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.252 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.252 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.253 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.253 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:34.253 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.253 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.254 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.254 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:34.254 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.254 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.254 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.255 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.255 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:34.255 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.255 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.256 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.256 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.256 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:34.256 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:34.257 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.257 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:34.257 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:34.257 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.257 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.258 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:34.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:34.258 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:34.259 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.259 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.259 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.259 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:34.259 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:34.260 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:34.260 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:34.260 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:34.260 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:34.261 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:34.261 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:34.261 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.261 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:34.262 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:34.262 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.262 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:34.262 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.262 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.263 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.263 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.263 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.263 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:34.264 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.264 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.264 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.264 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:34.264 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.265 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.265 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.265 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.265 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.266 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:34.266 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.266 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.266 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.266 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:34.267 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.267 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.267 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.267 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.268 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.268 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:34.268 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.268 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.268 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.269 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:34.269 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.269 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.269 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.269 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.270 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.270 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:34.270 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.270 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.271 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.271 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:34.271 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.271 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.271 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.272 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.272 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.272 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:34.272 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.273 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.273 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.273 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:34.273 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.273 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.274 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.274 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.274 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.274 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:34.275 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.275 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.275 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.275 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:34.275 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.276 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.276 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.276 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.276 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.277 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:34.277 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.277 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:34.277 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:34.278 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:34.278 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:34.278 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:34.278 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:34.278 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:34.279 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:34.279 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:34.279 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.279 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:34.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:34.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:34.280 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:34.280 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:34.280 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:10:34.281 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/3653268088": "2021-10-22T00:10:28.161727+0000", 2021-10-21T00:10:34.281 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/3653268088": "2021-10-22T00:10:28.161727+0000" 2021-10-21T00:10:34.281 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.281 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:34.282 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:34.282 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:34.282 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:34.282 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:34.283 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:34.283 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:34.283 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:34.283 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:34.283 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:34.284 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:34.284 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:34.284 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:34.284 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:34.285 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:34.285 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:34.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 msgr2=0x7f7824055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 0x7f7824055a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f784400b000 tx=0x7f7844006df0).stop 2021-10-21T00:10:34.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 msgr2=0x7f7848152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f78400032f0 tx=0x7f7840016000).stop 2021-10-21T00:10:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 shutdown_connections 2021-10-21T00:10:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7824053580 0x7f7824055a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78480b3a20 0x7f7848152570 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7848062f70 0x7f78480ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 --2- 172.21.15.41:0/996921666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7848062330 0x7f7848144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 >> 172.21.15.41:0/996921666 conn(0x7f78480b9080 msgr2=0x7f784813eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 shutdown_connections 2021-10-21T00:10:34.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.071+0000 7f784e413700 1 -- 172.21.15.41:0/996921666 wait complete. 2021-10-21T00:10:34.290 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:34.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.395+0000 7f88b5a7b700 1 Processor -- start 2021-10-21T00:10:34.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.395+0000 7f88b5a7b700 1 -- start start 2021-10-21T00:10:34.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88b00af620 0x7f88b00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f88b0067a80 0x7f88b0149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00b0b50 con 0x7f88b00b2170 2021-10-21T00:10:34.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00b2550 con 0x7f88b0067a80 2021-10-21T00:10:34.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00b0d90 con 0x7f88b00af620 2021-10-21T00:10:34.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f88b0067a80 0x7f88b0149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f88b0067a80 0x7f88b0149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35644/0 (socket says 172.21.15.41:35644) 2021-10-21T00:10:34.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 -- 172.21.15.41:0/1470854065 learned_addr learned my addr 172.21.15.41:0/1470854065 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:34.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88affff700 1 --2- 172.21.15.41:0/1470854065 >> v2:172.21.15.62:3300/0 conn(0x7f88b00af620 0x7f88b00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 -- 172.21.15.41:0/1470854065 >> v2:172.21.15.62:3300/0 conn(0x7f88b00af620 msgr2=0x7f88b00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:34.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 --2- 172.21.15.41:0/1470854065 >> v2:172.21.15.62:3300/0 conn(0x7f88b00af620 0x7f88b00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 -- 172.21.15.41:0/1470854065 >> v1:172.21.15.41:6789/0 conn(0x7f88b00b2170 legacy=0x7f88b00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 -- 172.21.15.41:0/1470854065 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00b1030 con 0x7f88b0067a80 2021-10-21T00:10:34.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b527a700 1 --2- 172.21.15.41:0/1470854065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b0149320 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f88b00aafa0 tx=0x7f88a8009290).ready entity=mon.0 client_cookie=715a0068523b5439 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88af7fe700 1 -- 172.21.15.41:0/1470854065 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a800b860 con 0x7f88b0067a80 2021-10-21T00:10:34.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88af7fe700 1 -- 172.21.15.41:0/1470854065 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800b9c0 con 0x7f88b0067a80 2021-10-21T00:10:34.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88af7fe700 1 -- 172.21.15.41:0/1470854065 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a800bb30 con 0x7f88b0067a80 2021-10-21T00:10:34.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- 172.21.15.41:0/1470854065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 msgr2=0x7f88b0149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/1470854065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b0149320 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f88b00aafa0 tx=0x7f88a8009290).stop 2021-10-21T00:10:34.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- 172.21.15.41:0/1470854065 shutdown_connections 2021-10-21T00:10:34.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/1470854065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b0149320 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/1470854065 >> v2:172.21.15.62:3300/0 conn(0x7f88b00af620 0x7f88b00ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- 172.21.15.41:0/1470854065 >> 172.21.15.41:0/1470854065 conn(0x7f88b00b5700 msgr2=0x7f88b00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:34.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- 172.21.15.41:0/1470854065 shutdown_connections 2021-10-21T00:10:34.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- 172.21.15.41:0/1470854065 wait complete. 2021-10-21T00:10:34.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 Processor -- start 2021-10-21T00:10:34.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.399+0000 7f88b5a7b700 1 -- start start 2021-10-21T00:10:34.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88b00af620 0x7f88b0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88b00b2170 0x7f88b0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0063bd0 con 0x7f88b0067a80 2021-10-21T00:10:34.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0067540 con 0x7f88b00af620 2021-10-21T00:10:34.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00638f0 con 0x7f88b00b2170 2021-10-21T00:10:34.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35646/0 (socket says 172.21.15.41:35646) 2021-10-21T00:10:34.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 -- 172.21.15.41:0/279486677 learned_addr learned my addr 172.21.15.41:0/279486677 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:34.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88affff700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88b00af620 0x7f88b0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b527a700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88b00b2170 0x7f88b0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 -- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88b00b2170 msgr2=0x7f88b0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88b00b2170 0x7f88b0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 -- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88b00af620 msgr2=0x7f88b0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88b00af620 0x7f88b0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 -- 172.21.15.41:0/279486677 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009530 con 0x7f88b0067a80 2021-10-21T00:10:34.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b4a79700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f88b0062470 tx=0x7f88a4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a4007e70 con 0x7f88b0067a80 2021-10-21T00:10:34.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4007030 con 0x7f88b0067a80 2021-10-21T00:10:34.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0066e00 con 0x7f88b0067a80 2021-10-21T00:10:34.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88a4007390 con 0x7f88b0067a80 2021-10-21T00:10:34.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b0063660 con 0x7f88b0067a80 2021-10-21T00:10:34.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.403+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b00b12d0 con 0x7f88b0067a80 2021-10-21T00:10:34.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.407+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f88a4010030 con 0x7f88b0067a80 2021-10-21T00:10:34.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.407+0000 7f88adffb700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 0x7f8890055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.407+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f88a406af00 con 0x7f88b0067a80 2021-10-21T00:10:34.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.407+0000 7f88affff700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 0x7f8890055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.407+0000 7f88affff700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 0x7f8890055ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f88a000c000 tx=0x7f88a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.415+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88a4042340 con 0x7f88b0067a80 2021-10-21T00:10:34.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.575+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b00b0b50 con 0x7f88b0067a80 2021-10-21T00:10:34.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.575+0000 7f88adffb700 1 -- 172.21.15.41:0/279486677 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f88b00b0b50 con 0x7f88b0067a80 2021-10-21T00:10:34.587 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:34.587 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43},{"gid":7254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/1371474465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1371474465},{"type":"v1","addr":"172.21.15.41:6833","nonce":1371474465}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[]} 2021-10-21T00:10:34.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 msgr2=0x7f8890055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 0x7f8890055ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f88a000c000 tx=0x7f88a0008040).stop 2021-10-21T00:10:34.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 msgr2=0x7f88b014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f88b0062470 tx=0x7f88a4007c00).stop 2021-10-21T00:10:34.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 shutdown_connections 2021-10-21T00:10:34.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8890053610 0x7f8890055ad0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88b00b2170 0x7f88b0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88b00af620 0x7f88b0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 --2- 172.21.15.41:0/279486677 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f88b0067a80 0x7f88b014cee0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 >> 172.21.15.41:0/279486677 conn(0x7f88b00b5700 msgr2=0x7f88b00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:34.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 shutdown_connections 2021-10-21T00:10:34.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.579+0000 7f88b5a7b700 1 -- 172.21.15.41:0/279486677 wait complete. 2021-10-21T00:10:34.592 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 48 2021-10-21T00:10:34.600 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:34.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 Processor -- start 2021-10-21T00:10:34.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 -- start start 2021-10-21T00:10:34.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8062f70 0x7f5ca805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca805bd40 con 0x7f5ca80b3a20 2021-10-21T00:10:34.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca805bf70 con 0x7f5ca8062330 2021-10-21T00:10:34.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5cac9c9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8142cb0 con 0x7f5ca8062f70 2021-10-21T00:10:34.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5ca7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5ca80b3a20 0x7f5ca813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33426/0 (socket says 172.21.15.41:33426) 2021-10-21T00:10:34.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5ca7fff700 1 -- 172.21.15.41:0/149867112 learned_addr learned my addr 172.21.15.41:0/149867112 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:34.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.691+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8062f70 0x7f5ca805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836062924 0 0) 0x7f5ca805bd40 con 0x7f5ca80b3a20 2021-10-21T00:10:34.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c94003260 con 0x7f5ca80b3a20 2021-10-21T00:10:34.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812013642 0 0) 0x7f5ca805bf70 con 0x7f5ca8062330 2021-10-21T00:10:34.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca805bd40 con 0x7f5ca8062330 2021-10-21T00:10:34.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2964843301 0 0) 0x7f5c94003260 con 0x7f5ca80b3a20 2021-10-21T00:10:34.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8062f70 msgr2=0x7f5ca805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:34.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8062f70 0x7f5ca805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 >> v1:172.21.15.62:6789/0 conn(0x7f5ca8062330 legacy=0x7f5ca80b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8142950 con 0x7f5ca80b3a20 2021-10-21T00:10:34.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f5ca00019e0 con 0x7f5ca80b3a20 2021-10-21T00:10:34.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 >> v1:172.21.15.41:6789/0 conn(0x7f5ca80b3a20 legacy=0x7f5ca813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c94003910 0x7f5c94003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94004500 0x7f5c94004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c94004e70 0x7f5c9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8142cb0 con 0x7f5c94003910 2021-10-21T00:10:34.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9400bc40 con 0x7f5c94004500 2021-10-21T00:10:34.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9400be00 con 0x7f5c94004e70 2021-10-21T00:10:34.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8062f70 0x7f5ca805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:34.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c94003910 0x7f5c94003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca7fff700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c94004e70 0x7f5c9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 -- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c94004e70 msgr2=0x7f5c9400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:34.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c94004e70 0x7f5c9400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 -- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94004500 msgr2=0x7f5c94004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:34.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94004500 0x7f5c94004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94004500 0x7f5c94004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 -- 172.21.15.41:0/149867112 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94003260 con 0x7f5c94003910 2021-10-21T00:10:34.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94004500 0x7f5c94004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:34.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c94003910 0x7f5c94003d10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f5c98001110 tx=0x7f5c980079c0).ready entity=mon.0 client_cookie=c8c2ee5d4855dc4d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c98007cd0 con 0x7f5c94003910 2021-10-21T00:10:34.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98007030 con 0x7f5c94003910 2021-10-21T00:10:34.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca67fc700 1 -- 172.21.15.41:0/149867112 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c98007390 con 0x7f5c94003910 2021-10-21T00:10:34.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 -- 172.21.15.41:0/149867112 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c94003910 msgr2=0x7f5c94003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/149867112 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c94003910 0x7f5c94003d10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f5c98001110 tx=0x7f5c980079c0).stop 2021-10-21T00:10:34.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5ca7fff700 1 -- 172.21.15.41:0/149867112 reap_dead start 2021-10-21T00:10:34.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 -- 172.21.15.41:0/149867112 shutdown_connections 2021-10-21T00:10:34.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 -- 172.21.15.41:0/149867112 >> 172.21.15.41:0/149867112 conn(0x7f5ca80b9080 msgr2=0x7f5ca80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:34.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 -- 172.21.15.41:0/149867112 shutdown_connections 2021-10-21T00:10:34.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.695+0000 7f5cac9c9700 1 -- 172.21.15.41:0/149867112 wait complete. 2021-10-21T00:10:34.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 Processor -- start 2021-10-21T00:10:34.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- start start 2021-10-21T00:10:34.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 0x7f5ca8141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8144ef0 0x7f5ca8145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8155930 con 0x7f5ca8112350 2021-10-21T00:10:34.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8155b50 con 0x7f5c94003910 2021-10-21T00:10:34.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8155df0 con 0x7f5ca8144ef0 2021-10-21T00:10:34.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35666/0 (socket says 172.21.15.41:35666) 2021-10-21T00:10:34.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 -- 172.21.15.41:0/3492516971 learned_addr learned my addr 172.21.15.41:0/3492516971 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:34.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 0x7f5ca8141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca7fff700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8144ef0 0x7f5ca8145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 -- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8144ef0 msgr2=0x7f5ca8145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8144ef0 0x7f5ca8145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 -- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 msgr2=0x7f5ca8141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 0x7f5ca8141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 -- 172.21.15.41:0/3492516971 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8156090 con 0x7f5ca8112350 2021-10-21T00:10:34.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 0x7f5ca8141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:34.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca6ffd700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f5c9c00b000 tx=0x7f5c9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c017070 con 0x7f5ca8112350 2021-10-21T00:10:34.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c000e90 con 0x7f5ca8112350 2021-10-21T00:10:34.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca8145860 con 0x7f5ca8112350 2021-10-21T00:10:34.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9c011980 con 0x7f5ca8112350 2021-10-21T00:10:34.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca813f6b0 con 0x7f5ca8112350 2021-10-21T00:10:34.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.699+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8145d90 con 0x7f5ca8112350 2021-10-21T00:10:34.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.703+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c9c011ae0 con 0x7f5ca8112350 2021-10-21T00:10:34.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.703+0000 7f5ca4ff9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 0x7f5c88055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:34.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.703+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5c9c06b9c0 con 0x7f5ca8112350 2021-10-21T00:10:34.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.703+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 0x7f5c88055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:34.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.703+0000 7f5ca77fe700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 0x7f5c88055ad0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f5c98019000 tx=0x7f5c98016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:34.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.707+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c9c042e00 con 0x7f5ca8112350 2021-10-21T00:10:34.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ca8156220 con 0x7f5ca8112350 2021-10-21T00:10:34.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5ca4ff9700 1 -- 172.21.15.41:0/3492516971 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f5c9c046420 con 0x7f5ca8112350 2021-10-21T00:10:34.884 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:34.885 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6245,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/123186886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":123186886},{"type":"v1","addr":"172.21.15.62:6835","nonce":123186886}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43},{"gid":7254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/1371474465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":1371474465},{"type":"v1","addr":"172.21.15.41:6833","nonce":1371474465}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[]} 2021-10-21T00:10:34.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 msgr2=0x7f5c88055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 0x7f5c88055ad0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f5c98019000 tx=0x7f5c98016000).stop 2021-10-21T00:10:34.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 msgr2=0x7f5ca8155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:34.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f5c9c00b000 tx=0x7f5c9c008040).stop 2021-10-21T00:10:34.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 shutdown_connections 2021-10-21T00:10:34.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c88053610 0x7f5c88055ad0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ca8144ef0 0x7f5ca8145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5ca8112350 0x7f5ca8155440 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 --2- 172.21.15.41:0/3492516971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94003910 0x7f5ca8141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:34.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 >> 172.21.15.41:0/3492516971 conn(0x7f5ca80b9080 msgr2=0x7f5ca8142ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:34.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 shutdown_connections 2021-10-21T00:10:34.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:34.875+0000 7f5cac9c9700 1 -- 172.21.15.41:0/3492516971 wait complete. 2021-10-21T00:10:34.889 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 48 2021-10-21T00:10:34.898 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:10:34.899 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:10:34.899 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:10:34.899 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:34.900 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:10:34.900 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:10:34.900 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:10:34.901 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:34.913 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:10:34.914 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:10:34.917 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:10:34.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:10:34.920 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:10:34.920 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:34.923 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:10:34.923 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:34.924 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:10:34.989 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:10:34.995 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:10:35.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.019+0000 7f7bcd95c700 1 Processor -- start 2021-10-21T00:10:35.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.019+0000 7f7bcd95c700 1 -- start start 2021-10-21T00:10:35.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 0x7f7bc813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc813f710 con 0x7f7bc80af700 2021-10-21T00:10:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc80b6350 con 0x7f7bc806a190 2021-10-21T00:10:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80adf10 con 0x7f7bc80b5f70 2021-10-21T00:10:35.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd15b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7bc80af700 0x7f7bc81432e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33466/0 (socket says 172.21.15.41:33466) 2021-10-21T00:10:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd15b700 1 -- 172.21.15.41:0/1040053115 learned_addr learned my addr 172.21.15.41:0/1040053115 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcc95a700 1 --2- 172.21.15.41:0/1040053115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 0x7f7bc813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280146549 0 0) 0x7f7bc80b6350 con 0x7f7bc806a190 2021-10-21T00:10:35.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb4003260 con 0x7f7bc806a190 2021-10-21T00:10:35.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572174183 0 0) 0x7f7bc813f710 con 0x7f7bc80af700 2021-10-21T00:10:35.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc80b6350 con 0x7f7bc80af700 2021-10-21T00:10:35.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcc95a700 1 -- 172.21.15.41:0/1040053115 >> v1:172.21.15.62:6789/0 conn(0x7f7bc806a190 legacy=0x7f7bc8142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:35.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcc95a700 1 -- 172.21.15.41:0/1040053115 >> v1:172.21.15.41:6789/0 conn(0x7f7bc80af700 legacy=0x7f7bc81432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:35.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcc95a700 1 -- 172.21.15.41:0/1040053115 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc81439f0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcc95a700 1 --2- 172.21.15.41:0/1040053115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 0x7f7bc813fb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7bbc002f70 tx=0x7f7bbc006df0).ready entity=mon.2 client_cookie=7ed88d77faff170b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:35.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc00d5c0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc000e90 con 0x7f7bc80b5f70 2021-10-21T00:10:35.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bc77fe700 1 -- 172.21.15.41:0/1040053115 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc00d910 con 0x7f7bc80b5f70 2021-10-21T00:10:35.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- 172.21.15.41:0/1040053115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 msgr2=0x7f7bc813fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/1040053115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 0x7f7bc813fb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7bbc002f70 tx=0x7f7bbc006df0).stop 2021-10-21T00:10:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- 172.21.15.41:0/1040053115 shutdown_connections 2021-10-21T00:10:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/1040053115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc80b5f70 0x7f7bc813fb40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- 172.21.15.41:0/1040053115 >> 172.21.15.41:0/1040053115 conn(0x7f7bc80639f0 msgr2=0x7f7bc80b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:35.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- 172.21.15.41:0/1040053115 shutdown_connections 2021-10-21T00:10:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.023+0000 7f7bcd95c700 1 -- 172.21.15.41:0/1040053115 wait complete. 2021-10-21T00:10:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 Processor -- start 2021-10-21T00:10:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 -- start start 2021-10-21T00:10:35.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc806a190 0x7f7bc814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc80af700 0x7f7bc80b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc813c470 con 0x7f7bc80b5f70 2021-10-21T00:10:35.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81501a0 con 0x7f7bc80af700 2021-10-21T00:10:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd95c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc813c1d0 con 0x7f7bc806a190 2021-10-21T00:10:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35702/0 (socket says 172.21.15.41:35702) 2021-10-21T00:10:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 -- 172.21.15.41:0/3705360883 learned_addr learned my addr 172.21.15.41:0/3705360883 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:35.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcc95a700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc806a190 0x7f7bc814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bc7fff700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc80af700 0x7f7bc80b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 -- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc806a190 msgr2=0x7f7bc814fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc806a190 0x7f7bc814fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:35.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 -- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc80af700 msgr2=0x7f7bc80b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc80af700 0x7f7bc80b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.027+0000 7f7bcd15b700 1 -- 172.21.15.41:0/3705360883 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc00b180 con 0x7f7bc80b5f70 2021-10-21T00:10:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcd15b700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f7bc0001490 tx=0x7f7bc0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:35.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc0005ba0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc8153370 con 0x7f7bc80b5f70 2021-10-21T00:10:35.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0005d00 con 0x7f7bc80b5f70 2021-10-21T00:10:35.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc00072c0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc813f1e0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8067600 con 0x7f7bc80b5f70 2021-10-21T00:10:35.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7bc0010070 con 0x7f7bc80b5f70 2021-10-21T00:10:35.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 0x7f7ba8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:35.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7bc006afb0 con 0x7f7bc80b5f70 2021-10-21T00:10:35.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcc95a700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 0x7f7ba8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:35.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.031+0000 7f7bcc95a700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 0x7f7ba8055ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f7bbc01a000 tx=0x7f7bbc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:35.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.039+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7bc0042350 con 0x7f7bc80b5f70 2021-10-21T00:10:35.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:35.183+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7bc8057350 con 0x7f7bc80b5f70 2021-10-21T00:10:36.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.011+0000 7f7bc5ffb700 1 -- 172.21.15.41:0/3705360883 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7bc0018030 con 0x7f7bc80b5f70 2021-10-21T00:10:36.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 msgr2=0x7f7ba8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 0x7f7ba8055ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f7bbc01a000 tx=0x7f7bbc014000).stop 2021-10-21T00:10:36.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 msgr2=0x7f7bc8153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f7bc0001490 tx=0x7f7bc0007e00).stop 2021-10-21T00:10:36.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 shutdown_connections 2021-10-21T00:10:36.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7ba8053610 0x7f7ba8055ad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7bc80b5f70 0x7f7bc8153810 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc80af700 0x7f7bc80b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 --2- 172.21.15.41:0/3705360883 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bc806a190 0x7f7bc814fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 >> 172.21.15.41:0/3705360883 conn(0x7f7bc80639f0 msgr2=0x7f7bc81382f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 shutdown_connections 2021-10-21T00:10:36.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.015+0000 7f7bcd95c700 1 -- 172.21.15.41:0/3705360883 wait complete. 2021-10-21T00:10:36.028 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:10:36.042 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:10:36.043 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:10:36.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.143+0000 7f5242558700 1 Processor -- start 2021-10-21T00:10:36.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- start start 2021-10-21T00:10:36.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f523c0aa750 0x7f523c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c0609d0 con 0x7f523c14b350 2021-10-21T00:10:36.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c05fdd0 con 0x7f523c05f9f0 2021-10-21T00:10:36.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c0b1620 con 0x7f523c0aa750 2021-10-21T00:10:36.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5240af5700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f523c14b350 0x7f523c0af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33480/0 (socket says 172.21.15.41:33480) 2021-10-21T00:10:36.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5240af5700 1 -- 172.21.15.41:0/1133000776 learned_addr learned my addr 172.21.15.41:0/1133000776 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:36.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523b7fe700 1 --2- 172.21.15.41:0/1133000776 >> v2:172.21.15.41:3300/0 conn(0x7f523c0aa750 0x7f523c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523affd700 1 -- 172.21.15.41:0/1133000776 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091517387 0 0) 0x7f523c0609d0 con 0x7f523c14b350 2021-10-21T00:10:36.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523affd700 1 -- 172.21.15.41:0/1133000776 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c003260 con 0x7f523c14b350 2021-10-21T00:10:36.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523b7fe700 1 -- 172.21.15.41:0/1133000776 >> v1:172.21.15.62:6789/0 conn(0x7f523c05f9f0 legacy=0x7f523c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523b7fe700 1 -- 172.21.15.41:0/1133000776 >> v1:172.21.15.41:6789/0 conn(0x7f523c14b350 legacy=0x7f523c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523b7fe700 1 -- 172.21.15.41:0/1133000776 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0b1380 con 0x7f523c0aa750 2021-10-21T00:10:36.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523b7fe700 1 --2- 172.21.15.41:0/1133000776 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c0aa750 0x7f523c14ae60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224006df0).ready entity=mon.0 client_cookie=622521285eb4ba7a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523affd700 1 -- 172.21.15.41:0/1133000776 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522400d610 con 0x7f523c0aa750 2021-10-21T00:10:36.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523affd700 1 -- 172.21.15.41:0/1133000776 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224000e90 con 0x7f523c0aa750 2021-10-21T00:10:36.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f523affd700 1 -- 172.21.15.41:0/1133000776 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522400d960 con 0x7f523c0aa750 2021-10-21T00:10:36.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- 172.21.15.41:0/1133000776 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c0aa750 msgr2=0x7f523c14ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 --2- 172.21.15.41:0/1133000776 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c0aa750 0x7f523c14ae60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f5224002f70 tx=0x7f5224006df0).stop 2021-10-21T00:10:36.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- 172.21.15.41:0/1133000776 shutdown_connections 2021-10-21T00:10:36.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 --2- 172.21.15.41:0/1133000776 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c0aa750 0x7f523c14ae60 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- 172.21.15.41:0/1133000776 >> 172.21.15.41:0/1133000776 conn(0x7f523c05bca0 msgr2=0x7f523c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- 172.21.15.41:0/1133000776 shutdown_connections 2021-10-21T00:10:36.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.147+0000 7f5242558700 1 -- 172.21.15.41:0/1133000776 wait complete. 2021-10-21T00:10:36.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 Processor -- start 2021-10-21T00:10:36.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 -- start start 2021-10-21T00:10:36.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523c05f9f0 0x7f523c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f523c0aa750 0x7f523c0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0ad930 con 0x7f523c14b350 2021-10-21T00:10:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0adbd0 con 0x7f523c05f9f0 2021-10-21T00:10:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5242558700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0ade70 con 0x7f523c0aa750 2021-10-21T00:10:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f523bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523c05f9f0 0x7f523c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35718/0 (socket says 172.21.15.41:35718) 2021-10-21T00:10:36.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 -- 172.21.15.41:0/4000913956 learned_addr learned my addr 172.21.15.41:0/4000913956 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:36.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f523b7fe700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f523c0aa750 0x7f523c0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 -- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f523c0aa750 msgr2=0x7f523c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f523c0aa750 0x7f523c0ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 -- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523c05f9f0 msgr2=0x7f523c0ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523c05f9f0 0x7f523c0ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.151+0000 7f5240af5700 1 -- 172.21.15.41:0/4000913956 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522400b180 con 0x7f523c14b350 2021-10-21T00:10:36.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f5240af5700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f522c001110 tx=0x7f522c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c00cda0 con 0x7f523c14b350 2021-10-21T00:10:36.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0070d0 con 0x7f523c14b350 2021-10-21T00:10:36.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c156210 con 0x7f523c14b350 2021-10-21T00:10:36.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f522c007430 con 0x7f523c14b350 2021-10-21T00:10:36.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c14e320 con 0x7f523c14b350 2021-10-21T00:10:36.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c0ad780 con 0x7f523c14b350 2021-10-21T00:10:36.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.155+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f522c01a060 con 0x7f523c14b350 2021-10-21T00:10:36.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.159+0000 7f52397fa700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 0x7f52200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.159+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f522c06ac60 con 0x7f523c14b350 2021-10-21T00:10:36.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.159+0000 7f523bfff700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 0x7f52200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.159+0000 7f523bfff700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 0x7f52200559b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f523400d000 tx=0x7f5234007f10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.163+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f522c0420f0 con 0x7f523c14b350 2021-10-21T00:10:36.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.327+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f523c1563a0 con 0x7f523c14b350 2021-10-21T00:10:36.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.327+0000 7f52397fa700 1 -- 172.21.15.41:0/4000913956 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f522c018030 con 0x7f523c14b350 2021-10-21T00:10:36.339 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:36.339 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:10:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:10:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:10:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:10:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:10:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:10:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:10:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:10:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:10:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:10:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:10:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:10:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:10:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:10:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:10:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:10:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:10:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.359 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:10:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:10:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:10:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:10:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:10:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:10:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:10:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:10:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:10:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:10:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:10:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:10:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:10:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:10:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:10:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:10:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:10:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:10:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:10:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:10:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:10:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:10:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:10:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:10:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:10:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:10:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:36.377 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:36.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 msgr2=0x7f52200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 0x7f52200559b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f523400d000 tx=0x7f5234007f10).stop 2021-10-21T00:10:36.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 msgr2=0x7f523c1408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f522c001110 tx=0x7f522c007a80).stop 2021-10-21T00:10:36.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 shutdown_connections 2021-10-21T00:10:36.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52200534f0 0x7f52200559b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f523c14b350 0x7f523c1408f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f523c0aa750 0x7f523c0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 --2- 172.21.15.41:0/4000913956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f523c05f9f0 0x7f523c0ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 >> 172.21.15.41:0/4000913956 conn(0x7f523c05bca0 msgr2=0x7f523c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 shutdown_connections 2021-10-21T00:10:36.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.331+0000 7f5242558700 1 -- 172.21.15.41:0/4000913956 wait complete. 2021-10-21T00:10:36.383 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 Processor -- start 2021-10-21T00:10:36.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 -- start start 2021-10-21T00:10:36.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90d80b2170 0x7f90d80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d80b0b50 con 0x7f90d80af620 2021-10-21T00:10:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80b2550 con 0x7f90d80b2170 2021-10-21T00:10:36.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90ddfe1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b0d90 con 0x7f90d8067a80 2021-10-21T00:10:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90dd7e0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90dcfdf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90d80b2170 0x7f90d80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90dd7e0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:54224/0 (socket says 172.21.15.41:54224) 2021-10-21T00:10:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.483+0000 7f90dd7e0700 1 -- 172.21.15.41:0/2103900822 learned_addr learned my addr 172.21.15.41:0/2103900822 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:36.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90dd7e0700 1 -- 172.21.15.41:0/2103900822 >> v2:172.21.15.62:3300/0 conn(0x7f90d80b2170 msgr2=0x7f90d80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90dd7e0700 1 --2- 172.21.15.41:0/2103900822 >> v2:172.21.15.62:3300/0 conn(0x7f90d80b2170 0x7f90d80ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90dd7e0700 1 -- 172.21.15.41:0/2103900822 >> v1:172.21.15.62:6789/0 conn(0x7f90d80af620 legacy=0x7f90d80ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90d77fe700 1 -- 172.21.15.41:0/2103900822 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157368419 0 0) 0x7f90c8001490 con 0x7f90d80af620 2021-10-21T00:10:36.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90dd7e0700 1 -- 172.21.15.41:0/2103900822 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80b1030 con 0x7f90d8067a80 2021-10-21T00:10:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90dd7e0700 1 --2- 172.21.15.41:0/2103900822 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f90d0002f70 tx=0x7f90d0006eb0).ready entity=mon.2 client_cookie=bf370151eb962908 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90d77fe700 1 -- 172.21.15.41:0/2103900822 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d000d570 con 0x7f90d8067a80 2021-10-21T00:10:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90d77fe700 1 -- 172.21.15.41:0/2103900822 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d0000e90 con 0x7f90d8067a80 2021-10-21T00:10:36.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90d77fe700 1 -- 172.21.15.41:0/2103900822 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d000d8c0 con 0x7f90d8067a80 2021-10-21T00:10:36.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2103900822 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 msgr2=0x7f90d8149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2103900822 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f90d0002f70 tx=0x7f90d0006eb0).stop 2021-10-21T00:10:36.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2103900822 shutdown_connections 2021-10-21T00:10:36.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2103900822 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d8067a80 0x7f90d8149320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2103900822 >> v2:172.21.15.62:3300/0 conn(0x7f90d80b2170 0x7f90d80ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2103900822 >> 172.21.15.41:0/2103900822 conn(0x7f90d80b5700 msgr2=0x7f90d80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2103900822 shutdown_connections 2021-10-21T00:10:36.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2103900822 wait complete. 2021-10-21T00:10:36.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 Processor -- start 2021-10-21T00:10:36.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.487+0000 7f90ddfe1700 1 -- start start 2021-10-21T00:10:36.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 0x7f90d8063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90d80b2170 0x7f90d8063b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8067410 con 0x7f90d8067a80 2021-10-21T00:10:36.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80652e0 con 0x7f90d80b2170 2021-10-21T00:10:36.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8065580 con 0x7f90d80af620 2021-10-21T00:10:36.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90dcfdf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90dcfdf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35730/0 (socket says 172.21.15.41:35730) 2021-10-21T00:10:36.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 0x7f90d8063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90dcfdf700 1 -- 172.21.15.41:0/2447326952 learned_addr learned my addr 172.21.15.41:0/2447326952 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:36.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90dd7e0700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90d80b2170 0x7f90d8063b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 -- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90d80b2170 msgr2=0x7f90d8063b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90d80b2170 0x7f90d8063b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 -- 172.21.15.41:0/2447326952 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 msgr2=0x7f90d808f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 -- 172.21.15.41:0/2447326952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d000b1e0 con 0x7f90d80af620 2021-10-21T00:10:36.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90dcfdf700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:36.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d7fff700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 0x7f90d8063620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f90d80aead0 tx=0x7f90c8007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c800f470 con 0x7f90d80af620 2021-10-21T00:10:36.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800f5d0 con 0x7f90d80af620 2021-10-21T00:10:36.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c800f930 con 0x7f90d80af620 2021-10-21T00:10:36.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d808fa50 con 0x7f90d80af620 2021-10-21T00:10:36.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.491+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8067060 con 0x7f90d80af620 2021-10-21T00:10:36.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d80b12d0 con 0x7f90d80af620 2021-10-21T00:10:36.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f90c8019030 con 0x7f90d80af620 2021-10-21T00:10:36.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90d5ffb700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 0x7f90b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f90c806aab0 con 0x7f90d80af620 2021-10-21T00:10:36.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90dcfdf700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 0x7f90b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.495+0000 7f90dcfdf700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 0x7f90b8055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f90cc00b000 tx=0x7f90cc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.503+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90c8041ee0 con 0x7f90d80af620 2021-10-21T00:10:36.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.635+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90d80b0b30 con 0x7f90d80af620 2021-10-21T00:10:36.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.635+0000 7f90d5ffb700 1 -- 172.21.15.41:0/2447326952 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f90c8024390 con 0x7f90d80af620 2021-10-21T00:10:36.646 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:36.647 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":94,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:36.007823+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:36.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 msgr2=0x7f90b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 0x7f90b8055ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f90cc00b000 tx=0x7f90cc006df0).stop 2021-10-21T00:10:36.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 msgr2=0x7f90d8063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 0x7f90d8063620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f90d80aead0 tx=0x7f90c8007bf0).stop 2021-10-21T00:10:36.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 shutdown_connections 2021-10-21T00:10:36.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f90b8053610 0x7f90b8055ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90d80b2170 0x7f90d8063b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90d80af620 0x7f90d8063620 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 --2- 172.21.15.41:0/2447326952 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f90d8067a80 0x7f90d808f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 >> 172.21.15.41:0/2447326952 conn(0x7f90d80b5700 msgr2=0x7f90d81490d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 shutdown_connections 2021-10-21T00:10:36.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.639+0000 7f90ddfe1700 1 -- 172.21.15.41:0/2447326952 wait complete. 2021-10-21T00:10:36.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:10:36.662 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 Processor -- start 2021-10-21T00:10:36.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 -- start start 2021-10-21T00:10:36.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb140b2170 0x7ffb140b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffb140ab600 0x7ffb1405fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140b2550 con 0x7ffb140602d0 2021-10-21T00:10:36.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140aba40 con 0x7ffb140ab600 2021-10-21T00:10:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb1a249700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb14142d60 con 0x7ffb140b2170 2021-10-21T00:10:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb18a46700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffb140ab600 0x7ffb1405fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb18a46700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffb140ab600 0x7ffb1405fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35740/0 (socket says 172.21.15.41:35740) 2021-10-21T00:10:36.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb18a46700 1 -- 172.21.15.41:0/921666501 learned_addr learned my addr 172.21.15.41:0/921666501 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.755+0000 7ffb19247700 1 --2- 172.21.15.41:0/921666501 >> v2:172.21.15.62:3300/0 conn(0x7ffb140b2170 0x7ffb140b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb18a46700 1 -- 172.21.15.41:0/921666501 >> v2:172.21.15.62:3300/0 conn(0x7ffb140b2170 msgr2=0x7ffb140b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb18a46700 1 --2- 172.21.15.41:0/921666501 >> v2:172.21.15.62:3300/0 conn(0x7ffb140b2170 0x7ffb140b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb18a46700 1 -- 172.21.15.41:0/921666501 >> v1:172.21.15.62:6789/0 conn(0x7ffb140602d0 legacy=0x7ffb14145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb18a46700 1 -- 172.21.15.41:0/921666501 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140b1350 con 0x7ffb140ab600 2021-10-21T00:10:36.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb18a46700 1 --2- 172.21.15.41:0/921666501 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb1405fde0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7ffb140abb80 tx=0x7ffb08006eb0).ready entity=mon.0 client_cookie=9f1c5ac100a56d8a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb13fff700 1 -- 172.21.15.41:0/921666501 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb0800d610 con 0x7ffb140ab600 2021-10-21T00:10:36.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb13fff700 1 -- 172.21.15.41:0/921666501 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08000e90 con 0x7ffb140ab600 2021-10-21T00:10:36.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb13fff700 1 -- 172.21.15.41:0/921666501 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb0800d9a0 con 0x7ffb140ab600 2021-10-21T00:10:36.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 -- 172.21.15.41:0/921666501 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 msgr2=0x7ffb1405fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 --2- 172.21.15.41:0/921666501 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb1405fde0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7ffb140abb80 tx=0x7ffb08006eb0).stop 2021-10-21T00:10:36.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 -- 172.21.15.41:0/921666501 shutdown_connections 2021-10-21T00:10:36.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 --2- 172.21.15.41:0/921666501 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb1405fde0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 --2- 172.21.15.41:0/921666501 >> v2:172.21.15.62:3300/0 conn(0x7ffb140b2170 0x7ffb140b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 -- 172.21.15.41:0/921666501 >> 172.21.15.41:0/921666501 conn(0x7ffb140b5700 msgr2=0x7ffb140b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 -- 172.21.15.41:0/921666501 shutdown_connections 2021-10-21T00:10:36.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.759+0000 7ffb1a249700 1 -- 172.21.15.41:0/921666501 wait complete. 2021-10-21T00:10:36.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 Processor -- start 2021-10-21T00:10:36.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- start start 2021-10-21T00:10:36.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb140602d0 0x7ffb140b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 0x7ffb1408fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140adf80 con 0x7ffb140ab600 2021-10-21T00:10:36.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140ad030 con 0x7ffb140b2170 2021-10-21T00:10:36.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1408f5b0 con 0x7ffb140602d0 2021-10-21T00:10:36.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35744/0 (socket says 172.21.15.41:35744) 2021-10-21T00:10:36.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 -- 172.21.15.41:0/1956018269 learned_addr learned my addr 172.21.15.41:0/1956018269 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:36.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb19247700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb140602d0 0x7ffb140b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb19a48700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 0x7ffb1408fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 -- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb140602d0 msgr2=0x7ffb140b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb140602d0 0x7ffb140b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 -- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 msgr2=0x7ffb1408fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 0x7ffb1408fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 -- 172.21.15.41:0/1956018269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0800b1e0 con 0x7ffb140ab600 2021-10-21T00:10:36.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb19a48700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 0x7ffb1408fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:36.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb18a46700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ffb140abb80 tx=0x7ffb08015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08021070 con 0x7ffb140ab600 2021-10-21T00:10:36.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb080117e0 con 0x7ffb140ab600 2021-10-21T00:10:36.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb140ac490 con 0x7ffb140ab600 2021-10-21T00:10:36.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb08011b40 con 0x7ffb140ab600 2021-10-21T00:10:36.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.763+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb140acb90 con 0x7ffb140ab600 2021-10-21T00:10:36.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1408f770 con 0x7ffb140ab600 2021-10-21T00:10:36.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb0800f070 con 0x7ffb140ab600 2021-10-21T00:10:36.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb127fc700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 0x7ffaf4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:36.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ffb0806c770 con 0x7ffb140ab600 2021-10-21T00:10:36.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb19247700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 0x7ffaf4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:36.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.767+0000 7ffb19247700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 0x7ffaf4055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7ffb0400b000 tx=0x7ffb04006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:36.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.775+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb08043c00 con 0x7ffb140ab600 2021-10-21T00:10:36.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffb140ad1f0 con 0x7ffb140ab600 2021-10-21T00:10:36.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb127fc700 1 -- 172.21.15.41:0/1956018269 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v94) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffb08047220 con 0x7ffb140ab600 2021-10-21T00:10:36.908 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:36.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 msgr2=0x7ffaf4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 0x7ffaf4055a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7ffb0400b000 tx=0x7ffb04006df0).stop 2021-10-21T00:10:36.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 msgr2=0x7ffb140986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:36.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ffb140abb80 tx=0x7ffb08015000).stop 2021-10-21T00:10:36.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 shutdown_connections 2021-10-21T00:10:36.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffaf4053580 0x7ffaf4055a40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb140b2170 0x7ffb1408fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffb140ab600 0x7ffb140986c0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 --2- 172.21.15.41:0/1956018269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb140602d0 0x7ffb140b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:36.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 >> 172.21.15.41:0/1956018269 conn(0x7ffb140b5700 msgr2=0x7ffb14146180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:36.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 shutdown_connections 2021-10-21T00:10:36.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:36.899+0000 7ffb1a249700 1 -- 172.21.15.41:0/1956018269 wait complete. 2021-10-21T00:10:36.924 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.019+0000 7f7bad123700 1 Processor -- start 2021-10-21T00:10:37.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 -- start start 2021-10-21T00:10:37.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7ba80b1a10 0x7f7ba813f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7ba8128480 0x7f7ba80ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba813ede0 con 0x7f7ba8128020 2021-10-21T00:10:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba813fe70 con 0x7f7ba8128480 2021-10-21T00:10:37.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba80b1df0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7ba8128480 0x7f7ba80ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7ba8128480 0x7f7ba80ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35752/0 (socket says 172.21.15.41:35752) 2021-10-21T00:10:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 -- 172.21.15.41:0/900993277 learned_addr learned my addr 172.21.15.41:0/900993277 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba6d9d700 1 --2- 172.21.15.41:0/900993277 >> v2:172.21.15.62:3300/0 conn(0x7f7ba80b1a10 0x7f7ba813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 -- 172.21.15.41:0/900993277 >> v2:172.21.15.62:3300/0 conn(0x7f7ba80b1a10 msgr2=0x7f7ba813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:37.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 --2- 172.21.15.41:0/900993277 >> v2:172.21.15.62:3300/0 conn(0x7f7ba80b1a10 0x7f7ba813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 -- 172.21.15.41:0/900993277 >> v1:172.21.15.62:6789/0 conn(0x7f7ba8128020 legacy=0x7f7ba80ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 -- 172.21.15.41:0/900993277 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba81288f0 con 0x7f7ba8128480 2021-10-21T00:10:37.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba759e700 1 --2- 172.21.15.41:0/900993277 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba8128480 0x7f7ba80ac940 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f7ba00032f0 tx=0x7f7ba000b530).ready entity=mon.0 client_cookie=fe4c7e5126c40f0b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba659c700 1 -- 172.21.15.41:0/900993277 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba000be70 con 0x7f7ba8128480 2021-10-21T00:10:37.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba659c700 1 -- 172.21.15.41:0/900993277 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0010470 con 0x7f7ba8128480 2021-10-21T00:10:37.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7ba659c700 1 -- 172.21.15.41:0/900993277 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ba00107d0 con 0x7f7ba8128480 2021-10-21T00:10:37.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 -- 172.21.15.41:0/900993277 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba8128480 msgr2=0x7f7ba80ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.023+0000 7f7bad123700 1 --2- 172.21.15.41:0/900993277 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba8128480 0x7f7ba80ac940 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f7ba00032f0 tx=0x7f7ba000b530).stop 2021-10-21T00:10:37.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 -- 172.21.15.41:0/900993277 shutdown_connections 2021-10-21T00:10:37.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 --2- 172.21.15.41:0/900993277 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba8128480 0x7f7ba80ac940 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 --2- 172.21.15.41:0/900993277 >> v2:172.21.15.62:3300/0 conn(0x7f7ba80b1a10 0x7f7ba813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 -- 172.21.15.41:0/900993277 >> 172.21.15.41:0/900993277 conn(0x7f7ba8063210 msgr2=0x7f7ba805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:37.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 -- 172.21.15.41:0/900993277 shutdown_connections 2021-10-21T00:10:37.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 -- 172.21.15.41:0/900993277 wait complete. 2021-10-21T00:10:37.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 Processor -- start 2021-10-21T00:10:37.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.027+0000 7f7bad123700 1 -- start start 2021-10-21T00:10:37.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba8128020 0x7f7ba8126d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ba8128480 0x7f7ba8127270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba813cdc0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8127be0 con 0x7f7ba8128020 2021-10-21T00:10:37.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8066da0 con 0x7f7ba8128480 2021-10-21T00:10:37.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35754/0 (socket says 172.21.15.41:35754) 2021-10-21T00:10:37.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 -- 172.21.15.41:0/3452162644 learned_addr learned my addr 172.21.15.41:0/3452162644 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7b9ffff700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba8128020 0x7f7ba8126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba759e700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ba8128480 0x7f7ba8127270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 -- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ba8128480 msgr2=0x7f7ba8127270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ba8128480 0x7f7ba8127270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 -- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba8128020 msgr2=0x7f7ba8126d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba8128020 0x7f7ba8126d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 -- 172.21.15.41:0/3452162644 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba000b7d0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba6d9d700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f7b980030b0 tx=0x7f7b98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b98011780 con 0x7f7ba80b1a10 2021-10-21T00:10:37.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b980118e0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba814e9a0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba8146060 con 0x7f7ba80b1a10 2021-10-21T00:10:37.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.031+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b98011c40 con 0x7f7ba80b1a10 2021-10-21T00:10:37.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b98012420 con 0x7f7ba80b1a10 2021-10-21T00:10:37.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b84003410 con 0x7f7ba80b1a10 2021-10-21T00:10:37.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7ba4d99700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 0x7f7b800559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7b9806b4a0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7b9ffff700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 0x7f7b800559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.035+0000 7f7b9ffff700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 0x7f7b800559b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f7b9000d000 tx=0x7f7b90000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.039+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b980427c0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.167+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b84003c40 con 0x7f7ba80b1a10 2021-10-21T00:10:37.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.167+0000 7f7ba4d99700 1 -- 172.21.15.41:0/3452162644 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b98045de0 con 0x7f7ba80b1a10 2021-10-21T00:10:37.178 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:37.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 msgr2=0x7f7b800559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 0x7f7b800559b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f7b9000d000 tx=0x7f7b90000bc0).stop 2021-10-21T00:10:37.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 msgr2=0x7f7ba80b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f7b980030b0 tx=0x7f7b98008040).stop 2021-10-21T00:10:37.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 shutdown_connections 2021-10-21T00:10:37.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7b800534f0 0x7f7b800559b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ba8128480 0x7f7ba8127270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ba8128020 0x7f7ba8126d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 --2- 172.21.15.41:0/3452162644 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ba80b1a10 0x7f7ba80b31c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 >> 172.21.15.41:0/3452162644 conn(0x7f7ba8063210 msgr2=0x7f7ba80b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:37.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 shutdown_connections 2021-10-21T00:10:37.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.171+0000 7f7bad123700 1 -- 172.21.15.41:0/3452162644 wait complete. 2021-10-21T00:10:37.191 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:10:37.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.283+0000 7fdb2c8f1700 1 Processor -- start 2021-10-21T00:10:37.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.283+0000 7fdb2c8f1700 1 -- start start 2021-10-21T00:10:37.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdb280b0d20 0x7fdb280ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280b2550 con 0x7fdb280604f0 2021-10-21T00:10:37.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280b1350 con 0x7fdb280b2170 2021-10-21T00:10:37.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2805f940 con 0x7fdb280b0d20 2021-10-21T00:10:37.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdb280b0d20 0x7fdb280ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdb280b0d20 0x7fdb280ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35764/0 (socket says 172.21.15.41:35764) 2021-10-21T00:10:37.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 -- 172.21.15.41:0/1329924540 learned_addr learned my addr 172.21.15.41:0/1329924540 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 -- 172.21.15.41:0/1329924540 >> v1:172.21.15.62:6789/0 conn(0x7fdb280b2170 legacy=0x7fdb2805fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 -- 172.21.15.41:0/1329924540 >> v1:172.21.15.41:6789/0 conn(0x7fdb280604f0 legacy=0x7fdb28141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 -- 172.21.15.41:0/1329924540 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28142460 con 0x7fdb280b0d20 2021-10-21T00:10:37.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2759e700 1 --2- 172.21.15.41:0/1329924540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb280ab600 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fdb18002f70 tx=0x7fdb18006eb0).ready entity=mon.0 client_cookie=db90af32017cac29 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb25d9b700 1 -- 172.21.15.41:0/1329924540 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1800d660 con 0x7fdb280b0d20 2021-10-21T00:10:37.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb25d9b700 1 -- 172.21.15.41:0/1329924540 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18000e90 con 0x7fdb280b0d20 2021-10-21T00:10:37.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb25d9b700 1 -- 172.21.15.41:0/1329924540 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1800d9f0 con 0x7fdb280b0d20 2021-10-21T00:10:37.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/1329924540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 msgr2=0x7fdb280ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/1329924540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb280ab600 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7fdb18002f70 tx=0x7fdb18006eb0).stop 2021-10-21T00:10:37.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/1329924540 shutdown_connections 2021-10-21T00:10:37.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/1329924540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb280ab600 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/1329924540 >> 172.21.15.41:0/1329924540 conn(0x7fdb280b5700 msgr2=0x7fdb280b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:37.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/1329924540 shutdown_connections 2021-10-21T00:10:37.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.287+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/1329924540 wait complete. 2021-10-21T00:10:37.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 Processor -- start 2021-10-21T00:10:37.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 -- start start 2021-10-21T00:10:37.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 0x7fdb28098530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb2809a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 0x7fdb2809a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280b1710 con 0x7fdb280b0d20 2021-10-21T00:10:37.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28152780 con 0x7fdb280604f0 2021-10-21T00:10:37.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2c8f1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281529b0 con 0x7fdb280b2170 2021-10-21T00:10:37.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb2809a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 0x7fdb28098530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 0x7fdb2809a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb26d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 0x7fdb28098530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47686/0 (socket says 172.21.15.41:47686) 2021-10-21T00:10:37.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb26d9d700 1 -- 172.21.15.41:0/746346794 learned_addr learned my addr 172.21.15.41:0/746346794 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 -- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 msgr2=0x7fdb28098530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 0x7fdb28098530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 -- 172.21.15.41:0/746346794 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 msgr2=0x7fdb2809a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb2809a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 -- 172.21.15.41:0/746346794 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1800b1e0 con 0x7fdb280b2170 2021-10-21T00:10:37.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb2759e700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 0x7fdb2809a700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdb28098090 tx=0x7fdb18015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.291+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1800d9e0 con 0x7fdb280b2170 2021-10-21T00:10:37.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18006b40 con 0x7fdb280b2170 2021-10-21T00:10:37.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb18011d30 con 0x7fdb280b2170 2021-10-21T00:10:37.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28098d80 con 0x7fdb280b2170 2021-10-21T00:10:37.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2809abf0 con 0x7fdb280b2170 2021-10-21T00:10:37.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb28098bc0 con 0x7fdb280b2170 2021-10-21T00:10:37.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb1801a040 con 0x7fdb280b2170 2021-10-21T00:10:37.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb17fff700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 0x7fdb04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdb1806c4e0 con 0x7fdb280b2170 2021-10-21T00:10:37.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.295+0000 7fdb26d9d700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 0x7fdb04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.299+0000 7fdb26d9d700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 0x7fdb04055a40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fdb2000d000 tx=0x7fdb20001400).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.307+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb18043860 con 0x7fdb280b2170 2021-10-21T00:10:37.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.435+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdb28057350 con 0x7fdb280b2170 2021-10-21T00:10:37.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb17fff700 1 -- 172.21.15.41:0/746346794 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+143 (secure 0 0 0) 0x7fdb18046e80 con 0x7fdb280b2170 2021-10-21T00:10:37.449 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:37.449 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:10:37.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:37.450 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:10:37.451 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:10:37.451 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:37.451 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:37.452 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:10:37.453 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:10:37.453 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:37.453 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:10:37.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 msgr2=0x7fdb04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 0x7fdb04055a40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fdb2000d000 tx=0x7fdb20001400).stop 2021-10-21T00:10:37.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 msgr2=0x7fdb2809a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 0x7fdb2809a700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdb28098090 tx=0x7fdb18015000).stop 2021-10-21T00:10:37.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 shutdown_connections 2021-10-21T00:10:37.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdb04053580 0x7fdb04055a40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb280b2170 0x7fdb2809a700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdb280b0d20 0x7fdb2809a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 --2- 172.21.15.41:0/746346794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb280604f0 0x7fdb28098530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 >> 172.21.15.41:0/746346794 conn(0x7fdb280b5700 msgr2=0x7fdb28143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:37.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 shutdown_connections 2021-10-21T00:10:37.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.439+0000 7fdb2c8f1700 1 -- 172.21.15.41:0/746346794 wait complete. 2021-10-21T00:10:37.463 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:10:37.464 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:10:37.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 Processor -- start 2021-10-21T00:10:37.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 -- start start 2021-10-21T00:10:37.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec0b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ec146b30 0x7f63ec0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec147040 con 0x7f63ec0b3530 2021-10-21T00:10:37.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0b2900 con 0x7f63ec146b30 2021-10-21T00:10:37.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63f2ff0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0b2ba0 con 0x7f63ec05be40 2021-10-21T00:10:37.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63ebfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ec146b30 0x7f63ec0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63ebfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63ec146b30 0x7f63ec0b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35778/0 (socket says 172.21.15.41:35778) 2021-10-21T00:10:37.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.563+0000 7f63ebfff700 1 -- 172.21.15.41:0/3478711215 learned_addr learned my addr 172.21.15.41:0/3478711215 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f0d8c700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec0b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63ebfff700 1 -- 172.21.15.41:0/3478711215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 msgr2=0x7f63ec0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:37.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63ebfff700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec0b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63ebfff700 1 -- 172.21.15.41:0/3478711215 >> v1:172.21.15.62:6789/0 conn(0x7f63ec0b3530 legacy=0x7f63ec13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63ebfff700 1 -- 172.21.15.41:0/3478711215 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec05ffd0 con 0x7f63ec146b30 2021-10-21T00:10:37.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63ebfff700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec146b30 0x7f63ec0b3040 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f63ec0b2f20 tx=0x7f63dc009290).ready entity=mon.0 client_cookie=26c90ca817984ba5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63eb7fe700 1 -- 172.21.15.41:0/3478711215 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63dc00b860 con 0x7f63ec146b30 2021-10-21T00:10:37.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63eb7fe700 1 -- 172.21.15.41:0/3478711215 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc00b9c0 con 0x7f63ec146b30 2021-10-21T00:10:37.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63eb7fe700 1 -- 172.21.15.41:0/3478711215 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63dc00bb70 con 0x7f63ec146b30 2021-10-21T00:10:37.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- 172.21.15.41:0/3478711215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec146b30 msgr2=0x7f63ec0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec146b30 0x7f63ec0b3040 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f63ec0b2f20 tx=0x7f63dc009290).stop 2021-10-21T00:10:37.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- 172.21.15.41:0/3478711215 shutdown_connections 2021-10-21T00:10:37.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec146b30 0x7f63ec0b3040 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/3478711215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec0b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- 172.21.15.41:0/3478711215 >> 172.21.15.41:0/3478711215 conn(0x7f63ec0638b0 msgr2=0x7f63ec063cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:37.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- 172.21.15.41:0/3478711215 shutdown_connections 2021-10-21T00:10:37.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- 172.21.15.41:0/3478711215 wait complete. 2021-10-21T00:10:37.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 Processor -- start 2021-10-21T00:10:37.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.567+0000 7f63f2ff0700 1 -- start start 2021-10-21T00:10:37.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 0x7f63ec065dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 0x7f63ec0662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0648c0 con 0x7f63ec0b3530 2021-10-21T00:10:37.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec064b60 con 0x7f63ec146b30 2021-10-21T00:10:37.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec064e00 con 0x7f63ec05be40 2021-10-21T00:10:37.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 0x7f63ec065dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 0x7f63ec0662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 0x7f63ec065dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35784/0 (socket says 172.21.15.41:35784) 2021-10-21T00:10:37.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63ebfff700 1 -- 172.21.15.41:0/2361095302 learned_addr learned my addr 172.21.15.41:0/2361095302 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:37.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f0d8c700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 -- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 msgr2=0x7f63ec152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 -- 172.21.15.41:0/2361095302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 msgr2=0x7f63ec065dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:37.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 0x7f63ec065dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:37.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 -- 172.21.15.41:0/2361095302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc009530 con 0x7f63ec146b30 2021-10-21T00:10:37.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f158d700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 0x7f63ec0662c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f63e4000ed0 tx=0x7f63e4007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e4007030 con 0x7f63ec146b30 2021-10-21T00:10:37.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4007190 con 0x7f63ec146b30 2021-10-21T00:10:37.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec152f30 con 0x7f63ec146b30 2021-10-21T00:10:37.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e4006510 con 0x7f63ec146b30 2021-10-21T00:10:37.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.571+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec0afaa0 con 0x7f63ec146b30 2021-10-21T00:10:37.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f63e4010030 con 0x7f63ec146b30 2021-10-21T00:10:37.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec057350 con 0x7f63ec146b30 2021-10-21T00:10:37.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63e9ffb700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 0x7f63cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:37.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f63e406b130 con 0x7f63ec146b30 2021-10-21T00:10:37.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63f0d8c700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 0x7f63cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:37.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.575+0000 7f63f0d8c700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 0x7f63cc055a40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f63e000c000 tx=0x7f63e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:37.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.583+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63e4042520 con 0x7f63ec146b30 2021-10-21T00:10:37.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:37.707+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f63ec05f250 con 0x7f63ec146b30 2021-10-21T00:10:38.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.391+0000 7f63e9ffb700 1 -- 172.21.15.41:0/2361095302 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v95) v1 ==== 133+0+0 (secure 0 0 0) 0x7f63e4045b40 con 0x7f63ec146b30 2021-10-21T00:10:38.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 msgr2=0x7f63cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 0x7f63cc055a40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f63e000c000 tx=0x7f63e0008040).stop 2021-10-21T00:10:38.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 msgr2=0x7f63ec0662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 0x7f63ec0662c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f63e4000ed0 tx=0x7f63e4007b70).stop 2021-10-21T00:10:38.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 shutdown_connections 2021-10-21T00:10:38.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f63cc053580 0x7f63cc055a40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63ec146b30 0x7f63ec0662c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63ec0b3530 0x7f63ec065dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 --2- 172.21.15.41:0/2361095302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63ec05be40 0x7f63ec152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 >> 172.21.15.41:0/2361095302 conn(0x7f63ec0638b0 msgr2=0x7f63ec0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:38.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 shutdown_connections 2021-10-21T00:10:38.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.395+0000 7f63f2ff0700 1 -- 172.21.15.41:0/2361095302 wait complete. 2021-10-21T00:10:38.409 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:10:38.421 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:10:38.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.527+0000 7fa13748b700 1 Processor -- start 2021-10-21T00:10:38.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.527+0000 7fa13748b700 1 -- start start 2021-10-21T00:10:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1300b6130 0x7fa1300b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1300b0290 0x7fa130142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300ac610 con 0x7fa130142ef0 2021-10-21T00:10:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300b6510 con 0x7fa1300b6130 2021-10-21T00:10:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300ace50 con 0x7fa1300b0290 2021-10-21T00:10:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1300b6130 0x7fa1300b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1300b6130 0x7fa1300b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35790/0 (socket says 172.21.15.41:35790) 2021-10-21T00:10:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 -- 172.21.15.41:0/956347576 learned_addr learned my addr 172.21.15.41:0/956347576 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:38.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa134a26700 1 --2- 172.21.15.41:0/956347576 >> v2:172.21.15.62:3300/0 conn(0x7fa1300b0290 0x7fa130142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 -- 172.21.15.41:0/956347576 >> v2:172.21.15.62:3300/0 conn(0x7fa1300b0290 msgr2=0x7fa130142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:38.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 --2- 172.21.15.41:0/956347576 >> v2:172.21.15.62:3300/0 conn(0x7fa1300b0290 0x7fa130142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 -- 172.21.15.41:0/956347576 >> v1:172.21.15.62:6789/0 conn(0x7fa130142ef0 legacy=0x7fa1301416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 -- 172.21.15.41:0/956347576 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300ad0f0 con 0x7fa1300b6130 2021-10-21T00:10:38.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa135227700 1 --2- 172.21.15.41:0/956347576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b6130 0x7fa1300b1460 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c006eb0).ready entity=mon.0 client_cookie=ec563479edc95dd3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:38.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa11ffff700 1 -- 172.21.15.41:0/956347576 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00d5c0 con 0x7fa1300b6130 2021-10-21T00:10:38.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa11ffff700 1 -- 172.21.15.41:0/956347576 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c000e90 con 0x7fa1300b6130 2021-10-21T00:10:38.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa11ffff700 1 -- 172.21.15.41:0/956347576 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00d950 con 0x7fa1300b6130 2021-10-21T00:10:38.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- 172.21.15.41:0/956347576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b6130 msgr2=0x7fa1300b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 --2- 172.21.15.41:0/956347576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b6130 0x7fa1300b1460 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c006eb0).stop 2021-10-21T00:10:38.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- 172.21.15.41:0/956347576 shutdown_connections 2021-10-21T00:10:38.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 --2- 172.21.15.41:0/956347576 >> v2:172.21.15.62:3300/0 conn(0x7fa1300b0290 0x7fa130142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 --2- 172.21.15.41:0/956347576 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b6130 0x7fa1300b1460 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- 172.21.15.41:0/956347576 >> 172.21.15.41:0/956347576 conn(0x7fa130063b40 msgr2=0x7fa1300b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:38.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- 172.21.15.41:0/956347576 shutdown_connections 2021-10-21T00:10:38.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.531+0000 7fa13748b700 1 -- 172.21.15.41:0/956347576 wait complete. 2021-10-21T00:10:38.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 Processor -- start 2021-10-21T00:10:38.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 -- start start 2021-10-21T00:10:38.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 0x7fa13014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 0x7fa13014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa130150000 con 0x7fa1300b0290 2021-10-21T00:10:38.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13013f730 con 0x7fa130142ef0 2021-10-21T00:10:38.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa13748b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13013f9d0 con 0x7fa1300b6130 2021-10-21T00:10:38.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa135227700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa135227700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35796/0 (socket says 172.21.15.41:35796) 2021-10-21T00:10:38.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa135227700 1 -- 172.21.15.41:0/3159055478 learned_addr learned my addr 172.21.15.41:0/3159055478 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:38.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa135a28700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 0x7fa13014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.535+0000 7fa134a26700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 0x7fa13014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 -- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 msgr2=0x7fa13014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 0x7fa13014f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 -- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 msgr2=0x7fa13014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:38.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 0x7fa13014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:38.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 -- 172.21.15.41:0/3159055478 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c00b1e0 con 0x7fa1300b0290 2021-10-21T00:10:38.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135a28700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 0x7fa13014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:38.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa134a26700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 0x7fa13014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:38.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa135227700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:38.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c011860 con 0x7fa1300b0290 2021-10-21T00:10:38.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0119c0 con 0x7fa1300b0290 2021-10-21T00:10:38.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13013fc70 con 0x7fa1300b0290 2021-10-21T00:10:38.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c011d20 con 0x7fa1300b0290 2021-10-21T00:10:38.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13014efe0 con 0x7fa1300b0290 2021-10-21T00:10:38.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1300ad390 con 0x7fa1300b0290 2021-10-21T00:10:38.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa12c025030 con 0x7fa1300b0290 2021-10-21T00:10:38.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.539+0000 7fa11e7fc700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 0x7fa110055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:38.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.543+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa12c06c900 con 0x7fa1300b0290 2021-10-21T00:10:38.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.543+0000 7fa134a26700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 0x7fa110055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:38.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.543+0000 7fa134a26700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 0x7fa110055b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fa12000b000 tx=0x7fa120008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:38.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.547+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa12c043c30 con 0x7fa1300b0290 2021-10-21T00:10:38.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:38.675+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa130057350 con 0x7fa1300b0290 2021-10-21T00:10:39.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.395+0000 7fa11e7fc700 1 -- 172.21.15.41:0/3159055478 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v96) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa12c023020 con 0x7fa1300b0290 2021-10-21T00:10:39.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 msgr2=0x7fa110055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 0x7fa110055b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fa12000b000 tx=0x7fa120008040).stop 2021-10-21T00:10:39.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 msgr2=0x7fa1300641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c015000).stop 2021-10-21T00:10:39.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 shutdown_connections 2021-10-21T00:10:39.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1100536a0 0x7fa110055b60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa130142ef0 0x7fa13014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1300b6130 0x7fa13014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 --2- 172.21.15.41:0/3159055478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1300b0290 0x7fa1300641e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 >> 172.21.15.41:0/3159055478 conn(0x7fa130063b40 msgr2=0x7fa13013d350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:39.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 shutdown_connections 2021-10-21T00:10:39.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.407+0000 7fa13748b700 1 -- 172.21.15.41:0/3159055478 wait complete. 2021-10-21T00:10:39.418 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:10:39.429 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:10:39.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.531+0000 7f7fe359e700 1 Processor -- start 2021-10-21T00:10:39.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.531+0000 7f7fe359e700 1 -- start start 2021-10-21T00:10:39.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 0x7f7fe40b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7fe40ad1b0 0x7f7fe4141110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fe40b1830 0x7f7fe405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe41409d0 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe4140c70 con 0x7f7fe40b1830 2021-10-21T00:10:39.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4067c70 con 0x7f7fe40b4040 2021-10-21T00:10:39.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7fe40ad1b0 0x7f7fe4141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 0x7f7fe40b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7fe40ad1b0 0x7f7fe4141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35806/0 (socket says 172.21.15.41:35806) 2021-10-21T00:10:39.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/2049183587 learned_addr learned my addr 172.21.15.41:0/2049183587 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:39.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe2d9d700 1 --2- 172.21.15.41:0/2049183587 >> v2:172.21.15.62:3300/0 conn(0x7f7fe40b1830 0x7f7fe405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/2049183587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 msgr2=0x7f7fe40b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:39.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 0x7f7fe40b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/2049183587 >> v2:172.21.15.62:3300/0 conn(0x7f7fe40b1830 msgr2=0x7f7fe405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:39.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/2049183587 >> v2:172.21.15.62:3300/0 conn(0x7f7fe40b1830 0x7f7fe405f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/2049183587 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4141600 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe259c700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 0x7f7fe40b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:39.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40ad1b0 0x7f7fe4141110 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f7fd8002f70 tx=0x7f7fd8006eb0).ready entity=mon.0 client_cookie=a9f272f130e9482d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe159a700 1 -- 172.21.15.41:0/2049183587 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800d570 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe159a700 1 -- 172.21.15.41:0/2049183587 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8000e90 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.535+0000 7f7fe159a700 1 -- 172.21.15.41:0/2049183587 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800d900 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/2049183587 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40ad1b0 msgr2=0x7f7fe4141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40ad1b0 0x7f7fe4141110 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f7fd8002f70 tx=0x7f7fd8006eb0).stop 2021-10-21T00:10:39.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/2049183587 shutdown_connections 2021-10-21T00:10:39.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40ad1b0 0x7f7fe4141110 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- 172.21.15.41:0/2049183587 >> v2:172.21.15.62:3300/0 conn(0x7f7fe40b1830 0x7f7fe405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- 172.21.15.41:0/2049183587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40b4040 0x7f7fe40b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/2049183587 >> 172.21.15.41:0/2049183587 conn(0x7f7fe40b7960 msgr2=0x7f7fe40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:39.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/2049183587 shutdown_connections 2021-10-21T00:10:39.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/2049183587 wait complete. 2021-10-21T00:10:39.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 Processor -- start 2021-10-21T00:10:39.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- start start 2021-10-21T00:10:39.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40ad1b0 0x7f7fe409a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 0x7f7fe40666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe409a5d0 con 0x7f7fe40b1830 2021-10-21T00:10:39.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe409a7f0 con 0x7f7fe40b4040 2021-10-21T00:10:39.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe414fbc0 con 0x7f7fe40ad1b0 2021-10-21T00:10:39.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35812/0 (socket says 172.21.15.41:35812) 2021-10-21T00:10:39.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/4290774998 learned_addr learned my addr 172.21.15.41:0/4290774998 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:39.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe259c700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40ad1b0 0x7f7fe409a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe2d9d700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 0x7f7fe40666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40ad1b0 msgr2=0x7f7fe409a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40ad1b0 0x7f7fe409a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 msgr2=0x7f7fe40666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 0x7f7fe40666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 -- 172.21.15.41:0/4290774998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd400b180 con 0x7f7fe40b1830 2021-10-21T00:10:39.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe2d9d700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 0x7f7fe40666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:39.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe1d9b700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f7fd8002f70 tx=0x7f7fd8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd80116e0 con 0x7f7fe40b1830 2021-10-21T00:10:39.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8011840 con 0x7f7fe40b1830 2021-10-21T00:10:39.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd800b1e0 con 0x7f7fe40b1830 2021-10-21T00:10:39.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd8011ba0 con 0x7f7fe40b1830 2021-10-21T00:10:39.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.539+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4066b90 con 0x7f7fe40b1830 2021-10-21T00:10:39.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.543+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe40afe70 con 0x7f7fe40b1830 2021-10-21T00:10:39.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.543+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fd8025030 con 0x7f7fe40b1830 2021-10-21T00:10:39.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.543+0000 7f7fd37fe700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 0x7f7fc00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.543+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7fd806ca20 con 0x7f7fe40b1830 2021-10-21T00:10:39.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.543+0000 7f7fe259c700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 0x7f7fc00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.547+0000 7f7fe259c700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 0x7f7fc00559e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7fd400b000 tx=0x7f7fd4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.551+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fe40afe70 con 0x7f7fe40b1830 2021-10-21T00:10:39.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.715+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7fe40afe70 con 0x7f7fe40b1830 2021-10-21T00:10:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.723+0000 7f7fd37fe700 1 -- 172.21.15.41:0/4290774998 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v50) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7fe40afe70 con 0x7f7fe40b1830 2021-10-21T00:10:39.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 msgr2=0x7f7fc00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 0x7f7fc00559e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7fd400b000 tx=0x7f7fd4006df0).stop 2021-10-21T00:10:39.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 msgr2=0x7f7fe409bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f7fd8002f70 tx=0x7f7fd8015000).stop 2021-10-21T00:10:39.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 shutdown_connections 2021-10-21T00:10:39.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fc0053520 0x7f7fc00559e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe40b4040 0x7f7fe40666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fe40b1830 0x7f7fe409bdb0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 --2- 172.21.15.41:0/4290774998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fe40ad1b0 0x7f7fe409a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 >> 172.21.15.41:0/4290774998 conn(0x7f7fe40b7960 msgr2=0x7f7fe413dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:39.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 shutdown_connections 2021-10-21T00:10:39.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.731+0000 7f7fe359e700 1 -- 172.21.15.41:0/4290774998 wait complete. 2021-10-21T00:10:39.745 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 19 and data pool 20 2021-10-21T00:10:39.754 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:39.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.879+0000 7f3da6519700 1 Processor -- start 2021-10-21T00:10:39.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- start start 2021-10-21T00:10:39.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3da009a450 0x7f3da00609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 0x7f3da005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da00abd10 con 0x7f3da005fba0 2021-10-21T00:10:39.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da009a830 con 0x7f3da009a450 2021-10-21T00:10:39.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00afed0 con 0x7f3da00ab880 2021-10-21T00:10:39.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3da009a450 0x7f3da00609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3da009a450 0x7f3da00609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35820/0 (socket says 172.21.15.41:35820) 2021-10-21T00:10:39.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 -- 172.21.15.41:0/2359876666 learned_addr learned my addr 172.21.15.41:0/2359876666 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:39.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9f7fe700 1 --2- 172.21.15.41:0/2359876666 >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 0x7f3da005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 -- 172.21.15.41:0/2359876666 >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 msgr2=0x7f3da005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:39.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 --2- 172.21.15.41:0/2359876666 >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 0x7f3da005f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 -- 172.21.15.41:0/2359876666 >> v1:172.21.15.62:6789/0 conn(0x7f3da005fba0 legacy=0x7f3da0140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 -- 172.21.15.41:0/2359876666 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00b0170 con 0x7f3da009a450 2021-10-21T00:10:39.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9f7fe700 1 --2- 172.21.15.41:0/2359876666 >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 0x7f3da005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:39.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9ffff700 1 --2- 172.21.15.41:0/2359876666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da009a450 0x7f3da00609a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f3da0060f70 tx=0x7f3d90006eb0).ready entity=mon.0 client_cookie=4fb1373bb87ec20a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9effd700 1 -- 172.21.15.41:0/2359876666 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9000d610 con 0x7f3da009a450 2021-10-21T00:10:39.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9effd700 1 -- 172.21.15.41:0/2359876666 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90000e90 con 0x7f3da009a450 2021-10-21T00:10:39.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3d9effd700 1 -- 172.21.15.41:0/2359876666 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9000d960 con 0x7f3da009a450 2021-10-21T00:10:39.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- 172.21.15.41:0/2359876666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da009a450 msgr2=0x7f3da00609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 --2- 172.21.15.41:0/2359876666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da009a450 0x7f3da00609a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f3da0060f70 tx=0x7f3d90006eb0).stop 2021-10-21T00:10:39.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- 172.21.15.41:0/2359876666 shutdown_connections 2021-10-21T00:10:39.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 --2- 172.21.15.41:0/2359876666 >> v2:172.21.15.62:3300/0 conn(0x7f3da00ab880 0x7f3da005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 --2- 172.21.15.41:0/2359876666 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da009a450 0x7f3da00609a0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- 172.21.15.41:0/2359876666 >> 172.21.15.41:0/2359876666 conn(0x7f3da005bca0 msgr2=0x7f3da005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:39.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- 172.21.15.41:0/2359876666 shutdown_connections 2021-10-21T00:10:39.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.883+0000 7f3da6519700 1 -- 172.21.15.41:0/2359876666 wait complete. 2021-10-21T00:10:39.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 Processor -- start 2021-10-21T00:10:39.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- start start 2021-10-21T00:10:39.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3da009a450 0x7f3da0137050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3da00aef40 0x7f3da0137540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da014feb0 con 0x7f3da005fba0 2021-10-21T00:10:39.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00ad8b0 con 0x7f3da009a450 2021-10-21T00:10:39.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da013d050 con 0x7f3da00aef40 2021-10-21T00:10:39.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35826/0 (socket says 172.21.15.41:35826) 2021-10-21T00:10:39.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3da009a450 0x7f3da0137050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 -- 172.21.15.41:0/615586610 learned_addr learned my addr 172.21.15.41:0/615586610 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:39.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da4ab6700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3da00aef40 0x7f3da0137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 -- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3da00aef40 msgr2=0x7f3da0137540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3da00aef40 0x7f3da0137540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 -- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3da009a450 msgr2=0x7f3da0137050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:39.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3da009a450 0x7f3da0137050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:39.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 -- 172.21.15.41:0/615586610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9000b1e0 con 0x7f3da005fba0 2021-10-21T00:10:39.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9ffff700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f3da0060f70 tx=0x7f3d90015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d900068b0 con 0x7f3da005fba0 2021-10-21T00:10:39.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da00adb50 con 0x7f3da005fba0 2021-10-21T00:10:39.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90002f50 con 0x7f3da005fba0 2021-10-21T00:10:39.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da0137a30 con 0x7f3da005fba0 2021-10-21T00:10:39.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.887+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d90011b80 con 0x7f3da005fba0 2021-10-21T00:10:39.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00af950 con 0x7f3da005fba0 2021-10-21T00:10:39.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3d90025030 con 0x7f3da005fba0 2021-10-21T00:10:39.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3d9d7fa700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 0x7f3d80055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:39.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d9006ca40 con 0x7f3da005fba0 2021-10-21T00:10:39.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3d9f7fe700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 0x7f3d80055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:39.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.891+0000 7f3d9f7fe700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 0x7f3d80055ad0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f3d9400c000 tx=0x7f3d94008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:39.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:39.899+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d90043bb0 con 0x7f3da005fba0 2021-10-21T00:10:40.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.027+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3da00686c0 con 0x7f3da005fba0 2021-10-21T00:10:40.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3d9d7fa700 1 -- 172.21.15.41:0/615586610 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f3d90030ed0 con 0x7f3da005fba0 2021-10-21T00:10:40.040 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:40.040 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":97,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:39.722527+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:37.769852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:38.737124+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:40.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 msgr2=0x7f3d80055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 0x7f3d80055ad0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f3d9400c000 tx=0x7f3d94008040).stop 2021-10-21T00:10:40.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 msgr2=0x7f3da00629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f3da0060f70 tx=0x7f3d90015000).stop 2021-10-21T00:10:40.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 shutdown_connections 2021-10-21T00:10:40.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3d80053610 0x7f3d80055ad0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3da00aef40 0x7f3da0137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3da009a450 0x7f3da0137050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 --2- 172.21.15.41:0/615586610 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3da005fba0 0x7f3da00629d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 >> 172.21.15.41:0/615586610 conn(0x7f3da005bca0 msgr2=0x7f3da005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 shutdown_connections 2021-10-21T00:10:40.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.031+0000 7f3da6519700 1 -- 172.21.15.41:0/615586610 wait complete. 2021-10-21T00:10:40.060 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:40.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 Processor -- start 2021-10-21T00:10:40.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 -- start start 2021-10-21T00:10:40.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 0x7fab080ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab080af620 0x7fab080ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab080b0b50 con 0x7fab080abb50 2021-10-21T00:10:40.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080b2550 con 0x7fab080af620 2021-10-21T00:10:40.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0d1e9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b0d90 con 0x7fab080b2170 2021-10-21T00:10:40.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0c9e8700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fab080abb50 0x7fab0814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33606/0 (socket says 172.21.15.41:33606) 2021-10-21T00:10:40.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab0c9e8700 1 -- 172.21.15.41:0/3463982926 learned_addr learned my addr 172.21.15.41:0/3463982926 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:40.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab077fe700 1 --2- 172.21.15.41:0/3463982926 >> v2:172.21.15.62:3300/0 conn(0x7fab080af620 0x7fab080ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 --2- 172.21.15.41:0/3463982926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 0x7fab080ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab06ffd700 1 -- 172.21.15.41:0/3463982926 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182659072 0 0) 0x7faaf8001110 con 0x7fab080abb50 2021-10-21T00:10:40.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab06ffd700 1 -- 172.21.15.41:0/3463982926 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae8003260 con 0x7fab080abb50 2021-10-21T00:10:40.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 -- 172.21.15.41:0/3463982926 >> v2:172.21.15.62:3300/0 conn(0x7fab080af620 msgr2=0x7fab080ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:40.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 --2- 172.21.15.41:0/3463982926 >> v2:172.21.15.62:3300/0 conn(0x7fab080af620 0x7fab080ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 -- 172.21.15.41:0/3463982926 >> v1:172.21.15.41:6789/0 conn(0x7fab080abb50 legacy=0x7fab0814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 -- 172.21.15.41:0/3463982926 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080b1030 con 0x7fab080b2170 2021-10-21T00:10:40.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab07fff700 1 --2- 172.21.15.41:0/3463982926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 0x7fab080ab170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faaf0002f70 tx=0x7faaf0006df0).ready entity=mon.2 client_cookie=4096c996d4bf91da server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab06ffd700 1 -- 172.21.15.41:0/3463982926 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf000d4a0 con 0x7fab080b2170 2021-10-21T00:10:40.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab06ffd700 1 -- 172.21.15.41:0/3463982926 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0000e90 con 0x7fab080b2170 2021-10-21T00:10:40.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.155+0000 7fab06ffd700 1 -- 172.21.15.41:0/3463982926 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf000d7f0 con 0x7fab080b2170 2021-10-21T00:10:40.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- 172.21.15.41:0/3463982926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 msgr2=0x7fab080ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/3463982926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 0x7fab080ab170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7faaf0002f70 tx=0x7faaf0006df0).stop 2021-10-21T00:10:40.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- 172.21.15.41:0/3463982926 shutdown_connections 2021-10-21T00:10:40.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/3463982926 >> v2:172.21.15.62:3300/0 conn(0x7fab080af620 0x7fab080ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/3463982926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080b2170 0x7fab080ab170 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- 172.21.15.41:0/3463982926 >> 172.21.15.41:0/3463982926 conn(0x7fab080b5700 msgr2=0x7fab080b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- 172.21.15.41:0/3463982926 shutdown_connections 2021-10-21T00:10:40.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- 172.21.15.41:0/3463982926 wait complete. 2021-10-21T00:10:40.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 Processor -- start 2021-10-21T00:10:40.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- start start 2021-10-21T00:10:40.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080abb50 0x7fab08149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab080b2170 0x7fab08065fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab080aefa0 con 0x7fab080af620 2021-10-21T00:10:40.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08065b60 con 0x7fab080b2170 2021-10-21T00:10:40.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab0d1e9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080aed00 con 0x7fab080abb50 2021-10-21T00:10:40.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.159+0000 7fab077fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35840/0 (socket says 172.21.15.41:35840) 2021-10-21T00:10:40.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 -- 172.21.15.41:0/2010976809 learned_addr learned my addr 172.21.15.41:0/2010976809 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:40.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab0c9e8700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab080b2170 0x7fab08065fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab07fff700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080abb50 0x7fab08149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 -- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080abb50 msgr2=0x7fab08149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080abb50 0x7fab08149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 -- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab080b2170 msgr2=0x7fab08065fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab080b2170 0x7fab08065fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 -- 172.21.15.41:0/2010976809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf000b180 con 0x7fab080af620 2021-10-21T00:10:40.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab077fe700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fab0000c000 tx=0x7fab000091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0000c670 con 0x7fab080af620 2021-10-21T00:10:40.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0000c7d0 con 0x7fab080af620 2021-10-21T00:10:40.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab08159a10 con 0x7fab080af620 2021-10-21T00:10:40.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0000cb30 con 0x7fab080af620 2021-10-21T00:10:40.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab080ada60 con 0x7fab080af620 2021-10-21T00:10:40.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab080b12d0 con 0x7fab080af620 2021-10-21T00:10:40.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab00022070 con 0x7fab080af620 2021-10-21T00:10:40.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 0x7faaec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.163+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab0006bfd0 con 0x7fab080af620 2021-10-21T00:10:40.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.167+0000 7fab07fff700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 0x7faaec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.167+0000 7fab07fff700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 0x7faaec055b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faaf001a000 tx=0x7faaf0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.171+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab00043020 con 0x7fab080af620 2021-10-21T00:10:40.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.291+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab08057350 con 0x7fab080af620 2021-10-21T00:10:40.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab057fa700 1 -- 172.21.15.41:0/2010976809 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fab00046640 con 0x7fab080af620 2021-10-21T00:10:40.303 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:40.304 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":97,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:39.722527+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:37.769852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:38.737124+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:40.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 msgr2=0x7faaec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 0x7faaec055b90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faaf001a000 tx=0x7faaf0014000).stop 2021-10-21T00:10:40.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 msgr2=0x7fab08159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fab0000c000 tx=0x7fab000091d0).stop 2021-10-21T00:10:40.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 shutdown_connections 2021-10-21T00:10:40.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faaec0536d0 0x7faaec055b90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab080b2170 0x7fab08065fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab080af620 0x7fab08159520 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 --2- 172.21.15.41:0/2010976809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab080abb50 0x7fab08149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 >> 172.21.15.41:0/2010976809 conn(0x7fab080b5700 msgr2=0x7fab0809a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 shutdown_connections 2021-10-21T00:10:40.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.295+0000 7fab0d1e9700 1 -- 172.21.15.41:0/2010976809 wait complete. 2021-10-21T00:10:40.316 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:10:40.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.415+0000 7f2ba359e700 1 Processor -- start 2021-10-21T00:10:40.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.415+0000 7f2ba359e700 1 -- start start 2021-10-21T00:10:40.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba40ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba413f710 con 0x7f2ba40af700 2021-10-21T00:10:40.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40b6350 con 0x7f2ba40b5f70 2021-10-21T00:10:40.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40adf10 con 0x7f2ba406a190 2021-10-21T00:10:40.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba2d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f2ba40af700 0x7f2ba40ace90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33618/0 (socket says 172.21.15.41:33618) 2021-10-21T00:10:40.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba2d9d700 1 -- 172.21.15.41:0/2683779011 learned_addr learned my addr 172.21.15.41:0/2683779011 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:40.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba1d9b700 1 --2- 172.21.15.41:0/2683779011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba40ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba159a700 1 -- 172.21.15.41:0/2683779011 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752565855 0 0) 0x7f2ba413f710 con 0x7f2ba40af700 2021-10-21T00:10:40.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba159a700 1 -- 172.21.15.41:0/2683779011 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88003260 con 0x7f2ba40af700 2021-10-21T00:10:40.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba1d9b700 1 -- 172.21.15.41:0/2683779011 >> v1:172.21.15.62:6789/0 conn(0x7f2ba40b5f70 legacy=0x7f2ba413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba1d9b700 1 -- 172.21.15.41:0/2683779011 >> v1:172.21.15.41:6789/0 conn(0x7f2ba40af700 legacy=0x7f2ba40ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba1d9b700 1 -- 172.21.15.41:0/2683779011 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4067600 con 0x7f2ba406a190 2021-10-21T00:10:40.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba1d9b700 1 --2- 172.21.15.41:0/2683779011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba40ac9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2b98002f70 tx=0x7f2b98006df0).ready entity=mon.2 client_cookie=7ac48c011076c176 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba159a700 1 -- 172.21.15.41:0/2683779011 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9800d570 con 0x7f2ba406a190 2021-10-21T00:10:40.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba159a700 1 -- 172.21.15.41:0/2683779011 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98000e90 con 0x7f2ba406a190 2021-10-21T00:10:40.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba159a700 1 -- 172.21.15.41:0/2683779011 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9800d8c0 con 0x7f2ba406a190 2021-10-21T00:10:40.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- 172.21.15.41:0/2683779011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 msgr2=0x7f2ba40ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 --2- 172.21.15.41:0/2683779011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba40ac9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2b98002f70 tx=0x7f2b98006df0).stop 2021-10-21T00:10:40.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- 172.21.15.41:0/2683779011 shutdown_connections 2021-10-21T00:10:40.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 --2- 172.21.15.41:0/2683779011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba40ac9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- 172.21.15.41:0/2683779011 >> 172.21.15.41:0/2683779011 conn(0x7f2ba40639f0 msgr2=0x7f2ba40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- 172.21.15.41:0/2683779011 shutdown_connections 2021-10-21T00:10:40.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.419+0000 7f2ba359e700 1 -- 172.21.15.41:0/2683779011 wait complete. 2021-10-21T00:10:40.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 Processor -- start 2021-10-21T00:10:40.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 -- start start 2021-10-21T00:10:40.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba4139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba40af700 0x7f2ba413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba410e820 con 0x7f2ba40b5f70 2021-10-21T00:10:40.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba410eac0 con 0x7f2ba40af700 2021-10-21T00:10:40.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.423+0000 7f2ba359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba410ed60 con 0x7f2ba406a190 2021-10-21T00:10:40.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba4139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35856/0 (socket says 172.21.15.41:35856) 2021-10-21T00:10:40.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 -- 172.21.15.41:0/3759963412 learned_addr learned my addr 172.21.15.41:0/3759963412 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:40.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba1d9b700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba40af700 0x7f2ba413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 -- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 msgr2=0x7f2ba4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba4139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 -- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba40af700 msgr2=0x7f2ba413cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba40af700 0x7f2ba413cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 -- 172.21.15.41:0/3759963412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9800b180 con 0x7f2ba40b5f70 2021-10-21T00:10:40.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba2d9d700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2b9c001490 tx=0x7f2b9c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c005d90 con 0x7f2ba40b5f70 2021-10-21T00:10:40.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c007110 con 0x7f2ba40b5f70 2021-10-21T00:10:40.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba4066020 con 0x7f2ba40b5f70 2021-10-21T00:10:40.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c007470 con 0x7f2ba40b5f70 2021-10-21T00:10:40.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40664f0 con 0x7f2ba40b5f70 2021-10-21T00:10:40.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba410ef20 con 0x7f2ba40b5f70 2021-10-21T00:10:40.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.427+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2b9c0075d0 con 0x7f2ba40b5f70 2021-10-21T00:10:40.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.431+0000 7f2b937fe700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 0x7f2b80055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.431+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b9c06e210 con 0x7f2ba40b5f70 2021-10-21T00:10:40.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.431+0000 7f2ba259c700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 0x7f2b80055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.431+0000 7f2ba259c700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 0x7f2b80055b00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2b9400d000 tx=0x7f2b94007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.435+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b9c045370 con 0x7f2ba40b5f70 2021-10-21T00:10:40.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.595+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2ba40b17e0 con 0x7f2ba40b5f70 2021-10-21T00:10:40.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.735+0000 7f2b937fe700 1 -- 172.21.15.41:0/3759963412 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2b9c048990 con 0x7f2ba40b5f70 2021-10-21T00:10:40.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 msgr2=0x7f2b80055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 0x7f2b80055b00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2b9400d000 tx=0x7f2b94007b90).stop 2021-10-21T00:10:40.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 msgr2=0x7f2ba413eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2b9c001490 tx=0x7f2b9c007e90).stop 2021-10-21T00:10:40.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 shutdown_connections 2021-10-21T00:10:40.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2b80053640 0x7f2b80055b00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2ba40b5f70 0x7f2ba413eff0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ba40af700 0x7f2ba413cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 --2- 172.21.15.41:0/3759963412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ba406a190 0x7f2ba4139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 >> 172.21.15.41:0/3759963412 conn(0x7f2ba40639f0 msgr2=0x7f2ba40affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 shutdown_connections 2021-10-21T00:10:40.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.739+0000 7f2ba359e700 1 -- 172.21.15.41:0/3759963412 wait complete. 2021-10-21T00:10:40.764 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:40.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 Processor -- start 2021-10-21T00:10:40.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 -- start start 2021-10-21T00:10:40.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f88580b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885805fdd0 con 0x7f88580b0730 2021-10-21T00:10:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8858140400 con 0x7f88580b3370 2021-10-21T00:10:40.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885f17f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b27c0 con 0x7f885805f9f0 2021-10-21T00:10:40.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885d97c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f88580b0730 0x7f88580b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33630/0 (socket says 172.21.15.41:33630) 2021-10-21T00:10:40.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885d97c700 1 -- 172.21.15.41:0/3750195495 learned_addr learned my addr 172.21.15.41:0/3750195495 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:40.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.867+0000 7f885e17d700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f88580b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985078813 0 0) 0x7f885805fdd0 con 0x7f88580b0730 2021-10-21T00:10:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840003260 con 0x7f88580b0730 2021-10-21T00:10:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179412618 0 0) 0x7f8858140400 con 0x7f88580b3370 2021-10-21T00:10:40.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885805fdd0 con 0x7f88580b3370 2021-10-21T00:10:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720809748 0 0) 0x7f8840003260 con 0x7f88580b0730 2021-10-21T00:10:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 msgr2=0x7f88580b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f88580b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 >> v1:172.21.15.62:6789/0 conn(0x7f88580b3370 legacy=0x7f8858138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858140080 con 0x7f88580b0730 2021-10-21T00:10:40.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f8854001660 con 0x7f88580b0730 2021-10-21T00:10:40.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 >> v1:172.21.15.41:6789/0 conn(0x7f88580b0730 legacy=0x7f88580b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8840003910 0x7f8840003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f8840004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88400049f0 0x7f8840004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b27c0 con 0x7f8840003910 2021-10-21T00:10:40.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000b780 con 0x7f88400049f0 2021-10-21T00:10:40.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884000b940 con 0x7f885805f9f0 2021-10-21T00:10:40.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8840003910 0x7f8840003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d97c700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f8840004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e97e700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88400049f0 0x7f8840004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 -- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 msgr2=0x7f8840004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:40.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f8840004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 -- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88400049f0 msgr2=0x7f8840004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:40.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88400049f0 0x7f8840004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 -- 172.21.15.41:0/3750195495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840003260 con 0x7f8840003910 2021-10-21T00:10:40.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d97c700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f885805f9f0 0x7f8840004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:40.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e17d700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8840003910 0x7f8840003d10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f884800c000 tx=0x7f8848006d90).ready entity=mon.0 client_cookie=182b26971138c717 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8848013450 con 0x7f8840003910 2021-10-21T00:10:40.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88480135b0 con 0x7f8840003910 2021-10-21T00:10:40.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885d17b700 1 -- 172.21.15.41:0/3750195495 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8848013910 con 0x7f8840003910 2021-10-21T00:10:40.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 -- 172.21.15.41:0/3750195495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8840003910 msgr2=0x7f8840003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 --2- 172.21.15.41:0/3750195495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8840003910 0x7f8840003d10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f884800c000 tx=0x7f8848006d90).stop 2021-10-21T00:10:40.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885e97e700 1 -- 172.21.15.41:0/3750195495 reap_dead start 2021-10-21T00:10:40.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 -- 172.21.15.41:0/3750195495 shutdown_connections 2021-10-21T00:10:40.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 -- 172.21.15.41:0/3750195495 >> 172.21.15.41:0/3750195495 conn(0x7f88580637b0 msgr2=0x7f8858063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:40.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 -- 172.21.15.41:0/3750195495 shutdown_connections 2021-10-21T00:10:40.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.871+0000 7f885f17f700 1 -- 172.21.15.41:0/3750195495 wait complete. 2021-10-21T00:10:40.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 Processor -- start 2021-10-21T00:10:40.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 -- start start 2021-10-21T00:10:40.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88580b50f0 0x7f885813e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f885813efb0 0x7f885813f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b58e0 con 0x7f885813d9a0 2021-10-21T00:10:40.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b6560 con 0x7f885813efb0 2021-10-21T00:10:40.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885f17f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885813f930 con 0x7f88580b50f0 2021-10-21T00:10:40.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35874/0 (socket says 172.21.15.41:35874) 2021-10-21T00:10:40.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 -- 172.21.15.41:0/1680677561 learned_addr learned my addr 172.21.15.41:0/1680677561 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:40.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885e17d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88580b50f0 0x7f885813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885e97e700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f885813efb0 0x7f885813f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 -- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88580b50f0 msgr2=0x7f885813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88580b50f0 0x7f885813e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 -- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f885813efb0 msgr2=0x7f885813f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:40.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f885813efb0 0x7f885813f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:40.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 -- 172.21.15.41:0/1680677561 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580b5d10 con 0x7f885813d9a0 2021-10-21T00:10:40.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.875+0000 7f885d97c700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f885400d000 tx=0x7f8854001dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8854011780 con 0x7f885813d9a0 2021-10-21T00:10:40.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540118e0 con 0x7f885813d9a0 2021-10-21T00:10:40.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580b6800 con 0x7f885813d9a0 2021-10-21T00:10:40.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8854011c40 con 0x7f885813d9a0 2021-10-21T00:10:40.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885813def0 con 0x7f885813d9a0 2021-10-21T00:10:40.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885813d780 con 0x7f885813d9a0 2021-10-21T00:10:40.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f885401b030 con 0x7f885813d9a0 2021-10-21T00:10:40.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 0x7f8838055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:40.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f885406b5c0 con 0x7f885813d9a0 2021-10-21T00:10:40.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f885e17d700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 0x7f8838055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:40.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.879+0000 7f885e17d700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 0x7f8838055ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f884801d000 tx=0x7f8848017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:40.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:40.887+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88540426c0 con 0x7f885813d9a0 2021-10-21T00:10:41.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.051+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8858057350 con 0x7f885813d9a0 2021-10-21T00:10:41.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.051+0000 7f88477fe700 1 -- 172.21.15.41:0/1680677561 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f8854019030 con 0x7f885813d9a0 2021-10-21T00:10:41.061 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:41.061 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:40.726692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/576603081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":576603081},{"type":"v1","addr":"172.21.15.62:6835","nonce":576603081}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:41.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 msgr2=0x7f8838055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 0x7f8838055ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f884801d000 tx=0x7f8848017000).stop 2021-10-21T00:10:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 msgr2=0x7f885814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f885400d000 tx=0x7f8854001dd0).stop 2021-10-21T00:10:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 shutdown_connections 2021-10-21T00:10:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8838053610 0x7f8838055ad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f885813efb0 0x7f885813f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f885813d9a0 0x7f885814f590 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 --2- 172.21.15.41:0/1680677561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88580b50f0 0x7f885813e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 >> 172.21.15.41:0/1680677561 conn(0x7f88580637b0 msgr2=0x7f88580ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 shutdown_connections 2021-10-21T00:10:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.055+0000 7f885f17f700 1 -- 172.21.15.41:0/1680677561 wait complete. 2021-10-21T00:10:41.066 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 51 2021-10-21T00:10:41.074 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:41.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 Processor -- start 2021-10-21T00:10:41.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 -- start start 2021-10-21T00:10:41.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f817c0b2bf0 0x7f817c144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c05f6b0 con 0x7f817c09b220 2021-10-21T00:10:41.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c09d070 con 0x7f817c0b2bf0 2021-10-21T00:10:41.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f8183f11700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c099b70 con 0x7f817c09cc90 2021-10-21T00:10:41.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f81824ae700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f817c0b2bf0 0x7f817c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f817c0b2bf0 0x7f817c144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35884/0 (socket says 172.21.15.41:35884) 2021-10-21T00:10:41.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.167+0000 7f81814ac700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f817c09b220 0x7f817c140380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33652/0 (socket says 172.21.15.41:33652) 2021-10-21T00:10:41.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 -- 172.21.15.41:0/1266375770 learned_addr learned my addr 172.21.15.41:0/1266375770 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:41.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8181cad700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 -- 172.21.15.41:0/1266375770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 msgr2=0x7f817c13fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:41.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c13fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 -- 172.21.15.41:0/1266375770 >> v1:172.21.15.41:6789/0 conn(0x7f817c09b220 legacy=0x7f817c140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8180cab700 1 -- 172.21.15.41:0/1266375770 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753194458 0 0) 0x7f817c05f6b0 con 0x7f817c09b220 2021-10-21T00:10:41.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 -- 172.21.15.41:0/1266375770 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c05f910 con 0x7f817c0b2bf0 2021-10-21T00:10:41.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8181cad700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c13fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:41.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f81824ae700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c0b2bf0 0x7f817c144180 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f817c0ae030 tx=0x7f8174006eb0).ready entity=mon.0 client_cookie=8ee3bd52d7b8911b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8180cab700 1 -- 172.21.15.41:0/1266375770 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817400d5c0 con 0x7f817c0b2bf0 2021-10-21T00:10:41.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8180cab700 1 -- 172.21.15.41:0/1266375770 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8174000e90 con 0x7f817c0b2bf0 2021-10-21T00:10:41.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8180cab700 1 -- 172.21.15.41:0/1266375770 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817400d910 con 0x7f817c0b2bf0 2021-10-21T00:10:41.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 -- 172.21.15.41:0/1266375770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c0b2bf0 msgr2=0x7f817c144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c0b2bf0 0x7f817c144180 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f817c0ae030 tx=0x7f8174006eb0).stop 2021-10-21T00:10:41.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 -- 172.21.15.41:0/1266375770 shutdown_connections 2021-10-21T00:10:41.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c0b2bf0 0x7f817c144180 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 --2- 172.21.15.41:0/1266375770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c13fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 -- 172.21.15.41:0/1266375770 >> 172.21.15.41:0/1266375770 conn(0x7f817c0b7030 msgr2=0x7f817c0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 -- 172.21.15.41:0/1266375770 shutdown_connections 2021-10-21T00:10:41.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.171+0000 7f8183f11700 1 -- 172.21.15.41:0/1266375770 wait complete. 2021-10-21T00:10:41.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 Processor -- start 2021-10-21T00:10:41.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 -- start start 2021-10-21T00:10:41.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c065830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817c0b2bf0 0x7f817c065d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c1500b0 con 0x7f817c09b220 2021-10-21T00:10:41.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c150350 con 0x7f817c0b2bf0 2021-10-21T00:10:41.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8183f11700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c1505f0 con 0x7f817c09cc90 2021-10-21T00:10:41.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35886/0 (socket says 172.21.15.41:35886) 2021-10-21T00:10:41.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 -- 172.21.15.41:0/1814134961 learned_addr learned my addr 172.21.15.41:0/1814134961 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:41.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f81824ae700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817c0b2bf0 0x7f817c065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f81814ac700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c065830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 -- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 msgr2=0x7f817c065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c065830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 -- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817c0b2bf0 msgr2=0x7f817c065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817c0b2bf0 0x7f817c065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.175+0000 7f8181cad700 1 -- 172.21.15.41:0/1814134961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009470 con 0x7f817c09b220 2021-10-21T00:10:41.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f8181cad700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f816c00c000 tx=0x7f816c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c00c850 con 0x7f817c09b220 2021-10-21T00:10:41.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00c9b0 con 0x7f817c09b220 2021-10-21T00:10:41.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817400b1e0 con 0x7f817c09b220 2021-10-21T00:10:41.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c00cd10 con 0x7f817c09b220 2021-10-21T00:10:41.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c150a90 con 0x7f817c09b220 2021-10-21T00:10:41.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c1507b0 con 0x7f817c09b220 2021-10-21T00:10:41.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f816c01b400 con 0x7f817c09b220 2021-10-21T00:10:41.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 0x7f815c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f816c06c300 con 0x7f817c09b220 2021-10-21T00:10:41.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.179+0000 7f81814ac700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 0x7f815c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.183+0000 7f81814ac700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 0x7f815c055a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f817000d000 tx=0x7f8170007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.187+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f816c043400 con 0x7f817c09b220 2021-10-21T00:10:41.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.315+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f817c057350 con 0x7f817c09b220 2021-10-21T00:10:41.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.315+0000 7f817affd700 1 -- 172.21.15.41:0/1814134961 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f816c046a20 con 0x7f817c09b220 2021-10-21T00:10:41.326 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:41.326 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":98,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:40.725582+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:37.769852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:38.737124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:41.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 msgr2=0x7f815c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 0x7f815c055a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f817000d000 tx=0x7f8170007a00).stop 2021-10-21T00:10:41.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 msgr2=0x7f817c0ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f816c00c000 tx=0x7f816c0091d0).stop 2021-10-21T00:10:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 shutdown_connections 2021-10-21T00:10:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f815c053580 0x7f815c055a40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817c0b2bf0 0x7f817c065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f817c09cc90 0x7f817c065830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 --2- 172.21.15.41:0/1814134961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f817c09b220 0x7f817c0ae850 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 >> 172.21.15.41:0/1814134961 conn(0x7f817c0b7030 msgr2=0x7f817c144090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 shutdown_connections 2021-10-21T00:10:41.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.319+0000 7f8183f11700 1 -- 172.21.15.41:0/1814134961 wait complete. 2021-10-21T00:10:41.339 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:41.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 Processor -- start 2021-10-21T00:10:41.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- start start 2021-10-21T00:10:41.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f652c062330 0x7f652c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f652c143610 0x7f652c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c142ad0 con 0x7f652c13c510 2021-10-21T00:10:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0b3520 con 0x7f652c143610 2021-10-21T00:10:41.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c143c40 con 0x7f652c062330 2021-10-21T00:10:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f652c143610 0x7f652c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f652c143610 0x7f652c13c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35898/0 (socket says 172.21.15.41:35898) 2021-10-21T00:10:41.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 -- 172.21.15.41:0/2407335638 learned_addr learned my addr 172.21.15.41:0/2407335638 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:41.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531153700 1 --2- 172.21.15.41:0/2407335638 >> v2:172.21.15.62:3300/0 conn(0x7f652c062330 0x7f652c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 -- 172.21.15.41:0/2407335638 >> v2:172.21.15.62:3300/0 conn(0x7f652c062330 msgr2=0x7f652c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:41.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 --2- 172.21.15.41:0/2407335638 >> v2:172.21.15.62:3300/0 conn(0x7f652c062330 0x7f652c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 -- 172.21.15.41:0/2407335638 >> v1:172.21.15.62:6789/0 conn(0x7f652c13c510 legacy=0x7f652c142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 -- 172.21.15.41:0/2407335638 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c13ce60 con 0x7f652c143610 2021-10-21T00:10:41.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6531954700 1 --2- 172.21.15.41:0/2407335638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c143610 0x7f652c13c970 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f65240032f0 tx=0x7f6524009290).ready entity=mon.0 client_cookie=afb4cf7bd0732f44 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6523fff700 1 -- 172.21.15.41:0/2407335638 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652400b870 con 0x7f652c143610 2021-10-21T00:10:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6523fff700 1 -- 172.21.15.41:0/2407335638 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400b9d0 con 0x7f652c143610 2021-10-21T00:10:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6523fff700 1 -- 172.21.15.41:0/2407335638 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652400bb40 con 0x7f652c143610 2021-10-21T00:10:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- 172.21.15.41:0/2407335638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c143610 msgr2=0x7f652c13c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 --2- 172.21.15.41:0/2407335638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c143610 0x7f652c13c970 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f65240032f0 tx=0x7f6524009290).stop 2021-10-21T00:10:41.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- 172.21.15.41:0/2407335638 shutdown_connections 2021-10-21T00:10:41.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 --2- 172.21.15.41:0/2407335638 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c143610 0x7f652c13c970 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 --2- 172.21.15.41:0/2407335638 >> v2:172.21.15.62:3300/0 conn(0x7f652c062330 0x7f652c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.443+0000 7f6532155700 1 -- 172.21.15.41:0/2407335638 >> 172.21.15.41:0/2407335638 conn(0x7f652c0b9080 msgr2=0x7f652c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.447+0000 7f6532155700 1 -- 172.21.15.41:0/2407335638 shutdown_connections 2021-10-21T00:10:41.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.447+0000 7f6532155700 1 -- 172.21.15.41:0/2407335638 wait complete. 2021-10-21T00:10:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.447+0000 7f6532155700 1 Processor -- start 2021-10-21T00:10:41.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.447+0000 7f6532155700 1 -- start start 2021-10-21T00:10:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f652c062330 0x7f652c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f652c143610 0x7f652c1384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c144850 con 0x7f652c13c510 2021-10-21T00:10:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c148460 con 0x7f652c062330 2021-10-21T00:10:41.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c146dd0 con 0x7f652c143610 2021-10-21T00:10:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35902/0 (socket says 172.21.15.41:35902) 2021-10-21T00:10:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 -- 172.21.15.41:0/2299777458 learned_addr learned my addr 172.21.15.41:0/2299777458 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:41.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6531153700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f652c062330 0x7f652c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6531954700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f652c143610 0x7f652c1384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 -- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f652c143610 msgr2=0x7f652c1384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f652c143610 0x7f652c1384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 -- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f652c062330 msgr2=0x7f652c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f652c062330 0x7f652c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 -- 172.21.15.41:0/2299777458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524009530 con 0x7f652c13c510 2021-10-21T00:10:41.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6530952700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f652c0b08b0 tx=0x7f6528007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6528007030 con 0x7f652c13c510 2021-10-21T00:10:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528007190 con 0x7f652c13c510 2021-10-21T00:10:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c1521a0 con 0x7f652c13c510 2021-10-21T00:10:41.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6528006510 con 0x7f652c13c510 2021-10-21T00:10:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c146b00 con 0x7f652c13c510 2021-10-21T00:10:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c1482b0 con 0x7f652c13c510 2021-10-21T00:10:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.451+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6528010030 con 0x7f652c13c510 2021-10-21T00:10:41.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.455+0000 7f65227fc700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 0x7f6514055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.455+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f652806b540 con 0x7f652c13c510 2021-10-21T00:10:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.455+0000 7f6531153700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 0x7f6514055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.455+0000 7f6531153700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 0x7f6514055a40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f651c00b000 tx=0x7f651c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.459+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6528042600 con 0x7f652c13c510 2021-10-21T00:10:41.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.627+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f652c144680 con 0x7f652c13c510 2021-10-21T00:10:41.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.635+0000 7f65227fc700 1 -- 172.21.15.41:0/2299777458 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6528045c20 con 0x7f652c13c510 2021-10-21T00:10:41.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 msgr2=0x7f6514055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 0x7f6514055a40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f651c00b000 tx=0x7f651c006df0).stop 2021-10-21T00:10:41.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 msgr2=0x7f652c146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f652c0b08b0 tx=0x7f6528007c10).stop 2021-10-21T00:10:41.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 shutdown_connections 2021-10-21T00:10:41.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6514053580 0x7f6514055a40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f652c143610 0x7f652c1384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f652c13c510 0x7f652c146470 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 --2- 172.21.15.41:0/2299777458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f652c062330 0x7f652c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 >> 172.21.15.41:0/2299777458 conn(0x7f652c0b9080 msgr2=0x7f652c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 shutdown_connections 2021-10-21T00:10:41.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.639+0000 7f6532155700 1 -- 172.21.15.41:0/2299777458 wait complete. 2021-10-21T00:10:41.651 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:10:41.661 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:41.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 Processor -- start 2021-10-21T00:10:41.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 -- start start 2021-10-21T00:10:41.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd95c062330 0x7fd95c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c142ad0 con 0x7fd95c143610 2021-10-21T00:10:41.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c145f90 con 0x7fd95c13c510 2021-10-21T00:10:41.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.767+0000 7fd96146e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0b3520 con 0x7fd95c062330 2021-10-21T00:10:41.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd960c6d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd95c143610 0x7fd95c14d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33678/0 (socket says 172.21.15.41:33678) 2021-10-21T00:10:41.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd960c6d700 1 -- 172.21.15.41:0/1925978779 learned_addr learned my addr 172.21.15.41:0/1925978779 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:41.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd95c062330 0x7fd95c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95affd700 1 -- 172.21.15.41:0/1925978779 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334668868 0 0) 0x7fd95c142ad0 con 0x7fd95c143610 2021-10-21T00:10:41.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95affd700 1 -- 172.21.15.41:0/1925978779 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd940003260 con 0x7fd95c143610 2021-10-21T00:10:41.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95bfff700 1 -- 172.21.15.41:0/1925978779 >> v1:172.21.15.62:6789/0 conn(0x7fd95c13c510 legacy=0x7fd95c142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95bfff700 1 -- 172.21.15.41:0/1925978779 >> v1:172.21.15.41:6789/0 conn(0x7fd95c143610 legacy=0x7fd95c14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95bfff700 1 -- 172.21.15.41:0/1925978779 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c146230 con 0x7fd95c062330 2021-10-21T00:10:41.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95bfff700 1 --2- 172.21.15.41:0/1925978779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c0b4140 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fd94c002f70 tx=0x7fd94c006df0).ready entity=mon.0 client_cookie=437f7f10c0e1781a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95affd700 1 -- 172.21.15.41:0/1925978779 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c00d610 con 0x7fd95c062330 2021-10-21T00:10:41.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95affd700 1 -- 172.21.15.41:0/1925978779 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c000e90 con 0x7fd95c062330 2021-10-21T00:10:41.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd95affd700 1 -- 172.21.15.41:0/1925978779 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c00d960 con 0x7fd95c062330 2021-10-21T00:10:41.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 -- 172.21.15.41:0/1925978779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 msgr2=0x7fd95c0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 --2- 172.21.15.41:0/1925978779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c0b4140 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fd94c002f70 tx=0x7fd94c006df0).stop 2021-10-21T00:10:41.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 -- 172.21.15.41:0/1925978779 shutdown_connections 2021-10-21T00:10:41.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 --2- 172.21.15.41:0/1925978779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c0b4140 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 -- 172.21.15.41:0/1925978779 >> 172.21.15.41:0/1925978779 conn(0x7fd95c0b9080 msgr2=0x7fd95c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 -- 172.21.15.41:0/1925978779 shutdown_connections 2021-10-21T00:10:41.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.771+0000 7fd96146e700 1 -- 172.21.15.41:0/1925978779 wait complete. 2021-10-21T00:10:41.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 Processor -- start 2021-10-21T00:10:41.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 -- start start 2021-10-21T00:10:41.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 0x7fd95c13a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd95c143610 0x7fd95c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c140410 con 0x7fd95c062330 2021-10-21T00:10:41.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c148d30 con 0x7fd95c13c510 2021-10-21T00:10:41.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd96146e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c1410e0 con 0x7fd95c143610 2021-10-21T00:10:41.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35914/0 (socket says 172.21.15.41:35914) 2021-10-21T00:10:41.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 -- 172.21.15.41:0/721299077 learned_addr learned my addr 172.21.15.41:0/721299077 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:41.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95b7fe700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 0x7fd95c13a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd960c6d700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd95c143610 0x7fd95c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 -- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd95c143610 msgr2=0x7fd95c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd95c143610 0x7fd95c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 -- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 msgr2=0x7fd95c13a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 0x7fd95c13a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 -- 172.21.15.41:0/721299077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c00b180 con 0x7fd95c062330 2021-10-21T00:10:41.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95b7fe700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 0x7fd95c13a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:41.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd95bfff700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fd94c002f70 tx=0x7fd94c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.775+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c00d290 con 0x7fd95c062330 2021-10-21T00:10:41.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c01e400 con 0x7fd95c062330 2021-10-21T00:10:41.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c141380 con 0x7fd95c062330 2021-10-21T00:10:41.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c01e760 con 0x7fd95c062330 2021-10-21T00:10:41.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c155210 con 0x7fd95c062330 2021-10-21T00:10:41.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c063020 con 0x7fd95c062330 2021-10-21T00:10:41.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd94c025030 con 0x7fd95c062330 2021-10-21T00:10:41.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd9597fa700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 0x7fd934055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:41.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd94c06c870 con 0x7fd95c062330 2021-10-21T00:10:41.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd95b7fe700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 0x7fd934055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:41.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.779+0000 7fd95b7fe700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 0x7fd934055a40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd94400b000 tx=0x7fd944009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:41.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.783+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd94c043900 con 0x7fd95c062330 2021-10-21T00:10:41.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.951+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd95c057350 con 0x7fd95c062330 2021-10-21T00:10:41.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.959+0000 7fd9597fa700 1 -- 172.21.15.41:0/721299077 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd94c023020 con 0x7fd95c062330 2021-10-21T00:10:41.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 msgr2=0x7fd934055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 0x7fd934055a40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd94400b000 tx=0x7fd944009040).stop 2021-10-21T00:10:41.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 msgr2=0x7fd95c142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:41.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fd94c002f70 tx=0x7fd94c014000).stop 2021-10-21T00:10:41.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 shutdown_connections 2021-10-21T00:10:41.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd934053580 0x7fd934055a40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd95c143610 0x7fd95c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd95c13c510 0x7fd95c13a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 --2- 172.21.15.41:0/721299077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd95c062330 0x7fd95c142120 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:41.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 >> 172.21.15.41:0/721299077 conn(0x7fd95c0b9080 msgr2=0x7fd95c0b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:41.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 shutdown_connections 2021-10-21T00:10:41.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:41.963+0000 7fd96146e700 1 -- 172.21.15.41:0/721299077 wait complete. 2021-10-21T00:10:41.976 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:10:41.986 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:10:42.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.087+0000 7f047121f700 1 Processor -- start 2021-10-21T00:10:42.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.087+0000 7f047121f700 1 -- start start 2021-10-21T00:10:42.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f046c0b9c70 0x7f046c143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f046c0b3bc0 0x7f046c143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c142bc0 con 0x7f046c143a00 2021-10-21T00:10:42.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c1429a0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c0ba050 con 0x7f046c0b9c70 2021-10-21T00:10:42.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f046c0b3bc0 0x7f046c143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f046c0b3bc0 0x7f046c143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35924/0 (socket says 172.21.15.41:35924) 2021-10-21T00:10:42.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 -- 172.21.15.41:0/2545677043 learned_addr learned my addr 172.21.15.41:0/2545677043 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:42.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046ad9d700 1 --2- 172.21.15.41:0/2545677043 >> v2:172.21.15.62:3300/0 conn(0x7f046c0b9c70 0x7f046c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 -- 172.21.15.41:0/2545677043 >> v2:172.21.15.62:3300/0 conn(0x7f046c0b9c70 msgr2=0x7f046c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:42.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 --2- 172.21.15.41:0/2545677043 >> v2:172.21.15.62:3300/0 conn(0x7f046c0b9c70 0x7f046c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 -- 172.21.15.41:0/2545677043 >> v1:172.21.15.41:6789/0 conn(0x7f046c143a00 legacy=0x7f046c05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 -- 172.21.15.41:0/2545677043 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c1463c0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046259c700 1 --2- 172.21.15.41:0/2545677043 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c143510 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f0454002f70 tx=0x7f0454006eb0).ready entity=mon.0 client_cookie=26273eae9c6c1460 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046a59c700 1 -- 172.21.15.41:0/2545677043 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045400d610 con 0x7f046c0b3bc0 2021-10-21T00:10:42.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046a59c700 1 -- 172.21.15.41:0/2545677043 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0454000e90 con 0x7f046c0b3bc0 2021-10-21T00:10:42.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f046a59c700 1 -- 172.21.15.41:0/2545677043 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045400d9a0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- 172.21.15.41:0/2545677043 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 msgr2=0x7f046c143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 --2- 172.21.15.41:0/2545677043 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c143510 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f0454002f70 tx=0x7f0454006eb0).stop 2021-10-21T00:10:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- 172.21.15.41:0/2545677043 shutdown_connections 2021-10-21T00:10:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 --2- 172.21.15.41:0/2545677043 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c143510 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 --2- 172.21.15.41:0/2545677043 >> v2:172.21.15.62:3300/0 conn(0x7f046c0b9c70 0x7f046c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- 172.21.15.41:0/2545677043 >> 172.21.15.41:0/2545677043 conn(0x7f046c062e80 msgr2=0x7f046c0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:42.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- 172.21.15.41:0/2545677043 shutdown_connections 2021-10-21T00:10:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.091+0000 7f047121f700 1 -- 172.21.15.41:0/2545677043 wait complete. 2021-10-21T00:10:42.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 Processor -- start 2021-10-21T00:10:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 -- start start 2021-10-21T00:10:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0b9c70 0x7f046c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c143a00 0x7f046c112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c13f890 con 0x7f046c0b3bc0 2021-10-21T00:10:42.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c114740 con 0x7f046c143a00 2021-10-21T00:10:42.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f047121f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c152100 con 0x7f046c0b9c70 2021-10-21T00:10:42.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f046ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f046ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35928/0 (socket says 172.21.15.41:35928) 2021-10-21T00:10:42.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.095+0000 7f046ad9d700 1 -- 172.21.15.41:0/1603918004 learned_addr learned my addr 172.21.15.41:0/1603918004 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046b59e700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c143a00 0x7f046c112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046259c700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0b9c70 0x7f046c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 -- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0b9c70 msgr2=0x7f046c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0b9c70 0x7f046c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 -- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c143a00 msgr2=0x7f046c112cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c143a00 0x7f046c112cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 -- 172.21.15.41:0/1603918004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045400b1e0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046ad9d700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f046c0ae850 tx=0x7f045c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c011780 con 0x7f046c0b3bc0 2021-10-21T00:10:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c0118e0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c1525e0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f045c011c40 con 0x7f046c0b3bc0 2021-10-21T00:10:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c0af9e0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c146120 con 0x7f046c0b3bc0 2021-10-21T00:10:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f045c012420 con 0x7f046c0b3bc0 2021-10-21T00:10:42.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 0x7f04440559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f045c06b770 con 0x7f046c0b3bc0 2021-10-21T00:10:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.099+0000 7f046259c700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 0x7f04440559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.103+0000 7f046259c700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 0x7f04440559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f045401c000 tx=0x7f0454015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.107+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f045c042760 con 0x7f046c0b3bc0 2021-10-21T00:10:42.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.275+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f046c057350 con 0x7f046c0b3bc0 2021-10-21T00:10:42.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.283+0000 7f0468d99700 1 -- 172.21.15.41:0/1603918004 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f045c00dea0 con 0x7f046c0b3bc0 2021-10-21T00:10:42.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 msgr2=0x7f04440559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 0x7f04440559b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f045401c000 tx=0x7f0454015000).stop 2021-10-21T00:10:42.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 msgr2=0x7f046c152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f046c0ae850 tx=0x7f045c008040).stop 2021-10-21T00:10:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 shutdown_connections 2021-10-21T00:10:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f04440534f0 0x7f04440559b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c143a00 0x7f046c112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0b9c70 0x7f046c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 --2- 172.21.15.41:0/1603918004 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f046c0b3bc0 0x7f046c152d20 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 >> 172.21.15.41:0/1603918004 conn(0x7f046c062e80 msgr2=0x7f046c140170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 shutdown_connections 2021-10-21T00:10:42.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.287+0000 7f047121f700 1 -- 172.21.15.41:0/1603918004 wait complete. 2021-10-21T00:10:42.299 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:10:42.309 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:42.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.399+0000 7fef5892b700 1 Processor -- start 2021-10-21T00:10:42.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.399+0000 7fef5892b700 1 -- start start 2021-10-21T00:10:42.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540b2170 0x7fef540ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fef54067a80 0x7fef54149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540b0b50 con 0x7fef540af620 2021-10-21T00:10:42.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540b2550 con 0x7fef54067a80 2021-10-21T00:10:42.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540b0d90 con 0x7fef540b2170 2021-10-21T00:10:42.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fef54067a80 0x7fef54149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef52d9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540b2170 0x7fef540ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fef540af620 0x7fef540ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41762/0 (socket says 172.21.15.41:41762) 2021-10-21T00:10:42.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5259c700 1 -- 172.21.15.41:0/3997249179 learned_addr learned my addr 172.21.15.41:0/3997249179 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 -- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540b2170 msgr2=0x7fef540ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:42.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 --2- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540b2170 0x7fef540ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 -- 172.21.15.41:0/3997249179 >> v1:172.21.15.62:6789/0 conn(0x7fef540af620 legacy=0x7fef540ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 -- 172.21.15.41:0/3997249179 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540b1030 con 0x7fef54067a80 2021-10-21T00:10:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5359e700 1 --2- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef54067a80 0x7fef54149320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fef4c002f70 tx=0x7fef4c006df0).ready entity=mon.1 client_cookie=63a2de46a4d40253 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef51d9b700 1 -- 172.21.15.41:0/3997249179 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c00d570 con 0x7fef54067a80 2021-10-21T00:10:42.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef51d9b700 1 -- 172.21.15.41:0/3997249179 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c000e90 con 0x7fef54067a80 2021-10-21T00:10:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef51d9b700 1 -- 172.21.15.41:0/3997249179 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c00d8c0 con 0x7fef54067a80 2021-10-21T00:10:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef54067a80 msgr2=0x7fef54149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 --2- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef54067a80 0x7fef54149320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fef4c002f70 tx=0x7fef4c006df0).stop 2021-10-21T00:10:42.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- 172.21.15.41:0/3997249179 shutdown_connections 2021-10-21T00:10:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 --2- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef54067a80 0x7fef54149320 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 --2- 172.21.15.41:0/3997249179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540b2170 0x7fef540ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- 172.21.15.41:0/3997249179 >> 172.21.15.41:0/3997249179 conn(0x7fef540b5700 msgr2=0x7fef540b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:42.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- 172.21.15.41:0/3997249179 shutdown_connections 2021-10-21T00:10:42.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.403+0000 7fef5892b700 1 -- 172.21.15.41:0/3997249179 wait complete. 2021-10-21T00:10:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 Processor -- start 2021-10-21T00:10:42.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- start start 2021-10-21T00:10:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fef54067a80 0x7fef540ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540af620 0x7fef540ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54145230 con 0x7fef54067a80 2021-10-21T00:10:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540adee0 con 0x7fef540b2170 2021-10-21T00:10:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ae180 con 0x7fef540af620 2021-10-21T00:10:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef52d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fef54067a80 0x7fef540ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47864/0 (socket says 172.21.15.41:47864) 2021-10-21T00:10:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 -- 172.21.15.41:0/3655966130 learned_addr learned my addr 172.21.15.41:0/3655966130 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5259c700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540af620 0x7fef540ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 -- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540af620 msgr2=0x7fef540ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540af620 0x7fef540ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 -- 172.21.15.41:0/3655966130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fef54067a80 msgr2=0x7fef540ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fef54067a80 0x7fef540ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 -- 172.21.15.41:0/3655966130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c00b180 con 0x7fef540b2170 2021-10-21T00:10:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5359e700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fef4c002f70 tx=0x7fef4c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c016070 con 0x7fef540b2170 2021-10-21T00:10:42.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00d8f0 con 0x7fef540b2170 2021-10-21T00:10:42.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540ac450 con 0x7fef540b2170 2021-10-21T00:10:42.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c013e90 con 0x7fef540b2170 2021-10-21T00:10:42.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.407+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540aca70 con 0x7fef540b2170 2021-10-21T00:10:42.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540ae340 con 0x7fef540b2170 2021-10-21T00:10:42.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef4c00f030 con 0x7fef540b2170 2021-10-21T00:10:42.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef43fff700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 0x7fef30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:42.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef4c06c6b0 con 0x7fef540b2170 2021-10-21T00:10:42.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef52d9d700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 0x7fef30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:42.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.411+0000 7fef52d9d700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 0x7fef30055ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fef4800b000 tx=0x7fef48006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:42.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.419+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef4c043770 con 0x7fef540b2170 2021-10-21T00:10:42.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.583+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef540b12d0 con 0x7fef540b2170 2021-10-21T00:10:42.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef43fff700 1 -- 172.21.15.41:0/3655966130 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fef4c023090 con 0x7fef540b2170 2021-10-21T00:10:42.595 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:42.596 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:40.726692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/576603081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":576603081},{"type":"v1","addr":"172.21.15.62:6835","nonce":576603081}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 msgr2=0x7fef30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 0x7fef30055ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fef4800b000 tx=0x7fef48006df0).stop 2021-10-21T00:10:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 msgr2=0x7fef541560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fef4c002f70 tx=0x7fef4c014000).stop 2021-10-21T00:10:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 shutdown_connections 2021-10-21T00:10:42.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fef30053610 0x7fef30055ad0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef540b2170 0x7fef541560b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef540af620 0x7fef540ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 --2- 172.21.15.41:0/3655966130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fef54067a80 0x7fef540ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:42.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 >> 172.21.15.41:0/3655966130 conn(0x7fef540b5700 msgr2=0x7fef541490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:42.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 shutdown_connections 2021-10-21T00:10:42.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:42.587+0000 7fef5892b700 1 -- 172.21.15.41:0/3655966130 wait complete. 2021-10-21T00:10:42.600 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 51 2021-10-21T00:10:42.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:39.722912+0000', 'modified': '2021-10-21T00:10:40.726692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7350': {'gid': 7350, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/576603081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 576603081}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 576603081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:42.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:42.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:10:42.929 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7350,"want_state":"up:active","state":"up:active","rank_uptime":3.1905157019999999,"mdsmap_epoch":51,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":7.9221441989999999} 2021-10-21T00:10:42.930 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7350, "mdsmap_epoch": 51, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 3.190515702, "state": "up:active", "uptime": 7.922144199, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:42.931 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:43.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 Processor -- start 2021-10-21T00:10:43.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 -- start start 2021-10-21T00:10:43.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f128c0af620 0x7f128c0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f128c067a80 0x7f128c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c0b0b50 con 0x7f128c0b2170 2021-10-21T00:10:43.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0b2550 con 0x7f128c067a80 2021-10-21T00:10:43.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0b0d90 con 0x7f128c0af620 2021-10-21T00:10:43.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f128c067a80 0x7f128c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f128c067a80 0x7f128c149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35954/0 (socket says 172.21.15.41:35954) 2021-10-21T00:10:43.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 -- 172.21.15.41:0/1510277932 learned_addr learned my addr 172.21.15.41:0/1510277932 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:43.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128a7fc700 1 --2- 172.21.15.41:0/1510277932 >> v2:172.21.15.62:3300/0 conn(0x7f128c0af620 0x7f128c0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 -- 172.21.15.41:0/1510277932 >> v2:172.21.15.62:3300/0 conn(0x7f128c0af620 msgr2=0x7f128c0ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:43.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 --2- 172.21.15.41:0/1510277932 >> v2:172.21.15.62:3300/0 conn(0x7f128c0af620 0x7f128c0ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 -- 172.21.15.41:0/1510277932 >> v1:172.21.15.62:6789/0 conn(0x7f128c0b2170 legacy=0x7f128c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 -- 172.21.15.41:0/1510277932 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0b1030 con 0x7f128c067a80 2021-10-21T00:10:43.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f128b7fe700 1 --2- 172.21.15.41:0/1510277932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c149320 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f128c0aafa0 tx=0x7f127c006eb0).ready entity=mon.0 client_cookie=e660258ccb057e8e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f1289ffb700 1 -- 172.21.15.41:0/1510277932 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f127c00d610 con 0x7f128c067a80 2021-10-21T00:10:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f1289ffb700 1 -- 172.21.15.41:0/1510277932 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c000e90 con 0x7f128c067a80 2021-10-21T00:10:43.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.039+0000 7f1289ffb700 1 -- 172.21.15.41:0/1510277932 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f127c00d9a0 con 0x7f128c067a80 2021-10-21T00:10:43.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- 172.21.15.41:0/1510277932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 msgr2=0x7f128c149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 --2- 172.21.15.41:0/1510277932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c149320 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f128c0aafa0 tx=0x7f127c006eb0).stop 2021-10-21T00:10:43.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- 172.21.15.41:0/1510277932 shutdown_connections 2021-10-21T00:10:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 --2- 172.21.15.41:0/1510277932 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c149320 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 --2- 172.21.15.41:0/1510277932 >> v2:172.21.15.62:3300/0 conn(0x7f128c0af620 0x7f128c0ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- 172.21.15.41:0/1510277932 >> 172.21.15.41:0/1510277932 conn(0x7f128c0b5700 msgr2=0x7f128c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- 172.21.15.41:0/1510277932 shutdown_connections 2021-10-21T00:10:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- 172.21.15.41:0/1510277932 wait complete. 2021-10-21T00:10:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 Processor -- start 2021-10-21T00:10:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.043+0000 7f128bfff700 1 -- start start 2021-10-21T00:10:43.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 0x7f128c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f128c0b2170 0x7f128c0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c149b40 con 0x7f128c067a80 2021-10-21T00:10:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c156360 con 0x7f128c0af620 2021-10-21T00:10:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c066b50 con 0x7f128c0b2170 2021-10-21T00:10:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128a7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 0x7f128c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35956/0 (socket says 172.21.15.41:35956) 2021-10-21T00:10:43.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 -- 172.21.15.41:0/1840082664 learned_addr learned my addr 172.21.15.41:0/1840082664 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:43.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128b7fe700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f128c0b2170 0x7f128c0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 -- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f128c0b2170 msgr2=0x7f128c0635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f128c0b2170 0x7f128c0635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 -- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 msgr2=0x7f128c0ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 0x7f128c0ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 -- 172.21.15.41:0/1840082664 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c00b1e0 con 0x7f128c067a80 2021-10-21T00:10:43.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128a7fc700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 0x7f128c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:43.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128affd700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f128c062470 tx=0x7f1274007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1274012400 con 0x7f128c067a80 2021-10-21T00:10:43.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274012560 con 0x7f128c067a80 2021-10-21T00:10:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c066d80 con 0x7f128c067a80 2021-10-21T00:10:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12740128c0 con 0x7f128c067a80 2021-10-21T00:10:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c0976f0 con 0x7f128c067a80 2021-10-21T00:10:43.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.047+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c0b12d0 con 0x7f128c067a80 2021-10-21T00:10:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.051+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1274019030 con 0x7f128c067a80 2021-10-21T00:10:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.051+0000 7f1283fff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 0x7f1264055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.051+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f127406aa20 con 0x7f128c067a80 2021-10-21T00:10:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.051+0000 7f128a7fc700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 0x7f1264055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.051+0000 7f128a7fc700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 0x7f1264055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f128400b000 tx=0x7f12840091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.055+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1274041b80 con 0x7f128c067a80 2021-10-21T00:10:43.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.187+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128c0b0b50 con 0x7f128c067a80 2021-10-21T00:10:43.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f1283fff700 1 -- 172.21.15.41:0/1840082664 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f128c0b0b50 con 0x7f128c067a80 2021-10-21T00:10:43.199 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:43.199 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":98,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:40.725582+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:37.769852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:38.737124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 msgr2=0x7f1264055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 0x7f1264055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f128400b000 tx=0x7f12840091d0).stop 2021-10-21T00:10:43.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 msgr2=0x7f128c067130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f128c062470 tx=0x7f1274007c50).stop 2021-10-21T00:10:43.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 shutdown_connections 2021-10-21T00:10:43.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1264053610 0x7f1264055ad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f128c0b2170 0x7f128c0635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f128c0af620 0x7f128c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 --2- 172.21.15.41:0/1840082664 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f128c067a80 0x7f128c067130 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 >> 172.21.15.41:0/1840082664 conn(0x7f128c0b5700 msgr2=0x7f128c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 shutdown_connections 2021-10-21T00:10:43.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.191+0000 7f128bfff700 1 -- 172.21.15.41:0/1840082664 wait complete. 2021-10-21T00:10:43.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:10:37.769852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:10:38.737124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:10:43.212 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 Processor -- start 2021-10-21T00:10:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 -- start start 2021-10-21T00:10:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f00740b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f00740b3a20 0x7f007413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007405bd40 con 0x7f0074062f70 2021-10-21T00:10:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007405bf70 con 0x7f00740b3a20 2021-10-21T00:10:43.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00791f0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074142cb0 con 0x7f0074062330 2021-10-21T00:10:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00737fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0074062f70 0x7f007405c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33736/0 (socket says 172.21.15.41:33736) 2021-10-21T00:10:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00737fe700 1 -- 172.21.15.41:0/1162655763 learned_addr learned my addr 172.21.15.41:0/1162655763 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 --2- 172.21.15.41:0/1162655763 >> v2:172.21.15.41:3300/0 conn(0x7f00740b3a20 0x7f007413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0073fff700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f00740b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0072ffd700 1 -- 172.21.15.41:0/1162655763 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808399633 0 0) 0x7f007405bd40 con 0x7f0074062f70 2021-10-21T00:10:43.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0072ffd700 1 -- 172.21.15.41:0/1162655763 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0060003260 con 0x7f0074062f70 2021-10-21T00:10:43.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 -- 172.21.15.41:0/1162655763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 msgr2=0x7f00740b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:43.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f00740b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 -- 172.21.15.41:0/1162655763 >> v1:172.21.15.41:6789/0 conn(0x7f0074062f70 legacy=0x7f007405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 -- 172.21.15.41:0/1162655763 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074142950 con 0x7f00740b3a20 2021-10-21T00:10:43.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f00789ef700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00740b3a20 0x7f007413c510 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f006c0032f0 tx=0x7f006c0091d0).ready entity=mon.0 client_cookie=893dd65dd09427d8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0072ffd700 1 -- 172.21.15.41:0/1162655763 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006c00b600 con 0x7f00740b3a20 2021-10-21T00:10:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0072ffd700 1 -- 172.21.15.41:0/1162655763 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00b760 con 0x7f00740b3a20 2021-10-21T00:10:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.311+0000 7f0072ffd700 1 -- 172.21.15.41:0/1162655763 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006c00b8d0 con 0x7f00740b3a20 2021-10-21T00:10:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- 172.21.15.41:0/1162655763 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00740b3a20 msgr2=0x7f007413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00740b3a20 0x7f007413c510 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f006c0032f0 tx=0x7f006c0091d0).stop 2021-10-21T00:10:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- 172.21.15.41:0/1162655763 shutdown_connections 2021-10-21T00:10:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f00740b3a20 0x7f007413c510 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- 172.21.15.41:0/1162655763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f00740b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- 172.21.15.41:0/1162655763 >> 172.21.15.41:0/1162655763 conn(0x7f00740b9080 msgr2=0x7f00740b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- 172.21.15.41:0/1162655763 shutdown_connections 2021-10-21T00:10:43.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- 172.21.15.41:0/1162655763 wait complete. 2021-10-21T00:10:43.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 Processor -- start 2021-10-21T00:10:43.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- start start 2021-10-21T00:10:43.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f0074140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00740b3a20 0x7f00740b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007413e5f0 con 0x7f0074062f70 2021-10-21T00:10:43.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007413e760 con 0x7f00740b3a20 2021-10-21T00:10:43.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00791f0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007413ea00 con 0x7f0074062330 2021-10-21T00:10:43.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00737fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:35972/0 (socket says 172.21.15.41:35972) 2021-10-21T00:10:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.315+0000 7f00737fe700 1 -- 172.21.15.41:0/4015569495 learned_addr learned my addr 172.21.15.41:0/4015569495 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f0073fff700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f0074140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00789ef700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00740b3a20 0x7f00740b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 -- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 msgr2=0x7f0074140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f0074140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 -- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00740b3a20 msgr2=0x7f00740b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00740b3a20 0x7f00740b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 -- 172.21.15.41:0/4015569495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009470 con 0x7f0074062f70 2021-10-21T00:10:43.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f0073fff700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f0074140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:43.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00737fe700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f0068001110 tx=0x7f0068007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00680070d0 con 0x7f0074062f70 2021-10-21T00:10:43.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068007230 con 0x7f0074062f70 2021-10-21T00:10:43.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00740b5ca0 con 0x7f0074062f70 2021-10-21T00:10:43.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0068005610 con 0x7f0074062f70 2021-10-21T00:10:43.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074142400 con 0x7f0074062f70 2021-10-21T00:10:43.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007413ebc0 con 0x7f0074062f70 2021-10-21T00:10:43.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.319+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0068010070 con 0x7f0074062f70 2021-10-21T00:10:43.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.323+0000 7f00717fa700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 0x7f0054055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.323+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f006806af80 con 0x7f0074062f70 2021-10-21T00:10:43.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.323+0000 7f0073fff700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 0x7f0054055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.323+0000 7f0073fff700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 0x7f0054055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f006400b000 tx=0x7f0064008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.327+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00680420e0 con 0x7f0074062f70 2021-10-21T00:10:43.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.455+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0074057350 con 0x7f0074062f70 2021-10-21T00:10:43.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00717fa700 1 -- 172.21.15.41:0/4015569495 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0068045700 con 0x7f0074062f70 2021-10-21T00:10:43.467 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:43.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 msgr2=0x7f0054055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 0x7f0054055a40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f006400b000 tx=0x7f0064008040).stop 2021-10-21T00:10:43.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 msgr2=0x7f007413fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f0068001110 tx=0x7f0068007aa0).stop 2021-10-21T00:10:43.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 shutdown_connections 2021-10-21T00:10:43.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0054053580 0x7f0054055a40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00740b3a20 0x7f00740b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0074062f70 0x7f007413fbd0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 --2- 172.21.15.41:0/4015569495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0074062330 0x7f0074140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 >> 172.21.15.41:0/4015569495 conn(0x7f00740b9080 msgr2=0x7f0074142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 shutdown_connections 2021-10-21T00:10:43.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.459+0000 7f00791f0700 1 -- 172.21.15.41:0/4015569495 wait complete. 2021-10-21T00:10:43.485 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:43.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 Processor -- start 2021-10-21T00:10:43.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 -- start start 2021-10-21T00:10:43.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f44900b2170 0x7f44900b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900b2550 con 0x7f44900ab600 2021-10-21T00:10:43.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900b1350 con 0x7f44900604f0 2021-10-21T00:10:43.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4497112700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44900aba40 con 0x7f44900b2170 2021-10-21T00:10:43.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f449590f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f44900ab600 0x7f449005fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33748/0 (socket says 172.21.15.41:33748) 2021-10-21T00:10:43.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f449590f700 1 -- 172.21.15.41:0/45941404 learned_addr learned my addr 172.21.15.41:0/45941404 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:43.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f4496110700 1 --2- 172.21.15.41:0/45941404 >> v2:172.21.15.62:3300/0 conn(0x7f44900b2170 0x7f44900b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718293083 0 0) 0x7f44900b2550 con 0x7f44900ab600 2021-10-21T00:10:43.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4478003260 con 0x7f44900ab600 2021-10-21T00:10:43.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.587+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3150267752 0 0) 0x7f4478003260 con 0x7f44900ab600 2021-10-21T00:10:43.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 >> v2:172.21.15.62:3300/0 conn(0x7f44900b2170 msgr2=0x7f44900b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:43.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 --2- 172.21.15.41:0/45941404 >> v2:172.21.15.62:3300/0 conn(0x7f44900b2170 0x7f44900b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 >> v1:172.21.15.62:6789/0 conn(0x7f44900604f0 legacy=0x7f4490141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449005f940 con 0x7f44900ab600 2021-10-21T00:10:43.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f4480001660 con 0x7f44900ab600 2021-10-21T00:10:43.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 >> v1:172.21.15.41:6789/0 conn(0x7f44900ab600 legacy=0x7f449005fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4478003750 0x7f4478003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 0x7f4478004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004e70 0x7f447800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900aba40 con 0x7f4478004500 2021-10-21T00:10:43.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447800bd20 con 0x7f4478004e70 2021-10-21T00:10:43.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447800bee0 con 0x7f4478003750 2021-10-21T00:10:43.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 0x7f4478004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4496110700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4478003750 0x7f4478003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4496911700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004e70 0x7f447800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 -- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4478003750 msgr2=0x7f4478003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:43.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4478003750 0x7f4478003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 -- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004e70 msgr2=0x7f447800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:43.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004e70 0x7f447800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4496911700 1 -- 172.21.15.41:0/45941404 reap_dead start 2021-10-21T00:10:43.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 -- 172.21.15.41:0/45941404 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478003260 con 0x7f4478004500 2021-10-21T00:10:43.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449590f700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 0x7f4478004980 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4480001370 tx=0x7f4480001e10).ready entity=mon.0 client_cookie=6ac073c256dfb378 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44800071a0 con 0x7f4478004500 2021-10-21T00:10:43.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480007300 con 0x7f4478004500 2021-10-21T00:10:43.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f449510e700 1 -- 172.21.15.41:0/45941404 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f448000c8f0 con 0x7f4478004500 2021-10-21T00:10:43.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 msgr2=0x7f4478004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 0x7f4478004980 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f4480001370 tx=0x7f4480001e10).stop 2021-10-21T00:10:43.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- 172.21.15.41:0/45941404 shutdown_connections 2021-10-21T00:10:43.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 --2- 172.21.15.41:0/45941404 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4478004500 0x7f4478004980 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- 172.21.15.41:0/45941404 >> 172.21.15.41:0/45941404 conn(0x7f44900b5700 msgr2=0x7f44900b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- 172.21.15.41:0/45941404 shutdown_connections 2021-10-21T00:10:43.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- 172.21.15.41:0/45941404 wait complete. 2021-10-21T00:10:43.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 Processor -- start 2021-10-21T00:10:43.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.591+0000 7f4497112700 1 -- start start 2021-10-21T00:10:43.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 0x7f44900ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44901441d0 0x7f449009a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 0x7f4490151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449009ac90 con 0x7f449009a810 2021-10-21T00:10:43.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490098450 con 0x7f4478004500 2021-10-21T00:10:43.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900986f0 con 0x7f44901441d0 2021-10-21T00:10:43.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 0x7f4490151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496110700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 0x7f44900ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496110700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 0x7f44900ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47908/0 (socket says 172.21.15.41:47908) 2021-10-21T00:10:43.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496110700 1 -- 172.21.15.41:0/1322649926 learned_addr learned my addr 172.21.15.41:0/1322649926 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:43.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f449590f700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44901441d0 0x7f449009a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 -- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44901441d0 msgr2=0x7f449009a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44901441d0 0x7f449009a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 -- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 msgr2=0x7f44900ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 0x7f44900ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 -- 172.21.15.41:0/1322649926 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490098e30 con 0x7f449009a810 2021-10-21T00:10:43.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4496911700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 0x7f4490151ba0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f4480001430 tx=0x7f4488009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44880032c0 con 0x7f449009a810 2021-10-21T00:10:43.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900adad0 con 0x7f449009a810 2021-10-21T00:10:43.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488003420 con 0x7f449009a810 2021-10-21T00:10:43.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4488006a80 con 0x7f449009a810 2021-10-21T00:10:43.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4490143e00 con 0x7f449009a810 2021-10-21T00:10:43.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.595+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4490098240 con 0x7f449009a810 2021-10-21T00:10:43.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.599+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f448801e070 con 0x7f449009a810 2021-10-21T00:10:43.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.599+0000 7f447f7fe700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 0x7f4470055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.599+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f448806b110 con 0x7f449009a810 2021-10-21T00:10:43.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.599+0000 7f4496110700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 0x7f4470055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.599+0000 7f4496110700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 0x7f4470055ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f448c00b000 tx=0x7f448c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.603+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4488042170 con 0x7f449009a810 2021-10-21T00:10:43.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.731+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4490057350 con 0x7f449009a810 2021-10-21T00:10:43.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.731+0000 7f447f7fe700 1 -- 172.21.15.41:0/1322649926 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4488045790 con 0x7f449009a810 2021-10-21T00:10:43.742 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:43.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 msgr2=0x7f4470055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 0x7f4470055ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f448c00b000 tx=0x7f448c008040).stop 2021-10-21T00:10:43.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 msgr2=0x7f4490151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 0x7f4490151ba0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f4480001430 tx=0x7f4488009040).stop 2021-10-21T00:10:43.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 shutdown_connections 2021-10-21T00:10:43.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4470053610 0x7f4470055ad0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f449009a810 0x7f4490151ba0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f44901441d0 0x7f449009a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 --2- 172.21.15.41:0/1322649926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4478004500 0x7f44900ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 >> 172.21.15.41:0/1322649926 conn(0x7f44900b5700 msgr2=0x7f44900ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 shutdown_connections 2021-10-21T00:10:43.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.735+0000 7f4497112700 1 -- 172.21.15.41:0/1322649926 wait complete. 2021-10-21T00:10:43.760 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:10:43.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 Processor -- start 2021-10-21T00:10:43.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 -- start start 2021-10-21T00:10:43.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 0x7f4bbc14d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc05cc80 con 0x7f4bbc0acd30 2021-10-21T00:10:43.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0ba000 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc143bc0 con 0x7f4bbc05c860 2021-10-21T00:10:43.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bba7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4bbc0acd30 0x7f4bbc0b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33770/0 (socket says 172.21.15.41:33770) 2021-10-21T00:10:43.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bba7fc700 1 -- 172.21.15.41:0/3915026664 learned_addr learned my addr 172.21.15.41:0/3915026664 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:43.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.863+0000 7f4bbb7fe700 1 --2- 172.21.15.41:0/3915026664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 0x7f4bbc14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bb9ffb700 1 -- 172.21.15.41:0/3915026664 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026636844 0 0) 0x7f4bbc05cc80 con 0x7f4bbc0acd30 2021-10-21T00:10:43.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bb9ffb700 1 -- 172.21.15.41:0/3915026664 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c003260 con 0x7f4bbc0acd30 2021-10-21T00:10:43.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3915026664 >> v1:172.21.15.62:6789/0 conn(0x7f4bbc0b9c20 legacy=0x7f4bbc1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3915026664 >> v1:172.21.15.41:6789/0 conn(0x7f4bbc0acd30 legacy=0x7f4bbc0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3915026664 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc142ad0 con 0x7f4bbc05c860 2021-10-21T00:10:43.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbb7fe700 1 --2- 172.21.15.41:0/3915026664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 0x7f4bbc14d550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f4bb40032f0 tx=0x7f4bb40091d0).ready entity=mon.2 client_cookie=ebd5ed882467055b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bb9ffb700 1 -- 172.21.15.41:0/3915026664 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb400b6c0 con 0x7f4bbc05c860 2021-10-21T00:10:43.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bb9ffb700 1 -- 172.21.15.41:0/3915026664 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400b820 con 0x7f4bbc05c860 2021-10-21T00:10:43.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bb9ffb700 1 -- 172.21.15.41:0/3915026664 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb400b990 con 0x7f4bbc05c860 2021-10-21T00:10:43.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3915026664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 msgr2=0x7f4bbc14d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3915026664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 0x7f4bbc14d550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f4bb40032f0 tx=0x7f4bb40091d0).stop 2021-10-21T00:10:43.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3915026664 shutdown_connections 2021-10-21T00:10:43.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3915026664 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc05c860 0x7f4bbc14d550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3915026664 >> 172.21.15.41:0/3915026664 conn(0x7f4bbc062f00 msgr2=0x7f4bbc0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:43.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3915026664 shutdown_connections 2021-10-21T00:10:43.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3915026664 wait complete. 2021-10-21T00:10:43.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 Processor -- start 2021-10-21T00:10:43.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.867+0000 7f4bbbfff700 1 -- start start 2021-10-21T00:10:43.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 0x7f4bbc0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc0acd30 0x7f4bbc1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc151d60 con 0x7f4bbc05c860 2021-10-21T00:10:43.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc155db0 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0b0600 con 0x7f4bbc0acd30 2021-10-21T00:10:43.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 0x7f4bbc0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bba7fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc0acd30 0x7f4bbc1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:47926/0 (socket says 172.21.15.41:47926) 2021-10-21T00:10:43.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 0x7f4bbc0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36004/0 (socket says 172.21.15.41:36004) 2021-10-21T00:10:43.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3384346495 learned_addr learned my addr 172.21.15.41:0/3384346495 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:43.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc0acd30 msgr2=0x7f4bbc1463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc0acd30 0x7f4bbc1463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3384346495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 msgr2=0x7f4bbc0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:43.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 0x7f4bbc0b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:43.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 -- 172.21.15.41:0/3384346495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4009470 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbb7fe700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4bbc0b3570 tx=0x7f4bb4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb400b990 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4021630 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc156050 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb400b6c0 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.871+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1468a0 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc0b0340 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4bb400f070 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bb3fff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 0x7f4ba00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:43.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4bb406cc60 con 0x7f4bbc0b9c20 2021-10-21T00:10:43.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bbaffd700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 0x7f4ba00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:43.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.875+0000 7f4bbaffd700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 0x7f4ba00559b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f4ba400d000 tx=0x7f4ba4007bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:43.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:43.883+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4bbc0b0340 con 0x7f4bbc0b9c20 2021-10-21T00:10:44.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.007+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bbc0b0340 con 0x7f4bbc0b9c20 2021-10-21T00:10:44.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.007+0000 7f4bb3fff700 1 -- 172.21.15.41:0/3384346495 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4bbc0b0340 con 0x7f4bbc0b9c20 2021-10-21T00:10:44.019 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:44.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 msgr2=0x7f4ba00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 0x7f4ba00559b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f4ba400d000 tx=0x7f4ba4007bc0).stop 2021-10-21T00:10:44.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 msgr2=0x7f4bbc13e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4bbc0b3570 tx=0x7f4bb4016000).stop 2021-10-21T00:10:44.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 shutdown_connections 2021-10-21T00:10:44.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ba00534f0 0x7f4ba00559b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bbc0b9c20 0x7f4bbc13e680 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bbc0acd30 0x7f4bbc1463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 --2- 172.21.15.41:0/3384346495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4bbc05c860 0x7f4bbc0b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 >> 172.21.15.41:0/3384346495 conn(0x7f4bbc062f00 msgr2=0x7f4bbc0b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:44.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 shutdown_connections 2021-10-21T00:10:44.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.011+0000 7f4bbbfff700 1 -- 172.21.15.41:0/3384346495 wait complete. 2021-10-21T00:10:44.037 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:10:44.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.135+0000 7f9842854700 1 Processor -- start 2021-10-21T00:10:44.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.135+0000 7f9842854700 1 -- start start 2021-10-21T00:10:44.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f983c05c6f0 0x7f983c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f983c0b0560 0x7f983c0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c05cad0 con 0x7f983c0b0ee0 2021-10-21T00:10:44.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0aece0 con 0x7f983c0b0560 2021-10-21T00:10:44.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0ae300 con 0x7f983c05c6f0 2021-10-21T00:10:44.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f983c0b0560 0x7f983c0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9840df1700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f983c0b0ee0 0x7f983c14a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33786/0 (socket says 172.21.15.41:33786) 2021-10-21T00:10:44.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9840df1700 1 -- 172.21.15.41:0/1632470158 learned_addr learned my addr 172.21.15.41:0/1632470158 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:44.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983bfff700 1 --2- 172.21.15.41:0/1632470158 >> v2:172.21.15.62:3300/0 conn(0x7f983c05c6f0 0x7f983c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 -- 172.21.15.41:0/1632470158 >> v2:172.21.15.62:3300/0 conn(0x7f983c05c6f0 msgr2=0x7f983c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:44.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 --2- 172.21.15.41:0/1632470158 >> v2:172.21.15.62:3300/0 conn(0x7f983c05c6f0 0x7f983c0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 -- 172.21.15.41:0/1632470158 >> v1:172.21.15.41:6789/0 conn(0x7f983c0b0ee0 legacy=0x7f983c14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 -- 172.21.15.41:0/1632470158 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0ae5a0 con 0x7f983c0b0560 2021-10-21T00:10:44.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983b7fe700 1 --2- 172.21.15.41:0/1632470158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c0b0560 0x7f983c0b09f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f982c002f70 tx=0x7f982c006df0).ready entity=mon.0 client_cookie=461f40a0c31c1e6b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983affd700 1 -- 172.21.15.41:0/1632470158 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982c00d5c0 con 0x7f983c0b0560 2021-10-21T00:10:44.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983affd700 1 -- 172.21.15.41:0/1632470158 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c000e90 con 0x7f983c0b0560 2021-10-21T00:10:44.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f983affd700 1 -- 172.21.15.41:0/1632470158 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982c00d910 con 0x7f983c0b0560 2021-10-21T00:10:44.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- 172.21.15.41:0/1632470158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c0b0560 msgr2=0x7f983c0b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 --2- 172.21.15.41:0/1632470158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c0b0560 0x7f983c0b09f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f982c002f70 tx=0x7f982c006df0).stop 2021-10-21T00:10:44.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- 172.21.15.41:0/1632470158 shutdown_connections 2021-10-21T00:10:44.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 --2- 172.21.15.41:0/1632470158 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c0b0560 0x7f983c0b09f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 --2- 172.21.15.41:0/1632470158 >> v2:172.21.15.62:3300/0 conn(0x7f983c05c6f0 0x7f983c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- 172.21.15.41:0/1632470158 >> 172.21.15.41:0/1632470158 conn(0x7f983c063210 msgr2=0x7f983c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:44.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- 172.21.15.41:0/1632470158 shutdown_connections 2021-10-21T00:10:44.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- 172.21.15.41:0/1632470158 wait complete. 2021-10-21T00:10:44.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 Processor -- start 2021-10-21T00:10:44.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.139+0000 7f9842854700 1 -- start start 2021-10-21T00:10:44.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 0x7f983c146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f983c0b0ee0 0x7f983c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c066dd0 con 0x7f983c05c6f0 2021-10-21T00:10:44.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15a510 con 0x7f983c0b0560 2021-10-21T00:10:44.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c14b290 con 0x7f983c0b0ee0 2021-10-21T00:10:44.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36018/0 (socket says 172.21.15.41:36018) 2021-10-21T00:10:44.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 -- 172.21.15.41:0/2476722058 learned_addr learned my addr 172.21.15.41:0/2476722058 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:44.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983b7fe700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 0x7f983c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9840df1700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f983c0b0ee0 0x7f983c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 -- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f983c0b0ee0 msgr2=0x7f983c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f983c0b0ee0 0x7f983c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 -- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 msgr2=0x7f983c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 0x7f983c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 -- 172.21.15.41:0/2476722058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c00b180 con 0x7f983c05c6f0 2021-10-21T00:10:44.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983b7fe700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 0x7f983c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:44.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f983bfff700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f98300030b0 tx=0x7f9830008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9830011780 con 0x7f983c05c6f0 2021-10-21T00:10:44.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98300118e0 con 0x7f983c05c6f0 2021-10-21T00:10:44.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9830011c40 con 0x7f983c05c6f0 2021-10-21T00:10:44.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c063b00 con 0x7f983c05c6f0 2021-10-21T00:10:44.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c063780 con 0x7f983c05c6f0 2021-10-21T00:10:44.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f983001c460 con 0x7f983c05c6f0 2021-10-21T00:10:44.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.143+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c063970 con 0x7f983c05c6f0 2021-10-21T00:10:44.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.147+0000 7f98397fa700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 0x7f981c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.147+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f983006bc10 con 0x7f983c05c6f0 2021-10-21T00:10:44.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.147+0000 7f983b7fe700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 0x7f981c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.147+0000 7f983b7fe700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 0x7f981c055b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f982c018000 tx=0x7f982c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.151+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9830042c70 con 0x7f983c05c6f0 2021-10-21T00:10:44.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.275+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f983c0ae840 con 0x7f983c05c6f0 2021-10-21T00:10:44.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f98397fa700 1 -- 172.21.15.41:0/2476722058 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9830046290 con 0x7f983c05c6f0 2021-10-21T00:10:44.288 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:44.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 msgr2=0x7f981c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 0x7f981c055b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f982c018000 tx=0x7f982c014000).stop 2021-10-21T00:10:44.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 msgr2=0x7f983c067200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f98300030b0 tx=0x7f9830008040).stop 2021-10-21T00:10:44.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 shutdown_connections 2021-10-21T00:10:44.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f981c0536d0 0x7f981c055b90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f983c0b0ee0 0x7f983c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f983c0b0560 0x7f983c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 --2- 172.21.15.41:0/2476722058 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f983c05c6f0 0x7f983c067200 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 >> 172.21.15.41:0/2476722058 conn(0x7f983c063210 msgr2=0x7f983c14d940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:44.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 shutdown_connections 2021-10-21T00:10:44.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.279+0000 7f9842854700 1 -- 172.21.15.41:0/2476722058 wait complete. 2021-10-21T00:10:44.300 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:10:44.301 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:44.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 Processor -- start 2021-10-21T00:10:44.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 -- start start 2021-10-21T00:10:44.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 0x7f40680ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680b0b50 con 0x7f40680b2170 2021-10-21T00:10:44.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680b2550 con 0x7f4068067a80 2021-10-21T00:10:44.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.395+0000 7f406c881700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680b0d90 con 0x7f40680af620 2021-10-21T00:10:44.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40677fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f40680b2170 0x7f40680ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33796/0 (socket says 172.21.15.41:33796) 2021-10-21T00:10:44.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40677fe700 1 -- 172.21.15.41:0/989337775 learned_addr learned my addr 172.21.15.41:0/989337775 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:44.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f4066ffd700 1 --2- 172.21.15.41:0/989337775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 0x7f40680ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126240474 0 0) 0x7f405c001110 con 0x7f40680b2170 2021-10-21T00:10:44.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4054003260 con 0x7f40680b2170 2021-10-21T00:10:44.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759045317 0 0) 0x7f40680b2550 con 0x7f4068067a80 2021-10-21T00:10:44.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c001110 con 0x7f4068067a80 2021-10-21T00:10:44.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f4066ffd700 1 -- 172.21.15.41:0/989337775 >> v1:172.21.15.62:6789/0 conn(0x7f4068067a80 legacy=0x7f4068149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f4066ffd700 1 -- 172.21.15.41:0/989337775 >> v1:172.21.15.41:6789/0 conn(0x7f40680b2170 legacy=0x7f40680ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f4066ffd700 1 -- 172.21.15.41:0/989337775 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680b1030 con 0x7f40680af620 2021-10-21T00:10:44.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f4066ffd700 1 --2- 172.21.15.41:0/989337775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 0x7f40680ab880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f4058002f70 tx=0x7f4058006df0).ready entity=mon.2 client_cookie=681fc366da2da22d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f405800d5c0 con 0x7f40680af620 2021-10-21T00:10:44.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4058000e90 con 0x7f40680af620 2021-10-21T00:10:44.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f40667fc700 1 -- 172.21.15.41:0/989337775 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f405800d910 con 0x7f40680af620 2021-10-21T00:10:44.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 -- 172.21.15.41:0/989337775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 msgr2=0x7f40680ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 --2- 172.21.15.41:0/989337775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 0x7f40680ab880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f4058002f70 tx=0x7f4058006df0).stop 2021-10-21T00:10:44.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 -- 172.21.15.41:0/989337775 shutdown_connections 2021-10-21T00:10:44.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 --2- 172.21.15.41:0/989337775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40680af620 0x7f40680ab880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 -- 172.21.15.41:0/989337775 >> 172.21.15.41:0/989337775 conn(0x7f40680b5700 msgr2=0x7f40680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:44.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 -- 172.21.15.41:0/989337775 shutdown_connections 2021-10-21T00:10:44.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 -- 172.21.15.41:0/989337775 wait complete. 2021-10-21T00:10:44.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.399+0000 7f406c881700 1 Processor -- start 2021-10-21T00:10:44.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- start start 2021-10-21T00:10:44.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4068067a80 0x7f40680b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40680af620 0x7f4068147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068066a70 con 0x7f40680b2170 2021-10-21T00:10:44.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680672a0 con 0x7f40680af620 2021-10-21T00:10:44.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4068067000 con 0x7f4068067a80 2021-10-21T00:10:44.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4066ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40680af620 0x7f4068147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36036/0 (socket says 172.21.15.41:36036) 2021-10-21T00:10:44.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f40677fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4068067a80 0x7f40680b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 -- 172.21.15.41:0/1417592136 learned_addr learned my addr 172.21.15.41:0/1417592136 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:44.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 -- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4068067a80 msgr2=0x7f40680b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4068067a80 0x7f40680b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 -- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40680af620 msgr2=0x7f4068147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40680af620 0x7f4068147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 -- 172.21.15.41:0/1417592136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405800b180 con 0x7f40680b2170 2021-10-21T00:10:44.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4067fff700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f4060001490 tx=0x7f4060007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4060002240 con 0x7f40680b2170 2021-10-21T00:10:44.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600023a0 con 0x7f40680b2170 2021-10-21T00:10:44.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406814c770 con 0x7f40680b2170 2021-10-21T00:10:44.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40600017a0 con 0x7f40680b2170 2021-10-21T00:10:44.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40680aef60 con 0x7f40680b2170 2021-10-21T00:10:44.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.403+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40680b12d0 con 0x7f40680b2170 2021-10-21T00:10:44.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.407+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4060010030 con 0x7f40680b2170 2021-10-21T00:10:44.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.407+0000 7f4064ff9700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 0x7f4048055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:44.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.407+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f406006b800 con 0x7f40680b2170 2021-10-21T00:10:44.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.407+0000 7f40677fe700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 0x7f4048055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:44.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.407+0000 7f40677fe700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 0x7f4048055b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f405c00d000 tx=0x7f405c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:44.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.415+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4060042850 con 0x7f40680b2170 2021-10-21T00:10:44.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.579+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4068066bb0 con 0x7f40680b2170 2021-10-21T00:10:44.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f4064ff9700 1 -- 172.21.15.41:0/1417592136 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f4060045e70 con 0x7f40680b2170 2021-10-21T00:10:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:44.593 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:40.726692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/576603081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":576603081},{"type":"v1","addr":"172.21.15.62:6835","nonce":576603081}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:44.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 msgr2=0x7f4048055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 0x7f4048055b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f405c00d000 tx=0x7f405c009040).stop 2021-10-21T00:10:44.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 msgr2=0x7f40681477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:44.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f4060001490 tx=0x7f4060007da0).stop 2021-10-21T00:10:44.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 shutdown_connections 2021-10-21T00:10:44.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4048053640 0x7f4048055b00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40680b2170 0x7f40681477f0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40680af620 0x7f4068147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 --2- 172.21.15.41:0/1417592136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4068067a80 0x7f40680b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:44.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 >> 172.21.15.41:0/1417592136 conn(0x7f40680b5700 msgr2=0x7f406805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:44.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 shutdown_connections 2021-10-21T00:10:44.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:44.583+0000 7f406c881700 1 -- 172.21.15.41:0/1417592136 wait complete. 2021-10-21T00:10:44.600 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 51 2021-10-21T00:10:44.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:39.722912+0000', 'modified': '2021-10-21T00:10:40.726692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7350': {'gid': 7350, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/576603081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 576603081}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 576603081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:44.807 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:44.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:10:44.925 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7350,"want_state":"up:active","state":"up:active","rank_uptime":5.1853185789999996,"mdsmap_epoch":51,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":9.9169403020000004} 2021-10-21T00:10:44.926 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7350, "mdsmap_epoch": 51, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 5.185318579, "state": "up:active", "uptime": 9.916940302, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:44.926 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:10:44.926 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:10:44.927 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:10:44.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:44.928 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:44.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:10:44.954 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:44.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:45.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:45.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.015 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:10:45.022 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:10:45.022 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:45.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:10:45.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:45.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:45.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:10:45.092+0000 7fe71ea0f080 -1 init, newargv = 0x55ecac2fc9d0 newargc=9 2021-10-21T00:10:45.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14819]: starting ceph client 2021-10-21T00:10:45.099 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:45.100 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:45.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.102 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:10:45.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14819]: starting fuse 2021-10-21T00:10:45.108 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:10:45.108 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:10:45.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:10:45.110 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:10:45.110 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:10:45.111 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:10:45.111 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:10:45.112 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:45.112 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:10:45.112 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:10:45.113 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:10:45.114 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:45.114 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:10:45.115 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:10:45.115 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:10:45.115 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:10:45.116 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:45.116 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:10:45.117 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:10:45.117 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:10:45.118 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:10:45.118 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:10:45.119 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:10:45.119 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:10:45.120 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:10:45.190 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14819.asok 2021-10-21T00:10:45.194 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14819.asok 2021-10-21T00:10:45.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14819.asok status 2021-10-21T00:10:45.284 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:10:45.284 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:10:45.284 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:10:45.285 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:10:45.285 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:10:45.285 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:10:45.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:10:45.286 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14819", 2021-10-21T00:10:45.286 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:10:45.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:45.286 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:10:45.287 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:10:45.287 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7357, 2021-10-21T00:10:45.287 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:10:45.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:10:45.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:10:45.288 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 7357 2021-10-21T00:10:45.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:45.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:10:45.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:10:45.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:10:45.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3836637855 2021-10-21T00:10:45.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:10:45.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:45.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:10:45.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:10:45.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:10:45.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3836637855 2021-10-21T00:10:45.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:10:45.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.7357 172.21.15.71:0/3836637855", 2021-10-21T00:10:45.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/3836637855", 2021-10-21T00:10:45.294 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:10:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 51, 2021-10-21T00:10:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 98, 2021-10-21T00:10:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:10:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:10:45.295 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:10:45.296 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:10:45.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.298 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:45.298 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:45.305 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:10:45.307 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:45.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:45.308 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:45.368 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:10:45.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 Processor -- start 2021-10-21T00:10:45.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- start start 2021-10-21T00:10:45.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda5c05f9f0 0x7fda5c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c0aa750 0x7fda5c14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda5c14b130 0x7fda5c1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0b1620 con 0x7fda5c05f9f0 2021-10-21T00:10:45.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0609d0 con 0x7fda5c14b130 2021-10-21T00:10:45.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c05fdd0 con 0x7fda5c0aa750 2021-10-21T00:10:45.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda5c05f9f0 0x7fda5c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fda5c05f9f0 0x7fda5c14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36040/0 (socket says 172.21.15.41:36040) 2021-10-21T00:10:45.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 -- 172.21.15.41:0/1558423773 learned_addr learned my addr 172.21.15.41:0/1558423773 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:45.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5affd700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c0aa750 0x7fda5c14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5bfff700 1 --2- 172.21.15.41:0/1558423773 >> v2:172.21.15.62:3300/0 conn(0x7fda5c14b130 0x7fda5c1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 -- 172.21.15.41:0/1558423773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c0aa750 msgr2=0x7fda5c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:45.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c0aa750 0x7fda5c14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 -- 172.21.15.41:0/1558423773 >> v2:172.21.15.62:3300/0 conn(0x7fda5c14b130 msgr2=0x7fda5c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:45.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/1558423773 >> v2:172.21.15.62:3300/0 conn(0x7fda5c14b130 0x7fda5c1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 -- 172.21.15.41:0/1558423773 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0b1380 con 0x7fda5c05f9f0 2021-10-21T00:10:45.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c05f9f0 0x7fda5c14a750 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fda44002f70 tx=0x7fda44006eb0).ready entity=mon.0 client_cookie=2a9f5ee65fa21126 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5a7fc700 1 -- 172.21.15.41:0/1558423773 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4400d570 con 0x7fda5c05f9f0 2021-10-21T00:10:45.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5a7fc700 1 -- 172.21.15.41:0/1558423773 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44000e90 con 0x7fda5c05f9f0 2021-10-21T00:10:45.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda5a7fc700 1 -- 172.21.15.41:0/1558423773 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4400d900 con 0x7fda5c05f9f0 2021-10-21T00:10:45.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- 172.21.15.41:0/1558423773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c05f9f0 msgr2=0x7fda5c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c05f9f0 0x7fda5c14a750 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7fda44002f70 tx=0x7fda44006eb0).stop 2021-10-21T00:10:45.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- 172.21.15.41:0/1558423773 shutdown_connections 2021-10-21T00:10:45.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- 172.21.15.41:0/1558423773 >> v2:172.21.15.62:3300/0 conn(0x7fda5c14b130 0x7fda5c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c0aa750 0x7fda5c14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 --2- 172.21.15.41:0/1558423773 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c05f9f0 0x7fda5c14a750 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- 172.21.15.41:0/1558423773 >> 172.21.15.41:0/1558423773 conn(0x7fda5c05bca0 msgr2=0x7fda5c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:45.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- 172.21.15.41:0/1558423773 shutdown_connections 2021-10-21T00:10:45.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.471+0000 7fda620d1700 1 -- 172.21.15.41:0/1558423773 wait complete. 2021-10-21T00:10:45.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 Processor -- start 2021-10-21T00:10:45.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 -- start start 2021-10-21T00:10:45.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 0x7fda5c062b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 0x7fda5c064290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0ae510 con 0x7fda5c0aa750 2021-10-21T00:10:45.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0af140 con 0x7fda5c05f9f0 2021-10-21T00:10:45.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0ae760 con 0x7fda5c14b130 2021-10-21T00:10:45.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36048/0 (socket says 172.21.15.41:36048) 2021-10-21T00:10:45.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 -- 172.21.15.41:0/2280748084 learned_addr learned my addr 172.21.15.41:0/2280748084 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:45.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 0x7fda5c062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5bfff700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 0x7fda5c064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 -- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 msgr2=0x7fda5c064290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 0x7fda5c064290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 -- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 msgr2=0x7fda5c062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 0x7fda5c062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 -- 172.21.15.41:0/2280748084 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4400b1e0 con 0x7fda5c0aa750 2021-10-21T00:10:45.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 0x7fda5c062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:45.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5bfff700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 0x7fda5c064290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:45.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda5affd700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fda54006e00 tx=0x7fda540091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5400c850 con 0x7fda5c0aa750 2021-10-21T00:10:45.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400c9b0 con 0x7fda5c0aa750 2021-10-21T00:10:45.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5400cd10 con 0x7fda5c0aa750 2021-10-21T00:10:45.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.475+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0aea00 con 0x7fda5c0aa750 2021-10-21T00:10:45.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c146870 con 0x7fda5c0aa750 2021-10-21T00:10:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c14b550 con 0x7fda5c0aa750 2021-10-21T00:10:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda54022070 con 0x7fda5c0aa750 2021-10-21T00:10:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda58ff9700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 0x7fda34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda5406c240 con 0x7fda5c0aa750 2021-10-21T00:10:45.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 0x7fda34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.479+0000 7fda5b7fe700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 0x7fda34055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fda4401a000 tx=0x7fda44015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.487+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda54043290 con 0x7fda5c0aa750 2021-10-21T00:10:45.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.615+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda5c057350 con 0x7fda5c0aa750 2021-10-21T00:10:45.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.615+0000 7fda58ff9700 1 -- 172.21.15.41:0/2280748084 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fda54016020 con 0x7fda5c0aa750 2021-10-21T00:10:45.627 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:45.627 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":98,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:10:40.725582+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:10:37.769852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-10-21T00:10:38.737124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:10:45.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 msgr2=0x7fda34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 0x7fda34055ad0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fda4401a000 tx=0x7fda44015000).stop 2021-10-21T00:10:45.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 msgr2=0x7fda5c14ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fda54006e00 tx=0x7fda540091d0).stop 2021-10-21T00:10:45.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 shutdown_connections 2021-10-21T00:10:45.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fda34053610 0x7fda34055ad0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda5c14b130 0x7fda5c064290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fda5c0aa750 0x7fda5c14ceb0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 --2- 172.21.15.41:0/2280748084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda5c05f9f0 0x7fda5c062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 >> 172.21.15.41:0/2280748084 conn(0x7fda5c05bca0 msgr2=0x7fda5c0b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:45.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 shutdown_connections 2021-10-21T00:10:45.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.619+0000 7fda620d1700 1 -- 172.21.15.41:0/2280748084 wait complete. 2021-10-21T00:10:45.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:10:37.769852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:10:38.737124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:10:45.646 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:10:45.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.747+0000 7fbb498c3700 1 Processor -- start 2021-10-21T00:10:45.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.747+0000 7fbb498c3700 1 -- start start 2021-10-21T00:10:45.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb4405bfe0 0x7fbb441461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44067a00 0x7fbb441466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbb44146ba0 0x7fbb4405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440b1920 con 0x7fbb44146ba0 2021-10-21T00:10:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4405c3c0 con 0x7fbb4405bfe0 2021-10-21T00:10:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440b27a0 con 0x7fbb44067a00 2021-10-21T00:10:45.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbb44146ba0 0x7fbb4405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbb44146ba0 0x7fbb4405f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36058/0 (socket says 172.21.15.41:36058) 2021-10-21T00:10:45.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 -- 172.21.15.41:0/63204688 learned_addr learned my addr 172.21.15.41:0/63204688 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:45.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb488c1700 1 --2- 172.21.15.41:0/63204688 >> v2:172.21.15.62:3300/0 conn(0x7fbb4405bfe0 0x7fbb441461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb43fff700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44067a00 0x7fbb441466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 -- 172.21.15.41:0/63204688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44067a00 msgr2=0x7fbb441466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:45.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44067a00 0x7fbb441466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 -- 172.21.15.41:0/63204688 >> v2:172.21.15.62:3300/0 conn(0x7fbb4405bfe0 msgr2=0x7fbb441461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 --2- 172.21.15.41:0/63204688 >> v2:172.21.15.62:3300/0 conn(0x7fbb4405bfe0 0x7fbb441461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 -- 172.21.15.41:0/63204688 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440b2a40 con 0x7fbb44146ba0 2021-10-21T00:10:45.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb490c2700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44146ba0 0x7fbb4405f6b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fbb3c0032f0 tx=0x7fbb3c009290).ready entity=mon.0 client_cookie=4fe6dd7fbc159de9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb437fe700 1 -- 172.21.15.41:0/63204688 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3c00b870 con 0x7fbb44146ba0 2021-10-21T00:10:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb437fe700 1 -- 172.21.15.41:0/63204688 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00b9d0 con 0x7fbb44146ba0 2021-10-21T00:10:45.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb437fe700 1 -- 172.21.15.41:0/63204688 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3c00bb40 con 0x7fbb44146ba0 2021-10-21T00:10:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 -- 172.21.15.41:0/63204688 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44146ba0 msgr2=0x7fbb4405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44146ba0 0x7fbb4405f6b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fbb3c0032f0 tx=0x7fbb3c009290).stop 2021-10-21T00:10:45.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 -- 172.21.15.41:0/63204688 shutdown_connections 2021-10-21T00:10:45.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44146ba0 0x7fbb4405f6b0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- 172.21.15.41:0/63204688 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44067a00 0x7fbb441466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.751+0000 7fbb498c3700 1 --2- 172.21.15.41:0/63204688 >> v2:172.21.15.62:3300/0 conn(0x7fbb4405bfe0 0x7fbb441461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- 172.21.15.41:0/63204688 >> 172.21.15.41:0/63204688 conn(0x7fbb440637b0 msgr2=0x7fbb44063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:45.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- 172.21.15.41:0/63204688 shutdown_connections 2021-10-21T00:10:45.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- 172.21.15.41:0/63204688 wait complete. 2021-10-21T00:10:45.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 Processor -- start 2021-10-21T00:10:45.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- start start 2021-10-21T00:10:45.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4405bfe0 0x7fbb44140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 0x7fbb440b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440b3c60 con 0x7fbb44067a00 2021-10-21T00:10:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440b50a0 con 0x7fbb4405bfe0 2021-10-21T00:10:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb498c3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440b4e00 con 0x7fbb44146ba0 2021-10-21T00:10:45.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36062/0 (socket says 172.21.15.41:36062) 2021-10-21T00:10:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 -- 172.21.15.41:0/1803947805 learned_addr learned my addr 172.21.15.41:0/1803947805 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb488c1700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4405bfe0 0x7fbb44140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb490c2700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 0x7fbb440b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 -- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 msgr2=0x7fbb440b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 0x7fbb440b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 -- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4405bfe0 msgr2=0x7fbb44140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4405bfe0 0x7fbb44140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb43fff700 1 -- 172.21.15.41:0/1803947805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009530 con 0x7fbb44067a00 2021-10-21T00:10:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.755+0000 7fbb490c2700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 0x7fbb440b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb43fff700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fbb2c00a000 tx=0x7fbb2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c011780 con 0x7fbb44067a00 2021-10-21T00:10:45.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0118e0 con 0x7fbb44067a00 2021-10-21T00:10:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2c011c40 con 0x7fbb44067a00 2021-10-21T00:10:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb440aee90 con 0x7fbb44067a00 2021-10-21T00:10:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb440ad460 con 0x7fbb44067a00 2021-10-21T00:10:45.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb440ae050 con 0x7fbb44067a00 2021-10-21T00:10:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb2c006030 con 0x7fbb44067a00 2021-10-21T00:10:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 0x7fbb28055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.759+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb2c06b8d0 con 0x7fbb44067a00 2021-10-21T00:10:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.763+0000 7fbb488c1700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 0x7fbb28055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:45.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.763+0000 7fbb488c1700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 0x7fbb28055ad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbb3400c000 tx=0x7fbb34008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:45.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.771+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb440ae050 con 0x7fbb44067a00 2021-10-21T00:10:45.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.907+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbb440ae050 con 0x7fbb44067a00 2021-10-21T00:10:45.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.907+0000 7fbb41ffb700 1 -- 172.21.15.41:0/1803947805 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb440ae050 con 0x7fbb44067a00 2021-10-21T00:10:45.917 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:10:45.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 msgr2=0x7fbb28055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 0x7fbb28055ad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fbb3400c000 tx=0x7fbb34008040).stop 2021-10-21T00:10:45.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 msgr2=0x7fbb44151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:45.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fbb2c00a000 tx=0x7fbb2c008040).stop 2021-10-21T00:10:45.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 shutdown_connections 2021-10-21T00:10:45.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbb28053610 0x7fbb28055ad0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb44146ba0 0x7fbb440b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbb44067a00 0x7fbb44151a90 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 --2- 172.21.15.41:0/1803947805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4405bfe0 0x7fbb44140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:45.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 >> 172.21.15.41:0/1803947805 conn(0x7fbb440637b0 msgr2=0x7fbb44146430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:45.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 shutdown_connections 2021-10-21T00:10:45.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:45.911+0000 7fbb498c3700 1 -- 172.21.15.41:0/1803947805 wait complete. 2021-10-21T00:10:45.931 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:10:46.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.035+0000 7ff713fff700 1 Processor -- start 2021-10-21T00:10:46.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.035+0000 7ff713fff700 1 -- start start 2021-10-21T00:10:46.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 0x7ff7140b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff71405f6b0 0x7ff71413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff714144400 con 0x7ff7140af720 2021-10-21T00:10:46.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140afb00 con 0x7ff71405f6b0 2021-10-21T00:10:46.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140afdf0 con 0x7ff7140b2370 2021-10-21T00:10:46.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff71405f6b0 0x7ff71413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff712ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff7140af720 0x7ff714143cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33838/0 (socket says 172.21.15.41:33838) 2021-10-21T00:10:46.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff712ffd700 1 -- 172.21.15.41:0/2283941194 learned_addr learned my addr 172.21.15.41:0/2283941194 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:46.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff70bfff700 1 --2- 172.21.15.41:0/2283941194 >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 0x7ff7140b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 -- 172.21.15.41:0/2283941194 >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 msgr2=0x7ff7140b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 --2- 172.21.15.41:0/2283941194 >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 0x7ff7140b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 -- 172.21.15.41:0/2283941194 >> v1:172.21.15.41:6789/0 conn(0x7ff7140af720 legacy=0x7ff714143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7127fc700 1 -- 172.21.15.41:0/2283941194 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805029193 0 0) 0x7ff714144400 con 0x7ff7140af720 2021-10-21T00:10:46.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 -- 172.21.15.41:0/2283941194 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140b0090 con 0x7ff71405f6b0 2021-10-21T00:10:46.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff70bfff700 1 --2- 172.21.15.41:0/2283941194 >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 0x7ff7140b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:46.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7137fe700 1 --2- 172.21.15.41:0/2283941194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413d6c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7ff70c0032f0 tx=0x7ff70c0091d0).ready entity=mon.0 client_cookie=f1107032982e0f81 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7127fc700 1 -- 172.21.15.41:0/2283941194 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff70c009ea0 con 0x7ff71405f6b0 2021-10-21T00:10:46.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7127fc700 1 -- 172.21.15.41:0/2283941194 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00b870 con 0x7ff71405f6b0 2021-10-21T00:10:46.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff7127fc700 1 -- 172.21.15.41:0/2283941194 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff70c00b9e0 con 0x7ff71405f6b0 2021-10-21T00:10:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- 172.21.15.41:0/2283941194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 msgr2=0x7ff71413d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 --2- 172.21.15.41:0/2283941194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413d6c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7ff70c0032f0 tx=0x7ff70c0091d0).stop 2021-10-21T00:10:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- 172.21.15.41:0/2283941194 shutdown_connections 2021-10-21T00:10:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 --2- 172.21.15.41:0/2283941194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413d6c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 --2- 172.21.15.41:0/2283941194 >> v2:172.21.15.62:3300/0 conn(0x7ff7140b2370 0x7ff7140b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- 172.21.15.41:0/2283941194 >> 172.21.15.41:0/2283941194 conn(0x7ff7140637b0 msgr2=0x7ff714063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- 172.21.15.41:0/2283941194 shutdown_connections 2021-10-21T00:10:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.039+0000 7ff713fff700 1 -- 172.21.15.41:0/2283941194 wait complete. 2021-10-21T00:10:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 Processor -- start 2021-10-21T00:10:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 -- start start 2021-10-21T00:10:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 0x7ff714065300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 0x7ff714065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff714064a80 con 0x7ff71405f6b0 2021-10-21T00:10:46.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140647e0 con 0x7ff7140af720 2021-10-21T00:10:46.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff713fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff714066310 con 0x7ff7140b2370 2021-10-21T00:10:46.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36074/0 (socket says 172.21.15.41:36074) 2021-10-21T00:10:46.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 -- 172.21.15.41:0/1598710526 learned_addr learned my addr 172.21.15.41:0/1598710526 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:46.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff7137fe700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 0x7ff714065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff70bfff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 0x7ff714065300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 -- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 msgr2=0x7ff714065bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 0x7ff714065bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 -- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 msgr2=0x7ff714065300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 0x7ff714065300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff712ffd700 1 -- 172.21.15.41:0/1598710526 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009470 con 0x7ff71405f6b0 2021-10-21T00:10:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff7137fe700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 0x7ff714065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.043+0000 7ff70bfff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 0x7ff714065300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff712ffd700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7ff704000bc0 tx=0x7ff7040079c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7040070d0 con 0x7ff71405f6b0 2021-10-21T00:10:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff704007230 con 0x7ff71405f6b0 2021-10-21T00:10:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff714142b40 con 0x7ff71405f6b0 2021-10-21T00:10:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff704005610 con 0x7ff71405f6b0 2021-10-21T00:10:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff714146510 con 0x7ff71405f6b0 2021-10-21T00:10:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff70401a060 con 0x7ff71405f6b0 2021-10-21T00:10:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff714142ea0 con 0x7ff71405f6b0 2021-10-21T00:10:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 0x7ff6f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff70406b0f0 con 0x7ff71405f6b0 2021-10-21T00:10:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff70bfff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 0x7ff6f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.047+0000 7ff70bfff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 0x7ff6f8055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff6fc00c000 tx=0x7ff6fc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.055+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff704042250 con 0x7ff71405f6b0 2021-10-21T00:10:46.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.183+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7140b2bc0 con 0x7ff71405f6b0 2021-10-21T00:10:46.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.183+0000 7ff710ff9700 1 -- 172.21.15.41:0/1598710526 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff704018070 con 0x7ff71405f6b0 2021-10-21T00:10:46.194 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:46.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 msgr2=0x7ff6f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 0x7ff6f8055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff6fc00c000 tx=0x7ff6fc008040).stop 2021-10-21T00:10:46.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 msgr2=0x7ff71413fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7ff704000bc0 tx=0x7ff7040079c0).stop 2021-10-21T00:10:46.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 shutdown_connections 2021-10-21T00:10:46.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff6f80536a0 0x7ff6f8055b60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7140b2370 0x7ff714065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7140af720 0x7ff714065300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 --2- 172.21.15.41:0/1598710526 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff71405f6b0 0x7ff71413fe60 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 >> 172.21.15.41:0/1598710526 conn(0x7ff7140637b0 msgr2=0x7ff7140b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 shutdown_connections 2021-10-21T00:10:46.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.187+0000 7ff713fff700 1 -- 172.21.15.41:0/1598710526 wait complete. 2021-10-21T00:10:46.208 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:10:46.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 Processor -- start 2021-10-21T00:10:46.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- start start 2021-10-21T00:10:46.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6180b9c20 0x7fd6180acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd6180b41a0 0x7fd618141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6180ba000 con 0x7fd61805c860 2021-10-21T00:10:46.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd618143bc0 con 0x7fd6180b41a0 2021-10-21T00:10:46.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61805ccc0 con 0x7fd6180b9c20 2021-10-21T00:10:46.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61cf1e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd61805c860 0x7fd6181434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33852/0 (socket says 172.21.15.41:33852) 2021-10-21T00:10:46.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd6180b41a0 0x7fd618141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61cf1e700 1 -- 172.21.15.41:0/160073160 learned_addr learned my addr 172.21.15.41:0/160073160 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:46.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61d71f700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6180b9c20 0x7fd6180acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 -- 172.21.15.41:0/160073160 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6180b9c20 msgr2=0x7fd6180acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6180b9c20 0x7fd6180acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 -- 172.21.15.41:0/160073160 >> v1:172.21.15.41:6789/0 conn(0x7fd61805c860 legacy=0x7fd6181434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 -- 172.21.15.41:0/160073160 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618142ad0 con 0x7fd6180b41a0 2021-10-21T00:10:46.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61df20700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618141910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7fd61805ce00 tx=0x7fd614006df0).ready entity=mon.0 client_cookie=bced2856f834fd21 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd60bfff700 1 -- 172.21.15.41:0/160073160 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61400d570 con 0x7fd6180b41a0 2021-10-21T00:10:46.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd60bfff700 1 -- 172.21.15.41:0/160073160 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd614000e90 con 0x7fd6180b41a0 2021-10-21T00:10:46.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd60bfff700 1 -- 172.21.15.41:0/160073160 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61400d8c0 con 0x7fd6180b41a0 2021-10-21T00:10:46.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- 172.21.15.41:0/160073160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 msgr2=0x7fd618141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618141910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7fd61805ce00 tx=0x7fd614006df0).stop 2021-10-21T00:10:46.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- 172.21.15.41:0/160073160 shutdown_connections 2021-10-21T00:10:46.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618141910 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 --2- 172.21.15.41:0/160073160 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6180b9c20 0x7fd6180acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.311+0000 7fd61e721700 1 -- 172.21.15.41:0/160073160 >> 172.21.15.41:0/160073160 conn(0x7fd618062f00 msgr2=0x7fd6180b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- 172.21.15.41:0/160073160 shutdown_connections 2021-10-21T00:10:46.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- 172.21.15.41:0/160073160 wait complete. 2021-10-21T00:10:46.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 Processor -- start 2021-10-21T00:10:46.330 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- start start 2021-10-21T00:10:46.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd61805c860 0x7fd618145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6180b9c20 0x7fd61813d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180aefd0 con 0x7fd6180b41a0 2021-10-21T00:10:46.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618151a90 con 0x7fd6180b9c20 2021-10-21T00:10:46.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180b2da0 con 0x7fd61805c860 2021-10-21T00:10:46.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36090/0 (socket says 172.21.15.41:36090) 2021-10-21T00:10:46.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 -- 172.21.15.41:0/4039356155 learned_addr learned my addr 172.21.15.41:0/4039356155 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:46.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61d71f700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd61805c860 0x7fd618145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61df20700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6180b9c20 0x7fd61813d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 -- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd61805c860 msgr2=0x7fd618145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd61805c860 0x7fd618145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 -- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6180b9c20 msgr2=0x7fd61813d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6180b9c20 0x7fd61813d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 -- 172.21.15.41:0/4039356155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61400b180 con 0x7fd6180b41a0 2021-10-21T00:10:46.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61cf1e700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd618151bd0 tx=0x7fd60c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60c0070d0 con 0x7fd6180b41a0 2021-10-21T00:10:46.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c007230 con 0x7fd6180b41a0 2021-10-21T00:10:46.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6180b2fd0 con 0x7fd6180b41a0 2021-10-21T00:10:46.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60c005610 con 0x7fd6180b41a0 2021-10-21T00:10:46.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.315+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd618146320 con 0x7fd6180b41a0 2021-10-21T00:10:46.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd60c010070 con 0x7fd6180b41a0 2021-10-21T00:10:46.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618142d70 con 0x7fd6180b41a0 2021-10-21T00:10:46.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd60a7fc700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 0x7fd5f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd60c06ae10 con 0x7fd6180b41a0 2021-10-21T00:10:46.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd61d71f700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 0x7fd5f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.319+0000 7fd61d71f700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 0x7fd5f8055ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd61000c000 tx=0x7fd610008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.323+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd60c045e60 con 0x7fd6180b41a0 2021-10-21T00:10:46.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd618057350 con 0x7fd6180b41a0 2021-10-21T00:10:46.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd60a7fc700 1 -- 172.21.15.41:0/4039356155 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd60c045e60 con 0x7fd6180b41a0 2021-10-21T00:10:46.461 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:46.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 msgr2=0x7fd5f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 0x7fd5f8055ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd61000c000 tx=0x7fd610008040).stop 2021-10-21T00:10:46.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 msgr2=0x7fd618148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7fd618151bd0 tx=0x7fd60c007c40).stop 2021-10-21T00:10:46.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 shutdown_connections 2021-10-21T00:10:46.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5f8053610 0x7fd5f8055ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6180b9c20 0x7fd61813d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd6180b41a0 0x7fd618148330 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 --2- 172.21.15.41:0/4039356155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd61805c860 0x7fd618145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 >> 172.21.15.41:0/4039356155 conn(0x7fd618062f00 msgr2=0x7fd618147820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 shutdown_connections 2021-10-21T00:10:46.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.451+0000 7fd61e721700 1 -- 172.21.15.41:0/4039356155 wait complete. 2021-10-21T00:10:46.473 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:10:46.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 Processor -- start 2021-10-21T00:10:46.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 -- start start 2021-10-21T00:10:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7418142520 0x7f741805c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7418145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180b6350 con 0x7f74180b5f70 2021-10-21T00:10:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7418067d00 con 0x7f7418142520 2021-10-21T00:10:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741e94b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741805cee0 con 0x7f74180b1a50 2021-10-21T00:10:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741d949700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f74180b5f70 0x7f7418141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33866/0 (socket says 172.21.15.41:33866) 2021-10-21T00:10:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.575+0000 7f741d949700 1 -- 172.21.15.41:0/1734795751 learned_addr learned my addr 172.21.15.41:0/1734795751 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:46.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741d148700 1 --2- 172.21.15.41:0/1734795751 >> v2:172.21.15.62:3300/0 conn(0x7f7418142520 0x7f741805c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7418145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028392145 0 0) 0x7f74180b6350 con 0x7f74180b5f70 2021-10-21T00:10:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7404003260 con 0x7f74180b5f70 2021-10-21T00:10:46.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585627998 0 0) 0x7f7404003260 con 0x7f74180b5f70 2021-10-21T00:10:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 msgr2=0x7f7418145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7418145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 >> v2:172.21.15.62:3300/0 conn(0x7f7418142520 msgr2=0x7f741805c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 --2- 172.21.15.41:0/1734795751 >> v2:172.21.15.62:3300/0 conn(0x7f7418142520 0x7f741805c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741805d180 con 0x7f74180b5f70 2021-10-21T00:10:46.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f7408001660 con 0x7f74180b5f70 2021-10-21T00:10:46.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 >> v1:172.21.15.41:6789/0 conn(0x7f74180b5f70 legacy=0x7f7418141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7404003750 0x7f7404003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7404004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74040049f0 0x7f7404004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7418067d00 con 0x7f74040049f0 2021-10-21T00:10:46.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741805cee0 con 0x7f7404003750 2021-10-21T00:10:46.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740400b750 con 0x7f74180b1a50 2021-10-21T00:10:46.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74040049f0 0x7f7404004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741d148700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7404004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741d949700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7404003750 0x7f7404003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 -- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 msgr2=0x7f7404004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74180b1a50 0x7f7404004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 -- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7404003750 msgr2=0x7f7404003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7404003750 0x7f7404003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 -- 172.21.15.41:0/1734795751 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404003260 con 0x7f74040049f0 2021-10-21T00:10:46.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74040049f0 0x7f7404004e70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f741000c000 tx=0x7f74100091d0).ready entity=mon.0 client_cookie=fda87b5489d3fbe6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741000e7e0 con 0x7f74040049f0 2021-10-21T00:10:46.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000e940 con 0x7f74040049f0 2021-10-21T00:10:46.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741c947700 1 -- 172.21.15.41:0/1734795751 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f741000eca0 con 0x7f74040049f0 2021-10-21T00:10:46.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 -- 172.21.15.41:0/1734795751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74040049f0 msgr2=0x7f7404004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 --2- 172.21.15.41:0/1734795751 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74040049f0 0x7f7404004e70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f741000c000 tx=0x7f74100091d0).stop 2021-10-21T00:10:46.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e14a700 1 -- 172.21.15.41:0/1734795751 reap_dead start 2021-10-21T00:10:46.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 -- 172.21.15.41:0/1734795751 shutdown_connections 2021-10-21T00:10:46.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 -- 172.21.15.41:0/1734795751 >> 172.21.15.41:0/1734795751 conn(0x7f74180639f0 msgr2=0x7f74180b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 -- 172.21.15.41:0/1734795751 shutdown_connections 2021-10-21T00:10:46.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.579+0000 7f741e94b700 1 -- 172.21.15.41:0/1734795751 wait complete. 2021-10-21T00:10:46.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 Processor -- start 2021-10-21T00:10:46.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 -- start start 2021-10-21T00:10:46.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74040049f0 0x7f74180b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74181442c0 0x7f7418144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7418144c30 con 0x7f74180669d0 2021-10-21T00:10:46.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7418143e90 con 0x7f74040049f0 2021-10-21T00:10:46.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741e94b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74181556c0 con 0x7f74181442c0 2021-10-21T00:10:46.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.583+0000 7f741d148700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36110/0 (socket says 172.21.15.41:36110) 2021-10-21T00:10:46.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 -- 172.21.15.41:0/2383950961 learned_addr learned my addr 172.21.15.41:0/2383950961 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:46.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d949700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74040049f0 0x7f74180b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741e14a700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74181442c0 0x7f7418144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 -- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74181442c0 msgr2=0x7f7418144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74181442c0 0x7f7418144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 -- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74040049f0 msgr2=0x7f74180b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74040049f0 0x7f74180b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 -- 172.21.15.41:0/2383950961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418065b90 con 0x7f74180669d0 2021-10-21T00:10:46.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741d148700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f7418146020 tx=0x7f740c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740c00f730 con 0x7f74180669d0 2021-10-21T00:10:46.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c00f890 con 0x7f74180669d0 2021-10-21T00:10:46.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7418065e30 con 0x7f74180669d0 2021-10-21T00:10:46.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740c00fbf0 con 0x7f74180669d0 2021-10-21T00:10:46.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7418146b90 con 0x7f74180669d0 2021-10-21T00:10:46.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418057350 con 0x7f74180669d0 2021-10-21T00:10:46.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.587+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f740c00fd50 con 0x7f74180669d0 2021-10-21T00:10:46.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.591+0000 7f7416ffd700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 0x7f73f8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.591+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f740c06c2a0 con 0x7f74180669d0 2021-10-21T00:10:46.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.591+0000 7f741d949700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 0x7f73f8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.591+0000 7f741d949700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 0x7f73f8055a40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f7408005000 tx=0x7f741805ccb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.595+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f740c043360 con 0x7f74180669d0 2021-10-21T00:10:46.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f741805d8f0 con 0x7f74180669d0 2021-10-21T00:10:46.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f7416ffd700 1 -- 172.21.15.41:0/2383950961 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7f740c018020 con 0x7f74180669d0 2021-10-21T00:10:46.730 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:10:46.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 msgr2=0x7f73f8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 0x7f73f8055a40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f7408005000 tx=0x7f741805ccb0).stop 2021-10-21T00:10:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 msgr2=0x7f74181551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f7418146020 tx=0x7f740c006df0).stop 2021-10-21T00:10:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 shutdown_connections 2021-10-21T00:10:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f73f8053580 0x7f73f8055a40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74181442c0 0x7f7418144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74180669d0 0x7f74181551d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 --2- 172.21.15.41:0/2383950961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74040049f0 0x7f74180b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 >> 172.21.15.41:0/2383950961 conn(0x7f74180639f0 msgr2=0x7f7418066f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 shutdown_connections 2021-10-21T00:10:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.719+0000 7f741e94b700 1 -- 172.21.15.41:0/2383950961 wait complete. 2021-10-21T00:10:46.742 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:10:46.742 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:46.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.835+0000 7f3cbe2ce700 1 Processor -- start 2021-10-21T00:10:46.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.835+0000 7f3cbe2ce700 1 -- start start 2021-10-21T00:10:46.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3cb805f9f0 0x7f3cb814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80609d0 con 0x7f3cb814b130 2021-10-21T00:10:46.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb80b1620 con 0x7f3cb805f9f0 2021-10-21T00:10:46.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb805fdd0 con 0x7f3cb80aa750 2021-10-21T00:10:46.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb77fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3cb805f9f0 0x7f3cb814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb77fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:54616/0 (socket says 172.21.15.41:54616) 2021-10-21T00:10:46.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3cb805f9f0 0x7f3cb814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48034/0 (socket says 172.21.15.41:48034) 2021-10-21T00:10:46.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb77fe700 1 -- 172.21.15.41:0/3295569002 learned_addr learned my addr 172.21.15.41:0/3295569002 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:46.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbc86b700 1 --1- 172.21.15.41:0/3295569002 >> v1:172.21.15.62:6789/0 conn(0x7f3cb814b130 0x7f3cb81495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:41946/0 (socket says 172.21.15.41:41946) 2021-10-21T00:10:46.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 -- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 msgr2=0x7f3cb814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:46.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 -- 172.21.15.41:0/3295569002 >> v1:172.21.15.62:6789/0 conn(0x7f3cb814b130 legacy=0x7f3cb81495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 -- 172.21.15.41:0/3295569002 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80b1380 con 0x7f3cb805f9f0 2021-10-21T00:10:46.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb77fe700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:46.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb7fff700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb805f9f0 0x7f3cb814a750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f3cb00032f0 tx=0x7f3cb00091d0).ready entity=mon.1 client_cookie=50e69746e212691b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb6ffd700 1 -- 172.21.15.41:0/3295569002 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cb000b6c0 con 0x7f3cb805f9f0 2021-10-21T00:10:46.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb6ffd700 1 -- 172.21.15.41:0/3295569002 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000b820 con 0x7f3cb805f9f0 2021-10-21T00:10:46.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cb6ffd700 1 -- 172.21.15.41:0/3295569002 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cb000b990 con 0x7f3cb805f9f0 2021-10-21T00:10:46.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb805f9f0 msgr2=0x7f3cb814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb805f9f0 0x7f3cb814a750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f3cb00032f0 tx=0x7f3cb00091d0).stop 2021-10-21T00:10:46.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/3295569002 shutdown_connections 2021-10-21T00:10:46.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/3295569002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb805f9f0 0x7f3cb814a750 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/3295569002 >> 172.21.15.41:0/3295569002 conn(0x7f3cb805bca0 msgr2=0x7f3cb805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:46.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/3295569002 shutdown_connections 2021-10-21T00:10:46.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.839+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/3295569002 wait complete. 2021-10-21T00:10:46.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 Processor -- start 2021-10-21T00:10:46.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- start start 2021-10-21T00:10:46.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb814b130 0x7f3cb80ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8157570 con 0x7f3cb805f9f0 2021-10-21T00:10:46.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb81566a0 con 0x7f3cb814b130 2021-10-21T00:10:46.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8156940 con 0x7f3cb80aa750 2021-10-21T00:10:46.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36122/0 (socket says 172.21.15.41:36122) 2021-10-21T00:10:46.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 -- 172.21.15.41:0/1222019572 learned_addr learned my addr 172.21.15.41:0/1222019572 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:46.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb77fe700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbc86b700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb814b130 0x7f3cb80ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 -- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 msgr2=0x7f3cb8157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb8157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 -- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb814b130 msgr2=0x7f3cb80ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:46.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb814b130 0x7f3cb80ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:46.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 -- 172.21.15.41:0/1222019572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac00b1e0 con 0x7f3cb805f9f0 2021-10-21T00:10:46.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb7fff700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f3cb00032f0 tx=0x7f3cb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cb000b6c0 con 0x7f3cb805f9f0 2021-10-21T00:10:46.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb00107a0 con 0x7f3cb805f9f0 2021-10-21T00:10:46.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb0009470 con 0x7f3cb805f9f0 2021-10-21T00:10:46.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cb0010b00 con 0x7f3cb805f9f0 2021-10-21T00:10:46.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.843+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8156340 con 0x7f3cb805f9f0 2021-10-21T00:10:46.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb814b550 con 0x7f3cb805f9f0 2021-10-21T00:10:46.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3cb0027020 con 0x7f3cb805f9f0 2021-10-21T00:10:46.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cb57fa700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 0x7f3c98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:46.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3cb006cf10 con 0x7f3cb805f9f0 2021-10-21T00:10:46.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cb77fe700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 0x7f3c98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:46.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.847+0000 7f3cb77fe700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 0x7f3c98055ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3cac00b000 tx=0x7f3cac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:46.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:46.855+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3cb0044070 con 0x7f3cb805f9f0 2021-10-21T00:10:47.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.019+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cb80686c0 con 0x7f3cb805f9f0 2021-10-21T00:10:47.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.019+0000 7f3cb57fa700 1 -- 172.21.15.41:0/1222019572 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f3cb0015090 con 0x7f3cb805f9f0 2021-10-21T00:10:47.028 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:47.028 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:40.726692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/576603081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":576603081},{"type":"v1","addr":"172.21.15.62:6835","nonce":576603081}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:47.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 msgr2=0x7f3c98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:47.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 0x7f3c98055ad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3cac00b000 tx=0x7f3cac008040).stop 2021-10-21T00:10:47.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 msgr2=0x7f3cb80ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:47.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f3cb00032f0 tx=0x7f3cb0016000).stop 2021-10-21T00:10:47.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 shutdown_connections 2021-10-21T00:10:47.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3c98053610 0x7f3c98055ad0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:47.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cb814b130 0x7f3cb80ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:47.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cb80aa750 0x7f3cb8157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:47.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 --2- 172.21.15.41:0/1222019572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3cb805f9f0 0x7f3cb80ae220 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:47.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 >> 172.21.15.41:0/1222019572 conn(0x7f3cb805bca0 msgr2=0x7f3cb805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:47.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 shutdown_connections 2021-10-21T00:10:47.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:47.023+0000 7f3cbe2ce700 1 -- 172.21.15.41:0/1222019572 wait complete. 2021-10-21T00:10:47.034 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 51 2021-10-21T00:10:47.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:10:39.722912+0000', 'modified': '2021-10-21T00:10:40.726692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7350': {'gid': 7350, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/576603081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 576603081}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 576603081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:10:47.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:10:47.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:10:47.368 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7350,"want_state":"up:active","state":"up:active","rank_uptime":7.6296667679999999,"mdsmap_epoch":51,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":12.361293053000001} 2021-10-21T00:10:47.369 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7350, "mdsmap_epoch": 51, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 7.629666768, "state": "up:active", "uptime": 12.361293053, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:10:47.369 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:10:47.370 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:10:47.370 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:10:47.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:47.371 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:47.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:47.397 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:47.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:47.461 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:47.461 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:47.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:47.463 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:47.470 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:10:47.471 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:47.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:47.490 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:47.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:47.501 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:47.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:47.503 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:47.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:10:47.539+0000 7fd897e37080 -1 init, newargv = 0x55852d1e9800 newargc=9ceph-fuse[14232 2021-10-21T00:10:47.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:]: starting ceph client 2021-10-21T00:10:47.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14232]: starting fuse 2021-10-21T00:10:48.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:10:48.629 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:10:48.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:10:48.688 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:10:48.689 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:10:48.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:48.691 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:10:48.696 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:10:48.696 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:10:48.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:48.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:10:48.698 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:10:48.698 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:10:48.699 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:10:48.699 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:10:48.700 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:48.700 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:10:48.700 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:10:48.701 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:10:48.701 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:48.702 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:10:48.702 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:10:48.703 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:10:48.703 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:10:48.704 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:48.704 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:10:48.704 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:10:48.705 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:10:48.705 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:10:48.706 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:10:48.706 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:10:48.707 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:10:48.707 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:10:48.752 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14232.asok 2021-10-21T00:10:48.758 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14232.asok 2021-10-21T00:10:48.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:48.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14232.asok status 2021-10-21T00:10:48.891 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:10:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:10:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:10:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:10:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:10:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:10:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:10:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14232", 2021-10-21T00:10:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:10:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:10:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:10:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6626, 2021-10-21T00:10:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:10:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:10:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:10:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 6626 2021-10-21T00:10:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3828481656 2021-10-21T00:10:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:10:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:10:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:10:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:10:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3828481656 2021-10-21T00:10:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:10:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.6626 172.21.15.99:0/3828481656", 2021-10-21T00:10:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/3828481656", 2021-10-21T00:10:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:10:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 51, 2021-10-21T00:10:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 98, 2021-10-21T00:10:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:10:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:10:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:10:48.901 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:10:48.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:48.903 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:48.903 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:48.911 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:48.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:48.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:48.913 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:48.971 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-21T00:10:49.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 Processor -- start 2021-10-21T00:10:49.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 -- start start 2021-10-21T00:10:49.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03740aa750 0x7f037414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740609d0 con 0x7f037414b350 2021-10-21T00:10:49.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037405fdd0 con 0x7f037405f9f0 2021-10-21T00:10:49.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0378e84700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03740b1620 con 0x7f03740aa750 2021-10-21T00:10:49.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0371d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03740aa750 0x7f037414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0372d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f037414b350 0x7f03740af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33904/0 (socket says 172.21.15.41:33904) 2021-10-21T00:10:49.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0372d9d700 1 -- 172.21.15.41:0/853201670 learned_addr learned my addr 172.21.15.41:0/853201670 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:49.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0371d9b700 1 -- 172.21.15.41:0/853201670 >> v1:172.21.15.62:6789/0 conn(0x7f037405f9f0 legacy=0x7f037414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0371d9b700 1 -- 172.21.15.41:0/853201670 >> v1:172.21.15.41:6789/0 conn(0x7f037414b350 legacy=0x7f03740af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0371d9b700 1 -- 172.21.15.41:0/853201670 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740b1380 con 0x7f03740aa750 2021-10-21T00:10:49.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f0371d9b700 1 --2- 172.21.15.41:0/853201670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03740aa750 0x7f037414ae60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f03640032f0 tx=0x7f03640091d0).ready entity=mon.0 client_cookie=746f4d021c960841 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f037159a700 1 -- 172.21.15.41:0/853201670 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036400b8a0 con 0x7f03740aa750 2021-10-21T00:10:49.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f037159a700 1 -- 172.21.15.41:0/853201670 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036400ba00 con 0x7f03740aa750 2021-10-21T00:10:49.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.071+0000 7f037159a700 1 -- 172.21.15.41:0/853201670 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036400bb70 con 0x7f03740aa750 2021-10-21T00:10:49.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/853201670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03740aa750 msgr2=0x7f037414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 --2- 172.21.15.41:0/853201670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03740aa750 0x7f037414ae60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f03640032f0 tx=0x7f03640091d0).stop 2021-10-21T00:10:49.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/853201670 shutdown_connections 2021-10-21T00:10:49.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 --2- 172.21.15.41:0/853201670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03740aa750 0x7f037414ae60 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/853201670 >> 172.21.15.41:0/853201670 conn(0x7f037405bca0 msgr2=0x7f037405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:49.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/853201670 shutdown_connections 2021-10-21T00:10:49.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/853201670 wait complete. 2021-10-21T00:10:49.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 Processor -- start 2021-10-21T00:10:49.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- start start 2021-10-21T00:10:49.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f037405f9f0 0x7f03740b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 0x7f0374066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037415a900 con 0x7f037414b350 2021-10-21T00:10:49.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740ae7c0 con 0x7f03740aa750 2021-10-21T00:10:49.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0374157650 con 0x7f037405f9f0 2021-10-21T00:10:49.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0372d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 0x7f0374066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f037259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f037405f9f0 0x7f03740b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48056/0 (socket says 172.21.15.41:48056) 2021-10-21T00:10:49.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 -- 172.21.15.41:0/384863229 learned_addr learned my addr 172.21.15.41:0/384863229 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:49.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 -- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f037405f9f0 msgr2=0x7f03740b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f037405f9f0 0x7f03740b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 -- 172.21.15.41:0/384863229 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 msgr2=0x7f0374066d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 0x7f0374066d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 -- 172.21.15.41:0/384863229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364009470 con 0x7f03740aa750 2021-10-21T00:10:49.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0372d9d700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 0x7f0374066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:49.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0371d9b700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f036400b5f0 tx=0x7f0364016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036400b8a0 con 0x7f03740aa750 2021-10-21T00:10:49.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036401f3f0 con 0x7f03740aa750 2021-10-21T00:10:49.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03740ae280 con 0x7f03740aa750 2021-10-21T00:10:49.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.075+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036401f750 con 0x7f03740aa750 2021-10-21T00:10:49.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03741599f0 con 0x7f03740aa750 2021-10-21T00:10:49.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03740678f0 con 0x7f03740aa750 2021-10-21T00:10:49.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0364026030 con 0x7f03740aa750 2021-10-21T00:10:49.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f03637fe700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 0x7f03500559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f036406c7c0 con 0x7f03740aa750 2021-10-21T00:10:49.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f037259c700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 0x7f03500559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.079+0000 7f037259c700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 0x7f03500559b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f036800d000 tx=0x7f0368009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.087+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0364043850 con 0x7f03740aa750 2021-10-21T00:10:49.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.259+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0374057350 con 0x7f03740aa750 2021-10-21T00:10:49.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.259+0000 7f03637fe700 1 -- 172.21.15.41:0/384863229 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1939 (secure 0 0 0) 0x7f03640247b0 con 0x7f03740aa750 2021-10-21T00:10:49.270 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:49.270 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:49.270 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:10:49.270 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:10:49.271 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761054121984, 2021-10-21T00:10:49.271 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6531112960, 2021-10-21T00:10:49.271 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6531198976, 2021-10-21T00:10:49.271 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085087595507502556, 2021-10-21T00:10:49.272 INFO:teuthology.orchestra.run.smithi041.stdout: "num_osds": 8, 2021-10-21T00:10:49.272 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_osds": 0, 2021-10-21T00:10:49.272 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_omap_osds": 0 2021-10-21T00:10:49.272 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:49.273 INFO:teuthology.orchestra.run.smithi041.stdout: "stats_by_class": { 2021-10-21T00:10:49.273 INFO:teuthology.orchestra.run.smithi041.stdout: "ssd": { 2021-10-21T00:10:49.273 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:10:49.273 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761054121984, 2021-10-21T00:10:49.273 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6531112960, 2021-10-21T00:10:49.274 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6531198976, 2021-10-21T00:10:49.274 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085087595507502556 2021-10-21T00:10:49.274 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.274 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:49.275 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:49.275 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:49.275 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "device_health_metrics", 2021-10-21T00:10:49.275 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 1, 2021-10-21T00:10:49.275 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:10:49.276 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:10:49.276 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 2, 2021-10-21T00:10:49.276 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:10:49.277 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:10:49.277 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:10:49.277 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361337356288 2021-10-21T00:10:49.277 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:49.278 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:49.278 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "rbd", 2021-10-21T00:10:49.278 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 2, 2021-10-21T00:10:49.278 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:10:49.279 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:10:49.279 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:10:49.279 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:10:49.279 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:10:49.279 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:10:49.280 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361337356288 2021-10-21T00:10:49.280 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:49.280 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:49.280 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "cephfs_metadata", 2021-10-21T00:10:49.281 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 19, 2021-10-21T00:10:49.281 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:10:49.281 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 2304, 2021-10-21T00:10:49.281 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 22, 2021-10-21T00:10:49.282 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 3, 2021-10-21T00:10:49.282 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 2304, 2021-10-21T00:10:49.282 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 3.188156405542486e-09, 2021-10-21T00:10:49.282 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361337356288 2021-10-21T00:10:49.283 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.283 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:49.283 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:49.283 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "cephfs_data", 2021-10-21T00:10:49.283 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 20, 2021-10-21T00:10:49.284 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:10:49.284 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:10:49.284 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:10:49.284 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:10:49.284 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:10:49.285 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:10:49.285 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361337356288 2021-10-21T00:10:49.285 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.285 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:49.286 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:49.286 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:49.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 msgr2=0x7f03500559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 0x7f03500559b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f036800d000 tx=0x7f0368009040).stop 2021-10-21T00:10:49.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 msgr2=0x7f03740654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f036400b5f0 tx=0x7f0364016000).stop 2021-10-21T00:10:49.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 shutdown_connections 2021-10-21T00:10:49.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03500534f0 0x7f03500559b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f037414b350 0x7f0374066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03740aa750 0x7f03740654a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 --2- 172.21.15.41:0/384863229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f037405f9f0 0x7f03740b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 >> 172.21.15.41:0/384863229 conn(0x7f037405bca0 msgr2=0x7f0374098f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:49.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 shutdown_connections 2021-10-21T00:10:49.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.263+0000 7f0378e84700 1 -- 172.21.15.41:0/384863229 wait complete. 2021-10-21T00:10:49.291 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-10-21T00:10:49.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 Processor -- start 2021-10-21T00:10:49.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 -- start start 2021-10-21T00:10:49.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f50062330 0x7f9f500b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f50062f70 0x7f9f5005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5005bd40 con 0x7f9f500b3a20 2021-10-21T00:10:49.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5005bf70 con 0x7f9f50062f70 2021-10-21T00:10:49.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50142cb0 con 0x7f9f50062330 2021-10-21T00:10:49.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f50062f70 0x7f9f5005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9f50062f70 0x7f9f5005c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48062/0 (socket says 172.21.15.41:48062) 2021-10-21T00:10:49.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/2551561660 learned_addr learned my addr 172.21.15.41:0/2551561660 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:49.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.391+0000 7f9f4effd700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f50062330 0x7f9f500b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f50062330 msgr2=0x7f9f500b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:49.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4e7fc700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f50062330 0x7f9f500b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/2551561660 >> v1:172.21.15.62:6789/0 conn(0x7f9f500b3a20 legacy=0x7f9f5013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/2551561660 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50142950 con 0x7f9f50062f70 2021-10-21T00:10:49.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4e7fc700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062f70 0x7f9f5005c410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f9f40002f70 tx=0x7f9f40006eb0).ready entity=mon.1 client_cookie=f2ecd2c9e85617b5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4dffb700 1 -- 172.21.15.41:0/2551561660 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000d5c0 con 0x7f9f50062f70 2021-10-21T00:10:49.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4dffb700 1 -- 172.21.15.41:0/2551561660 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40000e90 con 0x7f9f50062f70 2021-10-21T00:10:49.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4dffb700 1 -- 172.21.15.41:0/2551561660 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000d950 con 0x7f9f50062f70 2021-10-21T00:10:49.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062f70 msgr2=0x7f9f5005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062f70 0x7f9f5005c410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f9f40002f70 tx=0x7f9f40006eb0).stop 2021-10-21T00:10:49.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- 172.21.15.41:0/2551561660 shutdown_connections 2021-10-21T00:10:49.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062f70 0x7f9f5005c410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/2551561660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f50062330 0x7f9f500b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- 172.21.15.41:0/2551561660 >> 172.21.15.41:0/2551561660 conn(0x7f9f500b9080 msgr2=0x7f9f500b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:49.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- 172.21.15.41:0/2551561660 shutdown_connections 2021-10-21T00:10:49.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- 172.21.15.41:0/2551561660 wait complete. 2021-10-21T00:10:49.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 Processor -- start 2021-10-21T00:10:49.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.395+0000 7f9f4ffff700 1 -- start start 2021-10-21T00:10:49.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062330 0x7f9f50145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.415 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f500b3a20 0x7f9f500b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500af800 con 0x7f9f50062f70 2021-10-21T00:10:49.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500af560 con 0x7f9f50062330 2021-10-21T00:10:49.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50143f80 con 0x7f9f500b3a20 2021-10-21T00:10:49.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.416 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062330 0x7f9f50145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36152/0 (socket says 172.21.15.41:36152) 2021-10-21T00:10:49.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/3492494142 learned_addr learned my addr 172.21.15.41:0/3492494142 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:49.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4f7fe700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f500b3a20 0x7f9f500b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f500b3a20 msgr2=0x7f9f500b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.417 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f500b3a20 0x7f9f500b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062330 msgr2=0x7f9f50145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062330 0x7f9f50145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 -- 172.21.15.41:0/3492494142 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4000b1e0 con 0x7f9f50062f70 2021-10-21T00:10:49.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4e7fc700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f9f40002f70 tx=0x7f9f40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f40006b40 con 0x7f9f50062f70 2021-10-21T00:10:49.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000d940 con 0x7f9f50062f70 2021-10-21T00:10:49.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f50152d30 con 0x7f9f50062f70 2021-10-21T00:10:49.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f40011d30 con 0x7f9f50062f70 2021-10-21T00:10:49.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500b7650 con 0x7f9f50062f70 2021-10-21T00:10:49.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.399+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50057350 con 0x7f9f50062f70 2021-10-21T00:10:49.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.403+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f40025030 con 0x7f9f50062f70 2021-10-21T00:10:49.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.403+0000 7f9f47fff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 0x7f9f34055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:49.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.403+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f4006cad0 con 0x7f9f50062f70 2021-10-21T00:10:49.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.403+0000 7f9f4effd700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 0x7f9f34055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:49.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.403+0000 7f9f4effd700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 0x7f9f34055ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9f3800c000 tx=0x7f9f38008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:49.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.407+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f40043c70 con 0x7f9f50062f70 2021-10-21T00:10:49.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.535+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7f9f5005d080 con 0x7f9f50062f70 2021-10-21T00:10:49.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.535+0000 7f9f47fff700 1 -- 172.21.15.41:0/3492494142 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v98) v1 ==== 123+0+64 (secure 0 0 0) 0x7f9f40023020 con 0x7f9f50062f70 2021-10-21T00:10:49.545 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:49.545 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:49.546 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": "cephfs_data", 2021-10-21T00:10:49.546 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_id": 20, 2021-10-21T00:10:49.546 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2 2021-10-21T00:10:49.546 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:49.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 msgr2=0x7f9f34055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 0x7f9f34055ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9f3800c000 tx=0x7f9f38008040).stop 2021-10-21T00:10:49.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 msgr2=0x7f9f50152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:49.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f9f40002f70 tx=0x7f9f40015000).stop 2021-10-21T00:10:49.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 shutdown_connections 2021-10-21T00:10:49.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9f34053610 0x7f9f34055ad0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f500b3a20 0x7f9f500b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9f50062f70 0x7f9f50152840 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 --2- 172.21.15.41:0/3492494142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f50062330 0x7f9f50145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:49.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 >> 172.21.15.41:0/3492494142 conn(0x7f9f500b9080 msgr2=0x7f9f50142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:49.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 shutdown_connections 2021-10-21T00:10:49.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:49.539+0000 7f9f4ffff700 1 -- 172.21.15.41:0/3492494142 wait complete. 2021-10-21T00:10:49.559 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-21T00:10:49.559 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-10-21T00:10:49.598 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-10-21T00:10:49.598 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-fuse 352866304 0 352866304 0% /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:49.599 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:49.600 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:49.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:49.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:49.663 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:49.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:49.706 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:49.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:49.707 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:49.707 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:49.715 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:10:49.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:49.717 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:10:49.717 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:49.718 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:49.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14819]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:49.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:49.775 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:49.775 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:49.784 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:10:49.785 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:49.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:49.897 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:49.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:49.945 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:49.945 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:49.955 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:10:49.956 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:49.957 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:10:49.958 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:10:49.958 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:50.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14232]: fuse finished with error 0 and tester_r 0 2021-10-21T00:10:50.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:50.026 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:50.026 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:50.040 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:10:50.041 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:10:50.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:50.145 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:50.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:50.155 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:50.156 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:50.167 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:50.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:50.168 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:50.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:10:50.169 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:50.224 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:50.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:50.227 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:50.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 Processor -- start 2021-10-21T00:10:50.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 -- start start 2021-10-21T00:10:50.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f46880ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f46880af620 0x7f46880ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880b0b50 con 0x7f46880abb50 2021-10-21T00:10:50.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880b2550 con 0x7f46880af620 2021-10-21T00:10:50.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468d56b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880b0d90 con 0x7f46880b2170 2021-10-21T00:10:50.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468cd6a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f46880abb50 0x7f468814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33930/0 (socket says 172.21.15.41:33930) 2021-10-21T00:10:50.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f468cd6a700 1 -- 172.21.15.41:0/2601463557 learned_addr learned my addr 172.21.15.41:0/2601463557 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:50.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f46877fe700 1 --2- 172.21.15.41:0/2601463557 >> v2:172.21.15.41:3300/0 conn(0x7f46880af620 0x7f46880ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f4687fff700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f46880ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.335+0000 7f4686ffd700 1 -- 172.21.15.41:0/2601463557 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73227990 0 0) 0x7f4678001110 con 0x7f46880abb50 2021-10-21T00:10:50.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f4686ffd700 1 -- 172.21.15.41:0/2601463557 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4674003260 con 0x7f46880abb50 2021-10-21T00:10:50.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f46877fe700 1 -- 172.21.15.41:0/2601463557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 msgr2=0x7f46880ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:50.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f46877fe700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f46880ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f46877fe700 1 -- 172.21.15.41:0/2601463557 >> v1:172.21.15.41:6789/0 conn(0x7f46880abb50 legacy=0x7f468814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f46877fe700 1 -- 172.21.15.41:0/2601463557 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880b1030 con 0x7f46880af620 2021-10-21T00:10:50.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f4687fff700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f46880ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:50.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f46877fe700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880ab660 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f467c002f70 tx=0x7f467c006df0).ready entity=mon.0 client_cookie=31f590e41a214473 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f4686ffd700 1 -- 172.21.15.41:0/2601463557 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c00d4a0 con 0x7f46880af620 2021-10-21T00:10:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f4686ffd700 1 -- 172.21.15.41:0/2601463557 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c000e90 con 0x7f46880af620 2021-10-21T00:10:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f4686ffd700 1 -- 172.21.15.41:0/2601463557 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c00d7f0 con 0x7f46880af620 2021-10-21T00:10:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- 172.21.15.41:0/2601463557 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 msgr2=0x7f46880ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880ab660 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f467c002f70 tx=0x7f467c006df0).stop 2021-10-21T00:10:50.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- 172.21.15.41:0/2601463557 shutdown_connections 2021-10-21T00:10:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880ab660 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 --2- 172.21.15.41:0/2601463557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f46880ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- 172.21.15.41:0/2601463557 >> 172.21.15.41:0/2601463557 conn(0x7f46880b5700 msgr2=0x7f46880b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:50.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- 172.21.15.41:0/2601463557 shutdown_connections 2021-10-21T00:10:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- 172.21.15.41:0/2601463557 wait complete. 2021-10-21T00:10:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 Processor -- start 2021-10-21T00:10:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.339+0000 7f468d56b700 1 -- start start 2021-10-21T00:10:50.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46880abb50 0x7f4688063920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f4688066dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880654d0 con 0x7f46880af620 2021-10-21T00:10:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880644b0 con 0x7f46880abb50 2021-10-21T00:10:50.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4688064750 con 0x7f46880b2170 2021-10-21T00:10:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36168/0 (socket says 172.21.15.41:36168) 2021-10-21T00:10:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468cd6a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f4688066dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 -- 172.21.15.41:0/1357188750 learned_addr learned my addr 172.21.15.41:0/1357188750 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:50.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f4687fff700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46880abb50 0x7f4688063920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 -- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 msgr2=0x7f4688066dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f4688066dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 -- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46880abb50 msgr2=0x7f4688063920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46880abb50 0x7f4688063920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 -- 172.21.15.41:0/1357188750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009470 con 0x7f46880af620 2021-10-21T00:10:50.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46877fe700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f467c002f70 tx=0x7f467c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c016070 con 0x7f46880af620 2021-10-21T00:10:50.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c0137d0 con 0x7f46880af620 2021-10-21T00:10:50.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c00b180 con 0x7f46880af620 2021-10-21T00:10:50.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467c013b30 con 0x7f46880af620 2021-10-21T00:10:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.343+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688148750 con 0x7f46880af620 2021-10-21T00:10:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f467c00f030 con 0x7f46880af620 2021-10-21T00:10:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880b12d0 con 0x7f46880af620 2021-10-21T00:10:50.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f46857fa700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 0x7f4668055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f467c06c5a0 con 0x7f46880af620 2021-10-21T00:10:50.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f4687fff700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 0x7f4668055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.347+0000 7f4687fff700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 0x7f4668055b60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f468000b000 tx=0x7f46800091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.351+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f467c0435f0 con 0x7f46880af620 2021-10-21T00:10:50.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.475+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4688057350 con 0x7f46880af620 2021-10-21T00:10:50.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.475+0000 7f46857fa700 1 -- 172.21.15.41:0/1357188750 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f467c023020 con 0x7f46880af620 2021-10-21T00:10:50.485 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:50.485 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:50.485 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 98, 2021-10-21T00:10:50.486 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:50.486 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:50.486 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:10:40.725582+0000", 2021-10-21T00:10:50.486 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:50.487 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:50.487 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:50.487 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:50.487 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:50.487 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:50.488 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:50.488 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:50.488 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:50.488 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:50.489 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:50.489 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:50.489 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:50.489 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:50.489 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:50.490 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 20, 2021-10-21T00:10:50.490 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:50.490 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:50.490 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:50.491 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:50.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:50.491 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:50.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:50.492 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:50.493 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:50.494 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:50.495 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:50.496 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:50.497 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:50.498 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:50.499 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:50.500 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:50.501 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:50.502 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:50.505 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:50.506 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:50.507 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.508 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:50.509 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:50.510 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:50.511 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:50.512 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:50.513 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:50.514 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:50.515 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:50.516 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:50.517 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:50.517 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:50.517 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:50.518 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:50.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:50.520 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:50.521 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:50.522 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:50.523 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:50.524 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:50.525 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:50.526 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:50.527 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.528 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 19, 2021-10-21T00:10:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:10:50.529 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:10:37.769852+0000", 2021-10-21T00:10:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:50.530 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:50.531 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:50.532 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:50.533 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "97", 2021-10-21T00:10:50.534 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:50.535 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:50.536 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:50.537 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:50.538 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:50.538 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:50.538 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:50.538 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:50.539 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:50.539 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:50.539 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:50.539 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:50.539 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:50.540 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:50.540 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:50.540 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.540 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:50.540 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:50.541 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:50.541 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:50.541 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:50.542 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:50.543 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:50.543 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:50.543 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:50.543 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:10:50.543 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:10:50.544 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:10:50.544 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.544 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:50.544 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:50.544 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:10:50.545 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.545 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.545 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.545 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.546 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 20, 2021-10-21T00:10:50.546 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:10:50.546 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:10:38.737124+0000", 2021-10-21T00:10:50.546 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:50.546 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:50.547 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:50.547 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:50.547 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:50.548 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:50.548 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:50.548 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:50.548 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:50.548 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:50.549 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:50.549 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:50.549 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:50.549 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:50.550 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:50.550 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:50.550 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:50.551 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:50.551 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:50.551 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:50.551 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.551 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "98", 2021-10-21T00:10:50.552 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:50.552 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:50.552 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:50.553 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:50.553 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:50.553 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:50.553 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:50.554 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:50.554 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:50.554 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:50.555 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:50.555 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:50.555 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:50.555 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:50.555 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:50.556 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:50.556 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:50.556 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:50.556 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:50.557 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:50.557 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:50.557 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:50.557 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:50.557 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:50.558 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:50.558 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:50.558 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.558 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:50.559 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:50.559 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:50.559 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:50.559 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:50.559 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:50.560 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:50.560 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:50.560 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:50.560 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:50.560 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:50.561 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:50.561 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:50.561 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:10:50.561 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:10:50.562 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.562 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.562 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.562 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:50.562 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:50.563 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.563 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:50.563 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:50.563 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.564 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.564 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.564 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.564 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.564 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.565 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.565 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:50.565 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.565 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.565 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.566 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.566 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.566 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.566 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:50.567 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.567 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.567 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.567 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.567 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:50.568 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.568 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.568 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.568 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.568 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.569 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.569 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.569 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.569 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:50.570 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.570 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.570 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.570 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.570 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:50.571 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.571 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.571 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.571 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.572 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.572 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.572 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.572 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.572 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:50.573 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.573 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.573 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.573 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.573 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:50.574 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.574 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.574 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.574 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.575 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.575 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.575 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.575 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.575 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:50.576 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.576 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.576 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.576 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.577 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:50.577 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:50.577 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.577 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.577 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.578 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:50.578 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:50.578 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:50.578 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:50.579 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.579 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.579 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.579 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.579 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.580 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.580 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:50.580 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:50.580 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.580 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.581 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.581 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.581 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.581 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.582 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.582 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:50.582 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.582 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.582 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.583 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.583 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.583 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.583 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:50.583 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.584 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.584 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.584 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.584 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:50.585 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.585 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.585 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.585 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.585 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.586 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.586 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.586 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.586 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:50.586 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.587 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.587 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.587 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.587 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:50.588 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.588 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.588 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.588 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.588 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.589 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.589 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.589 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.589 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:50.589 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.590 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.590 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.590 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.590 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:50.591 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.591 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.591 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.591 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.591 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.592 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.592 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.592 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.592 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:50.593 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.593 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.593 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.593 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.593 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:50.594 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:50.594 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.594 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.594 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.594 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:50.595 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:50.595 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:50.595 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:50.595 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.596 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.596 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.596 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.596 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.597 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.597 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:50.597 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:50.597 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.598 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.598 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.598 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.598 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.598 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.599 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.599 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:50.599 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.599 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.599 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.600 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.600 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.600 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.600 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:50.601 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.601 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.601 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.601 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.601 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:50.602 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.602 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.602 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.602 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.603 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.603 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.603 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.603 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.603 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:50.604 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.604 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.604 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.604 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.605 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:50.605 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.605 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.605 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.606 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.606 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.606 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.607 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.607 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.607 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:50.607 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.607 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.608 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.608 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.608 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:50.608 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.608 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.609 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.609 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.609 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.609 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.610 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.610 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.610 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:50.610 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.610 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.611 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.611 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.611 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:50.611 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:50.612 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.612 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.612 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.612 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:50.612 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:50.613 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:50.613 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:50.613 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.613 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.613 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.614 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.614 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.614 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.615 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:50.615 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:50.615 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.615 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.615 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.616 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.616 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.616 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.616 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.617 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:50.617 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.617 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.617 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.617 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.618 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.618 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.618 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:50.618 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.618 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.619 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.619 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.619 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:50.619 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.620 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.620 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.620 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.620 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.620 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.621 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.621 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.621 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:50.621 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.621 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.622 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.622 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.622 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:50.622 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.623 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.623 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.623 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.623 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.623 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.624 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.624 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.624 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:50.624 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.625 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.625 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.625 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.625 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:50.625 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.626 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.626 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.626 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.626 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.626 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.627 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.627 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.627 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:50.627 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.628 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.628 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.628 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.628 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:50.628 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:50.629 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.629 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.629 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.629 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:50.629 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:50.630 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:50.630 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:50.630 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.630 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.631 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.631 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.631 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.631 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.631 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:50.632 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:50.632 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.632 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.632 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.633 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.633 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.633 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.633 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.633 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:50.634 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.634 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.634 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.634 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.634 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.635 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.635 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:50.635 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.635 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.636 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.636 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.636 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:50.636 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.636 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.637 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.637 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.637 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.637 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.637 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.638 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.638 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:50.638 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.638 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.639 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.639 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.639 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:50.639 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.639 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.640 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.640 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.640 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.640 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.641 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.641 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.641 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:50.641 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.642 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.642 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.642 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.642 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:50.642 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.643 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.643 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.643 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.643 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.644 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.644 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.644 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.644 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:50.644 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.645 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.645 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.645 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.645 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:50.646 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:50.646 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.646 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.646 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.646 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:50.647 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:50.647 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:50.647 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:50.647 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.647 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.648 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.648 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.648 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.649 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.649 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:50.649 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:50.649 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.649 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.650 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.650 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.650 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.651 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.651 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.651 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:50.651 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.651 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.652 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.652 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.652 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.652 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.653 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:50.653 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.653 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.653 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.653 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.654 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:50.654 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.654 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.654 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.655 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.655 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.655 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.655 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.655 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.656 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:50.656 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.656 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.656 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.656 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.657 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:50.657 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.657 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.657 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.658 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.658 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.658 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.658 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.658 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.659 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:50.659 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.659 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.659 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.659 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.660 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:50.660 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.660 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.660 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.661 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.661 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.661 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.661 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.661 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.662 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:50.662 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.662 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.662 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.663 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.663 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:50.663 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:50.663 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.663 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.664 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.664 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:50.664 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:50.664 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:50.664 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:50.665 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.665 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.665 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.665 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.666 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.666 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.666 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:50.666 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:50.666 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.667 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.667 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.667 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.667 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.667 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.668 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.668 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:50.668 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.668 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.669 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.669 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.669 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.669 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.669 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:50.670 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.670 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.670 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.670 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.671 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:50.671 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.671 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.671 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.671 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.672 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.672 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.672 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.672 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.672 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:50.673 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.673 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.673 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.673 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.674 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:50.674 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.674 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.674 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.674 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.680 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.681 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.681 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.681 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.681 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:50.682 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.682 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.682 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.682 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.683 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:50.683 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.683 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.683 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.683 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.684 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.684 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.684 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.684 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.684 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:50.685 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.685 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.685 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.685 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.686 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:50.686 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:50.686 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.686 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.686 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.687 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:50.687 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:50.687 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:50.687 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:50.688 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.688 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.688 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.688 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.688 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.689 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.689 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:50.689 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:50.689 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:50.689 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:50.690 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:50.690 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:50.690 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:50.690 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:50.691 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:50.691 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:50.691 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:50.691 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:50.691 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:50.692 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.692 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.692 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.692 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:50.692 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.693 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.693 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.693 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.693 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:50.694 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.694 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.694 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.694 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.694 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:50.695 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.695 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.695 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.695 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:50.696 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.696 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.696 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.696 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.696 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:50.697 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.697 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.697 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.697 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.698 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:50.698 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.698 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.698 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.698 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:50.699 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.699 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.699 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.699 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.700 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:50.700 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.700 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.700 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.700 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.701 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:50.701 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:50.701 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.701 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:50.701 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:50.702 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.702 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.702 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.702 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:50.703 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:50.703 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:50.703 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.703 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.703 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.704 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:50.704 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:50.704 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:50.704 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:50.704 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:50.705 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:50.705 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:50.705 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:50.705 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.706 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:50.706 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:50.706 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.706 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:50.706 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.707 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.707 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.707 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.707 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.707 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:50.708 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.708 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.708 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.708 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:50.709 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.709 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.709 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.709 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.709 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.710 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:50.710 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.710 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.710 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.710 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:50.711 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.711 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.711 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.711 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.712 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.712 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:50.712 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.712 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.712 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.713 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:50.713 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.713 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.713 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.713 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.714 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.714 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:50.714 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.714 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.715 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.715 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:50.715 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.715 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.715 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.716 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.716 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.716 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:50.716 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.717 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.717 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.717 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:50.717 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.717 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.718 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.718 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.718 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.718 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:50.718 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.719 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.719 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.719 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:50.719 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.720 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.720 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.720 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.720 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.720 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:50.721 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.721 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.721 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:50.721 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:50.721 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:50.722 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:50.722 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:50.722 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:50.722 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:50.723 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:50.723 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:50.723 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.723 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:50.723 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:50.724 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:50.724 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:50.724 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:50.724 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:10:50.724 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:50.725 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:50.725 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:50.725 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:50.725 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:50.726 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:50.726 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:50.726 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:50.726 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:50.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:50.727 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:50.727 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:50.727 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:50.727 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:50.727 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:50.728 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:50.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 msgr2=0x7f4668055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 0x7f4668055b60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f468000b000 tx=0x7f46800091d0).stop 2021-10-21T00:10:50.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 msgr2=0x7f46880668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f467c002f70 tx=0x7f467c014000).stop 2021-10-21T00:10:50.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 shutdown_connections 2021-10-21T00:10:50.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f46680536a0 0x7f4668055b60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46880b2170 0x7f4688066dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f46880af620 0x7f46880668e0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 --2- 172.21.15.41:0/1357188750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46880abb50 0x7f4688063920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 >> 172.21.15.41:0/1357188750 conn(0x7f46880b5700 msgr2=0x7f468805f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:50.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 shutdown_connections 2021-10-21T00:10:50.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.479+0000 7f468d56b700 1 -- 172.21.15.41:0/1357188750 wait complete. 2021-10-21T00:10:50.734 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:50.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 Processor -- start 2021-10-21T00:10:50.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 -- start start 2021-10-21T00:10:50.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca2c0b2c90 0x7fca2c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c13f4a0 0x7fca2c142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0b3070 con 0x7fca2c0b16f0 2021-10-21T00:10:50.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0b0ce0 con 0x7fca2c0b2c90 2021-10-21T00:10:50.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca313e4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0ae550 con 0x7fca2c13f4a0 2021-10-21T00:10:50.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2a7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fca2c0b16f0 0x7fca2c13ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33942/0 (socket says 172.21.15.41:33942) 2021-10-21T00:10:50.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2a7fc700 1 -- 172.21.15.41:0/2033097259 learned_addr learned my addr 172.21.15.41:0/2033097259 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:50.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 --2- 172.21.15.41:0/2033097259 >> v2:172.21.15.62:3300/0 conn(0x7fca2c0b2c90 0x7fca2c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2b7fe700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c13f4a0 0x7fca2c142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca29ffb700 1 -- 172.21.15.41:0/2033097259 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278257073 0 0) 0x7fca2c0b3070 con 0x7fca2c0b16f0 2021-10-21T00:10:50.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca29ffb700 1 -- 172.21.15.41:0/2033097259 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca0c003260 con 0x7fca2c0b16f0 2021-10-21T00:10:50.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 -- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c13f4a0 msgr2=0x7fca2c142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:50.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c13f4a0 0x7fca2c142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 -- 172.21.15.41:0/2033097259 >> v1:172.21.15.41:6789/0 conn(0x7fca2c0b16f0 legacy=0x7fca2c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 -- 172.21.15.41:0/2033097259 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0ae7f0 con 0x7fca2c0b2c90 2021-10-21T00:10:50.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca2affd700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c0b2c90 0x7fca2c0aec90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fca14002f70 tx=0x7fca14006df0).ready entity=mon.1 client_cookie=ee5c407a9bad198b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca29ffb700 1 -- 172.21.15.41:0/2033097259 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca1400d4a0 con 0x7fca2c0b2c90 2021-10-21T00:10:50.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca29ffb700 1 -- 172.21.15.41:0/2033097259 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca14000e90 con 0x7fca2c0b2c90 2021-10-21T00:10:50.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.839+0000 7fca29ffb700 1 -- 172.21.15.41:0/2033097259 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca1400d7f0 con 0x7fca2c0b2c90 2021-10-21T00:10:50.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c0b2c90 msgr2=0x7fca2c0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c0b2c90 0x7fca2c0aec90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fca14002f70 tx=0x7fca14006df0).stop 2021-10-21T00:10:50.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- 172.21.15.41:0/2033097259 shutdown_connections 2021-10-21T00:10:50.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c13f4a0 0x7fca2c142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 --2- 172.21.15.41:0/2033097259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c0b2c90 0x7fca2c0aec90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- 172.21.15.41:0/2033097259 >> 172.21.15.41:0/2033097259 conn(0x7fca2c061d80 msgr2=0x7fca2c063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:50.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- 172.21.15.41:0/2033097259 shutdown_connections 2021-10-21T00:10:50.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- 172.21.15.41:0/2033097259 wait complete. 2021-10-21T00:10:50.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 Processor -- start 2021-10-21T00:10:50.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.843+0000 7fca313e4700 1 -- start start 2021-10-21T00:10:50.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 0x7fca2c064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 0x7fca2c133a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c13f4a0 0x7fca2c130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c067930 con 0x7fca2c0b2c90 2021-10-21T00:10:50.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c132600 con 0x7fca2c13f4a0 2021-10-21T00:10:50.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c135040 con 0x7fca2c0b16f0 2021-10-21T00:10:50.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 0x7fca2c133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 0x7fca2c133a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36180/0 (socket says 172.21.15.41:36180) 2021-10-21T00:10:50.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2a7fc700 1 -- 172.21.15.41:0/3998742141 learned_addr learned my addr 172.21.15.41:0/3998742141 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:50.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 0x7fca2c064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2b7fe700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c13f4a0 0x7fca2c130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 -- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c13f4a0 msgr2=0x7fca2c130fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c13f4a0 0x7fca2c130fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 -- 172.21.15.41:0/3998742141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 msgr2=0x7fca2c133a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:50.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 0x7fca2c133a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:50.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 -- 172.21.15.41:0/3998742141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1400b180 con 0x7fca2c0b16f0 2021-10-21T00:10:50.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca2affd700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 0x7fca2c064a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fca14002f70 tx=0x7fca14014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca140139c0 con 0x7fca2c0b16f0 2021-10-21T00:10:50.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca14013b20 con 0x7fca2c0b16f0 2021-10-21T00:10:50.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c133f60 con 0x7fca2c0b16f0 2021-10-21T00:10:50.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca14013e80 con 0x7fca2c0b16f0 2021-10-21T00:10:50.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c1314b0 con 0x7fca2c0b16f0 2021-10-21T00:10:50.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.847+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c135240 con 0x7fca2c0b16f0 2021-10-21T00:10:50.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.851+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca1401c070 con 0x7fca2c0b16f0 2021-10-21T00:10:50.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.851+0000 7fca23fff700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 0x7fca10055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:50.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.851+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca1406c330 con 0x7fca2c0b16f0 2021-10-21T00:10:50.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.851+0000 7fca2a7fc700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 0x7fca10055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:50.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.851+0000 7fca2a7fc700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 0x7fca10055b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fca1c00d000 tx=0x7fca1c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:50.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:50.859+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca140433f0 con 0x7fca2c0b16f0 2021-10-21T00:10:51.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.027+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca2c067750 con 0x7fca2c0b16f0 2021-10-21T00:10:51.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.027+0000 7fca23fff700 1 -- 172.21.15.41:0/3998742141 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fca14023020 con 0x7fca2c0b16f0 2021-10-21T00:10:51.038 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:51.038 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:40.726692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/576603081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":576603081},{"type":"v1","addr":"172.21.15.62:6835","nonce":576603081}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:51.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 msgr2=0x7fca10055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:51.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 0x7fca10055b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fca1c00d000 tx=0x7fca1c009040).stop 2021-10-21T00:10:51.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 msgr2=0x7fca2c064a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:51.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 0x7fca2c064a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fca14002f70 tx=0x7fca14014000).stop 2021-10-21T00:10:51.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 shutdown_connections 2021-10-21T00:10:51.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca10053640 0x7fca10055b00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca2c13f4a0 0x7fca2c130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca2c0b2c90 0x7fca2c133a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 --2- 172.21.15.41:0/3998742141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca2c0b16f0 0x7fca2c064a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 >> 172.21.15.41:0/3998742141 conn(0x7fca2c061d80 msgr2=0x7fca2c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:51.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 shutdown_connections 2021-10-21T00:10:51.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.031+0000 7fca313e4700 1 -- 172.21.15.41:0/3998742141 wait complete. 2021-10-21T00:10:51.043 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 51 2021-10-21T00:10:51.052 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:10:51.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 Processor -- start 2021-10-21T00:10:51.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 -- start start 2021-10-21T00:10:51.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40b4380 0x7fd8d405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8d40b1830 0x7fd8d405fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd8d40601a0 0x7fd8d4143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40b4760 con 0x7fd8d40601a0 2021-10-21T00:10:51.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40ad4c0 con 0x7fd8d40b1830 2021-10-21T00:10:51.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d972e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40ad760 con 0x7fd8d40b4380 2021-10-21T00:10:51.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd8d40601a0 0x7fd8d4143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd8d40601a0 0x7fd8d4143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36190/0 (socket says 172.21.15.41:36190) 2021-10-21T00:10:51.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 -- 172.21.15.41:0/3047001411 learned_addr learned my addr 172.21.15.41:0/3047001411 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:51.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d37fe700 1 --2- 172.21.15.41:0/3047001411 >> v2:172.21.15.62:3300/0 conn(0x7fd8d40b1830 0x7fd8d405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d3fff700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40b4380 0x7fd8d405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 -- 172.21.15.41:0/3047001411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40b4380 msgr2=0x7fd8d405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:51.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40b4380 0x7fd8d405f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 -- 172.21.15.41:0/3047001411 >> v2:172.21.15.62:3300/0 conn(0x7fd8d40b1830 msgr2=0x7fd8d405fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 --2- 172.21.15.41:0/3047001411 >> v2:172.21.15.62:3300/0 conn(0x7fd8d40b1830 0x7fd8d405fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 -- 172.21.15.41:0/3047001411 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40ada00 con 0x7fd8d40601a0 2021-10-21T00:10:51.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.151+0000 7fd8d8f2d700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40601a0 0x7fd8d4143eb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fd8cc002f70 tx=0x7fd8cc006eb0).ready entity=mon.0 client_cookie=7623a05fe15f3d2d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d2ffd700 1 -- 172.21.15.41:0/3047001411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d570 con 0x7fd8d40601a0 2021-10-21T00:10:51.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d2ffd700 1 -- 172.21.15.41:0/3047001411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc000e90 con 0x7fd8d40601a0 2021-10-21T00:10:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d2ffd700 1 -- 172.21.15.41:0/3047001411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d900 con 0x7fd8d40601a0 2021-10-21T00:10:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- 172.21.15.41:0/3047001411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40601a0 msgr2=0x7fd8d4143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:51.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40601a0 0x7fd8d4143eb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fd8cc002f70 tx=0x7fd8cc006eb0).stop 2021-10-21T00:10:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- 172.21.15.41:0/3047001411 shutdown_connections 2021-10-21T00:10:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40601a0 0x7fd8d4143eb0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 --2- 172.21.15.41:0/3047001411 >> v2:172.21.15.62:3300/0 conn(0x7fd8d40b1830 0x7fd8d405fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 --2- 172.21.15.41:0/3047001411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40b4380 0x7fd8d405f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- 172.21.15.41:0/3047001411 >> 172.21.15.41:0/3047001411 conn(0x7fd8d40b7910 msgr2=0x7fd8d40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- 172.21.15.41:0/3047001411 shutdown_connections 2021-10-21T00:10:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- 172.21.15.41:0/3047001411 wait complete. 2021-10-21T00:10:51.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 Processor -- start 2021-10-21T00:10:51.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.155+0000 7fd8d972e700 1 -- start start 2021-10-21T00:10:51.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 0x7fd8d40b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 0x7fd8d413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4063170 con 0x7fd8d40b1830 2021-10-21T00:10:51.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4062ed0 con 0x7fd8d40b4380 2021-10-21T00:10:51.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d413dee0 con 0x7fd8d40601a0 2021-10-21T00:10:51.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36194/0 (socket says 172.21.15.41:36194) 2021-10-21T00:10:51.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 -- 172.21.15.41:0/1440339373 learned_addr learned my addr 172.21.15.41:0/1440339373 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:51.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d3fff700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 0x7fd8d40b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d8f2d700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 0x7fd8d413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 -- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 msgr2=0x7fd8d40b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:51.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 0x7fd8d40b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 -- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 msgr2=0x7fd8d413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:51.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 0x7fd8d413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 -- 172.21.15.41:0/1440339373 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc00b1e0 con 0x7fd8d40b1830 2021-10-21T00:10:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d3fff700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 0x7fd8d40b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:51.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d8f2d700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 0x7fd8d413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:51.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d37fe700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fd8bc00c000 tx=0x7fd8bc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:51.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc00c850 con 0x7fd8d40b1830 2021-10-21T00:10:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00c9b0 con 0x7fd8d40b1830 2021-10-21T00:10:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d4062ac0 con 0x7fd8d40b1830 2021-10-21T00:10:51.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc00cd10 con 0x7fd8d40b1830 2021-10-21T00:10:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4098960 con 0x7fd8d40b1830 2021-10-21T00:10:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d4062c50 con 0x7fd8d40b1830 2021-10-21T00:10:51.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.159+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8bc022070 con 0x7fd8d40b1830 2021-10-21T00:10:51.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.163+0000 7fd8d17fa700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 0x7fd8b80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:51.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.163+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8bc06c230 con 0x7fd8d40b1830 2021-10-21T00:10:51.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.163+0000 7fd8d3fff700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 0x7fd8b80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:51.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.163+0000 7fd8d3fff700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 0x7fd8b80559e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fd8c400b000 tx=0x7fd8c4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:51.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.167+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8bc043220 con 0x7fd8d40b1830 2021-10-21T00:10:51.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:51.331+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd8d413e0a0 con 0x7fd8d40b1830 2021-10-21T00:10:52.311 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:10:52.303+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:10:52.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.307+0000 7fd8d17fa700 1 -- 172.21.15.41:0/1440339373 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd8bc046840 con 0x7fd8d40b1830 2021-10-21T00:10:52.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 msgr2=0x7fd8b80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 0x7fd8b80559e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fd8c400b000 tx=0x7fd8c4008040).stop 2021-10-21T00:10:52.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 msgr2=0x7fd8d413e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7fd8bc00c000 tx=0x7fd8bc0091d0).stop 2021-10-21T00:10:52.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 shutdown_connections 2021-10-21T00:10:52.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8b8053520 0x7fd8b80559e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d40b4380 0x7fd8d413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd8d40b1830 0x7fd8d413e470 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 --2- 172.21.15.41:0/1440339373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8d40601a0 0x7fd8d40b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 >> 172.21.15.41:0/1440339373 conn(0x7fd8d40b7910 msgr2=0x7fd8d409bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:52.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.311+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 shutdown_connections 2021-10-21T00:10:52.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.315+0000 7fd8d972e700 1 -- 172.21.15.41:0/1440339373 wait complete. 2021-10-21T00:10:52.326 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:10:52.340 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:52.346 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:10:52.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.443+0000 7f3dda82c700 1 Processor -- start 2021-10-21T00:10:52.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.443+0000 7f3dda82c700 1 -- start start 2021-10-21T00:10:52.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.443+0000 7f3dda82c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3dd40604f0 0x7f3dd40b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.443+0000 7f3dda82c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40ab600 0x7f3dd4141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40b2550 con 0x7f3dd40b2170 2021-10-21T00:10:52.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd40b1350 con 0x7f3dd40604f0 2021-10-21T00:10:52.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd405f940 con 0x7f3dd40ab600 2021-10-21T00:10:52.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3dd40604f0 0x7f3dd40b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3dd40604f0 0x7f3dd40b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36200/0 (socket says 172.21.15.41:36200) 2021-10-21T00:10:52.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 -- 172.21.15.41:0/4097430879 learned_addr learned my addr 172.21.15.41:0/4097430879 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:52.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda02b700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40ab600 0x7f3dd4141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 -- 172.21.15.41:0/4097430879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40ab600 msgr2=0x7f3dd4141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:52.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40ab600 0x7f3dd4141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 -- 172.21.15.41:0/4097430879 >> v1:172.21.15.62:6789/0 conn(0x7f3dd40b2170 legacy=0x7f3dd405fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 -- 172.21.15.41:0/4097430879 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4142240 con 0x7f3dd40604f0 2021-10-21T00:10:52.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd9029700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd40b0d20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f3dd00032f0 tx=0x7f3dd0009290).ready entity=mon.0 client_cookie=579c351bc2560e8f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd8828700 1 -- 172.21.15.41:0/4097430879 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd000b8a0 con 0x7f3dd40604f0 2021-10-21T00:10:52.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd8828700 1 -- 172.21.15.41:0/4097430879 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000ba00 con 0x7f3dd40604f0 2021-10-21T00:10:52.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dd8828700 1 -- 172.21.15.41:0/4097430879 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd000bb70 con 0x7f3dd40604f0 2021-10-21T00:10:52.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- 172.21.15.41:0/4097430879 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 msgr2=0x7f3dd40b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd40b0d20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f3dd00032f0 tx=0x7f3dd0009290).stop 2021-10-21T00:10:52.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- 172.21.15.41:0/4097430879 shutdown_connections 2021-10-21T00:10:52.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40ab600 0x7f3dd4141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 --2- 172.21.15.41:0/4097430879 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd40b0d20 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- 172.21.15.41:0/4097430879 >> 172.21.15.41:0/4097430879 conn(0x7f3dd40b5700 msgr2=0x7f3dd40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:52.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- 172.21.15.41:0/4097430879 shutdown_connections 2021-10-21T00:10:52.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.447+0000 7f3dda82c700 1 -- 172.21.15.41:0/4097430879 wait complete. 2021-10-21T00:10:52.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 Processor -- start 2021-10-21T00:10:52.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- start start 2021-10-21T00:10:52.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd40ab600 0x7f3dd41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40b2170 0x7f3dd41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40ac240 con 0x7f3dd40604f0 2021-10-21T00:10:52.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40ac4e0 con 0x7f3dd40ab600 2021-10-21T00:10:52.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd409ab10 con 0x7f3dd40b2170 2021-10-21T00:10:52.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd9029700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd40ab600 0x7f3dd41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36208/0 (socket says 172.21.15.41:36208) 2021-10-21T00:10:52.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 -- 172.21.15.41:0/497909631 learned_addr learned my addr 172.21.15.41:0/497909631 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:52.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda02b700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40b2170 0x7f3dd41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 -- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40b2170 msgr2=0x7f3dd41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40b2170 0x7f3dd41557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 -- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd40ab600 msgr2=0x7f3dd41552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd40ab600 0x7f3dd41552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 -- 172.21.15.41:0/497909631 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009530 con 0x7f3dd40604f0 2021-10-21T00:10:52.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dd982a700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f3dd405d270 tx=0x7f3dc4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc4012400 con 0x7f3dd40604f0 2021-10-21T00:10:52.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc4012560 con 0x7f3dd40604f0 2021-10-21T00:10:52.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd413ee00 con 0x7f3dd40604f0 2021-10-21T00:10:52.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dc40128c0 con 0x7f3dd40604f0 2021-10-21T00:10:52.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.451+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd4099460 con 0x7f3dd40604f0 2021-10-21T00:10:52.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd4057350 con 0x7f3dd40604f0 2021-10-21T00:10:52.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3dc4019030 con 0x7f3dd40604f0 2021-10-21T00:10:52.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dc2ffd700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 0x7f3db4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3dc406adb0 con 0x7f3dd40604f0 2021-10-21T00:10:52.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dd9029700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 0x7f3db4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.455+0000 7f3dd9029700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 0x7f3db4055a40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3dd001b000 tx=0x7f3dd0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.463+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3dc4041e20 con 0x7f3dd40604f0 2021-10-21T00:10:52.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.627+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd41419d0 con 0x7f3dd40604f0 2021-10-21T00:10:52.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.627+0000 7f3dc2ffd700 1 -- 172.21.15.41:0/497909631 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f3dc4045440 con 0x7f3dd40604f0 2021-10-21T00:10:52.638 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:52.638 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:10:39.722912+0000","modified":"2021-10-21T00:10:52.307517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-10-21T00:10:52.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 msgr2=0x7f3db4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 0x7f3db4055a40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3dd001b000 tx=0x7f3dd0016000).stop 2021-10-21T00:10:52.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 msgr2=0x7f3dd4098430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f3dd405d270 tx=0x7f3dc4007c50).stop 2021-10-21T00:10:52.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 shutdown_connections 2021-10-21T00:10:52.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3db4053580 0x7f3db4055a40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3dd40b2170 0x7f3dd41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd40ab600 0x7f3dd41552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 --2- 172.21.15.41:0/497909631 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3dd40604f0 0x7f3dd4098430 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 >> 172.21.15.41:0/497909631 conn(0x7f3dd40b5700 msgr2=0x7f3dd40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:52.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 shutdown_connections 2021-10-21T00:10:52.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.631+0000 7f3dda82c700 1 -- 172.21.15.41:0/497909631 wait complete. 2021-10-21T00:10:52.643 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 52 2021-10-21T00:10:52.651 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:10:52.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 Processor -- start 2021-10-21T00:10:52.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 -- start start 2021-10-21T00:10:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40dc0aa750 0x7f40dc14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40dc0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc0609d0 con 0x7f40dc05f9f0 2021-10-21T00:10:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc0b1620 con 0x7f40dc0aa750 2021-10-21T00:10:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e3621700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc05fdd0 con 0x7f40dc14b350 2021-10-21T00:10:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e13bd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f40dc05f9f0 0x7f40dc14a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:33984/0 (socket says 172.21.15.41:33984) 2021-10-21T00:10:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e13bd700 1 -- 172.21.15.41:0/915962702 learned_addr learned my addr 172.21.15.41:0/915962702 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> v2:172.21.15.62:3300/0 conn(0x7f40dc0aa750 0x7f40dc14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e1bbe700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40dc0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267451844 0 0) 0x7f40dc0609d0 con 0x7f40dc05f9f0 2021-10-21T00:10:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c8003260 con 0x7f40dc05f9f0 2021-10-21T00:10:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 179724602 0 0) 0x7f40c8003260 con 0x7f40dc05f9f0 2021-10-21T00:10:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 msgr2=0x7f40dc0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40dc0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 >> v2:172.21.15.62:3300/0 conn(0x7f40dc0aa750 msgr2=0x7f40dc14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:52.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 --2- 172.21.15.41:0/915962702 >> v2:172.21.15.62:3300/0 conn(0x7f40dc0aa750 0x7f40dc14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc0b1380 con 0x7f40dc05f9f0 2021-10-21T00:10:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f40d8001680 con 0x7f40dc05f9f0 2021-10-21T00:10:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 >> v1:172.21.15.41:6789/0 conn(0x7f40dc05f9f0 legacy=0x7f40dc14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c8003750 0x7f40c8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40c8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b1620 con 0x7f40c8004500 2021-10-21T00:10:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc05fdd0 con 0x7f40c8003750 2021-10-21T00:10:52.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c800b750 con 0x7f40dc14b350 2021-10-21T00:10:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> v2:172.21.15.62:3300/0 conn(0x7f40dc0aa750 0x7f40dc14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e13bd700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c8003750 0x7f40c8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e1bbe700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40c8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 -- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 msgr2=0x7f40c8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc14b350 0x7f40c8004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 -- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c8003750 msgr2=0x7f40c8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c8003750 0x7f40c8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 -- 172.21.15.41:0/915962702 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8003260 con 0x7f40c8004500 2021-10-21T00:10:52.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e13bd700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40c8003750 0x7f40c8003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:52.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.751+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40c8004980 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f40d400c000 tx=0x7f40d40091d0).ready entity=mon.0 client_cookie=d0381b1f661c5bad server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d400e920 con 0x7f40c8004500 2021-10-21T00:10:52.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400ea80 con 0x7f40c8004500 2021-10-21T00:10:52.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40d3fff700 1 -- 172.21.15.41:0/915962702 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d400ede0 con 0x7f40c8004500 2021-10-21T00:10:52.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 -- 172.21.15.41:0/915962702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 msgr2=0x7f40c8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 --2- 172.21.15.41:0/915962702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40c8004980 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f40d400c000 tx=0x7f40d40091d0).stop 2021-10-21T00:10:52.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e1bbe700 1 -- 172.21.15.41:0/915962702 reap_dead start 2021-10-21T00:10:52.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 -- 172.21.15.41:0/915962702 shutdown_connections 2021-10-21T00:10:52.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 -- 172.21.15.41:0/915962702 >> 172.21.15.41:0/915962702 conn(0x7f40dc05bca0 msgr2=0x7f40dc05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:52.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 -- 172.21.15.41:0/915962702 shutdown_connections 2021-10-21T00:10:52.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.755+0000 7f40e3621700 1 -- 172.21.15.41:0/915962702 wait complete. 2021-10-21T00:10:52.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 Processor -- start 2021-10-21T00:10:52.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- start start 2021-10-21T00:10:52.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc0acb20 0x7f40dc159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40dc099140 0x7f40dc0995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc09a240 con 0x7f40c8004500 2021-10-21T00:10:52.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15a130 con 0x7f40dc099140 2021-10-21T00:10:52.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15a350 con 0x7f40dc0acb20 2021-10-21T00:10:52.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36226/0 (socket says 172.21.15.41:36226) 2021-10-21T00:10:52.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc0acb20 0x7f40dc159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 -- 172.21.15.41:0/3785788857 learned_addr learned my addr 172.21.15.41:0/3785788857 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:52.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e1bbe700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40dc099140 0x7f40dc0995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 -- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc0acb20 msgr2=0x7f40dc159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc0acb20 0x7f40dc159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 -- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40dc099140 msgr2=0x7f40dc0995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:52.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40dc099140 0x7f40dc0995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:52.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 -- 172.21.15.41:0/3785788857 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc15a5f0 con 0x7f40c8004500 2021-10-21T00:10:52.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e13bd700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f40dc15a270 tx=0x7f40dc0abcf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d8011850 con 0x7f40c8004500 2021-10-21T00:10:52.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80119b0 con 0x7f40c8004500 2021-10-21T00:10:52.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc15a890 con 0x7f40c8004500 2021-10-21T00:10:52.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d8011d10 con 0x7f40c8004500 2021-10-21T00:10:52.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.759+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0adad0 con 0x7f40c8004500 2021-10-21T00:10:52.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc156480 con 0x7f40c8004500 2021-10-21T00:10:52.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f40d801b030 con 0x7f40c8004500 2021-10-21T00:10:52.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40d27fc700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 0x7f40bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:52.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f40d806b6d0 con 0x7f40c8004500 2021-10-21T00:10:52.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 0x7f40bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:52.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.763+0000 7f40e0bbc700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 0x7f40bc055a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f40d401e000 tx=0x7f40d401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:52.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.767+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40d8042740 con 0x7f40c8004500 2021-10-21T00:10:52.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:52.931+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40dc0678f0 con 0x7f40c8004500 2021-10-21T00:10:53.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.311+0000 7f40d27fc700 1 -- 172.21.15.41:0/3785788857 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f40d8019070 con 0x7f40c8004500 2021-10-21T00:10:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 msgr2=0x7f40bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 0x7f40bc055a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f40d401e000 tx=0x7f40d401a000).stop 2021-10-21T00:10:53.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 msgr2=0x7f40dc143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f40dc15a270 tx=0x7f40dc0abcf0).stop 2021-10-21T00:10:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 shutdown_connections 2021-10-21T00:10:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40bc053580 0x7f40bc055a40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40dc099140 0x7f40dc0995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40dc0acb20 0x7f40dc159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 --2- 172.21.15.41:0/3785788857 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40c8004500 0x7f40dc143b10 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 >> 172.21.15.41:0/3785788857 conn(0x7f40dc05bca0 msgr2=0x7f40dc05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 shutdown_connections 2021-10-21T00:10:53.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.315+0000 7f40e3621700 1 -- 172.21.15.41:0/3785788857 wait complete. 2021-10-21T00:10:53.343 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:10:53.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 Processor -- start 2021-10-21T00:10:53.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 -- start start 2021-10-21T00:10:53.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f74f80b1fd0 0x7f74f80afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80af690 0x7f74f80b0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f80ab280 con 0x7f74f80b0720 2021-10-21T00:10:53.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f8067d70 con 0x7f74f80b1fd0 2021-10-21T00:10:53.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74fcdaf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80ab520 con 0x7f74f80af690 2021-10-21T00:10:53.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f74f80b0720 0x7f74f814a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34008/0 (socket says 172.21.15.41:34008) 2021-10-21T00:10:53.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f7fff700 1 -- 172.21.15.41:0/1757931254 learned_addr learned my addr 172.21.15.41:0/1757931254 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:53.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1757931254 >> v2:172.21.15.62:3300/0 conn(0x7f74f80b1fd0 0x7f74f80afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74eeffd700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80af690 0x7f74f80b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f6ffd700 1 -- 172.21.15.41:0/1757931254 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522280753 0 0) 0x7f74f80ab280 con 0x7f74f80b0720 2021-10-21T00:10:53.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f6ffd700 1 -- 172.21.15.41:0/1757931254 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d8003260 con 0x7f74f80b0720 2021-10-21T00:10:53.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 -- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80af690 msgr2=0x7f74f80b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:53.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80af690 0x7f74f80b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 -- 172.21.15.41:0/1757931254 >> v1:172.21.15.41:6789/0 conn(0x7f74f80b0720 legacy=0x7f74f814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 -- 172.21.15.41:0/1757931254 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80ab7c0 con 0x7f74f80b1fd0 2021-10-21T00:10:53.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80b1fd0 0x7f74f80afd40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f74e8002f70 tx=0x7f74e8006df0).ready entity=mon.1 client_cookie=a064cf8c735b542e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:53.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f6ffd700 1 -- 172.21.15.41:0/1757931254 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e800d4a0 con 0x7f74f80b1fd0 2021-10-21T00:10:53.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f6ffd700 1 -- 172.21.15.41:0/1757931254 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8000e90 con 0x7f74f80b1fd0 2021-10-21T00:10:53.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.455+0000 7f74f6ffd700 1 -- 172.21.15.41:0/1757931254 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e800d7f0 con 0x7f74f80b1fd0 2021-10-21T00:10:53.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80b1fd0 msgr2=0x7f74f80afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80b1fd0 0x7f74f80afd40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f74e8002f70 tx=0x7f74e8006df0).stop 2021-10-21T00:10:53.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1757931254 shutdown_connections 2021-10-21T00:10:53.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80af690 0x7f74f80b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1757931254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80b1fd0 0x7f74f80afd40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1757931254 >> 172.21.15.41:0/1757931254 conn(0x7f74f80b5700 msgr2=0x7f74f80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:53.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1757931254 shutdown_connections 2021-10-21T00:10:53.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1757931254 wait complete. 2021-10-21T00:10:53.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 Processor -- start 2021-10-21T00:10:53.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- start start 2021-10-21T00:10:53.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80af690 0x7f74f8159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80b1fd0 0x7f74f80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8099660 con 0x7f74f80b0720 2021-10-21T00:10:53.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8099900 con 0x7f74f80af690 2021-10-21T00:10:53.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.459+0000 7f74fcdaf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80acdf0 con 0x7f74f80b1fd0 2021-10-21T00:10:53.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36242/0 (socket says 172.21.15.41:36242) 2021-10-21T00:10:53.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 -- 172.21.15.41:0/1197194076 learned_addr learned my addr 172.21.15.41:0/1197194076 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:53.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80af690 0x7f74f8159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74f7fff700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80b1fd0 0x7f74f80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 -- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80b1fd0 msgr2=0x7f74f80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80b1fd0 0x7f74f80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 -- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80af690 msgr2=0x7f74f8159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:53.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80af690 0x7f74f8159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:53.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 -- 172.21.15.41:0/1197194076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e800b180 con 0x7f74f80b0720 2021-10-21T00:10:53.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74eeffd700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f74e000c000 tx=0x7f74e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:53.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e0010780 con 0x7f74f80b0720 2021-10-21T00:10:53.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00108e0 con 0x7f74f80b0720 2021-10-21T00:10:53.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f8147590 con 0x7f74f80b0720 2021-10-21T00:10:53.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e0010c40 con 0x7f74f80b0720 2021-10-21T00:10:53.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f80b39c0 con 0x7f74f80b0720 2021-10-21T00:10:53.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.463+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f80b31f0 con 0x7f74f80b0720 2021-10-21T00:10:53.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.467+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f74e001c460 con 0x7f74f80b0720 2021-10-21T00:10:53.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.467+0000 7f74f57fa700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 0x7f74dc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:53.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.467+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f74e006be60 con 0x7f74f80b0720 2021-10-21T00:10:53.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.467+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 0x7f74dc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:53.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.467+0000 7f74f77fe700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 0x7f74dc055b60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f74e801a000 tx=0x7f74e8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:53.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.471+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74e0042e00 con 0x7f74f80b0720 2021-10-21T00:10:53.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:53.603+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74f8099ac0 con 0x7f74f80b0720 2021-10-21T00:10:54.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.543+0000 7f74f57fa700 1 -- 172.21.15.41:0/1197194076 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 185+0+0 (secure 0 0 0) 0x7f74e0046420 con 0x7f74f80b0720 2021-10-21T00:10:54.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 msgr2=0x7f74dc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 0x7f74dc055b60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f74e801a000 tx=0x7f74e8014000).stop 2021-10-21T00:10:54.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 msgr2=0x7f74f80ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f74e000c000 tx=0x7f74e0006df0).stop 2021-10-21T00:10:54.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 shutdown_connections 2021-10-21T00:10:54.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74dc0536a0 0x7f74dc055b60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f74f80b1fd0 0x7f74f80b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f74f80b0720 0x7f74f80ac330 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 --2- 172.21.15.41:0/1197194076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74f80af690 0x7f74f8159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 >> 172.21.15.41:0/1197194076 conn(0x7f74f80b5700 msgr2=0x7f74f8097ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:54.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 shutdown_connections 2021-10-21T00:10:54.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.547+0000 7f74fcdaf700 1 -- 172.21.15.41:0/1197194076 wait complete. 2021-10-21T00:10:54.562 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:10:54.571 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:10:54.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 Processor -- start 2021-10-21T00:10:54.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 -- start start 2021-10-21T00:10:54.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 0x7f5adc1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0ba050 con 0x7f5adc0b9c70 2021-10-21T00:10:54.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc146360 con 0x7f5adc0b0660 2021-10-21T00:10:54.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ae11d0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc142bf0 con 0x7f5adc143a40 2021-10-21T00:10:54.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5adb59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 0x7f5adc1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:54748/0 (socket says 172.21.15.41:54748) 2021-10-21T00:10:54.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5adad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5adc0b9c70 0x7f5adc143330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42074/0 (socket says 172.21.15.41:42074) 2021-10-21T00:10:54.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5adb59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 0x7f5adc1419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48170/0 (socket says 172.21.15.41:48170) 2021-10-21T00:10:54.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 -- 172.21.15.41:0/588763669 learned_addr learned my addr 172.21.15.41:0/588763669 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:54.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 -- 172.21.15.41:0/588763669 >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 msgr2=0x7f5adc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:54.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 --2- 172.21.15.41:0/588763669 >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 0x7f5adc1419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 -- 172.21.15.41:0/588763669 >> v1:172.21.15.62:6789/0 conn(0x7f5adc0b9c70 legacy=0x7f5adc143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.675+0000 7f5ad259c700 1 -- 172.21.15.41:0/588763669 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc142e90 con 0x7f5adc143a40 2021-10-21T00:10:54.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ad259c700 1 --2- 172.21.15.41:0/588763669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5ac4002f70 tx=0x7f5ac4006eb0).ready entity=mon.2 client_cookie=cdde679bd1522ac1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:54.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ada59c700 1 -- 172.21.15.41:0/588763669 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac400d570 con 0x7f5adc143a40 2021-10-21T00:10:54.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ada59c700 1 -- 172.21.15.41:0/588763669 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4000e90 con 0x7f5adc143a40 2021-10-21T00:10:54.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ada59c700 1 -- 172.21.15.41:0/588763669 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac400d900 con 0x7f5adc143a40 2021-10-21T00:10:54.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- 172.21.15.41:0/588763669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 msgr2=0x7f5adc0b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/588763669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5ac4002f70 tx=0x7f5ac4006eb0).stop 2021-10-21T00:10:54.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- 172.21.15.41:0/588763669 shutdown_connections 2021-10-21T00:10:54.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/588763669 >> v2:172.21.15.62:3300/0 conn(0x7f5adc0b0660 0x7f5adc1419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/588763669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc0b3bc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- 172.21.15.41:0/588763669 >> 172.21.15.41:0/588763669 conn(0x7f5adc062f00 msgr2=0x7f5adc0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:54.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- 172.21.15.41:0/588763669 shutdown_connections 2021-10-21T00:10:54.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- 172.21.15.41:0/588763669 wait complete. 2021-10-21T00:10:54.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 Processor -- start 2021-10-21T00:10:54.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.679+0000 7f5ae11d0700 1 -- start start 2021-10-21T00:10:54.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5adc0b0660 0x7f5adc1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc13fdc0 con 0x7f5adc0b9c70 2021-10-21T00:10:54.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc152190 con 0x7f5adc0b0660 2021-10-21T00:10:54.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1165f0 con 0x7f5adc143a40 2021-10-21T00:10:54.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36256/0 (socket says 172.21.15.41:36256) 2021-10-21T00:10:54.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 -- 172.21.15.41:0/548513878 learned_addr learned my addr 172.21.15.41:0/548513878 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:54.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5adb59e700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5adad9d700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5adc0b0660 0x7f5adc1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 -- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 msgr2=0x7f5adc152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 -- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5adc0b0660 msgr2=0x7f5adc1453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:54.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5adc0b0660 0x7f5adc1453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:54.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 -- 172.21.15.41:0/548513878 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac400b1e0 con 0x7f5adc0b9c70 2021-10-21T00:10:54.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad259c700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f5ac4002f70 tx=0x7f5ac4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:54.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac4011760 con 0x7f5adc0b9c70 2021-10-21T00:10:54.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40118c0 con 0x7f5adc0b9c70 2021-10-21T00:10:54.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc112590 con 0x7f5adc0b9c70 2021-10-21T00:10:54.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac4011c20 con 0x7f5adc0b9c70 2021-10-21T00:10:54.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc0af370 con 0x7f5adc0b9c70 2021-10-21T00:10:54.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc146050 con 0x7f5adc0b9c70 2021-10-21T00:10:54.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ac4025030 con 0x7f5adc0b9c70 2021-10-21T00:10:54.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 0x7f5ac0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:54.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f5ac406ca50 con 0x7f5adc0b9c70 2021-10-21T00:10:54.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5adad9d700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 0x7f5ac0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:54.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.687+0000 7f5adad9d700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 0x7f5ac0055ad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5acc00d000 tx=0x7f5acc007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:54.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.695+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ac4043c00 con 0x7f5adc0b9c70 2021-10-21T00:10:54.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:54.819+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5adc057350 con 0x7f5adc0b9c70 2021-10-21T00:10:55.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.551+0000 7f5ad8d99700 1 -- 172.21.15.41:0/548513878 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5ac4023070 con 0x7f5adc0b9c70 2021-10-21T00:10:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 msgr2=0x7f5ac0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 0x7f5ac0055ad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f5acc00d000 tx=0x7f5acc007b80).stop 2021-10-21T00:10:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 msgr2=0x7f5adc116100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f5ac4002f70 tx=0x7f5ac4015000).stop 2021-10-21T00:10:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 shutdown_connections 2021-10-21T00:10:55.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ac0053610 0x7f5ac0055ad0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5adc143a40 0x7f5adc152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5adc0b9c70 0x7f5adc116100 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 --2- 172.21.15.41:0/548513878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5adc0b0660 0x7f5adc1453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 >> 172.21.15.41:0/548513878 conn(0x7f5adc062f00 msgr2=0x7f5adc0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:55.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 shutdown_connections 2021-10-21T00:10:55.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.555+0000 7f5ae11d0700 1 -- 172.21.15.41:0/548513878 wait complete. 2021-10-21T00:10:55.566 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:10:55.576 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:10:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.679+0000 7f1739906700 1 Processor -- start 2021-10-21T00:10:55.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.679+0000 7f1739906700 1 -- start start 2021-10-21T00:10:55.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f17340b3150 0x7f1734061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340b38b0 con 0x7f173405f9f0 2021-10-21T00:10:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1734061660 con 0x7f17340b19f0 2021-10-21T00:10:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340ad200 con 0x7f17340b3150 2021-10-21T00:10:55.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f17340b3150 0x7f1734061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f17340b3150 0x7f1734061ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36264/0 (socket says 172.21.15.41:36264) 2021-10-21T00:10:55.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 -- 172.21.15.41:0/150519577 learned_addr learned my addr 172.21.15.41:0/150519577 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:55.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1732ffd700 1 --1- 172.21.15.41:0/150519577 >> v1:172.21.15.41:6789/0 conn(0x7f173405f9f0 0x7f17341435d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34032/0 (socket says 172.21.15.41:34032) 2021-10-21T00:10:55.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 -- 172.21.15.41:0/150519577 >> v1:172.21.15.62:6789/0 conn(0x7f17340b19f0 legacy=0x7f1734061fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 -- 172.21.15.41:0/150519577 >> v1:172.21.15.41:6789/0 conn(0x7f173405f9f0 legacy=0x7f17341435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 -- 172.21.15.41:0/150519577 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173405fdd0 con 0x7f17340b3150 2021-10-21T00:10:55.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f172bfff700 1 --2- 172.21.15.41:0/150519577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17340b3150 0x7f1734061ac0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f171c002f70 tx=0x7f171c006eb0).ready entity=mon.0 client_cookie=d694338d5d3bbbff server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f17327fc700 1 -- 172.21.15.41:0/150519577 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00d660 con 0x7f17340b3150 2021-10-21T00:10:55.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f17327fc700 1 -- 172.21.15.41:0/150519577 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c000e90 con 0x7f17340b3150 2021-10-21T00:10:55.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f17327fc700 1 -- 172.21.15.41:0/150519577 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00d9f0 con 0x7f17340b3150 2021-10-21T00:10:55.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- 172.21.15.41:0/150519577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17340b3150 msgr2=0x7f1734061ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 --2- 172.21.15.41:0/150519577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17340b3150 0x7f1734061ac0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f171c002f70 tx=0x7f171c006eb0).stop 2021-10-21T00:10:55.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- 172.21.15.41:0/150519577 shutdown_connections 2021-10-21T00:10:55.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 --2- 172.21.15.41:0/150519577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f17340b3150 0x7f1734061ac0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- 172.21.15.41:0/150519577 >> 172.21.15.41:0/150519577 conn(0x7f17340b3af0 msgr2=0x7f17340b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:55.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- 172.21.15.41:0/150519577 shutdown_connections 2021-10-21T00:10:55.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.683+0000 7f1739906700 1 -- 172.21.15.41:0/150519577 wait complete. 2021-10-21T00:10:55.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 Processor -- start 2021-10-21T00:10:55.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- start start 2021-10-21T00:10:55.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340b19f0 0x7f1734152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17340b3150 0x7f1734153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734065d10 con 0x7f173405f9f0 2021-10-21T00:10:55.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734097790 con 0x7f17340b19f0 2021-10-21T00:10:55.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1734094070 con 0x7f17340b3150 2021-10-21T00:10:55.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36268/0 (socket says 172.21.15.41:36268) 2021-10-21T00:10:55.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 -- 172.21.15.41:0/1546488426 learned_addr learned my addr 172.21.15.41:0/1546488426 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:55.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f172bfff700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340b19f0 0x7f1734152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f17337fe700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17340b3150 0x7f1734153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 -- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17340b3150 msgr2=0x7f1734153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17340b3150 0x7f1734153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 -- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340b19f0 msgr2=0x7f1734152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340b19f0 0x7f1734152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 -- 172.21.15.41:0/1546488426 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c00b1e0 con 0x7f173405f9f0 2021-10-21T00:10:55.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1732ffd700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f1734097920 tx=0x7f1724007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17240070d0 con 0x7f173405f9f0 2021-10-21T00:10:55.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724007230 con 0x7f173405f9f0 2021-10-21T00:10:55.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340974f0 con 0x7f173405f9f0 2021-10-21T00:10:55.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1724005550 con 0x7f173405f9f0 2021-10-21T00:10:55.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.687+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734093a10 con 0x7f173405f9f0 2021-10-21T00:10:55.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.691+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1734143ce0 con 0x7f173405f9f0 2021-10-21T00:10:55.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.691+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f172401a070 con 0x7f173405f9f0 2021-10-21T00:10:55.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.691+0000 7f1730ff9700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 0x7f17180559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.695+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f172406a6f0 con 0x7f173405f9f0 2021-10-21T00:10:55.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.695+0000 7f172bfff700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 0x7f17180559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.695+0000 7f172bfff700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 0x7f17180559e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f171c01c000 tx=0x7f171c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.699+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1724041a20 con 0x7f173405f9f0 2021-10-21T00:10:55.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.827+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1734060590 con 0x7f173405f9f0 2021-10-21T00:10:55.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1730ff9700 1 -- 172.21.15.41:0/1546488426 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1724018070 con 0x7f173405f9f0 2021-10-21T00:10:55.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 msgr2=0x7f17180559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 0x7f17180559e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f171c01c000 tx=0x7f171c015000).stop 2021-10-21T00:10:55.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 msgr2=0x7f17340655d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f1734097920 tx=0x7f1724007c40).stop 2021-10-21T00:10:55.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 shutdown_connections 2021-10-21T00:10:55.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1718053520 0x7f17180559e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f17340b3150 0x7f1734153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17340b19f0 0x7f1734152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 --2- 172.21.15.41:0/1546488426 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f173405f9f0 0x7f17340655d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 >> 172.21.15.41:0/1546488426 conn(0x7f17340b3af0 msgr2=0x7f17340b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:55.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 shutdown_connections 2021-10-21T00:10:55.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.835+0000 7f1739906700 1 -- 172.21.15.41:0/1546488426 wait complete. 2021-10-21T00:10:55.854 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-10-21T00:10:55.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 Processor -- start 2021-10-21T00:10:55.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 -- start start 2021-10-21T00:10:55.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8de00b2170 0x7f8de00ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8de00abb50 0x7f8de014a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de00b0b50 con 0x7f8de00abb50 2021-10-21T00:10:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de00b2550 con 0x7f8de00b2170 2021-10-21T00:10:55.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8de4d74700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b0d90 con 0x7f8de00af620 2021-10-21T00:10:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8de00abb50 0x7f8de014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8de00abb50 0x7f8de014a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36280/0 (socket says 172.21.15.41:36280) 2021-10-21T00:10:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddeffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddf7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8de00b2170 0x7f8de00ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 -- 172.21.15.41:0/273563153 learned_addr learned my addr 172.21.15.41:0/273563153 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 -- 172.21.15.41:0/273563153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 msgr2=0x7f8de00ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 --2- 172.21.15.41:0/273563153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 -- 172.21.15.41:0/273563153 >> v2:172.21.15.62:3300/0 conn(0x7f8de00b2170 msgr2=0x7f8de00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 --2- 172.21.15.41:0/273563153 >> v2:172.21.15.62:3300/0 conn(0x7f8de00b2170 0x7f8de00ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.951+0000 7f8ddffff700 1 -- 172.21.15.41:0/273563153 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00b1030 con 0x7f8de00abb50 2021-10-21T00:10:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8ddffff700 1 --2- 172.21.15.41:0/273563153 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00abb50 0x7f8de014a410 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f8dd8002f70 tx=0x7f8dd8006eb0).ready entity=mon.0 client_cookie=76d379b4906a4dce server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8dde7fc700 1 -- 172.21.15.41:0/273563153 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd800d570 con 0x7f8de00abb50 2021-10-21T00:10:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8dde7fc700 1 -- 172.21.15.41:0/273563153 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd8000e90 con 0x7f8de00abb50 2021-10-21T00:10:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8dde7fc700 1 -- 172.21.15.41:0/273563153 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd800d900 con 0x7f8de00abb50 2021-10-21T00:10:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- 172.21.15.41:0/273563153 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00abb50 msgr2=0x7f8de014a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 --2- 172.21.15.41:0/273563153 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00abb50 0x7f8de014a410 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f8dd8002f70 tx=0x7f8dd8006eb0).stop 2021-10-21T00:10:55.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- 172.21.15.41:0/273563153 shutdown_connections 2021-10-21T00:10:55.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 --2- 172.21.15.41:0/273563153 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00abb50 0x7f8de014a410 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 --2- 172.21.15.41:0/273563153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 --2- 172.21.15.41:0/273563153 >> v2:172.21.15.62:3300/0 conn(0x7f8de00b2170 0x7f8de00ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- 172.21.15.41:0/273563153 >> 172.21.15.41:0/273563153 conn(0x7f8de00b5700 msgr2=0x7f8de00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:55.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- 172.21.15.41:0/273563153 shutdown_connections 2021-10-21T00:10:55.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- 172.21.15.41:0/273563153 wait complete. 2021-10-21T00:10:55.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 Processor -- start 2021-10-21T00:10:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.955+0000 7f8de4d74700 1 -- start start 2021-10-21T00:10:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de00abb50 0x7f8de0099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de0146b20 con 0x7f8de00b2170 2021-10-21T00:10:55.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00ac0c0 con 0x7f8de00abb50 2021-10-21T00:10:55.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00ad860 con 0x7f8de00af620 2021-10-21T00:10:55.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36286/0 (socket says 172.21.15.41:36286) 2021-10-21T00:10:55.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 -- 172.21.15.41:0/1326578792 learned_addr learned my addr 172.21.15.41:0/1326578792 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:55.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddf7fe700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de00abb50 0x7f8de0099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddeffd700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 -- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 msgr2=0x7f8de00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 -- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de00abb50 msgr2=0x7f8de0099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:55.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de00abb50 0x7f8de0099cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 -- 172.21.15.41:0/1326578792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd800b1e0 con 0x7f8de00b2170 2021-10-21T00:10:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddffff700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f8dd8002f70 tx=0x7f8dd8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd80116e0 con 0x7f8de00b2170 2021-10-21T00:10:55.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd8011840 con 0x7f8de00b2170 2021-10-21T00:10:55.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd8011ba0 con 0x7f8de00b2170 2021-10-21T00:10:55.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de00acf50 con 0x7f8de00b2170 2021-10-21T00:10:55.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.959+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de00aca10 con 0x7f8de00b2170 2021-10-21T00:10:55.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8dd801a040 con 0x7f8de00b2170 2021-10-21T00:10:55.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de00ada60 con 0x7f8de00b2170 2021-10-21T00:10:55.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8ddcff9700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 0x7f8dc0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:55.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8dd806c370 con 0x7f8de00b2170 2021-10-21T00:10:55.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8ddf7fe700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 0x7f8dc0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:55.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.963+0000 7f8ddf7fe700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 0x7f8dc0055a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f8dd400b000 tx=0x7f8dd4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:55.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:55.967+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8dd80437a0 con 0x7f8de00b2170 2021-10-21T00:10:56.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.131+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f8de00b12d0 con 0x7f8de00b2170 2021-10-21T00:10:56.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8ddcff9700 1 -- 172.21.15.41:0/1326578792 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v356) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8dd80230c0 con 0x7f8de00b2170 2021-10-21T00:10:56.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 msgr2=0x7f8dc0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 0x7f8dc0055a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f8dd400b000 tx=0x7f8dd4006df0).stop 2021-10-21T00:10:56.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 msgr2=0x7f8de00ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f8dd8002f70 tx=0x7f8dd8015000).stop 2021-10-21T00:10:56.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 shutdown_connections 2021-10-21T00:10:56.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8dc0053580 0x7f8dc0055a40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8de00b2170 0x7f8de00ae2d0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de00af620 0x7f8de00adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 --2- 172.21.15.41:0/1326578792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de00abb50 0x7f8de0099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.563+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 >> 172.21.15.41:0/1326578792 conn(0x7f8de00b5700 msgr2=0x7f8de005f840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:56.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.567+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 shutdown_connections 2021-10-21T00:10:56.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.567+0000 7f8de4d74700 1 -- 172.21.15.41:0/1326578792 wait complete. 2021-10-21T00:10:56.587 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:10:56.588 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:10:56.588 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-10-21T00:10:56.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 Processor -- start 2021-10-21T00:10:56.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 -- start start 2021-10-21T00:10:56.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 0x7f408c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f408c14b350 0x7f408c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0609d0 con 0x7f408c05f9f0 2021-10-21T00:10:56.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0b1620 con 0x7f408c14b350 2021-10-21T00:10:56.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f4091cbd700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c05fdd0 con 0x7f408c0aa750 2021-10-21T00:10:56.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f408c14b350 0x7f408c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f408c14b350 0x7f408c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36294/0 (socket says 172.21.15.41:36294) 2021-10-21T00:10:56.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 -- 172.21.15.41:0/2948810072 learned_addr learned my addr 172.21.15.41:0/2948810072 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:56.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408affd700 1 --2- 172.21.15.41:0/2948810072 >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 0x7f408c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 -- 172.21.15.41:0/2948810072 >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 msgr2=0x7f408c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:56.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 --2- 172.21.15.41:0/2948810072 >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 0x7f408c14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 -- 172.21.15.41:0/2948810072 >> v1:172.21.15.62:6789/0 conn(0x7f408c05f9f0 legacy=0x7f408c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 -- 172.21.15.41:0/2948810072 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0b1380 con 0x7f408c14b350 2021-10-21T00:10:56.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408affd700 1 --2- 172.21.15.41:0/2948810072 >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 0x7f408c14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:10:56.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408bfff700 1 --2- 172.21.15.41:0/2948810072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c14b350 0x7f408c0af7c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f40840032f0 tx=0x7f4084009290).ready entity=mon.0 client_cookie=10d5545287d0ea44 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:56.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408a7fc700 1 -- 172.21.15.41:0/2948810072 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408400b870 con 0x7f408c14b350 2021-10-21T00:10:56.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408a7fc700 1 -- 172.21.15.41:0/2948810072 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400b9d0 con 0x7f408c14b350 2021-10-21T00:10:56.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.695+0000 7f408a7fc700 1 -- 172.21.15.41:0/2948810072 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408400bb40 con 0x7f408c14b350 2021-10-21T00:10:56.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- 172.21.15.41:0/2948810072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c14b350 msgr2=0x7f408c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2948810072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c14b350 0x7f408c0af7c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f40840032f0 tx=0x7f4084009290).stop 2021-10-21T00:10:56.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- 172.21.15.41:0/2948810072 shutdown_connections 2021-10-21T00:10:56.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2948810072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c14b350 0x7f408c0af7c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2948810072 >> v2:172.21.15.62:3300/0 conn(0x7f408c0aa750 0x7f408c14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- 172.21.15.41:0/2948810072 >> 172.21.15.41:0/2948810072 conn(0x7f408c05bca0 msgr2=0x7f408c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:56.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- 172.21.15.41:0/2948810072 shutdown_connections 2021-10-21T00:10:56.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- 172.21.15.41:0/2948810072 wait complete. 2021-10-21T00:10:56.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 Processor -- start 2021-10-21T00:10:56.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- start start 2021-10-21T00:10:56.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f408c0aa750 0x7f408c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f408c14b350 0x7f408c143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0ad650 con 0x7f408c05f9f0 2021-10-21T00:10:56.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1464a0 con 0x7f408c14b350 2021-10-21T00:10:56.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f4091cbd700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c146740 con 0x7f408c0aa750 2021-10-21T00:10:56.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36296/0 (socket says 172.21.15.41:36296) 2021-10-21T00:10:56.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 -- 172.21.15.41:0/2649695440 learned_addr learned my addr 172.21.15.41:0/2649695440 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:56.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408affd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f408c0aa750 0x7f408c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408bfff700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f408c14b350 0x7f408c143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 -- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f408c0aa750 msgr2=0x7f408c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f408c0aa750 0x7f408c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 -- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f408c14b350 msgr2=0x7f408c143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:56.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f408c14b350 0x7f408c143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:56.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 -- 172.21.15.41:0/2649695440 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084009530 con 0x7f408c05f9f0 2021-10-21T00:10:56.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.699+0000 7f408b7fe700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f408c0af680 tx=0x7f4080007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:56.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f408000ce30 con 0x7f408c05f9f0 2021-10-21T00:10:56.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080007240 con 0x7f408c05f9f0 2021-10-21T00:10:56.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4080006700 con 0x7f408c05f9f0 2021-10-21T00:10:56.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c143630 con 0x7f408c05f9f0 2021-10-21T00:10:56.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c0ad220 con 0x7f408c05f9f0 2021-10-21T00:10:56.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c0af120 con 0x7f408c05f9f0 2021-10-21T00:10:56.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4080010030 con 0x7f408c05f9f0 2021-10-21T00:10:56.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.703+0000 7f4088ff9700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 0x7f406c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:56.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.707+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f408006b720 con 0x7f408c05f9f0 2021-10-21T00:10:56.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.707+0000 7f408affd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 0x7f406c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:56.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.707+0000 7f408affd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 0x7f406c055b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f407c00c000 tx=0x7f407c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:56.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.711+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4080042a50 con 0x7f408c05f9f0 2021-10-21T00:10:56.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:56.879+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f408c0af120 con 0x7f408c05f9f0 2021-10-21T00:10:57.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.563+0000 7f4088ff9700 1 -- 172.21.15.41:0/2649695440 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v357) v1 ==== 125+0+0 (secure 0 0 0) 0x7f408c0af120 con 0x7f408c05f9f0 2021-10-21T00:10:57.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 msgr2=0x7f406c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 0x7f406c055b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f407c00c000 tx=0x7f407c008040).stop 2021-10-21T00:10:57.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 msgr2=0x7f408c1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f408c0af680 tx=0x7f4080007c10).stop 2021-10-21T00:10:57.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 shutdown_connections 2021-10-21T00:10:57.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f406c053640 0x7f406c055b00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f408c14b350 0x7f408c143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f408c0aa750 0x7f408c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 --2- 172.21.15.41:0/2649695440 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f408c05f9f0 0x7f408c1472a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 >> 172.21.15.41:0/2649695440 conn(0x7f408c05bca0 msgr2=0x7f408c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:57.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 shutdown_connections 2021-10-21T00:10:57.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.567+0000 7f4091cbd700 1 -- 172.21.15.41:0/2649695440 wait complete. 2021-10-21T00:10:57.591 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:10:57.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 Processor -- start 2021-10-21T00:10:57.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 -- start start 2021-10-21T00:10:57.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d08128450 0x7f6d08128870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6d08128d60 0x7f6d0813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080ad850 con 0x7f6d080b17e0 2021-10-21T00:10:57.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080ae0e0 con 0x7f6d08128d60 2021-10-21T00:10:57.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080ad5b0 con 0x7f6d08128450 2021-10-21T00:10:57.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6d08128d60 0x7f6d0813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6d08128d60 0x7f6d0813fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36306/0 (socket says 172.21.15.41:36306) 2021-10-21T00:10:57.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 -- 172.21.15.41:0/106958140 learned_addr learned my addr 172.21.15.41:0/106958140 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:57.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d05d9b700 1 --2- 172.21.15.41:0/106958140 >> v2:172.21.15.62:3300/0 conn(0x7f6d08128450 0x7f6d08128870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 -- 172.21.15.41:0/106958140 >> v2:172.21.15.62:3300/0 conn(0x7f6d08128450 msgr2=0x7f6d08128870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:57.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 --2- 172.21.15.41:0/106958140 >> v2:172.21.15.62:3300/0 conn(0x7f6d08128450 0x7f6d08128870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 -- 172.21.15.41:0/106958140 >> v1:172.21.15.62:6789/0 conn(0x7f6d080b17e0 legacy=0x7f6d080b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d0559a700 1 -- 172.21.15.41:0/106958140 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195662206 0 0) 0x7f6d080ad850 con 0x7f6d080b17e0 2021-10-21T00:10:57.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.707+0000 7f6d06d9d700 1 -- 172.21.15.41:0/106958140 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0813f7d0 con 0x7f6d08128d60 2021-10-21T00:10:57.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d06d9d700 1 --2- 172.21.15.41:0/106958140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128d60 0x7f6d0813fc70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f6d000032f0 tx=0x7f6d00009290).ready entity=mon.0 client_cookie=4401d9249aa7be68 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:57.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0559a700 1 -- 172.21.15.41:0/106958140 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d0000b870 con 0x7f6d08128d60 2021-10-21T00:10:57.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0559a700 1 -- 172.21.15.41:0/106958140 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000b9d0 con 0x7f6d08128d60 2021-10-21T00:10:57.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0559a700 1 -- 172.21.15.41:0/106958140 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d0000bb40 con 0x7f6d08128d60 2021-10-21T00:10:57.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 -- 172.21.15.41:0/106958140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128d60 msgr2=0x7f6d0813fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 --2- 172.21.15.41:0/106958140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128d60 0x7f6d0813fc70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f6d000032f0 tx=0x7f6d00009290).stop 2021-10-21T00:10:57.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 -- 172.21.15.41:0/106958140 shutdown_connections 2021-10-21T00:10:57.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 --2- 172.21.15.41:0/106958140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128d60 0x7f6d0813fc70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 --2- 172.21.15.41:0/106958140 >> v2:172.21.15.62:3300/0 conn(0x7f6d08128450 0x7f6d08128870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 -- 172.21.15.41:0/106958140 >> 172.21.15.41:0/106958140 conn(0x7f6d080627b0 msgr2=0x7f6d08062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:57.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 -- 172.21.15.41:0/106958140 shutdown_connections 2021-10-21T00:10:57.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.711+0000 7f6d0759e700 1 -- 172.21.15.41:0/106958140 wait complete. 2021-10-21T00:10:57.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 Processor -- start 2021-10-21T00:10:57.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- start start 2021-10-21T00:10:57.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080b17e0 0x7f6d08145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d08128d60 0x7f6d08151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08065230 con 0x7f6d08128450 2021-10-21T00:10:57.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08065960 con 0x7f6d080b17e0 2021-10-21T00:10:57.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08065420 con 0x7f6d08128d60 2021-10-21T00:10:57.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36310/0 (socket says 172.21.15.41:36310) 2021-10-21T00:10:57.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 -- 172.21.15.41:0/2845138442 learned_addr learned my addr 172.21.15.41:0/2845138442 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:57.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0659c700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080b17e0 0x7f6d08145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d06d9d700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d08128d60 0x7f6d08151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 -- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d08128d60 msgr2=0x7f6d08151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d08128d60 0x7f6d08151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 -- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080b17e0 msgr2=0x7f6d08145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080b17e0 0x7f6d08145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 -- 172.21.15.41:0/2845138442 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00009530 con 0x7f6d08128450 2021-10-21T00:10:57.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d05d9b700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6cf000c000 tx=0x7f6cf0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:57.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cf0010780 con 0x7f6d08128450 2021-10-21T00:10:57.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf00108e0 con 0x7f6d08128450 2021-10-21T00:10:57.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d080656c0 con 0x7f6d08128450 2021-10-21T00:10:57.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cf0010c40 con 0x7f6d08128450 2021-10-21T00:10:57.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.715+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d08151940 con 0x7f6d08128450 2021-10-21T00:10:57.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.719+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08150d00 con 0x7f6d08128450 2021-10-21T00:10:57.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.719+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6cf001c460 con 0x7f6d08128450 2021-10-21T00:10:57.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.719+0000 7f6cff7fe700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 0x7f6cec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:57.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.719+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6cf006ba20 con 0x7f6d08128450 2021-10-21T00:10:57.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.719+0000 7f6d0659c700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 0x7f6cec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:57.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.723+0000 7f6d0659c700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 0x7f6cec055b60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f6cf800d000 tx=0x7f6cf80079d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:57.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.727+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6cf0042e00 con 0x7f6d08128450 2021-10-21T00:10:57.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.855+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6d080ad2a0 con 0x7f6d08128450 2021-10-21T00:10:57.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.863+0000 7f6cff7fe700 1 -- 172.21.15.41:0/2845138442 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cf0046420 con 0x7f6d08128450 2021-10-21T00:10:57.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 msgr2=0x7f6cec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 0x7f6cec055b60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f6cf800d000 tx=0x7f6cf80079d0).stop 2021-10-21T00:10:57.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 msgr2=0x7f6d08150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:57.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f6cf000c000 tx=0x7f6cf0006df0).stop 2021-10-21T00:10:57.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 shutdown_connections 2021-10-21T00:10:57.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6cec0536a0 0x7f6cec055b60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d08128d60 0x7f6d08151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6d08128450 0x7f6d08150f60 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 --2- 172.21.15.41:0/2845138442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d080b17e0 0x7f6d08145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:57.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 >> 172.21.15.41:0/2845138442 conn(0x7f6d080627b0 msgr2=0x7f6d08143c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:57.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 shutdown_connections 2021-10-21T00:10:57.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:57.867+0000 7f6d0759e700 1 -- 172.21.15.41:0/2845138442 wait complete. 2021-10-21T00:10:57.885 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:10:57.886 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:57.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:57.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:57.949 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:57.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:10:57.993 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:10:57.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:57.994 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:57.995 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:10:58.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:10:58.006 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:10:58.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:58.007 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:58.008 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:10:58.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:58.022 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:10:58.023 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:10:58.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:10:58.024 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:10:58.025 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:10:58.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:10:58.043 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:10:58.043 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:10:58.048 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:10:58.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 Processor -- start 2021-10-21T00:10:58.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 -- start start 2021-10-21T00:10:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d740b2170 0x7f1d740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d740ab600 0x7f1d7405fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740b2550 con 0x7f1d740602d0 2021-10-21T00:10:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740aba40 con 0x7f1d740b2170 2021-10-21T00:10:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d7ac73700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d74142d60 con 0x7f1d740ab600 2021-10-21T00:10:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d79c71700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d740b2170 0x7f1d740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d79c71700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1d740b2170 0x7f1d740b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36320/0 (socket says 172.21.15.41:36320) 2021-10-21T00:10:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d79c71700 1 -- 172.21.15.41:0/2997966203 learned_addr learned my addr 172.21.15.41:0/2997966203 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.155+0000 7f1d79470700 1 --2- 172.21.15.41:0/2997966203 >> v2:172.21.15.62:3300/0 conn(0x7f1d740ab600 0x7f1d7405fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d79c71700 1 -- 172.21.15.41:0/2997966203 >> v2:172.21.15.62:3300/0 conn(0x7f1d740ab600 msgr2=0x7f1d7405fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:58.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d79c71700 1 --2- 172.21.15.41:0/2997966203 >> v2:172.21.15.62:3300/0 conn(0x7f1d740ab600 0x7f1d7405fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d79c71700 1 -- 172.21.15.41:0/2997966203 >> v1:172.21.15.62:6789/0 conn(0x7f1d740602d0 legacy=0x7f1d74145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d79c71700 1 -- 172.21.15.41:0/2997966203 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740b1350 con 0x7f1d740b2170 2021-10-21T00:10:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d79c71700 1 --2- 172.21.15.41:0/2997966203 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740b2170 0x7f1d740b0d20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1d740abb80 tx=0x7f1d64006eb0).ready entity=mon.0 client_cookie=cbd756f71dc2e9fa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d78c6f700 1 -- 172.21.15.41:0/2997966203 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6400d610 con 0x7f1d740b2170 2021-10-21T00:10:58.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d78c6f700 1 -- 172.21.15.41:0/2997966203 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64000e90 con 0x7f1d740b2170 2021-10-21T00:10:58.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d78c6f700 1 -- 172.21.15.41:0/2997966203 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6400d9a0 con 0x7f1d740b2170 2021-10-21T00:10:58.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 -- 172.21.15.41:0/2997966203 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740b2170 msgr2=0x7f1d740b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/2997966203 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740b2170 0x7f1d740b0d20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1d740abb80 tx=0x7f1d64006eb0).stop 2021-10-21T00:10:58.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 -- 172.21.15.41:0/2997966203 shutdown_connections 2021-10-21T00:10:58.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/2997966203 >> v2:172.21.15.62:3300/0 conn(0x7f1d740ab600 0x7f1d7405fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/2997966203 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740b2170 0x7f1d740b0d20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 -- 172.21.15.41:0/2997966203 >> 172.21.15.41:0/2997966203 conn(0x7f1d740b5700 msgr2=0x7f1d740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:58.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 -- 172.21.15.41:0/2997966203 shutdown_connections 2021-10-21T00:10:58.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.159+0000 7f1d7ac73700 1 -- 172.21.15.41:0/2997966203 wait complete. 2021-10-21T00:10:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 Processor -- start 2021-10-21T00:10:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 -- start start 2021-10-21T00:10:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d740ab600 0x7f1d74141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d740b2170 0x7f1d741423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74090150 con 0x7f1d740602d0 2021-10-21T00:10:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74090380 con 0x7f1d740b2170 2021-10-21T00:10:58.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7ac73700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ac240 con 0x7f1d740ab600 2021-10-21T00:10:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36324/0 (socket says 172.21.15.41:36324) 2021-10-21T00:10:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 -- 172.21.15.41:0/936253156 learned_addr learned my addr 172.21.15.41:0/936253156 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79470700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d740ab600 0x7f1d74141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d7a472700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d740b2170 0x7f1d741423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 -- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d740ab600 msgr2=0x7f1d74141ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d740ab600 0x7f1d74141ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 -- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d740b2170 msgr2=0x7f1d741423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d740b2170 0x7f1d741423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 -- 172.21.15.41:0/936253156 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6400b1e0 con 0x7f1d740602d0 2021-10-21T00:10:58.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.163+0000 7f1d79c71700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f1d740abb80 tx=0x7f1d64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d64021070 con 0x7f1d740602d0 2021-10-21T00:10:58.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64006b40 con 0x7f1d740602d0 2021-10-21T00:10:58.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740ac6e0 con 0x7f1d740602d0 2021-10-21T00:10:58.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d64011e20 con 0x7f1d740602d0 2021-10-21T00:10:58.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7409a8e0 con 0x7f1d740602d0 2021-10-21T00:10:58.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d6400f070 con 0x7f1d740602d0 2021-10-21T00:10:58.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7405f940 con 0x7f1d740602d0 2021-10-21T00:10:58.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 0x7f1d54055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1d6406c980 con 0x7f1d740602d0 2021-10-21T00:10:58.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d79470700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 0x7f1d54055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.167+0000 7f1d79470700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 0x7f1d54055ad0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f1d7000b000 tx=0x7f1d70006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.171+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d64043cb0 con 0x7f1d740602d0 2021-10-21T00:10:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.295+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1d74090540 con 0x7f1d740602d0 2021-10-21T00:10:58.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.295+0000 7f1d62ffd700 1 -- 172.21.15.41:0/936253156 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+28827 (secure 0 0 0) 0x7f1d640472d0 con 0x7f1d740602d0 2021-10-21T00:10:58.303 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:58.304 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:10:58.305 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 101, 2021-10-21T00:10:58.305 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:10:58.305 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:10:58.306 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:10:55.543418+0000", 2021-10-21T00:10:58.306 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:58.306 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:10:58.307 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:10:58.307 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:10:58.307 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:10:58.308 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:10:58.308 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:10:58.308 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:10:58.309 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:10:58.309 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:58.309 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:10:58.310 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:10:58.310 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:10:58.310 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:10:58.311 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:10:58.311 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 20, 2021-10-21T00:10:58.312 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:10:58.312 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:10:58.312 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:10:58.312 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:10:58.313 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:10:58.313 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.314 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:10:58.314 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:10:58.314 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:10:58.314 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:58.315 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:58.315 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:58.316 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:58.316 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:58.316 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:58.317 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:58.317 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:58.317 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:10:58.318 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:10:58.318 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:10:58.319 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:10:58.319 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:10:58.320 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:58.320 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:58.320 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:58.320 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:58.321 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:58.321 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:58.321 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:58.321 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.321 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:10:58.323 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:58.323 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:58.323 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:58.323 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:58.324 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:58.324 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:58.324 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:58.325 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:58.325 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:58.326 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:58.326 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:58.326 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:58.326 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:58.327 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:58.327 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:58.328 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:58.328 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:58.328 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:58.328 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:58.328 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:58.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:58.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:58.329 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:58.329 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:58.330 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:58.330 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:58.330 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.330 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:58.330 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:58.331 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:58.331 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:58.331 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:58.332 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:58.332 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:58.332 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:58.333 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:58.333 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:58.334 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:58.334 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:10:58.335 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:10:58.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.336 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:58.336 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:10:58.337 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.337 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.338 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.338 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:10:58.338 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:10:58.338 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:10:58.338 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:10:58.339 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:10:58.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:10:58.339 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:10:58.339 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:10:58.340 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:10:58.340 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:10:58.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:10:58.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:10:58.340 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:10:58.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:10:58.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:10:58.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:10:58.342 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:10:58.342 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:10:58.342 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:10:58.343 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:10:58.344 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:10:58.344 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:10:58.344 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:10:58.344 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:10:58.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:10:58.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:10:58.345 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:10:58.346 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:10:58.346 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:10:58.346 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:10:58.346 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:10:58.347 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:10:58.347 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:10:58.347 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:10:58.348 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:10:58.348 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:10:58.348 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:10:58.348 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:10:58.349 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:10:58.349 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:10:58.349 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:10:58.349 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:10:58.349 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:10:58.350 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:10:58.350 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:10:58.350 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:10:58.350 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:10:58.351 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:10:58.351 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:10:58.351 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:10:58.351 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.352 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:10:58.352 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:10:58.352 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:10:58.352 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:10:58.352 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:10:58.353 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:10:58.353 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:10:58.353 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:10:58.353 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:10:58.354 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:10:58.354 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:10:58.354 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:10:58.355 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:10:58.355 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:10:58.355 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.355 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.356 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:58.356 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:10:58.356 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.356 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:58.356 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:10:58.357 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.357 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.357 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.357 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.358 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.358 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.358 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.358 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:58.358 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.359 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.359 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.359 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.359 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.360 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.360 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:10:58.360 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.360 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.360 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.361 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.361 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:10:58.361 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.361 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.362 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.362 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.362 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.362 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.362 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.363 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.363 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:10:58.363 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.363 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.364 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.364 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:10:58.364 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.364 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.365 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.365 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.365 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.365 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.366 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.366 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:10:58.366 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.367 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.367 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.367 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.368 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:10:58.368 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.368 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.369 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.369 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.369 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.369 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.370 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.370 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:10:58.370 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.371 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.371 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.371 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:10:58.371 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:10:58.372 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.372 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.372 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.372 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:10:58.373 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:10:58.373 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:10:58.373 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:10:58.373 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.373 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.374 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.374 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.374 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.375 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:58.375 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:10:58.375 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.376 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.376 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.376 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.376 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.377 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.377 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.377 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:58.377 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.378 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.378 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.378 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.378 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.378 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.379 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:10:58.379 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.379 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.379 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.380 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.380 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:10:58.380 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.380 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.380 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.381 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.381 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.381 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.381 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.382 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.382 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:10:58.382 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.382 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.382 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.383 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.383 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:10:58.383 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.383 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.384 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.384 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.384 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.384 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.384 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.385 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.385 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:10:58.385 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.385 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.386 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.386 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.386 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:10:58.387 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.387 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.387 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.387 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.387 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.388 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.388 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.389 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:10:58.389 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.389 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.389 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.389 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.390 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:10:58.390 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:10:58.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.390 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.391 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.391 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:10:58.391 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:10:58.391 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:10:58.391 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:10:58.392 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.392 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.392 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.392 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.393 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.393 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.393 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:58.393 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:10:58.393 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.394 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.394 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.394 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.394 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.395 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.395 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.395 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:58.395 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.395 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.396 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.396 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.396 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.396 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.397 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:10:58.397 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.397 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.397 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.397 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.398 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:10:58.398 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.398 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.398 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.399 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.399 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.399 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.399 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.400 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:10:58.400 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.400 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.401 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.401 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:10:58.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.401 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.401 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.402 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.402 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.402 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.403 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.403 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:10:58.403 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.403 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.404 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:10:58.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.404 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.405 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.405 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.405 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.406 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.406 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.406 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:10:58.406 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.407 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.407 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:10:58.407 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:10:58.408 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.408 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.408 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.408 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:10:58.409 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:10:58.409 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:10:58.409 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:10:58.409 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.409 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.410 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.410 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.410 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.410 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.411 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:58.411 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:10:58.411 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.411 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.411 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.412 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.412 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.412 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.412 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.413 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:58.413 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.413 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.413 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.414 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.414 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.414 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.414 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:10:58.414 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.415 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.415 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.415 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.415 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:10:58.416 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.416 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.416 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.416 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.416 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.417 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.417 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:10:58.418 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.418 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.418 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.418 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:10:58.419 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.419 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.419 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.419 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.420 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.420 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.420 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:10:58.421 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.421 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.421 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.421 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.422 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:10:58.422 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.422 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.422 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.423 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.423 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.423 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.424 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:10:58.424 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.424 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.424 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.424 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.425 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:10:58.425 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:10:58.425 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.425 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.426 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.426 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:10:58.426 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:10:58.426 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:10:58.426 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:10:58.427 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.427 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.427 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.427 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.428 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.428 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.428 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:58.428 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:10:58.428 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.429 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.429 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.429 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.429 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.430 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.430 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.430 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:58.430 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.430 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.431 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.431 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.431 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.431 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.432 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:10:58.432 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.432 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.432 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.433 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.433 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:10:58.433 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.433 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.433 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.434 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.434 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.434 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.434 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:10:58.435 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.435 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.436 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.436 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:10:58.436 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.438 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.438 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.439 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.439 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.440 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.440 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:10:58.440 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.440 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.441 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.441 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.441 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:10:58.441 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.441 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.442 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.442 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.442 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.443 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.443 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.444 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:10:58.444 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.444 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.445 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.445 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.445 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:10:58.446 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:10:58.446 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.446 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.447 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.447 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:10:58.448 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:10:58.448 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:10:58.448 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:10:58.448 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.449 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.449 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.450 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.450 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.450 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.450 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:58.451 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:10:58.451 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.451 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.451 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.452 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.452 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.452 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.452 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.452 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 95, 2021-10-21T00:10:58.453 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.453 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.453 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.453 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.454 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.454 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.454 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:10:58.454 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.454 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.455 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.455 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:10:58.455 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.455 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.456 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.456 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.456 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.456 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.457 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.457 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:10:58.457 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.457 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.458 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.458 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:10:58.458 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.459 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.459 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.459 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.459 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.460 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.460 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.460 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:10:58.460 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.461 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.461 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.461 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:10:58.461 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.462 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.462 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.463 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.463 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.464 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.464 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.464 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:10:58.464 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.465 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.465 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:10:58.465 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:10:58.466 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.466 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.466 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.466 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:10:58.467 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:10:58.467 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:10:58.467 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:10:58.467 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.468 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.468 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.468 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.468 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.468 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.469 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:58.469 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:10:58.469 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.469 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.469 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.470 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.470 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.470 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.470 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.471 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:58.471 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.471 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.471 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.471 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.472 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.472 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.472 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:10:58.472 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.473 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.474 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.474 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:10:58.474 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.474 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.475 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.475 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.475 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.475 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.476 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.476 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.476 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:10:58.476 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.476 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.477 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.477 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.477 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:10:58.477 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.478 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.478 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.478 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.478 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.479 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.479 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.479 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:10:58.479 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.480 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.480 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.480 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.480 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:10:58.480 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.481 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.481 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.481 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.481 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.481 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.482 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.482 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.482 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:10:58.482 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.483 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.483 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.483 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.483 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:10:58.483 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:10:58.484 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.484 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.484 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.484 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:10:58.485 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:10:58.485 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:10:58.485 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:10:58.485 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.485 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.486 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.486 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.486 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.487 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:58.487 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:10:58.487 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:10:58.487 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:10:58.488 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:10:58.488 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:10:58.488 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:10:58.488 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:10:58.489 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:10:58.489 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 96, 2021-10-21T00:10:58.489 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:10:58.489 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:10:58.489 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:10:58.490 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.490 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.490 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.490 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:10:58.491 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.491 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.491 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.491 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.492 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:10:58.492 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.492 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.492 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.492 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.493 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:10:58.493 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.493 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.493 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.494 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:10:58.494 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.494 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.494 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.494 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.495 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:10:58.495 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.495 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.495 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.496 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.496 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:10:58.496 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.496 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.497 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.497 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:10:58.497 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.497 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.497 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.498 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.498 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:10:58.498 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.498 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.499 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.499 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.499 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:10:58.499 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:10:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:10:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:10:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.500 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.501 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.501 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:10:58.501 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:10:58.501 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:10:58.501 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.502 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.502 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.502 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:10:58.502 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:10:58.503 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:10:58.503 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:10:58.503 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:10:58.503 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:10:58.504 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:10:58.504 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:10:58.504 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.504 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:58.504 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:10:58.505 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.506 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:10:58.506 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.507 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.507 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.507 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.507 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.508 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:10:58.508 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.508 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.508 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.509 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:10:58.509 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.509 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.509 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.510 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.510 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.510 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:10:58.510 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.511 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.511 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.511 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:10:58.511 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.511 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.512 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.512 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.512 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.512 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:10:58.513 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.513 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.513 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:10:58.513 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.514 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.514 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.514 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.514 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.515 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:10:58.515 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.515 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.516 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:10:58.516 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.516 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.516 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.516 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.517 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.517 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:10:58.517 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.517 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.517 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.518 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:10:58.518 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.518 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.518 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.519 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.519 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:10:58.519 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.520 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.520 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:10:58.520 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.520 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.521 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.521 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.521 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.521 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:10:58.522 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.522 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.522 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:10:58.522 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:10:58.522 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:10:58.523 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:10:58.523 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:10:58.523 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:10:58.523 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:10:58.524 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:10:58.524 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:10:58.524 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.524 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:10:58.525 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:10:58.525 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:10:58.525 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:10:58.525 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:10:58.525 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:10:58.526 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/576603081": "2021-10-22T00:10:51.338018+0000", 2021-10-21T00:10:58.526 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/576603081": "2021-10-22T00:10:51.338018+0000" 2021-10-21T00:10:58.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.526 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:10:58.527 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:10:58.527 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:10:58.527 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:10:58.527 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:10:58.527 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:10:58.528 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:10:58.528 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:10:58.528 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:10:58.528 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:10:58.528 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:10:58.529 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:10:58.529 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:10:58.529 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:10:58.529 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:10:58.530 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:10:58.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 msgr2=0x7f1d54055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 0x7f1d54055ad0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f1d7000b000 tx=0x7f1d70006df0).stop 2021-10-21T00:10:58.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 msgr2=0x7f1d740ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f1d740abb80 tx=0x7f1d64015000).stop 2021-10-21T00:10:58.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 shutdown_connections 2021-10-21T00:10:58.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d54053610 0x7f1d54055ad0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d740b2170 0x7f1d741423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d740ab600 0x7f1d74141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 --2- 172.21.15.41:0/936253156 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d740602d0 0x7f1d740ad350 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 >> 172.21.15.41:0/936253156 conn(0x7f1d740b5700 msgr2=0x7f1d74142ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:58.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 shutdown_connections 2021-10-21T00:10:58.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.299+0000 7f1d7ac73700 1 -- 172.21.15.41:0/936253156 wait complete. 2021-10-21T00:10:58.535 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:58.536 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:58.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:58.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:58.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:58.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:10:58.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 Processor -- start 2021-10-21T00:10:58.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 -- start start 2021-10-21T00:10:58.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f26280b3370 0x7f26280b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 0x7f2628138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262805fdd0 con 0x7f262805f9f0 2021-10-21T00:10:58.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2628140400 con 0x7f26280b3370 2021-10-21T00:10:58.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.643+0000 7f262dda0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b27c0 con 0x7f26280b0730 2021-10-21T00:10:58.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f26280b3370 0x7f26280b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f26280b3370 0x7f26280b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36332/0 (socket says 172.21.15.41:36332) 2021-10-21T00:10:58.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 -- 172.21.15.41:0/931975748 learned_addr learned my addr 172.21.15.41:0/931975748 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262d59f700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 0x7f2628138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 -- 172.21.15.41:0/931975748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 msgr2=0x7f2628138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:58.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 0x7f2628138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 -- 172.21.15.41:0/931975748 >> v1:172.21.15.41:6789/0 conn(0x7f262805f9f0 legacy=0x7f26280b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:58.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 -- 172.21.15.41:0/931975748 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628140080 con 0x7f26280b3370 2021-10-21T00:10:58.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262d59f700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 0x7f2628138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:10:58.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f2627fff700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26280b3370 0x7f26280b0e50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f2628064620 tx=0x7f2618006f40).ready entity=mon.0 client_cookie=d1a8224ba429f3de server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f26277fe700 1 -- 172.21.15.41:0/931975748 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800dc20 con 0x7f26280b3370 2021-10-21T00:10:58.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f26277fe700 1 -- 172.21.15.41:0/931975748 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618000e90 con 0x7f26280b3370 2021-10-21T00:10:58.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f26277fe700 1 -- 172.21.15.41:0/931975748 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800be90 con 0x7f26280b3370 2021-10-21T00:10:58.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- 172.21.15.41:0/931975748 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26280b3370 msgr2=0x7f26280b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26280b3370 0x7f26280b0e50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f2628064620 tx=0x7f2618006f40).stop 2021-10-21T00:10:58.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- 172.21.15.41:0/931975748 shutdown_connections 2021-10-21T00:10:58.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b0730 0x7f2628138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 --2- 172.21.15.41:0/931975748 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26280b3370 0x7f26280b0e50 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- 172.21.15.41:0/931975748 >> 172.21.15.41:0/931975748 conn(0x7f26280637b0 msgr2=0x7f2628063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:58.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- 172.21.15.41:0/931975748 shutdown_connections 2021-10-21T00:10:58.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- 172.21.15.41:0/931975748 wait complete. 2021-10-21T00:10:58.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 Processor -- start 2021-10-21T00:10:58.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.647+0000 7f262dda0700 1 -- start start 2021-10-21T00:10:58.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26280b0730 0x7f262813a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b3370 0x7f2628150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628143880 con 0x7f262805f9f0 2021-10-21T00:10:58.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628064900 con 0x7f26280b0730 2021-10-21T00:10:58.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2628064660 con 0x7f26280b3370 2021-10-21T00:10:58.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f2627fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26280b0730 0x7f262813a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36340/0 (socket says 172.21.15.41:36340) 2021-10-21T00:10:58.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 -- 172.21.15.41:0/578591408 learned_addr learned my addr 172.21.15.41:0/578591408 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262d59f700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b3370 0x7f2628150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 -- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b3370 msgr2=0x7f2628150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b3370 0x7f2628150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 -- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26280b0730 msgr2=0x7f262813a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26280b0730 0x7f262813a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 -- 172.21.15.41:0/578591408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261800b460 con 0x7f262805f9f0 2021-10-21T00:10:58.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262cd9e700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f2610001ff0 tx=0x7f2610007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610007030 con 0x7f262805f9f0 2021-10-21T00:10:58.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610007190 con 0x7f262805f9f0 2021-10-21T00:10:58.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280678f0 con 0x7f262805f9f0 2021-10-21T00:10:58.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2610006510 con 0x7f262805f9f0 2021-10-21T00:10:58.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.651+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2628143530 con 0x7f262805f9f0 2021-10-21T00:10:58.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2628057350 con 0x7f262805f9f0 2021-10-21T00:10:58.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2610010030 con 0x7f262805f9f0 2021-10-21T00:10:58.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f2625ffb700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 0x7f260c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f261006b320 con 0x7f262805f9f0 2021-10-21T00:10:58.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f2627fff700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 0x7f260c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.655+0000 7f2627fff700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 0x7f260c055a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f261801e000 tx=0x7f2618006f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.659+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2610042650 con 0x7f262805f9f0 2021-10-21T00:10:58.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.823+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f262814e2e0 con 0x7f262805f9f0 2021-10-21T00:10:58.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f2625ffb700 1 -- 172.21.15.41:0/578591408 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f2610045c70 con 0x7f262805f9f0 2021-10-21T00:10:58.831 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:58.832 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/897856252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":897856252},{"type":"v1","addr":"172.21.15.62:6835","nonce":897856252}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53},{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-10-21T00:10:58.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 msgr2=0x7f260c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 0x7f260c055a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f261801e000 tx=0x7f2618006f40).stop 2021-10-21T00:10:58.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 msgr2=0x7f2628139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f2610001ff0 tx=0x7f2610007c30).stop 2021-10-21T00:10:58.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 shutdown_connections 2021-10-21T00:10:58.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f260c053580 0x7f260c055a40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26280b3370 0x7f2628150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26280b0730 0x7f262813a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 --2- 172.21.15.41:0/578591408 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f262805f9f0 0x7f2628139eb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 >> 172.21.15.41:0/578591408 conn(0x7f26280637b0 msgr2=0x7f2628138e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:58.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 shutdown_connections 2021-10-21T00:10:58.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.827+0000 7f262dda0700 1 -- 172.21.15.41:0/578591408 wait complete. 2021-10-21T00:10:58.836 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 53 2021-10-21T00:10:58.845 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:10:58.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 Processor -- start 2021-10-21T00:10:58.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 -- start start 2021-10-21T00:10:58.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 0x7f9bf4146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9bf40adf70 0x7f9bf4146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf41407e0 con 0x7f9bf40adf70 2021-10-21T00:10:58.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40ad450 con 0x7f9bf405fba0 2021-10-21T00:10:58.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfbb95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40aca70 con 0x7f9bf4140400 2021-10-21T00:10:58.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9bf40adf70 0x7f9bf4146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bf9130700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 0x7f9bf4146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9bf40adf70 0x7f9bf4146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36348/0 (socket says 172.21.15.41:36348) 2021-10-21T00:10:58.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 -- 172.21.15.41:0/3677550281 learned_addr learned my addr 172.21.15.41:0/3677550281 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bf9931700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 -- 172.21.15.41:0/3677550281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 msgr2=0x7f9bf405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:58.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 -- 172.21.15.41:0/3677550281 >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 msgr2=0x7f9bf4146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:10:58.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 --2- 172.21.15.41:0/3677550281 >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 0x7f9bf4146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bfa132700 1 -- 172.21.15.41:0/3677550281 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40acd10 con 0x7f9bf40adf70 2021-10-21T00:10:58.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.939+0000 7f9bf9130700 1 --2- 172.21.15.41:0/3677550281 >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 0x7f9bf4146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:10:58.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfa132700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf40adf70 0x7f9bf4146800 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f9bec0032f0 tx=0x7f9bec009290).ready entity=mon.0 client_cookie=71d1be84bb20de71 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bf892f700 1 -- 172.21.15.41:0/3677550281 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec00b680 con 0x7f9bf40adf70 2021-10-21T00:10:58.960 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bf892f700 1 -- 172.21.15.41:0/3677550281 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00b7e0 con 0x7f9bf40adf70 2021-10-21T00:10:58.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bf892f700 1 -- 172.21.15.41:0/3677550281 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bec00b950 con 0x7f9bf40adf70 2021-10-21T00:10:58.961 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- 172.21.15.41:0/3677550281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf40adf70 msgr2=0x7f9bf4146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf40adf70 0x7f9bf4146800 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f9bec0032f0 tx=0x7f9bec009290).stop 2021-10-21T00:10:58.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- 172.21.15.41:0/3677550281 shutdown_connections 2021-10-21T00:10:58.962 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf40adf70 0x7f9bf4146800 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/3677550281 >> v2:172.21.15.62:3300/0 conn(0x7f9bf405fba0 0x7f9bf4146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/3677550281 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- 172.21.15.41:0/3677550281 >> 172.21.15.41:0/3677550281 conn(0x7f9bf40b7030 msgr2=0x7f9bf40b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:58.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- 172.21.15.41:0/3677550281 shutdown_connections 2021-10-21T00:10:58.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- 172.21.15.41:0/3677550281 wait complete. 2021-10-21T00:10:58.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 Processor -- start 2021-10-21T00:10:58.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.943+0000 7f9bfbb95700 1 -- start start 2021-10-21T00:10:58.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf40adf70 0x7f9bf41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf4141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf41559c0 con 0x7f9bf405fba0 2021-10-21T00:10:58.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40aee30 con 0x7f9bf40adf70 2021-10-21T00:10:58.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4141210 con 0x7f9bf4140400 2021-10-21T00:10:58.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36352/0 (socket says 172.21.15.41:36352) 2021-10-21T00:10:58.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 -- 172.21.15.41:0/923005768 learned_addr learned my addr 172.21.15.41:0/923005768 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:58.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfa132700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf4141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9130700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf40adf70 0x7f9bf41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 -- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 msgr2=0x7f9bf4141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf4141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 -- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf40adf70 msgr2=0x7f9bf41554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:58.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf40adf70 0x7f9bf41554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:58.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 -- 172.21.15.41:0/923005768 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf000b180 con 0x7f9bf405fba0 2021-10-21T00:10:58.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bf9931700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f9be400c000 tx=0x7f9be4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be4011750 con 0x7f9bf405fba0 2021-10-21T00:10:58.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40118b0 con 0x7f9bf405fba0 2021-10-21T00:10:58.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec009530 con 0x7f9bf405fba0 2021-10-21T00:10:58.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be4011c10 con 0x7f9bf405fba0 2021-10-21T00:10:58.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf40b0c60 con 0x7f9bf405fba0 2021-10-21T00:10:58.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.947+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9be4011d70 con 0x7f9bf405fba0 2021-10-21T00:10:58.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.951+0000 7f9be2ffd700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 0x7f9bd4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:58.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.951+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40acfb0 con 0x7f9bf405fba0 2021-10-21T00:10:58.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.951+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9be406ba80 con 0x7f9bf405fba0 2021-10-21T00:10:58.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.951+0000 7f9bf9130700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 0x7f9bd4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:58.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.951+0000 7f9bf9130700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 0x7f9bd4055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f9bf000b000 tx=0x7f9bf0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:58.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:58.955+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9be4042ec0 con 0x7f9bf405fba0 2021-10-21T00:10:59.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.115+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf4057350 con 0x7f9bf405fba0 2021-10-21T00:10:59.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.115+0000 7f9be2ffd700 1 -- 172.21.15.41:0/923005768 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f9be40464e0 con 0x7f9bf405fba0 2021-10-21T00:10:59.122 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:10:59.123 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/897856252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":897856252},{"type":"v1","addr":"172.21.15.62:6835","nonce":897856252}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53},{"gid":7344,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/3229368921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3229368921},{"type":"v1","addr":"172.21.15.41:6833","nonce":3229368921}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-10-21T00:10:59.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 msgr2=0x7f9bd4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 0x7f9bd4055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f9bf000b000 tx=0x7f9bf0006df0).stop 2021-10-21T00:10:59.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 msgr2=0x7f9bf4065d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f9be400c000 tx=0x7f9be4006df0).stop 2021-10-21T00:10:59.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 shutdown_connections 2021-10-21T00:10:59.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9bd4053610 0x7f9bd4055ad0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9bf4140400 0x7f9bf4141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf40adf70 0x7f9bf41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 --2- 172.21.15.41:0/923005768 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9bf405fba0 0x7f9bf4065d60 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 >> 172.21.15.41:0/923005768 conn(0x7f9bf40b7030 msgr2=0x7f9bf40b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:59.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 shutdown_connections 2021-10-21T00:10:59.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.119+0000 7f9bfbb95700 1 -- 172.21.15.41:0/923005768 wait complete. 2021-10-21T00:10:59.128 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 53 2021-10-21T00:10:59.135 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:10:59.136 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:10:59.136 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:10:59.136 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:59.137 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:10:59.137 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:10:59.138 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:10:59.138 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:10:59.150 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:10:59.150 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:10:59.153 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:10:59.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:10:59.156 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:10:59.156 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:59.159 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:10:59.160 DEBUG:teuthology.parallel:result is None 2021-10-21T00:10:59.160 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:10:59.236 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:10:59.236 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:10:59.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 Processor -- start 2021-10-21T00:10:59.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 -- start start 2021-10-21T00:10:59.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76940b6120 0x7f76940b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:59.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940b18b0 con 0x7f769413e610 2021-10-21T00:10:59.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940b6500 con 0x7f76940b1170 2021-10-21T00:10:59.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7698f3b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769413f6c0 con 0x7f76940b6120 2021-10-21T00:10:59.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7692d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f769413e610 0x7f769413eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34152/0 (socket says 172.21.15.41:34152) 2021-10-21T00:10:59.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f769259c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76940b6120 0x7f76940b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:59.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7692d9d700 1 -- 172.21.15.41:0/840942897 learned_addr learned my addr 172.21.15.41:0/840942897 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:10:59.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f7691d9b700 1 --1- 172.21.15.41:0/840942897 >> v1:172.21.15.62:6789/0 conn(0x7f76940b1170 0x7f76940ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42206/0 (socket says 172.21.15.41:42206) 2021-10-21T00:10:59.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f769159a700 1 -- 172.21.15.41:0/840942897 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265589976 0 0) 0x7f76940b18b0 con 0x7f769413e610 2021-10-21T00:10:59.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f769259c700 1 -- 172.21.15.41:0/840942897 >> v1:172.21.15.62:6789/0 conn(0x7f76940b1170 legacy=0x7f76940ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f769259c700 1 -- 172.21.15.41:0/840942897 >> v1:172.21.15.41:6789/0 conn(0x7f769413e610 legacy=0x7f769413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.255+0000 7f769259c700 1 -- 172.21.15.41:0/840942897 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940b1b00 con 0x7f76940b6120 2021-10-21T00:10:59.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f769259c700 1 --2- 172.21.15.41:0/840942897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f76940b05e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f76940adaf0 tx=0x7f7688006df0).ready entity=mon.1 client_cookie=9ee775315fe2a359 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:59.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f769159a700 1 -- 172.21.15.41:0/840942897 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768800d610 con 0x7f76940b6120 2021-10-21T00:10:59.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f769159a700 1 -- 172.21.15.41:0/840942897 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688000e90 con 0x7f76940b6120 2021-10-21T00:10:59.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f769159a700 1 -- 172.21.15.41:0/840942897 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768800d960 con 0x7f76940b6120 2021-10-21T00:10:59.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- 172.21.15.41:0/840942897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 msgr2=0x7f76940b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 --2- 172.21.15.41:0/840942897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f76940b05e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f76940adaf0 tx=0x7f7688006df0).stop 2021-10-21T00:10:59.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- 172.21.15.41:0/840942897 shutdown_connections 2021-10-21T00:10:59.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 --2- 172.21.15.41:0/840942897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f76940b05e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- 172.21.15.41:0/840942897 >> 172.21.15.41:0/840942897 conn(0x7f7694063ae0 msgr2=0x7f76940b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:10:59.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- 172.21.15.41:0/840942897 shutdown_connections 2021-10-21T00:10:59.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- 172.21.15.41:0/840942897 wait complete. 2021-10-21T00:10:59.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 Processor -- start 2021-10-21T00:10:59.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- start start 2021-10-21T00:10:59.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:59.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f7694064610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:59.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f769413e610 0x7f7694064b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:59.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.259+0000 7f7698f3b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694067190 con 0x7f76940b1170 2021-10-21T00:10:59.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7698f3b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769413c030 con 0x7f76940b6120 2021-10-21T00:10:59.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7698f3b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769413b110 con 0x7f769413e610 2021-10-21T00:10:59.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:59.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f7694064610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:59.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36384/0 (socket says 172.21.15.41:36384) 2021-10-21T00:10:59.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f7694064610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48304/0 (socket says 172.21.15.41:48304) 2021-10-21T00:10:59.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 -- 172.21.15.41:0/3430250896 learned_addr learned my addr 172.21.15.41:0/3430250896 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:10:59.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7692d9d700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f769413e610 0x7f7694064b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:59.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 -- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f769413e610 msgr2=0x7f7694064b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f769413e610 0x7f7694064b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 -- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 msgr2=0x7f7694064610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:10:59.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f7694064610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:10:59.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 -- 172.21.15.41:0/3430250896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768800b180 con 0x7f76940b1170 2021-10-21T00:10:59.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f769259c700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f76940adaf0 tx=0x7f7688015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:59.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768800bec0 con 0x7f76940b1170 2021-10-21T00:10:59.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688011b00 con 0x7f76940b1170 2021-10-21T00:10:59.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7688011e60 con 0x7f76940b1170 2021-10-21T00:10:59.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940b2820 con 0x7f76940b1170 2021-10-21T00:10:59.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7694144b10 con 0x7f76940b1170 2021-10-21T00:10:59.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769413b2d0 con 0x7f76940b1170 2021-10-21T00:10:59.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.263+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7688025030 con 0x7f76940b1170 2021-10-21T00:10:59.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.267+0000 7f76837fe700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 0x7f7670055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:10:59.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.267+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f768806c920 con 0x7f76940b1170 2021-10-21T00:10:59.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.267+0000 7f7691d9b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 0x7f7670055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:10:59.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.267+0000 7f7691d9b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 0x7f7670055ad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f768400d000 tx=0x7f7684007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:10:59.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.267+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7688043d60 con 0x7f76940b1170 2021-10-21T00:10:59.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:10:59.403+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f76940b1da0 con 0x7f76940b1170 2021-10-21T00:11:00.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.259+0000 7f76837fe700 1 -- 172.21.15.41:0/3430250896 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7688023020 con 0x7f76940b1170 2021-10-21T00:11:00.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 msgr2=0x7f7670055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 0x7f7670055ad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f768400d000 tx=0x7f7684007b80).stop 2021-10-21T00:11:00.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 msgr2=0x7f76940b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f76940adaf0 tx=0x7f7688015000).stop 2021-10-21T00:11:00.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 shutdown_connections 2021-10-21T00:11:00.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7670053610 0x7f7670055ad0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f769413e610 0x7f7694064b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76940b6120 0x7f7694064610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 --2- 172.21.15.41:0/3430250896 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f76940b1170 0x7f76940b2330 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 >> 172.21.15.41:0/3430250896 conn(0x7f7694063ae0 msgr2=0x7f76940aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 shutdown_connections 2021-10-21T00:11:00.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.263+0000 7f7698f3b700 1 -- 172.21.15.41:0/3430250896 wait complete. 2021-10-21T00:11:00.274 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:11:00.286 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:11:00.287 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:11:00.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.387+0000 7fb6f51d4700 1 Processor -- start 2021-10-21T00:11:00.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.387+0000 7fb6f51d4700 1 -- start start 2021-10-21T00:11:00.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 0x7fb6f013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f005bd40 con 0x7fb6f0062330 2021-10-21T00:11:00.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f005bf70 con 0x7fb6f0062f70 2021-10-21T00:11:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0142cb0 con 0x7fb6f00b3a20 2021-10-21T00:11:00.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6effff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb6f0062330 0x7fb6f00b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34164/0 (socket says 172.21.15.41:34164) 2021-10-21T00:11:00.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6effff700 1 -- 172.21.15.41:0/3045772680 learned_addr learned my addr 172.21.15.41:0/3045772680 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:00.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f49d3700 1 --2- 172.21.15.41:0/3045772680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 0x7fb6f013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051598848 0 0) 0x7fb6f005bd40 con 0x7fb6f0062330 2021-10-21T00:11:00.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6dc003260 con 0x7fb6f0062330 2021-10-21T00:11:00.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f49d3700 1 -- 172.21.15.41:0/3045772680 >> v1:172.21.15.62:6789/0 conn(0x7fb6f0062f70 legacy=0x7fb6f005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103215900 0 0) 0x7fb6f005bf70 con 0x7fb6f0062f70 2021-10-21T00:11:00.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f49d3700 1 -- 172.21.15.41:0/3045772680 >> v1:172.21.15.41:6789/0 conn(0x7fb6f0062330 legacy=0x7fb6f00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f49d3700 1 -- 172.21.15.41:0/3045772680 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0142950 con 0x7fb6f00b3a20 2021-10-21T00:11:00.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f49d3700 1 --2- 172.21.15.41:0/3045772680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 0x7fb6f013c510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb6e0001800 tx=0x7fb6e80091d0).ready entity=mon.2 client_cookie=57170c27f7e35b7e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0001660 con 0x7fb6f00b3a20 2021-10-21T00:11:00.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e800b580 con 0x7fb6f00b3a20 2021-10-21T00:11:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6eeffd700 1 -- 172.21.15.41:0/3045772680 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e800b6f0 con 0x7fb6f00b3a20 2021-10-21T00:11:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- 172.21.15.41:0/3045772680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 msgr2=0x7fb6f013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/3045772680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 0x7fb6f013c510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb6e0001800 tx=0x7fb6e80091d0).stop 2021-10-21T00:11:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- 172.21.15.41:0/3045772680 shutdown_connections 2021-10-21T00:11:00.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/3045772680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f00b3a20 0x7fb6f013c510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- 172.21.15.41:0/3045772680 >> 172.21.15.41:0/3045772680 conn(0x7fb6f00b9080 msgr2=0x7fb6f00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:00.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- 172.21.15.41:0/3045772680 shutdown_connections 2021-10-21T00:11:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.391+0000 7fb6f51d4700 1 -- 172.21.15.41:0/3045772680 wait complete. 2021-10-21T00:11:00.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 Processor -- start 2021-10-21T00:11:00.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 -- start start 2021-10-21T00:11:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.418 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 0x7fb6f00acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f00b3a20 0x7fb6f00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f00adbc0 con 0x7fb6f0062330 2021-10-21T00:11:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0155c40 con 0x7fb6f00b3a20 2021-10-21T00:11:00.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01560a0 con 0x7fb6f0062f70 2021-10-21T00:11:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36400/0 (socket says 172.21.15.41:36400) 2021-10-21T00:11:00.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 -- 172.21.15.41:0/2255539858 learned_addr learned my addr 172.21.15.41:0/2255539858 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f49d3700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f00b3a20 0x7fb6f00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6ef7fe700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 0x7fb6f00acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 -- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 msgr2=0x7fb6f00acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 0x7fb6f00acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 -- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f00b3a20 msgr2=0x7fb6f00ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f00b3a20 0x7fb6f00ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 -- 172.21.15.41:0/2255539858 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009470 con 0x7fb6f0062330 2021-10-21T00:11:00.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6ef7fe700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 0x7fb6f00acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6effff700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fb6e00011d0 tx=0x7fb6e0001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0007170 con 0x7fb6f0062330 2021-10-21T00:11:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00072d0 con 0x7fb6f0062330 2021-10-21T00:11:00.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f013d9a0 con 0x7fb6f0062330 2021-10-21T00:11:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.395+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0004920 con 0x7fb6f0062330 2021-10-21T00:11:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f00ad5b0 con 0x7fb6f0062330 2021-10-21T00:11:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f0057350 con 0x7fb6f0062330 2021-10-21T00:11:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6e001b070 con 0x7fb6f0062330 2021-10-21T00:11:00.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6ed7fa700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 0x7fb6d0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb6e006adc0 con 0x7fb6f0062330 2021-10-21T00:11:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.399+0000 7fb6ef7fe700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 0x7fb6d0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.403+0000 7fb6ef7fe700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 0x7fb6d0055a90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fb6e400b000 tx=0x7fb6e4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.403+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6e0042250 con 0x7fb6f0062330 2021-10-21T00:11:00.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.575+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb6f005d080 con 0x7fb6f0062330 2021-10-21T00:11:00.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.575+0000 7fb6ed7fa700 1 -- 172.21.15.41:0/2255539858 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fb6e0045870 con 0x7fb6f0062330 2021-10-21T00:11:00.582 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:00.582 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:00.583 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:11:00.583 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.583 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:11:00.583 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:11:00.584 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.584 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:00.584 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.584 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.584 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.585 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.585 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.585 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.586 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:11:00.586 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:11:00.586 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.586 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:00.586 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.587 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.587 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.587 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.587 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.588 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.588 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:11:00.588 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:11:00.588 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.589 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.589 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.589 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.589 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.590 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.590 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.590 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:11:00.590 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:11:00.591 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.591 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.591 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.591 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.592 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.592 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.592 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.592 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:11:00.593 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:11:00.593 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.593 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.593 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.594 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.594 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.594 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.594 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.595 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:11:00.595 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:11:00.595 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.595 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.596 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.596 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.596 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.597 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.597 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.598 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:11:00.598 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:11:00.599 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.599 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.600 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.600 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.600 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.601 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.601 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.602 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:11:00.602 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:11:00.602 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.603 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.603 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.604 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.604 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.604 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.605 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.606 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:11:00.606 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:11:00.606 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.606 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.607 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.607 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.607 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.607 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.608 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.608 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:11:00.608 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:11:00.608 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.608 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.609 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.609 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.609 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.609 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.610 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.610 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:11:00.610 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:11:00.610 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.611 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:00.611 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:00.611 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:00.611 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.612 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.612 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.612 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:11:00.612 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:11:00.613 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.613 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:00.613 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:00.613 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:00.613 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.614 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.614 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.614 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:11:00.614 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:11:00.615 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.615 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:00.615 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:00.615 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:00.615 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.616 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.616 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.616 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:11:00.616 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:11:00.616 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.617 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:00.617 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:00.617 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:00.617 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.618 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.618 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.618 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.618 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:11:00.619 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:11:00.619 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.619 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:00.619 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:11:00.619 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.620 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.620 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:00.620 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:00.620 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:11:00.621 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:11:00.621 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:00.621 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:00.622 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:11:00.622 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:00.622 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.622 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:00.622 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:00.623 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:00.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 msgr2=0x7fb6d0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 0x7fb6d0055a90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fb6e400b000 tx=0x7fb6e4009040).stop 2021-10-21T00:11:00.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 msgr2=0x7fb6f0151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fb6e00011d0 tx=0x7fb6e0001ae0).stop 2021-10-21T00:11:00.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 shutdown_connections 2021-10-21T00:11:00.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6d00535d0 0x7fb6d0055a90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f00b3a20 0x7fb6f00ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6f0062f70 0x7fb6f00acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 --2- 172.21.15.41:0/2255539858 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb6f0062330 0x7fb6f0151c40 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 >> 172.21.15.41:0/2255539858 conn(0x7fb6f00b9080 msgr2=0x7fb6f013f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:00.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 shutdown_connections 2021-10-21T00:11:00.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.579+0000 7fb6f51d4700 1 -- 172.21.15.41:0/2255539858 wait complete. 2021-10-21T00:11:00.629 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:00.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.727+0000 7f76893a5700 1 Processor -- start 2021-10-21T00:11:00.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.727+0000 7f76893a5700 1 -- start start 2021-10-21T00:11:00.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7684062330 0x7f76840b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 0x7f768413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768405bd40 con 0x7f7684062f70 2021-10-21T00:11:00.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768405bf70 con 0x7f7684062330 2021-10-21T00:11:00.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7684142cb0 con 0x7f76840b3a20 2021-10-21T00:11:00.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7684062330 0x7f76840b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7684062330 0x7f76840b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36408/0 (socket says 172.21.15.41:36408) 2021-10-21T00:11:00.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 -- 172.21.15.41:0/3068603246 learned_addr learned my addr 172.21.15.41:0/3068603246 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:00.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7688ba4700 1 --2- 172.21.15.41:0/3068603246 >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 0x7f768413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 -- 172.21.15.41:0/3068603246 >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 msgr2=0x7f768413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:00.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 --2- 172.21.15.41:0/3068603246 >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 0x7f768413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 -- 172.21.15.41:0/3068603246 >> v1:172.21.15.62:6789/0 conn(0x7f7684062f70 legacy=0x7f768405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 -- 172.21.15.41:0/3068603246 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684142950 con 0x7f7684062330 2021-10-21T00:11:00.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7688ba4700 1 --2- 172.21.15.41:0/3068603246 >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 0x7f768413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:00.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7683fff700 1 --2- 172.21.15.41:0/3068603246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840b3f30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f7674002f70 tx=0x7f7674006eb0).ready entity=mon.0 client_cookie=96a835c72026c69a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7682ffd700 1 -- 172.21.15.41:0/3068603246 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f767400d610 con 0x7f7684062330 2021-10-21T00:11:00.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7682ffd700 1 -- 172.21.15.41:0/3068603246 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674000e90 con 0x7f7684062330 2021-10-21T00:11:00.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f7682ffd700 1 -- 172.21.15.41:0/3068603246 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f767400d9a0 con 0x7f7684062330 2021-10-21T00:11:00.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- 172.21.15.41:0/3068603246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 msgr2=0x7f76840b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 --2- 172.21.15.41:0/3068603246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840b3f30 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f7674002f70 tx=0x7f7674006eb0).stop 2021-10-21T00:11:00.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- 172.21.15.41:0/3068603246 shutdown_connections 2021-10-21T00:11:00.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 --2- 172.21.15.41:0/3068603246 >> v2:172.21.15.62:3300/0 conn(0x7f76840b3a20 0x7f768413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 --2- 172.21.15.41:0/3068603246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840b3f30 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- 172.21.15.41:0/3068603246 >> 172.21.15.41:0/3068603246 conn(0x7f76840b9080 msgr2=0x7f76840b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:00.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- 172.21.15.41:0/3068603246 shutdown_connections 2021-10-21T00:11:00.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.731+0000 7f76893a5700 1 -- 172.21.15.41:0/3068603246 wait complete. 2021-10-21T00:11:00.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 Processor -- start 2021-10-21T00:11:00.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- start start 2021-10-21T00:11:00.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 0x7f76840ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76840b3a20 0x7f76841555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768413d510 con 0x7f7684062330 2021-10-21T00:11:00.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840ad6e0 con 0x7f7684062f70 2021-10-21T00:11:00.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7684113390 con 0x7f76840b3a20 2021-10-21T00:11:00.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36414/0 (socket says 172.21.15.41:36414) 2021-10-21T00:11:00.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 -- 172.21.15.41:0/1627283095 learned_addr learned my addr 172.21.15.41:0/1627283095 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:00.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7688ba4700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76840b3a20 0x7f76841555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76837fe700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 0x7f76840ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 -- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76840b3a20 msgr2=0x7f76841555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76840b3a20 0x7f76841555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 -- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 msgr2=0x7f76840ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 0x7f76840ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 -- 172.21.15.41:0/1627283095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767400b1e0 con 0x7f7684062330 2021-10-21T00:11:00.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76837fe700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 0x7f76840ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:00.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f7683fff700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f7674002f70 tx=0x7f7674015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76740117e0 con 0x7f7684062330 2021-10-21T00:11:00.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674011940 con 0x7f7684062330 2021-10-21T00:11:00.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7684113630 con 0x7f7684062330 2021-10-21T00:11:00.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7674011ca0 con 0x7f7684062330 2021-10-21T00:11:00.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.735+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7684112e50 con 0x7f7684062330 2021-10-21T00:11:00.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7684057350 con 0x7f7684062330 2021-10-21T00:11:00.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7674025030 con 0x7f7684062330 2021-10-21T00:11:00.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76817fa700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 0x7f7664055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:00.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f767406c7f0 con 0x7f7684062330 2021-10-21T00:11:00.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76837fe700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 0x7f7664055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:00.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.739+0000 7f76837fe700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 0x7f7664055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f767800b000 tx=0x7f7678009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:00.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.747+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7674043af0 con 0x7f7684062330 2021-10-21T00:11:00.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.875+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f768405d080 con 0x7f7684062330 2021-10-21T00:11:00.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.875+0000 7f76817fa700 1 -- 172.21.15.41:0/1627283095 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+13183 (secure 0 0 0) 0x7f7674047110 con 0x7f7684062330 2021-10-21T00:11:00.882 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:00.883 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":104,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:00.253075+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:00.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 msgr2=0x7f7664055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 0x7f7664055ad0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f767800b000 tx=0x7f7678009040).stop 2021-10-21T00:11:00.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 msgr2=0x7f76840ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:00.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f7674002f70 tx=0x7f7674015000).stop 2021-10-21T00:11:00.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 shutdown_connections 2021-10-21T00:11:00.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7664053610 0x7f7664055ad0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76840b3a20 0x7f76841555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7684062f70 0x7f76840ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 --2- 172.21.15.41:0/1627283095 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7684062330 0x7f76840ae050 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:00.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 >> 172.21.15.41:0/1627283095 conn(0x7f76840b9080 msgr2=0x7f7684142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:00.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 shutdown_connections 2021-10-21T00:11:00.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:00.879+0000 7f76893a5700 1 -- 172.21.15.41:0/1627283095 wait complete. 2021-10-21T00:11:00.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:11:00.904 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:01.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 Processor -- start 2021-10-21T00:11:01.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- start start 2021-10-21T00:11:01.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2f880b2170 0x7f2f880ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f880af620 0x7f2f880ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880b0b50 con 0x7f2f880abb50 2021-10-21T00:11:01.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880b2550 con 0x7f2f880b2170 2021-10-21T00:11:01.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880b0d90 con 0x7f2f880af620 2021-10-21T00:11:01.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2f880b2170 0x7f2f880ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2f880b2170 0x7f2f880ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36422/0 (socket says 172.21.15.41:36422) 2021-10-21T00:11:01.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 -- 172.21.15.41:0/3564957693 learned_addr learned my addr 172.21.15.41:0/3564957693 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f877fe700 1 --2- 172.21.15.41:0/3564957693 >> v2:172.21.15.62:3300/0 conn(0x7f2f880af620 0x7f2f880ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 -- 172.21.15.41:0/3564957693 >> v2:172.21.15.62:3300/0 conn(0x7f2f880af620 msgr2=0x7f2f880ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:01.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 --2- 172.21.15.41:0/3564957693 >> v2:172.21.15.62:3300/0 conn(0x7f2f880af620 0x7f2f880ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 -- 172.21.15.41:0/3564957693 >> v1:172.21.15.41:6789/0 conn(0x7f2f880abb50 legacy=0x7f2f8814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 -- 172.21.15.41:0/3564957693 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880b1030 con 0x7f2f880b2170 2021-10-21T00:11:01.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f87fff700 1 --2- 172.21.15.41:0/3564957693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880b2170 0x7f2f880ab170 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f2f7c002f70 tx=0x7f2f7c006eb0).ready entity=mon.0 client_cookie=1ca5554d6271aff0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f86ffd700 1 -- 172.21.15.41:0/3564957693 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c00d610 con 0x7f2f880b2170 2021-10-21T00:11:01.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f86ffd700 1 -- 172.21.15.41:0/3564957693 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c000e90 con 0x7f2f880b2170 2021-10-21T00:11:01.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f86ffd700 1 -- 172.21.15.41:0/3564957693 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c00d9a0 con 0x7f2f880b2170 2021-10-21T00:11:01.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/3564957693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880b2170 msgr2=0x7f2f880ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/3564957693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880b2170 0x7f2f880ab170 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f2f7c002f70 tx=0x7f2f7c006eb0).stop 2021-10-21T00:11:01.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/3564957693 shutdown_connections 2021-10-21T00:11:01.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/3564957693 >> v2:172.21.15.62:3300/0 conn(0x7f2f880af620 0x7f2f880ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/3564957693 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880b2170 0x7f2f880ab170 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/3564957693 >> 172.21.15.41:0/3564957693 conn(0x7f2f880b5700 msgr2=0x7f2f880b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/3564957693 shutdown_connections 2021-10-21T00:11:01.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.011+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/3564957693 wait complete. 2021-10-21T00:11:01.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.015+0000 7f2f8d4b7700 1 Processor -- start 2021-10-21T00:11:01.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.015+0000 7f2f8d4b7700 1 -- start start 2021-10-21T00:11:01.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 0x7f2f881460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f880b2170 0x7f2f881465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88147e60 con 0x7f2f880abb50 2021-10-21T00:11:01.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88148100 con 0x7f2f880af620 2021-10-21T00:11:01.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881483a0 con 0x7f2f880b2170 2021-10-21T00:11:01.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36426/0 (socket says 172.21.15.41:36426) 2021-10-21T00:11:01.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 -- 172.21.15.41:0/447763362 learned_addr learned my addr 172.21.15.41:0/447763362 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f877fe700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 0x7f2f881460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8ccb6700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f880b2170 0x7f2f881465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 -- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f880b2170 msgr2=0x7f2f881465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f880b2170 0x7f2f881465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 -- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 msgr2=0x7f2f881460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 0x7f2f881460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 -- 172.21.15.41:0/447763362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c00b1e0 con 0x7f2f880abb50 2021-10-21T00:11:01.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f877fe700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 0x7f2f881460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:01.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f87fff700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f2f7c002f70 tx=0x7f2f7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c011950 con 0x7f2f880abb50 2021-10-21T00:11:01.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c011ab0 con 0x7f2f880abb50 2021-10-21T00:11:01.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88146aa0 con 0x7f2f880abb50 2021-10-21T00:11:01.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c011e10 con 0x7f2f880abb50 2021-10-21T00:11:01.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880655c0 con 0x7f2f880abb50 2021-10-21T00:11:01.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f7c025030 con 0x7f2f880abb50 2021-10-21T00:11:01.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f88148560 con 0x7f2f880abb50 2021-10-21T00:11:01.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 0x7f2f68055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.019+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2f7c06c7f0 con 0x7f2f880abb50 2021-10-21T00:11:01.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.023+0000 7f2f877fe700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 0x7f2f68055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.023+0000 7f2f877fe700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 0x7f2f68055b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f2f7800c000 tx=0x7f2f78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.027+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f7c043c80 con 0x7f2f880abb50 2021-10-21T00:11:01.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.155+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2f880b12d0 con 0x7f2f880abb50 2021-10-21T00:11:01.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.155+0000 7f2f857fa700 1 -- 172.21.15.41:0/447763362 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2f7c023070 con 0x7f2f880abb50 2021-10-21T00:11:01.162 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:01.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 msgr2=0x7f2f68055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 0x7f2f68055b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f2f7800c000 tx=0x7f2f78008040).stop 2021-10-21T00:11:01.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 msgr2=0x7f2f880aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f2f7c002f70 tx=0x7f2f7c015000).stop 2021-10-21T00:11:01.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 shutdown_connections 2021-10-21T00:11:01.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2f680536a0 0x7f2f68055b60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2f880b2170 0x7f2f881465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f880af620 0x7f2f881460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 --2- 172.21.15.41:0/447763362 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2f880abb50 0x7f2f880aeb40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 >> 172.21.15.41:0/447763362 conn(0x7f2f880b5700 msgr2=0x7f2f880b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 shutdown_connections 2021-10-21T00:11:01.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.159+0000 7f2f8d4b7700 1 -- 172.21.15.41:0/447763362 wait complete. 2021-10-21T00:11:01.183 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:01.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.283+0000 7fc6420c8700 1 Processor -- start 2021-10-21T00:11:01.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.283+0000 7fc6420c8700 1 -- start start 2021-10-21T00:11:01.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc63c062330 0x7fc63c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 0x7fc63c05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c05bd40 con 0x7fc63c0b3a20 2021-10-21T00:11:01.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c05bf70 con 0x7fc63c062330 2021-10-21T00:11:01.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c142cb0 con 0x7fc63c062f70 2021-10-21T00:11:01.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc63c062330 0x7fc63c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6418c7700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc63c0b3a20 0x7fc63c13c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34204/0 (socket says 172.21.15.41:34204) 2021-10-21T00:11:01.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6418c7700 1 -- 172.21.15.41:0/3626542167 learned_addr learned my addr 172.21.15.41:0/3626542167 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:01.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6408c5700 1 --2- 172.21.15.41:0/3626542167 >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 0x7fc63c05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc62bfff700 1 -- 172.21.15.41:0/3626542167 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013863470 0 0) 0x7fc63c05bd40 con 0x7fc63c0b3a20 2021-10-21T00:11:01.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc62bfff700 1 -- 172.21.15.41:0/3626542167 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc624003260 con 0x7fc63c0b3a20 2021-10-21T00:11:01.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 -- 172.21.15.41:0/3626542167 >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 msgr2=0x7fc63c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:01.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 --2- 172.21.15.41:0/3626542167 >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 0x7fc63c05c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 -- 172.21.15.41:0/3626542167 >> v1:172.21.15.41:6789/0 conn(0x7fc63c0b3a20 legacy=0x7fc63c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 -- 172.21.15.41:0/3626542167 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c142950 con 0x7fc63c062330 2021-10-21T00:11:01.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6408c5700 1 --2- 172.21.15.41:0/3626542167 >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 0x7fc63c05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:01.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6410c6700 1 --2- 172.21.15.41:0/3626542167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062330 0x7fc63c0b3f30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fc638002f70 tx=0x7fc638006df0).ready entity=mon.0 client_cookie=e9c14b617b8344 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc62bfff700 1 -- 172.21.15.41:0/3626542167 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc63800d570 con 0x7fc63c062330 2021-10-21T00:11:01.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc62bfff700 1 -- 172.21.15.41:0/3626542167 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638000e90 con 0x7fc63c062330 2021-10-21T00:11:01.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc62bfff700 1 -- 172.21.15.41:0/3626542167 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc63800d8c0 con 0x7fc63c062330 2021-10-21T00:11:01.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- 172.21.15.41:0/3626542167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062330 msgr2=0x7fc63c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 --2- 172.21.15.41:0/3626542167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062330 0x7fc63c0b3f30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fc638002f70 tx=0x7fc638006df0).stop 2021-10-21T00:11:01.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- 172.21.15.41:0/3626542167 shutdown_connections 2021-10-21T00:11:01.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 --2- 172.21.15.41:0/3626542167 >> v2:172.21.15.62:3300/0 conn(0x7fc63c062f70 0x7fc63c05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 --2- 172.21.15.41:0/3626542167 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062330 0x7fc63c0b3f30 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- 172.21.15.41:0/3626542167 >> 172.21.15.41:0/3626542167 conn(0x7fc63c0b9080 msgr2=0x7fc63c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- 172.21.15.41:0/3626542167 shutdown_connections 2021-10-21T00:11:01.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- 172.21.15.41:0/3626542167 wait complete. 2021-10-21T00:11:01.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 Processor -- start 2021-10-21T00:11:01.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.287+0000 7fc6420c8700 1 -- start start 2021-10-21T00:11:01.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc63c062330 0x7fc63c1408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc63c0b3a20 0x7fc63c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c144490 con 0x7fc63c062f70 2021-10-21T00:11:01.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c1553b0 con 0x7fc63c0b3a20 2021-10-21T00:11:01.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0ae6b0 con 0x7fc63c062330 2021-10-21T00:11:01.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36442/0 (socket says 172.21.15.41:36442) 2021-10-21T00:11:01.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 -- 172.21.15.41:0/463489613 learned_addr learned my addr 172.21.15.41:0/463489613 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6410c6700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc63c062330 0x7fc63c1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6418c7700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc63c0b3a20 0x7fc63c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 -- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc63c062330 msgr2=0x7fc63c1408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc63c062330 0x7fc63c1408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 -- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc63c0b3a20 msgr2=0x7fc63c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc63c0b3a20 0x7fc63c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 -- 172.21.15.41:0/463489613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63800b180 con 0x7fc63c062f70 2021-10-21T00:11:01.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6408c5700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fc62c00a000 tx=0x7fc62c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62c011780 con 0x7fc63c062f70 2021-10-21T00:11:01.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0118e0 con 0x7fc63c062f70 2021-10-21T00:11:01.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c152f10 con 0x7fc63c062f70 2021-10-21T00:11:01.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62c011c40 con 0x7fc63c062f70 2021-10-21T00:11:01.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0addb0 con 0x7fc63c062f70 2021-10-21T00:11:01.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.291+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c057350 con 0x7fc63c062f70 2021-10-21T00:11:01.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.295+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc62c012420 con 0x7fc63c062f70 2021-10-21T00:11:01.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.295+0000 7fc62a7fc700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 0x7fc61c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.295+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc62c06b6f0 con 0x7fc63c062f70 2021-10-21T00:11:01.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.295+0000 7fc6410c6700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 0x7fc61c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.295+0000 7fc6410c6700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 0x7fc61c055a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc638018000 tx=0x7fc638014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.303+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc62c042990 con 0x7fc63c062f70 2021-10-21T00:11:01.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.427+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc63c05d080 con 0x7fc63c062f70 2021-10-21T00:11:01.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.427+0000 7fc62a7fc700 1 -- 172.21.15.41:0/463489613 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc62c045fb0 con 0x7fc63c062f70 2021-10-21T00:11:01.435 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 msgr2=0x7fc61c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 0x7fc61c055a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc638018000 tx=0x7fc638014000).stop 2021-10-21T00:11:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 msgr2=0x7fc63c0aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fc62c00a000 tx=0x7fc62c008040).stop 2021-10-21T00:11:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 shutdown_connections 2021-10-21T00:11:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc61c053580 0x7fc61c055a40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc63c0b3a20 0x7fc63c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc63c062f70 0x7fc63c0aeb10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 --2- 172.21.15.41:0/463489613 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc63c062330 0x7fc63c1408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 >> 172.21.15.41:0/463489613 conn(0x7fc63c0b9080 msgr2=0x7fc63c142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 shutdown_connections 2021-10-21T00:11:01.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.431+0000 7fc6420c8700 1 -- 172.21.15.41:0/463489613 wait complete. 2021-10-21T00:11:01.447 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:11:01.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 Processor -- start 2021-10-21T00:11:01.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- start start 2021-10-21T00:11:01.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8dc40b1830 0x7f8dc405fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc40b4760 con 0x7f8dc4140890 2021-10-21T00:11:01.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc40ad4c0 con 0x7f8dc40b4380 2021-10-21T00:11:01.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40ad760 con 0x7f8dc40b1830 2021-10-21T00:11:01.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8dc40b1830 0x7f8dc405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8dc40b1830 0x7f8dc405fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36448/0 (socket says 172.21.15.41:36448) 2021-10-21T00:11:01.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 -- 172.21.15.41:0/1324365916 learned_addr learned my addr 172.21.15.41:0/1324365916 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc37fe700 1 --1- 172.21.15.41:0/1324365916 >> v1:172.21.15.41:6789/0 conn(0x7f8dc4140890 0x7f8dc4140cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34222/0 (socket says 172.21.15.41:34222) 2021-10-21T00:11:01.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 -- 172.21.15.41:0/1324365916 >> v1:172.21.15.62:6789/0 conn(0x7f8dc40b4380 legacy=0x7f8dc405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 -- 172.21.15.41:0/1324365916 >> v1:172.21.15.41:6789/0 conn(0x7f8dc4140890 legacy=0x7f8dc4140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 -- 172.21.15.41:0/1324365916 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40ada00 con 0x7f8dc40b1830 2021-10-21T00:11:01.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc27fc700 1 --2- 172.21.15.41:0/1324365916 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b1830 0x7f8dc405fed0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc009290).ready entity=mon.0 client_cookie=39d3ac398851f3bc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc1ffb700 1 -- 172.21.15.41:0/1324365916 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00b8a0 con 0x7f8dc40b1830 2021-10-21T00:11:01.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc1ffb700 1 -- 172.21.15.41:0/1324365916 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00ba00 con 0x7f8dc40b1830 2021-10-21T00:11:01.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc1ffb700 1 -- 172.21.15.41:0/1324365916 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00bb70 con 0x7f8dc40b1830 2021-10-21T00:11:01.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- 172.21.15.41:0/1324365916 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b1830 msgr2=0x7f8dc405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/1324365916 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b1830 0x7f8dc405fed0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f8dbc0032f0 tx=0x7f8dbc009290).stop 2021-10-21T00:11:01.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- 172.21.15.41:0/1324365916 shutdown_connections 2021-10-21T00:11:01.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/1324365916 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b1830 0x7f8dc405fed0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- 172.21.15.41:0/1324365916 >> 172.21.15.41:0/1324365916 conn(0x7f8dc40b7910 msgr2=0x7f8dc40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- 172.21.15.41:0/1324365916 shutdown_connections 2021-10-21T00:11:01.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.547+0000 7f8dc3fff700 1 -- 172.21.15.41:0/1324365916 wait complete. 2021-10-21T00:11:01.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 Processor -- start 2021-10-21T00:11:01.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 -- start start 2021-10-21T00:11:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dc40b1830 0x7f8dc41401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc4140890 0x7f8dc413af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc413e2f0 con 0x7f8dc40b4380 2021-10-21T00:11:01.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40b0640 con 0x7f8dc4140890 2021-10-21T00:11:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc3fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc413de90 con 0x7f8dc40b1830 2021-10-21T00:11:01.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36456/0 (socket says 172.21.15.41:36456) 2021-10-21T00:11:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 -- 172.21.15.41:0/706995594 learned_addr learned my addr 172.21.15.41:0/706995594 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc37fe700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc4140890 0x7f8dc413af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc2ffd700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dc40b1830 0x7f8dc41401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 -- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dc40b1830 msgr2=0x7f8dc41401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dc40b1830 0x7f8dc41401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 -- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc4140890 msgr2=0x7f8dc413af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc4140890 0x7f8dc413af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 -- 172.21.15.41:0/706995594 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009530 con 0x7f8dc40b4380 2021-10-21T00:11:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.551+0000 7f8dc27fc700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f8dc413e430 tx=0x7f8dbc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc00bde0 con 0x7f8dc40b4380 2021-10-21T00:11:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc01f3f0 con 0x7f8dc40b4380 2021-10-21T00:11:01.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc4156a90 con 0x7f8dc40b4380 2021-10-21T00:11:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dbc01f750 con 0x7f8dc40b4380 2021-10-21T00:11:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc409ce50 con 0x7f8dc40b4380 2021-10-21T00:11:01.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc413e050 con 0x7f8dc40b4380 2021-10-21T00:11:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8dbc026030 con 0x7f8dc40b4380 2021-10-21T00:11:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 0x7f8da8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8dbc06c2a0 con 0x7f8dc40b4380 2021-10-21T00:11:01.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.555+0000 7f8dc2ffd700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 0x7f8da8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.559+0000 7f8dc2ffd700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 0x7f8da8055b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8dac00d000 tx=0x7f8dac007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.563+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8dc413e050 con 0x7f8dc40b4380 2021-10-21T00:11:01.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8dc413e050 con 0x7f8dc40b4380 2021-10-21T00:11:01.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dbbfff700 1 -- 172.21.15.41:0/706995594 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8dc413e050 con 0x7f8dc40b4380 2021-10-21T00:11:01.696 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:01.697 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:11:01.697 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:01.697 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:11:01.697 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:11:01.698 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:01.698 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:01.698 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:11:01.698 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:11:01.699 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:01.699 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:11:01.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 msgr2=0x7f8da8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 0x7f8da8055b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f8dac00d000 tx=0x7f8dac007b90).stop 2021-10-21T00:11:01.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 msgr2=0x7f8dc41565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f8dc413e430 tx=0x7f8dbc016000).stop 2021-10-21T00:11:01.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 shutdown_connections 2021-10-21T00:11:01.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8da80536a0 0x7f8da8055b60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc4140890 0x7f8dc413af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8dc40b4380 0x7f8dc41565a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 --2- 172.21.15.41:0/706995594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8dc40b1830 0x7f8dc41401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 >> 172.21.15.41:0/706995594 conn(0x7f8dc40b7910 msgr2=0x7f8dc40b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 shutdown_connections 2021-10-21T00:11:01.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.691+0000 7f8dc3fff700 1 -- 172.21.15.41:0/706995594 wait complete. 2021-10-21T00:11:01.709 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:11:01.709 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:11:01.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 Processor -- start 2021-10-21T00:11:01.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 -- start start 2021-10-21T00:11:01.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0880060c60 0x7f0880065a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f088013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800b0430 con 0x7f08800ac390 2021-10-21T00:11:01.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0880067180 con 0x7f0880060c60 2021-10-21T00:11:01.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f088482d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800b1a90 con 0x7f08800b0620 2021-10-21T00:11:01.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0880060c60 0x7f0880065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0880060c60 0x7f0880065a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36462/0 (socket says 172.21.15.41:36462) 2021-10-21T00:11:01.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 -- 172.21.15.41:0/1777300072 learned_addr learned my addr 172.21.15.41:0/1777300072 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087ed9d700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f088013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 -- 172.21.15.41:0/1777300072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 msgr2=0x7f088013ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:01.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f088013ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 -- 172.21.15.41:0/1777300072 >> v1:172.21.15.62:6789/0 conn(0x7f08800ac390 legacy=0x7f08800b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 -- 172.21.15.41:0/1777300072 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880061040 con 0x7f0880060c60 2021-10-21T00:11:01.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.815+0000 7f087e59c700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f0880065a00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f08700032f0 tx=0x7f0870009290).ready entity=mon.0 client_cookie=bfa45fef029e1b80 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087d59a700 1 -- 172.21.15.41:0/1777300072 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000b8a0 con 0x7f0880060c60 2021-10-21T00:11:01.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087d59a700 1 -- 172.21.15.41:0/1777300072 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000ba00 con 0x7f0880060c60 2021-10-21T00:11:01.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087d59a700 1 -- 172.21.15.41:0/1777300072 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000bb70 con 0x7f0880060c60 2021-10-21T00:11:01.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- 172.21.15.41:0/1777300072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 msgr2=0x7f0880065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f0880065a00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f08700032f0 tx=0x7f0870009290).stop 2021-10-21T00:11:01.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- 172.21.15.41:0/1777300072 shutdown_connections 2021-10-21T00:11:01.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f088013ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- 172.21.15.41:0/1777300072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f0880065a00 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- 172.21.15.41:0/1777300072 >> 172.21.15.41:0/1777300072 conn(0x7f0880063b70 msgr2=0x7f0880060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:01.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- 172.21.15.41:0/1777300072 shutdown_connections 2021-10-21T00:11:01.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- 172.21.15.41:0/1777300072 wait complete. 2021-10-21T00:11:01.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 Processor -- start 2021-10-21T00:11:01.834 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- start start 2021-10-21T00:11:01.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.835 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f0880155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800a5760 con 0x7f0880060c60 2021-10-21T00:11:01.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800a7a20 con 0x7f08800ac390 2021-10-21T00:11:01.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f088482d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08801557f0 con 0x7f08800b0620 2021-10-21T00:11:01.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087ed9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f0880155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48386/0 (socket says 172.21.15.41:48386) 2021-10-21T00:11:01.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087dd9b700 1 -- 172.21.15.41:0/462323231 learned_addr learned my addr 172.21.15.41:0/462323231 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:01.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36470/0 (socket says 172.21.15.41:36470) 2021-10-21T00:11:01.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 -- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 msgr2=0x7f0880155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f0880155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 -- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 msgr2=0x7f08800a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:01.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.819+0000 7f087e59c700 1 -- 172.21.15.41:0/462323231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870009530 con 0x7f0880060c60 2021-10-21T00:11:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f087dd9b700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f087e59c700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f08700032f0 tx=0x7f0870016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000b8a0 con 0x7f0880060c60 2021-10-21T00:11:01.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870021440 con 0x7f0880060c60 2021-10-21T00:11:01.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08800a9440 con 0x7f0880060c60 2021-10-21T00:11:01.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08700217a0 con 0x7f0880060c60 2021-10-21T00:11:01.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800a6610 con 0x7f0880060c60 2021-10-21T00:11:01.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880155c20 con 0x7f0880060c60 2021-10-21T00:11:01.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0870027020 con 0x7f0880060c60 2021-10-21T00:11:01.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.823+0000 7f086f7fe700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 0x7f085c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.827+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f087006c9a0 con 0x7f0880060c60 2021-10-21T00:11:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.827+0000 7f087dd9b700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 0x7f085c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:01.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.827+0000 7f087dd9b700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 0x7f085c055b00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f087400d000 tx=0x7f0874007be0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:01.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.831+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0880155c20 con 0x7f0880060c60 2021-10-21T00:11:01.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:01.959+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0880155c20 con 0x7f0880060c60 2021-10-21T00:11:02.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.887+0000 7f086f7fe700 1 -- 172.21.15.41:0/462323231 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v105) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0880155c20 con 0x7f0880060c60 2021-10-21T00:11:02.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 msgr2=0x7f085c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:02.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 0x7f085c055b00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f087400d000 tx=0x7f0874007be0).stop 2021-10-21T00:11:02.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 msgr2=0x7f08800a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:02.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f08700032f0 tx=0x7f0870016000).stop 2021-10-21T00:11:02.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 shutdown_connections 2021-10-21T00:11:02.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f085c053640 0x7f085c055b00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:02.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f08800b0620 0x7f0880155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:02.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08800ac390 0x7f08800a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:02.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 --2- 172.21.15.41:0/462323231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0880060c60 0x7f08800a2580 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:02.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.891+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 >> 172.21.15.41:0/462323231 conn(0x7f0880063b70 msgr2=0x7f0880065810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:02.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.895+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 shutdown_connections 2021-10-21T00:11:02.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:02.895+0000 7f088482d700 1 -- 172.21.15.41:0/462323231 wait complete. 2021-10-21T00:11:02.902 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:11:02.914 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:11:03.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 Processor -- start 2021-10-21T00:11:03.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 -- start start 2021-10-21T00:11:03.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac880b1a10 0x7fac8813f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8813ede0 con 0x7fac88128020 2021-10-21T00:11:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8813fe70 con 0x7fac880b1a10 2021-10-21T00:11:03.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8fe6f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac88128910 con 0x7fac88128480 2021-10-21T00:11:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8e40c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8dc0b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac880b1a10 0x7fac8813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8e40c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:54976/0 (socket says 172.21.15.41:54976) 2021-10-21T00:11:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8dc0b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fac880b1a10 0x7fac8813f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48394/0 (socket says 172.21.15.41:48394) 2021-10-21T00:11:03.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.027+0000 7fac8e40c700 1 -- 172.21.15.41:0/634076132 learned_addr learned my addr 172.21.15.41:0/634076132 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8dc0b700 1 -- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 msgr2=0x7fac880ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8dc0b700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8dc0b700 1 -- 172.21.15.41:0/634076132 >> v1:172.21.15.62:6789/0 conn(0x7fac88128020 legacy=0x7fac880ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8dc0b700 1 -- 172.21.15.41:0/634076132 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880b1df0 con 0x7fac880b1a10 2021-10-21T00:11:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8e40c700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8dc0b700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac880b1a10 0x7fac8813f980 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fac84002f70 tx=0x7fac84006e80).ready entity=mon.1 client_cookie=6d17671a8288154e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:03.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8cc09700 1 -- 172.21.15.41:0/634076132 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84012070 con 0x7fac880b1a10 2021-10-21T00:11:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8cc09700 1 -- 172.21.15.41:0/634076132 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84000e90 con 0x7fac880b1a10 2021-10-21T00:11:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8cc09700 1 -- 172.21.15.41:0/634076132 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8400f7f0 con 0x7fac880b1a10 2021-10-21T00:11:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac880b1a10 msgr2=0x7fac8813f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac880b1a10 0x7fac8813f980 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fac84002f70 tx=0x7fac84006e80).stop 2021-10-21T00:11:03.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- 172.21.15.41:0/634076132 shutdown_connections 2021-10-21T00:11:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128480 0x7fac880ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/634076132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac880b1a10 0x7fac8813f980 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- 172.21.15.41:0/634076132 >> 172.21.15.41:0/634076132 conn(0x7fac88063210 msgr2=0x7fac8805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:03.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- 172.21.15.41:0/634076132 shutdown_connections 2021-10-21T00:11:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- 172.21.15.41:0/634076132 wait complete. 2021-10-21T00:11:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 Processor -- start 2021-10-21T00:11:03.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.031+0000 7fac8fe6f700 1 -- start start 2021-10-21T00:11:03.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128020 0x7fac8811e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 0x7fac88066320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac88127a80 con 0x7fac880b1a10 2021-10-21T00:11:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8811e1e0 con 0x7fac88128480 2021-10-21T00:11:03.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8811e480 con 0x7fac88128020 2021-10-21T00:11:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36482/0 (socket says 172.21.15.41:36482) 2021-10-21T00:11:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 -- 172.21.15.41:0/2562315707 learned_addr learned my addr 172.21.15.41:0/2562315707 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:03.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8e40c700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 0x7fac88066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8d40a700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128020 0x7fac8811e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 -- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128020 msgr2=0x7fac8811e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128020 0x7fac8811e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 -- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 msgr2=0x7fac88066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 0x7fac88066320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 -- 172.21.15.41:0/2562315707 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8000b5e0 con 0x7fac880b1a10 2021-10-21T00:11:03.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8e40c700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 0x7fac88066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:03.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8dc0b700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fac84002f70 tx=0x7fac84006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:03.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84017660 con 0x7fac880b1a10 2021-10-21T00:11:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840177c0 con 0x7fac880b1a10 2021-10-21T00:11:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8400d590 con 0x7fac880b1a10 2021-10-21T00:11:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac84017b20 con 0x7fac880b1a10 2021-10-21T00:11:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.035+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8811ee10 con 0x7fac880b1a10 2021-10-21T00:11:03.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880ae900 con 0x7fac880b1a10 2021-10-21T00:11:03.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac84029020 con 0x7fac880b1a10 2021-10-21T00:11:03.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac76ffd700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 0x7fac68055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:03.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fac84070700 con 0x7fac880b1a10 2021-10-21T00:11:03.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac8d40a700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 0x7fac68055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:03.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.039+0000 7fac8d40a700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 0x7fac68055b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fac7800d000 tx=0x7fac78007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:03.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.043+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac84047920 con 0x7fac880b1a10 2021-10-21T00:11:03.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.175+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fac8805daf0 con 0x7fac880b1a10 2021-10-21T00:11:03.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.895+0000 7fac76ffd700 1 -- 172.21.15.41:0/2562315707 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v106) v1 ==== 125+0+0 (secure 0 0 0) 0x7fac8404af40 con 0x7fac880b1a10 2021-10-21T00:11:03.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 msgr2=0x7fac68055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 0x7fac68055b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fac7800d000 tx=0x7fac78007b90).stop 2021-10-21T00:11:03.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 msgr2=0x7fac880b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:03.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fac84002f70 tx=0x7fac84006e80).stop 2021-10-21T00:11:03.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 shutdown_connections 2021-10-21T00:11:03.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac680536a0 0x7fac68055b60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac88128480 0x7fac88066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac88128020 0x7fac8811e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 --2- 172.21.15.41:0/2562315707 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac880b1a10 0x7fac880b3ef0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:03.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.899+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 >> 172.21.15.41:0/2562315707 conn(0x7fac88063210 msgr2=0x7fac8813dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:03.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.903+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 shutdown_connections 2021-10-21T00:11:03.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:03.903+0000 7fac8fe6f700 1 -- 172.21.15.41:0/2562315707 wait complete. 2021-10-21T00:11:03.911 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:11:03.920 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:11:04.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 Processor -- start 2021-10-21T00:11:04.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 -- start start 2021-10-21T00:11:04.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd1940b22c0 0x7fd1940ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940adeb0 con 0x7fd19405c3b0 2021-10-21T00:11:04.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940ae150 con 0x7fd1940b1550 2021-10-21T00:11:04.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd19a1f6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1940ae3f0 con 0x7fd1940b22c0 2021-10-21T00:11:04.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.023+0000 7fd193fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd19405c3b0 0x7fd194141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34262/0 (socket says 172.21.15.41:34262) 2021-10-21T00:11:04.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd193fff700 1 -- 172.21.15.41:0/3455290702 learned_addr learned my addr 172.21.15.41:0/3455290702 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:04.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd1937fe700 1 --2- 172.21.15.41:0/3455290702 >> v2:172.21.15.41:3300/0 conn(0x7fd1940b22c0 0x7fd1940ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062615263 0 0) 0x7fd1940adeb0 con 0x7fd19405c3b0 2021-10-21T00:11:04.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd174003260 con 0x7fd19405c3b0 2021-10-21T00:11:04.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024371236 0 0) 0x7fd1940ae150 con 0x7fd1940b1550 2021-10-21T00:11:04.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1940adeb0 con 0x7fd1940b1550 2021-10-21T00:11:04.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd1937fe700 1 -- 172.21.15.41:0/3455290702 >> v1:172.21.15.62:6789/0 conn(0x7fd1940b1550 legacy=0x7fd19405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641060358 0 0) 0x7fd174003260 con 0x7fd19405c3b0 2021-10-21T00:11:04.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd1937fe700 1 -- 172.21.15.41:0/3455290702 >> v1:172.21.15.41:6789/0 conn(0x7fd19405c3b0 legacy=0x7fd194141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd1937fe700 1 -- 172.21.15.41:0/3455290702 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940b26a0 con 0x7fd1940b22c0 2021-10-21T00:11:04.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd1937fe700 1 --2- 172.21.15.41:0/3455290702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd1940ae890 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fd18c001490 tx=0x7fd184006df0).ready entity=mon.0 client_cookie=e78e07599cd4ac06 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd18c0019e0 con 0x7fd1940b22c0 2021-10-21T00:11:04.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184000e90 con 0x7fd1940b22c0 2021-10-21T00:11:04.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd192ffd700 1 -- 172.21.15.41:0/3455290702 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd184012460 con 0x7fd1940b22c0 2021-10-21T00:11:04.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 -- 172.21.15.41:0/3455290702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 msgr2=0x7fd1940ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/3455290702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd1940ae890 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fd18c001490 tx=0x7fd184006df0).stop 2021-10-21T00:11:04.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 -- 172.21.15.41:0/3455290702 shutdown_connections 2021-10-21T00:11:04.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/3455290702 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd1940ae890 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 -- 172.21.15.41:0/3455290702 >> 172.21.15.41:0/3455290702 conn(0x7fd1940630e0 msgr2=0x7fd1940634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 -- 172.21.15.41:0/3455290702 shutdown_connections 2021-10-21T00:11:04.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.027+0000 7fd19a1f6700 1 -- 172.21.15.41:0/3455290702 wait complete. 2021-10-21T00:11:04.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 Processor -- start 2021-10-21T00:11:04.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- start start 2021-10-21T00:11:04.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd19405c3b0 0x7fd1940b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1940b1550 0x7fd19413e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19414a470 con 0x7fd1940b22c0 2021-10-21T00:11:04.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19413f0a0 con 0x7fd1940b1550 2021-10-21T00:11:04.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194066b90 con 0x7fd19405c3b0 2021-10-21T00:11:04.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36500/0 (socket says 172.21.15.41:36500) 2021-10-21T00:11:04.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd1937fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd19405c3b0 0x7fd1940b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 -- 172.21.15.41:0/252050090 learned_addr learned my addr 172.21.15.41:0/252050090 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:04.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd18affd700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1940b1550 0x7fd19413e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 -- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd19405c3b0 msgr2=0x7fd1940b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd19405c3b0 0x7fd1940b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 -- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1940b1550 msgr2=0x7fd19413e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1940b1550 0x7fd19413e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 -- 172.21.15.41:0/252050090 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18400b180 con 0x7fd1940b22c0 2021-10-21T00:11:04.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd193fff700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fd18c001360 tx=0x7fd18c001cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd18c004ab0 con 0x7fd1940b22c0 2021-10-21T00:11:04.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c004c10 con 0x7fd1940b22c0 2021-10-21T00:11:04.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194066e30 con 0x7fd1940b22c0 2021-10-21T00:11:04.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd18c007170 con 0x7fd1940b22c0 2021-10-21T00:11:04.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.031+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1940672d0 con 0x7fd1940b22c0 2021-10-21T00:11:04.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.035+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd194064810 con 0x7fd1940b22c0 2021-10-21T00:11:04.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.035+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd18c0072d0 con 0x7fd1940b22c0 2021-10-21T00:11:04.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.035+0000 7fd1917fa700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 0x7fd178055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.035+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd18c06b620 con 0x7fd1940b22c0 2021-10-21T00:11:04.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.035+0000 7fd1937fe700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 0x7fd178055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.039+0000 7fd1937fe700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 0x7fd178055b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd18401a000 tx=0x7fd184014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.039+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd18c0427f0 con 0x7fd1940b22c0 2021-10-21T00:11:04.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.207+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd1940669c0 con 0x7fd1940b22c0 2021-10-21T00:11:04.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.215+0000 7fd1917fa700 1 -- 172.21.15.41:0/252050090 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v55) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd18c045e10 con 0x7fd1940b22c0 2021-10-21T00:11:04.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.215+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 msgr2=0x7fd178055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.215+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 0x7fd178055b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd18401a000 tx=0x7fd184014000).stop 2021-10-21T00:11:04.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.215+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 msgr2=0x7fd19413ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.215+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fd18c001360 tx=0x7fd18c001cf0).stop 2021-10-21T00:11:04.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 shutdown_connections 2021-10-21T00:11:04.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1780536a0 0x7fd178055b60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd1940b22c0 0x7fd19413ebb0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1940b1550 0x7fd19413e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 --2- 172.21.15.41:0/252050090 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd19405c3b0 0x7fd1940b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 >> 172.21.15.41:0/252050090 conn(0x7fd1940630e0 msgr2=0x7fd1940b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 shutdown_connections 2021-10-21T00:11:04.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.219+0000 7fd19a1f6700 1 -- 172.21.15.41:0/252050090 wait complete. 2021-10-21T00:11:04.226 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 21 and data pool 22 2021-10-21T00:11:04.240 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:04.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 Processor -- start 2021-10-21T00:11:04.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 -- start start 2021-10-21T00:11:04.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84f80b3bc0 0x7f84f8143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f8142bc0 con 0x7f84f80b9c70 2021-10-21T00:11:04.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80ba050 con 0x7f84f81418f0 2021-10-21T00:11:04.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84ff46e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f81429a0 con 0x7f84f80b3bc0 2021-10-21T00:11:04.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84fd20a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f84f80b9c70 0x7f84f8143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34274/0 (socket says 172.21.15.41:34274) 2021-10-21T00:11:04.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84fd20a700 1 -- 172.21.15.41:0/1378489457 learned_addr learned my addr 172.21.15.41:0/1378489457 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:04.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84fca09700 1 --2- 172.21.15.41:0/1378489457 >> v2:172.21.15.62:3300/0 conn(0x7f84f80b3bc0 0x7f84f8143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584051788 0 0) 0x7f84f8142bc0 con 0x7f84f80b9c70 2021-10-21T00:11:04.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.323+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84dc003260 con 0x7f84f80b9c70 2021-10-21T00:11:04.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875834719 0 0) 0x7f84f80ba050 con 0x7f84f81418f0 2021-10-21T00:11:04.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f8142bc0 con 0x7f84f81418f0 2021-10-21T00:11:04.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139921812 0 0) 0x7f84dc003260 con 0x7f84f80b9c70 2021-10-21T00:11:04.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 >> v2:172.21.15.62:3300/0 conn(0x7f84f80b3bc0 msgr2=0x7f84f8143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 --2- 172.21.15.41:0/1378489457 >> v2:172.21.15.62:3300/0 conn(0x7f84f80b3bc0 0x7f84f8143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 >> v1:172.21.15.62:6789/0 conn(0x7f84f81418f0 legacy=0x7f84f8141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f81463c0 con 0x7f84f80b9c70 2021-10-21T00:11:04.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f84f4001660 con 0x7f84f80b9c70 2021-10-21T00:11:04.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 >> v1:172.21.15.41:6789/0 conn(0x7f84f80b9c70 legacy=0x7f84f8143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84dc003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84dc004500 0x7f84dc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84dc004e70 0x7f84dc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f81429a0 con 0x7f84dc0038e0 2021-10-21T00:11:04.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc00bdd0 con 0x7f84dc004500 2021-10-21T00:11:04.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc00bf40 con 0x7f84dc004e70 2021-10-21T00:11:04.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84dc003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fca09700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84dc004500 0x7f84dc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fda0b700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84dc004e70 0x7f84dc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 -- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84dc004e70 msgr2=0x7f84dc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84dc004e70 0x7f84dc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 -- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84dc004500 msgr2=0x7f84dc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84dc004500 0x7f84dc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 -- 172.21.15.41:0/1378489457 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc003260 con 0x7f84dc0038e0 2021-10-21T00:11:04.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fda0b700 1 -- 172.21.15.41:0/1378489457 reap_dead start 2021-10-21T00:11:04.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84fd20a700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84dc003ce0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f84f4001430 tx=0x7f84f80b0c80).ready entity=mon.0 client_cookie=65e41eb32fa82980 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f40077e0 con 0x7f84dc0038e0 2021-10-21T00:11:04.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40070d0 con 0x7f84dc0038e0 2021-10-21T00:11:04.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84e3fff700 1 -- 172.21.15.41:0/1378489457 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f4007430 con 0x7f84dc0038e0 2021-10-21T00:11:04.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 -- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 msgr2=0x7f84dc003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84dc003ce0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f84f4001430 tx=0x7f84f80b0c80).stop 2021-10-21T00:11:04.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 -- 172.21.15.41:0/1378489457 shutdown_connections 2021-10-21T00:11:04.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 --2- 172.21.15.41:0/1378489457 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84dc003ce0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 -- 172.21.15.41:0/1378489457 >> 172.21.15.41:0/1378489457 conn(0x7f84f8062e80 msgr2=0x7f84f80b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 -- 172.21.15.41:0/1378489457 shutdown_connections 2021-10-21T00:11:04.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.327+0000 7f84ff46e700 1 -- 172.21.15.41:0/1378489457 wait complete. 2021-10-21T00:11:04.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 Processor -- start 2021-10-21T00:11:04.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- start start 2021-10-21T00:11:04.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 0x7f84f80acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84f80adc30 0x7f84f80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f813e650 con 0x7f84dc0038e0 2021-10-21T00:11:04.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80af310 con 0x7f84f80aee70 2021-10-21T00:11:04.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80af5b0 con 0x7f84f80adc30 2021-10-21T00:11:04.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36516/0 (socket says 172.21.15.41:36516) 2021-10-21T00:11:04.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 -- 172.21.15.41:0/2120173806 learned_addr learned my addr 172.21.15.41:0/2120173806 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:04.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fca09700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 0x7f84f80acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fda0b700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84f80adc30 0x7f84f80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 -- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84f80adc30 msgr2=0x7f84f80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84f80adc30 0x7f84f80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 -- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 msgr2=0x7f84f80acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 0x7f84f80acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 -- 172.21.15.41:0/2120173806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80af850 con 0x7f84dc0038e0 2021-10-21T00:11:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fca09700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 0x7f84f80acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84fd20a700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f84f4001430 tx=0x7f84f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f40077e0 con 0x7f84dc0038e0 2021-10-21T00:11:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4001760 con 0x7f84dc0038e0 2021-10-21T00:11:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f80b9200 con 0x7f84dc0038e0 2021-10-21T00:11:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f4004900 con 0x7f84dc0038e0 2021-10-21T00:11:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.331+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f80b8910 con 0x7f84dc0038e0 2021-10-21T00:11:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f84f4026070 con 0x7f84dc0038e0 2021-10-21T00:11:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f8146120 con 0x7f84dc0038e0 2021-10-21T00:11:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84eaffd700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 0x7f84d4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84f406bdf0 con 0x7f84dc0038e0 2021-10-21T00:11:04.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84fca09700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 0x7f84d4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.335+0000 7f84fca09700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 0x7f84d4055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f84ec00b000 tx=0x7f84ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.339+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84f4042e40 con 0x7f84dc0038e0 2021-10-21T00:11:04.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.475+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84f8057350 con 0x7f84dc0038e0 2021-10-21T00:11:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84eaffd700 1 -- 172.21.15.41:0/2120173806 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16064 (secure 0 0 0) 0x7f84f4046460 con 0x7f84dc0038e0 2021-10-21T00:11:04.484 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:04.484 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":107,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:04.209175+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:02.014555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:03.230021+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:04.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 msgr2=0x7f84d4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 0x7f84d4055ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f84ec00b000 tx=0x7f84ec008040).stop 2021-10-21T00:11:04.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 msgr2=0x7f84f80b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f84f4001430 tx=0x7f84f4015000).stop 2021-10-21T00:11:04.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 shutdown_connections 2021-10-21T00:11:04.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f84d4053610 0x7f84d4055ad0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84f80adc30 0x7f84f80ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80aee70 0x7f84f80acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 --2- 172.21.15.41:0/2120173806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f84dc0038e0 0x7f84f80b8420 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 >> 172.21.15.41:0/2120173806 conn(0x7f84f8062e80 msgr2=0x7f84f80b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 shutdown_connections 2021-10-21T00:11:04.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.479+0000 7f84ff46e700 1 -- 172.21.15.41:0/2120173806 wait complete. 2021-10-21T00:11:04.497 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:04.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 Processor -- start 2021-10-21T00:11:04.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 -- start start 2021-10-21T00:11:04.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f37400b2170 0x7f37400ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37400af620 0x7f37400ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400b0b50 con 0x7f37400abb50 2021-10-21T00:11:04.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400b2550 con 0x7f37400b2170 2021-10-21T00:11:04.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400b0d90 con 0x7f37400af620 2021-10-21T00:11:04.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f37400abb50 0x7f374014a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34298/0 (socket says 172.21.15.41:34298) 2021-10-21T00:11:04.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373f7fe700 1 -- 172.21.15.41:0/470601754 learned_addr learned my addr 172.21.15.41:0/470601754 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:04.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f37400b2170 0x7f37400ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373e7fc700 1 --2- 172.21.15.41:0/470601754 >> v2:172.21.15.62:3300/0 conn(0x7f37400af620 0x7f37400ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045714089 0 0) 0x7f3738001490 con 0x7f37400abb50 2021-10-21T00:11:04.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3724003260 con 0x7f37400abb50 2021-10-21T00:11:04.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142132716 0 0) 0x7f3724003260 con 0x7f37400abb50 2021-10-21T00:11:04.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 >> v2:172.21.15.62:3300/0 conn(0x7f37400af620 msgr2=0x7f37400ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 --2- 172.21.15.41:0/470601754 >> v2:172.21.15.62:3300/0 conn(0x7f37400af620 0x7f37400ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 >> v2:172.21.15.41:3300/0 conn(0x7f37400b2170 msgr2=0x7f37400ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.595+0000 7f373dffb700 1 --2- 172.21.15.41:0/470601754 >> v2:172.21.15.41:3300/0 conn(0x7f37400b2170 0x7f37400ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400b1030 con 0x7f37400abb50 2021-10-21T00:11:04.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f3738001b70 con 0x7f37400abb50 2021-10-21T00:11:04.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 >> v1:172.21.15.41:6789/0 conn(0x7f37400abb50 legacy=0x7f374014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3724003750 0x7f3724003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f3724004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3724004e70 0x7f372400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400b2550 con 0x7f3724004500 2021-10-21T00:11:04.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400b0d90 con 0x7f3724003750 2021-10-21T00:11:04.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372400bc40 con 0x7f3724004e70 2021-10-21T00:11:04.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373effd700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3724003750 0x7f3724003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f3724004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373f7fe700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3724004e70 0x7f372400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 -- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3724004e70 msgr2=0x7f372400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3724004e70 0x7f372400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 -- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3724003750 msgr2=0x7f3724003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3724003750 0x7f3724003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 -- 172.21.15.41:0/470601754 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724003260 con 0x7f3724004500 2021-10-21T00:11:04.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373f7fe700 1 -- 172.21.15.41:0/470601754 reap_dead start 2021-10-21T00:11:04.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373e7fc700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f3724004980 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f373000c000 tx=0x7f3730006df0).ready entity=mon.0 client_cookie=472420cf8d3cfa0d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373000e7a0 con 0x7f3724004500 2021-10-21T00:11:04.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000e900 con 0x7f3724004500 2021-10-21T00:11:04.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373dffb700 1 -- 172.21.15.41:0/470601754 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373000ec60 con 0x7f3724004500 2021-10-21T00:11:04.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 -- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 msgr2=0x7f3724004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f3724004980 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f373000c000 tx=0x7f3730006df0).stop 2021-10-21T00:11:04.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 -- 172.21.15.41:0/470601754 shutdown_connections 2021-10-21T00:11:04.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 --2- 172.21.15.41:0/470601754 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f3724004980 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 -- 172.21.15.41:0/470601754 >> 172.21.15.41:0/470601754 conn(0x7f37400b5700 msgr2=0x7f37400b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 -- 172.21.15.41:0/470601754 shutdown_connections 2021-10-21T00:11:04.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.599+0000 7f373ffff700 1 -- 172.21.15.41:0/470601754 wait complete. 2021-10-21T00:11:04.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 Processor -- start 2021-10-21T00:11:04.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- start start 2021-10-21T00:11:04.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 0x7f3740066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3740066c80 0x7f3740067130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400663b0 con 0x7f3724004500 2021-10-21T00:11:04.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374005ad30 con 0x7f37401487f0 2021-10-21T00:11:04.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400aeb70 con 0x7f3740066c80 2021-10-21T00:11:04.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36536/0 (socket says 172.21.15.41:36536) 2021-10-21T00:11:04.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 -- 172.21.15.41:0/3056053559 learned_addr learned my addr 172.21.15.41:0/3056053559 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:04.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373e7fc700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 0x7f3740066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373f7fe700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3740066c80 0x7f3740067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 -- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3740066c80 msgr2=0x7f3740067130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3740066c80 0x7f3740067130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 -- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 msgr2=0x7f3740066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 0x7f3740066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 -- 172.21.15.41:0/3056053559 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400983c0 con 0x7f3724004500 2021-10-21T00:11:04.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373e7fc700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 0x7f3740066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:04.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373effd700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f373400b000 tx=0x7f3734006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373400f940 con 0x7f3724004500 2021-10-21T00:11:04.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400faa0 con 0x7f3724004500 2021-10-21T00:11:04.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37400635e0 con 0x7f3724004500 2021-10-21T00:11:04.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f373400fe40 con 0x7f3724004500 2021-10-21T00:11:04.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.603+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37400ad050 con 0x7f3724004500 2021-10-21T00:11:04.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3734014440 con 0x7f3724004500 2021-10-21T00:11:04.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f372ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 0x7f371c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f373406c440 con 0x7f3724004500 2021-10-21T00:11:04.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f373e7fc700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 0x7f371c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37400b12d0 con 0x7f3724004500 2021-10-21T00:11:04.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.607+0000 7f373e7fc700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 0x7f371c055b90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f373001b000 tx=0x7f3730019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.611+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3734018080 con 0x7f3724004500 2021-10-21T00:11:04.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.739+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3740057350 con 0x7f3724004500 2021-10-21T00:11:04.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f372ffff700 1 -- 172.21.15.41:0/3056053559 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16064 (secure 0 0 0) 0x7f37340434a0 con 0x7f3724004500 2021-10-21T00:11:04.750 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:04.750 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":107,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:04.209175+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:02.014555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:03.230021+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:04.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 msgr2=0x7f371c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 0x7f371c055b90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f373001b000 tx=0x7f3730019000).stop 2021-10-21T00:11:04.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 msgr2=0x7f374014ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f373400b000 tx=0x7f3734006df0).stop 2021-10-21T00:11:04.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 shutdown_connections 2021-10-21T00:11:04.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f371c0536d0 0x7f371c055b90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3740066c80 0x7f3740067130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37401487f0 0x7f3740066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 --2- 172.21.15.41:0/3056053559 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3724004500 0x7f374014ca70 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 >> 172.21.15.41:0/3056053559 conn(0x7f37400b5700 msgr2=0x7f37400b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 shutdown_connections 2021-10-21T00:11:04.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.743+0000 7f373ffff700 1 -- 172.21.15.41:0/3056053559 wait complete. 2021-10-21T00:11:04.762 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:11:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 Processor -- start 2021-10-21T00:11:04.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 -- start start 2021-10-21T00:11:04.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30c40b7300 0x7f30c413a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30c413a9b0 0x7f30c4065a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c40b76e0 con 0x7f30c4065ef0 2021-10-21T00:11:04.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c4144de0 con 0x7f30c413a9b0 2021-10-21T00:11:04.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30cb8bf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40ac890 con 0x7f30c40b7300 2021-10-21T00:11:04.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30c413a9b0 0x7f30c4065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f30c413a9b0 0x7f30c4065a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36546/0 (socket says 172.21.15.41:36546) 2021-10-21T00:11:04.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c9e5c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f30c4065ef0 0x7f30c40b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34318/0 (socket says 172.21.15.41:34318) 2021-10-21T00:11:04.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 -- 172.21.15.41:0/3104161550 learned_addr learned my addr 172.21.15.41:0/3104161550 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:04.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c965b700 1 --2- 172.21.15.41:0/3104161550 >> v2:172.21.15.62:3300/0 conn(0x7f30c40b7300 0x7f30c413a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 -- 172.21.15.41:0/3104161550 >> v2:172.21.15.62:3300/0 conn(0x7f30c40b7300 msgr2=0x7f30c413a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:04.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 --2- 172.21.15.41:0/3104161550 >> v2:172.21.15.62:3300/0 conn(0x7f30c40b7300 0x7f30c413a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 -- 172.21.15.41:0/3104161550 >> v1:172.21.15.41:6789/0 conn(0x7f30c4065ef0 legacy=0x7f30c40b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 -- 172.21.15.41:0/3104161550 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40acb30 con 0x7f30c413a9b0 2021-10-21T00:11:04.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c8e5a700 1 --2- 172.21.15.41:0/3104161550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c4065a00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f30b4001110 tx=0x7f30bc009290).ready entity=mon.0 client_cookie=2ca5586a040a7dbc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c3fff700 1 -- 172.21.15.41:0/3104161550 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30bc00b730 con 0x7f30c413a9b0 2021-10-21T00:11:04.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c3fff700 1 -- 172.21.15.41:0/3104161550 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00b890 con 0x7f30c413a9b0 2021-10-21T00:11:04.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.871+0000 7f30c3fff700 1 -- 172.21.15.41:0/3104161550 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30bc00ba00 con 0x7f30c413a9b0 2021-10-21T00:11:04.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3104161550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 msgr2=0x7f30c4065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3104161550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c4065a00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f30b4001110 tx=0x7f30bc009290).stop 2021-10-21T00:11:04.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3104161550 shutdown_connections 2021-10-21T00:11:04.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3104161550 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c4065a00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3104161550 >> v2:172.21.15.62:3300/0 conn(0x7f30c40b7300 0x7f30c413a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3104161550 >> 172.21.15.41:0/3104161550 conn(0x7f30c4069df0 msgr2=0x7f30c4064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:04.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3104161550 shutdown_connections 2021-10-21T00:11:04.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3104161550 wait complete. 2021-10-21T00:11:04.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 Processor -- start 2021-10-21T00:11:04.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- start start 2021-10-21T00:11:04.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30c4065ef0 0x7f30c40b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 0x7f30c4066f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b4eb0 con 0x7f30c413a9b0 2021-10-21T00:11:04.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b5150 con 0x7f30c40b7300 2021-10-21T00:11:04.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30cb8bf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b53f0 con 0x7f30c4065ef0 2021-10-21T00:11:04.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36552/0 (socket says 172.21.15.41:36552) 2021-10-21T00:11:04.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 -- 172.21.15.41:0/3863546246 learned_addr learned my addr 172.21.15.41:0/3863546246 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:04.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c965b700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30c4065ef0 0x7f30c40b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c8e5a700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 0x7f30c4066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 -- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30c4065ef0 msgr2=0x7f30c40b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30c4065ef0 0x7f30c40b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 -- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 msgr2=0x7f30c4066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:04.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 0x7f30c4066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:04.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 -- 172.21.15.41:0/3863546246 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009530 con 0x7f30c413a9b0 2021-10-21T00:11:04.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c8e5a700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 0x7f30c4066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:04.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.875+0000 7f30c9e5c700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f30b4000fe0 tx=0x7f30b4007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b40072e0 con 0x7f30c413a9b0 2021-10-21T00:11:04.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4005550 con 0x7f30c413a9b0 2021-10-21T00:11:04.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40b0220 con 0x7f30c413a9b0 2021-10-21T00:11:04.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b40058f0 con 0x7f30c413a9b0 2021-10-21T00:11:04.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c4139bc0 con 0x7f30c413a9b0 2021-10-21T00:11:04.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c40ad9d0 con 0x7f30c413a9b0 2021-10-21T00:11:04.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30b4010070 con 0x7f30c413a9b0 2021-10-21T00:11:04.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 0x7f30a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:04.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f30b406b1b0 con 0x7f30c413a9b0 2021-10-21T00:11:04.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c965b700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 0x7f30a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:04.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.879+0000 7f30c965b700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 0x7f30a4055b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f30b800b000 tx=0x7f30b8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:04.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:04.883+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f30b4042310 con 0x7f30c413a9b0 2021-10-21T00:11:05.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.051+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30c4057350 con 0x7f30c413a9b0 2021-10-21T00:11:05.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.227+0000 7f30c27fc700 1 -- 172.21.15.41:0/3863546246 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30b4045930 con 0x7f30c413a9b0 2021-10-21T00:11:05.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.227+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 msgr2=0x7f30a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.235 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.227+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 0x7f30a4055b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f30b800b000 tx=0x7f30b8006df0).stop 2021-10-21T00:11:05.236 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 msgr2=0x7f30c40afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f30b4000fe0 tx=0x7f30b4007bc0).stop 2021-10-21T00:11:05.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 shutdown_connections 2021-10-21T00:11:05.237 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30a40536a0 0x7f30a4055b60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f30c413a9b0 0x7f30c40afd30 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30c40b7300 0x7f30c4066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 --2- 172.21.15.41:0/3863546246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30c4065ef0 0x7f30c40b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.238 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 >> 172.21.15.41:0/3863546246 conn(0x7f30c4069df0 msgr2=0x7f30c4144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:05.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 shutdown_connections 2021-10-21T00:11:05.239 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.231+0000 7f30cb8bf700 1 -- 172.21.15.41:0/3863546246 wait complete. 2021-10-21T00:11:05.253 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:05.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 Processor -- start 2021-10-21T00:11:05.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 -- start start 2021-10-21T00:11:05.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fea100b2170 0x7fea100ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fea10149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea100b0b50 con 0x7fea100af620 2021-10-21T00:11:05.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100b2550 con 0x7fea100b2170 2021-10-21T00:11:05.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea16662700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100b0d90 con 0x7fea10067a80 2021-10-21T00:11:05.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea14e5f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fea100af620 0x7fea100ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34328/0 (socket says 172.21.15.41:34328) 2021-10-21T00:11:05.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea14e5f700 1 -- 172.21.15.41:0/3136238581 learned_addr learned my addr 172.21.15.41:0/3136238581 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:05.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea15e61700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fea10149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea15660700 1 --2- 172.21.15.41:0/3136238581 >> v2:172.21.15.62:3300/0 conn(0x7fea100b2170 0x7fea100ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703185141 0 0) 0x7fea0c001490 con 0x7fea100af620 2021-10-21T00:11:05.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003260 con 0x7fea100af620 2021-10-21T00:11:05.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937045182 0 0) 0x7fe9f4003260 con 0x7fea100af620 2021-10-21T00:11:05.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 msgr2=0x7fea10149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fea10149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 >> v2:172.21.15.62:3300/0 conn(0x7fea100b2170 msgr2=0x7fea100ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 --2- 172.21.15.41:0/3136238581 >> v2:172.21.15.62:3300/0 conn(0x7fea100b2170 0x7fea100ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100b1030 con 0x7fea100af620 2021-10-21T00:11:05.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fea0c001b70 con 0x7fea100af620 2021-10-21T00:11:05.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 >> v1:172.21.15.41:6789/0 conn(0x7fea100af620 legacy=0x7fea100ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f4003750 0x7fe9f4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fe9f4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f40049f0 0x7fe9f4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea100b2550 con 0x7fe9f40049f0 2021-10-21T00:11:05.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea100b0d90 con 0x7fe9f4003750 2021-10-21T00:11:05.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.355+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400b750 con 0x7fea10067a80 2021-10-21T00:11:05.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f40049f0 0x7fe9f4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea14e5f700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fe9f4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15660700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f4003750 0x7fe9f4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 -- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 msgr2=0x7fe9f4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea10067a80 0x7fe9f4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 -- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f4003750 msgr2=0x7fe9f4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f4003750 0x7fe9f4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 -- 172.21.15.41:0/3136238581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4003260 con 0x7fe9f40049f0 2021-10-21T00:11:05.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f40049f0 0x7fe9f4004e70 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fea0800c000 tx=0x7fea08006df0).ready entity=mon.0 client_cookie=400c22b4b945adf8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0800e800 con 0x7fe9f40049f0 2021-10-21T00:11:05.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800e960 con 0x7fe9f40049f0 2021-10-21T00:11:05.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea07fff700 1 -- 172.21.15.41:0/3136238581 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0800ecc0 con 0x7fe9f40049f0 2021-10-21T00:11:05.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 -- 172.21.15.41:0/3136238581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f40049f0 msgr2=0x7fe9f4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 --2- 172.21.15.41:0/3136238581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f40049f0 0x7fe9f4004e70 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fea0800c000 tx=0x7fea08006df0).stop 2021-10-21T00:11:05.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea15e61700 1 -- 172.21.15.41:0/3136238581 reap_dead start 2021-10-21T00:11:05.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 -- 172.21.15.41:0/3136238581 shutdown_connections 2021-10-21T00:11:05.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 -- 172.21.15.41:0/3136238581 >> 172.21.15.41:0/3136238581 conn(0x7fea100b5700 msgr2=0x7fea100b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:05.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 -- 172.21.15.41:0/3136238581 shutdown_connections 2021-10-21T00:11:05.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.359+0000 7fea16662700 1 -- 172.21.15.41:0/3136238581 wait complete. 2021-10-21T00:11:05.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 Processor -- start 2021-10-21T00:11:05.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 -- start start 2021-10-21T00:11:05.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f40049f0 0x7fea100ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea10064250 0x7fea10064d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10063cb0 con 0x7fea10148a70 2021-10-21T00:11:05.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10096f50 con 0x7fea10064250 2021-10-21T00:11:05.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea16662700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea10065260 con 0x7fe9f40049f0 2021-10-21T00:11:05.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36572/0 (socket says 172.21.15.41:36572) 2021-10-21T00:11:05.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea15660700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f40049f0 0x7fea100ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 -- 172.21.15.41:0/583309958 learned_addr learned my addr 172.21.15.41:0/583309958 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:05.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea15e61700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea10064250 0x7fea10064d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 -- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f40049f0 msgr2=0x7fea100ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f40049f0 0x7fea100ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 -- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea10064250 msgr2=0x7fea10064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea10064250 0x7fea10064d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 -- 172.21.15.41:0/583309958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100635e0 con 0x7fea10148a70 2021-10-21T00:11:05.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea14e5f700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fea0c00d000 tx=0x7fea10061f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.363+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c00fac0 con 0x7fea10148a70 2021-10-21T00:11:05.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00fc20 con 0x7fea10148a70 2021-10-21T00:11:05.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea100aeb40 con 0x7fea10148a70 2021-10-21T00:11:05.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c012350 con 0x7fea10148a70 2021-10-21T00:11:05.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100ad460 con 0x7fea10148a70 2021-10-21T00:11:05.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea0c0124b0 con 0x7fea10148a70 2021-10-21T00:11:05.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10063af0 con 0x7fea10148a70 2021-10-21T00:11:05.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea067fc700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 0x7fe9f8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea0c06b460 con 0x7fea10148a70 2021-10-21T00:11:05.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea15660700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 0x7fe9f8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.367+0000 7fea15660700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 0x7fe9f8055b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fea0000b000 tx=0x7fea00006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.375+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea0c0424c0 con 0x7fea10148a70 2021-10-21T00:11:05.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea100b0b50 con 0x7fea10148a70 2021-10-21T00:11:05.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea067fc700 1 -- 172.21.15.41:0/583309958 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fea100b0b50 con 0x7fea10148a70 2021-10-21T00:11:05.545 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:05.546 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/2545988246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2545988246},{"type":"v1","addr":"172.21.15.41:6833","nonce":2545988246}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:04.209527+0000","modified":"2021-10-21T00:11:05.213156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"b","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/851642528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":851642528},{"type":"v1","addr":"172.21.15.62:6835","nonce":851642528}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-21T00:11:05.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 msgr2=0x7fe9f8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 0x7fe9f8055b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fea0000b000 tx=0x7fea00006df0).stop 2021-10-21T00:11:05.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 msgr2=0x7fea10064880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fea0c00d000 tx=0x7fea10061f20).stop 2021-10-21T00:11:05.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 shutdown_connections 2021-10-21T00:11:05.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9f8053640 0x7fe9f8055b00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea10064250 0x7fea10064d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fea10148a70 0x7fea10064880 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 --2- 172.21.15.41:0/583309958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f40049f0 0x7fea100ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.539+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 >> 172.21.15.41:0/583309958 conn(0x7fea100b5700 msgr2=0x7fea10097f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:05.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.543+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 shutdown_connections 2021-10-21T00:11:05.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.543+0000 7fea16662700 1 -- 172.21.15.41:0/583309958 wait complete. 2021-10-21T00:11:05.642 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 56 2021-10-21T00:11:05.644 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:05.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 Processor -- start 2021-10-21T00:11:05.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 -- start start 2021-10-21T00:11:05.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72980b4380 0x7f729805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980b4760 con 0x7f72980b1830 2021-10-21T00:11:05.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980ad4c0 con 0x7f7298140890 2021-10-21T00:11:05.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f729ce1c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72980ad760 con 0x7f72980b4380 2021-10-21T00:11:05.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f7296ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f72980b1830 0x7f729805fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34348/0 (socket says 172.21.15.41:34348) 2021-10-21T00:11:05.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f7296ffd700 1 -- 172.21.15.41:0/3392933870 learned_addr learned my addr 172.21.15.41:0/3392933870 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:05.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72977fe700 1 --2- 172.21.15.41:0/3392933870 >> v2:172.21.15.62:3300/0 conn(0x7f72980b4380 0x7f729805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547596518 0 0) 0x7f72980b4760 con 0x7f72980b1830 2021-10-21T00:11:05.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7284003260 con 0x7f72980b1830 2021-10-21T00:11:05.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743992570 0 0) 0x7f7284003260 con 0x7f72980b1830 2021-10-21T00:11:05.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 >> v2:172.21.15.62:3300/0 conn(0x7f72980b4380 msgr2=0x7f729805f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 --2- 172.21.15.41:0/3392933870 >> v2:172.21.15.62:3300/0 conn(0x7f72980b4380 0x7f729805f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 >> v1:172.21.15.62:6789/0 conn(0x7f7298140890 legacy=0x7f7298140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980ada00 con 0x7f72980b1830 2021-10-21T00:11:05.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f7288001660 con 0x7f72980b1830 2021-10-21T00:11:05.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 >> v1:172.21.15.41:6789/0 conn(0x7f72980b1830 legacy=0x7f729805fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.747+0000 7f72967fc700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284003750 0x7f7284003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7284004500 0x7f7284004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 0x7f728400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72980ad760 con 0x7f7284004e70 2021-10-21T00:11:05.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728400bd20 con 0x7f7284003750 2021-10-21T00:11:05.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728400bee0 con 0x7f7284004500 2021-10-21T00:11:05.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 0x7f728400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72977fe700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284003750 0x7f7284003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7296ffd700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7284004500 0x7f7284004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 -- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7284004500 msgr2=0x7f7284004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7284004500 0x7f7284004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 -- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284003750 msgr2=0x7f7284003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:05.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284003750 0x7f7284003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 -- 172.21.15.41:0/3392933870 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284003260 con 0x7f7284004e70 2021-10-21T00:11:05.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 -- 172.21.15.41:0/3392933870 reap_dead start 2021-10-21T00:11:05.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f7297fff700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 0x7f728400b750 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f72980643f0 tx=0x7f7290007d80).ready entity=mon.0 client_cookie=3b8efc9ce29a1cc6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7290001620 con 0x7f7284004e70 2021-10-21T00:11:05.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290006890 con 0x7f7284004e70 2021-10-21T00:11:05.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f72967fc700 1 -- 172.21.15.41:0/3392933870 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7290006bf0 con 0x7f7284004e70 2021-10-21T00:11:05.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 -- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 msgr2=0x7f728400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 0x7f728400b750 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f72980643f0 tx=0x7f7290007d80).stop 2021-10-21T00:11:05.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 -- 172.21.15.41:0/3392933870 shutdown_connections 2021-10-21T00:11:05.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 --2- 172.21.15.41:0/3392933870 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7284004e70 0x7f728400b750 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 -- 172.21.15.41:0/3392933870 >> 172.21.15.41:0/3392933870 conn(0x7f72980b7910 msgr2=0x7f72980b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:05.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 -- 172.21.15.41:0/3392933870 shutdown_connections 2021-10-21T00:11:05.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 -- 172.21.15.41:0/3392933870 wait complete. 2021-10-21T00:11:05.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.751+0000 7f729ce1c700 1 Processor -- start 2021-10-21T00:11:05.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- start start 2021-10-21T00:11:05.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284004e70 0x7f72981518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f729809c050 0x7f72980b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72980b0050 con 0x7f72980ae4e0 2021-10-21T00:11:05.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729813ae60 con 0x7f7284004e70 2021-10-21T00:11:05.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72980af300 con 0x7f729809c050 2021-10-21T00:11:05.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36592/0 (socket says 172.21.15.41:36592) 2021-10-21T00:11:05.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 -- 172.21.15.41:0/1537882709 learned_addr learned my addr 172.21.15.41:0/1537882709 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:05.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f72977fe700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284004e70 0x7f72981518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7296ffd700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f729809c050 0x7f72980b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 -- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f729809c050 msgr2=0x7f72980b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f729809c050 0x7f72980b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 -- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284004e70 msgr2=0x7f72981518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284004e70 0x7f72981518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 -- 172.21.15.41:0/1537882709 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980af560 con 0x7f72980ae4e0 2021-10-21T00:11:05.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7297fff700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f729809c520 tx=0x7f7290016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7290001620 con 0x7f72980ae4e0 2021-10-21T00:11:05.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729000c860 con 0x7f72980ae4e0 2021-10-21T00:11:05.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7290006ea0 con 0x7f72980ae4e0 2021-10-21T00:11:05.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729813b290 con 0x7f72980ae4e0 2021-10-21T00:11:05.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.755+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729809cba0 con 0x7f72980ae4e0 2021-10-21T00:11:05.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72980adea0 con 0x7f72980ae4e0 2021-10-21T00:11:05.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7290026070 con 0x7f72980ae4e0 2021-10-21T00:11:05.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f7294ff9700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 0x7f7278055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:05.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f729006c9d0 con 0x7f72980ae4e0 2021-10-21T00:11:05.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f72977fe700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 0x7f7278055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:05.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.759+0000 7f72977fe700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 0x7f7278055b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f728c00b000 tx=0x7f728c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:05.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.763+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7290043b30 con 0x7f72980ae4e0 2021-10-21T00:11:05.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.891+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7298057350 con 0x7f72980ae4e0 2021-10-21T00:11:05.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.891+0000 7f7294ff9700 1 -- 172.21.15.41:0/1537882709 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f7290047150 con 0x7f72980ae4e0 2021-10-21T00:11:05.898 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:05.899 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":108,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:05.213279+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:02.014555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:03.230021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:05.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 msgr2=0x7f7278055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 0x7f7278055b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f728c00b000 tx=0x7f728c006df0).stop 2021-10-21T00:11:05.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 msgr2=0x7f729813f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:05.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f729809c520 tx=0x7f7290016000).stop 2021-10-21T00:11:05.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 shutdown_connections 2021-10-21T00:11:05.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f72780536d0 0x7f7278055b90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72980ae4e0 0x7f729813f9e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f729809c050 0x7f72980b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 --2- 172.21.15.41:0/1537882709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7284004e70 0x7f72981518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:05.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 >> 172.21.15.41:0/1537882709 conn(0x7f72980b7910 msgr2=0x7f72980b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:05.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 shutdown_connections 2021-10-21T00:11:05.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:05.895+0000 7f729ce1c700 1 -- 172.21.15.41:0/1537882709 wait complete. 2021-10-21T00:11:05.912 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:06.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.019+0000 7fcc7ffff700 1 Processor -- start 2021-10-21T00:11:06.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.019+0000 7fcc7ffff700 1 -- start start 2021-10-21T00:11:06.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fcc8013c510 0x7fcc8013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80142ad0 con 0x7fcc80142f00 2021-10-21T00:11:06.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800b3520 con 0x7fcc8013c510 2021-10-21T00:11:06.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80143c40 con 0x7fcc80062330 2021-10-21T00:11:06.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcc80142f00 0x7fcc80143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34370/0 (socket says 172.21.15.41:34370) 2021-10-21T00:11:06.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7f7fe700 1 -- 172.21.15.41:0/3192678955 learned_addr learned my addr 172.21.15.41:0/3192678955 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:06.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 --2- 172.21.15.41:0/3192678955 >> v2:172.21.15.41:3300/0 conn(0x7fcc8013c510 0x7fcc8013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7effd700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 -- 172.21.15.41:0/3192678955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 msgr2=0x7fcc800b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:06.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 -- 172.21.15.41:0/3192678955 >> v1:172.21.15.41:6789/0 conn(0x7fcc80142f00 legacy=0x7fcc80143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 -- 172.21.15.41:0/3192678955 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8013ce60 con 0x7fcc8013c510 2021-10-21T00:11:06.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7e7fc700 1 -- 172.21.15.41:0/3192678955 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940717717 0 0) 0x7fcc80142ad0 con 0x7fcc80142f00 2021-10-21T00:11:06.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc767fc700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc8013c970 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fcc68002f70 tx=0x7fcc68006df0).ready entity=mon.0 client_cookie=766399ff309a040a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7e7fc700 1 -- 172.21.15.41:0/3192678955 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6800d570 con 0x7fcc8013c510 2021-10-21T00:11:06.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7e7fc700 1 -- 172.21.15.41:0/3192678955 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68000e90 con 0x7fcc8013c510 2021-10-21T00:11:06.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7e7fc700 1 -- 172.21.15.41:0/3192678955 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6800d8c0 con 0x7fcc8013c510 2021-10-21T00:11:06.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- 172.21.15.41:0/3192678955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 msgr2=0x7fcc8013c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc8013c970 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fcc68002f70 tx=0x7fcc68006df0).stop 2021-10-21T00:11:06.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- 172.21.15.41:0/3192678955 shutdown_connections 2021-10-21T00:11:06.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc8013c970 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/3192678955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- 172.21.15.41:0/3192678955 >> 172.21.15.41:0/3192678955 conn(0x7fcc800b9080 msgr2=0x7fcc800b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- 172.21.15.41:0/3192678955 shutdown_connections 2021-10-21T00:11:06.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.023+0000 7fcc7ffff700 1 -- 172.21.15.41:0/3192678955 wait complete. 2021-10-21T00:11:06.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 Processor -- start 2021-10-21T00:11:06.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- start start 2021-10-21T00:11:06.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc80142f00 0x7fcc80147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80138810 con 0x7fcc8013c510 2021-10-21T00:11:06.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80139100 con 0x7fcc80142f00 2021-10-21T00:11:06.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8013dca0 con 0x7fcc80062330 2021-10-21T00:11:06.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36604/0 (socket says 172.21.15.41:36604) 2021-10-21T00:11:06.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 -- 172.21.15.41:0/4132714304 learned_addr learned my addr 172.21.15.41:0/4132714304 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:06.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7f7fe700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc80142f00 0x7fcc80147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7effd700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 -- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 msgr2=0x7fcc800b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 -- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc80142f00 msgr2=0x7fcc80147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc80142f00 0x7fcc80147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 -- 172.21.15.41:0/4132714304 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6800b180 con 0x7fcc8013c510 2021-10-21T00:11:06.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc767fc700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fcc68002f70 tx=0x7fcc68014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6800dea0 con 0x7fcc8013c510 2021-10-21T00:11:06.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68013e90 con 0x7fcc8013c510 2021-10-21T00:11:06.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8013b140 con 0x7fcc8013c510 2021-10-21T00:11:06.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6801e5f0 con 0x7fcc8013c510 2021-10-21T00:11:06.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.027+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8013a7d0 con 0x7fcc8013c510 2021-10-21T00:11:06.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc68025030 con 0x7fcc8013c510 2021-10-21T00:11:06.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc801392c0 con 0x7fcc8013c510 2021-10-21T00:11:06.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7cff9700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 0x7fcc58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc6806c750 con 0x7fcc8013c510 2021-10-21T00:11:06.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7effd700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 0x7fcc58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.031+0000 7fcc7effd700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 0x7fcc58055b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fcc7000b000 tx=0x7fcc70006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.039+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc680438f0 con 0x7fcc8013c510 2021-10-21T00:11:06.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.203+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcc80145f90 con 0x7fcc8013c510 2021-10-21T00:11:06.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.207+0000 7fcc7cff9700 1 -- 172.21.15.41:0/4132714304 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcc68046ed0 con 0x7fcc8013c510 2021-10-21T00:11:06.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 msgr2=0x7fcc58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 0x7fcc58055b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fcc7000b000 tx=0x7fcc70006df0).stop 2021-10-21T00:11:06.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 msgr2=0x7fcc80147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fcc68002f70 tx=0x7fcc68014000).stop 2021-10-21T00:11:06.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 shutdown_connections 2021-10-21T00:11:06.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcc580536a0 0x7fcc58055b60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc80142f00 0x7fcc80147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcc8013c510 0x7fcc80147050 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 --2- 172.21.15.41:0/4132714304 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcc80062330 0x7fcc800b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 >> 172.21.15.41:0/4132714304 conn(0x7fcc800b9080 msgr2=0x7fcc80143340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 shutdown_connections 2021-10-21T00:11:06.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.211+0000 7fcc7ffff700 1 -- 172.21.15.41:0/4132714304 wait complete. 2021-10-21T00:11:06.223 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:11:06.232 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:06.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.343+0000 7f0aea588700 1 Processor -- start 2021-10-21T00:11:06.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.343+0000 7f0aea588700 1 -- start start 2021-10-21T00:11:06.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 0x7f0ae40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae40b0180 0x7f0ae413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae405bca0 0x7f0ae413f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae413f7c0 con 0x7f0ae40b0180 2021-10-21T00:11:06.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40b6350 con 0x7f0ae40b5f70 2021-10-21T00:11:06.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40ae560 con 0x7f0ae405bca0 2021-10-21T00:11:06.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae40b0180 0x7f0ae413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0ae40b0180 0x7f0ae413ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36610/0 (socket says 172.21.15.41:36610) 2021-10-21T00:11:06.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 -- 172.21.15.41:0/4192192887 learned_addr learned my addr 172.21.15.41:0/4192192887 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:06.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae9586700 1 --2- 172.21.15.41:0/4192192887 >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 0x7f0ae40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae9d87700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae405bca0 0x7f0ae413f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 -- 172.21.15.41:0/4192192887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae405bca0 msgr2=0x7f0ae413f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:06.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae405bca0 0x7f0ae413f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 -- 172.21.15.41:0/4192192887 >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 msgr2=0x7f0ae40aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:06.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4192192887 >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 0x7f0ae40aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 -- 172.21.15.41:0/4192192887 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40ae800 con 0x7f0ae40b0180 2021-10-21T00:11:06.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae9586700 1 --2- 172.21.15.41:0/4192192887 >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 0x7f0ae40aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:06.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae40b0180 0x7f0ae413ede0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f0ad8002f70 tx=0x7f0ad8006eb0).ready entity=mon.0 client_cookie=4656df04493cd1e7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ad7fff700 1 -- 172.21.15.41:0/4192192887 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ad800d570 con 0x7f0ae40b0180 2021-10-21T00:11:06.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ad7fff700 1 -- 172.21.15.41:0/4192192887 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8000e90 con 0x7f0ae40b0180 2021-10-21T00:11:06.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0ad7fff700 1 -- 172.21.15.41:0/4192192887 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ad800d900 con 0x7f0ae40b0180 2021-10-21T00:11:06.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- 172.21.15.41:0/4192192887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae40b0180 msgr2=0x7f0ae413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae40b0180 0x7f0ae413ede0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f0ad8002f70 tx=0x7f0ad8006eb0).stop 2021-10-21T00:11:06.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- 172.21.15.41:0/4192192887 shutdown_connections 2021-10-21T00:11:06.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae40b0180 0x7f0ae413ede0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- 172.21.15.41:0/4192192887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae405bca0 0x7f0ae413f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 --2- 172.21.15.41:0/4192192887 >> v2:172.21.15.62:3300/0 conn(0x7f0ae40b5f70 0x7f0ae40aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- 172.21.15.41:0/4192192887 >> 172.21.15.41:0/4192192887 conn(0x7f0ae40639f0 msgr2=0x7f0ae40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- 172.21.15.41:0/4192192887 shutdown_connections 2021-10-21T00:11:06.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.347+0000 7f0aea588700 1 -- 172.21.15.41:0/4192192887 wait complete. 2021-10-21T00:11:06.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 Processor -- start 2021-10-21T00:11:06.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- start start 2021-10-21T00:11:06.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae40b0180 0x7f0ae4134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae40b5f70 0x7f0ae4135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4066200 con 0x7f0ae405bca0 2021-10-21T00:11:06.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4141220 con 0x7f0ae40b5f70 2021-10-21T00:11:06.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae413b580 con 0x7f0ae40b0180 2021-10-21T00:11:06.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36616/0 (socket says 172.21.15.41:36616) 2021-10-21T00:11:06.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 -- 172.21.15.41:0/4285682369 learned_addr learned my addr 172.21.15.41:0/4285682369 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:06.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae40b0180 0x7f0ae4134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9d87700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae40b5f70 0x7f0ae4135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 -- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae40b0180 msgr2=0x7f0ae4134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae40b0180 0x7f0ae4134f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 -- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae40b5f70 msgr2=0x7f0ae4135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae40b5f70 0x7f0ae4135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 -- 172.21.15.41:0/4285682369 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae000b180 con 0x7f0ae405bca0 2021-10-21T00:11:06.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ae9586700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f0ae000c000 tx=0x7f0ae0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae000ca40 con 0x7f0ae405bca0 2021-10-21T00:11:06.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000cba0 con 0x7f0ae405bca0 2021-10-21T00:11:06.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae00123f0 con 0x7f0ae405bca0 2021-10-21T00:11:06.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad800b1e0 con 0x7f0ae405bca0 2021-10-21T00:11:06.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.351+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4135970 con 0x7f0ae405bca0 2021-10-21T00:11:06.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae4141420 con 0x7f0ae405bca0 2021-10-21T00:11:06.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ae0012550 con 0x7f0ae405bca0 2021-10-21T00:11:06.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0ad67fc700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 0x7f0ac4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ae006c000 con 0x7f0ae405bca0 2021-10-21T00:11:06.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 0x7f0ac4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.355+0000 7f0ae8d85700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 0x7f0ac4055b00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f0ad801a000 tx=0x7f0ad8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.363+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ae0043100 con 0x7f0ae405bca0 2021-10-21T00:11:06.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.527+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0ae4066020 con 0x7f0ae405bca0 2021-10-21T00:11:06.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.535+0000 7f0ad67fc700 1 -- 172.21.15.41:0/4285682369 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0ae0046720 con 0x7f0ae405bca0 2021-10-21T00:11:06.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.535+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 msgr2=0x7f0ac4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.535+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 0x7f0ac4055b00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f0ad801a000 tx=0x7f0ad8015000).stop 2021-10-21T00:11:06.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 msgr2=0x7f0ae4141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f0ae000c000 tx=0x7f0ae0006df0).stop 2021-10-21T00:11:06.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 shutdown_connections 2021-10-21T00:11:06.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ac4053640 0x7f0ac4055b00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ae40b5f70 0x7f0ae4135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ae40b0180 0x7f0ae4134f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 --2- 172.21.15.41:0/4285682369 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0ae405bca0 0x7f0ae4141b00 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 >> 172.21.15.41:0/4285682369 conn(0x7f0ae40639f0 msgr2=0x7f0ae4066760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 shutdown_connections 2021-10-21T00:11:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.539+0000 7f0aea588700 1 -- 172.21.15.41:0/4285682369 wait complete. 2021-10-21T00:11:06.546 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:11:06.556 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:06.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 Processor -- start 2021-10-21T00:11:06.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 -- start start 2021-10-21T00:11:06.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31300b3bc0 0x7f3130143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f3130141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3130142bc0 con 0x7f31300b9c70 2021-10-21T00:11:06.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31301429a0 con 0x7f31300b3bc0 2021-10-21T00:11:06.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3136d21700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300ba050 con 0x7f31301418f0 2021-10-21T00:11:06.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3134abd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f31300b9c70 0x7f3130143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34394/0 (socket says 172.21.15.41:34394) 2021-10-21T00:11:06.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f3134abd700 1 -- 172.21.15.41:0/3339199305 learned_addr learned my addr 172.21.15.41:0/3339199305 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:06.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f31352be700 1 --2- 172.21.15.41:0/3339199305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f3130141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f312ffff700 1 --2- 172.21.15.41:0/3339199305 >> v2:172.21.15.62:3300/0 conn(0x7f31300b3bc0 0x7f3130143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f312f7fe700 1 -- 172.21.15.41:0/3339199305 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624015014 0 0) 0x7f3130142bc0 con 0x7f31300b9c70 2021-10-21T00:11:06.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.663+0000 7f312f7fe700 1 -- 172.21.15.41:0/3339199305 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c003260 con 0x7f31300b9c70 2021-10-21T00:11:06.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f31352be700 1 -- 172.21.15.41:0/3339199305 >> v2:172.21.15.62:3300/0 conn(0x7f31300b3bc0 msgr2=0x7f3130143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:06.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f31352be700 1 --2- 172.21.15.41:0/3339199305 >> v2:172.21.15.62:3300/0 conn(0x7f31300b3bc0 0x7f3130143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f31352be700 1 -- 172.21.15.41:0/3339199305 >> v1:172.21.15.41:6789/0 conn(0x7f31300b9c70 legacy=0x7f3130143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f31352be700 1 -- 172.21.15.41:0/3339199305 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31301463c0 con 0x7f31301418f0 2021-10-21T00:11:06.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f31352be700 1 --2- 172.21.15.41:0/3339199305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f3130141d50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f31280032f0 tx=0x7f31280091d0).ready entity=mon.2 client_cookie=890ab253165a5d1b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f312f7fe700 1 -- 172.21.15.41:0/3339199305 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312800b600 con 0x7f31301418f0 2021-10-21T00:11:06.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f312f7fe700 1 -- 172.21.15.41:0/3339199305 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312800b760 con 0x7f31301418f0 2021-10-21T00:11:06.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f312f7fe700 1 -- 172.21.15.41:0/3339199305 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312800b8d0 con 0x7f31301418f0 2021-10-21T00:11:06.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 -- 172.21.15.41:0/3339199305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 msgr2=0x7f3130141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 --2- 172.21.15.41:0/3339199305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f3130141d50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f31280032f0 tx=0x7f31280091d0).stop 2021-10-21T00:11:06.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 -- 172.21.15.41:0/3339199305 shutdown_connections 2021-10-21T00:11:06.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 --2- 172.21.15.41:0/3339199305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f3130141d50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 --2- 172.21.15.41:0/3339199305 >> v2:172.21.15.62:3300/0 conn(0x7f31300b3bc0 0x7f3130143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 -- 172.21.15.41:0/3339199305 >> 172.21.15.41:0/3339199305 conn(0x7f3130062e80 msgr2=0x7f31300b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 -- 172.21.15.41:0/3339199305 shutdown_connections 2021-10-21T00:11:06.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.667+0000 7f3136d21700 1 -- 172.21.15.41:0/3339199305 wait complete. 2021-10-21T00:11:06.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 Processor -- start 2021-10-21T00:11:06.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 -- start start 2021-10-21T00:11:06.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31300b9c70 0x7f313013dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f313013e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300adaa0 con 0x7f31300b3bc0 2021-10-21T00:11:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130112be0 con 0x7f31300b9c70 2021-10-21T00:11:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3136d21700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300adcd0 con 0x7f31301418f0 2021-10-21T00:11:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36630/0 (socket says 172.21.15.41:36630) 2021-10-21T00:11:06.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 -- 172.21.15.41:0/990290740 learned_addr learned my addr 172.21.15.41:0/990290740 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:06.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f31352be700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f313013e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f312ffff700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31300b9c70 0x7f313013dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 -- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 msgr2=0x7f313013e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f313013e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 -- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31300b9c70 msgr2=0x7f313013dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31300b9c70 0x7f313013dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 -- 172.21.15.41:0/990290740 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128009470 con 0x7f31300b3bc0 2021-10-21T00:11:06.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.671+0000 7f3134abd700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f3120001110 tx=0x7f3120007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31200070d0 con 0x7f31300b3bc0 2021-10-21T00:11:06.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3120007230 con 0x7f31300b3bc0 2021-10-21T00:11:06.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3130112940 con 0x7f31300b3bc0 2021-10-21T00:11:06.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3120005610 con 0x7f31300b3bc0 2021-10-21T00:11:06.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313013f4d0 con 0x7f31300b3bc0 2021-10-21T00:11:06.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3130146120 con 0x7f31300b3bc0 2021-10-21T00:11:06.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3120010070 con 0x7f31300b3bc0 2021-10-21T00:11:06.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 0x7f3110055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f312006aee0 con 0x7f31300b3bc0 2021-10-21T00:11:06.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.675+0000 7f312ffff700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 0x7f3110055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.679+0000 7f312ffff700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 0x7f3110055a70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f312400b000 tx=0x7f3124006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.679+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3120042040 con 0x7f31300b3bc0 2021-10-21T00:11:06.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.847+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3130113b90 con 0x7f31300b3bc0 2021-10-21T00:11:06.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.855+0000 7f312dffb700 1 -- 172.21.15.41:0/990290740 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3120045660 con 0x7f31300b3bc0 2021-10-21T00:11:06.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 msgr2=0x7f3110055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 0x7f3110055a70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f312400b000 tx=0x7f3124006df0).stop 2021-10-21T00:11:06.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 msgr2=0x7f3130141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f3120001110 tx=0x7f3120007aa0).stop 2021-10-21T00:11:06.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 shutdown_connections 2021-10-21T00:11:06.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31100535b0 0x7f3110055a70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31301418f0 0x7f313013e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31300b9c70 0x7f313013dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 --2- 172.21.15.41:0/990290740 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31300b3bc0 0x7f3130141cd0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 >> 172.21.15.41:0/990290740 conn(0x7f3130062e80 msgr2=0x7f313013ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 shutdown_connections 2021-10-21T00:11:06.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.859+0000 7f3136d21700 1 -- 172.21.15.41:0/990290740 wait complete. 2021-10-21T00:11:06.868 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:11:06.877 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:06.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.975+0000 7fe9effff700 1 Processor -- start 2021-10-21T00:11:06.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.975+0000 7fe9effff700 1 -- start start 2021-10-21T00:11:06.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9f00af720 0x7fe9f0143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f013d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00b3770 con 0x7fe9f00b2370 2021-10-21T00:11:06.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f00afb00 con 0x7fe9f00af720 2021-10-21T00:11:06.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00afdf0 con 0x7fe9f005f6b0 2021-10-21T00:11:06.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe9f00af720 0x7fe9f0143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9e7fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe9f00b2370 0x7fe9f00b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42464/0 (socket says 172.21.15.41:42464) 2021-10-21T00:11:06.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9e7fff700 1 -- 172.21.15.41:0/1293375894 learned_addr learned my addr 172.21.15.41:0/1293375894 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:06.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 --2- 172.21.15.41:0/1293375894 >> v2:172.21.15.41:3300/0 conn(0x7fe9f00af720 0x7fe9f0143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36640/0 (socket says 172.21.15.41:36640) 2021-10-21T00:11:06.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9ef7fe700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f013d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 -- 172.21.15.41:0/1293375894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 msgr2=0x7fe9f013d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:06.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9ee7fc700 1 -- 172.21.15.41:0/1293375894 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691779508 0 0) 0x7fe9f00b3770 con 0x7fe9f00b2370 2021-10-21T00:11:06.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f013d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 -- 172.21.15.41:0/1293375894 >> v1:172.21.15.62:6789/0 conn(0x7fe9f00b2370 legacy=0x7fe9f00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 -- 172.21.15.41:0/1293375894 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00b0090 con 0x7fe9f00af720 2021-10-21T00:11:06.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9eeffd700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f0143cf0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fe9e0002f70 tx=0x7fe9e0006df0).ready entity=mon.0 client_cookie=4f335586299ba2a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9ee7fc700 1 -- 172.21.15.41:0/1293375894 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e0006e60 con 0x7fe9f00af720 2021-10-21T00:11:06.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9ee7fc700 1 -- 172.21.15.41:0/1293375894 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0000e90 con 0x7fe9f00af720 2021-10-21T00:11:06.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9ee7fc700 1 -- 172.21.15.41:0/1293375894 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000d690 con 0x7fe9f00af720 2021-10-21T00:11:06.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- 172.21.15.41:0/1293375894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 msgr2=0x7fe9f0143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f0143cf0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fe9e0002f70 tx=0x7fe9e0006df0).stop 2021-10-21T00:11:06.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- 172.21.15.41:0/1293375894 shutdown_connections 2021-10-21T00:11:06.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f013d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 --2- 172.21.15.41:0/1293375894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f0143cf0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- 172.21.15.41:0/1293375894 >> 172.21.15.41:0/1293375894 conn(0x7fe9f00637b0 msgr2=0x7fe9f0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:06.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- 172.21.15.41:0/1293375894 shutdown_connections 2021-10-21T00:11:06.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.979+0000 7fe9effff700 1 -- 172.21.15.41:0/1293375894 wait complete. 2021-10-21T00:11:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 Processor -- start 2021-10-21T00:11:06.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- start start 2021-10-21T00:11:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f01463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f00b2370 0x7fe9f00b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f0064e20 con 0x7fe9f00af720 2021-10-21T00:11:06.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00646e0 con 0x7fe9f00b2370 2021-10-21T00:11:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f0064980 con 0x7fe9f005f6b0 2021-10-21T00:11:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9eeffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f01463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36646/0 (socket says 172.21.15.41:36646) 2021-10-21T00:11:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 -- 172.21.15.41:0/3422978336 learned_addr learned my addr 172.21.15.41:0/3422978336 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9ef7fe700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f00b2370 0x7fe9f00b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 -- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 msgr2=0x7fe9f01463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f01463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 -- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f00b2370 msgr2=0x7fe9f00b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f00b2370 0x7fe9f00b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 -- 172.21.15.41:0/3422978336 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e000b120 con 0x7fe9f00af720 2021-10-21T00:11:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9e7fff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe9d8000ed0 tx=0x7fe9d8007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:06.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d80070d0 con 0x7fe9f00af720 2021-10-21T00:11:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8007230 con 0x7fe9f00af720 2021-10-21T00:11:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8005610 con 0x7fe9f00af720 2021-10-21T00:11:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f00af170 con 0x7fe9f00af720 2021-10-21T00:11:07.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.983+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f00ad610 con 0x7fe9f00af720 2021-10-21T00:11:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f00adc90 con 0x7fe9f00af720 2021-10-21T00:11:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9d8010070 con 0x7fe9f00af720 2021-10-21T00:11:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9ecff9700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 0x7fe9d4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9d806af30 con 0x7fe9f00af720 2021-10-21T00:11:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9eeffd700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 0x7fe9d4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.987+0000 7fe9eeffd700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 0x7fe9d4055ad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fe9e001a000 tx=0x7fe9e0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:06.991+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9f00adc90 con 0x7fe9f00af720 2021-10-21T00:11:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.155+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9f00adc90 con 0x7fe9f00af720 2021-10-21T00:11:07.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.155+0000 7fe9ecff9700 1 -- 172.21.15.41:0/3422978336 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fe9f00adc90 con 0x7fe9f00af720 2021-10-21T00:11:07.162 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:07.163 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/2545988246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2545988246},{"type":"v1","addr":"172.21.15.41:6833","nonce":2545988246}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:04.209527+0000","modified":"2021-10-21T00:11:05.213156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"b","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/851642528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":851642528},{"type":"v1","addr":"172.21.15.62:6835","nonce":851642528}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-21T00:11:07.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 msgr2=0x7fe9d4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 0x7fe9d4055ad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fe9e001a000 tx=0x7fe9e0014000).stop 2021-10-21T00:11:07.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 msgr2=0x7fe9f00b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe9d8000ed0 tx=0x7fe9d8007ce0).stop 2021-10-21T00:11:07.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 shutdown_connections 2021-10-21T00:11:07.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe9d4053610 0x7fe9d4055ad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9f00b2370 0x7fe9f00b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe9f00af720 0x7fe9f00b43e0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 --2- 172.21.15.41:0/3422978336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe9f005f6b0 0x7fe9f01463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 >> 172.21.15.41:0/3422978336 conn(0x7fe9f00637b0 msgr2=0x7fe9f00b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:07.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 shutdown_connections 2021-10-21T00:11:07.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.159+0000 7fe9effff700 1 -- 172.21.15.41:0/3422978336 wait complete. 2021-10-21T00:11:07.169 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 56 2021-10-21T00:11:07.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:04.209527+0000', 'modified': '2021-10-21T00:11:05.213156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7683}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7683': {'gid': 7683, 'name': 'b', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/851642528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 851642528}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 851642528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:07.384 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:07.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:11:07.503 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7683,"want_state":"up:active","state":"up:active","rank_uptime":3.2757723429999999,"mdsmap_epoch":56,"osdmap_epoch":108,"osdmap_epoch_barrier":107,"uptime":8.2536021809999998} 2021-10-21T00:11:07.503 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7683, "mdsmap_epoch": 56, "osdmap_epoch": 108, "osdmap_epoch_barrier": 107, "rank_uptime": 3.275772343, "state": "up:active", "uptime": 8.253602181, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:07.504 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 Processor -- start 2021-10-21T00:11:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 -- start start 2021-10-21T00:11:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8afc0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8afc067a80 0x7f8afc149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc0b0b50 con 0x7f8afc0af620 2021-10-21T00:11:07.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc0b2550 con 0x7f8afc067a80 2021-10-21T00:11:07.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01989700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b0d90 con 0x7f8afc0b2170 2021-10-21T00:11:07.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8afbfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8afc0af620 0x7f8afc0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34422/0 (socket says 172.21.15.41:34422) 2021-10-21T00:11:07.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8afbfff700 1 -- 172.21.15.41:0/3481478418 learned_addr learned my addr 172.21.15.41:0/3481478418 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:07.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> v2:172.21.15.62:3300/0 conn(0x7f8afc067a80 0x7f8afc149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8b00987700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8afc0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773952313 0 0) 0x7f8aec001490 con 0x7f8afc0af620 2021-10-21T00:11:07.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.610+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae8003260 con 0x7f8afc0af620 2021-10-21T00:11:07.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790467849 0 0) 0x7f8ae8003260 con 0x7f8afc0af620 2021-10-21T00:11:07.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 msgr2=0x7f8afc0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:07.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8afc0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 >> v2:172.21.15.62:3300/0 conn(0x7f8afc067a80 msgr2=0x7f8afc149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:07.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 --2- 172.21.15.41:0/3481478418 >> v2:172.21.15.62:3300/0 conn(0x7f8afc067a80 0x7f8afc149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0b1030 con 0x7f8afc0af620 2021-10-21T00:11:07.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f8aec001b70 con 0x7f8afc0af620 2021-10-21T00:11:07.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> v2:172.21.15.62:3300/0 conn(0x7f8afc067a80 0x7f8afc149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:07.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 >> v1:172.21.15.41:6789/0 conn(0x7f8afc0af620 legacy=0x7f8afc0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8ae8003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae8003c80 0x7f8ae8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ae80049f0 0x7f8ae8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b2550 con 0x7f8ae80049f0 2021-10-21T00:11:07.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b0d90 con 0x7f8ae8003c80 2021-10-21T00:11:07.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae800b750 con 0x7f8afc0b2170 2021-10-21T00:11:07.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ae80049f0 0x7f8ae8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afbfff700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae8003c80 0x7f8ae8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b00987700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8ae8003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 -- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 msgr2=0x7f8ae8003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:07.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8ae8003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 -- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae8003c80 msgr2=0x7f8ae8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:07.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae8003c80 0x7f8ae8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 -- 172.21.15.41:0/3481478418 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8003260 con 0x7f8ae80049f0 2021-10-21T00:11:07.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b00987700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc0b2170 0x7f8ae8003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:07.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ae80049f0 0x7f8ae8004e70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f8ae80054d0 tx=0x7f8af4006df0).ready entity=mon.0 client_cookie=e9a5230d8aafcc33 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af400e830 con 0x7f8ae80049f0 2021-10-21T00:11:07.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af400e990 con 0x7f8ae80049f0 2021-10-21T00:11:07.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8afb7fe700 1 -- 172.21.15.41:0/3481478418 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af400ecf0 con 0x7f8ae80049f0 2021-10-21T00:11:07.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 -- 172.21.15.41:0/3481478418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ae80049f0 msgr2=0x7f8ae8004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 --2- 172.21.15.41:0/3481478418 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8ae80049f0 0x7f8ae8004e70 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f8ae80054d0 tx=0x7f8af4006df0).stop 2021-10-21T00:11:07.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01188700 1 -- 172.21.15.41:0/3481478418 reap_dead start 2021-10-21T00:11:07.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 -- 172.21.15.41:0/3481478418 shutdown_connections 2021-10-21T00:11:07.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 -- 172.21.15.41:0/3481478418 >> 172.21.15.41:0/3481478418 conn(0x7f8afc0b5700 msgr2=0x7f8afc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:07.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 -- 172.21.15.41:0/3481478418 shutdown_connections 2021-10-21T00:11:07.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.614+0000 7f8b01989700 1 -- 172.21.15.41:0/3481478418 wait complete. 2021-10-21T00:11:07.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 Processor -- start 2021-10-21T00:11:07.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 -- start start 2021-10-21T00:11:07.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 0x7f8afc0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc1484b0 0x7f8afc148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc063d10 con 0x7f8afc0adc50 2021-10-21T00:11:07.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b3850 con 0x7f8ae80049f0 2021-10-21T00:11:07.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0ac970 con 0x7f8afc1484b0 2021-10-21T00:11:07.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36666/0 (socket says 172.21.15.41:36666) 2021-10-21T00:11:07.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 -- 172.21.15.41:0/2655865890 learned_addr learned my addr 172.21.15.41:0/2655865890 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:07.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b00987700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 0x7f8afc0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01188700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc1484b0 0x7f8afc148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 -- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc1484b0 msgr2=0x7f8afc148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc1484b0 0x7f8afc148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 -- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 msgr2=0x7f8afc0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 0x7f8afc0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 -- 172.21.15.41:0/2655865890 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc148e20 con 0x7f8afc0adc50 2021-10-21T00:11:07.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b00987700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 0x7f8afc0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:07.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8afbfff700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f8afc0ac730 tx=0x7f8afc061f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aec00fa60 con 0x7f8afc0adc50 2021-10-21T00:11:07.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec00fbc0 con 0x7f8afc0adc50 2021-10-21T00:11:07.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc0acba0 con 0x7f8afc0adc50 2021-10-21T00:11:07.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.618+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aec007880 con 0x7f8afc0adc50 2021-10-21T00:11:07.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc0ad0e0 con 0x7f8afc0adc50 2021-10-21T00:11:07.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc0b12d0 con 0x7f8afc0adc50 2021-10-21T00:11:07.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8aec0133f0 con 0x7f8afc0adc50 2021-10-21T00:11:07.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8af9ffb700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 0x7f8adc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8aec06b4f0 con 0x7f8afc0adc50 2021-10-21T00:11:07.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.622+0000 7f8b00987700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 0x7f8adc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.626+0000 7f8b00987700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 0x7f8adc055b60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8af000b000 tx=0x7f8af0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.630+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8aec0424e0 con 0x7f8afc0adc50 2021-10-21T00:11:07.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8afc0b0b50 con 0x7f8afc0adc50 2021-10-21T00:11:07.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8af9ffb700 1 -- 172.21.15.41:0/2655865890 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f8afc0b0b50 con 0x7f8afc0adc50 2021-10-21T00:11:07.765 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:07.766 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":108,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:05.213279+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:02.014555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:03.230021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:07.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 msgr2=0x7f8adc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 0x7f8adc055b60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8af000b000 tx=0x7f8af0008040).stop 2021-10-21T00:11:07.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 msgr2=0x7f8afc147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f8afc0ac730 tx=0x7f8afc061f20).stop 2021-10-21T00:11:07.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 shutdown_connections 2021-10-21T00:11:07.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8adc0536a0 0x7f8adc055b60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8afc1484b0 0x7f8afc148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8afc0adc50 0x7f8afc147fc0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 --2- 172.21.15.41:0/2655865890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ae80049f0 0x7f8afc0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 >> 172.21.15.41:0/2655865890 conn(0x7f8afc0b5700 msgr2=0x7f8afc09a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:07.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.758+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 shutdown_connections 2021-10-21T00:11:07.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.762+0000 7f8b01989700 1 -- 172.21.15.41:0/2655865890 wait complete. 2021-10-21T00:11:07.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:11:02.014555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:11:03.230021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:11:07.780 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:07.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.886+0000 7f563c7af700 1 Processor -- start 2021-10-21T00:11:07.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.886+0000 7f563c7af700 1 -- start start 2021-10-21T00:11:07.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b9ca0 0x7f56340b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f56340b31e0 0x7f56340b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340ba080 con 0x7f56340b24b0 2021-10-21T00:11:07.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563405c670 con 0x7f56340b31e0 2021-10-21T00:11:07.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563405c8e0 con 0x7f56340b9ca0 2021-10-21T00:11:07.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563ad4c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f56340b24b0 0x7f5634146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34446/0 (socket says 172.21.15.41:34446) 2021-10-21T00:11:07.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f56340b31e0 0x7f56340b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563ad4c700 1 -- 172.21.15.41:0/1386161461 learned_addr learned my addr 172.21.15.41:0/1386161461 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:07.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563a54b700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b9ca0 0x7f56340b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 -- 172.21.15.41:0/1386161461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b9ca0 msgr2=0x7f56340b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:07.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b9ca0 0x7f56340b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 -- 172.21.15.41:0/1386161461 >> v1:172.21.15.41:6789/0 conn(0x7f56340b24b0 legacy=0x7f5634146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 -- 172.21.15.41:0/1386161461 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563405cb80 con 0x7f56340b31e0 2021-10-21T00:11:07.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639549700 1 -- 172.21.15.41:0/1386161461 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710789768 0 0) 0x7f56340ba080 con 0x7f56340b24b0 2021-10-21T00:11:07.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639d4a700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b1fc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f5624002f70 tx=0x7f5624006df0).ready entity=mon.0 client_cookie=785122cc4c447846 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639549700 1 -- 172.21.15.41:0/1386161461 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562400d570 con 0x7f56340b31e0 2021-10-21T00:11:07.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639549700 1 -- 172.21.15.41:0/1386161461 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624000e90 con 0x7f56340b31e0 2021-10-21T00:11:07.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f5639549700 1 -- 172.21.15.41:0/1386161461 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562400d8c0 con 0x7f56340b31e0 2021-10-21T00:11:07.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- 172.21.15.41:0/1386161461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 msgr2=0x7f56340b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b1fc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f5624002f70 tx=0x7f5624006df0).stop 2021-10-21T00:11:07.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- 172.21.15.41:0/1386161461 shutdown_connections 2021-10-21T00:11:07.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b1fc0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 --2- 172.21.15.41:0/1386161461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b9ca0 0x7f56340b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- 172.21.15.41:0/1386161461 >> 172.21.15.41:0/1386161461 conn(0x7f5634062f00 msgr2=0x7f56340b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:07.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- 172.21.15.41:0/1386161461 shutdown_connections 2021-10-21T00:11:07.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.890+0000 7f563c7af700 1 -- 172.21.15.41:0/1386161461 wait complete. 2021-10-21T00:11:07.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 Processor -- start 2021-10-21T00:11:07.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- start start 2021-10-21T00:11:07.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 0x7f5634151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56340b9ca0 0x7f56341555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340af440 con 0x7f56340b31e0 2021-10-21T00:11:07.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634155180 con 0x7f56340b9ca0 2021-10-21T00:11:07.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56341466e0 con 0x7f56340b24b0 2021-10-21T00:11:07.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36680/0 (socket says 172.21.15.41:36680) 2021-10-21T00:11:07.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 -- 172.21.15.41:0/1663802632 learned_addr learned my addr 172.21.15.41:0/1663802632 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:07.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563a54b700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 0x7f5634151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563ad4c700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56340b9ca0 0x7f56341555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 -- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 msgr2=0x7f5634151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 0x7f5634151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 -- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56340b9ca0 msgr2=0x7f56341555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:07.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56340b9ca0 0x7f56341555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:07.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 -- 172.21.15.41:0/1663802632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562400b180 con 0x7f56340b31e0 2021-10-21T00:11:07.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563a54b700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 0x7f5634151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:07.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f5639d4a700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f5624002f70 tx=0x7f5624014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562400dea0 con 0x7f56340b31e0 2021-10-21T00:11:07.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624013de0 con 0x7f56340b31e0 2021-10-21T00:11:07.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340aca10 con 0x7f56340b31e0 2021-10-21T00:11:07.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562401e5f0 con 0x7f56340b31e0 2021-10-21T00:11:07.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.894+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340ae620 con 0x7f56340b31e0 2021-10-21T00:11:07.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340aeba0 con 0x7f56340b31e0 2021-10-21T00:11:07.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5624025030 con 0x7f56340b31e0 2021-10-21T00:11:07.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f56237fe700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 0x7f5614055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:07.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f562406c540 con 0x7f56340b31e0 2021-10-21T00:11:07.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f563a54b700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 0x7f5614055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:07.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.898+0000 7f563a54b700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 0x7f5614055ad0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f563000b000 tx=0x7f5630006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:07.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:07.906+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56340aeba0 con 0x7f56340b31e0 2021-10-21T00:11:08.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.034+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f56340aeba0 con 0x7f56340b31e0 2021-10-21T00:11:08.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.034+0000 7f56237fe700 1 -- 172.21.15.41:0/1663802632 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7f56340aeba0 con 0x7f56340b31e0 2021-10-21T00:11:08.043 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:08.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 msgr2=0x7f5614055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 0x7f5614055ad0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f563000b000 tx=0x7f5630006df0).stop 2021-10-21T00:11:08.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 msgr2=0x7f56340b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f5624002f70 tx=0x7f5624014000).stop 2021-10-21T00:11:08.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 shutdown_connections 2021-10-21T00:11:08.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5614053610 0x7f5614055ad0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56340b9ca0 0x7f56341555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56340b31e0 0x7f56340b80b0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 --2- 172.21.15.41:0/1663802632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56340b24b0 0x7f5634151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 >> 172.21.15.41:0/1663802632 conn(0x7f5634062f00 msgr2=0x7f56340b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 shutdown_connections 2021-10-21T00:11:08.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.038+0000 7f563c7af700 1 -- 172.21.15.41:0/1663802632 wait complete. 2021-10-21T00:11:08.055 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:08.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.162+0000 7f03dbfff700 1 Processor -- start 2021-10-21T00:11:08.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.162+0000 7f03dbfff700 1 -- start start 2021-10-21T00:11:08.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 0x7f03dc143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03dbfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0b6350 con 0x7f03dc0aebb0 2021-10-21T00:11:08.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03dbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc05c830 con 0x7f03dc1448e0 2021-10-21T00:11:08.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03dbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0b13b0 con 0x7f03dc0b5f70 2021-10-21T00:11:08.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03d3fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f03dc0aebb0 0x7f03dc1441d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34458/0 (socket says 172.21.15.41:34458) 2021-10-21T00:11:08.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03d3fff700 1 -- 172.21.15.41:0/2646563509 learned_addr learned my addr 172.21.15.41:0/2646563509 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:08.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03daffd700 1 --2- 172.21.15.41:0/2646563509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 0x7f03dc143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293677798 0 0) 0x7f03dc0b6350 con 0x7f03dc0aebb0 2021-10-21T00:11:08.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03bc003260 con 0x7f03dc0aebb0 2021-10-21T00:11:08.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591257876 0 0) 0x7f03dc05c830 con 0x7f03dc1448e0 2021-10-21T00:11:08.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc0b6350 con 0x7f03dc1448e0 2021-10-21T00:11:08.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03daffd700 1 -- 172.21.15.41:0/2646563509 >> v1:172.21.15.62:6789/0 conn(0x7f03dc1448e0 legacy=0x7f03dc13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3364572065 0 0) 0x7f03bc003260 con 0x7f03dc0aebb0 2021-10-21T00:11:08.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03daffd700 1 -- 172.21.15.41:0/2646563509 >> v1:172.21.15.41:6789/0 conn(0x7f03dc0aebb0 legacy=0x7f03dc1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03daffd700 1 -- 172.21.15.41:0/2646563509 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc05cad0 con 0x7f03dc0b5f70 2021-10-21T00:11:08.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03daffd700 1 --2- 172.21.15.41:0/2646563509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 0x7f03dc143ce0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f03c4001110 tx=0x7f03cc006df0).ready entity=mon.2 client_cookie=2d6660a0830ac1c3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c4001660 con 0x7f03dc0b5f70 2021-10-21T00:11:08.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc000e90 con 0x7f03dc0b5f70 2021-10-21T00:11:08.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.166+0000 7f03da7fc700 1 -- 172.21.15.41:0/2646563509 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03cc012460 con 0x7f03dc0b5f70 2021-10-21T00:11:08.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- 172.21.15.41:0/2646563509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 msgr2=0x7f03dc143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 --2- 172.21.15.41:0/2646563509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 0x7f03dc143ce0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f03c4001110 tx=0x7f03cc006df0).stop 2021-10-21T00:11:08.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- 172.21.15.41:0/2646563509 shutdown_connections 2021-10-21T00:11:08.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 --2- 172.21.15.41:0/2646563509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc0b5f70 0x7f03dc143ce0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- 172.21.15.41:0/2646563509 >> 172.21.15.41:0/2646563509 conn(0x7f03dc0639f0 msgr2=0x7f03dc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- 172.21.15.41:0/2646563509 shutdown_connections 2021-10-21T00:11:08.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- 172.21.15.41:0/2646563509 wait complete. 2021-10-21T00:11:08.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 Processor -- start 2021-10-21T00:11:08.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- start start 2021-10-21T00:11:08.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03dc0aebb0 0x7f03dc064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc1448e0 0x7f03dc152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc064e60 con 0x7f03dc0b5f70 2021-10-21T00:11:08.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc152250 con 0x7f03dc0aebb0 2021-10-21T00:11:08.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03dbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc1524f0 con 0x7f03dc1448e0 2021-10-21T00:11:08.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03d3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36692/0 (socket says 172.21.15.41:36692) 2021-10-21T00:11:08.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03d3fff700 1 -- 172.21.15.41:0/3566426497 learned_addr learned my addr 172.21.15.41:0/3566426497 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:08.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.170+0000 7f03db7fe700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc1448e0 0x7f03dc152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03daffd700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03dc0aebb0 0x7f03dc064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 -- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc1448e0 msgr2=0x7f03dc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc1448e0 0x7f03dc152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 -- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03dc0aebb0 msgr2=0x7f03dc064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03dc0aebb0 0x7f03dc064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 -- 172.21.15.41:0/3566426497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc00b180 con 0x7f03dc0b5f70 2021-10-21T00:11:08.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d3fff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f03c4001840 tx=0x7f03c4001620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c4007110 con 0x7f03dc0b5f70 2021-10-21T00:11:08.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4007270 con 0x7f03dc0b5f70 2021-10-21T00:11:08.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc0b52a0 con 0x7f03dc0b5f70 2021-10-21T00:11:08.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c4005030 con 0x7f03dc0b5f70 2021-10-21T00:11:08.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc0b4820 con 0x7f03dc0b5f70 2021-10-21T00:11:08.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc1526b0 con 0x7f03dc0b5f70 2021-10-21T00:11:08.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03c401b070 con 0x7f03dc0b5f70 2021-10-21T00:11:08.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 0x7f03c0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03c406aeb0 con 0x7f03dc0b5f70 2021-10-21T00:11:08.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.174+0000 7f03daffd700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 0x7f03c0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.178+0000 7f03daffd700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 0x7f03c0055b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f03cc01a000 tx=0x7f03cc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.178+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03c4041f00 con 0x7f03dc0b5f70 2021-10-21T00:11:08.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03dc067810 con 0x7f03dc0b5f70 2021-10-21T00:11:08.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03d8ff9700 1 -- 172.21.15.41:0/3566426497 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03c4045520 con 0x7f03dc0b5f70 2021-10-21T00:11:08.313 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:08.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 msgr2=0x7f03c0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 0x7f03c0055b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f03cc01a000 tx=0x7f03cc014000).stop 2021-10-21T00:11:08.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 msgr2=0x7f03dc065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f03c4001840 tx=0x7f03c4001620).stop 2021-10-21T00:11:08.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 shutdown_connections 2021-10-21T00:11:08.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053640 0x7f03c0055b00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03dc1448e0 0x7f03dc152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03dc0b5f70 0x7f03dc065940 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 --2- 172.21.15.41:0/3566426497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03dc0aebb0 0x7f03dc064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.306+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 >> 172.21.15.41:0/3566426497 conn(0x7f03dc0639f0 msgr2=0x7f03dc13f700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.310+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 shutdown_connections 2021-10-21T00:11:08.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.310+0000 7f03dbfff700 1 -- 172.21.15.41:0/3566426497 wait complete. 2021-10-21T00:11:08.326 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:11:08.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 Processor -- start 2021-10-21T00:11:08.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 -- start start 2021-10-21T00:11:08.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f256c05c860 0x7f256c14d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c05cc80 con 0x7f256c0acd30 2021-10-21T00:11:08.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c0ba000 con 0x7f256c0b9c20 2021-10-21T00:11:08.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25710ee700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c143bc0 con 0x7f256c05c860 2021-10-21T00:11:08.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f256b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f256c0acd30 0x7f256c0b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34472/0 (socket says 172.21.15.41:34472) 2021-10-21T00:11:08.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f256b7fe700 1 -- 172.21.15.41:0/2129354030 learned_addr learned my addr 172.21.15.41:0/2129354030 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:08.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.430+0000 7f25708ed700 1 --2- 172.21.15.41:0/2129354030 >> v2:172.21.15.62:3300/0 conn(0x7f256c05c860 0x7f256c14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409908500 0 0) 0x7f256c05cc80 con 0x7f256c0acd30 2021-10-21T00:11:08.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2558003260 con 0x7f256c0acd30 2021-10-21T00:11:08.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013199598 0 0) 0x7f256c0ba000 con 0x7f256c0b9c20 2021-10-21T00:11:08.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c05cc80 con 0x7f256c0b9c20 2021-10-21T00:11:08.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497200597 0 0) 0x7f2558003260 con 0x7f256c0acd30 2021-10-21T00:11:08.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25708ed700 1 -- 172.21.15.41:0/2129354030 >> v1:172.21.15.62:6789/0 conn(0x7f256c0b9c20 legacy=0x7f256c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25708ed700 1 -- 172.21.15.41:0/2129354030 >> v1:172.21.15.41:6789/0 conn(0x7f256c0acd30 legacy=0x7f256c0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25708ed700 1 -- 172.21.15.41:0/2129354030 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c142ad0 con 0x7f256c05c860 2021-10-21T00:11:08.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25708ed700 1 --2- 172.21.15.41:0/2129354030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c05c860 0x7f256c14d550 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f255c001110 tx=0x7f25640091d0).ready entity=mon.1 client_cookie=fca5b6a754625835 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255c001660 con 0x7f256c05c860 2021-10-21T00:11:08.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256400f510 con 0x7f256c05c860 2021-10-21T00:11:08.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256affd700 1 -- 172.21.15.41:0/2129354030 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256400f680 con 0x7f256c05c860 2021-10-21T00:11:08.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- 172.21.15.41:0/2129354030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c05c860 msgr2=0x7f256c14d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 --2- 172.21.15.41:0/2129354030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c05c860 0x7f256c14d550 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f255c001110 tx=0x7f25640091d0).stop 2021-10-21T00:11:08.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- 172.21.15.41:0/2129354030 shutdown_connections 2021-10-21T00:11:08.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 --2- 172.21.15.41:0/2129354030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c05c860 0x7f256c14d550 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- 172.21.15.41:0/2129354030 >> 172.21.15.41:0/2129354030 conn(0x7f256c062f00 msgr2=0x7f256c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- 172.21.15.41:0/2129354030 shutdown_connections 2021-10-21T00:11:08.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- 172.21.15.41:0/2129354030 wait complete. 2021-10-21T00:11:08.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 Processor -- start 2021-10-21T00:11:08.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- start start 2021-10-21T00:11:08.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f256c0acd30 0x7f256c0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c0b9c20 0x7f256c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0adea0 con 0x7f256c05c860 2021-10-21T00:11:08.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0ae0d0 con 0x7f256c0b9c20 2021-10-21T00:11:08.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f25710ee700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0ae370 con 0x7f256c0acd30 2021-10-21T00:11:08.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.434+0000 7f256bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36708/0 (socket says 172.21.15.41:36708) 2021-10-21T00:11:08.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f256c0acd30 0x7f256c0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 -- 172.21.15.41:0/4230617588 learned_addr learned my addr 172.21.15.41:0/4230617588 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:08.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25708ed700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c0b9c20 0x7f256c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 -- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f256c0acd30 msgr2=0x7f256c0ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f256c0acd30 0x7f256c0ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 -- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c0b9c20 msgr2=0x7f256c0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c0b9c20 0x7f256c0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 -- 172.21.15.41:0/4230617588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009470 con 0x7f256c05c860 2021-10-21T00:11:08.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f256bfff700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2560001160 tx=0x7f2560007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2560012400 con 0x7f256c05c860 2021-10-21T00:11:08.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560012560 con 0x7f256c05c860 2021-10-21T00:11:08.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25600128c0 con 0x7f256c05c860 2021-10-21T00:11:08.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c0aed00 con 0x7f256c05c860 2021-10-21T00:11:08.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c0af6e0 con 0x7f256c05c860 2021-10-21T00:11:08.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c142d70 con 0x7f256c05c860 2021-10-21T00:11:08.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2560019030 con 0x7f256c05c860 2021-10-21T00:11:08.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.438+0000 7f25697fa700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 0x7f254c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.442+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f256006ac60 con 0x7f256c05c860 2021-10-21T00:11:08.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.442+0000 7f256b7fe700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 0x7f254c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.442+0000 7f256b7fe700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 0x7f254c055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f255c00d000 tx=0x7f255c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.446+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2560041d40 con 0x7f256c05c860 2021-10-21T00:11:08.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.570+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f256c057350 con 0x7f256c05c860 2021-10-21T00:11:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.570+0000 7f25697fa700 1 -- 172.21.15.41:0/4230617588 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2560045360 con 0x7f256c05c860 2021-10-21T00:11:08.578 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 msgr2=0x7f254c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 0x7f254c055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f255c00d000 tx=0x7f255c000bc0).stop 2021-10-21T00:11:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 msgr2=0x7f256c145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2560001160 tx=0x7f2560007ad0).stop 2021-10-21T00:11:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 shutdown_connections 2021-10-21T00:11:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f254c0536a0 0x7f254c055b60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f256c0b9c20 0x7f256c0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f256c0acd30 0x7f256c0ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 --2- 172.21.15.41:0/4230617588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f256c05c860 0x7f256c145ed0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 >> 172.21.15.41:0/4230617588 conn(0x7f256c062f00 msgr2=0x7f256c13e890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 shutdown_connections 2021-10-21T00:11:08.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.574+0000 7f25710ee700 1 -- 172.21.15.41:0/4230617588 wait complete. 2021-10-21T00:11:08.597 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:11:08.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.702+0000 7f156bfff700 1 Processor -- start 2021-10-21T00:11:08.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.702+0000 7f156bfff700 1 -- start start 2021-10-21T00:11:08.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f156c05bfe0 0x7f156c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f156c05c6b0 0x7f156c141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c05c3c0 con 0x7f156c067a00 2021-10-21T00:11:08.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b1920 con 0x7f156c05bfe0 2021-10-21T00:11:08.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b27a0 con 0x7f156c05c6b0 2021-10-21T00:11:08.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f156c05bfe0 0x7f156c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f156c05bfe0 0x7f156c1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36714/0 (socket says 172.21.15.41:36714) 2021-10-21T00:11:08.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 -- 172.21.15.41:0/983266461 learned_addr learned my addr 172.21.15.41:0/983266461 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:08.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156b7fe700 1 --2- 172.21.15.41:0/983266461 >> v2:172.21.15.62:3300/0 conn(0x7f156c05c6b0 0x7f156c141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 -- 172.21.15.41:0/983266461 >> v2:172.21.15.62:3300/0 conn(0x7f156c05c6b0 msgr2=0x7f156c141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:08.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 --2- 172.21.15.41:0/983266461 >> v2:172.21.15.62:3300/0 conn(0x7f156c05c6b0 0x7f156c141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 -- 172.21.15.41:0/983266461 >> v1:172.21.15.62:6789/0 conn(0x7f156c067a00 legacy=0x7f156c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:08.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 -- 172.21.15.41:0/983266461 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0b2a40 con 0x7f156c05bfe0 2021-10-21T00:11:08.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156affd700 1 --2- 172.21.15.41:0/983266461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1461c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f156c063430 tx=0x7f155c006eb0).ready entity=mon.0 client_cookie=7459cf431706f1f5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f1569ffb700 1 -- 172.21.15.41:0/983266461 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c00d5c0 con 0x7f156c05bfe0 2021-10-21T00:11:08.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f1569ffb700 1 -- 172.21.15.41:0/983266461 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c000e90 con 0x7f156c05bfe0 2021-10-21T00:11:08.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f1569ffb700 1 -- 172.21.15.41:0/983266461 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c00d950 con 0x7f156c05bfe0 2021-10-21T00:11:08.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- 172.21.15.41:0/983266461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 msgr2=0x7f156c1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 --2- 172.21.15.41:0/983266461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1461c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f156c063430 tx=0x7f155c006eb0).stop 2021-10-21T00:11:08.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- 172.21.15.41:0/983266461 shutdown_connections 2021-10-21T00:11:08.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 --2- 172.21.15.41:0/983266461 >> v2:172.21.15.62:3300/0 conn(0x7f156c05c6b0 0x7f156c141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 --2- 172.21.15.41:0/983266461 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1461c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- 172.21.15.41:0/983266461 >> 172.21.15.41:0/983266461 conn(0x7f156c0637b0 msgr2=0x7f156c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- 172.21.15.41:0/983266461 shutdown_connections 2021-10-21T00:11:08.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.706+0000 7f156bfff700 1 -- 172.21.15.41:0/983266461 wait complete. 2021-10-21T00:11:08.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 Processor -- start 2021-10-21T00:11:08.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- start start 2021-10-21T00:11:08.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 0x7f156c064620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f156c067a00 0x7f156c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0af6e0 con 0x7f156c05bfe0 2021-10-21T00:11:08.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c064b10 con 0x7f156c067a00 2021-10-21T00:11:08.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c066030 con 0x7f156c05c6b0 2021-10-21T00:11:08.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36720/0 (socket says 172.21.15.41:36720) 2021-10-21T00:11:08.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 -- 172.21.15.41:0/1671252989 learned_addr learned my addr 172.21.15.41:0/1671252989 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:08.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156b7fe700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f156c067a00 0x7f156c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156a7fc700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 0x7f156c064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 -- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 msgr2=0x7f156c064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 0x7f156c064620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 -- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f156c067a00 msgr2=0x7f156c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f156c067a00 0x7f156c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 -- 172.21.15.41:0/1671252989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c00b1e0 con 0x7f156c05bfe0 2021-10-21T00:11:08.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156a7fc700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 0x7f156c064620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:08.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156affd700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f156c063430 tx=0x7f155c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c0119b0 con 0x7f156c05bfe0 2021-10-21T00:11:08.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c011b10 con 0x7f156c05bfe0 2021-10-21T00:11:08.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c011e70 con 0x7f156c05bfe0 2021-10-21T00:11:08.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c0662d0 con 0x7f156c05bfe0 2021-10-21T00:11:08.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.710+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c067150 con 0x7f156c05bfe0 2021-10-21T00:11:08.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c0b1480 con 0x7f156c05bfe0 2021-10-21T00:11:08.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f155c01a040 con 0x7f156c05bfe0 2021-10-21T00:11:08.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f155bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 0x7f15480559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f155c06c8a0 con 0x7f156c05bfe0 2021-10-21T00:11:08.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f156a7fc700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 0x7f15480559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.714+0000 7f156a7fc700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 0x7f15480559b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f1560007000 tx=0x7f1560008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.722+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f155c043a00 con 0x7f156c05bfe0 2021-10-21T00:11:08.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f156c057350 con 0x7f156c05bfe0 2021-10-21T00:11:08.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f155bfff700 1 -- 172.21.15.41:0/1671252989 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7f155c023020 con 0x7f156c05bfe0 2021-10-21T00:11:08.853 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:08.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 msgr2=0x7f15480559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 0x7f15480559b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f1560007000 tx=0x7f1560008040).stop 2021-10-21T00:11:08.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 msgr2=0x7f156c1451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f156c063430 tx=0x7f155c013000).stop 2021-10-21T00:11:08.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 shutdown_connections 2021-10-21T00:11:08.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15480534f0 0x7f15480559b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f156c067a00 0x7f156c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f156c05c6b0 0x7f156c064620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 --2- 172.21.15.41:0/1671252989 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f156c05bfe0 0x7f156c1451b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 >> 172.21.15.41:0/1671252989 conn(0x7f156c0637b0 msgr2=0x7f156c0b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.846+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 shutdown_connections 2021-10-21T00:11:08.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.850+0000 7f156bfff700 1 -- 172.21.15.41:0/1671252989 wait complete. 2021-10-21T00:11:08.869 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:11:08.870 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:08.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 Processor -- start 2021-10-21T00:11:08.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 -- start start 2021-10-21T00:11:08.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98200b4380 0x7f982005f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9820140890 0x7f9820140d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b4760 con 0x7f98200b1830 2021-10-21T00:11:08.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200ad4c0 con 0x7f98200b4380 2021-10-21T00:11:08.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f98249b4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200ad760 con 0x7f9820140890 2021-10-21T00:11:08.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98200b4380 0x7f982005f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9820140890 0x7f9820140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f98200b1830 0x7f982005fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42556/0 (socket says 172.21.15.41:42556) 2021-10-21T00:11:08.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981effd700 1 -- 172.21.15.41:0/2819993751 learned_addr learned my addr 172.21.15.41:0/2819993751 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:08.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 --2- 172.21.15.41:0/2819993751 >> v2:172.21.15.62:3300/0 conn(0x7f98200b4380 0x7f982005f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48646/0 (socket says 172.21.15.41:48646) 2021-10-21T00:11:08.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 -- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9820140890 msgr2=0x7f9820140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:08.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 --2- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9820140890 0x7f9820140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 -- 172.21.15.41:0/2819993751 >> v1:172.21.15.62:6789/0 conn(0x7f98200b1830 legacy=0x7f982005fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 -- 172.21.15.41:0/2819993751 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200ada00 con 0x7f98200b4380 2021-10-21T00:11:08.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.962+0000 7f981f7fe700 1 --2- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f982005f7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9810002f70 tx=0x7f9810006df0).ready entity=mon.1 client_cookie=50a9e488c10f83f1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981e7fc700 1 -- 172.21.15.41:0/2819993751 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981000d570 con 0x7f98200b4380 2021-10-21T00:11:08.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981e7fc700 1 -- 172.21.15.41:0/2819993751 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810000e90 con 0x7f98200b4380 2021-10-21T00:11:08.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981e7fc700 1 -- 172.21.15.41:0/2819993751 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981000d8c0 con 0x7f98200b4380 2021-10-21T00:11:08.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 msgr2=0x7f982005f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f982005f7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9810002f70 tx=0x7f9810006df0).stop 2021-10-21T00:11:08.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- 172.21.15.41:0/2819993751 shutdown_connections 2021-10-21T00:11:08.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9820140890 0x7f9820140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- 172.21.15.41:0/2819993751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f982005f7c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- 172.21.15.41:0/2819993751 >> 172.21.15.41:0/2819993751 conn(0x7f98200b7910 msgr2=0x7f98200b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:08.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- 172.21.15.41:0/2819993751 shutdown_connections 2021-10-21T00:11:08.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- 172.21.15.41:0/2819993751 wait complete. 2021-10-21T00:11:08.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 Processor -- start 2021-10-21T00:11:08.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- start start 2021-10-21T00:11:08.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 0x7f9820139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f9820141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820143e90 con 0x7f9820140890 2021-10-21T00:11:08.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201422a0 con 0x7f98200b4380 2021-10-21T00:11:08.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f98249b4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200af180 con 0x7f98200b1830 2021-10-21T00:11:08.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36738/0 (socket says 172.21.15.41:36738) 2021-10-21T00:11:08.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981ffff700 1 -- 172.21.15.41:0/1377715789 learned_addr learned my addr 172.21.15.41:0/1377715789 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:08.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.966+0000 7f981effd700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f9820141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981f7fe700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 0x7f9820139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 -- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 msgr2=0x7f9820139810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 0x7f9820139810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 -- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 msgr2=0x7f9820141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:08.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f9820141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:08.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 -- 172.21.15.41:0/1377715789 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981000b180 con 0x7f9820140890 2021-10-21T00:11:08.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981effd700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f9820141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:08.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981f7fe700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 0x7f9820139810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:08.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981ffff700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f98200af930 tx=0x7f9818006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9818010780 con 0x7f9820140890 2021-10-21T00:11:08.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98180108e0 con 0x7f9820140890 2021-10-21T00:11:08.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9818010c40 con 0x7f9820140890 2021-10-21T00:11:08.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820144b10 con 0x7f9820140890 2021-10-21T00:11:08.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9820143750 con 0x7f9820140890 2021-10-21T00:11:08.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f981801c460 con 0x7f9820140890 2021-10-21T00:11:08.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9820143cf0 con 0x7f9820140890 2021-10-21T00:11:08.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.970+0000 7f981cff9700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 0x7f98040559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:08.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.974+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f981806bd90 con 0x7f9820140890 2021-10-21T00:11:08.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.974+0000 7f981f7fe700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 0x7f98040559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:08.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.974+0000 7f981f7fe700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 0x7f98040559b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9810018000 tx=0x7f9810014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:08.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:08.982+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9820143cf0 con 0x7f9820140890 2021-10-21T00:11:09.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.142+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9820143cf0 con 0x7f9820140890 2021-10-21T00:11:09.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f981cff9700 1 -- 172.21.15.41:0/1377715789 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f9820143cf0 con 0x7f9820140890 2021-10-21T00:11:09.151 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:09.152 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/2545988246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2545988246},{"type":"v1","addr":"172.21.15.41:6833","nonce":2545988246}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:04.209527+0000","modified":"2021-10-21T00:11:05.213156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"b","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/851642528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":851642528},{"type":"v1","addr":"172.21.15.62:6835","nonce":851642528}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-21T00:11:09.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 msgr2=0x7f98040559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:09.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 0x7f98040559b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9810018000 tx=0x7f9810014000).stop 2021-10-21T00:11:09.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 msgr2=0x7f98200b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:09.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f98200af930 tx=0x7f9818006df0).stop 2021-10-21T00:11:09.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 shutdown_connections 2021-10-21T00:11:09.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f98040534f0 0x7f98040559b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:09.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9820140890 0x7f98200b0970 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:09.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98200b4380 0x7f9820141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:09.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 --2- 172.21.15.41:0/1377715789 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98200b1830 0x7f9820139810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:09.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 >> 172.21.15.41:0/1377715789 conn(0x7f98200b7910 msgr2=0x7f98200b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:09.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 shutdown_connections 2021-10-21T00:11:09.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:09.146+0000 7f98249b4700 1 -- 172.21.15.41:0/1377715789 wait complete. 2021-10-21T00:11:09.162 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 56 2021-10-21T00:11:09.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:04.209527+0000', 'modified': '2021-10-21T00:11:05.213156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7683}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7683': {'gid': 7683, 'name': 'b', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/851642528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 851642528}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 851642528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:09.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:09.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:11:09.491 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7683,"want_state":"up:active","state":"up:active","rank_uptime":5.2635708020000003,"mdsmap_epoch":56,"osdmap_epoch":108,"osdmap_epoch_barrier":107,"uptime":10.24139875} 2021-10-21T00:11:09.492 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7683, "mdsmap_epoch": 56, "osdmap_epoch": 108, "osdmap_epoch_barrier": 107, "rank_uptime": 5.263570802, "state": "up:active", "uptime": 10.24139875, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:09.492 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:11:09.493 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:11:09.493 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:11:09.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:09.494 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:09.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:09.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:09.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:09.579 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:09.580 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:09.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:09.581 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:09.586 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:11:09.587 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:09.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:09.648 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:09.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:09.662 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:09.663 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:09.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:09.664 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:09.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:11:09.699+0000 7f319ce1a080 -1 init, newargv = 0x5639d460c6a0 newargc=9ceph-fuse[14907]: starting ceph client 2021-10-21T00:11:09.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr: 2021-10-21T00:11:09.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14907]: starting fuse 2021-10-21T00:11:10.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:10.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:10.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:10.851 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:10.852 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:10.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:10.856 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:10.868 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:11:10.869 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:11:10.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:10.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:11:10.871 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:11:10.872 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:11:10.873 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:11:10.874 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:11:10.877 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:10.879 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:11:10.880 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:11:10.880 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:11:10.881 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:10.881 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:11:10.882 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:11:10.883 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:11:10.884 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:11:10.885 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:10.885 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:11:10.886 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:11:10.888 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:11:10.890 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:11:10.891 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:11:10.891 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:10.892 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:11:10.893 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:11:10.951 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.14907.asok 2021-10-21T00:11:10.956 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14907.asok 2021-10-21T00:11:10.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:10.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14907.asok status 2021-10-21T00:11:11.048 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:11:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:11:11.049 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:11:11.049 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:11:11.050 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:11:11.050 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:11:11.050 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:11:11.051 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "14907", 2021-10-21T00:11:11.051 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:11:11.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:11.052 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:11:11.052 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:11:11.053 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7687, 2021-10-21T00:11:11.053 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:11:11.054 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:11:11.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:11:11.055 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 7687 2021-10-21T00:11:11.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:11.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:11:11.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:11:11.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:11:11.059 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 4042295374 2021-10-21T00:11:11.059 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:11:11.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:11.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:11:11.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:11:11.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:11:11.062 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 4042295374 2021-10-21T00:11:11.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:11.063 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.7687 172.21.15.71:0/4042295374", 2021-10-21T00:11:11.063 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/4042295374", 2021-10-21T00:11:11.064 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:11:11.064 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 56, 2021-10-21T00:11:11.064 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 108, 2021-10-21T00:11:11.065 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:11:11.065 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:11:11.066 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:11:11.067 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:11:11.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:11.069 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:11.069 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:11.077 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:11.078 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:11.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:11.079 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:11.139 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:11.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 Processor -- start 2021-10-21T00:11:11.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 -- start start 2021-10-21T00:11:11.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6c000b2170 0x7f6c000ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 0x7f6c000ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 0x7f6c0014a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000b0b50 con 0x7f6c000b2170 2021-10-21T00:11:11.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000b2550 con 0x7f6c000abb50 2021-10-21T00:11:11.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000b0d90 con 0x7f6c000af620 2021-10-21T00:11:11.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6c000b2170 0x7f6c000ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6c000b2170 0x7f6c000ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36742/0 (socket says 172.21.15.41:36742) 2021-10-21T00:11:11.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3209221065 learned_addr learned my addr 172.21.15.41:0/3209221065 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:11.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bff7fe700 1 --2- 172.21.15.41:0/3209221065 >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 0x7f6c0014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bf7fff700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 0x7f6c000ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3209221065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 msgr2=0x7f6c000ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:11.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 0x7f6c000ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3209221065 >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 msgr2=0x7f6c0014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:11.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3209221065 >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 0x7f6c0014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3209221065 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000b1030 con 0x7f6c000b2170 2021-10-21T00:11:11.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bff7fe700 1 --2- 172.21.15.41:0/3209221065 >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 0x7f6c0014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:11.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.246+0000 7f6bf7fff700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 0x7f6c000ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:11.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000b2170 0x7f6c000ab170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0006eb0).ready entity=mon.0 client_cookie=747ee9ee9e666a2e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfe7fc700 1 -- 172.21.15.41:0/3209221065 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf000d570 con 0x7f6c000b2170 2021-10-21T00:11:11.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfe7fc700 1 -- 172.21.15.41:0/3209221065 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0000e90 con 0x7f6c000b2170 2021-10-21T00:11:11.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfe7fc700 1 -- 172.21.15.41:0/3209221065 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf000d900 con 0x7f6c000b2170 2021-10-21T00:11:11.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 -- 172.21.15.41:0/3209221065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000b2170 msgr2=0x7f6c000ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000b2170 0x7f6c000ab170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0006eb0).stop 2021-10-21T00:11:11.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 -- 172.21.15.41:0/3209221065 shutdown_connections 2021-10-21T00:11:11.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3209221065 >> v2:172.21.15.62:3300/0 conn(0x7f6c000abb50 0x7f6c0014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000af620 0x7f6c000ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3209221065 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000b2170 0x7f6c000ab170 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 -- 172.21.15.41:0/3209221065 >> 172.21.15.41:0/3209221065 conn(0x7f6c000b5700 msgr2=0x7f6c000b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 -- 172.21.15.41:0/3209221065 shutdown_connections 2021-10-21T00:11:11.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.250+0000 7f6bfffff700 1 -- 172.21.15.41:0/3209221065 wait complete. 2021-10-21T00:11:11.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 Processor -- start 2021-10-21T00:11:11.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- start start 2021-10-21T00:11:11.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c000af620 0x7f6c00156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000b2170 0x7f6c00156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000aef50 con 0x7f6c000abb50 2021-10-21T00:11:11.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000aecb0 con 0x7f6c000af620 2021-10-21T00:11:11.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00156290 con 0x7f6c000b2170 2021-10-21T00:11:11.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36748/0 (socket says 172.21.15.41:36748) 2021-10-21T00:11:11.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3751973495 learned_addr learned my addr 172.21.15.41:0/3751973495 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:11.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bff7fe700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000b2170 0x7f6c00156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bf7fff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c000af620 0x7f6c00156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000b2170 msgr2=0x7f6c00156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000b2170 0x7f6c00156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c000af620 msgr2=0x7f6c00156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c000af620 0x7f6c00156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 -- 172.21.15.41:0/3751973495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf000b1e0 con 0x7f6c000abb50 2021-10-21T00:11:11.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfeffd700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf00117e0 con 0x7f6c000abb50 2021-10-21T00:11:11.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0011940 con 0x7f6c000abb50 2021-10-21T00:11:11.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf0011ca0 con 0x7f6c000abb50 2021-10-21T00:11:11.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000ae8e0 con 0x7f6c000abb50 2021-10-21T00:11:11.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.254+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0015a560 con 0x7f6c000abb50 2021-10-21T00:11:11.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c00156450 con 0x7f6c000abb50 2021-10-21T00:11:11.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6bf001a040 con 0x7f6c000abb50 2021-10-21T00:11:11.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bfcff9700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 0x7f6be4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6bf006c850 con 0x7f6c000abb50 2021-10-21T00:11:11.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bf7fff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 0x7f6be4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.258+0000 7f6bf7fff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 0x7f6be4055b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f6be800d000 tx=0x7f6be8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.262+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6bf00439b0 con 0x7f6c000abb50 2021-10-21T00:11:11.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.390+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c000b12d0 con 0x7f6c000abb50 2021-10-21T00:11:11.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfcff9700 1 -- 172.21.15.41:0/3751973495 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f6bf0046fd0 con 0x7f6c000abb50 2021-10-21T00:11:11.401 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:11.401 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":108,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:05.213279+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:02.014555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:03.230021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:11.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 msgr2=0x7f6be4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 0x7f6be4055b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f6be800d000 tx=0x7f6be8008040).stop 2021-10-21T00:11:11.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 msgr2=0x7f6c00159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0015000).stop 2021-10-21T00:11:11.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 shutdown_connections 2021-10-21T00:11:11.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6be4053640 0x7f6be4055b00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c000b2170 0x7f6c00156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c000af620 0x7f6c00156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 --2- 172.21.15.41:0/3751973495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c000abb50 0x7f6c00159a10 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 >> 172.21.15.41:0/3751973495 conn(0x7f6c000b5700 msgr2=0x7f6c00060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 shutdown_connections 2021-10-21T00:11:11.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.394+0000 7f6bfffff700 1 -- 172.21.15.41:0/3751973495 wait complete. 2021-10-21T00:11:11.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:11:02.014555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:11:03.230021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:11:11.415 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:11.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.514+0000 7f0a6fbb2700 1 Processor -- start 2021-10-21T00:11:11.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.514+0000 7f0a6fbb2700 1 -- start start 2021-10-21T00:11:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a680b9ca0 0x7f0a680b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b26d0 0x7f0a68141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680ba080 con 0x7f0a680b31e0 2021-10-21T00:11:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6805c670 con 0x7f0a680b9ca0 2021-10-21T00:11:11.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6805c8e0 con 0x7f0a680b26d0 2021-10-21T00:11:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a680b9ca0 0x7f0a680b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a680b9ca0 0x7f0a680b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36756/0 (socket says 172.21.15.41:36756) 2021-10-21T00:11:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 -- 172.21.15.41:0/4287437266 learned_addr learned my addr 172.21.15.41:0/4287437266 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6e14f700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b26d0 0x7f0a68141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 -- 172.21.15.41:0/4287437266 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b26d0 msgr2=0x7f0a68141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b26d0 0x7f0a68141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 -- 172.21.15.41:0/4287437266 >> v1:172.21.15.62:6789/0 conn(0x7f0a680b31e0 legacy=0x7f0a680b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 -- 172.21.15.41:0/4287437266 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6805cb80 con 0x7f0a680b9ca0 2021-10-21T00:11:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6d94e700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b0690 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f0a58002f70 tx=0x7f0a58006eb0).ready entity=mon.0 client_cookie=a281d57969c753db server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6c94c700 1 -- 172.21.15.41:0/4287437266 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5800d570 con 0x7f0a680b9ca0 2021-10-21T00:11:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6c94c700 1 -- 172.21.15.41:0/4287437266 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58000e90 con 0x7f0a680b9ca0 2021-10-21T00:11:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6c94c700 1 -- 172.21.15.41:0/4287437266 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5800d900 con 0x7f0a680b9ca0 2021-10-21T00:11:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/4287437266 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 msgr2=0x7f0a680b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b0690 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f0a58002f70 tx=0x7f0a58006eb0).stop 2021-10-21T00:11:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/4287437266 shutdown_connections 2021-10-21T00:11:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b26d0 0x7f0a68141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/4287437266 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b0690 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/4287437266 >> 172.21.15.41:0/4287437266 conn(0x7f0a68062f00 msgr2=0x7f0a680b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/4287437266 shutdown_connections 2021-10-21T00:11:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.518+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/4287437266 wait complete. 2021-10-21T00:11:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 Processor -- start 2021-10-21T00:11:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 -- start start 2021-10-21T00:11:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a680b26d0 0x7f0a680add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b31e0 0x7f0a68113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a681317d0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68113470 con 0x7f0a680b26d0 2021-10-21T00:11:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6fbb2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68113710 con 0x7f0a680b31e0 2021-10-21T00:11:11.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6e14f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.522+0000 7f0a6e14f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36766/0 (socket says 172.21.15.41:36766) 2021-10-21T00:11:11.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 -- 172.21.15.41:0/1985056817 learned_addr learned my addr 172.21.15.41:0/1985056817 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:11.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6d94e700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a680b26d0 0x7f0a680add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6d14d700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b31e0 0x7f0a68113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 -- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b31e0 msgr2=0x7f0a68113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b31e0 0x7f0a68113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 -- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a680b26d0 msgr2=0x7f0a680add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a680b26d0 0x7f0a680add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 -- 172.21.15.41:0/1985056817 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5800b1e0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6e14f700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f0a60006e00 tx=0x7f0a600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a6000c640 con 0x7f0a680b9ca0 2021-10-21T00:11:11.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000c7a0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a681140a0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a6000cb00 con 0x7f0a680b9ca0 2021-10-21T00:11:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a680b8ec0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a681138d0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a6000cc60 con 0x7f0a680b9ca0 2021-10-21T00:11:11.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.526+0000 7f0a66ffd700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 0x7f0a48055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.530+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a6006bb20 con 0x7f0a680b9ca0 2021-10-21T00:11:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.530+0000 7f0a6d94e700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 0x7f0a48055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.530+0000 7f0a6d94e700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 0x7f0a48055b90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0a5801c000 tx=0x7f0a58015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.534+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a60042c80 con 0x7f0a680b9ca0 2021-10-21T00:11:11.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.662+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0a68057350 con 0x7f0a680b9ca0 2021-10-21T00:11:11.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.662+0000 7f0a66ffd700 1 -- 172.21.15.41:0/1985056817 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0a600462a0 con 0x7f0a680b9ca0 2021-10-21T00:11:11.669 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:11.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 msgr2=0x7f0a48055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 0x7f0a48055b90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0a5801c000 tx=0x7f0a58015000).stop 2021-10-21T00:11:11.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 msgr2=0x7f0a680b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f0a60006e00 tx=0x7f0a600091d0).stop 2021-10-21T00:11:11.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 shutdown_connections 2021-10-21T00:11:11.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a480536d0 0x7f0a48055b90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a680b9ca0 0x7f0a680b89d0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a680b31e0 0x7f0a68113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 --2- 172.21.15.41:0/1985056817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a680b26d0 0x7f0a680add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 >> 172.21.15.41:0/1985056817 conn(0x7f0a68062f00 msgr2=0x7f0a68069600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 shutdown_connections 2021-10-21T00:11:11.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.666+0000 7f0a6fbb2700 1 -- 172.21.15.41:0/1985056817 wait complete. 2021-10-21T00:11:11.686 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.790+0000 7f453bc51700 1 Processor -- start 2021-10-21T00:11:11.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.790+0000 7f453bc51700 1 -- start start 2021-10-21T00:11:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f453405bca0 0x7f453413aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4534140970 0x7f45340b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4534064640 con 0x7f45340af8a0 2021-10-21T00:11:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4534141c40 con 0x7f4534140970 2021-10-21T00:11:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340afc80 con 0x7f453405bca0 2021-10-21T00:11:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45399ed700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f45340af8a0 0x7f453413a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34540/0 (socket says 172.21.15.41:34540) 2021-10-21T00:11:11.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45399ed700 1 -- 172.21.15.41:0/2517283285 learned_addr learned my addr 172.21.15.41:0/2517283285 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:11.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 --2- 172.21.15.41:0/2517283285 >> v2:172.21.15.62:3300/0 conn(0x7f4534140970 0x7f45340b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45391ec700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f453405bca0 0x7f453413aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911491791 0 0) 0x7f4534064640 con 0x7f45340af8a0 2021-10-21T00:11:11.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f451c003260 con 0x7f45340af8a0 2021-10-21T00:11:11.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 -- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f453405bca0 msgr2=0x7f453413aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:11.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f453405bca0 0x7f453413aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 -- 172.21.15.41:0/2517283285 >> v1:172.21.15.41:6789/0 conn(0x7f45340af8a0 legacy=0x7f453413a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3402038308 0 0) 0x7f451c003260 con 0x7f45340af8a0 2021-10-21T00:11:11.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 -- 172.21.15.41:0/2517283285 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340601d0 con 0x7f4534140970 2021-10-21T00:11:11.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453a1ee700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4534140970 0x7f45340b1a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4530001800 tx=0x7f452c0091d0).ready entity=mon.1 client_cookie=f5a9b3d65a188da1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4530001660 con 0x7f4534140970 2021-10-21T00:11:11.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00f510 con 0x7f4534140970 2021-10-21T00:11:11.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f45389eb700 1 -- 172.21.15.41:0/2517283285 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f452c00f680 con 0x7f4534140970 2021-10-21T00:11:11.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4534140970 msgr2=0x7f45340b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4534140970 0x7f45340b1a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f4530001800 tx=0x7f452c0091d0).stop 2021-10-21T00:11:11.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- 172.21.15.41:0/2517283285 shutdown_connections 2021-10-21T00:11:11.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4534140970 0x7f45340b1a70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 --2- 172.21.15.41:0/2517283285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f453405bca0 0x7f453413aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- 172.21.15.41:0/2517283285 >> 172.21.15.41:0/2517283285 conn(0x7f4534061e00 msgr2=0x7f4534069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.794+0000 7f453bc51700 1 -- 172.21.15.41:0/2517283285 shutdown_connections 2021-10-21T00:11:11.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 -- 172.21.15.41:0/2517283285 wait complete. 2021-10-21T00:11:11.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 Processor -- start 2021-10-21T00:11:11.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 -- start start 2021-10-21T00:11:11.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 0x7f45340b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4534140970 0x7f45340b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453413cd10 con 0x7f453405bca0 2021-10-21T00:11:11.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45341427a0 con 0x7f45340af8a0 2021-10-21T00:11:11.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453bc51700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4534142aa0 con 0x7f4534140970 2021-10-21T00:11:11.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45391ec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 0x7f45340b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36778/0 (socket says 172.21.15.41:36778) 2021-10-21T00:11:11.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 -- 172.21.15.41:0/2854777578 learned_addr learned my addr 172.21.15.41:0/2854777578 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:11.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f453a1ee700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4534140970 0x7f45340b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 -- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4534140970 msgr2=0x7f45340b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4534140970 0x7f45340b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 -- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 msgr2=0x7f45340b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 0x7f45340b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 -- 172.21.15.41:0/2854777578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c009470 con 0x7f453405bca0 2021-10-21T00:11:11.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45391ec700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 0x7f45340b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:11.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.798+0000 7f45399ed700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f45300018c0 tx=0x7f45300011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4530007170 con 0x7f453405bca0 2021-10-21T00:11:11.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300072d0 con 0x7f453405bca0 2021-10-21T00:11:11.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340b4e70 con 0x7f453405bca0 2021-10-21T00:11:11.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4530004920 con 0x7f453405bca0 2021-10-21T00:11:11.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4534142d40 con 0x7f453405bca0 2021-10-21T00:11:11.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534060470 con 0x7f453405bca0 2021-10-21T00:11:11.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4530004a80 con 0x7f453405bca0 2021-10-21T00:11:11.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 0x7f4514055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:11.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f453006b740 con 0x7f453405bca0 2021-10-21T00:11:11.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.802+0000 7f45391ec700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 0x7f4514055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:11.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.806+0000 7f45391ec700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 0x7f4514055ad0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f452400b000 tx=0x7f4524006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:11.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.810+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4530042800 con 0x7f453405bca0 2021-10-21T00:11:11.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.938+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f453405daf0 con 0x7f453405bca0 2021-10-21T00:11:11.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f4522ffd700 1 -- 172.21.15.41:0/2854777578 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4530045e20 con 0x7f453405bca0 2021-10-21T00:11:11.948 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:11.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 msgr2=0x7f4514055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 0x7f4514055ad0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f452400b000 tx=0x7f4524006df0).stop 2021-10-21T00:11:11.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 msgr2=0x7f45340b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:11.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f45300018c0 tx=0x7f45300011a0).stop 2021-10-21T00:11:11.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 shutdown_connections 2021-10-21T00:11:11.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4514053610 0x7f4514055ad0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4534140970 0x7f45340b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45340af8a0 0x7f45340b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 --2- 172.21.15.41:0/2854777578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f453405bca0 0x7f45340b4980 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:11.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 >> 172.21.15.41:0/2854777578 conn(0x7f4534061e00 msgr2=0x7f45341319f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:11.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 shutdown_connections 2021-10-21T00:11:11.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:11.942+0000 7f453bc51700 1 -- 172.21.15.41:0/2854777578 wait complete. 2021-10-21T00:11:11.961 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:11:12.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 Processor -- start 2021-10-21T00:11:12.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 -- start start 2021-10-21T00:11:12.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9cfc0ad320 0x7f9cfc140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0ad700 0x7f9cfc13c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc065490 con 0x7f9cfc13cb80 2021-10-21T00:11:12.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc064b00 con 0x7f9cfc0ad320 2021-10-21T00:11:12.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9d013cb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc064da0 con 0x7f9cfc0ad700 2021-10-21T00:11:12.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9cfc0ad320 0x7f9cfc140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9cfc0ad320 0x7f9cfc140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36784/0 (socket says 172.21.15.41:36784) 2021-10-21T00:11:12.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 -- 172.21.15.41:0/3196332880 learned_addr learned my addr 172.21.15.41:0/3196332880 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:12.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfa7fc700 1 --2- 172.21.15.41:0/3196332880 >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0ad700 0x7f9cfc13c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 -- 172.21.15.41:0/3196332880 >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0ad700 msgr2=0x7f9cfc13c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:12.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 --2- 172.21.15.41:0/3196332880 >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0ad700 0x7f9cfc13c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 -- 172.21.15.41:0/3196332880 >> v1:172.21.15.62:6789/0 conn(0x7f9cfc13cb80 legacy=0x7f9cfc142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 -- 172.21.15.41:0/3196332880 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc13cf90 con 0x7f9cfc0ad320 2021-10-21T00:11:12.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cfaffd700 1 --2- 172.21.15.41:0/3196332880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc140030 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f9ce4002f70 tx=0x7f9ce4006f40).ready entity=mon.0 client_cookie=bf3df2ebfb39cd93 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cf9ffb700 1 -- 172.21.15.41:0/3196332880 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400da80 con 0x7f9cfc0ad320 2021-10-21T00:11:12.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cf9ffb700 1 -- 172.21.15.41:0/3196332880 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4000e90 con 0x7f9cfc0ad320 2021-10-21T00:11:12.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.066+0000 7f9cf9ffb700 1 -- 172.21.15.41:0/3196332880 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400de10 con 0x7f9cfc0ad320 2021-10-21T00:11:12.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- 172.21.15.41:0/3196332880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 msgr2=0x7f9cfc140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- 172.21.15.41:0/3196332880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc140030 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f9ce4002f70 tx=0x7f9ce4006f40).stop 2021-10-21T00:11:12.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- 172.21.15.41:0/3196332880 shutdown_connections 2021-10-21T00:11:12.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- 172.21.15.41:0/3196332880 >> v2:172.21.15.62:3300/0 conn(0x7f9cfc0ad700 0x7f9cfc13c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- 172.21.15.41:0/3196332880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc140030 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- 172.21.15.41:0/3196332880 >> 172.21.15.41:0/3196332880 conn(0x7f9cfc0b5f00 msgr2=0x7f9cfc0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- 172.21.15.41:0/3196332880 shutdown_connections 2021-10-21T00:11:12.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- 172.21.15.41:0/3196332880 wait complete. 2021-10-21T00:11:12.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 Processor -- start 2021-10-21T00:11:12.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- start start 2021-10-21T00:11:12.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9cfc0ad700 0x7f9cfc0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 0x7f9cfc1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc151e60 con 0x7f9cfc0ad320 2021-10-21T00:11:12.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc143710 con 0x7f9cfc13cb80 2021-10-21T00:11:12.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9d013cb700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc143470 con 0x7f9cfc0ad700 2021-10-21T00:11:12.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36790/0 (socket says 172.21.15.41:36790) 2021-10-21T00:11:12.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 -- 172.21.15.41:0/694324279 learned_addr learned my addr 172.21.15.41:0/694324279 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:12.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfa7fc700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9cfc0ad700 0x7f9cfc0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfb7fe700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 0x7f9cfc1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 -- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9cfc0ad700 msgr2=0x7f9cfc0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9cfc0ad700 0x7f9cfc0ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 -- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 msgr2=0x7f9cfc1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 0x7f9cfc1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 -- 172.21.15.41:0/694324279 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce400b460 con 0x7f9cfc0ad320 2021-10-21T00:11:12.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfb7fe700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 0x7f9cfc1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:12.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cfaffd700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f9cfc1438a0 tx=0x7f9ce4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce401d070 con 0x7f9cfc0ad320 2021-10-21T00:11:12.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.070+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40185f0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce4018950 con 0x7f9cfc0ad320 2021-10-21T00:11:12.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc152050 con 0x7f9cfc0ad320 2021-10-21T00:11:12.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc142380 con 0x7f9cfc0ad320 2021-10-21T00:11:12.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc1432c0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ce4018ab0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cf3fff700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 0x7f9ce0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ce406cce0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cfa7fc700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 0x7f9ce0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.074+0000 7f9cfa7fc700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 0x7f9ce0055a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9cf400b000 tx=0x7f9cf40091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.082+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ce4043da0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.210+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cfc0adb80 con 0x7f9cfc0ad320 2021-10-21T00:11:12.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.210+0000 7f9cf3fff700 1 -- 172.21.15.41:0/694324279 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9ce40473c0 con 0x7f9cfc0ad320 2021-10-21T00:11:12.221 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:12.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 msgr2=0x7f9ce0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 0x7f9ce0055a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9cf400b000 tx=0x7f9cf40091d0).stop 2021-10-21T00:11:12.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 msgr2=0x7f9cfc0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f9cfc1438a0 tx=0x7f9ce4006f40).stop 2021-10-21T00:11:12.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 shutdown_connections 2021-10-21T00:11:12.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9ce0053580 0x7f9ce0055a40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cfc13cb80 0x7f9cfc1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9cfc0ad700 0x7f9cfc0ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 --2- 172.21.15.41:0/694324279 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9cfc0ad320 0x7f9cfc0b4990 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 >> 172.21.15.41:0/694324279 conn(0x7f9cfc0b5f00 msgr2=0x7f9cfc139c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 shutdown_connections 2021-10-21T00:11:12.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.214+0000 7f9d013cb700 1 -- 172.21.15.41:0/694324279 wait complete. 2021-10-21T00:11:12.232 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:11:12.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 Processor -- start 2021-10-21T00:11:12.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 -- start start 2021-10-21T00:11:12.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d04062330 0x7f0d040b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d04062f70 0x7f0d0405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040b3a20 0x7f0d0413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0405bd40 con 0x7f0d04062330 2021-10-21T00:11:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0405bf70 con 0x7f0d04062f70 2021-10-21T00:11:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04142cb0 con 0x7f0d040b3a20 2021-10-21T00:11:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d04062330 0x7f0d040b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d04062330 0x7f0d040b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36800/0 (socket says 172.21.15.41:36800) 2021-10-21T00:11:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 -- 172.21.15.41:0/3897139894 learned_addr learned my addr 172.21.15.41:0/3897139894 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d02d9d700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040b3a20 0x7f0d0413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d01d9b700 1 --2- 172.21.15.41:0/3897139894 >> v2:172.21.15.62:3300/0 conn(0x7f0d04062f70 0x7f0d0405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 -- 172.21.15.41:0/3897139894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040b3a20 msgr2=0x7f0d0413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:12.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040b3a20 0x7f0d0413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 -- 172.21.15.41:0/3897139894 >> v2:172.21.15.62:3300/0 conn(0x7f0d04062f70 msgr2=0x7f0d0405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:12.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 --2- 172.21.15.41:0/3897139894 >> v2:172.21.15.62:3300/0 conn(0x7f0d04062f70 0x7f0d0405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.330+0000 7f0d0259c700 1 -- 172.21.15.41:0/3897139894 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04142950 con 0x7f0d04062330 2021-10-21T00:11:12.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0259c700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062330 0x7f0d040b3f30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f0cf8002f70 tx=0x7f0cf8006eb0).ready entity=mon.0 client_cookie=89d12a5adf252837 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0159a700 1 -- 172.21.15.41:0/3897139894 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf800d570 con 0x7f0d04062330 2021-10-21T00:11:12.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0159a700 1 -- 172.21.15.41:0/3897139894 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8000e90 con 0x7f0d04062330 2021-10-21T00:11:12.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0159a700 1 -- 172.21.15.41:0/3897139894 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf800d900 con 0x7f0d04062330 2021-10-21T00:11:12.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- 172.21.15.41:0/3897139894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062330 msgr2=0x7f0d040b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062330 0x7f0d040b3f30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f0cf8002f70 tx=0x7f0cf8006eb0).stop 2021-10-21T00:11:12.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- 172.21.15.41:0/3897139894 shutdown_connections 2021-10-21T00:11:12.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040b3a20 0x7f0d0413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- 172.21.15.41:0/3897139894 >> v2:172.21.15.62:3300/0 conn(0x7f0d04062f70 0x7f0d0405c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- 172.21.15.41:0/3897139894 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062330 0x7f0d040b3f30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- 172.21.15.41:0/3897139894 >> 172.21.15.41:0/3897139894 conn(0x7f0d040b9080 msgr2=0x7f0d040b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- 172.21.15.41:0/3897139894 shutdown_connections 2021-10-21T00:11:12.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- 172.21.15.41:0/3897139894 wait complete. 2021-10-21T00:11:12.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 Processor -- start 2021-10-21T00:11:12.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- start start 2021-10-21T00:11:12.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d040b3a20 0x7f0d040b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 0x7f0d040ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040af580 con 0x7f0d04062f70 2021-10-21T00:11:12.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040ae7d0 con 0x7f0d040b3a20 2021-10-21T00:11:12.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040af2e0 con 0x7f0d040ade30 2021-10-21T00:11:12.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.334+0000 7f0d0259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36804/0 (socket says 172.21.15.41:36804) 2021-10-21T00:11:12.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 -- 172.21.15.41:0/2625441253 learned_addr learned my addr 172.21.15.41:0/2625441253 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:12.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d02d9d700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 0x7f0d040ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d01d9b700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d040b3a20 0x7f0d040b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 -- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 msgr2=0x7f0d040ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 0x7f0d040ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 -- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d040b3a20 msgr2=0x7f0d040b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d040b3a20 0x7f0d040b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 -- 172.21.15.41:0/2625441253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf800b1e0 con 0x7f0d04062f70 2021-10-21T00:11:12.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d02d9d700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 0x7f0d040ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:12.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0259c700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f0cf8002f70 tx=0x7f0cf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf8011790 con 0x7f0d04062f70 2021-10-21T00:11:12.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf80118f0 con 0x7f0d04062f70 2021-10-21T00:11:12.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d04152b00 con 0x7f0d04062f70 2021-10-21T00:11:12.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf8011c50 con 0x7f0d04062f70 2021-10-21T00:11:12.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d04141c10 con 0x7f0d04062f70 2021-10-21T00:11:12.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d040af080 con 0x7f0d04062f70 2021-10-21T00:11:12.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.338+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0cf8025030 con 0x7f0d04062f70 2021-10-21T00:11:12.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.342+0000 7f0cf37fe700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 0x7f0ce0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.342+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0cf806cac0 con 0x7f0d04062f70 2021-10-21T00:11:12.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.342+0000 7f0d01d9b700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 0x7f0ce0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.342+0000 7f0d01d9b700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 0x7f0ce0055a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f0cf400b000 tx=0x7f0cf4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.346+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cf8043b10 con 0x7f0d04062f70 2021-10-21T00:11:12.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d04057350 con 0x7f0d04062f70 2021-10-21T00:11:12.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0cf37fe700 1 -- 172.21.15.41:0/2625441253 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0cf8023020 con 0x7f0d04062f70 2021-10-21T00:11:12.482 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:12.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 msgr2=0x7f0ce0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 0x7f0ce0055a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f0cf400b000 tx=0x7f0cf4006df0).stop 2021-10-21T00:11:12.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 msgr2=0x7f0d040ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f0cf8002f70 tx=0x7f0cf8015000).stop 2021-10-21T00:11:12.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 shutdown_connections 2021-10-21T00:11:12.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0ce00535b0 0x7f0ce0055a70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d040ade30 0x7f0d040ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d040b3a20 0x7f0d040b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 --2- 172.21.15.41:0/2625441253 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d04062f70 0x7f0d040ad820 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 >> 172.21.15.41:0/2625441253 conn(0x7f0d040b9080 msgr2=0x7f0d040b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 shutdown_connections 2021-10-21T00:11:12.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.474+0000 7f0d0359e700 1 -- 172.21.15.41:0/2625441253 wait complete. 2021-10-21T00:11:12.494 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:11:12.495 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:12.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 Processor -- start 2021-10-21T00:11:12.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 -- start start 2021-10-21T00:11:12.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f00b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 0x7ff2f0143e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f0064200 con 0x7ff2f00b2cc0 2021-10-21T00:11:12.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f005cfa0 con 0x7ff2f005cb10 2021-10-21T00:11:12.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2f4b54700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00644a0 con 0x7ff2f00b5f80 2021-10-21T00:11:12.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2eed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 0x7ff2f0143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2e7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff2f00b2cc0 0x7ff2f013dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34584/0 (socket says 172.21.15.41:34584) 2021-10-21T00:11:12.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2e7fff700 1 -- 172.21.15.41:0/1355923170 learned_addr learned my addr 172.21.15.41:0/1355923170 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:12.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1355923170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f00b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1355923170 >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 msgr2=0x7ff2f0143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:12.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1355923170 >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 0x7ff2f0143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1355923170 >> v1:172.21.15.41:6789/0 conn(0x7ff2f00b2cc0 legacy=0x7ff2f013dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1355923170 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00b17c0 con 0x7ff2f00b5f80 2021-10-21T00:11:12.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.590+0000 7ff2eed9d700 1 --2- 172.21.15.41:0/1355923170 >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 0x7ff2f0143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:12.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1355923170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f00b1c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0006df0).ready entity=mon.2 client_cookie=1b5e1fac936b0cbc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2edd9b700 1 -- 172.21.15.41:0/1355923170 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e000d570 con 0x7ff2f00b5f80 2021-10-21T00:11:12.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2edd9b700 1 -- 172.21.15.41:0/1355923170 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0000e90 con 0x7ff2f00b5f80 2021-10-21T00:11:12.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2edd9b700 1 -- 172.21.15.41:0/1355923170 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e000d8c0 con 0x7ff2f00b5f80 2021-10-21T00:11:12.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1355923170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 msgr2=0x7ff2f00b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1355923170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f00b1c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0006df0).stop 2021-10-21T00:11:12.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1355923170 shutdown_connections 2021-10-21T00:11:12.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1355923170 >> v2:172.21.15.41:3300/0 conn(0x7ff2f005cb10 0x7ff2f0143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1355923170 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f00b1c60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1355923170 >> 172.21.15.41:0/1355923170 conn(0x7ff2f0063ae0 msgr2=0x7ff2f00b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1355923170 shutdown_connections 2021-10-21T00:11:12.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.594+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1355923170 wait complete. 2021-10-21T00:11:12.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 Processor -- start 2021-10-21T00:11:12.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- start start 2021-10-21T00:11:12.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f00b2cc0 0x7ff2f0147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f0141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f013d550 con 0x7ff2f005cb10 2021-10-21T00:11:12.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f013d180 con 0x7ff2f00b2cc0 2021-10-21T00:11:12.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f010e930 con 0x7ff2f00b5f80 2021-10-21T00:11:12.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36818/0 (socket says 172.21.15.41:36818) 2021-10-21T00:11:12.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1015211834 learned_addr learned my addr 172.21.15.41:0/1015211834 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:12.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2e7fff700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f00b2cc0 0x7ff2f0147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2eed9d700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f0141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 msgr2=0x7ff2f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f0141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f00b2cc0 msgr2=0x7ff2f0147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f00b2cc0 0x7ff2f0147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 -- 172.21.15.41:0/1015211834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8009470 con 0x7ff2f005cb10 2021-10-21T00:11:12.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2ee59c700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0016070 con 0x7ff2f005cb10 2021-10-21T00:11:12.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e000b180 con 0x7ff2f005cb10 2021-10-21T00:11:12.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000d8f0 con 0x7ff2f005cb10 2021-10-21T00:11:12.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0013e90 con 0x7ff2f005cb10 2021-10-21T00:11:12.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.598+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f013c270 con 0x7ff2f005cb10 2021-10-21T00:11:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2e000f030 con 0x7ff2f005cb10 2021-10-21T00:11:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2e77fe700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 0x7ff2d4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f013dad0 con 0x7ff2f005cb10 2021-10-21T00:11:12.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2e006c760 con 0x7ff2f005cb10 2021-10-21T00:11:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2e7fff700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 0x7ff2d4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.602+0000 7ff2e7fff700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 0x7ff2d4055b90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7ff2d800d000 tx=0x7ff2d8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:12.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.606+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2e0043730 con 0x7ff2f005cb10 2021-10-21T00:11:12.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.766+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2f0057350 con 0x7ff2f005cb10 2021-10-21T00:11:12.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2e77fe700 1 -- 172.21.15.41:0/1015211834 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2139 (secure 0 0 0) 0x7ff2e0023020 con 0x7ff2f005cb10 2021-10-21T00:11:12.776 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:12.776 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.41:6833/2545988246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2545988246},{"type":"v1","addr":"172.21.15.41:6833","nonce":2545988246}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:04.209527+0000","modified":"2021-10-21T00:11:05.213156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"b","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/851642528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":851642528},{"type":"v1","addr":"172.21.15.62:6835","nonce":851642528}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-10-21T00:11:12.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 msgr2=0x7ff2d4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 0x7ff2d4055b90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7ff2d800d000 tx=0x7ff2d8009040).stop 2021-10-21T00:11:12.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 msgr2=0x7ff2f0064aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:12.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0014000).stop 2021-10-21T00:11:12.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 shutdown_connections 2021-10-21T00:11:12.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff2d40536d0 0x7ff2d4055b90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2f00b5f80 0x7ff2f0141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2f00b2cc0 0x7ff2f0147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 --2- 172.21.15.41:0/1015211834 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff2f005cb10 0x7ff2f0064aa0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:12.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 >> 172.21.15.41:0/1015211834 conn(0x7ff2f0063ae0 msgr2=0x7ff2f0140f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:12.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 shutdown_connections 2021-10-21T00:11:12.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:12.770+0000 7ff2f4b54700 1 -- 172.21.15.41:0/1015211834 wait complete. 2021-10-21T00:11:12.782 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 56 2021-10-21T00:11:12.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:04.209527+0000', 'modified': '2021-10-21T00:11:05.213156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7683}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7683': {'gid': 7683, 'name': 'b', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/851642528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 851642528}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 851642528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:12.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:12.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:11:13.109 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":7683,"want_state":"up:active","state":"up:active","rank_uptime":8.8833168459999996,"mdsmap_epoch":56,"osdmap_epoch":108,"osdmap_epoch_barrier":107,"uptime":13.861145555} 2021-10-21T00:11:13.110 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 7683, "mdsmap_epoch": 56, "osdmap_epoch": 108, "osdmap_epoch_barrier": 107, "rank_uptime": 8.883316846, "state": "up:active", "uptime": 13.861145555, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:13.111 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:11:13.111 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:11:13.111 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:11:13.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.113 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.122 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:13.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:13.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:13.194 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:13.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.196 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:13.202 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:11:13.203 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:13.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:13.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:13.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:11:13.274+0000 7f2ea8e02080 -1 init, newargv = 0x55a803d06830 newargc=9ceph-fuse[ 2021-10-21T00:11:13.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:14316]: starting ceph client 2021-10-21T00:11:13.282 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:13.283 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:13.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.285 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:13.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14316]: starting fuse 2021-10-21T00:11:13.292 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:11:13.292 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:11:13.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.293 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:11:13.294 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:11:13.294 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:11:13.295 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:11:13.295 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:11:13.295 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:13.296 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:11:13.296 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:11:13.297 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:11:13.297 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:13.298 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:11:13.298 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:11:13.298 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:11:13.299 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:11:13.299 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:13.300 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:11:13.300 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:11:13.301 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:11:13.301 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:11:13.301 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:11:13.302 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:13.302 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:11:13.303 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:11:13.344 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14316.asok 2021-10-21T00:11:13.349 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14316.asok 2021-10-21T00:11:13.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14316.asok status 2021-10-21T00:11:13.482 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:11:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:11:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:11:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:11:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:11:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:11:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:11:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14316", 2021-10-21T00:11:13.485 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:11:13.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:13.485 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:11:13.485 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:11:13.486 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 7729, 2021-10-21T00:11:13.486 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:11:13.486 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:11:13.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:11:13.487 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 7729 2021-10-21T00:11:13.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:13.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:13.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:13.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:13.488 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1613326227 2021-10-21T00:11:13.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:11:13.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:13.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:13.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:13.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:13.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1613326227 2021-10-21T00:11:13.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:13.490 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.7729 172.21.15.99:0/1613326227", 2021-10-21T00:11:13.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/1613326227", 2021-10-21T00:11:13.490 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:11:13.490 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 56, 2021-10-21T00:11:13.491 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 108, 2021-10-21T00:11:13.491 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:11:13.491 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:11:13.492 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:11:13.492 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:11:13.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.494 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.494 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.501 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:13.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:13.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.504 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.568 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.568 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:13.577 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:13.577 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:13.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.578 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.579 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:13.587 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:13.588 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:13.588 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:11:13.589 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:11:13.589 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:13.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[14907]: fuse finished with error 0 and tester_r 0 2021-10-21T00:11:13.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.647 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.647 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:13.655 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:11:13.656 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:11:13.656 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:11:13.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:13.706 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:13.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.714 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.714 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.722 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:13.724 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:13.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.725 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.725 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.772 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:13.774 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:13.774 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:11:13.775 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:11:13.775 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14316]: fuse finished with error 0 and tester_r 0 2021-10-21T00:11:13.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:13.793 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:13.793 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.800 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:11:13.801 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:11:13.801 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:11:13.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:13.875 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:13.883 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:11:13.884 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:11:13.884 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:11:13.884 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:11:13.899 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:11:13.900 DEBUG:teuthology.parallel:result is None 2021-10-21T00:11:13.902 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:11:13.902 DEBUG:teuthology.parallel:result is None 2021-10-21T00:11:13.905 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-10-21T00:11:13.905 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-10-21T00:11:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.010+0000 7fb7e100f700 1 Processor -- start 2021-10-21T00:11:14.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.010+0000 7fb7e100f700 1 -- start start 2021-10-21T00:11:14.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7dc13cb90 0x7fb7dc064a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc064ef0 0x7fb7dc065330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc05fb50 con 0x7fb7dc13c7b0 2021-10-21T00:11:14.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0609f0 con 0x7fb7dc13cb90 2021-10-21T00:11:14.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc05c3b0 con 0x7fb7dc064ef0 2021-10-21T00:11:14.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7dc13cb90 0x7fb7dc064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7db59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc064ef0 0x7fb7dc065330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7dad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb7dc13c7b0 0x7fb7dc05bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42652/0 (socket says 172.21.15.41:42652) 2021-10-21T00:11:14.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7dad9d700 1 -- 172.21.15.41:0/1632399602 learned_addr learned my addr 172.21.15.41:0/1632399602 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:14.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 -- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc064ef0 msgr2=0x7fb7dc065330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:14.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 --2- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc064ef0 0x7fb7dc065330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 -- 172.21.15.41:0/1632399602 >> v1:172.21.15.62:6789/0 conn(0x7fb7dc13c7b0 legacy=0x7fb7dc05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 -- 172.21.15.41:0/1632399602 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc05fdc0 con 0x7fb7dc13cb90 2021-10-21T00:11:14.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7d3fff700 1 --2- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc064a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fb7c4002f70 tx=0x7fb7c4006df0).ready entity=mon.1 client_cookie=b6095c1768d76d35 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7da59c700 1 -- 172.21.15.41:0/1632399602 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c400d570 con 0x7fb7dc13cb90 2021-10-21T00:11:14.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7da59c700 1 -- 172.21.15.41:0/1632399602 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4000e90 con 0x7fb7dc13cb90 2021-10-21T00:11:14.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7da59c700 1 -- 172.21.15.41:0/1632399602 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c400d8c0 con 0x7fb7dc13cb90 2021-10-21T00:11:14.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 msgr2=0x7fb7dc064a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 --2- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc064a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fb7c4002f70 tx=0x7fb7c4006df0).stop 2021-10-21T00:11:14.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- 172.21.15.41:0/1632399602 shutdown_connections 2021-10-21T00:11:14.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 --2- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc064ef0 0x7fb7dc065330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 --2- 172.21.15.41:0/1632399602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc064a00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- 172.21.15.41:0/1632399602 >> 172.21.15.41:0/1632399602 conn(0x7fb7dc0639f0 msgr2=0x7fb7dc063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:14.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- 172.21.15.41:0/1632399602 shutdown_connections 2021-10-21T00:11:14.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.014+0000 7fb7e100f700 1 -- 172.21.15.41:0/1632399602 wait complete. 2021-10-21T00:11:14.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 Processor -- start 2021-10-21T00:11:14.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- start start 2021-10-21T00:11:14.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc13c7b0 0x7fb7dc0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc13bb90 con 0x7fb7dc064ef0 2021-10-21T00:11:14.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc13f470 con 0x7fb7dc13cb90 2021-10-21T00:11:14.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc13f710 con 0x7fb7dc13c7b0 2021-10-21T00:11:14.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36832/0 (socket says 172.21.15.41:36832) 2021-10-21T00:11:14.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 -- 172.21.15.41:0/3000861060 learned_addr learned my addr 172.21.15.41:0/3000861060 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:14.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7db59e700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7d3fff700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc13c7b0 0x7fb7dc0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7f770c669700 1 Processor -- start 2021-10-21T00:11:14.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7f770c669700 1 -- start start 2021-10-21T00:11:14.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 -- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc13c7b0 msgr2=0x7fb7dc0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc13c7b0 0x7fb7dc0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 -- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 msgr2=0x7fb7dc152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 -- 172.21.15.41:0/3000861060 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c400b180 con 0x7fb7dc064ef0 2021-10-21T00:11:14.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7dad9d700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb7dc0629c0 tx=0x7fb7cc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7cc0070d0 con 0x7fb7dc064ef0 2021-10-21T00:11:14.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc007230 con 0x7fb7dc064ef0 2021-10-21T00:11:14.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc13f9b0 con 0x7fb7dc064ef0 2021-10-21T00:11:14.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7f770c669700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 0x7f77040b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f77041424d0 0x7f77040adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7cc005610 con 0x7fb7dc064ef0 2021-10-21T00:11:14.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.018+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc13f0f0 con 0x7fb7dc064ef0 2021-10-21T00:11:14.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040b0c20 con 0x7f77040ae490 2021-10-21T00:11:14.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040b6500 con 0x7f77041424d0 2021-10-21T00:11:14.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b1ed0 con 0x7f77040b6120 2021-10-21T00:11:14.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 0x7f77040b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770ac06700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f77040ae490 0x7f770413de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42666/0 (socket says 172.21.15.41:42666) 2021-10-21T00:11:14.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770ac06700 1 -- 172.21.15.41:0/2000163947 learned_addr learned my addr 172.21.15.41:0/2000163947 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:14.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709c04700 1 --2- 172.21.15.41:0/2000163947 >> v2:172.21.15.41:3300/0 conn(0x7f77041424d0 0x7f77040adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709403700 1 -- 172.21.15.41:0/2000163947 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721516561 0 0) 0x7f77040b0c20 con 0x7f77040ae490 2021-10-21T00:11:14.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709403700 1 -- 172.21.15.41:0/2000163947 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec003260 con 0x7f77040ae490 2021-10-21T00:11:14.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 -- 172.21.15.41:0/2000163947 >> v2:172.21.15.41:3300/0 conn(0x7f77041424d0 msgr2=0x7f77040adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:14.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 --2- 172.21.15.41:0/2000163947 >> v2:172.21.15.41:3300/0 conn(0x7f77041424d0 0x7f77040adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 -- 172.21.15.41:0/2000163947 >> v1:172.21.15.62:6789/0 conn(0x7f77040ae490 legacy=0x7f770413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 -- 172.21.15.41:0/2000163947 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770405d1e0 con 0x7f77040b6120 2021-10-21T00:11:14.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb7cc010070 con 0x7fb7dc064ef0 2021-10-21T00:11:14.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770a405700 1 --2- 172.21.15.41:0/2000163947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 0x7f77040b19e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f76fc001490 tx=0x7f7700006df0).ready entity=mon.2 client_cookie=863ad6c1e8e9af4f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc064260 con 0x7fb7dc064ef0 2021-10-21T00:11:14.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709403700 1 -- 172.21.15.41:0/2000163947 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770000d4a0 con 0x7f77040b6120 2021-10-21T00:11:14.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709403700 1 -- 172.21.15.41:0/2000163947 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7700000e90 con 0x7f77040b6120 2021-10-21T00:11:14.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f7709403700 1 -- 172.21.15.41:0/2000163947 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770000d7f0 con 0x7f77040b6120 2021-10-21T00:11:14.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7d8d99700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 0x7fb7c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7cc06ae20 con 0x7fb7dc064ef0 2021-10-21T00:11:14.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7d3fff700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 0x7fb7c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- 172.21.15.41:0/2000163947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 msgr2=0x7f77040b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 --2- 172.21.15.41:0/2000163947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 0x7f77040b19e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f76fc001490 tx=0x7f7700006df0).stop 2021-10-21T00:11:14.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- 172.21.15.41:0/2000163947 shutdown_connections 2021-10-21T00:11:14.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 --2- 172.21.15.41:0/2000163947 >> v2:172.21.15.41:3300/0 conn(0x7f77041424d0 0x7f77040adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 --2- 172.21.15.41:0/2000163947 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77040b6120 0x7f77040b19e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- 172.21.15.41:0/2000163947 >> 172.21.15.41:0/2000163947 conn(0x7f7704063ae0 msgr2=0x7f77040b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:14.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- 172.21.15.41:0/2000163947 shutdown_connections 2021-10-21T00:11:14.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- 172.21.15.41:0/2000163947 wait complete. 2021-10-21T00:11:14.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7fb7d3fff700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 0x7fb7c0055b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fb7c401a000 tx=0x7fb7c4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 Processor -- start 2021-10-21T00:11:14.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.022+0000 7f770c669700 1 -- start start 2021-10-21T00:11:14.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77040ae490 0x7f77041349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77041424d0 0x7f7704150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704138d50 con 0x7f77040b6120 2021-10-21T00:11:14.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704150d50 con 0x7f77040ae490 2021-10-21T00:11:14.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b3900 con 0x7f77041424d0 2021-10-21T00:11:14.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36848/0 (socket says 172.21.15.41:36848) 2021-10-21T00:11:14.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 -- 172.21.15.41:0/605041775 learned_addr learned my addr 172.21.15.41:0/605041775 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:14.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770a405700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77040ae490 0x7f77041349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770ac06700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77041424d0 0x7f7704150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 -- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77041424d0 msgr2=0x7f7704150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77041424d0 0x7f7704150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 -- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77040ae490 msgr2=0x7f77041349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77040ae490 0x7f77041349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 -- 172.21.15.41:0/605041775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770000b180 con 0x7f77040b6120 2021-10-21T00:11:14.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f7709c04700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f76f400c000 tx=0x7f76f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f4011750 con 0x7f77040b6120 2021-10-21T00:11:14.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77040b0e50 con 0x7f77040b6120 2021-10-21T00:11:14.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40118b0 con 0x7f77040b6120 2021-10-21T00:11:14.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f4011c10 con 0x7f77040b6120 2021-10-21T00:11:14.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.026+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040b4ec0 con 0x7f77040b6120 2021-10-21T00:11:14.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7cc041f80 con 0x7fb7dc064ef0 2021-10-21T00:11:14.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77040b3b80 con 0x7f77040b6120 2021-10-21T00:11:14.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f76f4011d70 con 0x7f77040b6120 2021-10-21T00:11:14.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f76f37fe700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 0x7f76ec055fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76f406bdf0 con 0x7f77040b6120 2021-10-21T00:11:14.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f770a405700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 0x7f76ec055fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.030+0000 7f770a405700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 0x7f76ec055fc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f770001a000 tx=0x7f7700014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.034+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f76f4042dc0 con 0x7f77040b6120 2021-10-21T00:11:14.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.198+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fb7dc060e10 con 0x7fb7dc064ef0 2021-10-21T00:11:14.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.206+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f7704138e90 con 0x7f77040b6120 2021-10-21T00:11:14.330 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:11:14.322+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:11:14.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7fb7d8d99700 1 -- 172.21.15.41:0/3000861060 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7680 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb7cc0455a0 con 0x7fb7dc064ef0 2021-10-21T00:11:14.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7f76f37fe700 1 -- 172.21.15.41:0/605041775 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7683 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f76f40463e0 con 0x7f77040b6120 2021-10-21T00:11:14.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 msgr2=0x7f76ec055fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 0x7f76ec055fc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f770001a000 tx=0x7f7700014000).stop 2021-10-21T00:11:14.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 msgr2=0x7f7704150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.338+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f76f400c000 tx=0x7f76f4006df0).stop 2021-10-21T00:11:14.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 shutdown_connections 2021-10-21T00:11:14.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f76ec053b00 0x7f76ec055fc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77041424d0 0x7f7704150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77040b6120 0x7f7704150370 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 --2- 172.21.15.41:0/605041775 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77040ae490 0x7f77041349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 >> 172.21.15.41:0/605041775 conn(0x7f7704063ae0 msgr2=0x7f77040ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:14.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 shutdown_connections 2021-10-21T00:11:14.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 msgr2=0x7fb7c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 0x7fb7c0055b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fb7c401a000 tx=0x7fb7c4014000).stop 2021-10-21T00:11:14.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 msgr2=0x7fb7dc0b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7f770c669700 1 -- 172.21.15.41:0/605041775 wait complete. 2021-10-21T00:11:14.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb7dc0629c0 tx=0x7fb7cc007c40).stop 2021-10-21T00:11:14.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 shutdown_connections 2021-10-21T00:11:14.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7c00536a0 0x7fb7c0055b60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc13cb90 0x7fb7dc152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7dc13c7b0 0x7fb7dc0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 --2- 172.21.15.41:0/3000861060 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb7dc064ef0 0x7fb7dc0b6950 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 >> 172.21.15.41:0/3000861060 conn(0x7fb7dc0639f0 msgr2=0x7fb7dc067340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:14.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 shutdown_connections 2021-10-21T00:11:14.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.342+0000 7fb7e100f700 1 -- 172.21.15.41:0/3000861060 wait complete. 2021-10-21T00:11:14.354 INFO:teuthology.orchestra.run.smithi041.stderr:failed mds gid 7683 2021-10-21T00:11:14.355 INFO:teuthology.orchestra.run.smithi041.stderr:failed mds gid 7680 2021-10-21T00:11:14.364 DEBUG:teuthology.parallel:result is '' 2021-10-21T00:11:14.365 DEBUG:teuthology.parallel:result is '' 2021-10-21T00:11:14.365 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:11:14.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 Processor -- start 2021-10-21T00:11:14.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 -- start start 2021-10-21T00:11:14.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd91c140400 0x7fd91c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c05fba0 0x7fd91c146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c1407e0 con 0x7fd91c0adf70 2021-10-21T00:11:14.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0ad450 con 0x7fd91c140400 2021-10-21T00:11:14.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd9234fc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0aca70 con 0x7fd91c05fba0 2021-10-21T00:11:14.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd921a99700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd91c0adf70 0x7fd91c146800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34628/0 (socket says 172.21.15.41:34628) 2021-10-21T00:11:14.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd921a99700 1 -- 172.21.15.41:0/311264478 learned_addr learned my addr 172.21.15.41:0/311264478 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:14.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd921298700 1 --2- 172.21.15.41:0/311264478 >> v2:172.21.15.41:3300/0 conn(0x7fd91c140400 0x7fd91c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd920a97700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c05fba0 0x7fd91c146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd907fff700 1 -- 172.21.15.41:0/311264478 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799152800 0 0) 0x7fd91c1407e0 con 0x7fd91c0adf70 2021-10-21T00:11:14.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.470+0000 7fd907fff700 1 -- 172.21.15.41:0/311264478 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd900003260 con 0x7fd91c0adf70 2021-10-21T00:11:14.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd921298700 1 -- 172.21.15.41:0/311264478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c05fba0 msgr2=0x7fd91c146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:14.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd921298700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c05fba0 0x7fd91c146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd921298700 1 -- 172.21.15.41:0/311264478 >> v1:172.21.15.41:6789/0 conn(0x7fd91c0adf70 legacy=0x7fd91c146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd921298700 1 -- 172.21.15.41:0/311264478 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0acd10 con 0x7fd91c140400 2021-10-21T00:11:14.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd921298700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c140400 0x7fd91c05f6b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd918002f70 tx=0x7fd918006df0).ready entity=mon.0 client_cookie=837d5b2327e19389 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd907fff700 1 -- 172.21.15.41:0/311264478 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91800d4a0 con 0x7fd91c140400 2021-10-21T00:11:14.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd907fff700 1 -- 172.21.15.41:0/311264478 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918000e90 con 0x7fd91c140400 2021-10-21T00:11:14.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd907fff700 1 -- 172.21.15.41:0/311264478 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91800d7f0 con 0x7fd91c140400 2021-10-21T00:11:14.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 -- 172.21.15.41:0/311264478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c140400 msgr2=0x7fd91c05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c140400 0x7fd91c05f6b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd918002f70 tx=0x7fd918006df0).stop 2021-10-21T00:11:14.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 -- 172.21.15.41:0/311264478 shutdown_connections 2021-10-21T00:11:14.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c05fba0 0x7fd91c146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 --2- 172.21.15.41:0/311264478 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c140400 0x7fd91c05f6b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 -- 172.21.15.41:0/311264478 >> 172.21.15.41:0/311264478 conn(0x7fd91c0b7030 msgr2=0x7fd91c0b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:14.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 -- 172.21.15.41:0/311264478 shutdown_connections 2021-10-21T00:11:14.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.474+0000 7fd9234fc700 1 -- 172.21.15.41:0/311264478 wait complete. 2021-10-21T00:11:14.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 Processor -- start 2021-10-21T00:11:14.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 -- start start 2021-10-21T00:11:14.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 0x7fd91c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c140400 0x7fd91c0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c064940 con 0x7fd91c0adf70 2021-10-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c145450 con 0x7fd91c05fba0 2021-10-21T00:11:14.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd9234fc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c153180 con 0x7fd91c140400 2021-10-21T00:11:14.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 0x7fd91c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd921298700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd921298700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48778/0 (socket says 172.21.15.41:48778) 2021-10-21T00:11:14.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd921a99700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c140400 0x7fd91c0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd921298700 1 -- 172.21.15.41:0/830240659 learned_addr learned my addr 172.21.15.41:0/830240659 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:14.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 -- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c140400 msgr2=0x7fd91c0ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c140400 0x7fd91c0ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 -- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 msgr2=0x7fd91c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:14.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:14.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd920a97700 1 -- 172.21.15.41:0/830240659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91800b180 con 0x7fd91c0adf70 2021-10-21T00:11:14.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.478+0000 7fd921298700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:14.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd920a97700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 0x7fd91c152c90 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fd91000c000 tx=0x7fd910006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd910011750 con 0x7fd91c0adf70 2021-10-21T00:11:14.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9100118b0 con 0x7fd91c0adf70 2021-10-21T00:11:14.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c146060 con 0x7fd91c0adf70 2021-10-21T00:11:14.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd910011c10 con 0x7fd91c0adf70 2021-10-21T00:11:14.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c145bb0 con 0x7fd91c0adf70 2021-10-21T00:11:14.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c1452b0 con 0x7fd91c0adf70 2021-10-21T00:11:14.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd910011d70 con 0x7fd91c0adf70 2021-10-21T00:11:14.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 0x7fd8f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:14.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.482+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd91006bbb0 con 0x7fd91c0adf70 2021-10-21T00:11:14.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.486+0000 7fd921298700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 0x7fd8f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:14.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.486+0000 7fd921298700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 0x7fd8f8055ad0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd91801a000 tx=0x7fd918014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:14.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.486+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd91c1452b0 con 0x7fd91c0adf70 2021-10-21T00:11:14.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:14.654+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd91c1452b0 con 0x7fd91c0adf70 2021-10-21T00:11:15.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.350+0000 7fd90effd700 1 -- 172.21.15.41:0/830240659 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd91c1452b0 con 0x7fd91c0adf70 2021-10-21T00:11:15.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 msgr2=0x7fd8f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 0x7fd8f8055ad0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd91801a000 tx=0x7fd918014000).stop 2021-10-21T00:11:15.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 msgr2=0x7fd91c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 0x7fd91c152c90 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fd91000c000 tx=0x7fd910006df0).stop 2021-10-21T00:11:15.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 shutdown_connections 2021-10-21T00:11:15.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd8f8053610 0x7fd8f8055ad0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd91c140400 0x7fd91c0ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd91c0adf70 0x7fd91c152c90 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 --2- 172.21.15.41:0/830240659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd91c05fba0 0x7fd91c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 >> 172.21.15.41:0/830240659 conn(0x7fd91c0b7030 msgr2=0x7fd91c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:15.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 shutdown_connections 2021-10-21T00:11:15.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.354+0000 7fd9234fc700 1 -- 172.21.15.41:0/830240659 wait complete. 2021-10-21T00:11:15.377 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:11:15.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.490+0000 7f45c359e700 1 Processor -- start 2021-10-21T00:11:15.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.490+0000 7f45c359e700 1 -- start start 2021-10-21T00:11:15.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f45c4062330 0x7f45c40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4143610 0x7f45c413c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4142ad0 con 0x7f45c413c510 2021-10-21T00:11:15.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40b3520 con 0x7f45c4062330 2021-10-21T00:11:15.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4143c40 con 0x7f45c4143610 2021-10-21T00:11:15.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f45c4062330 0x7f45c40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c1d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f45c413c510 0x7f45c4142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34640/0 (socket says 172.21.15.41:34640) 2021-10-21T00:11:15.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c1d9b700 1 -- 172.21.15.41:0/2271014149 learned_addr learned my addr 172.21.15.41:0/2271014149 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:15.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c2d9d700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4143610 0x7f45c413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c159a700 1 -- 172.21.15.41:0/2271014149 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230560321 0 0) 0x7f45c4142ad0 con 0x7f45c413c510 2021-10-21T00:11:15.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c159a700 1 -- 172.21.15.41:0/2271014149 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a8003260 con 0x7f45c413c510 2021-10-21T00:11:15.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 -- 172.21.15.41:0/2271014149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4143610 msgr2=0x7f45c413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:15.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4143610 0x7f45c413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 -- 172.21.15.41:0/2271014149 >> v1:172.21.15.41:6789/0 conn(0x7f45c413c510 legacy=0x7f45c4142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 -- 172.21.15.41:0/2271014149 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c413ce60 con 0x7f45c4062330 2021-10-21T00:11:15.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c259c700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4062330 0x7f45c40b4140 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f45b8002f70 tx=0x7f45b8006df0).ready entity=mon.0 client_cookie=c52593ea3790da5a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:15.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c159a700 1 -- 172.21.15.41:0/2271014149 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b800d4a0 con 0x7f45c4062330 2021-10-21T00:11:15.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c159a700 1 -- 172.21.15.41:0/2271014149 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8000e90 con 0x7f45c4062330 2021-10-21T00:11:15.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c159a700 1 -- 172.21.15.41:0/2271014149 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b800d7f0 con 0x7f45c4062330 2021-10-21T00:11:15.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- 172.21.15.41:0/2271014149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4062330 msgr2=0x7f45c40b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4062330 0x7f45c40b4140 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f45b8002f70 tx=0x7f45b8006df0).stop 2021-10-21T00:11:15.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- 172.21.15.41:0/2271014149 shutdown_connections 2021-10-21T00:11:15.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4143610 0x7f45c413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 --2- 172.21.15.41:0/2271014149 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4062330 0x7f45c40b4140 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- 172.21.15.41:0/2271014149 >> 172.21.15.41:0/2271014149 conn(0x7f45c40b9080 msgr2=0x7f45c40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:15.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- 172.21.15.41:0/2271014149 shutdown_connections 2021-10-21T00:11:15.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.494+0000 7f45c359e700 1 -- 172.21.15.41:0/2271014149 wait complete. 2021-10-21T00:11:15.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 Processor -- start 2021-10-21T00:11:15.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 -- start start 2021-10-21T00:11:15.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 0x7f45c4144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45c413c510 0x7f45c4138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4149560 con 0x7f45c4143610 2021-10-21T00:11:15.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4149800 con 0x7f45c413c510 2021-10-21T00:11:15.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4149aa0 con 0x7f45c4062330 2021-10-21T00:11:15.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36878/0 (socket says 172.21.15.41:36878) 2021-10-21T00:11:15.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 -- 172.21.15.41:0/3072070642 learned_addr learned my addr 172.21.15.41:0/3072070642 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:15.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c1d9b700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45c413c510 0x7f45c4138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c259c700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 0x7f45c4144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 -- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 msgr2=0x7f45c4144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 0x7f45c4144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 -- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45c413c510 msgr2=0x7f45c4138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:15.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45c413c510 0x7f45c4138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:15.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 -- 172.21.15.41:0/3072070642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b800b180 con 0x7f45c4143610 2021-10-21T00:11:15.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c259c700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 0x7f45c4144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:15.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.498+0000 7f45c2d9d700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f45bc006e00 tx=0x7f45bc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:15.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45bc00c670 con 0x7f45c4143610 2021-10-21T00:11:15.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00c7d0 con 0x7f45c4143610 2021-10-21T00:11:15.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c4145620 con 0x7f45c4143610 2021-10-21T00:11:15.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45bc00cb30 con 0x7f45c4143610 2021-10-21T00:11:15.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40b8be0 con 0x7f45c4143610 2021-10-21T00:11:15.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c413bcf0 con 0x7f45c4143610 2021-10-21T00:11:15.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.502+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45bc00cc90 con 0x7f45c4143610 2021-10-21T00:11:15.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.506+0000 7f45b37fe700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 0x7f45a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:15.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.506+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f45bc06bcb0 con 0x7f45c4143610 2021-10-21T00:11:15.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.506+0000 7f45c259c700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 0x7f45a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:15.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.506+0000 7f45c259c700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 0x7f45a0055ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f45b8018000 tx=0x7f45b8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:15.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.510+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45bc042dc0 con 0x7f45c4143610 2021-10-21T00:11:15.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:15.638+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45c4149c60 con 0x7f45c4143610 2021-10-21T00:11:16.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.354+0000 7f45b37fe700 1 -- 172.21.15.41:0/3072070642 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 185+0+0 (secure 0 0 0) 0x7f45bc0463e0 con 0x7f45c4143610 2021-10-21T00:11:16.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.354+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 msgr2=0x7f45a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:16.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.354+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 0x7f45a0055ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f45b8018000 tx=0x7f45b8014000).stop 2021-10-21T00:11:16.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.354+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 msgr2=0x7f45c4138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:16.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.354+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f45bc006e00 tx=0x7f45bc0091d0).stop 2021-10-21T00:11:16.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 shutdown_connections 2021-10-21T00:11:16.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f45a0053610 0x7f45a0055ad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f45c4143610 0x7f45c4138800 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45c413c510 0x7f45c4138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 --2- 172.21.15.41:0/3072070642 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f45c4062330 0x7f45c4144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 >> 172.21.15.41:0/3072070642 conn(0x7f45c40b9080 msgr2=0x7f45c40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:16.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 shutdown_connections 2021-10-21T00:11:16.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.358+0000 7f45c359e700 1 -- 172.21.15.41:0/3072070642 wait complete. 2021-10-21T00:11:16.366 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:11:16.379 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:11:16.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.482+0000 7fd334b1d700 1 Processor -- start 2021-10-21T00:11:16.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.482+0000 7fd334b1d700 1 -- start start 2021-10-21T00:11:16.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd3300b61d0 0x7fd3300af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 0x7fd3300af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300afe80 con 0x7fd3300afa00 2021-10-21T00:11:16.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3300b65b0 con 0x7fd3300b61d0 2021-10-21T00:11:16.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd330143db0 con 0x7fd3300677e0 2021-10-21T00:11:16.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd3300b61d0 0x7fd3300af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd3300b61d0 0x7fd3300af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36882/0 (socket says 172.21.15.41:36882) 2021-10-21T00:11:16.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 -- 172.21.15.41:0/2752681871 learned_addr learned my addr 172.21.15.41:0/2752681871 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:16.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32effd700 1 --2- 172.21.15.41:0/2752681871 >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 0x7fd3300af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 -- 172.21.15.41:0/2752681871 >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 msgr2=0x7fd3300af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:16.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 --2- 172.21.15.41:0/2752681871 >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 0x7fd3300af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 -- 172.21.15.41:0/2752681871 >> v1:172.21.15.62:6789/0 conn(0x7fd3300afa00 legacy=0x7fd330138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:16.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 -- 172.21.15.41:0/2752681871 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300b18f0 con 0x7fd3300b61d0 2021-10-21T00:11:16.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32effd700 1 --2- 172.21.15.41:0/2752681871 >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 0x7fd3300af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:16.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32f7fe700 1 --2- 172.21.15.41:0/2752681871 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd3300af020 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd3300b1f10 tx=0x7fd320006eb0).ready entity=mon.0 client_cookie=f405e74e0f1592fd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:16.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32e7fc700 1 -- 172.21.15.41:0/2752681871 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32000d5c0 con 0x7fd3300b61d0 2021-10-21T00:11:16.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32e7fc700 1 -- 172.21.15.41:0/2752681871 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320000e90 con 0x7fd3300b61d0 2021-10-21T00:11:16.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd32e7fc700 1 -- 172.21.15.41:0/2752681871 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32000d910 con 0x7fd3300b61d0 2021-10-21T00:11:16.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- 172.21.15.41:0/2752681871 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 msgr2=0x7fd3300af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:16.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 --2- 172.21.15.41:0/2752681871 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd3300af020 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fd3300b1f10 tx=0x7fd320006eb0).stop 2021-10-21T00:11:16.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- 172.21.15.41:0/2752681871 shutdown_connections 2021-10-21T00:11:16.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 --2- 172.21.15.41:0/2752681871 >> v2:172.21.15.62:3300/0 conn(0x7fd3300677e0 0x7fd3300af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 --2- 172.21.15.41:0/2752681871 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd3300af020 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- 172.21.15.41:0/2752681871 >> 172.21.15.41:0/2752681871 conn(0x7fd330063b80 msgr2=0x7fd3300b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:16.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- 172.21.15.41:0/2752681871 shutdown_connections 2021-10-21T00:11:16.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- 172.21.15.41:0/2752681871 wait complete. 2021-10-21T00:11:16.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 Processor -- start 2021-10-21T00:11:16.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.486+0000 7fd334b1d700 1 -- start start 2021-10-21T00:11:16.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 0x7fd330064c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3300afa00 0x7fd3301324c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33012cfc0 con 0x7fd3300b61d0 2021-10-21T00:11:16.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33012d260 con 0x7fd3300677e0 2021-10-21T00:11:16.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33012d500 con 0x7fd3300afa00 2021-10-21T00:11:16.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 0x7fd330064c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36892/0 (socket says 172.21.15.41:36892) 2021-10-21T00:11:16.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32effd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3300afa00 0x7fd3301324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 0x7fd330064c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48806/0 (socket says 172.21.15.41:48806) 2021-10-21T00:11:16.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 -- 172.21.15.41:0/1558479033 learned_addr learned my addr 172.21.15.41:0/1558479033 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:16.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 -- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3300afa00 msgr2=0x7fd3301324c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:16.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3300afa00 0x7fd3301324c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 -- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 msgr2=0x7fd330064c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:16.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 0x7fd330064c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:16.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 -- 172.21.15.41:0/1558479033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32000b1e0 con 0x7fd3300b61d0 2021-10-21T00:11:16.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32ffff700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fd328002320 tx=0x7fd3280023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:16.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd328006aa0 con 0x7fd3300b61d0 2021-10-21T00:11:16.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328006c00 con 0x7fd3300b61d0 2021-10-21T00:11:16.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33013a790 con 0x7fd3300b61d0 2021-10-21T00:11:16.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd328007030 con 0x7fd3300b61d0 2021-10-21T00:11:16.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33012d990 con 0x7fd3300b61d0 2021-10-21T00:11:16.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.490+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3300b1b90 con 0x7fd3300b61d0 2021-10-21T00:11:16.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.494+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd328010030 con 0x7fd3300b61d0 2021-10-21T00:11:16.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.494+0000 7fd32cff9700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 0x7fd310055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:16.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.494+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fd32806b690 con 0x7fd3300b61d0 2021-10-21T00:11:16.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.494+0000 7fd32f7fe700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 0x7fd310055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:16.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.494+0000 7fd32f7fe700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 0x7fd310055a40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fd32001c000 tx=0x7fd320015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:16.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.498+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd328042840 con 0x7fd3300b61d0 2021-10-21T00:11:16.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:16.622+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd33012d990 con 0x7fd3300b61d0 2021-10-21T00:11:17.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.366+0000 7fd32cff9700 1 -- 172.21.15.41:0/1558479033 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v112) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd33012d990 con 0x7fd3300b61d0 2021-10-21T00:11:17.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 msgr2=0x7fd310055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:17.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 0x7fd310055a40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fd32001c000 tx=0x7fd320015000).stop 2021-10-21T00:11:17.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 msgr2=0x7fd33012c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:17.377 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fd328002320 tx=0x7fd3280023f0).stop 2021-10-21T00:11:17.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 shutdown_connections 2021-10-21T00:11:17.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd310053580 0x7fd310055a40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd3300b61d0 0x7fd33012c340 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3300afa00 0x7fd3301324c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 --2- 172.21.15.41:0/1558479033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3300677e0 0x7fd330064c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 >> 172.21.15.41:0/1558479033 conn(0x7fd330063b80 msgr2=0x7fd33005be00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:17.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 shutdown_connections 2021-10-21T00:11:17.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:17.370+0000 7fd334b1d700 1 -- 172.21.15.41:0/1558479033 wait complete. 2021-10-21T00:11:17.380 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:11:17.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-10-21T00:11:17.435 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.423+0000 7fa0264beb80 1 Processor -- start 2021-10-21T00:11:17.435 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.423+0000 7fa0264beb80 1 -- start start 2021-10-21T00:11:17.436 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 0x5560aec1d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.436 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.436 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aecaef90 0x5560aec1e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.436 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560aeb9b460 con 0x5560aeca9830 2021-10-21T00:11:17.436 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560aecc0320 con 0x5560aeca8ca0 2021-10-21T00:11:17.437 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560aecc04b0 con 0x5560aecaef90 2021-10-21T00:11:17.437 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0240fb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.437 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 0x5560aec1d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.437 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0250fd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aecaef90 0x5560aec1e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.438 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0240fb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.71:48480/0 (socket says 172.21.15.71:48480) 2021-10-21T00:11:17.438 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0240fb700 1 -- 172.21.15.71:0/1502068571 learned_addr learned my addr 172.21.15.71:0/1502068571 (peer_addr_for_me v2:172.21.15.71:0/0) 2021-10-21T00:11:17.438 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 -- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aecaef90 msgr2=0x5560aec1e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:17.438 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aecaef90 0x5560aec1e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.439 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 -- 172.21.15.71:0/1502068571 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 msgr2=0x5560aec1deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:17.439 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.439 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 -- 172.21.15.71:0/1502068571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c00a0e0 con 0x5560aeca8ca0 2021-10-21T00:11:17.439 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0240fb700 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:17.439 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 0x5560aec1d9c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa01c00b000 tx=0x7fa01c007040).ready entity=mon.1 client_cookie=f511f77308d52dc2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:17.443 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0228f8700 1 -- 172.21.15.71:0/1502068571 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c011600 con 0x5560aeca8ca0 2021-10-21T00:11:17.444 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0228f8700 1 -- 172.21.15.71:0/1502068571 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c011760 con 0x5560aeca8ca0 2021-10-21T00:11:17.444 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0228f8700 1 -- 172.21.15.71:0/1502068571 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c011ac0 con 0x5560aeca8ca0 2021-10-21T00:11:17.444 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 msgr2=0x5560aec1d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:17.444 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 0x5560aec1d9c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa01c00b000 tx=0x7fa01c007040).stop 2021-10-21T00:11:17.444 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- 172.21.15.71:0/1502068571 shutdown_connections 2021-10-21T00:11:17.445 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aecaef90 0x5560aec1e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.445 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca9830 0x5560aec1deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.445 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- 172.21.15.71:0/1502068571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aeca8ca0 0x5560aec1d9c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.445 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- 172.21.15.71:0/1502068571 >> 172.21.15.71:0/1502068571 conn(0x5560aeca48b0 msgr2=0x5560aecac510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:17.446 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- 172.21.15.71:0/1502068571 shutdown_connections 2021-10-21T00:11:17.446 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- 172.21.15.71:0/1502068571 wait complete. 2021-10-21T00:11:17.446 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 Processor -- start 2021-10-21T00:11:17.446 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- start start 2021-10-21T00:11:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 0x5560aecbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aeca9830 0x5560aecbace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aecaef90 0x5560aecbb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560aecad520 con 0x5560aeca8ca0 2021-10-21T00:11:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560aecbb800 con 0x5560aecaef90 2021-10-21T00:11:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0264beb80 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560aecbb9c0 con 0x5560aeca9830 2021-10-21T00:11:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 0x5560aecbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 0x5560aecbfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.71:48482/0 (socket says 172.21.15.71:48482) 2021-10-21T00:11:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0248fc700 1 -- 172.21.15.71:0/2658218836 learned_addr learned my addr 172.21.15.71:0/2658218836 (peer_addr_for_me v2:172.21.15.71:0/0) 2021-10-21T00:11:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0240fb700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aeca9830 0x5560aecbace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.427+0000 7fa0250fd700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aecaef90 0x5560aecbb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 -- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aeca9830 msgr2=0x5560aecbace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5560aeca9830 0x5560aecbace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 -- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aecaef90 msgr2=0x5560aecbb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560aecaef90 0x5560aecbb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 -- 172.21.15.71:0/2658218836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010001e10 con 0x5560aeca8ca0 2021-10-21T00:11:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0248fc700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 0x5560aecbfb80 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa01c00b000 tx=0x7fa01c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c011600 con 0x5560aeca8ca0 2021-10-21T00:11:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c0193b0 con 0x5560aeca8ca0 2021-10-21T00:11:17.451 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c00a4e0 con 0x5560aeca8ca0 2021-10-21T00:11:17.451 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c005a50 con 0x5560aeca8ca0 2021-10-21T00:11:17.451 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa014005cd0 con 0x5560aeca8ca0 2021-10-21T00:11:17.451 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa01c019710 con 0x5560aeca8ca0 2021-10-21T00:11:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.431+0000 7fa0220f7700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa004052190 0x7fa004054650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fa01c06c780 con 0x5560aeca8ca0 2021-10-21T00:11:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0240fb700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa004052190 0x7fa004054650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0264beb80 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x5560aecc8a00 0x5560aeccadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 --> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e112) v8 -- 0x5560aeccb380 con 0x5560aecc8a00 2021-10-21T00:11:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0250fd700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x5560aecc8a00 0x5560aeccadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0240fb700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa004052190 0x7fa004054650 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fa00c009000 tx=0x7fa00c000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:17.435+0000 7fa0250fd700 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x5560aecc8a00 0x5560aeccadf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:18.674 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.667+0000 7fa0220f7700 1 -- 172.21.15.71:0/2658218836 <== osd.0 v2:172.21.15.41:6800/14347 1 ==== osd_map(113..113 src has 1..113) v4 ==== 320+0+0 (crc 0 0 0) 0x7fa0140078f0 con 0x5560aecc8a00 2021-10-21T00:11:18.679 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.667+0000 7fa0250fd700 1 -- 172.21.15.71:0/2658218836 <== osd.0 v2:172.21.15.41:6800/14347 2 ==== osd_op_reply(1 key [writefull 0~617] v113'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fa014007ab0 con 0x5560aecc8a00 2021-10-21T00:11:18.679 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x5560aecc8a00 msgr2=0x5560aeccadf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.680 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x5560aecc8a00 0x5560aeccadf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.680 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa004052190 msgr2=0x7fa004054650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.680 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa004052190 0x7fa004054650 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fa00c009000 tx=0x7fa00c000bc0).stop 2021-10-21T00:11:18.680 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 msgr2=0x5560aecbfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 --2- 172.21.15.71:0/2658218836 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x5560aeca8ca0 0x5560aecbfb80 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa01c00b000 tx=0x7fa01c019000).stop 2021-10-21T00:11:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0250fd700 1 -- 172.21.15.71:0/2658218836 reap_dead start 2021-10-21T00:11:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 shutdown_connections 2021-10-21T00:11:18.681 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 >> 172.21.15.71:0/2658218836 conn(0x5560aeca48b0 msgr2=0x5560aecac510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:18.682 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 shutdown_connections 2021-10-21T00:11:18.682 INFO:teuthology.orchestra.run.smithi071.stderr:2021-10-21T00:11:18.671+0000 7fa0264beb80 1 -- 172.21.15.71:0/2658218836 wait complete. 2021-10-21T00:11:18.684 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-21T00:11:18.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 Processor -- start 2021-10-21T00:11:18.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 -- start start 2021-10-21T00:11:18.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 0x7f1dd014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1dd00aa750 0x7f1dd014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd014b130 0x7f1dd01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00b1620 con 0x7f1dd005f9f0 2021-10-21T00:11:18.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00609d0 con 0x7f1dd00aa750 2021-10-21T00:11:18.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dd49df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd005fdd0 con 0x7f1dd014b130 2021-10-21T00:11:18.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dce59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 0x7f1dd014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dcdd9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1dd00aa750 0x7f1dd014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dce59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 0x7f1dd014a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36898/0 (socket says 172.21.15.41:36898) 2021-10-21T00:11:18.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.778+0000 7f1dce59c700 1 -- 172.21.15.41:0/3699635085 learned_addr learned my addr 172.21.15.41:0/3699635085 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:18.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dced9d700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd014b130 0x7f1dd01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 -- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd014b130 msgr2=0x7f1dd01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:18.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd014b130 0x7f1dd01495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 -- 172.21.15.41:0/3699635085 >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 msgr2=0x7f1dd014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:18.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 --2- 172.21.15.41:0/3699635085 >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 0x7f1dd014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 -- 172.21.15.41:0/3699635085 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00b1380 con 0x7f1dd00aa750 2021-10-21T00:11:18.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcdd9b700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd014ac40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f1dc0002f70 tx=0x7f1dc0006df0).ready entity=mon.1 client_cookie=7ca4990441e3d44 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:18.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcd59a700 1 -- 172.21.15.41:0/3699635085 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc000d4a0 con 0x7f1dd00aa750 2021-10-21T00:11:18.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcd59a700 1 -- 172.21.15.41:0/3699635085 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0000e90 con 0x7f1dd00aa750 2021-10-21T00:11:18.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dcd59a700 1 -- 172.21.15.41:0/3699635085 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc000d7f0 con 0x7f1dd00aa750 2021-10-21T00:11:18.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 -- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 msgr2=0x7f1dd014ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd014ac40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f1dc0002f70 tx=0x7f1dc0006df0).stop 2021-10-21T00:11:18.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 -- 172.21.15.41:0/3699635085 shutdown_connections 2021-10-21T00:11:18.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd014b130 0x7f1dd01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 --2- 172.21.15.41:0/3699635085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd014ac40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 --2- 172.21.15.41:0/3699635085 >> v2:172.21.15.41:3300/0 conn(0x7f1dd005f9f0 0x7f1dd014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 -- 172.21.15.41:0/3699635085 >> 172.21.15.41:0/3699635085 conn(0x7f1dd005bca0 msgr2=0x7f1dd005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:18.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 -- 172.21.15.41:0/3699635085 shutdown_connections 2021-10-21T00:11:18.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.782+0000 7f1dd49df700 1 -- 172.21.15.41:0/3699635085 wait complete. 2021-10-21T00:11:18.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 Processor -- start 2021-10-21T00:11:18.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- start start 2021-10-21T00:11:18.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd005f9f0 0x7f1dd00aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd0145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0098840 con 0x7f1dd014b130 2021-10-21T00:11:18.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0098a70 con 0x7f1dd00aa750 2021-10-21T00:11:18.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0098d10 con 0x7f1dd005f9f0 2021-10-21T00:11:18.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36904/0 (socket says 172.21.15.41:36904) 2021-10-21T00:11:18.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 -- 172.21.15.41:0/2454439302 learned_addr learned my addr 172.21.15.41:0/2454439302 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:18.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dcdd9b700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd0145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dce59c700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd005f9f0 0x7f1dd00aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 -- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd005f9f0 msgr2=0x7f1dd00aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd005f9f0 0x7f1dd00aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 -- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 msgr2=0x7f1dd0145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd0145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 -- 172.21.15.41:0/2454439302 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc000b180 con 0x7f1dd014b130 2021-10-21T00:11:18.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dced9d700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1dc8006e00 tx=0x7f1dc80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:18.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800c670 con 0x7f1dd014b130 2021-10-21T00:11:18.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800c7d0 con 0x7f1dd014b130 2021-10-21T00:11:18.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800cb30 con 0x7f1dd014b130 2021-10-21T00:11:18.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd0145970 con 0x7f1dd014b130 2021-10-21T00:11:18.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.786+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00b1ee0 con 0x7f1dd014b130 2021-10-21T00:11:18.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd0099980 con 0x7f1dd014b130 2021-10-21T00:11:18.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1dc8022070 con 0x7f1dd014b130 2021-10-21T00:11:18.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dbf7fe700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 0x7f1dac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:18.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f1dc806bf10 con 0x7f1dd014b130 2021-10-21T00:11:18.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dce59c700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 0x7f1dac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:18.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.790+0000 7f1dce59c700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 0x7f1dac055a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f1dc4008000 tx=0x7f1dc4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:18.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.794+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1dd0099980 con 0x7f1dd014b130 2021-10-21T00:11:18.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.966+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f1dd0099980 con 0x7f1dd014b130 2021-10-21T00:11:18.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.966+0000 7f1dbf7fe700 1 -- 172.21.15.41:0/2454439302 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1594 (secure 0 0 0) 0x7f1dd0099980 con 0x7f1dd014b130 2021-10-21T00:11:18.976 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:18.977 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:18.977 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:18.977 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:11:18.977 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761053446144, 2021-10-21T00:11:18.978 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6531874816, 2021-10-21T00:11:18.978 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6531874816, 2021-10-21T00:11:18.978 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085096405819058418, 2021-10-21T00:11:18.978 INFO:teuthology.orchestra.run.smithi041.stdout: "num_osds": 8, 2021-10-21T00:11:18.979 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_osds": 0, 2021-10-21T00:11:18.979 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_omap_osds": 0 2021-10-21T00:11:18.979 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:18.980 INFO:teuthology.orchestra.run.smithi041.stdout: "stats_by_class": { 2021-10-21T00:11:18.980 INFO:teuthology.orchestra.run.smithi041.stdout: "ssd": { 2021-10-21T00:11:18.980 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:11:18.980 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761053446144, 2021-10-21T00:11:18.981 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6531874816, 2021-10-21T00:11:18.981 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6531874816, 2021-10-21T00:11:18.981 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085096405819058418 2021-10-21T00:11:18.981 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:18.982 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:18.982 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:11:18.982 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:18.982 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "device_health_metrics", 2021-10-21T00:11:18.983 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 1, 2021-10-21T00:11:18.983 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:18.983 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:18.983 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 2, 2021-10-21T00:11:18.984 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:18.984 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:18.984 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:18.984 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361336995840 2021-10-21T00:11:18.985 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:18.985 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:18.985 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:18.985 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "rbd", 2021-10-21T00:11:18.986 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 2, 2021-10-21T00:11:18.986 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:18.986 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:18.986 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:11:18.986 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:18.987 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:18.987 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:18.987 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361336995840 2021-10-21T00:11:18.987 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:18.988 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:18.988 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:18.988 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "cephfs_data", 2021-10-21T00:11:18.988 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 22, 2021-10-21T00:11:18.989 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:18.989 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:18.989 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:11:18.989 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:18.989 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:18.990 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:18.990 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361336995840 2021-10-21T00:11:18.991 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:18.991 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:18.992 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:18.992 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:18.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 msgr2=0x7f1dac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 0x7f1dac055a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f1dc4008000 tx=0x7f1dc4008040).stop 2021-10-21T00:11:18.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 msgr2=0x7f1dd00b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:18.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f1dc8006e00 tx=0x7f1dc80091d0).stop 2021-10-21T00:11:18.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 shutdown_connections 2021-10-21T00:11:18.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1dac053580 0x7f1dac055a40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1dd014b130 0x7f1dd00b1850 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd00aa750 0x7f1dd0145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 --2- 172.21.15.41:0/2454439302 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd005f9f0 0x7f1dd00aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:18.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 >> 172.21.15.41:0/2454439302 conn(0x7f1dd005bca0 msgr2=0x7f1dd005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:18.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 shutdown_connections 2021-10-21T00:11:18.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:18.970+0000 7f1dd49df700 1 -- 172.21.15.41:0/2454439302 wait complete. 2021-10-21T00:11:18.997 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-10-21T00:11:23.998 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-10-21T00:11:24.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 Processor -- start 2021-10-21T00:11:24.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 -- start start 2021-10-21T00:11:24.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc2c40b2170 0x7fc2c40ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40af620 0x7fc2c40ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c40b0b50 con 0x7fc2c40abb50 2021-10-21T00:11:24.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40b2550 con 0x7fc2c40b2170 2021-10-21T00:11:24.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b0d90 con 0x7fc2c40af620 2021-10-21T00:11:24.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc2c40b2170 0x7fc2c40ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c2d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc2c40abb50 0x7fc2c414a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34682/0 (socket says 172.21.15.41:34682) 2021-10-21T00:11:24.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c2d9d700 1 -- 172.21.15.41:0/3389393807 learned_addr learned my addr 172.21.15.41:0/3389393807 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:24.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.102+0000 7fc2c1d9b700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40af620 0x7fc2c40ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c259c700 1 -- 172.21.15.41:0/3389393807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40af620 msgr2=0x7fc2c40ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:24.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c259c700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40af620 0x7fc2c40ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c259c700 1 -- 172.21.15.41:0/3389393807 >> v1:172.21.15.41:6789/0 conn(0x7fc2c40abb50 legacy=0x7fc2c414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c159a700 1 -- 172.21.15.41:0/3389393807 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615633401 0 0) 0x7fc2bc001490 con 0x7fc2c40abb50 2021-10-21T00:11:24.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c259c700 1 -- 172.21.15.41:0/3389393807 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40b1030 con 0x7fc2c40b2170 2021-10-21T00:11:24.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c259c700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40b2170 0x7fc2c40ab170 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fc2b8002f70 tx=0x7fc2b8006df0).ready entity=mon.0 client_cookie=ea181e9082a08987 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c159a700 1 -- 172.21.15.41:0/3389393807 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b800d570 con 0x7fc2c40b2170 2021-10-21T00:11:24.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c159a700 1 -- 172.21.15.41:0/3389393807 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8000e90 con 0x7fc2c40b2170 2021-10-21T00:11:24.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c159a700 1 -- 172.21.15.41:0/3389393807 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b800d8c0 con 0x7fc2c40b2170 2021-10-21T00:11:24.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- 172.21.15.41:0/3389393807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40b2170 msgr2=0x7fc2c40ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40b2170 0x7fc2c40ab170 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fc2b8002f70 tx=0x7fc2b8006df0).stop 2021-10-21T00:11:24.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- 172.21.15.41:0/3389393807 shutdown_connections 2021-10-21T00:11:24.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40af620 0x7fc2c40ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 --2- 172.21.15.41:0/3389393807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40b2170 0x7fc2c40ab170 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- 172.21.15.41:0/3389393807 >> 172.21.15.41:0/3389393807 conn(0x7fc2c40b5700 msgr2=0x7fc2c40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:24.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- 172.21.15.41:0/3389393807 shutdown_connections 2021-10-21T00:11:24.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- 172.21.15.41:0/3389393807 wait complete. 2021-10-21T00:11:24.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 Processor -- start 2021-10-21T00:11:24.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.106+0000 7fc2c359e700 1 -- start start 2021-10-21T00:11:24.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 0x7fc2c40adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40b2170 0x7fc2c40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4159ca0 con 0x7fc2c40abb50 2021-10-21T00:11:24.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4159f40 con 0x7fc2c40af620 2021-10-21T00:11:24.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415a1e0 con 0x7fc2c40b2170 2021-10-21T00:11:24.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36914/0 (socket says 172.21.15.41:36914) 2021-10-21T00:11:24.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 -- 172.21.15.41:0/633181285 learned_addr learned my addr 172.21.15.41:0/633181285 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:24.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c2d9d700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40b2170 0x7fc2c40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c1d9b700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 0x7fc2c40adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 -- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40b2170 msgr2=0x7fc2c40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40b2170 0x7fc2c40ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 -- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 msgr2=0x7fc2c40adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 0x7fc2c40adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 -- 172.21.15.41:0/633181285 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b800b180 con 0x7fc2c40abb50 2021-10-21T00:11:24.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c1d9b700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 0x7fc2c40adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:24.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c259c700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fc2b8002f70 tx=0x7fc2b8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b800dea0 con 0x7fc2c40abb50 2021-10-21T00:11:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8013e90 con 0x7fc2c40abb50 2021-10-21T00:11:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c414b7e0 con 0x7fc2c40abb50 2021-10-21T00:11:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b801e5f0 con 0x7fc2c40abb50 2021-10-21T00:11:24.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.110+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c415a680 con 0x7fc2c40abb50 2021-10-21T00:11:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c415a3a0 con 0x7fc2c40abb50 2021-10-21T00:11:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc2b8025030 con 0x7fc2c40abb50 2021-10-21T00:11:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2b37fe700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 0x7fc2a0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fc2b806c6a0 con 0x7fc2c40abb50 2021-10-21T00:11:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2c1d9b700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 0x7fc2a0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.114+0000 7fc2c1d9b700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 0x7fc2a0055b00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fc2b400b000 tx=0x7fc2b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.122+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2b8043840 con 0x7fc2c40abb50 2021-10-21T00:11:24.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fc2c40b12d0 con 0x7fc2c40abb50 2021-10-21T00:11:24.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2b37fe700 1 -- 172.21.15.41:0/633181285 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1937 (secure 0 0 0) 0x7fc2b8023020 con 0x7fc2c40abb50 2021-10-21T00:11:24.297 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:24.297 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:24.298 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:24.298 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:11:24.298 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761051340800, 2021-10-21T00:11:24.298 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6533378048, 2021-10-21T00:11:24.299 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6533980160, 2021-10-21T00:11:24.299 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085123833268880844, 2021-10-21T00:11:24.299 INFO:teuthology.orchestra.run.smithi041.stdout: "num_osds": 8, 2021-10-21T00:11:24.299 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_osds": 0, 2021-10-21T00:11:24.300 INFO:teuthology.orchestra.run.smithi041.stdout: "num_per_pool_omap_osds": 0 2021-10-21T00:11:24.300 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:24.300 INFO:teuthology.orchestra.run.smithi041.stdout: "stats_by_class": { 2021-10-21T00:11:24.300 INFO:teuthology.orchestra.run.smithi041.stdout: "ssd": { 2021-10-21T00:11:24.300 INFO:teuthology.orchestra.run.smithi041.stdout: "total_bytes": 767585320960, 2021-10-21T00:11:24.301 INFO:teuthology.orchestra.run.smithi041.stdout: "total_avail_bytes": 761051340800, 2021-10-21T00:11:24.301 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_bytes": 6533378048, 2021-10-21T00:11:24.301 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_bytes": 6533980160, 2021-10-21T00:11:24.301 INFO:teuthology.orchestra.run.smithi041.stdout: "total_used_raw_ratio": 0.0085123833268880844 2021-10-21T00:11:24.302 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.302 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:24.302 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:11:24.302 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:24.302 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "device_health_metrics", 2021-10-21T00:11:24.303 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 1, 2021-10-21T00:11:24.303 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:24.303 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:24.303 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 2, 2021-10-21T00:11:24.304 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:24.304 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:24.304 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:24.304 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361335750656 2021-10-21T00:11:24.304 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.305 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:24.305 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:24.305 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "rbd", 2021-10-21T00:11:24.305 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 2, 2021-10-21T00:11:24.305 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:24.306 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:24.306 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:11:24.306 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:24.306 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:24.307 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:24.307 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361335750656 2021-10-21T00:11:24.307 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.307 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:24.307 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:24.308 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "cephfs_data", 2021-10-21T00:11:24.308 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 22, 2021-10-21T00:11:24.308 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:24.308 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 0, 2021-10-21T00:11:24.309 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 0, 2021-10-21T00:11:24.309 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 0, 2021-10-21T00:11:24.309 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 0, 2021-10-21T00:11:24.309 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 0, 2021-10-21T00:11:24.310 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361335750656 2021-10-21T00:11:24.310 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.310 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:24.310 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:24.310 INFO:teuthology.orchestra.run.smithi041.stdout: "name": "cephfs_metadata", 2021-10-21T00:11:24.311 INFO:teuthology.orchestra.run.smithi041.stdout: "id": 23, 2021-10-21T00:11:24.311 INFO:teuthology.orchestra.run.smithi041.stdout: "stats": { 2021-10-21T00:11:24.311 INFO:teuthology.orchestra.run.smithi041.stdout: "stored": 617, 2021-10-21T00:11:24.311 INFO:teuthology.orchestra.run.smithi041.stdout: "objects": 1, 2021-10-21T00:11:24.311 INFO:teuthology.orchestra.run.smithi041.stdout: "kb_used": 1, 2021-10-21T00:11:24.312 INFO:teuthology.orchestra.run.smithi041.stdout: "bytes_used": 617, 2021-10-21T00:11:24.312 INFO:teuthology.orchestra.run.smithi041.stdout: "percent_used": 8.5377654945872905e-10, 2021-10-21T00:11:24.312 INFO:teuthology.orchestra.run.smithi041.stdout: "max_avail": 361335750656 2021-10-21T00:11:24.312 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.313 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:24.313 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:24.313 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:24.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 msgr2=0x7fc2a0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 0x7fc2a0055b00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fc2b400b000 tx=0x7fc2b4008040).stop 2021-10-21T00:11:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 msgr2=0x7fc2c414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fc2b8002f70 tx=0x7fc2b8014000).stop 2021-10-21T00:11:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 shutdown_connections 2021-10-21T00:11:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc2a0053640 0x7fc2a0055b00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc2c40b2170 0x7fc2c40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2c40af620 0x7fc2c40adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 --2- 172.21.15.41:0/633181285 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc2c40abb50 0x7fc2c414b2f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 >> 172.21.15.41:0/633181285 conn(0x7fc2c40b5700 msgr2=0x7fc2c4149190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 shutdown_connections 2021-10-21T00:11:24.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.290+0000 7fc2c359e700 1 -- 172.21.15.41:0/633181285 wait complete. 2021-10-21T00:11:24.318 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-10-21T00:11:24.319 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-10-21T00:11:24.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 Processor -- start 2021-10-21T00:11:24.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 -- start start 2021-10-21T00:11:24.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1be4097f40 0x7f1be40983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be413f560 con 0x7f1be40b0b40 2021-10-21T00:11:24.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be413cfd0 con 0x7f1be4097f40 2021-10-21T00:11:24.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be89ff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be413f790 con 0x7f1be40b1fd0 2021-10-21T00:11:24.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be2ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1be40b0b40 0x7f1be40a9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34694/0 (socket says 172.21.15.41:34694) 2021-10-21T00:11:24.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.422+0000 7f1be2ffd700 1 -- 172.21.15.41:0/1313291779 learned_addr learned my addr 172.21.15.41:0/1313291779 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:24.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be3fff700 1 --2- 172.21.15.41:0/1313291779 >> v2:172.21.15.62:3300/0 conn(0x7f1be4097f40 0x7f1be40983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1313291779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be27fc700 1 -- 172.21.15.41:0/1313291779 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761541528 0 0) 0x7f1be413f560 con 0x7f1be40b0b40 2021-10-21T00:11:24.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be27fc700 1 -- 172.21.15.41:0/1313291779 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd0003260 con 0x7f1be40b0b40 2021-10-21T00:11:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 -- 172.21.15.41:0/1313291779 >> v2:172.21.15.62:3300/0 conn(0x7f1be4097f40 msgr2=0x7f1be40983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1313291779 >> v2:172.21.15.62:3300/0 conn(0x7f1be4097f40 0x7f1be40983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 -- 172.21.15.41:0/1313291779 >> v1:172.21.15.41:6789/0 conn(0x7f1be40b0b40 legacy=0x7f1be40a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 -- 172.21.15.41:0/1313291779 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be413fa30 con 0x7f1be40b1fd0 2021-10-21T00:11:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1313291779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be413fed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f1bdc0032f0 tx=0x7f1bdc0091d0).ready entity=mon.2 client_cookie=30032d1280fc3365 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be27fc700 1 -- 172.21.15.41:0/1313291779 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bdc00b600 con 0x7f1be40b1fd0 2021-10-21T00:11:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be27fc700 1 -- 172.21.15.41:0/1313291779 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00b760 con 0x7f1be40b1fd0 2021-10-21T00:11:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be27fc700 1 -- 172.21.15.41:0/1313291779 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bdc00b8d0 con 0x7f1be40b1fd0 2021-10-21T00:11:24.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- 172.21.15.41:0/1313291779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 msgr2=0x7f1be413fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 --2- 172.21.15.41:0/1313291779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be413fed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f1bdc0032f0 tx=0x7f1bdc0091d0).stop 2021-10-21T00:11:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- 172.21.15.41:0/1313291779 shutdown_connections 2021-10-21T00:11:24.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 --2- 172.21.15.41:0/1313291779 >> v2:172.21.15.62:3300/0 conn(0x7f1be4097f40 0x7f1be40983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 --2- 172.21.15.41:0/1313291779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be413fed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- 172.21.15.41:0/1313291779 >> 172.21.15.41:0/1313291779 conn(0x7f1be40b5700 msgr2=0x7f1be40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- 172.21.15.41:0/1313291779 shutdown_connections 2021-10-21T00:11:24.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- 172.21.15.41:0/1313291779 wait complete. 2021-10-21T00:11:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 Processor -- start 2021-10-21T00:11:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.426+0000 7f1be89ff700 1 -- start start 2021-10-21T00:11:24.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1be4097f40 0x7f1be40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1be40b0b40 0x7f1be4066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be40671e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40ad8d0 con 0x7f1be40b0b40 2021-10-21T00:11:24.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40ae8c0 con 0x7f1be4097f40 2021-10-21T00:11:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be414e5d0 con 0x7f1be40b1fd0 2021-10-21T00:11:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1be40b0b40 0x7f1be4066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1be40b0b40 0x7f1be4066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36930/0 (socket says 172.21.15.41:36930) 2021-10-21T00:11:24.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 -- 172.21.15.41:0/1755223541 learned_addr learned my addr 172.21.15.41:0/1755223541 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:24.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1be4097f40 0x7f1be40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be3fff700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be40671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 -- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 msgr2=0x7f1be40671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be40671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 -- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1be4097f40 msgr2=0x7f1be40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1be4097f40 0x7f1be40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 -- 172.21.15.41:0/1755223541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009470 con 0x7f1be40b0b40 2021-10-21T00:11:24.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1be4097f40 0x7f1be40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:24.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be3fff700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1be40b1fd0 0x7f1be40671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:24.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be2ffd700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1be40b0b40 0x7f1be4066cf0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f1bd8001110 tx=0x7f1bd8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bd80072e0 con 0x7f1be40b0b40 2021-10-21T00:11:24.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd8007440 con 0x7f1be40b0b40 2021-10-21T00:11:24.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- 172.21.15.41:0/1755223541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be40aeaf0 con 0x7f1be40b0b40 2021-10-21T00:11:24.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bd8005800 con 0x7f1be40b0b40 2021-10-21T00:11:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- 172.21.15.41:0/1755223541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be405fa20 con 0x7f1be40b0b40 2021-10-21T00:11:24.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.430+0000 7f1be89ff700 1 -- 172.21.15.41:0/1755223541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be414e3f0 con 0x7f1be40b0b40 2021-10-21T00:11:24.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.434+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1bd801a060 con 0x7f1be40b0b40 2021-10-21T00:11:24.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.434+0000 7f1be0ff9700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1bc40535b0 0x7f1bc4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.434+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f1bd806b270 con 0x7f1be40b0b40 2021-10-21T00:11:24.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.434+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1bc40535b0 0x7f1bc4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.434+0000 7f1be37fe700 1 --2- 172.21.15.41:0/1755223541 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1bc40535b0 0x7f1bc4055a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f1bdc019000 tx=0x7f1bdc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.438+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1bd80422c0 con 0x7f1be40b0b40 2021-10-21T00:11:24.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.602+0000 7f1be89ff700 1 -- 172.21.15.41:0/1755223541 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1be40b1130 con 0x7f1be40b0b40 2021-10-21T00:11:24.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.606+0000 7f1be0ff9700 1 -- 172.21.15.41:0/1755223541 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v58) v1 ==== 209+0+0 (secure 0 0 0) 0x7f1bd8018020 con 0x7f1be40b0b40 2021-10-21T00:11:24.614 INFO:teuthology.orchestra.run.smithi041.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-10-21T00:11:24.618 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-10-21T00:11:24.619 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:11:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.714+0000 7f1d3c7e1700 1 Processor -- start 2021-10-21T00:11:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.714+0000 7f1d3c7e1700 1 -- start start 2021-10-21T00:11:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 0x7f1d3414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340b2f70 con 0x7f1d340b33b0 2021-10-21T00:11:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d34062fc0 con 0x7f1d340adea0 2021-10-21T00:11:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34148320 con 0x7f1d3405f850 2021-10-21T00:11:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3ad7e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 0x7f1d3414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:55434/0 (socket says 172.21.15.41:55434) 2021-10-21T00:11:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 -- 172.21.15.41:0/146320827 learned_addr learned my addr 172.21.15.41:0/146320827 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d39d7c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1d340b33b0 0x7f1d340b19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42764/0 (socket says 172.21.15.41:42764) 2021-10-21T00:11:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 -- 172.21.15.41:0/146320827 >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 msgr2=0x7f1d3414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 --2- 172.21.15.41:0/146320827 >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 0x7f1d3414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 -- 172.21.15.41:0/146320827 >> v1:172.21.15.62:6789/0 conn(0x7f1d340b33b0 legacy=0x7f1d340b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 -- 172.21.15.41:0/146320827 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34144ad0 con 0x7f1d3405f850 2021-10-21T00:11:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3ad7e700 1 --2- 172.21.15.41:0/146320827 >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 0x7f1d3414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3a57d700 1 --2- 172.21.15.41:0/146320827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1d2c0032f0 tx=0x7f1d2c009290).ready entity=mon.2 client_cookie=fdd1df9a441a88a7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3957b700 1 -- 172.21.15.41:0/146320827 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2c00b8a0 con 0x7f1d3405f850 2021-10-21T00:11:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3957b700 1 -- 172.21.15.41:0/146320827 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00ba00 con 0x7f1d3405f850 2021-10-21T00:11:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3957b700 1 -- 172.21.15.41:0/146320827 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2c00bb70 con 0x7f1d3405f850 2021-10-21T00:11:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/146320827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 msgr2=0x7f1d3414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/146320827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1d2c0032f0 tx=0x7f1d2c009290).stop 2021-10-21T00:11:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/146320827 shutdown_connections 2021-10-21T00:11:24.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/146320827 >> v2:172.21.15.62:3300/0 conn(0x7f1d340adea0 0x7f1d3414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/146320827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d3405f850 0x7f1d3414a670 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/146320827 >> 172.21.15.41:0/146320827 conn(0x7f1d340b7030 msgr2=0x7f1d340b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/146320827 shutdown_connections 2021-10-21T00:11:24.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.718+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/146320827 wait complete. 2021-10-21T00:11:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 Processor -- start 2021-10-21T00:11:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 -- start start 2021-10-21T00:11:24.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d3405f850 0x7f1d3409ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d340adea0 0x7f1d341564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34066e90 con 0x7f1d3414a630 2021-10-21T00:11:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34153f40 con 0x7f1d3405f850 2021-10-21T00:11:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3c7e1700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34156ca0 con 0x7f1d340adea0 2021-10-21T00:11:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36946/0 (socket says 172.21.15.41:36946) 2021-10-21T00:11:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 -- 172.21.15.41:0/4255773155 learned_addr learned my addr 172.21.15.41:0/4255773155 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d39d7c700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d340adea0 0x7f1d341564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3a57d700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d3405f850 0x7f1d3409ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 -- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d340adea0 msgr2=0x7f1d341564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d340adea0 0x7f1d341564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 -- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d3405f850 msgr2=0x7f1d3409ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d3405f850 0x7f1d3409ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 -- 172.21.15.41:0/4255773155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3000b180 con 0x7f1d3414a630 2021-10-21T00:11:24.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d3ad7e700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f1d34067810 tx=0x7f1d30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.722+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d30010590 con 0x7f1d3414a630 2021-10-21T00:11:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c009530 con 0x7f1d3414a630 2021-10-21T00:11:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d300106f0 con 0x7f1d3414a630 2021-10-21T00:11:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d30010a50 con 0x7f1d3414a630 2021-10-21T00:11:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d341569d0 con 0x7f1d3414a630 2021-10-21T00:11:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d340ac750 con 0x7f1d3414a630 2021-10-21T00:11:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d30010bb0 con 0x7f1d3414a630 2021-10-21T00:11:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d237fe700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 0x7f1d140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f1d3006bf10 con 0x7f1d3414a630 2021-10-21T00:11:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.726+0000 7f1d3a57d700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 0x7f1d140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.730+0000 7f1d3a57d700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 0x7f1d140559b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1d2c01b000 tx=0x7f1d2c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.734+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d30042fd0 con 0x7f1d3414a630 2021-10-21T00:11:24.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.898+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f1d340b7700 con 0x7f1d3414a630 2021-10-21T00:11:24.908 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:11:24.902+0000 7f808b04a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:11:24.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d237fe700 1 -- 172.21.15.41:0/4255773155 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v59) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1d300465f0 con 0x7f1d3414a630 2021-10-21T00:11:24.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 msgr2=0x7f1d140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 0x7f1d140559b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1d2c01b000 tx=0x7f1d2c016000).stop 2021-10-21T00:11:24.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 msgr2=0x7f1d3414aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:24.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f1d34067810 tx=0x7f1d30006df0).stop 2021-10-21T00:11:24.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 shutdown_connections 2021-10-21T00:11:24.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1d140534f0 0x7f1d140559b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1d3414a630 0x7f1d3414aae0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d340adea0 0x7f1d341564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 --2- 172.21.15.41:0/4255773155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d3405f850 0x7f1d3409ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:24.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 >> 172.21.15.41:0/4255773155 conn(0x7f1d340b7030 msgr2=0x7f1d340620c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:24.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 shutdown_connections 2021-10-21T00:11:24.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:24.910+0000 7f1d3c7e1700 1 -- 172.21.15.41:0/4255773155 wait complete. 2021-10-21T00:11:24.922 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 23 and data pool 22 2021-10-21T00:11:24.931 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:11:25.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.030+0000 7f3f3d1ed700 1 Processor -- start 2021-10-21T00:11:25.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3d1ed700 1 -- start start 2021-10-21T00:11:25.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3d1ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f38067a00 0x7f3f381468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3d1ed700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3805c3c0 con 0x7f3f3805c6b0 2021-10-21T00:11:25.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3d1ed700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380b27a0 con 0x7f3f3805bfe0 2021-10-21T00:11:25.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3d1ed700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f380b1920 con 0x7f3f38067a00 2021-10-21T00:11:25.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3c9ec700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3f3805c6b0 0x7f3f38141930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34724/0 (socket says 172.21.15.41:34724) 2021-10-21T00:11:25.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3c9ec700 1 -- 172.21.15.41:0/333370941 learned_addr learned my addr 172.21.15.41:0/333370941 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:25.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/333370941 >> v2:172.21.15.62:3300/0 conn(0x7f3f38067a00 0x7f3f381468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325948659 0 0) 0x7f3f3805c3c0 con 0x7f3f3805c6b0 2021-10-21T00:11:25.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f18003260 con 0x7f3f3805c6b0 2021-10-21T00:11:25.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 967202687 0 0) 0x7f3f18003260 con 0x7f3f3805c6b0 2021-10-21T00:11:25.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 >> v2:172.21.15.62:3300/0 conn(0x7f3f38067a00 msgr2=0x7f3f381468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:25.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 --2- 172.21.15.41:0/333370941 >> v2:172.21.15.62:3300/0 conn(0x7f3f38067a00 0x7f3f381468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 >> v1:172.21.15.62:6789/0 conn(0x7f3f3805bfe0 legacy=0x7f3f381461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380b2a40 con 0x7f3f3805c6b0 2021-10-21T00:11:25.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f3f300019e0 con 0x7f3f3805c6b0 2021-10-21T00:11:25.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 >> v1:172.21.15.41:6789/0 conn(0x7f3f3805c6b0 legacy=0x7f3f38141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f18003750 0x7f3f18003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f18004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f18004e70 0x7f3f1800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b1920 con 0x7f3f18003750 2021-10-21T00:11:25.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800bd20 con 0x7f3f18004500 2021-10-21T00:11:25.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1800bee0 con 0x7f3f18004e70 2021-10-21T00:11:25.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f37fff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f18003750 0x7f3f18003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f18004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.034+0000 7f3f3c9ec700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f18004e70 0x7f3f1800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 -- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f18004e70 msgr2=0x7f3f1800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:25.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f18004e70 0x7f3f1800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 -- 172.21.15.41:0/333370941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f18003750 msgr2=0x7f3f18003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:25.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f18003750 0x7f3f18003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 -- 172.21.15.41:0/333370941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18003260 con 0x7f3f18004500 2021-10-21T00:11:25.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3c9ec700 1 -- 172.21.15.41:0/333370941 reap_dead start 2021-10-21T00:11:25.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f37fff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f18003750 0x7f3f18003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:25.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f18004980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f3f2000c000 tx=0x7f3f20006df0).ready entity=mon.1 client_cookie=8e237714bc3246c4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:25.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2000e830 con 0x7f3f18004500 2021-10-21T00:11:25.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2000e990 con 0x7f3f18004500 2021-10-21T00:11:25.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f377fe700 1 -- 172.21.15.41:0/333370941 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2000ecf0 con 0x7f3f18004500 2021-10-21T00:11:25.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 msgr2=0x7f3f18004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f18004980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f3f2000c000 tx=0x7f3f20006df0).stop 2021-10-21T00:11:25.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/333370941 shutdown_connections 2021-10-21T00:11:25.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/333370941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f18004980 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/333370941 >> 172.21.15.41:0/333370941 conn(0x7f3f380637b0 msgr2=0x7f3f38063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:25.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/333370941 shutdown_connections 2021-10-21T00:11:25.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.038+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/333370941 wait complete. 2021-10-21T00:11:25.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 Processor -- start 2021-10-21T00:11:25.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- start start 2021-10-21T00:11:25.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f3813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38151d40 0x7f3f381521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380ae9f0 con 0x7f3f3813dc20 2021-10-21T00:11:25.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381553d0 con 0x7f3f18004500 2021-10-21T00:11:25.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38155670 con 0x7f3f38151d40 2021-10-21T00:11:25.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36964/0 (socket says 172.21.15.41:36964) 2021-10-21T00:11:25.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 -- 172.21.15.41:0/1564899669 learned_addr learned my addr 172.21.15.41:0/1564899669 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:25.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3c9ec700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38151d40 0x7f3f381521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f37fff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f3813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 -- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38151d40 msgr2=0x7f3f381521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38151d40 0x7f3f381521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 -- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 msgr2=0x7f3f3813cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f3813cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 -- 172.21.15.41:0/1564899669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38140690 con 0x7f3f3813dc20 2021-10-21T00:11:25.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f2ffff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f3f2000c000 tx=0x7f3f20019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:25.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f20012d20 con 0x7f3f3813dc20 2021-10-21T00:11:25.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f20000e90 con 0x7f3f3813dc20 2021-10-21T00:11:25.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f38156000 con 0x7f3f3813dc20 2021-10-21T00:11:25.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2001d600 con 0x7f3f3813dc20 2021-10-21T00:11:25.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.042+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3813e200 con 0x7f3f3813dc20 2021-10-21T00:11:25.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.046+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f380b11e0 con 0x7f3f3813dc20 2021-10-21T00:11:25.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.046+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3f2002d070 con 0x7f3f3813dc20 2021-10-21T00:11:25.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.046+0000 7f3f35ffb700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 0x7f3f1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:25.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.046+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3f2006d690 con 0x7f3f3813dc20 2021-10-21T00:11:25.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.046+0000 7f3f37fff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 0x7f3f1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:25.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.050+0000 7f3f37fff700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 0x7f3f1c055b60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f3f28009000 tx=0x7f3f28009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:25.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.054+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f20048150 con 0x7f3f3813dc20 2021-10-21T00:11:25.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.218+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3f38057350 con 0x7f3f3813dc20 2021-10-21T00:11:25.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.910+0000 7f3f35ffb700 1 -- 172.21.15.41:0/1564899669 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f20047d40 con 0x7f3f3813dc20 2021-10-21T00:11:25.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 msgr2=0x7f3f1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 0x7f3f1c055b60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f3f28009000 tx=0x7f3f28009040).stop 2021-10-21T00:11:25.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 msgr2=0x7f3f38155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:25.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f3f2000c000 tx=0x7f3f20019000).stop 2021-10-21T00:11:25.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 shutdown_connections 2021-10-21T00:11:25.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3f1c0536a0 0x7f3f1c055b60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38151d40 0x7f3f381521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3f3813dc20 0x7f3f38155b10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 --2- 172.21.15.41:0/1564899669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f18004500 0x7f3f3813cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:25.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 >> 172.21.15.41:0/1564899669 conn(0x7f3f380637b0 msgr2=0x7f3f380b63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:25.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 shutdown_connections 2021-10-21T00:11:25.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:25.914+0000 7f3f3d1ed700 1 -- 172.21.15.41:0/1564899669 wait complete. 2021-10-21T00:11:25.940 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:11:26.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 Processor -- start 2021-10-21T00:11:26.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 -- start start 2021-10-21T00:11:26.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7278143a40 0x7f72780b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 0x7f72781419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780ba050 con 0x7f72780b9c70 2021-10-21T00:11:26.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7278146360 con 0x7f7278143a40 2021-10-21T00:11:26.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.050+0000 7f727f42e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7278142bf0 con 0x7f72780b0660 2021-10-21T00:11:26.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7278143a40 0x7f72780b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f7278143a40 0x7f72780b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36970/0 (socket says 172.21.15.41:36970) 2021-10-21T00:11:26.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 -- 172.21.15.41:0/2772768379 learned_addr learned my addr 172.21.15.41:0/2772768379 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:26.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727d9cb700 1 --2- 172.21.15.41:0/2772768379 >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 0x7f72781419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 -- 172.21.15.41:0/2772768379 >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 msgr2=0x7f72781419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:26.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 --2- 172.21.15.41:0/2772768379 >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 0x7f72781419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 -- 172.21.15.41:0/2772768379 >> v1:172.21.15.62:6789/0 conn(0x7f72780b9c70 legacy=0x7f7278143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 -- 172.21.15.41:0/2772768379 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278142e90 con 0x7f7278143a40 2021-10-21T00:11:26.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727d9cb700 1 --2- 172.21.15.41:0/2772768379 >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 0x7f72781419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:26.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727c9c9700 1 --2- 172.21.15.41:0/2772768379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7278143a40 0x7f72780b3bc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f72780b5640 tx=0x7f7274006eb0).ready entity=mon.0 client_cookie=351a028a28d213a8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:26.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f7267fff700 1 -- 172.21.15.41:0/2772768379 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727400d610 con 0x7f7278143a40 2021-10-21T00:11:26.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f7267fff700 1 -- 172.21.15.41:0/2772768379 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274000e90 con 0x7f7278143a40 2021-10-21T00:11:26.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f7267fff700 1 -- 172.21.15.41:0/2772768379 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727400d960 con 0x7f7278143a40 2021-10-21T00:11:26.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- 172.21.15.41:0/2772768379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7278143a40 msgr2=0x7f72780b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 --2- 172.21.15.41:0/2772768379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7278143a40 0x7f72780b3bc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f72780b5640 tx=0x7f7274006eb0).stop 2021-10-21T00:11:26.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- 172.21.15.41:0/2772768379 shutdown_connections 2021-10-21T00:11:26.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 --2- 172.21.15.41:0/2772768379 >> v2:172.21.15.62:3300/0 conn(0x7f72780b0660 0x7f72781419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 --2- 172.21.15.41:0/2772768379 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7278143a40 0x7f72780b3bc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- 172.21.15.41:0/2772768379 >> 172.21.15.41:0/2772768379 conn(0x7f7278062f00 msgr2=0x7f72780b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:26.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- 172.21.15.41:0/2772768379 shutdown_connections 2021-10-21T00:11:26.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- 172.21.15.41:0/2772768379 wait complete. 2021-10-21T00:11:26.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 Processor -- start 2021-10-21T00:11:26.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.054+0000 7f727f42e700 1 -- start start 2021-10-21T00:11:26.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72780b0660 0x7f72780b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7278143a40 0x7f7278155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278113670 con 0x7f72780b9c70 2021-10-21T00:11:26.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278155ac0 con 0x7f72780b0660 2021-10-21T00:11:26.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72780ae710 con 0x7f7278143a40 2021-10-21T00:11:26.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36976/0 (socket says 172.21.15.41:36976) 2021-10-21T00:11:26.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 -- 172.21.15.41:0/208859428 learned_addr learned my addr 172.21.15.41:0/208859428 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:26.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727d1ca700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72780b0660 0x7f72780b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727d9cb700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7278143a40 0x7f7278155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 -- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7278143a40 msgr2=0x7f7278155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7278143a40 0x7f7278155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 -- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72780b0660 msgr2=0x7f72780b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72780b0660 0x7f72780b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 -- 172.21.15.41:0/208859428 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727400b1e0 con 0x7f72780b9c70 2021-10-21T00:11:26.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727c9c9700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f72780b5640 tx=0x7f7274015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:26.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727400d990 con 0x7f72780b9c70 2021-10-21T00:11:26.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727400bec0 con 0x7f72780b9c70 2021-10-21T00:11:26.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72780ad2d0 con 0x7f72780b9c70 2021-10-21T00:11:26.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7274002f50 con 0x7f72780b9c70 2021-10-21T00:11:26.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.058+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780ad070 con 0x7f72780b9c70 2021-10-21T00:11:26.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72780ad460 con 0x7f72780b9c70 2021-10-21T00:11:26.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7274025030 con 0x7f72780b9c70 2021-10-21T00:11:26.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f72667fc700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 0x7f7258055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:26.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f727406cea0 con 0x7f72780b9c70 2021-10-21T00:11:26.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f727d1ca700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 0x7f7258055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:26.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.062+0000 7f727d1ca700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 0x7f7258055a40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f726800b000 tx=0x7f7268009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:26.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.066+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7274043e20 con 0x7f72780b9c70 2021-10-21T00:11:26.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.194+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72781558d0 con 0x7f72780b9c70 2021-10-21T00:11:26.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.918+0000 7f72667fc700 1 -- 172.21.15.41:0/208859428 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7274023020 con 0x7f72780b9c70 2021-10-21T00:11:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 msgr2=0x7f7258055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 0x7f7258055a40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f726800b000 tx=0x7f7268009040).stop 2021-10-21T00:11:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 msgr2=0x7f72780ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:26.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f72780b5640 tx=0x7f7274015000).stop 2021-10-21T00:11:26.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 shutdown_connections 2021-10-21T00:11:26.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7258053580 0x7f7258055a40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7278143a40 0x7f7278155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f72780b9c70 0x7f72780ae220 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 --2- 172.21.15.41:0/208859428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72780b0660 0x7f72780b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 >> 172.21.15.41:0/208859428 conn(0x7f7278062f00 msgr2=0x7f72780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:26.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 shutdown_connections 2021-10-21T00:11:26.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:26.922+0000 7f727f42e700 1 -- 172.21.15.41:0/208859428 wait complete. 2021-10-21T00:11:26.936 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:11:26.944 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:11:27.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 Processor -- start 2021-10-21T00:11:27.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 -- start start 2021-10-21T00:11:27.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faed4060c60 0x7faed40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faed4143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40669e0 con 0x7faed41443c0 2021-10-21T00:11:27.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed4061040 con 0x7faed4060c60 2021-10-21T00:11:27.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faedaf14700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed4066c10 con 0x7faed40ac870 2021-10-21T00:11:27.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faed94b1700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7faed41443c0 0x7faed40af450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34756/0 (socket says 172.21.15.41:34756) 2021-10-21T00:11:27.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faed94b1700 1 -- 172.21.15.41:0/1396142558 learned_addr learned my addr 172.21.15.41:0/1396142558 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:27.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faed3fff700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faed4143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.046+0000 7faed8cb0700 1 --2- 172.21.15.41:0/1396142558 >> v2:172.21.15.62:3300/0 conn(0x7faed4060c60 0x7faed40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838229779 0 0) 0x7faed40669e0 con 0x7faed41443c0 2021-10-21T00:11:27.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec0003260 con 0x7faed41443c0 2021-10-21T00:11:27.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107355415 0 0) 0x7faec0003260 con 0x7faed41443c0 2021-10-21T00:11:27.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 msgr2=0x7faed4143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:27.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faed4143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 >> v2:172.21.15.62:3300/0 conn(0x7faed4060c60 msgr2=0x7faed40b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:27.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 --2- 172.21.15.41:0/1396142558 >> v2:172.21.15.62:3300/0 conn(0x7faed4060c60 0x7faed40b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4066eb0 con 0x7faed41443c0 2021-10-21T00:11:27.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7faecc0019e0 con 0x7faed41443c0 2021-10-21T00:11:27.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 >> v1:172.21.15.41:6789/0 conn(0x7faed41443c0 legacy=0x7faed40af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faec00037d0 0x7faec0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faec0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faec00049f0 0x7faec0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed4061040 con 0x7faec00037d0 2021-10-21T00:11:27.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed4066c10 con 0x7faec00049f0 2021-10-21T00:11:27.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec000b750 con 0x7faed40ac870 2021-10-21T00:11:27.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faec00037d0 0x7faec0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed3fff700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faec0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed94b1700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faec00049f0 0x7faec0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 -- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 msgr2=0x7faec0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:27.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40ac870 0x7faec0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 -- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faec00049f0 msgr2=0x7faec0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:27.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faec00049f0 0x7faec0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 -- 172.21.15.41:0/1396142558 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0003260 con 0x7faec00037d0 2021-10-21T00:11:27.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed8cb0700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faec00037d0 0x7faec0003bf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7faec400c000 tx=0x7faec4006df0).ready entity=mon.0 client_cookie=36e9fc7f9bd8f6fb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:27.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec400e830 con 0x7faec00037d0 2021-10-21T00:11:27.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400e990 con 0x7faec00037d0 2021-10-21T00:11:27.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed37fe700 1 -- 172.21.15.41:0/1396142558 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec400ecf0 con 0x7faec00037d0 2021-10-21T00:11:27.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 -- 172.21.15.41:0/1396142558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faec00037d0 msgr2=0x7faec0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 --2- 172.21.15.41:0/1396142558 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faec00037d0 0x7faec0003bf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7faec400c000 tx=0x7faec4006df0).stop 2021-10-21T00:11:27.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faed94b1700 1 -- 172.21.15.41:0/1396142558 reap_dead start 2021-10-21T00:11:27.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 -- 172.21.15.41:0/1396142558 shutdown_connections 2021-10-21T00:11:27.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 -- 172.21.15.41:0/1396142558 >> 172.21.15.41:0/1396142558 conn(0x7faed4063b70 msgr2=0x7faed4060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:27.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 -- 172.21.15.41:0/1396142558 shutdown_connections 2021-10-21T00:11:27.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.050+0000 7faedaf14700 1 -- 172.21.15.41:0/1396142558 wait complete. 2021-10-21T00:11:27.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 Processor -- start 2021-10-21T00:11:27.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 -- start start 2021-10-21T00:11:27.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed409fa90 0x7faed4153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40a2530 0x7faed40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed413d970 con 0x7faed40b4b00 2021-10-21T00:11:27.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40a1620 con 0x7faed409fa90 2021-10-21T00:11:27.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faedaf14700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40a2100 con 0x7faed40a2530 2021-10-21T00:11:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.054+0000 7faed8cb0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:36994/0 (socket says 172.21.15.41:36994) 2021-10-21T00:11:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 -- 172.21.15.41:0/2219871101 learned_addr learned my addr 172.21.15.41:0/2219871101 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed3fff700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed409fa90 0x7faed4153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed94b1700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40a2530 0x7faed40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 -- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40a2530 msgr2=0x7faed40a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40a2530 0x7faed40a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 -- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed409fa90 msgr2=0x7faed4153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed409fa90 0x7faed4153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 -- 172.21.15.41:0/2219871101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40a2ed0 con 0x7faed40b4b00 2021-10-21T00:11:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed8cb0700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7faec400c000 tx=0x7faec4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec401cc70 con 0x7faed40b4b00 2021-10-21T00:11:27.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4000e90 con 0x7faed40b4b00 2021-10-21T00:11:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40b4ee0 con 0x7faed40b4b00 2021-10-21T00:11:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec400be60 con 0x7faed40b4b00 2021-10-21T00:11:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed409efb0 con 0x7faed40b4b00 2021-10-21T00:11:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40a2240 con 0x7faed40b4b00 2021-10-21T00:11:27.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faec402d450 con 0x7faed40b4b00 2021-10-21T00:11:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 0x7faeb4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5721+0+0 (secure 0 0 0) 0x7faec406cbe0 con 0x7faed40b4b00 2021-10-21T00:11:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.058+0000 7faed3fff700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 0x7faeb4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:27.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.062+0000 7faed3fff700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 0x7faeb4055ad0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7faec800b000 tx=0x7faec8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:27.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.066+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faec4043e40 con 0x7faed40b4b00 2021-10-21T00:11:27.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.190+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7faed40b0b50 con 0x7faed40b4b00 2021-10-21T00:11:27.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.922+0000 7faed1ffb700 1 -- 172.21.15.41:0/2219871101 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v117) v1 ==== 133+0+0 (secure 0 0 0) 0x7faec4006980 con 0x7faed40b4b00 2021-10-21T00:11:27.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 msgr2=0x7faeb4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 0x7faeb4055ad0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7faec800b000 tx=0x7faec8006df0).stop 2021-10-21T00:11:27.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 msgr2=0x7faed409e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:27.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7faec400c000 tx=0x7faec4019000).stop 2021-10-21T00:11:27.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 shutdown_connections 2021-10-21T00:11:27.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faeb4053610 0x7faeb4055ad0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faed40a2530 0x7faed40a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faed409fa90 0x7faed4153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 --2- 172.21.15.41:0/2219871101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faed40b4b00 0x7faed409e670 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:27.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 >> 172.21.15.41:0/2219871101 conn(0x7faed4063b70 msgr2=0x7faed40b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:27.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 shutdown_connections 2021-10-21T00:11:27.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:27.926+0000 7faedaf14700 1 -- 172.21.15.41:0/2219871101 wait complete. 2021-10-21T00:11:27.936 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:11:27.948 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-10-21T00:11:28.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 Processor -- start 2021-10-21T00:11:28.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 -- start start 2021-10-21T00:11:28.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdcc4062330 0x7fdcc40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc405bd40 con 0x7fdcc40b3a20 2021-10-21T00:11:28.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc405bf70 con 0x7fdcc4062330 2021-10-21T00:11:28.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4142cb0 con 0x7fdcc4062f70 2021-10-21T00:11:28.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:55504/0 (socket says 172.21.15.41:55504) 2021-10-21T00:11:28.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc2d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdcc40b3a20 0x7fdcc413c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42828/0 (socket says 172.21.15.41:42828) 2021-10-21T00:11:28.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 -- 172.21.15.41:0/4238162724 learned_addr learned my addr 172.21.15.41:0/4238162724 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:28.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc259c700 1 --2- 172.21.15.41:0/4238162724 >> v2:172.21.15.62:3300/0 conn(0x7fdcc4062330 0x7fdcc40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 -- 172.21.15.41:0/4238162724 >> v2:172.21.15.62:3300/0 conn(0x7fdcc4062330 msgr2=0x7fdcc40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:28.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 --2- 172.21.15.41:0/4238162724 >> v2:172.21.15.62:3300/0 conn(0x7fdcc4062330 0x7fdcc40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc159a700 1 -- 172.21.15.41:0/4238162724 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127231609 0 0) 0x7fdcc405bd40 con 0x7fdcc40b3a20 2021-10-21T00:11:28.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 -- 172.21.15.41:0/4238162724 >> v1:172.21.15.62:6789/0 conn(0x7fdcc40b3a20 legacy=0x7fdcc413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 -- 172.21.15.41:0/4238162724 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4142950 con 0x7fdcc4062f70 2021-10-21T00:11:28.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc1d9b700 1 --2- 172.21.15.41:0/4238162724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdcac002f70 tx=0x7fdcac006eb0).ready entity=mon.2 client_cookie=a05366e905c935f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc159a700 1 -- 172.21.15.41:0/4238162724 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac00d570 con 0x7fdcc4062f70 2021-10-21T00:11:28.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc159a700 1 -- 172.21.15.41:0/4238162724 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac000e90 con 0x7fdcc4062f70 2021-10-21T00:11:28.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.058+0000 7fdcc159a700 1 -- 172.21.15.41:0/4238162724 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac00d8c0 con 0x7fdcc4062f70 2021-10-21T00:11:28.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- 172.21.15.41:0/4238162724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 msgr2=0x7fdcc405c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- 172.21.15.41:0/4238162724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdcac002f70 tx=0x7fdcac006eb0).stop 2021-10-21T00:11:28.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- 172.21.15.41:0/4238162724 shutdown_connections 2021-10-21T00:11:28.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- 172.21.15.41:0/4238162724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062f70 0x7fdcc405c410 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- 172.21.15.41:0/4238162724 >> v2:172.21.15.62:3300/0 conn(0x7fdcc4062330 0x7fdcc40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- 172.21.15.41:0/4238162724 >> 172.21.15.41:0/4238162724 conn(0x7fdcc40b9080 msgr2=0x7fdcc40b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:28.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- 172.21.15.41:0/4238162724 shutdown_connections 2021-10-21T00:11:28.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- 172.21.15.41:0/4238162724 wait complete. 2021-10-21T00:11:28.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 Processor -- start 2021-10-21T00:11:28.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- start start 2021-10-21T00:11:28.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062330 0x7fdcc413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdcc4062f70 0x7fdcc41455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40aef40 con 0x7fdcc4062f70 2021-10-21T00:11:28.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40ad540 con 0x7fdcc40b3a20 2021-10-21T00:11:28.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.062+0000 7fdcc359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40ad7e0 con 0x7fdcc4062330 2021-10-21T00:11:28.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc1d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdcc4062f70 0x7fdcc41455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc259c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062330 0x7fdcc413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48930/0 (socket says 172.21.15.41:48930) 2021-10-21T00:11:28.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 -- 172.21.15.41:0/1155683590 learned_addr learned my addr 172.21.15.41:0/1155683590 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:28.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 -- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062330 msgr2=0x7fdcc413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062330 0x7fdcc413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 -- 172.21.15.41:0/1155683590 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdcc4062f70 msgr2=0x7fdcc41455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdcc4062f70 0x7fdcc41455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 -- 172.21.15.41:0/1155683590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac00b1e0 con 0x7fdcc40b3a20 2021-10-21T00:11:28.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc2d9d700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fdcb4000f40 tx=0x7fdcb4007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcb4005ae0 con 0x7fdcc40b3a20 2021-10-21T00:11:28.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4005c40 con 0x7fdcc40b3a20 2021-10-21T00:11:28.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40ada80 con 0x7fdcc40b3a20 2021-10-21T00:11:28.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcb40070d0 con 0x7fdcc40b3a20 2021-10-21T00:11:28.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40ac9f0 con 0x7fdcc40b3a20 2021-10-21T00:11:28.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4057350 con 0x7fdcc40b3a20 2021-10-21T00:11:28.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.066+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdcb401a060 con 0x7fdcc40b3a20 2021-10-21T00:11:28.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.070+0000 7fdcbb7fe700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 0x7fdc9c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.070+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fdcb406b390 con 0x7fdcc40b3a20 2021-10-21T00:11:28.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.070+0000 7fdcc259c700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 0x7fdc9c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.070+0000 7fdcc259c700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 0x7fdc9c055ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fdcbc00b000 tx=0x7fdcbc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.078+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdcb40424f0 con 0x7fdcc40b3a20 2021-10-21T00:11:28.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.246+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdcc40b1490 con 0x7fdcc40b3a20 2021-10-21T00:11:28.256 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:11:28.250+0000 7f808b04a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:11:28.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.262+0000 7fdcbb7fe700 1 -- 172.21.15.41:0/1155683590 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdcb4018020 con 0x7fdcc40b3a20 2021-10-21T00:11:28.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.262+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 msgr2=0x7fdc9c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.262+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 0x7fdc9c055ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fdcbc00b000 tx=0x7fdcbc006df0).stop 2021-10-21T00:11:28.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.262+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 msgr2=0x7fdcc40ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.262+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fdcb4000f40 tx=0x7fdcb4007f90).stop 2021-10-21T00:11:28.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 shutdown_connections 2021-10-21T00:11:28.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc9c053610 0x7fdc9c055ad0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdcc40b3a20 0x7fdcc40ae4e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdcc4062f70 0x7fdcc41455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 --2- 172.21.15.41:0/1155683590 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdcc4062330 0x7fdcc413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 >> 172.21.15.41:0/1155683590 conn(0x7fdcc40b9080 msgr2=0x7fdcc4142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:28.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 shutdown_connections 2021-10-21T00:11:28.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.266+0000 7fdcc359e700 1 -- 172.21.15.41:0/1155683590 wait complete. 2021-10-21T00:11:28.276 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 24 and data pool 22 2021-10-21T00:11:28.282 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:11:28.283 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:28.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:28.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:28.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:28.364 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:28.386 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:11:28.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:28.388 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:28.388 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:11:28.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.399 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:28.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:28.400 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:28.407 INFO:teuthology.orchestra.run.smithi071.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:11:28.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:28.410 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:28.410 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:28.418 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:11:28.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.420 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:28.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:28.421 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:28.428 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:11:28.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:28.430 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:28.430 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:11:28.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.441 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:11:28.441 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:11:28.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:28.442 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:11:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:11:28.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:28.450 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:11:28.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 Processor -- start 2021-10-21T00:11:28.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- start start 2021-10-21T00:11:28.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 0x7fdc3814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc3814b350 0x7fdc380af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc380609d0 con 0x7fdc380aa750 2021-10-21T00:11:28.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc380b1620 con 0x7fdc3814b350 2021-10-21T00:11:28.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3805fdd0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc3814b350 0x7fdc380af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc36ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 0x7fdc3814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdc3814b350 0x7fdc380af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37020/0 (socket says 172.21.15.41:37020) 2021-10-21T00:11:28.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc2e7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdc380aa750 0x7fdc3814ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42844/0 (socket says 172.21.15.41:42844) 2021-10-21T00:11:28.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc36ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 0x7fdc3814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:48934/0 (socket says 172.21.15.41:48934) 2021-10-21T00:11:28.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 -- 172.21.15.41:0/2444069485 learned_addr learned my addr 172.21.15.41:0/2444069485 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:28.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 -- 172.21.15.41:0/2444069485 >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 msgr2=0x7fdc3814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:28.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 --2- 172.21.15.41:0/2444069485 >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 0x7fdc3814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 -- 172.21.15.41:0/2444069485 >> v1:172.21.15.62:6789/0 conn(0x7fdc380aa750 legacy=0x7fdc3814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 -- 172.21.15.41:0/2444069485 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380b1380 con 0x7fdc3814b350 2021-10-21T00:11:28.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc377fe700 1 --2- 172.21.15.41:0/2444069485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3814b350 0x7fdc380af7c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fdc300032f0 tx=0x7fdc30009290).ready entity=mon.0 client_cookie=a59e6990efd26dfd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc367fc700 1 -- 172.21.15.41:0/2444069485 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3000b870 con 0x7fdc3814b350 2021-10-21T00:11:28.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc367fc700 1 -- 172.21.15.41:0/2444069485 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000b9d0 con 0x7fdc3814b350 2021-10-21T00:11:28.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc367fc700 1 -- 172.21.15.41:0/2444069485 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3000bb40 con 0x7fdc3814b350 2021-10-21T00:11:28.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- 172.21.15.41:0/2444069485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3814b350 msgr2=0x7fdc380af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2444069485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3814b350 0x7fdc380af7c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fdc300032f0 tx=0x7fdc30009290).stop 2021-10-21T00:11:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- 172.21.15.41:0/2444069485 shutdown_connections 2021-10-21T00:11:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2444069485 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3814b350 0x7fdc380af7c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2444069485 >> v2:172.21.15.62:3300/0 conn(0x7fdc3805f9f0 0x7fdc3814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- 172.21.15.41:0/2444069485 >> 172.21.15.41:0/2444069485 conn(0x7fdc3805bca0 msgr2=0x7fdc3805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.558+0000 7fdc3d495700 1 -- 172.21.15.41:0/2444069485 shutdown_connections 2021-10-21T00:11:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 -- 172.21.15.41:0/2444069485 wait complete. 2021-10-21T00:11:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 Processor -- start 2021-10-21T00:11:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 -- start start 2021-10-21T00:11:28.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc380aa750 0x7fdc38156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3814b350 0x7fdc38063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38148fe0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38156220 con 0x7fdc3814b350 2021-10-21T00:11:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc3d495700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38156410 con 0x7fdc380aa750 2021-10-21T00:11:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37022/0 (socket says 172.21.15.41:37022) 2021-10-21T00:11:28.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 -- 172.21.15.41:0/2462824447 learned_addr learned my addr 172.21.15.41:0/2462824447 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:28.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc2e7fc700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc380aa750 0x7fdc38156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc377fe700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3814b350 0x7fdc38063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 -- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc380aa750 msgr2=0x7fdc38156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc380aa750 0x7fdc38156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 -- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3814b350 msgr2=0x7fdc38063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:28.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3814b350 0x7fdc38063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:28.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 -- 172.21.15.41:0/2462824447 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30009530 con 0x7fdc3805f9f0 2021-10-21T00:11:28.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.562+0000 7fdc36ffd700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fdc2800c000 tx=0x7fdc28006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc28010780 con 0x7fdc3805f9f0 2021-10-21T00:11:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc280108e0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc381566b0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc28010c40 con 0x7fdc3805f9f0 2021-10-21T00:11:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc380af010 con 0x7fdc3805f9f0 2021-10-21T00:11:28.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc380678f0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc2801c460 con 0x7fdc3805f9f0 2021-10-21T00:11:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdc2806bde0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc2e7fc700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.566+0000 7fdc2e7fc700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 0x7fdc1c055ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fdc2000d000 tx=0x7fdc20007b40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:28.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.574+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc28042df0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.702+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdc380686c0 con 0x7fdc3805f9f0 2021-10-21T00:11:28.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc34ff9700 1 -- 172.21.15.41:0/2462824447 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+33824 (secure 0 0 0) 0x7fdc28046410 con 0x7fdc3805f9f0 2021-10-21T00:11:28.712 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:28.713 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:28.713 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 118, 2021-10-21T00:11:28.713 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:11:28.713 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:11:28.714 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:11:28.251938+0000", 2021-10-21T00:11:28.714 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:28.714 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:28.714 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:11:28.715 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:11:28.715 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:11:28.715 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:11:28.715 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:11:28.716 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:11:28.716 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:11:28.716 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:28.717 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:11:28.717 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:11:28.717 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:11:28.718 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:11:28.718 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:11:28.718 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 24, 2021-10-21T00:11:28.719 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:11:28.719 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:11:28.719 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:11:28.719 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:11:28.720 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:11:28.720 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.720 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:11:28.720 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:11:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:11:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:28.721 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:28.722 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:28.722 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:28.722 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:28.722 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:28.723 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:11:28.723 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:11:28.723 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:11:28.724 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:11:28.724 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:11:28.724 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:28.724 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:28.725 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:28.725 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:28.725 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:28.725 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:28.726 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:28.726 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.726 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:11:28.726 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:28.727 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:28.727 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:28.727 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:28.727 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:28.728 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:28.728 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:28.728 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:28.729 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:28.729 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:28.729 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:28.729 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:28.730 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:28.730 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:28.730 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:28.730 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:28.730 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:28.731 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:28.731 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:28.731 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:28.731 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:28.732 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:28.732 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:28.732 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:28.732 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:28.733 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:28.733 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.733 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:28.733 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:28.733 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:28.734 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:28.734 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:28.734 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:28.734 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:28.735 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:28.735 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:28.735 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:28.735 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:28.735 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:11:28.736 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:11:28.736 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.736 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:28.737 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:11:28.737 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.737 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.737 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.738 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:11:28.738 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:11:28.738 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:11:28.738 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:28.739 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:28.739 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:28.739 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:28.741 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:28.741 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:28.742 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:28.743 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:28.743 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:28.743 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:28.743 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:28.745 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:28.747 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:28.747 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:28.748 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:28.748 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:28.748 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:28.749 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:28.749 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:28.749 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:28.749 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:11:28.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:28.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:28.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:28.751 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:28.751 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:28.753 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:28.754 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:28.755 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:28.755 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:28.755 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:28.756 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:28.756 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:28.756 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:28.756 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:28.756 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:28.757 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:28.757 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:28.757 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:28.757 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:28.758 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:28.758 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:28.758 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:28.758 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:28.759 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:28.759 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:28.760 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:28.760 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.760 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:28.760 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:28.760 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:28.761 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:28.761 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:28.761 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:28.761 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:28.762 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:28.762 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:28.762 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:28.762 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:28.763 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:11:28.763 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:28.763 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:11:28.763 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.764 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.764 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.764 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 22, 2021-10-21T00:11:28.764 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:11:28.764 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:11:03.230021+0000", 2021-10-21T00:11:28.765 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:28.765 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:28.765 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:28.765 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:28.766 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:28.766 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:28.766 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:28.766 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:28.767 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:28.767 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:28.767 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:28.767 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:28.768 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:28.768 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:28.768 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:28.768 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:28.768 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:28.769 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:28.769 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:28.769 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:28.769 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.770 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "118", 2021-10-21T00:11:28.770 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:28.770 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:28.770 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:28.771 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:28.771 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:28.771 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:28.771 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:28.771 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:28.772 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:28.772 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:28.772 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:28.772 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:28.773 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:28.773 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:28.773 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:28.773 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:28.774 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:28.774 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:28.774 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:28.774 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:28.774 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:28.775 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:28.775 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:28.775 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:28.775 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:28.776 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:28.776 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.776 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:28.776 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:28.777 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:28.777 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:28.777 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:28.777 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:28.777 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:28.778 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:28.778 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:28.778 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:28.778 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:28.779 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:11:28.779 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:28.779 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:11:28.779 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:11:28.780 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.780 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.780 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.780 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.780 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 24, 2021-10-21T00:11:28.781 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:11:28.781 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:11:27.247005+0000", 2021-10-21T00:11:28.781 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 32769, 2021-10-21T00:11:28.782 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool,creating", 2021-10-21T00:11:28.782 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:28.782 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:28.782 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:28.782 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:28.783 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:28.783 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:28.783 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:28.783 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:28.784 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:28.784 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:28.784 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:28.784 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:28.785 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:28.785 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:28.785 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:28.785 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:28.785 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:28.786 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:28.786 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.786 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "118", 2021-10-21T00:11:28.786 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:28.787 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:28.787 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:28.787 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:28.787 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:28.788 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:28.788 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:28.788 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:28.788 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:28.788 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:28.789 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:28.790 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:28.790 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:28.791 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:28.791 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:28.791 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:28.791 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:28.791 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:28.792 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:28.792 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:28.792 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:28.792 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:28.793 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:28.793 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:28.793 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:28.793 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:28.794 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.794 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:28.794 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:28.794 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:28.795 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:28.795 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:28.795 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:28.795 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:28.795 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:28.796 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:28.796 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:28.796 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:28.796 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:11:28.797 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:11:28.797 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:11:28.797 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:11:28.797 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.798 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:28.798 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:11:28.798 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:11:28.798 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.798 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.799 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.799 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:28.799 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:11:28.799 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.800 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:28.800 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:11:28.800 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.800 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.801 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.801 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.801 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.801 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.801 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.802 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:28.802 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.803 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.803 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.803 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.803 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.803 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.804 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:11:28.804 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.804 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.804 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.805 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.805 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:11:28.805 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.805 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.806 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.806 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.806 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.806 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.806 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.807 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.807 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:11:28.807 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.807 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.808 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.808 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.808 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:11:28.808 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.809 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.809 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.809 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.809 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.809 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.810 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.810 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.810 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:11:28.810 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.811 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.811 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.811 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.811 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:11:28.812 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.812 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.812 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.812 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.813 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.813 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.813 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.813 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.814 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:11:28.814 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.814 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.814 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.815 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.815 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:11:28.815 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:28.815 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.816 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.816 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.816 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:11:28.816 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:11:28.816 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:11:28.817 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:11:28.817 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.817 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.817 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.818 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.818 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.818 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.818 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:28.819 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:11:28.819 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.819 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.819 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.819 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.820 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.820 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.820 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.820 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:28.821 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.821 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.821 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.822 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.822 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.822 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.822 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:11:28.823 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.823 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.823 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.823 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.824 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:11:28.824 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.824 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.824 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.824 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.825 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.825 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.825 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.825 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.826 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:11:28.826 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.826 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.826 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.827 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.827 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:11:28.827 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.827 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.827 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.828 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.828 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.828 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.828 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.829 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.829 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:11:28.829 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.829 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.830 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.830 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.830 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:11:28.830 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.831 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.831 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.831 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.831 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.832 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.832 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.832 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.832 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:11:28.832 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.833 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.833 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.833 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.833 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:11:28.834 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:28.834 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.834 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.834 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.834 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:11:28.835 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:11:28.835 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:11:28.835 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:11:28.835 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.836 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.836 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.836 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.836 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.837 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.837 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:28.837 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:11:28.837 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.837 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.838 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.838 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.838 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.838 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.839 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.839 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 112, 2021-10-21T00:11:28.839 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.840 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.840 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.840 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.840 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.840 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.841 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:11:28.841 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.841 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.841 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.842 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.842 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:11:28.842 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.842 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.843 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.843 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.843 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.843 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.844 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.844 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.844 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:11:28.844 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.844 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.845 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.845 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.845 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:11:28.845 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.846 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.846 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.846 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.846 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.847 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.847 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.847 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.847 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:11:28.847 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.848 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.848 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.848 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.848 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:11:28.849 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.849 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.849 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.849 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.850 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.850 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.850 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.850 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.850 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:11:28.851 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.851 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.851 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.851 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.852 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:11:28.852 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:28.852 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.852 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.853 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.853 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:11:28.853 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:11:28.853 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:11:28.854 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:11:28.854 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.854 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.854 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.855 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.855 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.855 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.855 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:28.856 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:11:28.856 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.856 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.856 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.857 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.857 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.857 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.858 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.858 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:28.858 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.858 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.859 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.859 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.859 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.859 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.860 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:11:28.860 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.860 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.860 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.860 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.861 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:11:28.861 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.861 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.861 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.862 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.862 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.862 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.862 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.862 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.863 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:11:28.863 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.863 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.863 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.864 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.864 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:11:28.864 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.864 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.865 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.865 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.865 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.865 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.865 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.866 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.866 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:11:28.867 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.867 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.867 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.867 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.868 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:11:28.868 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.868 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.868 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.869 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.869 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.869 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.869 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.869 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.870 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:11:28.870 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.870 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.870 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.871 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.871 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:11:28.871 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:28.871 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.872 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.872 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.872 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:11:28.872 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:11:28.872 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:11:28.873 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:11:28.873 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.873 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.873 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.873 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.874 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.874 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.874 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:28.874 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:11:28.875 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.875 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.875 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.875 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.876 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.876 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.876 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.876 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 112, 2021-10-21T00:11:28.876 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.877 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.877 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.877 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.878 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.878 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.878 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:11:28.878 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.879 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.879 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.879 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.879 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:11:28.879 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.880 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.880 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.880 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.880 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.881 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.881 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.881 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.881 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:11:28.881 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.882 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.882 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.882 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.882 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:11:28.883 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.883 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.883 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.883 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.883 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.884 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.884 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.884 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.884 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:11:28.885 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.885 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.885 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.885 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.885 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:11:28.886 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.886 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.886 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.886 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.887 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.887 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.887 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.887 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.887 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:11:28.888 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.888 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.888 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.888 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.889 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:11:28.889 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:28.889 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.889 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.889 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.890 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:11:28.890 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:11:28.890 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:11:28.890 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:11:28.891 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.891 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.891 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.891 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.892 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.892 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.892 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:28.892 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:11:28.892 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.893 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.893 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.893 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.893 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.894 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.894 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.894 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:28.894 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.894 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.895 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.895 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.895 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.895 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.896 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:11:28.896 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.896 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.896 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.896 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.897 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:11:28.897 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.897 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.897 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.897 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.898 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.898 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.898 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.898 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.899 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:11:28.899 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.899 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.899 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.899 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.900 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:11:28.900 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.900 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.900 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.901 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.901 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.901 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.901 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.901 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.902 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:11:28.902 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.902 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.902 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.903 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.903 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:11:28.903 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.903 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.904 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.904 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.904 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.904 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.904 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.905 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.905 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:11:28.905 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.905 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.905 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.906 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.906 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:11:28.906 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:28.906 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.907 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.907 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.907 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:11:28.907 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:11:28.907 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:11:28.908 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:11:28.908 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.908 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.908 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.909 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.909 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.909 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.909 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:28.909 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:11:28.910 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.910 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.910 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.910 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.911 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.911 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.911 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.911 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:28.911 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.912 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.912 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.912 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.912 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.912 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.913 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:11:28.913 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.913 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.914 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.914 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.914 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:11:28.914 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.915 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.915 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.915 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.915 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.916 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.916 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.917 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.917 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:11:28.918 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.918 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.919 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.919 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.919 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:11:28.920 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.920 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.921 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.921 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.921 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.921 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.922 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.922 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.923 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:11:28.923 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.923 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.924 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.924 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.925 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:11:28.925 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.925 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.926 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.926 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.927 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.928 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.928 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.928 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.929 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:11:28.929 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.929 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.930 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.932 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.933 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:11:28.934 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:28.934 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.934 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.935 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.935 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:11:28.936 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:11:28.936 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:11:28.936 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:11:28.937 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.937 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.938 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.938 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.939 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.939 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.939 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:28.940 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:11:28.940 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:28.941 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:28.941 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:28.942 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:28.942 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:28.942 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:28.943 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:28.943 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 105, 2021-10-21T00:11:28.944 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:28.944 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:28.944 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:28.945 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.945 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.946 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.946 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:11:28.949 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.949 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.950 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.950 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.951 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:11:28.951 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.952 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.952 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.952 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.953 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:28.953 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.954 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.954 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.954 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:11:28.955 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.955 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.956 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.956 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.957 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:11:28.957 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.957 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.958 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.958 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.959 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:28.959 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.959 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.960 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.960 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:11:28.961 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.961 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.962 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.962 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.963 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:11:28.963 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.963 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.964 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.964 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.965 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:28.965 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:28.965 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.965 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:28.965 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:11:28.966 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.966 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.966 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.966 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:28.967 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:11:28.967 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:28.967 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.968 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.968 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.968 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:11:28.968 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:11:28.968 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:11:28.969 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:11:28.969 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:28.969 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:28.969 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:28.970 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:28.970 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.970 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:28.970 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:11:28.970 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.971 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:28.975 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.975 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.975 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.975 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.976 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.976 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:11:28.976 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.976 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.977 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.977 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:28.977 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.977 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.977 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.978 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.978 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.978 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:11:28.979 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.979 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.979 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.979 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:28.979 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.980 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.980 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.980 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.980 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.981 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:11:28.981 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.981 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.981 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.981 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:28.982 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.982 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.982 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.982 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.983 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.983 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:11:28.983 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.983 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.983 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.984 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:28.984 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.984 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.984 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.985 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.985 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.985 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:11:28.985 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.985 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.986 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.986 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:28.986 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.986 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.987 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.987 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.987 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.987 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:11:28.987 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.988 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.988 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.988 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:28.988 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.989 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.989 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.990 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.990 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.990 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:11:28.991 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.991 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.992 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:28.992 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:28.992 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:28.992 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:28.992 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:28.993 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:28.993 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:28.993 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:11:28.993 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:28.994 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.994 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:28.994 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:11:28.994 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:11:28.994 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:11:28.995 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:11:28.995 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:11:28.995 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/851642528": "2021-10-22T00:11:14.209715+0000", 2021-10-21T00:11:28.995 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/851642528": "2021-10-22T00:11:14.209715+0000" 2021-10-21T00:11:28.996 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.996 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:11:28.996 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:11:28.996 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:11:28.996 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:11:28.997 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:11:28.997 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:11:28.997 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:11:28.997 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:11:28.997 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:28.998 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:28.998 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:11:28.998 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:11:28.998 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:11:28.999 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:11:28.999 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:11:28.999 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:29.000 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:29.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 msgr2=0x7fdc1c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 0x7fdc1c055ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fdc2000d000 tx=0x7fdc20007b40).stop 2021-10-21T00:11:29.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 msgr2=0x7fdc380629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fdc2800c000 tx=0x7fdc28006df0).stop 2021-10-21T00:11:29.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 shutdown_connections 2021-10-21T00:11:29.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc1c053610 0x7fdc1c055ad0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc3814b350 0x7fdc38063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc380aa750 0x7fdc38156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 --2- 172.21.15.41:0/2462824447 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc3805f9f0 0x7fdc380629d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 >> 172.21.15.41:0/2462824447 conn(0x7fdc3805bca0 msgr2=0x7fdc380b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:29.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 shutdown_connections 2021-10-21T00:11:29.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:28.706+0000 7fdc3d495700 1 -- 172.21.15.41:0/2462824447 wait complete. 2021-10-21T00:11:29.006 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:29.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:29.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:29.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:29.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:29.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.110+0000 7f5a3ca2e700 1 Processor -- start 2021-10-21T00:11:29.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.110+0000 7f5a3ca2e700 1 -- start start 2021-10-21T00:11:29.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 0x7f5a380ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a381428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5a38142de0 0x7f5a380b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3805fee0 con 0x7f5a38142de0 2021-10-21T00:11:29.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a38060640 con 0x7f5a3805fb00 2021-10-21T00:11:29.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380aa0a0 con 0x7f5a38142480 2021-10-21T00:11:29.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5a38142de0 0x7f5a380b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5a38142de0 0x7f5a380b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37032/0 (socket says 172.21.15.41:37032) 2021-10-21T00:11:29.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 -- 172.21.15.41:0/745162807 learned_addr learned my addr 172.21.15.41:0/745162807 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:29.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a377fe700 1 --2- 172.21.15.41:0/745162807 >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 0x7f5a380ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a2ffff700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a381428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 -- 172.21.15.41:0/745162807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 msgr2=0x7f5a381428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:29.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a381428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 -- 172.21.15.41:0/745162807 >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 msgr2=0x7f5a380ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:29.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 --2- 172.21.15.41:0/745162807 >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 0x7f5a380ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 -- 172.21.15.41:0/745162807 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380aa340 con 0x7f5a38142de0 2021-10-21T00:11:29.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a377fe700 1 --2- 172.21.15.41:0/745162807 >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 0x7f5a380ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:29.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a2ffff700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a381428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:29.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a37fff700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380b1e30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f5a300032f0 tx=0x7f5a30009290).ready entity=mon.0 client_cookie=945dbcb3daab0bc3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a36ffd700 1 -- 172.21.15.41:0/745162807 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3000b870 con 0x7f5a38142de0 2021-10-21T00:11:29.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a36ffd700 1 -- 172.21.15.41:0/745162807 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000b9d0 con 0x7f5a38142de0 2021-10-21T00:11:29.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a36ffd700 1 -- 172.21.15.41:0/745162807 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3000bb40 con 0x7f5a38142de0 2021-10-21T00:11:29.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/745162807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 msgr2=0x7f5a380b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380b1e30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f5a300032f0 tx=0x7f5a30009290).stop 2021-10-21T00:11:29.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/745162807 shutdown_connections 2021-10-21T00:11:29.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380b1e30 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/745162807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a381428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/745162807 >> v2:172.21.15.62:3300/0 conn(0x7f5a3805fb00 0x7f5a380ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/745162807 >> 172.21.15.41:0/745162807 conn(0x7f5a380b5700 msgr2=0x7f5a380b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:29.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/745162807 shutdown_connections 2021-10-21T00:11:29.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.114+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/745162807 wait complete. 2021-10-21T00:11:29.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 Processor -- start 2021-10-21T00:11:29.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 -- start start 2021-10-21T00:11:29.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3805fb00 0x7f5a3813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a3813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3813d6f0 con 0x7f5a38142de0 2021-10-21T00:11:29.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3813c3b0 con 0x7f5a3805fb00 2021-10-21T00:11:29.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a3ca2e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3813d930 con 0x7f5a38142480 2021-10-21T00:11:29.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a3813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a377fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3805fb00 0x7f5a3813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37040/0 (socket says 172.21.15.41:37040) 2021-10-21T00:11:29.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a3813bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:55534/0 (socket says 172.21.15.41:55534) 2021-10-21T00:11:29.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 -- 172.21.15.41:0/2871955357 learned_addr learned my addr 172.21.15.41:0/2871955357 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:29.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 -- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 msgr2=0x7f5a3813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a3813bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 -- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3805fb00 msgr2=0x7f5a3813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3805fb00 0x7f5a3813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 -- 172.21.15.41:0/2871955357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009530 con 0x7f5a38142de0 2021-10-21T00:11:29.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a37fff700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f5a300032f0 tx=0x7f5a30016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.118+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3000b870 con 0x7f5a38142de0 2021-10-21T00:11:29.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30021630 con 0x7f5a38142de0 2021-10-21T00:11:29.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3813dbd0 con 0x7f5a38142de0 2021-10-21T00:11:29.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a30021990 con 0x7f5a38142de0 2021-10-21T00:11:29.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a38063ad0 con 0x7f5a38142de0 2021-10-21T00:11:29.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3813b210 con 0x7f5a38142de0 2021-10-21T00:11:29.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a30027020 con 0x7f5a38142de0 2021-10-21T00:11:29.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a357fa700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 0x7f5a1c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5a3006cdb0 con 0x7f5a38142de0 2021-10-21T00:11:29.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.122+0000 7f5a377fe700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 0x7f5a1c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.126+0000 7f5a377fe700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 0x7f5a1c0559b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5a2800d000 tx=0x7f5a28008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.134+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a30043ec0 con 0x7f5a38142de0 2021-10-21T00:11:29.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.298+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a38143270 con 0x7f5a38142de0 2021-10-21T00:11:29.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.298+0000 7f5a357fa700 1 -- 172.21.15.41:0/2871955357 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f5a30015070 con 0x7f5a38142de0 2021-10-21T00:11:29.307 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:29.307 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":61,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:28.252300+0000","modified":"2021-10-21T00:11:28.252422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-10-21T00:11:29.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 msgr2=0x7f5a1c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 0x7f5a1c0559b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5a2800d000 tx=0x7f5a28008040).stop 2021-10-21T00:11:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 msgr2=0x7f5a380635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f5a300032f0 tx=0x7f5a30016000).stop 2021-10-21T00:11:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 shutdown_connections 2021-10-21T00:11:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5a1c0534f0 0x7f5a1c0559b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5a38142de0 0x7f5a380635e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5a38142480 0x7f5a3813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 --2- 172.21.15.41:0/2871955357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5a3805fb00 0x7f5a3813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 >> 172.21.15.41:0/2871955357 conn(0x7f5a380b5700 msgr2=0x7f5a380b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 shutdown_connections 2021-10-21T00:11:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.302+0000 7f5a3ca2e700 1 -- 172.21.15.41:0/2871955357 wait complete. 2021-10-21T00:11:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 61 2021-10-21T00:11:29.321 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:11:29.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.414+0000 7fc61bfff700 1 Processor -- start 2021-10-21T00:11:29.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.414+0000 7fc61bfff700 1 -- start start 2021-10-21T00:11:29.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc61c0b1fd0 0x7fc61c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c13f560 con 0x7fc61c0b0b40 2021-10-21T00:11:29.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c13cfd0 con 0x7fc61c097f40 2021-10-21T00:11:29.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c13f790 con 0x7fc61c0b1fd0 2021-10-21T00:11:29.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc613fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc61c0b0b40 0x7fc61c0a9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34814/0 (socket says 172.21.15.41:34814) 2021-10-21T00:11:29.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc613fff700 1 -- 172.21.15.41:0/2261492046 learned_addr learned my addr 172.21.15.41:0/2261492046 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:29.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805881508 0 0) 0x7fc61c13f560 con 0x7fc61c0b0b40 2021-10-21T00:11:29.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61affd700 1 --2- 172.21.15.41:0/2261492046 >> v2:172.21.15.62:3300/0 conn(0x7fc61c0b1fd0 0x7fc61c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc003260 con 0x7fc61c0b0b40 2021-10-21T00:11:29.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996492261 0 0) 0x7fc5fc003260 con 0x7fc61c0b0b40 2021-10-21T00:11:29.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 >> v2:172.21.15.62:3300/0 conn(0x7fc61c0b1fd0 msgr2=0x7fc61c13fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:29.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 --2- 172.21.15.41:0/2261492046 >> v2:172.21.15.62:3300/0 conn(0x7fc61c0b1fd0 0x7fc61c13fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 >> v1:172.21.15.62:6789/0 conn(0x7fc61c097f40 legacy=0x7fc61c0983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c13fa30 con 0x7fc61c0b0b40 2021-10-21T00:11:29.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fc604001660 con 0x7fc61c0b0b40 2021-10-21T00:11:29.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 >> v1:172.21.15.41:6789/0 conn(0x7fc61c0b0b40 legacy=0x7fc61c0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5fc003750 0x7fc5fc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004500 0x7fc5fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 0x7fc5fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c13f790 con 0x7fc5fc004e70 2021-10-21T00:11:29.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00bdd0 con 0x7fc5fc004500 2021-10-21T00:11:29.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc00bf40 con 0x7fc5fc003750 2021-10-21T00:11:29.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 0x7fc5fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc613fff700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004500 0x7fc5fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61affd700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5fc003750 0x7fc5fc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 -- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5fc003750 msgr2=0x7fc5fc003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:29.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5fc003750 0x7fc5fc003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 -- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004500 msgr2=0x7fc5fc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:29.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004500 0x7fc5fc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 -- 172.21.15.41:0/2261492046 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc003260 con 0x7fc5fc004e70 2021-10-21T00:11:29.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 -- 172.21.15.41:0/2261492046 reap_dead start 2021-10-21T00:11:29.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61b7fe700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 0x7fc5fc00b750 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7fc61c05d270 tx=0x7fc614007d80).ready entity=mon.0 client_cookie=fb678302a3fa3be2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614001620 con 0x7fc5fc004e70 2021-10-21T00:11:29.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614006890 con 0x7fc5fc004e70 2021-10-21T00:11:29.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61a7fc700 1 -- 172.21.15.41:0/2261492046 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc614006bf0 con 0x7fc5fc004e70 2021-10-21T00:11:29.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 msgr2=0x7fc5fc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 0x7fc5fc00b750 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7fc61c05d270 tx=0x7fc614007d80).stop 2021-10-21T00:11:29.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- 172.21.15.41:0/2261492046 shutdown_connections 2021-10-21T00:11:29.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 --2- 172.21.15.41:0/2261492046 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc5fc004e70 0x7fc5fc00b750 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- 172.21.15.41:0/2261492046 >> 172.21.15.41:0/2261492046 conn(0x7fc61c0b5700 msgr2=0x7fc61c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:29.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- 172.21.15.41:0/2261492046 shutdown_connections 2021-10-21T00:11:29.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.418+0000 7fc61bfff700 1 -- 172.21.15.41:0/2261492046 wait complete. 2021-10-21T00:11:29.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 Processor -- start 2021-10-21T00:11:29.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 -- start start 2021-10-21T00:11:29.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004e70 0x7fc61c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc61c0ad050 0x7fc61c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0ae720 con 0x7fc61c1556b0 2021-10-21T00:11:29.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c155250 con 0x7fc5fc004e70 2021-10-21T00:11:29.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0ae950 con 0x7fc61c0ad050 2021-10-21T00:11:29.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37058/0 (socket says 172.21.15.41:37058) 2021-10-21T00:11:29.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 -- 172.21.15.41:0/3849405113 learned_addr learned my addr 172.21.15.41:0/3849405113 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:29.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61affd700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004e70 0x7fc61c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc61b7fe700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc61c0ad050 0x7fc61c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 -- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc61c0ad050 msgr2=0x7fc61c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc61c0ad050 0x7fc61c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 -- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004e70 msgr2=0x7fc61c0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:29.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004e70 0x7fc61c0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:29.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 -- 172.21.15.41:0/3849405113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c140a70 con 0x7fc61c1556b0 2021-10-21T00:11:29.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc613fff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fc60400c000 tx=0x7fc60400d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.422+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc604010040 con 0x7fc61c1556b0 2021-10-21T00:11:29.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c0aee20 con 0x7fc61c1556b0 2021-10-21T00:11:29.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604016630 con 0x7fc61c1556b0 2021-10-21T00:11:29.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c08fdd0 con 0x7fc61c1556b0 2021-10-21T00:11:29.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc604008510 con 0x7fc61c1556b0 2021-10-21T00:11:29.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c0b1130 con 0x7fc61c1556b0 2021-10-21T00:11:29.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc6040167a0 con 0x7fc61c1556b0 2021-10-21T00:11:29.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc618ff9700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 0x7fc600055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:29.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc60406b230 con 0x7fc61c1556b0 2021-10-21T00:11:29.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc61affd700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 0x7fc600055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:29.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.426+0000 7fc61affd700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 0x7fc600055a70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fc60c00c000 tx=0x7fc60c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:29.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.434+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6040422a0 con 0x7fc61c1556b0 2021-10-21T00:11:29.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:29.598+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc61c057350 con 0x7fc61c1556b0 2021-10-21T00:11:30.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.462+0000 7fc618ff9700 1 -- 172.21.15.41:0/3849405113 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc60401b030 con 0x7fc61c1556b0 2021-10-21T00:11:30.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 msgr2=0x7fc600055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 0x7fc600055a70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fc60c00c000 tx=0x7fc60c008040).stop 2021-10-21T00:11:30.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 msgr2=0x7fc61c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fc60400c000 tx=0x7fc60400d040).stop 2021-10-21T00:11:30.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 shutdown_connections 2021-10-21T00:11:30.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc6000535b0 0x7fc600055a70 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc61c0ad050 0x7fc61c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc61c1556b0 0x7fc61c155b10 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 --2- 172.21.15.41:0/3849405113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5fc004e70 0x7fc61c0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 >> 172.21.15.41:0/3849405113 conn(0x7fc61c0b5700 msgr2=0x7fc61c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:30.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 shutdown_connections 2021-10-21T00:11:30.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.466+0000 7fc61bfff700 1 -- 172.21.15.41:0/3849405113 wait complete. 2021-10-21T00:11:30.477 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:11:30.491 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:30.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 Processor -- start 2021-10-21T00:11:30.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 -- start start 2021-10-21T00:11:30.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 0x7f4b740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b740ab600 0x7f4b7405fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740b2550 con 0x7f4b740602d0 2021-10-21T00:11:30.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740aba40 con 0x7f4b740ab600 2021-10-21T00:11:30.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b789d9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74142d60 con 0x7f4b740b2170 2021-10-21T00:11:30.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b740ab600 0x7f4b7405fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b740ab600 0x7f4b7405fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37064/0 (socket says 172.21.15.41:37064) 2021-10-21T00:11:30.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 -- 172.21.15.41:0/1304732139 learned_addr learned my addr 172.21.15.41:0/1304732139 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:30.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b72d9d700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 0x7f4b740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 -- 172.21.15.41:0/1304732139 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 msgr2=0x7f4b740b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:30.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 0x7f4b740b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 -- 172.21.15.41:0/1304732139 >> v1:172.21.15.62:6789/0 conn(0x7f4b740602d0 legacy=0x7f4b74145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b7259c700 1 -- 172.21.15.41:0/1304732139 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740b1350 con 0x7f4b740ab600 2021-10-21T00:11:30.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.594+0000 7f4b72d9d700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 0x7f4b740b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:30.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b7259c700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740ab600 0x7f4b7405fde0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f4b64002f70 tx=0x7f4b64006eb0).ready entity=mon.0 client_cookie=922c5570f08be725 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b71d9b700 1 -- 172.21.15.41:0/1304732139 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400d5c0 con 0x7f4b740ab600 2021-10-21T00:11:30.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b71d9b700 1 -- 172.21.15.41:0/1304732139 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64000e90 con 0x7f4b740ab600 2021-10-21T00:11:30.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b71d9b700 1 -- 172.21.15.41:0/1304732139 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400d950 con 0x7f4b740ab600 2021-10-21T00:11:30.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- 172.21.15.41:0/1304732139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740ab600 msgr2=0x7f4b7405fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740ab600 0x7f4b7405fde0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f4b64002f70 tx=0x7f4b64006eb0).stop 2021-10-21T00:11:30.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- 172.21.15.41:0/1304732139 shutdown_connections 2021-10-21T00:11:30.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740ab600 0x7f4b7405fde0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 --2- 172.21.15.41:0/1304732139 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740b2170 0x7f4b740b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- 172.21.15.41:0/1304732139 >> 172.21.15.41:0/1304732139 conn(0x7f4b740b5700 msgr2=0x7f4b740b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:30.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- 172.21.15.41:0/1304732139 shutdown_connections 2021-10-21T00:11:30.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- 172.21.15.41:0/1304732139 wait complete. 2021-10-21T00:11:30.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 Processor -- start 2021-10-21T00:11:30.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.598+0000 7f4b789d9700 1 -- start start 2021-10-21T00:11:30.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740ab600 0x7f4b740b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b740b2170 0x7f4b7413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ade90 con 0x7f4b740602d0 2021-10-21T00:11:30.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740adbf0 con 0x7f4b740b2170 2021-10-21T00:11:30.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ac980 con 0x7f4b740ab600 2021-10-21T00:11:30.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37070/0 (socket says 172.21.15.41:37070) 2021-10-21T00:11:30.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 -- 172.21.15.41:0/3150062125 learned_addr learned my addr 172.21.15.41:0/3150062125 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:30.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b7259c700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740ab600 0x7f4b740b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b7359e700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b740b2170 0x7f4b7413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 -- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740ab600 msgr2=0x7f4b740b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740ab600 0x7f4b740b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 -- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b740b2170 msgr2=0x7f4b7413ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b740b2170 0x7f4b7413ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 -- 172.21.15.41:0/3150062125 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6400b1e0 con 0x7f4b740602d0 2021-10-21T00:11:30.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b72d9d700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f4b68006940 tx=0x7f4b68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b68011780 con 0x7f4b740602d0 2021-10-21T00:11:30.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680118e0 con 0x7f4b740602d0 2021-10-21T00:11:30.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740aee30 con 0x7f4b740602d0 2021-10-21T00:11:30.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b68011c40 con 0x7f4b740602d0 2021-10-21T00:11:30.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.602+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b740ad070 con 0x7f4b740602d0 2021-10-21T00:11:30.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7405f940 con 0x7f4b740602d0 2021-10-21T00:11:30.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b68012420 con 0x7f4b740602d0 2021-10-21T00:11:30.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b63fff700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 0x7f4b50055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4b6806b740 con 0x7f4b740602d0 2021-10-21T00:11:30.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b7259c700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 0x7f4b50055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.606+0000 7f4b7259c700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 0x7f4b50055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f4b6401c000 tx=0x7f4b64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.610+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b680427f0 con 0x7f4b740602d0 2021-10-21T00:11:30.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.774+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b74057350 con 0x7f4b740602d0 2021-10-21T00:11:30.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.774+0000 7f4b63fff700 1 -- 172.21.15.41:0/3150062125 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f4b68045e10 con 0x7f4b740602d0 2021-10-21T00:11:30.782 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:30.782 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":62,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:28.252300+0000","modified":"2021-10-21T00:11:30.453323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-10-21T00:11:30.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 msgr2=0x7f4b50055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 0x7f4b50055ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f4b6401c000 tx=0x7f4b64015000).stop 2021-10-21T00:11:30.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 msgr2=0x7f4b74151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f4b68006940 tx=0x7f4b68008040).stop 2021-10-21T00:11:30.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 shutdown_connections 2021-10-21T00:11:30.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4b50053610 0x7f4b50055ad0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b740b2170 0x7f4b7413ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b740ab600 0x7f4b740b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 --2- 172.21.15.41:0/3150062125 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b740602d0 0x7f4b74151c20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 >> 172.21.15.41:0/3150062125 conn(0x7f4b740b5700 msgr2=0x7f4b741445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:30.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 shutdown_connections 2021-10-21T00:11:30.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.778+0000 7f4b789d9700 1 -- 172.21.15.41:0/3150062125 wait complete. 2021-10-21T00:11:30.789 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 62 2021-10-21T00:11:30.796 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:11:30.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 Processor -- start 2021-10-21T00:11:30.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 -- start start 2021-10-21T00:11:30.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb8040aaaa0 0x7fb804140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040aa290 con 0x7fb8040b0c10 2021-10-21T00:11:30.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040b0ff0 con 0x7fb80409a990 2021-10-21T00:11:30.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80c41d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040aa4f0 con 0x7fb8040aaaa0 2021-10-21T00:11:30.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a9ba700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb8040aaaa0 0x7fb804140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a1b9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb8040b0c10 0x7fb8040ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34848/0 (socket says 172.21.15.41:34848) 2021-10-21T00:11:30.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a1b9700 1 -- 172.21.15.41:0/2327490486 learned_addr learned my addr 172.21.15.41:0/2327490486 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:30.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2327490486 >> v1:172.21.15.62:6789/0 conn(0x7fb80409a990 legacy=0x7fb804098fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2327490486 >> v1:172.21.15.41:6789/0 conn(0x7fb8040b0c10 legacy=0x7fb8040ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2327490486 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040aaf70 con 0x7fb8040aaaa0 2021-10-21T00:11:30.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.898+0000 7fb8091b7700 1 -- 172.21.15.41:0/2327490486 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433608677 0 0) 0x7fb8040aa290 con 0x7fb8040b0c10 2021-10-21T00:11:30.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- 172.21.15.41:0/2327490486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040aaaa0 0x7fb804140230 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fb7fc0032f0 tx=0x7fb7fc0091d0).ready entity=mon.0 client_cookie=718700c4666c82ff server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb8091b7700 1 -- 172.21.15.41:0/2327490486 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7fc009ea0 con 0x7fb8040aaaa0 2021-10-21T00:11:30.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb8091b7700 1 -- 172.21.15.41:0/2327490486 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00b8a0 con 0x7fb8040aaaa0 2021-10-21T00:11:30.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb8091b7700 1 -- 172.21.15.41:0/2327490486 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7fc00ba10 con 0x7fb8040aaaa0 2021-10-21T00:11:30.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2327490486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040aaaa0 msgr2=0x7fb804140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2327490486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040aaaa0 0x7fb804140230 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fb7fc0032f0 tx=0x7fb7fc0091d0).stop 2021-10-21T00:11:30.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2327490486 shutdown_connections 2021-10-21T00:11:30.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2327490486 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040aaaa0 0x7fb804140230 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2327490486 >> 172.21.15.41:0/2327490486 conn(0x7fb80405bca0 msgr2=0x7fb80405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:30.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2327490486 shutdown_connections 2021-10-21T00:11:30.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2327490486 wait complete. 2021-10-21T00:11:30.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 Processor -- start 2021-10-21T00:11:30.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- start start 2021-10-21T00:11:30.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 0x7fb80413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 0x7fb80414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804062d50 con 0x7fb8040b0c10 2021-10-21T00:11:30.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80414f620 con 0x7fb80409a990 2021-10-21T00:11:30.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80413ba90 con 0x7fb8040aaaa0 2021-10-21T00:11:30.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37088/0 (socket says 172.21.15.41:37088) 2021-10-21T00:11:30.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2675388044 learned_addr learned my addr 172.21.15.41:0/2675388044 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:30.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a1b9700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 0x7fb80413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb8099b8700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 0x7fb80414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 msgr2=0x7fb80414ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 0x7fb80414ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 msgr2=0x7fb80413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:30.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 0x7fb80413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:30.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 -- 172.21.15.41:0/2675388044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009470 con 0x7fb8040b0c10 2021-10-21T00:11:30.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb8099b8700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 0x7fb80414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:30.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a1b9700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 0x7fb80413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:30.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80a9ba700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb7fc0032f0 tx=0x7fb7fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7fc009ea0 con 0x7fb8040b0c10 2021-10-21T00:11:30.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc01f3f0 con 0x7fb8040b0c10 2021-10-21T00:11:30.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7fc01f750 con 0x7fb8040b0c10 2021-10-21T00:11:30.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.902+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8040672f0 con 0x7fb8040b0c10 2021-10-21T00:11:30.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb804141130 con 0x7fb8040b0c10 2021-10-21T00:11:30.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80414e7a0 con 0x7fb8040b0c10 2021-10-21T00:11:30.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb7fc026030 con 0x7fb8040b0c10 2021-10-21T00:11:30.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb7f37fe700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 0x7fb7e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:30.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb7fc06c990 con 0x7fb8040b0c10 2021-10-21T00:11:30.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb80a1b9700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 0x7fb7e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:30.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.906+0000 7fb80a1b9700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 0x7fb7e4055b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb7f400b000 tx=0x7fb7f4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:30.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:30.914+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb80414e7a0 con 0x7fb8040b0c10 2021-10-21T00:11:31.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.078+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb80414e7a0 con 0x7fb8040b0c10 2021-10-21T00:11:31.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.466+0000 7fb7f37fe700 1 -- 172.21.15.41:0/2675388044 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb80414e7a0 con 0x7fb8040b0c10 2021-10-21T00:11:31.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 msgr2=0x7fb7e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 0x7fb7e4055b60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb7f400b000 tx=0x7fb7f4009040).stop 2021-10-21T00:11:31.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 msgr2=0x7fb80414f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb7fc0032f0 tx=0x7fb7fc016000).stop 2021-10-21T00:11:31.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 shutdown_connections 2021-10-21T00:11:31.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb7e40536a0 0x7fb7e4055b60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb8040b0c10 0x7fb80414f130 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8040aaaa0 0x7fb80414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 --2- 172.21.15.41:0/2675388044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb80409a990 0x7fb80413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 >> 172.21.15.41:0/2675388044 conn(0x7fb80405bca0 msgr2=0x7fb8040af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:31.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 shutdown_connections 2021-10-21T00:11:31.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.470+0000 7fb80c41d700 1 -- 172.21.15.41:0/2675388044 wait complete. 2021-10-21T00:11:31.495 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:11:31.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 Processor -- start 2021-10-21T00:11:31.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 -- start start 2021-10-21T00:11:31.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf7c0aa790 0x7faf7c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c14a2c0 0x7faf7c14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0af7c0 con 0x7faf7c05f9f0 2021-10-21T00:11:31.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c067a40 con 0x7faf7c0aa790 2021-10-21T00:11:31.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf82ee0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0aae00 con 0x7faf7c14a2c0 2021-10-21T00:11:31.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf7c0aa790 0x7faf7c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf7c0aa790 0x7faf7c14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37092/0 (socket says 172.21.15.41:37092) 2021-10-21T00:11:31.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 -- 172.21.15.41:0/2654460993 learned_addr learned my addr 172.21.15.41:0/2654460993 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:31.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf8147d700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c14a2c0 0x7faf7c14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 -- 172.21.15.41:0/2654460993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c14a2c0 msgr2=0x7faf7c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:31.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c14a2c0 0x7faf7c14ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.606+0000 7faf7bfff700 1 -- 172.21.15.41:0/2654460993 >> v1:172.21.15.62:6789/0 conn(0x7faf7c05f9f0 legacy=0x7faf7c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf7bfff700 1 -- 172.21.15.41:0/2654460993 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c05fdd0 con 0x7faf7c0aa790 2021-10-21T00:11:31.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf7bfff700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c0aa790 0x7faf7c14a750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7faf7c0abb30 tx=0x7faf6c006eb0).ready entity=mon.0 client_cookie=1bdb0a98a3bdb974 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:31.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf7b7fe700 1 -- 172.21.15.41:0/2654460993 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c00d5c0 con 0x7faf7c0aa790 2021-10-21T00:11:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf7b7fe700 1 -- 172.21.15.41:0/2654460993 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c000e90 con 0x7faf7c0aa790 2021-10-21T00:11:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf7b7fe700 1 -- 172.21.15.41:0/2654460993 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6c00d950 con 0x7faf7c0aa790 2021-10-21T00:11:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 -- 172.21.15.41:0/2654460993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c0aa790 msgr2=0x7faf7c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c0aa790 0x7faf7c14a750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7faf7c0abb30 tx=0x7faf6c006eb0).stop 2021-10-21T00:11:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 -- 172.21.15.41:0/2654460993 shutdown_connections 2021-10-21T00:11:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c14a2c0 0x7faf7c14ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 --2- 172.21.15.41:0/2654460993 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c0aa790 0x7faf7c14a750 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 -- 172.21.15.41:0/2654460993 >> 172.21.15.41:0/2654460993 conn(0x7faf7c05bca0 msgr2=0x7faf7c05c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 -- 172.21.15.41:0/2654460993 shutdown_connections 2021-10-21T00:11:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.610+0000 7faf82ee0700 1 -- 172.21.15.41:0/2654460993 wait complete. 2021-10-21T00:11:31.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 Processor -- start 2021-10-21T00:11:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- start start 2021-10-21T00:11:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf7c05f9f0 0x7faf7c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c0aa790 0x7faf7c066b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c067820 con 0x7faf7c14a2c0 2021-10-21T00:11:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0627e0 con 0x7faf7c05f9f0 2021-10-21T00:11:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c062a80 con 0x7faf7c0aa790 2021-10-21T00:11:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37102/0 (socket says 172.21.15.41:37102) 2021-10-21T00:11:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 -- 172.21.15.41:0/770307101 learned_addr learned my addr 172.21.15.41:0/770307101 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf80c7c700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf7c05f9f0 0x7faf7c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf7bfff700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c0aa790 0x7faf7c066b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 -- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c0aa790 msgr2=0x7faf7c066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c0aa790 0x7faf7c066b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 -- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf7c05f9f0 msgr2=0x7faf7c0acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf7c05f9f0 0x7faf7c0acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 -- 172.21.15.41:0/770307101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c00b1e0 con 0x7faf7c14a2c0 2021-10-21T00:11:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf8147d700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7faf7400a000 tx=0x7faf74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf740127e0 con 0x7faf7c14a2c0 2021-10-21T00:11:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74012940 con 0x7faf7c14a2c0 2021-10-21T00:11:31.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c062d20 con 0x7faf7c14a2c0 2021-10-21T00:11:31.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf74012ca0 con 0x7faf7c14a2c0 2021-10-21T00:11:31.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.614+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c063520 con 0x7faf7c14a2c0 2021-10-21T00:11:31.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c0b0d80 con 0x7faf7c14a2c0 2021-10-21T00:11:31.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf74013480 con 0x7faf7c14a2c0 2021-10-21T00:11:31.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf79ffb700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 0x7faf5c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf80c7c700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 0x7faf5c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:31.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faf7406bea0 con 0x7faf7c14a2c0 2021-10-21T00:11:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.618+0000 7faf80c7c700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 0x7faf5c055a40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7faf7000b000 tx=0x7faf70009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:31.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.622+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf74042e40 con 0x7faf7c14a2c0 2021-10-21T00:11:31.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:31.750+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf7c0686c0 con 0x7faf7c14a2c0 2021-10-21T00:11:32.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.486+0000 7faf79ffb700 1 -- 172.21.15.41:0/770307101 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) v1 ==== 185+0+0 (secure 0 0 0) 0x7faf74012e00 con 0x7faf7c14a2c0 2021-10-21T00:11:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 msgr2=0x7faf5c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 0x7faf5c055a40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7faf7000b000 tx=0x7faf70009040).stop 2021-10-21T00:11:32.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 msgr2=0x7faf7c159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7faf7400a000 tx=0x7faf74008040).stop 2021-10-21T00:11:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 shutdown_connections 2021-10-21T00:11:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf5c053580 0x7faf5c055a40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.499 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf7c14a2c0 0x7faf7c159ba0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf7c0aa790 0x7faf7c066b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 --2- 172.21.15.41:0/770307101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf7c05f9f0 0x7faf7c0acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 >> 172.21.15.41:0/770307101 conn(0x7faf7c05bca0 msgr2=0x7faf7c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:32.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 shutdown_connections 2021-10-21T00:11:32.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.490+0000 7faf82ee0700 1 -- 172.21.15.41:0/770307101 wait complete. 2021-10-21T00:11:32.503 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:11:32.513 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:11:32.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.626+0000 7f953131c700 1 Processor -- start 2021-10-21T00:11:32.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.626+0000 7f953131c700 1 -- start start 2021-10-21T00:11:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f952c0b2170 0x7f952c09a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c0b2550 con 0x7f952c1410a0 2021-10-21T00:11:32.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c099ba0 con 0x7f952c0af620 2021-10-21T00:11:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c099e40 con 0x7f952c0b2170 2021-10-21T00:11:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f9530b1b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f952c1410a0 0x7f952c1414f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34876/0 (socket says 172.21.15.41:34876) 2021-10-21T00:11:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f9530b1b700 1 -- 172.21.15.41:0/830315294 learned_addr learned my addr 172.21.15.41:0/830315294 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:32.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952bfff700 1 --2- 172.21.15.41:0/830315294 >> v2:172.21.15.62:3300/0 conn(0x7f952c0b2170 0x7f952c09a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:32.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952affd700 1 -- 172.21.15.41:0/830315294 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949272949 0 0) 0x7f952c0b2550 con 0x7f952c1410a0 2021-10-21T00:11:32.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952affd700 1 -- 172.21.15.41:0/830315294 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f950c003260 con 0x7f952c1410a0 2021-10-21T00:11:32.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952bfff700 1 -- 172.21.15.41:0/830315294 >> v1:172.21.15.62:6789/0 conn(0x7f952c0af620 legacy=0x7f952c143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952bfff700 1 -- 172.21.15.41:0/830315294 >> v1:172.21.15.41:6789/0 conn(0x7f952c1410a0 legacy=0x7f952c1414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952bfff700 1 -- 172.21.15.41:0/830315294 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c09a0e0 con 0x7f952c0b2170 2021-10-21T00:11:32.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952bfff700 1 --2- 172.21.15.41:0/830315294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c0b2170 0x7f952c09a5a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514006df0).ready entity=mon.1 client_cookie=1b77b103b02e94fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:32.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952affd700 1 -- 172.21.15.41:0/830315294 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951400d610 con 0x7f952c0b2170 2021-10-21T00:11:32.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952affd700 1 -- 172.21.15.41:0/830315294 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9514000e90 con 0x7f952c0b2170 2021-10-21T00:11:32.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f952affd700 1 -- 172.21.15.41:0/830315294 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951400d960 con 0x7f952c0b2170 2021-10-21T00:11:32.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- 172.21.15.41:0/830315294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c0b2170 msgr2=0x7f952c09a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 --2- 172.21.15.41:0/830315294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c0b2170 0x7f952c09a5a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514006df0).stop 2021-10-21T00:11:32.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- 172.21.15.41:0/830315294 shutdown_connections 2021-10-21T00:11:32.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 --2- 172.21.15.41:0/830315294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c0b2170 0x7f952c09a5a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- 172.21.15.41:0/830315294 >> 172.21.15.41:0/830315294 conn(0x7f952c0b5700 msgr2=0x7f952c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:32.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- 172.21.15.41:0/830315294 shutdown_connections 2021-10-21T00:11:32.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- 172.21.15.41:0/830315294 wait complete. 2021-10-21T00:11:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 Processor -- start 2021-10-21T00:11:32.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.630+0000 7f953131c700 1 -- start start 2021-10-21T00:11:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f952c0b2170 0x7f952c13ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c1410a0 0x7f952c140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:32.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ad380 con 0x7f952c0af620 2021-10-21T00:11:32.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ac0c0 con 0x7f952c1410a0 2021-10-21T00:11:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0ab120 con 0x7f952c0b2170 2021-10-21T00:11:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:32.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37110/0 (socket says 172.21.15.41:37110) 2021-10-21T00:11:32.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 -- 172.21.15.41:0/1053831257 learned_addr learned my addr 172.21.15.41:0/1053831257 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f9530b1b700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c1410a0 0x7f952c140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952b7fe700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f952c0b2170 0x7f952c13ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:32.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 -- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f952c0b2170 msgr2=0x7f952c13ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f952c0b2170 0x7f952c13ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 -- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c1410a0 msgr2=0x7f952c140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c1410a0 0x7f952c140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 -- 172.21.15.41:0/1053831257 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951400b180 con 0x7f952c0af620 2021-10-21T00:11:32.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f952bfff700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951400d290 con 0x7f952c0af620 2021-10-21T00:11:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951401e400 con 0x7f952c0af620 2021-10-21T00:11:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951401e760 con 0x7f952c0af620 2021-10-21T00:11:32.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0ab3c0 con 0x7f952c0af620 2021-10-21T00:11:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0ac4f0 con 0x7f952c0af620 2021-10-21T00:11:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.634+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c097150 con 0x7f952c0af620 2021-10-21T00:11:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.638+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9514025030 con 0x7f952c0af620 2021-10-21T00:11:32.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.638+0000 7f95297fa700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 0x7f9510055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:32.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.638+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f951406c6d0 con 0x7f952c0af620 2021-10-21T00:11:32.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.638+0000 7f952b7fe700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 0x7f9510055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:32.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.638+0000 7f952b7fe700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 0x7f9510055b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f951c00b000 tx=0x7f951c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:32.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.646+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f952c097150 con 0x7f952c0af620 2021-10-21T00:11:32.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:32.766+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f952c097150 con 0x7f952c0af620 2021-10-21T00:11:33.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.490+0000 7f95297fa700 1 -- 172.21.15.41:0/1053831257 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) v1 ==== 173+0+0 (secure 0 0 0) 0x7f952c097150 con 0x7f952c0af620 2021-10-21T00:11:33.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 msgr2=0x7f9510055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 0x7f9510055b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f951c00b000 tx=0x7f951c009040).stop 2021-10-21T00:11:33.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 msgr2=0x7f952c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514014000).stop 2021-10-21T00:11:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 shutdown_connections 2021-10-21T00:11:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9510053640 0x7f9510055b00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f952c1410a0 0x7f952c140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f952c0b2170 0x7f952c13ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 --2- 172.21.15.41:0/1053831257 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f952c0af620 0x7f952c1430d0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 >> 172.21.15.41:0/1053831257 conn(0x7f952c0b5700 msgr2=0x7f952c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:33.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 shutdown_connections 2021-10-21T00:11:33.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.494+0000 7f953131c700 1 -- 172.21.15.41:0/1053831257 wait complete. 2021-10-21T00:11:33.504 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:11:33.517 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:11:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.622+0000 7f8547fff700 1 Processor -- start 2021-10-21T00:11:33.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.622+0000 7f8547fff700 1 -- start start 2021-10-21T00:11:33.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f854805bca0 0x7f854805c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8548066490 con 0x7f85480b2e00 2021-10-21T00:11:33.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8548146db0 con 0x7f854805bca0 2021-10-21T00:11:33.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8548145f60 con 0x7f8548142880 2021-10-21T00:11:33.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f853ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f85480b2e00 0x7f85481466a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34888/0 (socket says 172.21.15.41:34888) 2021-10-21T00:11:33.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f853ffff700 1 -- 172.21.15.41:0/4007588231 learned_addr learned my addr 172.21.15.41:0/4007588231 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:33.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4007588231 >> v2:172.21.15.41:3300/0 conn(0x7f854805bca0 0x7f854805c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85477fe700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85467fc700 1 -- 172.21.15.41:0/4007588231 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411781966 0 0) 0x7f8548066490 con 0x7f85480b2e00 2021-10-21T00:11:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85467fc700 1 -- 172.21.15.41:0/4007588231 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8528003260 con 0x7f85480b2e00 2021-10-21T00:11:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 -- 172.21.15.41:0/4007588231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 msgr2=0x7f8548142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 -- 172.21.15.41:0/4007588231 >> v1:172.21.15.41:6789/0 conn(0x7f85480b2e00 legacy=0x7f85481466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 -- 172.21.15.41:0/4007588231 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548146200 con 0x7f854805bca0 2021-10-21T00:11:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f854805bca0 0x7f854805c080 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f8538002f70 tx=0x7f8538006df0).ready entity=mon.0 client_cookie=102662ec4fb7f015 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85467fc700 1 -- 172.21.15.41:0/4007588231 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853800d4a0 con 0x7f854805bca0 2021-10-21T00:11:33.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85467fc700 1 -- 172.21.15.41:0/4007588231 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8538000e90 con 0x7f854805bca0 2021-10-21T00:11:33.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f85467fc700 1 -- 172.21.15.41:0/4007588231 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853800d7f0 con 0x7f854805bca0 2021-10-21T00:11:33.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- 172.21.15.41:0/4007588231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f854805bca0 msgr2=0x7f854805c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f854805bca0 0x7f854805c080 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f8538002f70 tx=0x7f8538006df0).stop 2021-10-21T00:11:33.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- 172.21.15.41:0/4007588231 shutdown_connections 2021-10-21T00:11:33.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 --2- 172.21.15.41:0/4007588231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f854805bca0 0x7f854805c080 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- 172.21.15.41:0/4007588231 >> 172.21.15.41:0/4007588231 conn(0x7f8548069df0 msgr2=0x7f8548063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:33.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- 172.21.15.41:0/4007588231 shutdown_connections 2021-10-21T00:11:33.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.626+0000 7f8547fff700 1 -- 172.21.15.41:0/4007588231 wait complete. 2021-10-21T00:11:33.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 Processor -- start 2021-10-21T00:11:33.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- start start 2021-10-21T00:11:33.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f854805bca0 0x7f85481421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548145530 con 0x7f85480b2e00 2021-10-21T00:11:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548145750 con 0x7f854805bca0 2021-10-21T00:11:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85481459f0 con 0x7f8548142880 2021-10-21T00:11:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37126/0 (socket says 172.21.15.41:37126) 2021-10-21T00:11:33.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 -- 172.21.15.41:0/4195592560 learned_addr learned my addr 172.21.15.41:0/4195592560 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:33.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f85477fe700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f854805bca0 0x7f85481421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 -- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 msgr2=0x7f8548145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 -- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f854805bca0 msgr2=0x7f85481421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f854805bca0 0x7f85481421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 -- 172.21.15.41:0/4195592560 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853800b180 con 0x7f85480b2e00 2021-10-21T00:11:33.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f853ffff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f8530001110 tx=0x7f8530007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853000ce80 con 0x7f85480b2e00 2021-10-21T00:11:33.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300070d0 con 0x7f85480b2e00 2021-10-21T00:11:33.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8530007430 con 0x7f85480b2e00 2021-10-21T00:11:33.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8548145c90 con 0x7f85480b2e00 2021-10-21T00:11:33.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.630+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8548155230 con 0x7f85480b2e00 2021-10-21T00:11:33.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.634+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8548057350 con 0x7f85480b2e00 2021-10-21T00:11:33.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.634+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8530010070 con 0x7f85480b2e00 2021-10-21T00:11:33.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.634+0000 7f8544ff9700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 0x7f852c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.634+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f853006ab90 con 0x7f85480b2e00 2021-10-21T00:11:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.634+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 0x7f852c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.638+0000 7f8546ffd700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 0x7f852c0559b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f853801a000 tx=0x7f8538014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.642+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8530041fd0 con 0x7f85480b2e00 2021-10-21T00:11:33.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.762+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8548143770 con 0x7f85480b2e00 2021-10-21T00:11:33.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.770+0000 7f8544ff9700 1 -- 172.21.15.41:0/4195592560 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8530018070 con 0x7f85480b2e00 2021-10-21T00:11:33.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 msgr2=0x7f852c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 0x7f852c0559b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f853801a000 tx=0x7f8538014000).stop 2021-10-21T00:11:33.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 msgr2=0x7f854812a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f8530001110 tx=0x7f8530007aa0).stop 2021-10-21T00:11:33.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 shutdown_connections 2021-10-21T00:11:33.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f852c0534f0 0x7f852c0559b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8548142880 0x7f8548145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85480b2e00 0x7f854812a510 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 --2- 172.21.15.41:0/4195592560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f854805bca0 0x7f85481421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 >> 172.21.15.41:0/4195592560 conn(0x7f8548069df0 msgr2=0x7f8548142cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:33.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 shutdown_connections 2021-10-21T00:11:33.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.774+0000 7f8547fff700 1 -- 172.21.15.41:0/4195592560 wait complete. 2021-10-21T00:11:33.796 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-10-21T00:11:33.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 Processor -- start 2021-10-21T00:11:33.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 -- start start 2021-10-21T00:11:33.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 0x7fd21c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0b0b50 con 0x7fd21c0abb50 2021-10-21T00:11:33.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0b2550 con 0x7fd21c0af620 2021-10-21T00:11:33.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.890+0000 7fd21bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0b0d90 con 0x7fd21c0b2170 2021-10-21T00:11:33.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 0x7fd21c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 0x7fd21c0ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49052/0 (socket says 172.21.15.41:49052) 2021-10-21T00:11:33.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21a7fc700 1 -- 172.21.15.41:0/69958407 learned_addr learned my addr 172.21.15.41:0/69958407 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:33.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21b7fe700 1 --1- 172.21.15.41:0/69958407 >> v1:172.21.15.62:6789/0 conn(0x7fd21c0abb50 0x7fd21c14a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:42962/0 (socket says 172.21.15.41:42962) 2021-10-21T00:11:33.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 -- 172.21.15.41:0/69958407 >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 msgr2=0x7fd21c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:33.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 --2- 172.21.15.41:0/69958407 >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 0x7fd21c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 -- 172.21.15.41:0/69958407 >> v1:172.21.15.62:6789/0 conn(0x7fd21c0abb50 legacy=0x7fd21c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 -- 172.21.15.41:0/69958407 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0b1030 con 0x7fd21c0b2170 2021-10-21T00:11:33.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21affd700 1 --2- 172.21.15.41:0/69958407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0ab170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd210002f70 tx=0x7fd210006df0).ready entity=mon.2 client_cookie=3258b2f371370bd4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd219ffb700 1 -- 172.21.15.41:0/69958407 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21000d570 con 0x7fd21c0b2170 2021-10-21T00:11:33.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd219ffb700 1 -- 172.21.15.41:0/69958407 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210000e90 con 0x7fd21c0b2170 2021-10-21T00:11:33.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd219ffb700 1 -- 172.21.15.41:0/69958407 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21000d8c0 con 0x7fd21c0b2170 2021-10-21T00:11:33.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 -- 172.21.15.41:0/69958407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 msgr2=0x7fd21c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 --2- 172.21.15.41:0/69958407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0ab170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd210002f70 tx=0x7fd210006df0).stop 2021-10-21T00:11:33.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 -- 172.21.15.41:0/69958407 shutdown_connections 2021-10-21T00:11:33.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 --2- 172.21.15.41:0/69958407 >> v2:172.21.15.62:3300/0 conn(0x7fd21c0af620 0x7fd21c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 --2- 172.21.15.41:0/69958407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0ab170 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 -- 172.21.15.41:0/69958407 >> 172.21.15.41:0/69958407 conn(0x7fd21c0b5700 msgr2=0x7fd21c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 -- 172.21.15.41:0/69958407 shutdown_connections 2021-10-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.894+0000 7fd21bfff700 1 -- 172.21.15.41:0/69958407 wait complete. 2021-10-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 Processor -- start 2021-10-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- start start 2021-10-21T00:11:33.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c0abb50 0x7fd21c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c148a80 con 0x7fd21c0af620 2021-10-21T00:11:33.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0ad440 con 0x7fd21c0abb50 2021-10-21T00:11:33.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c156450 con 0x7fd21c0b2170 2021-10-21T00:11:33.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c0abb50 0x7fd21c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37140/0 (socket says 172.21.15.41:37140) 2021-10-21T00:11:33.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 -- 172.21.15.41:0/4092848172 learned_addr learned my addr 172.21.15.41:0/4092848172 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:33.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 -- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 msgr2=0x7fd21c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 -- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c0abb50 msgr2=0x7fd21c0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:33.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c0abb50 0x7fd21c0b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:33.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 -- 172.21.15.41:0/4092848172 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21000b180 con 0x7fd21c0af620 2021-10-21T00:11:33.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21a7fc700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd20c00c000 tx=0x7fd20c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c013400 con 0x7fd21c0af620 2021-10-21T00:11:33.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c013560 con 0x7fd21c0af620 2021-10-21T00:11:33.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c156170 con 0x7fd21c0af620 2021-10-21T00:11:33.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c0138c0 con 0x7fd21c0af620 2021-10-21T00:11:33.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.898+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c146d90 con 0x7fd21c0af620 2021-10-21T00:11:33.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c0b12d0 con 0x7fd21c0af620 2021-10-21T00:11:33.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd20c023070 con 0x7fd21c0af620 2021-10-21T00:11:33.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd20bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 0x7fd1f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:33.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd20c06b800 con 0x7fd21c0af620 2021-10-21T00:11:33.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd21affd700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 0x7fd1f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:33.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.902+0000 7fd21affd700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 0x7fd1f8055b60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fd21001a000 tx=0x7fd210014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:33.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:33.906+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd20c042c40 con 0x7fd21c0af620 2021-10-21T00:11:34.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.078+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fd21c057350 con 0x7fd21c0af620 2021-10-21T00:11:34.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.502+0000 7fd20bfff700 1 -- 172.21.15.41:0/4092848172 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v393) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd20c06b020 con 0x7fd21c0af620 2021-10-21T00:11:34.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 msgr2=0x7fd1f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 0x7fd1f8055b60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fd21001a000 tx=0x7fd210014000).stop 2021-10-21T00:11:34.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 msgr2=0x7fd21c142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fd20c00c000 tx=0x7fd20c008040).stop 2021-10-21T00:11:34.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 shutdown_connections 2021-10-21T00:11:34.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd1f80536a0 0x7fd1f8055b60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd21c0b2170 0x7fd21c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd21c0af620 0x7fd21c142060 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 --2- 172.21.15.41:0/4092848172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd21c0abb50 0x7fd21c0b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 >> 172.21.15.41:0/4092848172 conn(0x7fd21c0b5700 msgr2=0x7fd21c149190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:34.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 shutdown_connections 2021-10-21T00:11:34.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.506+0000 7fd21bfff700 1 -- 172.21.15.41:0/4092848172 wait complete. 2021-10-21T00:11:34.531 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:11:34.532 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:11:34.533 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-10-21T00:11:34.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.634+0000 7f1caa07c700 1 Processor -- start 2021-10-21T00:11:34.643 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.634+0000 7f1caa07c700 1 -- start start 2021-10-21T00:11:34.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca405c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ca40b1a50 0x7f1ca4145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca40b6350 con 0x7f1ca40b5f70 2021-10-21T00:11:34.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca4067d00 con 0x7f1ca40b1a50 2021-10-21T00:11:34.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca405cee0 con 0x7f1ca4142520 2021-10-21T00:11:34.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ca40b1a50 0x7f1ca4145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca907a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f1ca40b5f70 0x7f1ca4141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34918/0 (socket says 172.21.15.41:34918) 2021-10-21T00:11:34.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f1ca40b1a50 0x7f1ca4145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37150/0 (socket says 172.21.15.41:37150) 2021-10-21T00:11:34.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 -- 172.21.15.41:0/1448707296 learned_addr learned my addr 172.21.15.41:0/1448707296 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:34.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca8879700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca405c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 -- 172.21.15.41:0/1448707296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 msgr2=0x7f1ca405c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:34.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca405c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 -- 172.21.15.41:0/1448707296 >> v1:172.21.15.41:6789/0 conn(0x7f1ca40b5f70 legacy=0x7f1ca4141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 -- 172.21.15.41:0/1448707296 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca405d180 con 0x7f1ca40b1a50 2021-10-21T00:11:34.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1ca987b700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca4145ef0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f1c9c0032f0 tx=0x7f1c9c009290).ready entity=mon.0 client_cookie=83c3bd6dc0861cda server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:34.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1c93fff700 1 -- 172.21.15.41:0/1448707296 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c00b8a0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1c93fff700 1 -- 172.21.15.41:0/1448707296 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00ba00 con 0x7f1ca40b1a50 2021-10-21T00:11:34.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1c93fff700 1 -- 172.21.15.41:0/1448707296 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c00bb70 con 0x7f1ca40b1a50 2021-10-21T00:11:34.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- 172.21.15.41:0/1448707296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 msgr2=0x7f1ca4145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca4145ef0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f1c9c0032f0 tx=0x7f1c9c009290).stop 2021-10-21T00:11:34.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- 172.21.15.41:0/1448707296 shutdown_connections 2021-10-21T00:11:34.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca4145ef0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1448707296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca405c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- 172.21.15.41:0/1448707296 >> 172.21.15.41:0/1448707296 conn(0x7f1ca40639f0 msgr2=0x7f1ca40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:34.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- 172.21.15.41:0/1448707296 shutdown_connections 2021-10-21T00:11:34.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.638+0000 7f1caa07c700 1 -- 172.21.15.41:0/1448707296 wait complete. 2021-10-21T00:11:34.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 Processor -- start 2021-10-21T00:11:34.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 -- start start 2021-10-21T00:11:34.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ca40b5f70 0x7f1ca41483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca4155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4065250 con 0x7f1ca40b1a50 2021-10-21T00:11:34.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40ae580 con 0x7f1ca40b5f70 2021-10-21T00:11:34.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1caa07c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40ae040 con 0x7f1ca4142520 2021-10-21T00:11:34.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37152/0 (socket says 172.21.15.41:37152) 2021-10-21T00:11:34.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 -- 172.21.15.41:0/1297771942 learned_addr learned my addr 172.21.15.41:0/1297771942 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:34.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca8879700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ca40b5f70 0x7f1ca41483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca987b700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca4155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 -- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 msgr2=0x7f1ca4155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca4155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 -- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ca40b5f70 msgr2=0x7f1ca41483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:34.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ca40b5f70 0x7f1ca41483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:34.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 -- 172.21.15.41:0/1297771942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009530 con 0x7f1ca40b1a50 2021-10-21T00:11:34.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1ca907a700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f1ca406a4d0 tx=0x7f1ca0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:34.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.642+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca00070d0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0007230 con 0x7f1ca40b1a50 2021-10-21T00:11:34.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca40ae2e0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca0005740 con 0x7f1ca40b1a50 2021-10-21T00:11:34.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca40aeec0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca40af3f0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1ca0010070 con 0x7f1ca40b1a50 2021-10-21T00:11:34.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1c927fc700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 0x7f1c84055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:34.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1ca006aae0 con 0x7f1ca40b1a50 2021-10-21T00:11:34.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1ca8879700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 0x7f1c84055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:34.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.646+0000 7f1ca8879700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 0x7f1c84055ad0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f1c9400b000 tx=0x7f1c94006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:34.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.654+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ca0041f20 con 0x7f1ca40b1a50 2021-10-21T00:11:34.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:34.826+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f1ca40666e0 con 0x7f1ca40b1a50 2021-10-21T00:11:35.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.506+0000 7f1c927fc700 1 -- 172.21.15.41:0/1297771942 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v394) v1 ==== 131+0+0 (secure 0 0 0) 0x7f1ca0045540 con 0x7f1ca40b1a50 2021-10-21T00:11:35.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 msgr2=0x7f1c84055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 0x7f1c84055ad0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f1c9400b000 tx=0x7f1c94006df0).stop 2021-10-21T00:11:35.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 msgr2=0x7f1ca40641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f1ca406a4d0 tx=0x7f1ca0007c00).stop 2021-10-21T00:11:35.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 shutdown_connections 2021-10-21T00:11:35.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1c84053610 0x7f1c84055ad0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1ca4142520 0x7f1ca4155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ca40b5f70 0x7f1ca41483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 --2- 172.21.15.41:0/1297771942 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f1ca40b1a50 0x7f1ca40641a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 >> 172.21.15.41:0/1297771942 conn(0x7f1ca40639f0 msgr2=0x7f1ca4141500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:35.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 shutdown_connections 2021-10-21T00:11:35.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.510+0000 7f1caa07c700 1 -- 172.21.15.41:0/1297771942 wait complete. 2021-10-21T00:11:35.535 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:11:35.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 Processor -- start 2021-10-21T00:11:35.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 -- start start 2021-10-21T00:11:35.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb0b00acd30 0x7fb0b005c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:35.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00ba000 con 0x7fb0b00b41a0 2021-10-21T00:11:35.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b0142ad0 con 0x7fb0b00b9c20 2021-10-21T00:11:35.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.642+0000 7fb0af59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0143bc0 con 0x7fb0b00acd30 2021-10-21T00:11:35.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0aed9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb0b00b41a0 0x7fb0b0141910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34934/0 (socket says 172.21.15.41:34934) 2021-10-21T00:11:35.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0aed9d700 1 -- 172.21.15.41:0/1931291954 learned_addr learned my addr 172.21.15.41:0/1931291954 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:35.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/1931291954 >> v2:172.21.15.41:3300/0 conn(0x7fb0b00acd30 0x7fb0b005c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:35.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45418374 0 0) 0x7fb0b00ba000 con 0x7fb0b00b41a0 2021-10-21T00:11:35.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb090003260 con 0x7fb0b00b41a0 2021-10-21T00:11:35.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053946767 0 0) 0x7fb0b0142ad0 con 0x7fb0b00b9c20 2021-10-21T00:11:35.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0a7fff700 1 -- 172.21.15.41:0/1931291954 >> v1:172.21.15.62:6789/0 conn(0x7fb0b00b9c20 legacy=0x7fb0b01434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0a7fff700 1 -- 172.21.15.41:0/1931291954 >> v1:172.21.15.41:6789/0 conn(0x7fb0b00b41a0 legacy=0x7fb0b0141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0a7fff700 1 -- 172.21.15.41:0/1931291954 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0142d70 con 0x7fb0b00acd30 2021-10-21T00:11:35.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/1931291954 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b005c860 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fb098002f70 tx=0x7fb098006df0).ready entity=mon.0 client_cookie=6d57e2321428b0db server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:35.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb09800d610 con 0x7fb0b00acd30 2021-10-21T00:11:35.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098000e90 con 0x7fb0b00acd30 2021-10-21T00:11:35.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0add9b700 1 -- 172.21.15.41:0/1931291954 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb09800d960 con 0x7fb0b00acd30 2021-10-21T00:11:35.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 -- 172.21.15.41:0/1931291954 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 msgr2=0x7fb0b005c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1931291954 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b005c860 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fb098002f70 tx=0x7fb098006df0).stop 2021-10-21T00:11:35.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 -- 172.21.15.41:0/1931291954 shutdown_connections 2021-10-21T00:11:35.658 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1931291954 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b005c860 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 -- 172.21.15.41:0/1931291954 >> 172.21.15.41:0/1931291954 conn(0x7fb0b0062f00 msgr2=0x7fb0b00b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:35.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 -- 172.21.15.41:0/1931291954 shutdown_connections 2021-10-21T00:11:35.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.646+0000 7fb0af59e700 1 -- 172.21.15.41:0/1931291954 wait complete. 2021-10-21T00:11:35.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 Processor -- start 2021-10-21T00:11:35.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 -- start start 2021-10-21T00:11:35.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:35.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0b00b41a0 0x7fb0b00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:35.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b9c20 0x7fb0b0145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:35.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0112860 con 0x7fb0b00acd30 2021-10-21T00:11:35.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0112b00 con 0x7fb0b00b9c20 2021-10-21T00:11:35.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0af59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b0ea0 con 0x7fb0b00b41a0 2021-10-21T00:11:35.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37168/0 (socket says 172.21.15.41:37168) 2021-10-21T00:11:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 -- 172.21.15.41:0/1907028466 learned_addr learned my addr 172.21.15.41:0/1907028466 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0b00b41a0 0x7fb0b00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0aed9d700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b9c20 0x7fb0b0145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 -- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0b00b41a0 msgr2=0x7fb0b00adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0b00b41a0 0x7fb0b00adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 -- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b9c20 msgr2=0x7fb0b0145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b9c20 0x7fb0b0145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.650+0000 7fb0ae59c700 1 -- 172.21.15.41:0/1907028466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09800b180 con 0x7fb0b00acd30 2021-10-21T00:11:35.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0ae59c700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fb0a0000f20 tx=0x7fb0a0007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:35.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a0012400 con 0x7fb0b00acd30 2021-10-21T00:11:35.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0012560 con 0x7fb0b00acd30 2021-10-21T00:11:35.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0145c80 con 0x7fb0b00acd30 2021-10-21T00:11:35.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a00128c0 con 0x7fb0b00acd30 2021-10-21T00:11:35.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01125e0 con 0x7fb0b00acd30 2021-10-21T00:11:35.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb0a0019030 con 0x7fb0b00acd30 2021-10-21T00:11:35.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.654+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0112cc0 con 0x7fb0b00acd30 2021-10-21T00:11:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.658+0000 7fb0a77fe700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 0x7fb094055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.658+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb0a006a940 con 0x7fb0b00acd30 2021-10-21T00:11:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.658+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 0x7fb094055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:35.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.658+0000 7fb0a7fff700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 0x7fb094055a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb09801a000 tx=0x7fb098014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:35.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.666+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0a0041d80 con 0x7fb0b00acd30 2021-10-21T00:11:35.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.794+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb0b0143010 con 0x7fb0b00acd30 2021-10-21T00:11:35.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.798+0000 7fb0a77fe700 1 -- 172.21.15.41:0/1907028466 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0a00453a0 con 0x7fb0b00acd30 2021-10-21T00:11:35.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 msgr2=0x7fb094055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 0x7fb094055a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb09801a000 tx=0x7fb098014000).stop 2021-10-21T00:11:35.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 msgr2=0x7fb0b00b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:35.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fb0a0000f20 tx=0x7fb0a0007ca0).stop 2021-10-21T00:11:35.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 shutdown_connections 2021-10-21T00:11:35.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb0940535b0 0x7fb094055a70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b9c20 0x7fb0b0145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0b00b41a0 0x7fb0b00adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 --2- 172.21.15.41:0/1907028466 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb0b00acd30 0x7fb0b00b32a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:35.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 >> 172.21.15.41:0/1907028466 conn(0x7fb0b0062f00 msgr2=0x7fb0b005c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:35.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 shutdown_connections 2021-10-21T00:11:35.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:35.802+0000 7fb0af59e700 1 -- 172.21.15.41:0/1907028466 wait complete. 2021-10-21T00:11:35.821 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:11:35.821 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:35.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:35.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:35.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:35.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:35.923 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:11:35.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:35.924 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:35.925 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:35.932 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:11:35.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:35.934 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:35.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:35.935 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:35.935 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:11:35.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:35.944 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:35.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:35.945 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:35.945 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:11:35.951 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:11:35.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:35.952 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:11:35.953 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:11:36.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 Processor -- start 2021-10-21T00:11:36.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 -- start start 2021-10-21T00:11:36.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 0x7f63200b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062f70 0x7f632005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63200b3a20 0x7f632013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632005bd40 con 0x7f63200b3a20 2021-10-21T00:11:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632005bf70 con 0x7f6320062330 2021-10-21T00:11:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6326185700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6320142cb0 con 0x7f6320062f70 2021-10-21T00:11:36.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6325984700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63200b3a20 0x7f632013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6325984700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f63200b3a20 0x7f632013c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37174/0 (socket says 172.21.15.41:37174) 2021-10-21T00:11:36.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6325984700 1 -- 172.21.15.41:0/532728109 learned_addr learned my addr 172.21.15.41:0/532728109 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:36.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6325183700 1 --2- 172.21.15.41:0/532728109 >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 0x7f63200b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.058+0000 7f6324982700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062f70 0x7f632005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 -- 172.21.15.41:0/532728109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062f70 msgr2=0x7f632005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062f70 0x7f632005c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 -- 172.21.15.41:0/532728109 >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 msgr2=0x7f63200b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:36.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 --2- 172.21.15.41:0/532728109 >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 0x7f63200b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 -- 172.21.15.41:0/532728109 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320142950 con 0x7f63200b3a20 2021-10-21T00:11:36.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325183700 1 --2- 172.21.15.41:0/532728109 >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 0x7f63200b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:36.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6325984700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f632013c510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f6318002f70 tx=0x7f6318006eb0).ready entity=mon.0 client_cookie=825ced01bc269832 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f631ffff700 1 -- 172.21.15.41:0/532728109 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631800d570 con 0x7f63200b3a20 2021-10-21T00:11:36.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f631ffff700 1 -- 172.21.15.41:0/532728109 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318000e90 con 0x7f63200b3a20 2021-10-21T00:11:36.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f631ffff700 1 -- 172.21.15.41:0/532728109 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631800d900 con 0x7f63200b3a20 2021-10-21T00:11:36.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 -- 172.21.15.41:0/532728109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 msgr2=0x7f632013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f632013c510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f6318002f70 tx=0x7f6318006eb0).stop 2021-10-21T00:11:36.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 -- 172.21.15.41:0/532728109 shutdown_connections 2021-10-21T00:11:36.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f632013c510 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 --2- 172.21.15.41:0/532728109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062f70 0x7f632005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 --2- 172.21.15.41:0/532728109 >> v2:172.21.15.62:3300/0 conn(0x7f6320062330 0x7f63200b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 -- 172.21.15.41:0/532728109 >> 172.21.15.41:0/532728109 conn(0x7f63200b9080 msgr2=0x7f63200b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:36.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 -- 172.21.15.41:0/532728109 shutdown_connections 2021-10-21T00:11:36.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.062+0000 7f6326185700 1 -- 172.21.15.41:0/532728109 wait complete. 2021-10-21T00:11:36.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 Processor -- start 2021-10-21T00:11:36.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- start start 2021-10-21T00:11:36.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062330 0x7f6320147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6320062f70 0x7f6320151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320155c70 con 0x7f63200b3a20 2021-10-21T00:11:36.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320144cc0 con 0x7f6320062f70 2021-10-21T00:11:36.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6320156060 con 0x7f6320062330 2021-10-21T00:11:36.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37184/0 (socket says 172.21.15.41:37184) 2021-10-21T00:11:36.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 -- 172.21.15.41:0/2171476174 learned_addr learned my addr 172.21.15.41:0/2171476174 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:36.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6324982700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6320062f70 0x7f6320151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325183700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062330 0x7f6320147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 -- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062330 msgr2=0x7f6320147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062330 0x7f6320147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 -- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6320062f70 msgr2=0x7f6320151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6320062f70 0x7f6320151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 -- 172.21.15.41:0/2171476174 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631800b1e0 con 0x7f63200b3a20 2021-10-21T00:11:36.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6325984700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f6318002f70 tx=0x7f6318015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631800d8f0 con 0x7f63200b3a20 2021-10-21T00:11:36.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318006b40 con 0x7f63200b3a20 2021-10-21T00:11:36.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320145b40 con 0x7f63200b3a20 2021-10-21T00:11:36.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6318011d70 con 0x7f63200b3a20 2021-10-21T00:11:36.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.066+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63201448c0 con 0x7f63200b3a20 2021-10-21T00:11:36.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320144b00 con 0x7f63200b3a20 2021-10-21T00:11:36.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6318025030 con 0x7f63200b3a20 2021-10-21T00:11:36.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f631e7fc700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 0x7f6304055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f631806c790 con 0x7f63200b3a20 2021-10-21T00:11:36.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f6325183700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 0x7f6304055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.070+0000 7f6325183700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 0x7f6304055b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f631000d000 tx=0x7f6310008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.078+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6318043a60 con 0x7f63200b3a20 2021-10-21T00:11:36.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6320145cd0 con 0x7f63200b3a20 2021-10-21T00:11:36.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f631e7fc700 1 -- 172.21.15.41:0/2171476174 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v122) v1 ==== 81+0+28835 (secure 0 0 0) 0x7f6318023020 con 0x7f63200b3a20 2021-10-21T00:11:36.214 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:36.214 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:36.215 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 122, 2021-10-21T00:11:36.215 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:11:36.215 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:11:36.216 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:11:33.483941+0000", 2021-10-21T00:11:36.216 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:36.216 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:36.216 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:11:36.217 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:11:36.217 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:11:36.217 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:11:36.217 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:11:36.218 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:11:36.218 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:11:36.218 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:36.219 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:11:36.219 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:11:36.219 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:11:36.220 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:11:36.220 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:11:36.220 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 24, 2021-10-21T00:11:36.221 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:11:36.221 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:11:36.221 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:11:36.222 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:11:36.222 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:11:36.222 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.222 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:11:36.223 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:11:36.223 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:11:36.223 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:36.223 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:36.224 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:36.224 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:36.224 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:36.224 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:36.225 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:36.225 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:36.225 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:11:36.225 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:11:36.226 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:11:36.226 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:11:36.226 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:11:36.227 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:36.227 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:36.227 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:36.228 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:36.228 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:36.228 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:36.228 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:36.229 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.229 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:11:36.229 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:36.229 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:36.230 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:36.230 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:36.230 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:36.230 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:36.231 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:36.231 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:36.231 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:36.231 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:36.232 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:36.232 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:36.232 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:36.232 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:36.232 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:36.233 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:36.233 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:36.233 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:36.233 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:36.234 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:36.234 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:36.234 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:36.234 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:36.235 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:36.235 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:36.235 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:36.235 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.235 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:36.236 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:36.236 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:36.236 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:36.236 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:36.236 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:36.237 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:36.237 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:36.237 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:36.237 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:36.238 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:36.238 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:11:36.238 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:11:36.238 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.238 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:36.239 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:11:36.239 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.239 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.239 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.240 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:11:36.240 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:11:36.240 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:11:36.240 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:36.240 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:36.241 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:36.241 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:36.241 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:36.241 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:36.242 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:36.242 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:36.242 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:36.242 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:36.242 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:36.243 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:36.243 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:36.243 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:36.243 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:36.244 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:36.244 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:36.244 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:36.244 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:36.244 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:36.245 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.245 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:11:36.245 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:36.245 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:36.246 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:36.246 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:36.246 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:36.246 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:36.246 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:36.247 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:36.247 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:36.247 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:36.247 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:36.248 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:36.248 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:36.248 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:36.248 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:36.248 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:36.249 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:36.249 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:36.249 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:36.249 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:36.249 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:36.250 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:36.250 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:36.250 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:36.250 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:36.251 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:36.251 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.251 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:36.251 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:36.251 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:36.252 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:36.252 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:36.252 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:36.252 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:36.253 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:36.253 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:36.253 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:36.253 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:36.253 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:11:36.254 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:36.254 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:11:36.254 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.254 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.255 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:36.255 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:11:36.255 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.255 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:36.255 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:11:36.256 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.256 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.256 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.256 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.256 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.257 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.257 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.257 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.257 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.258 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.258 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.258 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.259 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:11:36.259 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.259 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.259 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.260 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.260 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:11:36.260 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.260 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.260 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.261 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.261 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.261 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.261 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.261 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.262 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:11:36.262 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.262 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.262 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.263 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.263 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:11:36.263 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.263 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.263 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.264 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.264 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.264 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.264 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.265 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.265 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:11:36.265 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.265 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.266 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.266 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.266 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:11:36.266 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.266 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.267 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.267 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.267 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.267 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.268 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.268 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.268 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:11:36.268 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.268 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.269 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.269 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.269 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:11:36.269 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:36.270 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.270 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.270 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.270 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:11:36.271 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:11:36.272 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:11:36.272 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:11:36.272 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.273 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.273 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.273 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.274 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.274 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.274 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:36.274 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:11:36.274 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.275 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.275 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.275 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.275 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.276 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.276 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.276 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.276 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.276 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.277 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.277 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.277 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.277 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:11:36.278 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.278 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.278 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.278 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.279 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:11:36.279 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.279 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.279 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.280 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.280 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.280 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.281 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:11:36.281 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.281 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.281 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.282 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.282 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:11:36.282 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.282 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.283 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.284 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.284 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:11:36.284 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.284 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.285 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.285 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.285 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:11:36.285 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.285 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.286 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.286 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.286 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.286 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.287 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.287 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.287 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:11:36.287 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.288 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.288 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.288 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.288 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:11:36.289 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:36.289 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.289 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.289 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.289 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:11:36.290 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:11:36.290 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:11:36.290 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:11:36.290 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.291 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.291 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.291 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.291 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.292 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.292 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:36.292 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:11:36.292 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.293 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.294 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.294 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.294 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.295 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.295 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.295 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 112, 2021-10-21T00:11:36.296 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.296 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.296 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.296 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.297 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.297 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.297 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:11:36.298 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.298 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.298 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.299 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:11:36.299 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.299 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.299 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.299 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.300 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.300 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.300 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.300 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.301 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:11:36.301 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.301 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.301 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.301 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.302 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:11:36.302 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.302 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.302 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.303 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.303 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.303 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.303 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.303 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.304 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:11:36.304 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.304 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.304 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.305 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.305 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:11:36.305 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.305 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.305 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.306 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.306 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.306 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.306 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.307 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.307 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:11:36.307 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.307 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.307 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.308 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.308 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:11:36.308 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:36.308 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.308 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.309 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.309 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:11:36.309 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:11:36.309 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:11:36.310 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:11:36.310 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.310 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.310 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.310 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.311 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.311 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.311 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:36.311 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:11:36.312 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.312 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.312 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.312 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.312 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.313 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.313 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.313 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.313 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.313 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.314 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.314 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.314 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.314 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:11:36.315 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.315 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.315 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:11:36.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.316 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.316 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.317 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.317 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.317 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.317 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.317 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:11:36.318 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.318 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.318 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.319 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:11:36.319 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.319 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.319 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.320 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.320 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.320 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.320 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.321 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.321 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:11:36.321 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.321 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.321 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.322 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.322 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:11:36.322 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.322 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.322 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.323 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.323 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.323 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.324 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.324 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:11:36.324 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.324 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.324 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.325 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.325 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:11:36.325 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:36.325 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.326 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.326 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.326 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:11:36.326 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:11:36.326 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:11:36.327 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:11:36.327 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.327 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.327 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.328 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.328 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.328 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.328 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:36.328 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:11:36.329 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.329 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.329 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.329 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.329 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.330 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.330 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.330 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 112, 2021-10-21T00:11:36.330 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.331 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.331 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.331 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.331 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.332 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.332 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:11:36.332 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.332 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.332 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.333 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.333 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:11:36.333 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.333 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.334 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.334 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.334 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.334 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.335 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.335 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.335 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:11:36.335 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.335 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.336 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.336 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:11:36.336 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.337 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.337 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.337 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.337 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.338 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.338 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.338 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.338 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:11:36.338 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.339 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.339 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.339 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:11:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.340 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:11:36.341 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.342 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:11:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.343 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:11:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:11:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:11:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:11:36.344 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.345 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:11:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.346 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.347 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.348 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:11:36.349 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.350 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:11:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.351 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.352 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:11:36.353 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:11:36.354 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.355 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:11:36.356 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.357 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:11:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.358 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.359 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.359 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.359 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.359 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:11:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.360 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:11:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:11:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:11:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:11:36.362 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:11:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.363 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:11:36.364 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.365 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.366 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.367 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:11:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.368 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:11:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.369 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.370 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:11:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.371 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:11:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.372 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.373 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:11:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.374 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:11:36.375 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.376 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:11:36.377 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.378 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.378 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.378 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.378 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:11:36.378 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:36.379 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.379 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.379 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.379 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:11:36.380 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:11:36.380 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:11:36.380 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:11:36.380 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.381 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.381 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.381 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.381 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.381 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.382 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:36.382 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:11:36.382 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:36.382 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:36.383 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:36.383 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:36.383 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:36.383 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:36.383 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:36.384 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:36.384 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:36.384 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:36.384 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:36.385 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.385 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.385 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.385 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:11:36.385 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.386 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.386 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.386 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.386 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:11:36.386 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.387 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.387 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.387 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.387 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:36.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.388 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.388 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:11:36.388 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.389 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.389 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.389 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.389 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:11:36.389 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.390 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.390 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.390 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:36.391 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.391 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.391 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.391 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:11:36.391 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.392 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.392 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.392 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.392 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:11:36.393 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.393 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.393 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.393 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.393 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:36.394 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:36.394 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.394 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:36.394 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:11:36.395 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.395 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.395 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.395 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:36.396 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:11:36.396 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:36.396 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.396 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.397 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.397 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:11:36.398 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:11:36.398 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:11:36.398 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:11:36.399 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:36.399 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:36.399 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:36.400 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:36.400 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.400 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:36.400 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:11:36.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.401 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:36.401 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.401 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.401 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.402 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.402 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.402 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:11:36.402 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.402 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.403 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.403 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:36.403 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.403 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.404 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.404 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.404 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.404 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:11:36.404 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.405 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.405 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.405 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:36.405 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.406 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.406 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.406 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.406 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.407 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:11:36.407 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.407 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.407 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.408 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:36.408 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.408 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.408 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.408 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.409 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.409 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:11:36.409 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.409 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.410 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.410 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:36.410 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.410 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.410 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.411 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.411 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.411 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:11:36.411 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.412 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.412 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.412 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:36.412 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.412 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.413 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.413 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.413 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.413 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:11:36.413 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.414 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.414 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.414 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:36.414 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.415 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.415 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.415 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.415 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.416 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:11:36.416 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.416 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.416 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:36.416 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:36.417 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:36.417 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:36.417 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:36.417 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:36.417 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:36.418 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:11:36.418 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:36.418 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.418 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:36.419 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:11:36.419 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:11:36.419 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:11:36.419 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:11:36.419 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:11:36.420 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/851642528": "2021-10-22T00:11:14.209715+0000", 2021-10-21T00:11:36.420 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/851642528": "2021-10-22T00:11:14.209715+0000" 2021-10-21T00:11:36.420 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.420 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:11:36.421 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:11:36.421 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:11:36.421 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:11:36.421 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:11:36.421 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:11:36.422 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:11:36.422 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:11:36.422 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:36.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:36.423 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:11:36.423 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:11:36.423 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:11:36.423 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:11:36.424 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:11:36.424 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:36.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 msgr2=0x7f6304055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 0x7f6304055b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f631000d000 tx=0x7f6310008040).stop 2021-10-21T00:11:36.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 msgr2=0x7f6320146410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.206+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f6318002f70 tx=0x7f6318015000).stop 2021-10-21T00:11:36.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 shutdown_connections 2021-10-21T00:11:36.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6304053640 0x7f6304055b00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f63200b3a20 0x7f6320146410 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6320062f70 0x7f6320151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 --2- 172.21.15.41:0/2171476174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6320062330 0x7f6320147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 >> 172.21.15.41:0/2171476174 conn(0x7f63200b9080 msgr2=0x7f632005c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:36.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 shutdown_connections 2021-10-21T00:11:36.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.210+0000 7f6326185700 1 -- 172.21.15.41:0/2171476174 wait complete. 2021-10-21T00:11:36.429 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:36.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 Processor -- start 2021-10-21T00:11:36.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 -- start start 2021-10-21T00:11:36.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78600b1830 0x7f78600ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f78601433e0 0x7f7860062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600ae020 con 0x7f78600b4380 2021-10-21T00:11:36.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78600ade00 con 0x7f78601433e0 2021-10-21T00:11:36.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78668f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786005fe50 con 0x7f78600b1830 2021-10-21T00:11:36.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f78601433e0 0x7f7860062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78658f2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f78600b4380 0x7f786005f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34958/0 (socket says 172.21.15.41:34958) 2021-10-21T00:11:36.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78658f2700 1 -- 172.21.15.41:0/3673391048 learned_addr learned my addr 172.21.15.41:0/3673391048 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:36.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78650f1700 1 --2- 172.21.15.41:0/3673391048 >> v2:172.21.15.62:3300/0 conn(0x7f78600b1830 0x7f78600ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78648f0700 1 -- 172.21.15.41:0/3673391048 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392024362 0 0) 0x7f78600ae020 con 0x7f78600b4380 2021-10-21T00:11:36.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 -- 172.21.15.41:0/3673391048 >> v2:172.21.15.62:3300/0 conn(0x7f78600b1830 msgr2=0x7f78600ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:36.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 --2- 172.21.15.41:0/3673391048 >> v2:172.21.15.62:3300/0 conn(0x7f78600b1830 0x7f78600ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 -- 172.21.15.41:0/3673391048 >> v1:172.21.15.41:6789/0 conn(0x7f78600b4380 legacy=0x7f786005f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 -- 172.21.15.41:0/3673391048 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600b4760 con 0x7f78601433e0 2021-10-21T00:11:36.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78660f3700 1 --2- 172.21.15.41:0/3673391048 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78601433e0 0x7f7860062940 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f78580032f0 tx=0x7f78580091d0).ready entity=mon.0 client_cookie=7bb842270d1edb6c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78648f0700 1 -- 172.21.15.41:0/3673391048 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785800b680 con 0x7f78601433e0 2021-10-21T00:11:36.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78648f0700 1 -- 172.21.15.41:0/3673391048 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800b7e0 con 0x7f78601433e0 2021-10-21T00:11:36.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.534+0000 7f78648f0700 1 -- 172.21.15.41:0/3673391048 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785800b950 con 0x7f78601433e0 2021-10-21T00:11:36.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- 172.21.15.41:0/3673391048 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78601433e0 msgr2=0x7f7860062940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- 172.21.15.41:0/3673391048 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78601433e0 0x7f7860062940 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f78580032f0 tx=0x7f78580091d0).stop 2021-10-21T00:11:36.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- 172.21.15.41:0/3673391048 shutdown_connections 2021-10-21T00:11:36.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- 172.21.15.41:0/3673391048 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78601433e0 0x7f7860062940 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- 172.21.15.41:0/3673391048 >> v2:172.21.15.62:3300/0 conn(0x7f78600b1830 0x7f78600ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- 172.21.15.41:0/3673391048 >> 172.21.15.41:0/3673391048 conn(0x7f78600b7910 msgr2=0x7f78600b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:36.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- 172.21.15.41:0/3673391048 shutdown_connections 2021-10-21T00:11:36.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- 172.21.15.41:0/3673391048 wait complete. 2021-10-21T00:11:36.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 Processor -- start 2021-10-21T00:11:36.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- start start 2021-10-21T00:11:36.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78600b1830 0x7f7860065de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78601433e0 0x7f7860141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860145b10 con 0x7f78600b4380 2021-10-21T00:11:36.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860151fa0 con 0x7f78601433e0 2021-10-21T00:11:36.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78668f4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7860066900 con 0x7f78600b1830 2021-10-21T00:11:36.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78650f1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78650f1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37196/0 (socket says 172.21.15.41:37196) 2021-10-21T00:11:36.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78650f1700 1 -- 172.21.15.41:0/1801220880 learned_addr learned my addr 172.21.15.41:0/1801220880 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:36.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78658f2700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78600b1830 0x7f7860065de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.538+0000 7f78660f3700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78601433e0 0x7f7860141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 -- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78600b1830 msgr2=0x7f7860065de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78600b1830 0x7f7860065de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 -- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78601433e0 msgr2=0x7f7860141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78601433e0 0x7f7860141720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 -- 172.21.15.41:0/1801220880 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009470 con 0x7f78600b4380 2021-10-21T00:11:36.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78650f1700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f78600af940 tx=0x7f785c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785c00b3b0 con 0x7f78600b4380 2021-10-21T00:11:36.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c00c640 con 0x7f78600b4380 2021-10-21T00:11:36.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860066b50 con 0x7f78600b4380 2021-10-21T00:11:36.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785c00c9a0 con 0x7f78600b4380 2021-10-21T00:11:36.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7860067090 con 0x7f78600b4380 2021-10-21T00:11:36.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7860142ca0 con 0x7f78600b4380 2021-10-21T00:11:36.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f785c00cb00 con 0x7f78600b4380 2021-10-21T00:11:36.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 0x7f7840055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.542+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f785c06b6a0 con 0x7f78600b4380 2021-10-21T00:11:36.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.546+0000 7f78658f2700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 0x7f7840055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.546+0000 7f78658f2700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 0x7f7840055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f785000b000 tx=0x7f7850009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.550+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f785c042b90 con 0x7f78600b4380 2021-10-21T00:11:36.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7860057350 con 0x7f78600b4380 2021-10-21T00:11:36.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f784effd700 1 -- 172.21.15.41:0/1801220880 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+504 (secure 0 0 0) 0x7f785c0461b0 con 0x7f78600b4380 2021-10-21T00:11:36.720 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:36.721 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-10-21T00:11:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 msgr2=0x7f7840055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 0x7f7840055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f785000b000 tx=0x7f7850009040).stop 2021-10-21T00:11:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 msgr2=0x7f7860141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f78600af940 tx=0x7f785c006df0).stop 2021-10-21T00:11:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 shutdown_connections 2021-10-21T00:11:36.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7840053610 0x7f7840055ad0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78601433e0 0x7f7860141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f78600b4380 0x7f7860141230 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 --2- 172.21.15.41:0/1801220880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78600b1830 0x7f7860065de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 >> 172.21.15.41:0/1801220880 conn(0x7f78600b7910 msgr2=0x7f78600b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:36.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 shutdown_connections 2021-10-21T00:11:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.714+0000 7f78668f4700 1 -- 172.21.15.41:0/1801220880 wait complete. 2021-10-21T00:11:36.725 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 63 2021-10-21T00:11:36.733 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:36.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.830+0000 7f5679f8c700 1 Processor -- start 2021-10-21T00:11:36.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.830+0000 7f5679f8c700 1 -- start start 2021-10-21T00:11:36.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f567414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56740609d0 con 0x7f56740aa750 2021-10-21T00:11:36.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567405fdd0 con 0x7f567414b350 2021-10-21T00:11:36.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740b1620 con 0x7f567405f9f0 2021-10-21T00:11:36.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5672ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f56740aa750 0x7f567414ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:34976/0 (socket says 172.21.15.41:34976) 2021-10-21T00:11:36.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5672ffd700 1 -- 172.21.15.41:0/2595386847 learned_addr learned my addr 172.21.15.41:0/2595386847 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:36.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56737fe700 1 --2- 172.21.15.41:0/2595386847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f567414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445056960 0 0) 0x7f56740609d0 con 0x7f56740aa750 2021-10-21T00:11:36.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5660003260 con 0x7f56740aa750 2021-10-21T00:11:36.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176770683 0 0) 0x7f567405fdd0 con 0x7f567414b350 2021-10-21T00:11:36.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56740609d0 con 0x7f567414b350 2021-10-21T00:11:36.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56737fe700 1 -- 172.21.15.41:0/2595386847 >> v1:172.21.15.62:6789/0 conn(0x7f567414b350 legacy=0x7f56740af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56737fe700 1 -- 172.21.15.41:0/2595386847 >> v1:172.21.15.41:6789/0 conn(0x7f56740aa750 legacy=0x7f567414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56737fe700 1 -- 172.21.15.41:0/2595386847 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740b1380 con 0x7f567405f9f0 2021-10-21T00:11:36.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56737fe700 1 --2- 172.21.15.41:0/2595386847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f567414a750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f566c0032f0 tx=0x7f566c0091d0).ready entity=mon.2 client_cookie=92518ed407ac26e9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566c00b640 con 0x7f567405f9f0 2021-10-21T00:11:36.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c00b7a0 con 0x7f567405f9f0 2021-10-21T00:11:36.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f56727fc700 1 -- 172.21.15.41:0/2595386847 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566c00b910 con 0x7f567405f9f0 2021-10-21T00:11:36.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- 172.21.15.41:0/2595386847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 msgr2=0x7f567414a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 --2- 172.21.15.41:0/2595386847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f567414a750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f566c0032f0 tx=0x7f566c0091d0).stop 2021-10-21T00:11:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- 172.21.15.41:0/2595386847 shutdown_connections 2021-10-21T00:11:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 --2- 172.21.15.41:0/2595386847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f567414a750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- 172.21.15.41:0/2595386847 >> 172.21.15.41:0/2595386847 conn(0x7f567405bca0 msgr2=0x7f567405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:36.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- 172.21.15.41:0/2595386847 shutdown_connections 2021-10-21T00:11:36.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.834+0000 7f5679f8c700 1 -- 172.21.15.41:0/2595386847 wait complete. 2021-10-21T00:11:36.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 Processor -- start 2021-10-21T00:11:36.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- start start 2021-10-21T00:11:36.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f5674063c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567414b350 0x7f5674146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740ac820 con 0x7f56740aa750 2021-10-21T00:11:36.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740acac0 con 0x7f567414b350 2021-10-21T00:11:36.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740ae800 con 0x7f567405f9f0 2021-10-21T00:11:36.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5673fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567414b350 0x7f5674146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37210/0 (socket says 172.21.15.41:37210) 2021-10-21T00:11:36.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f56737fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f5674063c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 -- 172.21.15.41:0/364453523 learned_addr learned my addr 172.21.15.41:0/364453523 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:36.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 -- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 msgr2=0x7f5674063c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f5674063c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 -- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567414b350 msgr2=0x7f5674146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567414b350 0x7f5674146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:36.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 -- 172.21.15.41:0/364453523 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c009470 con 0x7f56740aa750 2021-10-21T00:11:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5672ffd700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f5668001040 tx=0x7f5668007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566800ce80 con 0x7f56740aa750 2021-10-21T00:11:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674146980 con 0x7f56740aa750 2021-10-21T00:11:36.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56680070d0 con 0x7f56740aa750 2021-10-21T00:11:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5668007430 con 0x7f56740aa750 2021-10-21T00:11:36.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.838+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56740ad7c0 con 0x7f56740aa750 2021-10-21T00:11:36.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5668010070 con 0x7f56740aa750 2021-10-21T00:11:36.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56740678f0 con 0x7f56740aa750 2021-10-21T00:11:36.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f5670ff9700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 0x7f5654055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:36.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f566806acf0 con 0x7f56740aa750 2021-10-21T00:11:36.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f56737fe700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 0x7f5654055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:36.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.842+0000 7f56737fe700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 0x7f5654055a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f566c019000 tx=0x7f566c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:36.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:36.846+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5668042090 con 0x7f56740aa750 2021-10-21T00:11:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.010+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5674057350 con 0x7f56740aa750 2021-10-21T00:11:37.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.010+0000 7f5670ff9700 1 -- 172.21.15.41:0/364453523 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+504 (secure 0 0 0) 0x7f56680456b0 con 0x7f56740aa750 2021-10-21T00:11:37.019 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:37.019 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-10-21T00:11:37.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 msgr2=0x7f5654055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 0x7f5654055a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f566c019000 tx=0x7f566c016000).stop 2021-10-21T00:11:37.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 msgr2=0x7f56740ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f5668001040 tx=0x7f5668007b60).stop 2021-10-21T00:11:37.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 shutdown_connections 2021-10-21T00:11:37.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5654053580 0x7f5654055a40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f567414b350 0x7f5674146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f56740aa750 0x7f56740ae1a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 --2- 172.21.15.41:0/364453523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f567405f9f0 0x7f5674063c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 >> 172.21.15.41:0/364453523 conn(0x7f567405bca0 msgr2=0x7f567414b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:37.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 shutdown_connections 2021-10-21T00:11:37.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.014+0000 7f5679f8c700 1 -- 172.21.15.41:0/364453523 wait complete. 2021-10-21T00:11:37.024 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 63 2021-10-21T00:11:37.032 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:11:37.033 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:11:37.033 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:11:37.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:11:37.039 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:11:37.039 DEBUG:teuthology.parallel:result is None 2021-10-21T00:11:37.042 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:11:37.042 DEBUG:teuthology.parallel:result is None 2021-10-21T00:11:37.043 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:11:37.113 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:11:37.121 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:11:37.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 Processor -- start 2021-10-21T00:11:37.148 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 -- start start 2021-10-21T00:11:37.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4e80b4380 0x7fd4e80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 0x7fd4e8062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80ae020 con 0x7fd4e80b1830 2021-10-21T00:11:37.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80ade00 con 0x7fd4e80b4380 2021-10-21T00:11:37.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e805fe50 con 0x7fd4e81433e0 2021-10-21T00:11:37.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4e80b4380 0x7fd4e80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4e80b4380 0x7fd4e80ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37228/0 (socket says 172.21.15.41:37228) 2021-10-21T00:11:37.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e67fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd4e80b1830 0x7fd4e805f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35000/0 (socket says 172.21.15.41:35000) 2021-10-21T00:11:37.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/954346067 learned_addr learned my addr 172.21.15.41:0/954346067 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:37.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e77fe700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 0x7fd4e8062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.153 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/954346067 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 msgr2=0x7fd4e8062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 0x7fd4e8062940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/954346067 >> v1:172.21.15.41:6789/0 conn(0x7fd4e80b1830 legacy=0x7fd4e805f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e5ffb700 1 -- 172.21.15.41:0/954346067 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623644298 0 0) 0x7fd4e80ae020 con 0x7fd4e80b1830 2021-10-21T00:11:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/954346067 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80b4760 con 0x7fd4e80b4380 2021-10-21T00:11:37.154 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e77fe700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 0x7fd4e8062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:37.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e6ffd700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e80b4380 0x7fd4e80ad910 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fd4d8002f70 tx=0x7fd4d8006eb0).ready entity=mon.0 client_cookie=d6d59d49e93fc23f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:37.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e5ffb700 1 -- 172.21.15.41:0/954346067 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d800d5c0 con 0x7fd4e80b4380 2021-10-21T00:11:37.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e5ffb700 1 -- 172.21.15.41:0/954346067 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8000e90 con 0x7fd4e80b4380 2021-10-21T00:11:37.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.142+0000 7fd4e5ffb700 1 -- 172.21.15.41:0/954346067 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d800d910 con 0x7fd4e80b4380 2021-10-21T00:11:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- 172.21.15.41:0/954346067 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e80b4380 msgr2=0x7fd4e80ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e80b4380 0x7fd4e80ad910 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fd4d8002f70 tx=0x7fd4d8006eb0).stop 2021-10-21T00:11:37.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- 172.21.15.41:0/954346067 shutdown_connections 2021-10-21T00:11:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e81433e0 0x7fd4e8062940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/954346067 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e80b4380 0x7fd4e80ad910 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- 172.21.15.41:0/954346067 >> 172.21.15.41:0/954346067 conn(0x7fd4e80b7910 msgr2=0x7fd4e80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:37.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- 172.21.15.41:0/954346067 shutdown_connections 2021-10-21T00:11:37.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- 172.21.15.41:0/954346067 wait complete. 2021-10-21T00:11:37.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 Processor -- start 2021-10-21T00:11:37.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.146+0000 7fd4e7fff700 1 -- start start 2021-10-21T00:11:37.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e80b4380 0x7fd4e809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 0x7fd4e81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8152330 con 0x7fd4e81433e0 2021-10-21T00:11:37.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81525d0 con 0x7fd4e80b1830 2021-10-21T00:11:37.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8152870 con 0x7fd4e80b4380 2021-10-21T00:11:37.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e77fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 0x7fd4e81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e67fc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e80b4380 0x7fd4e809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49152/0 (socket says 172.21.15.41:49152) 2021-10-21T00:11:37.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/1948768050 learned_addr learned my addr 172.21.15.41:0/1948768050 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:37.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e80b4380 msgr2=0x7fd4e809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e80b4380 0x7fd4e809a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/1948768050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 msgr2=0x7fd4e81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:37.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 0x7fd4e81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:37.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 -- 172.21.15.41:0/1948768050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d800b1e0 con 0x7fd4e80b1830 2021-10-21T00:11:37.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e77fe700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 0x7fd4e81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:37.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.150+0000 7fd4e6ffd700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fd4d8002f70 tx=0x7fd4d8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:37.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d800d940 con 0x7fd4e80b1830 2021-10-21T00:11:37.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8011b40 con 0x7fd4e80b1830 2021-10-21T00:11:37.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e809a5b0 con 0x7fd4e80b1830 2021-10-21T00:11:37.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d8011ea0 con 0x7fd4e80b1830 2021-10-21T00:11:37.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e8065ef0 con 0x7fd4e80b1830 2021-10-21T00:11:37.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8152a30 con 0x7fd4e80b1830 2021-10-21T00:11:37.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4d8025030 con 0x7fd4e80b1830 2021-10-21T00:11:37.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 0x7fd4c4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:37.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd4d806c960 con 0x7fd4e80b1830 2021-10-21T00:11:37.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4e67fc700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 0x7fd4c4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:37.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.154+0000 7fd4e67fc700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 0x7fd4c4055ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fd4dc00d000 tx=0x7fd4dc007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:37.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.158+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4d8043d00 con 0x7fd4e80b1830 2021-10-21T00:11:37.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:37.298+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fd4e8142ca0 con 0x7fd4e80b1830 2021-10-21T00:11:38.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.158+0000 7fd4d7fff700 1 -- 172.21.15.41:0/1948768050 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd4d8023070 con 0x7fd4e80b1830 2021-10-21T00:11:38.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 msgr2=0x7fd4c4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 0x7fd4c4055ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fd4dc00d000 tx=0x7fd4dc007a00).stop 2021-10-21T00:11:38.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 msgr2=0x7fd4e8152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fd4d8002f70 tx=0x7fd4d8015000).stop 2021-10-21T00:11:38.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 shutdown_connections 2021-10-21T00:11:38.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4c4053610 0x7fd4c4055ad0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4e81433e0 0x7fd4e81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4e80b4380 0x7fd4e809a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 --2- 172.21.15.41:0/1948768050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4e80b1830 0x7fd4e8152d10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 >> 172.21.15.41:0/1948768050 conn(0x7fd4e80b7910 msgr2=0x7fd4e80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 shutdown_connections 2021-10-21T00:11:38.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.162+0000 7fd4e7fff700 1 -- 172.21.15.41:0/1948768050 wait complete. 2021-10-21T00:11:38.174 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:11:38.185 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:11:38.188 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:11:38.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 Processor -- start 2021-10-21T00:11:38.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 -- start start 2021-10-21T00:11:38.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab4805f9f0 0x7fab480b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4805fdd0 con 0x7fab480b3370 2021-10-21T00:11:38.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48140400 con 0x7fab480b0730 2021-10-21T00:11:38.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab480b27c0 con 0x7fab4805f9f0 2021-10-21T00:11:38.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab46d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fab480b3370 0x7fab48138b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35018/0 (socket says 172.21.15.41:35018) 2021-10-21T00:11:38.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab46d9d700 1 -- 172.21.15.41:0/745086966 learned_addr learned my addr 172.21.15.41:0/745086966 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:38.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4659c700 1 --2- 172.21.15.41:0/745086966 >> v2:172.21.15.62:3300/0 conn(0x7fab4805f9f0 0x7fab480b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139666369 0 0) 0x7fab4805fdd0 con 0x7fab480b3370 2021-10-21T00:11:38.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2c003260 con 0x7fab480b3370 2021-10-21T00:11:38.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498027484 0 0) 0x7fab48140400 con 0x7fab480b0730 2021-10-21T00:11:38.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4805fdd0 con 0x7fab480b0730 2021-10-21T00:11:38.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4659c700 1 -- 172.21.15.41:0/745086966 >> v1:172.21.15.62:6789/0 conn(0x7fab480b0730 legacy=0x7fab480b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204474218 0 0) 0x7fab2c003260 con 0x7fab480b3370 2021-10-21T00:11:38.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4659c700 1 -- 172.21.15.41:0/745086966 >> v1:172.21.15.41:6789/0 conn(0x7fab480b3370 legacy=0x7fab48138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4659c700 1 -- 172.21.15.41:0/745086966 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48140080 con 0x7fab4805f9f0 2021-10-21T00:11:38.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4659c700 1 --2- 172.21.15.41:0/745086966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4805f9f0 0x7fab480b0e50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fab40001490 tx=0x7fab38006d90).ready entity=mon.1 client_cookie=820eaf381bea9f23 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab400019e0 con 0x7fab4805f9f0 2021-10-21T00:11:38.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38000e90 con 0x7fab4805f9f0 2021-10-21T00:11:38.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.294+0000 7fab4559a700 1 -- 172.21.15.41:0/745086966 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3800bee0 con 0x7fab4805f9f0 2021-10-21T00:11:38.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- 172.21.15.41:0/745086966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4805f9f0 msgr2=0x7fab480b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 --2- 172.21.15.41:0/745086966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4805f9f0 0x7fab480b0e50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fab40001490 tx=0x7fab38006d90).stop 2021-10-21T00:11:38.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- 172.21.15.41:0/745086966 shutdown_connections 2021-10-21T00:11:38.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 --2- 172.21.15.41:0/745086966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4805f9f0 0x7fab480b0e50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- 172.21.15.41:0/745086966 >> 172.21.15.41:0/745086966 conn(0x7fab480637b0 msgr2=0x7fab48063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- 172.21.15.41:0/745086966 shutdown_connections 2021-10-21T00:11:38.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- 172.21.15.41:0/745086966 wait complete. 2021-10-21T00:11:38.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 Processor -- start 2021-10-21T00:11:38.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 -- start start 2021-10-21T00:11:38.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.298+0000 7fab4759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab480b0730 0x7fab4813ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab480b3370 0x7fab48136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48138090 con 0x7fab4805f9f0 2021-10-21T00:11:38.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48136c40 con 0x7fab480b3370 2021-10-21T00:11:38.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48064790 con 0x7fab480b0730 2021-10-21T00:11:38.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37252/0 (socket says 172.21.15.41:37252) 2021-10-21T00:11:38.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 -- 172.21.15.41:0/3818793292 learned_addr learned my addr 172.21.15.41:0/3818793292 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:38.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab46d9d700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab480b3370 0x7fab48136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab45d9b700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab480b0730 0x7fab4813ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 -- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab480b0730 msgr2=0x7fab4813ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab480b0730 0x7fab4813ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 -- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab480b3370 msgr2=0x7fab48136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab480b3370 0x7fab48136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 -- 172.21.15.41:0/3818793292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3800b120 con 0x7fab4805f9f0 2021-10-21T00:11:38.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4659c700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fab40001490 tx=0x7fab38014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3800bee0 con 0x7fab4805f9f0 2021-10-21T00:11:38.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800ee40 con 0x7fab4805f9f0 2021-10-21T00:11:38.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab481553e0 con 0x7fab4805f9f0 2021-10-21T00:11:38.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab38011d70 con 0x7fab4805f9f0 2021-10-21T00:11:38.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48136370 con 0x7fab4805f9f0 2021-10-21T00:11:38.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.302+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab480645d0 con 0x7fab4805f9f0 2021-10-21T00:11:38.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.306+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab38023020 con 0x7fab4805f9f0 2021-10-21T00:11:38.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.306+0000 7fab377fe700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 0x7fab24055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.306+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fab3806c2c0 con 0x7fab4805f9f0 2021-10-21T00:11:38.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.306+0000 7fab45d9b700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 0x7fab24055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.306+0000 7fab45d9b700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 0x7fab24055a40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fab3c00d000 tx=0x7fab3c007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.310+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab38043800 con 0x7fab4805f9f0 2021-10-21T00:11:38.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.486+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fab48064950 con 0x7fab4805f9f0 2021-10-21T00:11:38.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.486+0000 7fab377fe700 1 -- 172.21.15.41:0/3818793292 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v38) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fab38015090 con 0x7fab4805f9f0 2021-10-21T00:11:38.494 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:38.495 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:38.495 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:11:38.496 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.496 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:11:38.497 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:11:38.497 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.497 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:38.498 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.498 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.499 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.499 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.500 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.500 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.501 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:11:38.501 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:11:38.501 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.502 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:38.502 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.503 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.503 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.504 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.504 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.505 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:11:38.505 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:11:38.506 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.506 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.506 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.507 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.507 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.508 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.508 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.509 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:11:38.509 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:11:38.509 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.510 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.510 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.511 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.511 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.512 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.512 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.512 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:11:38.513 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:11:38.514 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.514 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.514 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.515 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.515 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.515 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.515 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.516 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:11:38.516 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:11:38.516 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.516 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.516 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.517 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.517 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.517 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.517 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.518 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:11:38.518 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:11:38.518 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.518 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.518 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.519 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.519 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.519 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.519 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.519 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:11:38.520 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:11:38.520 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.520 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.520 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.521 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.521 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.521 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.521 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.521 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:11:38.522 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:11:38.522 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.522 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.522 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.522 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.523 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.523 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.523 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.523 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:11:38.524 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:11:38.524 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.524 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.524 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.524 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.525 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.525 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.525 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:11:38.525 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:11:38.526 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.526 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:38.526 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:38.526 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:38.527 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.527 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.527 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.527 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:11:38.528 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:11:38.528 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.528 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:38.528 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:38.529 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:38.529 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.529 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.529 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.529 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:11:38.530 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:11:38.530 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.530 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:11:38.530 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:11:38.531 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:11:38.531 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.531 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.531 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.531 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:11:38.532 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:11:38.532 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.532 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:38.532 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:11:38.532 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:11:38.533 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.533 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.533 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.533 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.533 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:11:38.534 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:11:38.534 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.534 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:38.534 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:11:38.535 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.535 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.535 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:38.535 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:38.535 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:11:38.536 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:11:38.536 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:11:38.536 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:11:38.536 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:11:38.537 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:11:38.537 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.537 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:38.537 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:38.537 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 msgr2=0x7fab24055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 0x7fab24055a40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fab3c00d000 tx=0x7fab3c007a20).stop 2021-10-21T00:11:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 msgr2=0x7fab480af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fab40001490 tx=0x7fab38014000).stop 2021-10-21T00:11:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 shutdown_connections 2021-10-21T00:11:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fab24053580 0x7fab24055a40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab480b3370 0x7fab48136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab480b0730 0x7fab4813ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 --2- 172.21.15.41:0/3818793292 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fab4805f9f0 0x7fab480af820 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 >> 172.21.15.41:0/3818793292 conn(0x7fab480637b0 msgr2=0x7fab480b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 shutdown_connections 2021-10-21T00:11:38.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.490+0000 7fab4759e700 1 -- 172.21.15.41:0/3818793292 wait complete. 2021-10-21T00:11:38.543 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:38.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 Processor -- start 2021-10-21T00:11:38.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 -- start start 2021-10-21T00:11:38.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e00062330 0x7f3e000b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e000b3a20 0x7f3e0013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0005bd40 con 0x7f3e00062f70 2021-10-21T00:11:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0005bf70 con 0x7f3e00062330 2021-10-21T00:11:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e07239700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e00142cb0 con 0x7f3e000b3a20 2021-10-21T00:11:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e00062330 0x7f3e000b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3e00062330 0x7f3e000b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37258/0 (socket says 172.21.15.41:37258) 2021-10-21T00:11:38.651 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 -- 172.21.15.41:0/2888426403 learned_addr learned my addr 172.21.15.41:0/2888426403 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:38.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06a38700 1 --2- 172.21.15.41:0/2888426403 >> v2:172.21.15.62:3300/0 conn(0x7f3e000b3a20 0x7f3e0013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 -- 172.21.15.41:0/2888426403 >> v2:172.21.15.62:3300/0 conn(0x7f3e000b3a20 msgr2=0x7f3e0013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:38.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 --2- 172.21.15.41:0/2888426403 >> v2:172.21.15.62:3300/0 conn(0x7f3e000b3a20 0x7f3e0013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 -- 172.21.15.41:0/2888426403 >> v1:172.21.15.41:6789/0 conn(0x7f3e00062f70 legacy=0x7f3e0005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 -- 172.21.15.41:0/2888426403 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00142950 con 0x7f3e00062330 2021-10-21T00:11:38.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e06237700 1 --2- 172.21.15.41:0/2888426403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e00062330 0x7f3e000b3f30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f3dfc002f70 tx=0x7f3dfc006eb0).ready entity=mon.0 client_cookie=869531083f3999e7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e05235700 1 -- 172.21.15.41:0/2888426403 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc00d5c0 con 0x7f3e00062330 2021-10-21T00:11:38.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e05235700 1 -- 172.21.15.41:0/2888426403 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc000e90 con 0x7f3e00062330 2021-10-21T00:11:38.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.642+0000 7f3e05235700 1 -- 172.21.15.41:0/2888426403 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc00d950 con 0x7f3e00062330 2021-10-21T00:11:38.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- 172.21.15.41:0/2888426403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e00062330 msgr2=0x7f3e000b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 --2- 172.21.15.41:0/2888426403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e00062330 0x7f3e000b3f30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f3dfc002f70 tx=0x7f3dfc006eb0).stop 2021-10-21T00:11:38.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- 172.21.15.41:0/2888426403 shutdown_connections 2021-10-21T00:11:38.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 --2- 172.21.15.41:0/2888426403 >> v2:172.21.15.62:3300/0 conn(0x7f3e000b3a20 0x7f3e0013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 --2- 172.21.15.41:0/2888426403 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e00062330 0x7f3e000b3f30 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- 172.21.15.41:0/2888426403 >> 172.21.15.41:0/2888426403 conn(0x7f3e000b9080 msgr2=0x7f3e000b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.656 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- 172.21.15.41:0/2888426403 shutdown_connections 2021-10-21T00:11:38.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- 172.21.15.41:0/2888426403 wait complete. 2021-10-21T00:11:38.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 Processor -- start 2021-10-21T00:11:38.657 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.646+0000 7f3e07239700 1 -- start start 2021-10-21T00:11:38.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e00062f70 0x7f3e00146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001138c0 con 0x7f3e000b3a20 2021-10-21T00:11:38.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00113b60 con 0x7f3e00062f70 2021-10-21T00:11:38.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00144150 con 0x7f3e00062330 2021-10-21T00:11:38.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06a38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:55762/0 (socket says 172.21.15.41:55762) 2021-10-21T00:11:38.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06a38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37266/0 (socket says 172.21.15.41:37266) 2021-10-21T00:11:38.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 -- 172.21.15.41:0/1307044283 learned_addr learned my addr 172.21.15.41:0/1307044283 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:38.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e05a36700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e00062f70 0x7f3e00146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 -- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e00062f70 msgr2=0x7f3e00146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e00062f70 0x7f3e00146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 -- 172.21.15.41:0/1307044283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 msgr2=0x7f3e00155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 -- 172.21.15.41:0/1307044283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc00b1e0 con 0x7f3e00062330 2021-10-21T00:11:38.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06a38700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:38.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e06237700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3dfc002f70 tx=0x7f3dfc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc006b40 con 0x7f3e00062330 2021-10-21T00:11:38.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00d940 con 0x7f3e00062330 2021-10-21T00:11:38.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e00146560 con 0x7f3e00062330 2021-10-21T00:11:38.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc011cf0 con 0x7f3e00062330 2021-10-21T00:11:38.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e001445f0 con 0x7f3e00062330 2021-10-21T00:11:38.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.650+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e00057350 con 0x7f3e00062330 2021-10-21T00:11:38.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.654+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3dfc025030 con 0x7f3e00062330 2021-10-21T00:11:38.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.654+0000 7f3def7fe700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 0x7f3de0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.654+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3dfc06c6b0 con 0x7f3e00062330 2021-10-21T00:11:38.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.654+0000 7f3e05a36700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 0x7f3de0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.667 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.654+0000 7f3e05a36700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 0x7f3de0055b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3df000d000 tx=0x7f3df0007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.662+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3dfc043b40 con 0x7f3e00062330 2021-10-21T00:11:38.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.786+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e0005d080 con 0x7f3e00062330 2021-10-21T00:11:38.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3def7fe700 1 -- 172.21.15.41:0/1307044283 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f3dfc023020 con 0x7f3e00062330 2021-10-21T00:11:38.797 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:38.797 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":123,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:38.149704+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:38.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 msgr2=0x7f3de0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 0x7f3de0055b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3df000d000 tx=0x7f3df0007b90).stop 2021-10-21T00:11:38.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 msgr2=0x7f3e00145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3dfc002f70 tx=0x7f3dfc015000).stop 2021-10-21T00:11:38.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 shutdown_connections 2021-10-21T00:11:38.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3de00536d0 0x7f3de0055b90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3e000b3a20 0x7f3e00155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e00062f70 0x7f3e00146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 --2- 172.21.15.41:0/1307044283 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e00062330 0x7f3e00145b80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 >> 172.21.15.41:0/1307044283 conn(0x7f3e000b9080 msgr2=0x7f3e000b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 shutdown_connections 2021-10-21T00:11:38.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.790+0000 7f3e07239700 1 -- 172.21.15.41:0/1307044283 wait complete. 2021-10-21T00:11:38.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:11:38.815 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:38.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.918+0000 7fafa70de700 1 Processor -- start 2021-10-21T00:11:38.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.918+0000 7fafa70de700 1 -- start start 2021-10-21T00:11:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 0x7fafa00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00ba080 con 0x7fafa00b9ca0 2021-10-21T00:11:38.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa005c670 con 0x7fafa00b26d0 2021-10-21T00:11:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa005c8e0 con 0x7fafa00b0690 2021-10-21T00:11:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa4e7a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fafa00b9ca0 0x7fafa00b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35042/0 (socket says 172.21.15.41:35042) 2021-10-21T00:11:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa4e7a700 1 -- 172.21.15.41:0/1103347379 learned_addr learned my addr 172.21.15.41:0/1103347379 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:38.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9ffff700 1 --2- 172.21.15.41:0/1103347379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 0x7fafa00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658928114 0 0) 0x7fafa00ba080 con 0x7fafa00b9ca0 2021-10-21T00:11:38.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf80003260 con 0x7fafa00b9ca0 2021-10-21T00:11:38.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116676450 0 0) 0x7fafa005c670 con 0x7fafa00b26d0 2021-10-21T00:11:38.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa00ba080 con 0x7fafa00b26d0 2021-10-21T00:11:38.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9ffff700 1 -- 172.21.15.41:0/1103347379 >> v1:172.21.15.62:6789/0 conn(0x7fafa00b26d0 legacy=0x7fafa0141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9ffff700 1 -- 172.21.15.41:0/1103347379 >> v1:172.21.15.41:6789/0 conn(0x7fafa00b9ca0 legacy=0x7fafa00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564665493 0 0) 0x7faf80003260 con 0x7fafa00b9ca0 2021-10-21T00:11:38.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9ffff700 1 -- 172.21.15.41:0/1103347379 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa005cb80 con 0x7fafa00b0690 2021-10-21T00:11:38.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9ffff700 1 --2- 172.21.15.41:0/1103347379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 0x7fafa00b31e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7faf88001800 tx=0x7faf90006df0).ready entity=mon.2 client_cookie=ec2ecfa8b9cf049b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88001660 con 0x7fafa00b0690 2021-10-21T00:11:38.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf90000e90 con 0x7fafa00b0690 2021-10-21T00:11:38.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7faf9f7fe700 1 -- 172.21.15.41:0/1103347379 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf90012460 con 0x7fafa00b0690 2021-10-21T00:11:38.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- 172.21.15.41:0/1103347379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 msgr2=0x7fafa00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 --2- 172.21.15.41:0/1103347379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 0x7fafa00b31e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7faf88001800 tx=0x7faf90006df0).stop 2021-10-21T00:11:38.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- 172.21.15.41:0/1103347379 shutdown_connections 2021-10-21T00:11:38.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 --2- 172.21.15.41:0/1103347379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b0690 0x7fafa00b31e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- 172.21.15.41:0/1103347379 >> 172.21.15.41:0/1103347379 conn(0x7fafa0062f00 msgr2=0x7fafa00b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:38.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- 172.21.15.41:0/1103347379 shutdown_connections 2021-10-21T00:11:38.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.922+0000 7fafa70de700 1 -- 172.21.15.41:0/1103347379 wait complete. 2021-10-21T00:11:38.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 Processor -- start 2021-10-21T00:11:38.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- start start 2021-10-21T00:11:38.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa00b0690 0x7fafa01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 0x7fafa01127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00addc0 con 0x7fafa00b26d0 2021-10-21T00:11:38.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00ae100 con 0x7fafa00b0690 2021-10-21T00:11:38.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00ada40 con 0x7fafa00b9ca0 2021-10-21T00:11:38.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa4e7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa00b0690 0x7fafa01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37280/0 (socket says 172.21.15.41:37280) 2021-10-21T00:11:38.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 -- 172.21.15.41:0/1759184735 learned_addr learned my addr 172.21.15.41:0/1759184735 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:38.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa567b700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 0x7fafa01127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 -- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 msgr2=0x7fafa01127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 0x7fafa01127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 -- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa00b0690 msgr2=0x7fafa01552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:38.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa00b0690 0x7fafa01552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:38.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 -- 172.21.15.41:0/1759184735 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9000b180 con 0x7fafa00b26d0 2021-10-21T00:11:38.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa567b700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 0x7fafa01127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:38.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9ffff700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7faf88001800 tx=0x7faf90014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf90016070 con 0x7fafa00b26d0 2021-10-21T00:11:38.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf90002f50 con 0x7fafa00b26d0 2021-10-21T00:11:38.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf90012460 con 0x7fafa00b26d0 2021-10-21T00:11:38.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa00acf30 con 0x7fafa00b26d0 2021-10-21T00:11:38.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa00acc40 con 0x7fafa00b26d0 2021-10-21T00:11:38.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf9000f030 con 0x7fafa00b26d0 2021-10-21T00:11:38.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.926+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa00adf60 con 0x7fafa00b26d0 2021-10-21T00:11:38.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.930+0000 7faf9dffb700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 0x7faf84055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:38.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.930+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7faf9006bff0 con 0x7fafa00b26d0 2021-10-21T00:11:38.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.930+0000 7fafa4e7a700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 0x7faf84055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:38.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.930+0000 7fafa4e7a700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 0x7faf84055a70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7faf8800d000 tx=0x7faf88001760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:38.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:38.930+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fafa00adf60 con 0x7fafa00b26d0 2021-10-21T00:11:39.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.058+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fafa00adf60 con 0x7fafa00b26d0 2021-10-21T00:11:39.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.058+0000 7faf9dffb700 1 -- 172.21.15.41:0/1759184735 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v123) v1 ==== 110+0+10 (secure 0 0 0) 0x7fafa00adf60 con 0x7fafa00b26d0 2021-10-21T00:11:39.067 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:39.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 msgr2=0x7faf84055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 0x7faf84055a70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7faf8800d000 tx=0x7faf88001760).stop 2021-10-21T00:11:39.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 msgr2=0x7fafa0149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7faf88001800 tx=0x7faf90014000).stop 2021-10-21T00:11:39.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 shutdown_connections 2021-10-21T00:11:39.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf840535b0 0x7faf84055a70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fafa00b9ca0 0x7fafa01127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fafa00b26d0 0x7fafa0149d90 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 --2- 172.21.15.41:0/1759184735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa00b0690 0x7fafa01552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 >> 172.21.15.41:0/1759184735 conn(0x7fafa0062f00 msgr2=0x7fafa005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 shutdown_connections 2021-10-21T00:11:39.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.062+0000 7fafa70de700 1 -- 172.21.15.41:0/1759184735 wait complete. 2021-10-21T00:11:39.079 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:39.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.182+0000 7f287e823700 1 Processor -- start 2021-10-21T00:11:39.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.182+0000 7f287e823700 1 -- start start 2021-10-21T00:11:39.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28780b9ca0 0x7f28780b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780ba080 con 0x7f28780b31e0 2021-10-21T00:11:39.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287805c670 con 0x7f28780b26d0 2021-10-21T00:11:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287805c8e0 con 0x7f28780b9ca0 2021-10-21T00:11:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f28777fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f28780b31e0 0x7f28780b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35058/0 (socket says 172.21.15.41:35058) 2021-10-21T00:11:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2877fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f28780b9ca0 0x7f28780b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f28777fe700 1 -- 172.21.15.41:0/2921128837 learned_addr learned my addr 172.21.15.41:0/2921128837 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:39.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940140052 0 0) 0x7f28780ba080 con 0x7f28780b31e0 2021-10-21T00:11:39.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2864003260 con 0x7f28780b31e0 2021-10-21T00:11:39.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2877fff700 1 -- 172.21.15.41:0/2921128837 >> v1:172.21.15.62:6789/0 conn(0x7f28780b26d0 legacy=0x7f2878141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029963099 0 0) 0x7f287805c670 con 0x7f28780b26d0 2021-10-21T00:11:39.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2877fff700 1 -- 172.21.15.41:0/2921128837 >> v1:172.21.15.41:6789/0 conn(0x7f28780b31e0 legacy=0x7f28780b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2877fff700 1 -- 172.21.15.41:0/2921128837 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287805cb80 con 0x7f28780b9ca0 2021-10-21T00:11:39.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2877fff700 1 --2- 172.21.15.41:0/2921128837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b9ca0 0x7f28780b0690 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f286c002f70 tx=0x7f286c006df0).ready entity=mon.0 client_cookie=1cbc06e505e18c52 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c00d610 con 0x7f28780b9ca0 2021-10-21T00:11:39.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c000e90 con 0x7f28780b9ca0 2021-10-21T00:11:39.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f2876ffd700 1 -- 172.21.15.41:0/2921128837 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c00d960 con 0x7f28780b9ca0 2021-10-21T00:11:39.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- 172.21.15.41:0/2921128837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b9ca0 msgr2=0x7f28780b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 --2- 172.21.15.41:0/2921128837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b9ca0 0x7f28780b0690 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f286c002f70 tx=0x7f286c006df0).stop 2021-10-21T00:11:39.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- 172.21.15.41:0/2921128837 shutdown_connections 2021-10-21T00:11:39.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 --2- 172.21.15.41:0/2921128837 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b9ca0 0x7f28780b0690 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- 172.21.15.41:0/2921128837 >> 172.21.15.41:0/2921128837 conn(0x7f2878062f00 msgr2=0x7f28780b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- 172.21.15.41:0/2921128837 shutdown_connections 2021-10-21T00:11:39.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.186+0000 7f287e823700 1 -- 172.21.15.41:0/2921128837 wait complete. 2021-10-21T00:11:39.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 Processor -- start 2021-10-21T00:11:39.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 -- start start 2021-10-21T00:11:39.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28780b31e0 0x7f287813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28780b9ca0 0x7f287813d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28780ad340 con 0x7f28780b26d0 2021-10-21T00:11:39.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781456b0 con 0x7f28780b9ca0 2021-10-21T00:11:39.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287e823700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2878145910 con 0x7f28780b31e0 2021-10-21T00:11:39.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f2877fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f2877fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37292/0 (socket says 172.21.15.41:37292) 2021-10-21T00:11:39.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f2877fff700 1 -- 172.21.15.41:0/3042789650 learned_addr learned my addr 172.21.15.41:0/3042789650 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:39.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f28777fe700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28780b31e0 0x7f287813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.190+0000 7f287cdc0700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28780b9ca0 0x7f287813d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 -- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28780b31e0 msgr2=0x7f287813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28780b31e0 0x7f287813d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 -- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28780b9ca0 msgr2=0x7f287813d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28780b9ca0 0x7f287813d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 -- 172.21.15.41:0/3042789650 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c00b180 con 0x7f28780b26d0 2021-10-21T00:11:39.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f2877fff700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f286c002f70 tx=0x7f286c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c013de0 con 0x7f28780b26d0 2021-10-21T00:11:39.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00d290 con 0x7f28780b26d0 2021-10-21T00:11:39.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287813f7b0 con 0x7f28780b26d0 2021-10-21T00:11:39.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c01e5f0 con 0x7f28780b26d0 2021-10-21T00:11:39.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781442a0 con 0x7f28780b26d0 2021-10-21T00:11:39.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f286c025030 con 0x7f28780b26d0 2021-10-21T00:11:39.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878057350 con 0x7f28780b26d0 2021-10-21T00:11:39.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 0x7f2858055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f286c06c270 con 0x7f28780b26d0 2021-10-21T00:11:39.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.194+0000 7f28777fe700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 0x7f2858055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.198+0000 7f28777fe700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 0x7f2858055ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f286800d000 tx=0x7f2868009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.198+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f286c043700 con 0x7f28780b26d0 2021-10-21T00:11:39.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.326+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2878067c90 con 0x7f28780b26d0 2021-10-21T00:11:39.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.326+0000 7f28757fa700 1 -- 172.21.15.41:0/3042789650 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7f286c0230a0 con 0x7f28780b26d0 2021-10-21T00:11:39.335 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 msgr2=0x7f2858055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 0x7f2858055ad0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f286800d000 tx=0x7f2868009040).stop 2021-10-21T00:11:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 msgr2=0x7f28780acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f286c002f70 tx=0x7f286c014000).stop 2021-10-21T00:11:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 shutdown_connections 2021-10-21T00:11:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2858053610 0x7f2858055ad0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28780b9ca0 0x7f287813d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f28780b31e0 0x7f287813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 --2- 172.21.15.41:0/3042789650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f28780b26d0 0x7f28780acbd0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 >> 172.21.15.41:0/3042789650 conn(0x7f2878062f00 msgr2=0x7f28780b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 shutdown_connections 2021-10-21T00:11:39.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.330+0000 7f287e823700 1 -- 172.21.15.41:0/3042789650 wait complete. 2021-10-21T00:11:39.347 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:11:39.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 Processor -- start 2021-10-21T00:11:39.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- start start 2021-10-21T00:11:39.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 0x7f678814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f678814b350 0x7f67880af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880609d0 con 0x7f67880aa750 2021-10-21T00:11:39.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880b1620 con 0x7f678814b350 2021-10-21T00:11:39.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678805fdd0 con 0x7f678805f9f0 2021-10-21T00:11:39.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f678814b350 0x7f67880af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f678814b350 0x7f67880af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37304/0 (socket says 172.21.15.41:37304) 2021-10-21T00:11:39.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 -- 172.21.15.41:0/3603616823 learned_addr learned my addr 172.21.15.41:0/3603616823 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:39.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678d329700 1 --2- 172.21.15.41:0/3603616823 >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 0x7f678814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 -- 172.21.15.41:0/3603616823 >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 msgr2=0x7f678814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:39.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 --2- 172.21.15.41:0/3603616823 >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 0x7f678814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 -- 172.21.15.41:0/3603616823 >> v1:172.21.15.62:6789/0 conn(0x7f67880aa750 legacy=0x7f678814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f677ffff700 1 -- 172.21.15.41:0/3603616823 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911741556 0 0) 0x7f67880609d0 con 0x7f67880aa750 2021-10-21T00:11:39.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 -- 172.21.15.41:0/3603616823 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880b1380 con 0x7f678814b350 2021-10-21T00:11:39.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678d329700 1 --2- 172.21.15.41:0/3603616823 >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 0x7f678814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:39.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678db2a700 1 --2- 172.21.15.41:0/3603616823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880af7c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f67800032f0 tx=0x7f6780009290).ready entity=mon.0 client_cookie=501a23e287ec9fbc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f677ffff700 1 -- 172.21.15.41:0/3603616823 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f678000b870 con 0x7f678814b350 2021-10-21T00:11:39.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f677ffff700 1 -- 172.21.15.41:0/3603616823 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000b9d0 con 0x7f678814b350 2021-10-21T00:11:39.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f677ffff700 1 -- 172.21.15.41:0/3603616823 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f678000bb40 con 0x7f678814b350 2021-10-21T00:11:39.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- 172.21.15.41:0/3603616823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 msgr2=0x7f67880af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 --2- 172.21.15.41:0/3603616823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880af7c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f67800032f0 tx=0x7f6780009290).stop 2021-10-21T00:11:39.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- 172.21.15.41:0/3603616823 shutdown_connections 2021-10-21T00:11:39.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 --2- 172.21.15.41:0/3603616823 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880af7c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 --2- 172.21.15.41:0/3603616823 >> v2:172.21.15.62:3300/0 conn(0x7f678805f9f0 0x7f678814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- 172.21.15.41:0/3603616823 >> 172.21.15.41:0/3603616823 conn(0x7f678805bca0 msgr2=0x7f678805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.442+0000 7f678f58d700 1 -- 172.21.15.41:0/3603616823 shutdown_connections 2021-10-21T00:11:39.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.446+0000 7f678f58d700 1 -- 172.21.15.41:0/3603616823 wait complete. 2021-10-21T00:11:39.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.446+0000 7f678f58d700 1 Processor -- start 2021-10-21T00:11:39.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.446+0000 7f678f58d700 1 -- start start 2021-10-21T00:11:39.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 0x7f67880acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 0x7f678814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678814d460 con 0x7f678814b350 2021-10-21T00:11:39.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678814cee0 con 0x7f67880aa750 2021-10-21T00:11:39.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678814c9a0 con 0x7f678805f9f0 2021-10-21T00:11:39.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37310/0 (socket says 172.21.15.41:37310) 2021-10-21T00:11:39.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 -- 172.21.15.41:0/1214433036 learned_addr learned my addr 172.21.15.41:0/1214433036 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:39.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678d329700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 0x7f67880acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678cb28700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 0x7f678814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 -- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 msgr2=0x7f67880acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 0x7f67880acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 -- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 msgr2=0x7f678814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 0x7f678814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 -- 172.21.15.41:0/1214433036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009530 con 0x7f678814b350 2021-10-21T00:11:39.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678cb28700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 0x7f678814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:39.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678d329700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 0x7f67880acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:39.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678db2a700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f67800032f0 tx=0x7f6780016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f678000b870 con 0x7f678814b350 2021-10-21T00:11:39.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780020430 con 0x7f678814b350 2021-10-21T00:11:39.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f678000bee0 con 0x7f678814b350 2021-10-21T00:11:39.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678814cc40 con 0x7f678814b350 2021-10-21T00:11:39.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6788156250 con 0x7f678814b350 2021-10-21T00:11:39.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678814c7d0 con 0x7f678814b350 2021-10-21T00:11:39.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.450+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6780027070 con 0x7f678814b350 2021-10-21T00:11:39.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.454+0000 7f677e7fc700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 0x7f6770055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.454+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f678006c190 con 0x7f678814b350 2021-10-21T00:11:39.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.454+0000 7f678d329700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 0x7f6770055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.454+0000 7f678d329700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 0x7f6770055a70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f677800c000 tx=0x7f6778008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.458+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6780043510 con 0x7f678814b350 2021-10-21T00:11:39.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.582+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f67880678f0 con 0x7f678814b350 2021-10-21T00:11:39.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f677e7fc700 1 -- 172.21.15.41:0/1214433036 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v123) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6780015090 con 0x7f678814b350 2021-10-21T00:11:39.592 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:39.592 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:11:39.592 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:39.593 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:11:39.593 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:11:39.593 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:39.593 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:39.593 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:11:39.594 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:11:39.594 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:39.594 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:11:39.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 msgr2=0x7f6770055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 0x7f6770055a70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f677800c000 tx=0x7f6778008040).stop 2021-10-21T00:11:39.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 msgr2=0x7f67880ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f67800032f0 tx=0x7f6780016000).stop 2021-10-21T00:11:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 shutdown_connections 2021-10-21T00:11:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67700535b0 0x7f6770055a70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f678814b350 0x7f67880ae600 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67880aa750 0x7f678814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 --2- 172.21.15.41:0/1214433036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f678805f9f0 0x7f67880acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 >> 172.21.15.41:0/1214433036 conn(0x7f678805bca0 msgr2=0x7f678809a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 shutdown_connections 2021-10-21T00:11:39.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.586+0000 7f678f58d700 1 -- 172.21.15.41:0/1214433036 wait complete. 2021-10-21T00:11:39.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:11:39.606 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:11:39.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.710+0000 7efc9bfff700 1 Processor -- start 2021-10-21T00:11:39.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.710+0000 7efc9bfff700 1 -- start start 2021-10-21T00:11:39.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 0x7efc9c065570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c066490 con 0x7efc9c05bca0 2021-10-21T00:11:39.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c145f60 con 0x7efc9c0b2e00 2021-10-21T00:11:39.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c146db0 con 0x7efc9c05c080 2021-10-21T00:11:39.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9affd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7efc9c05bca0 0x7efc9c1466a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35084/0 (socket says 172.21.15.41:35084) 2021-10-21T00:11:39.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9affd700 1 -- 172.21.15.41:0/1761486912 learned_addr learned my addr 172.21.15.41:0/1761486912 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:39.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9b7fe700 1 --2- 172.21.15.41:0/1761486912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 0x7efc9c065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168951831 0 0) 0x7efc9c066490 con 0x7efc9c05bca0 2021-10-21T00:11:39.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc7c003260 con 0x7efc9c05bca0 2021-10-21T00:11:39.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470467276 0 0) 0x7efc9c145f60 con 0x7efc9c0b2e00 2021-10-21T00:11:39.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc9c066490 con 0x7efc9c0b2e00 2021-10-21T00:11:39.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9b7fe700 1 -- 172.21.15.41:0/1761486912 >> v1:172.21.15.62:6789/0 conn(0x7efc9c0b2e00 legacy=0x7efc9c142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9b7fe700 1 -- 172.21.15.41:0/1761486912 >> v1:172.21.15.41:6789/0 conn(0x7efc9c05bca0 legacy=0x7efc9c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9b7fe700 1 -- 172.21.15.41:0/1761486912 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c146200 con 0x7efc9c05c080 2021-10-21T00:11:39.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9b7fe700 1 --2- 172.21.15.41:0/1761486912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 0x7efc9c065570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7efc940032f0 tx=0x7efc940091d0).ready entity=mon.2 client_cookie=50926b72b74fffd7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9400b640 con 0x7efc9c05c080 2021-10-21T00:11:39.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9400b7a0 con 0x7efc9c05c080 2021-10-21T00:11:39.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9a7fc700 1 -- 172.21.15.41:0/1761486912 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9400b910 con 0x7efc9c05c080 2021-10-21T00:11:39.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- 172.21.15.41:0/1761486912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 msgr2=0x7efc9c065570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 --2- 172.21.15.41:0/1761486912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 0x7efc9c065570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7efc940032f0 tx=0x7efc940091d0).stop 2021-10-21T00:11:39.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- 172.21.15.41:0/1761486912 shutdown_connections 2021-10-21T00:11:39.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 --2- 172.21.15.41:0/1761486912 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c05c080 0x7efc9c065570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- 172.21.15.41:0/1761486912 >> 172.21.15.41:0/1761486912 conn(0x7efc9c069df0 msgr2=0x7efc9c063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:39.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- 172.21.15.41:0/1761486912 shutdown_connections 2021-10-21T00:11:39.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.714+0000 7efc9bfff700 1 -- 172.21.15.41:0/1761486912 wait complete. 2021-10-21T00:11:39.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 Processor -- start 2021-10-21T00:11:39.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 -- start start 2021-10-21T00:11:39.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c05bca0 0x7efc9c12a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c0b2e00 0x7efc9c128de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c13f1c0 con 0x7efc9c05c080 2021-10-21T00:11:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0b6a80 con 0x7efc9c05bca0 2021-10-21T00:11:39.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0b6620 con 0x7efc9c0b2e00 2021-10-21T00:11:39.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc927fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc927fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37322/0 (socket says 172.21.15.41:37322) 2021-10-21T00:11:39.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc927fc700 1 -- 172.21.15.41:0/2422449434 learned_addr learned my addr 172.21.15.41:0/2422449434 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:39.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9affd700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c05bca0 0x7efc9c12a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.718+0000 7efc9b7fe700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c0b2e00 0x7efc9c128de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 -- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c0b2e00 msgr2=0x7efc9c128de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c0b2e00 0x7efc9c128de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 -- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c05bca0 msgr2=0x7efc9c12a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:39.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c05bca0 0x7efc9c12a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:39.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 -- 172.21.15.41:0/2422449434 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94009470 con 0x7efc9c05c080 2021-10-21T00:11:39.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc927fc700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7efc84001110 tx=0x7efc84007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8400cde0 con 0x7efc9c05c080 2021-10-21T00:11:39.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84012400 con 0x7efc9c05c080 2021-10-21T00:11:39.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc84012760 con 0x7efc9c05c080 2021-10-21T00:11:39.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c13dca0 con 0x7efc9c05c080 2021-10-21T00:11:39.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c1292d0 con 0x7efc9c05c080 2021-10-21T00:11:39.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc84019030 con 0x7efc9c05c080 2021-10-21T00:11:39.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c142f90 con 0x7efc9c05c080 2021-10-21T00:11:39.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 0x7efc80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:39.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.722+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efc8406a900 con 0x7efc9c05c080 2021-10-21T00:11:39.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.726+0000 7efc9affd700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 0x7efc80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:39.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.726+0000 7efc9affd700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 0x7efc80055b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7efc8c00d000 tx=0x7efc8c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:39.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.730+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc84041d90 con 0x7efc9c05c080 2021-10-21T00:11:39.862 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:39.854+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7efc9c13da90 con 0x7efc9c05c080 2021-10-21T00:11:40.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.534+0000 7efc98ff9700 1 -- 172.21.15.41:0/2422449434 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v124) v1 ==== 133+0+0 (secure 0 0 0) 0x7efc840453b0 con 0x7efc9c05c080 2021-10-21T00:11:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 msgr2=0x7efc80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 0x7efc80055b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7efc8c00d000 tx=0x7efc8c009040).stop 2021-10-21T00:11:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 msgr2=0x7efc9c1288f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7efc84001110 tx=0x7efc84007a90).stop 2021-10-21T00:11:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 shutdown_connections 2021-10-21T00:11:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc800536a0 0x7efc80055b60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc9c0b2e00 0x7efc9c128de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc9c05c080 0x7efc9c1288f0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 --2- 172.21.15.41:0/2422449434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c05bca0 0x7efc9c12a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 >> 172.21.15.41:0/2422449434 conn(0x7efc9c069df0 msgr2=0x7efc9c065d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 shutdown_connections 2021-10-21T00:11:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.538+0000 7efc9bfff700 1 -- 172.21.15.41:0/2422449434 wait complete. 2021-10-21T00:11:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:11:40.558 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:11:40.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 Processor -- start 2021-10-21T00:11:40.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 -- start start 2021-10-21T00:11:40.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a50062330 0x7f4a500b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a500b3a20 0x7f4a5013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5005bd40 con 0x7f4a50062f70 2021-10-21T00:11:40.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5005bf70 con 0x7f4a50062330 2021-10-21T00:11:40.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a55e9d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a50142cb0 con 0x7f4a500b3a20 2021-10-21T00:11:40.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.662+0000 7f4a54e9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a50062330 0x7f4a500b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a50062330 0x7f4a500b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37328/0 (socket says 172.21.15.41:37328) 2021-10-21T00:11:40.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a5569c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a500b3a20 0x7f4a5013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 -- 172.21.15.41:0/1097860725 learned_addr learned my addr 172.21.15.41:0/1097860725 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:40.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a4ffff700 1 --1- 172.21.15.41:0/1097860725 >> v1:172.21.15.41:6789/0 conn(0x7f4a50062f70 0x7f4a5005c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35102/0 (socket says 172.21.15.41:35102) 2021-10-21T00:11:40.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 -- 172.21.15.41:0/1097860725 >> v2:172.21.15.62:3300/0 conn(0x7f4a500b3a20 msgr2=0x7f4a5013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:40.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 --2- 172.21.15.41:0/1097860725 >> v2:172.21.15.62:3300/0 conn(0x7f4a500b3a20 0x7f4a5013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 -- 172.21.15.41:0/1097860725 >> v1:172.21.15.41:6789/0 conn(0x7f4a50062f70 legacy=0x7f4a5005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 -- 172.21.15.41:0/1097860725 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50142950 con 0x7f4a50062330 2021-10-21T00:11:40.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a54e9b700 1 --2- 172.21.15.41:0/1097860725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500b3f30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f4a400032f0 tx=0x7f4a40009290).ready entity=mon.0 client_cookie=d81c1c0eda7f3780 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:40.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a4f7fe700 1 -- 172.21.15.41:0/1097860725 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000b870 con 0x7f4a50062330 2021-10-21T00:11:40.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a4f7fe700 1 -- 172.21.15.41:0/1097860725 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000b9d0 con 0x7f4a50062330 2021-10-21T00:11:40.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a4f7fe700 1 -- 172.21.15.41:0/1097860725 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000bb40 con 0x7f4a50062330 2021-10-21T00:11:40.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 -- 172.21.15.41:0/1097860725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 msgr2=0x7f4a500b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/1097860725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500b3f30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f4a400032f0 tx=0x7f4a40009290).stop 2021-10-21T00:11:40.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 -- 172.21.15.41:0/1097860725 shutdown_connections 2021-10-21T00:11:40.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/1097860725 >> v2:172.21.15.62:3300/0 conn(0x7f4a500b3a20 0x7f4a5013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/1097860725 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500b3f30 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 -- 172.21.15.41:0/1097860725 >> 172.21.15.41:0/1097860725 conn(0x7f4a500b9080 msgr2=0x7f4a500b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 -- 172.21.15.41:0/1097860725 shutdown_connections 2021-10-21T00:11:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.666+0000 7f4a55e9d700 1 -- 172.21.15.41:0/1097860725 wait complete. 2021-10-21T00:11:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 Processor -- start 2021-10-21T00:11:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- start start 2021-10-21T00:11:40.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a50062f70 0x7f4a500ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a500b3a20 0x7f4a50145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50112560 con 0x7f4a50062330 2021-10-21T00:11:40.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500ae960 con 0x7f4a500b3a20 2021-10-21T00:11:40.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500ad910 con 0x7f4a50062f70 2021-10-21T00:11:40.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37334/0 (socket says 172.21.15.41:37334) 2021-10-21T00:11:40.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 -- 172.21.15.41:0/3965320577 learned_addr learned my addr 172.21.15.41:0/3965320577 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:40.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a5569c700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a500b3a20 0x7f4a50145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a4ffff700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a50062f70 0x7f4a500ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 -- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a50062f70 msgr2=0x7f4a500ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a50062f70 0x7f4a500ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 -- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a500b3a20 msgr2=0x7f4a50145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:40.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a500b3a20 0x7f4a50145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:40.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 -- 172.21.15.41:0/3965320577 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009530 con 0x7f4a50062330 2021-10-21T00:11:40.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a54e9b700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f4a50146ec0 tx=0x7f4a40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:40.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000b870 con 0x7f4a50062330 2021-10-21T00:11:40.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40021440 con 0x7f4a50062330 2021-10-21T00:11:40.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a400217a0 con 0x7f4a50062330 2021-10-21T00:11:40.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a500ae320 con 0x7f4a50062330 2021-10-21T00:11:40.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.670+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a500acf40 con 0x7f4a50062330 2021-10-21T00:11:40.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.674+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a50057350 con 0x7f4a50062330 2021-10-21T00:11:40.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.674+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a40027020 con 0x7f4a50062330 2021-10-21T00:11:40.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.674+0000 7f4a4dffb700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 0x7f4a30055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:40.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.674+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f4a4006d130 con 0x7f4a50062330 2021-10-21T00:11:40.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.674+0000 7f4a4ffff700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 0x7f4a30055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:40.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.678+0000 7f4a4ffff700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 0x7f4a30055ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4a4400d000 tx=0x7f4a44007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:40.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.682+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a40044350 con 0x7f4a50062330 2021-10-21T00:11:40.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:40.810+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4a5013f710 con 0x7f4a50062330 2021-10-21T00:11:41.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.534+0000 7f4a4dffb700 1 -- 172.21.15.41:0/3965320577 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v125) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4a40015020 con 0x7f4a50062330 2021-10-21T00:11:41.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.538+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 msgr2=0x7f4a30055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.538+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 0x7f4a30055ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4a4400d000 tx=0x7f4a44007b80).stop 2021-10-21T00:11:41.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.538+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 msgr2=0x7f4a500af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.538+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f4a50146ec0 tx=0x7f4a40016000).stop 2021-10-21T00:11:41.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 shutdown_connections 2021-10-21T00:11:41.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a30053610 0x7f4a30055ad0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a500b3a20 0x7f4a50145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a50062f70 0x7f4a500ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 --2- 172.21.15.41:0/3965320577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a50062330 0x7f4a500af3a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 >> 172.21.15.41:0/3965320577 conn(0x7f4a500b9080 msgr2=0x7f4a5013fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:41.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 shutdown_connections 2021-10-21T00:11:41.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.542+0000 7f4a55e9d700 1 -- 172.21.15.41:0/3965320577 wait complete. 2021-10-21T00:11:41.553 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:11:41.563 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:11:41.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.666+0000 7f4dc9413700 1 Processor -- start 2021-10-21T00:11:41.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.666+0000 7f4dc9413700 1 -- start start 2021-10-21T00:11:41.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dc40b0660 0x7f4dc40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40ba050 con 0x7f4dc4143a40 2021-10-21T00:11:41.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc4146360 con 0x7f4dc40b9c70 2021-10-21T00:11:41.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc4142bf0 con 0x7f4dc40b0660 2021-10-21T00:11:41.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc27fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4dc4143a40 0x7f4dc41419c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35114/0 (socket says 172.21.15.41:35114) 2021-10-21T00:11:41.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc27fc700 1 -- 172.21.15.41:0/676636267 learned_addr learned my addr 172.21.15.41:0/676636267 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:41.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc37fe700 1 --2- 172.21.15.41:0/676636267 >> v2:172.21.15.62:3300/0 conn(0x7f4dc40b0660 0x7f4dc40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749856489 0 0) 0x7f4dc40ba050 con 0x7f4dc4143a40 2021-10-21T00:11:41.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da4003260 con 0x7f4dc4143a40 2021-10-21T00:11:41.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc37fe700 1 -- 172.21.15.41:0/676636267 >> v1:172.21.15.62:6789/0 conn(0x7f4dc40b9c70 legacy=0x7f4dc4143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887961754 0 0) 0x7f4dc4146360 con 0x7f4dc40b9c70 2021-10-21T00:11:41.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc37fe700 1 -- 172.21.15.41:0/676636267 >> v1:172.21.15.41:6789/0 conn(0x7f4dc4143a40 legacy=0x7f4dc41419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc37fe700 1 -- 172.21.15.41:0/676636267 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4142e90 con 0x7f4dc40b0660 2021-10-21T00:11:41.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc37fe700 1 --2- 172.21.15.41:0/676636267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40b3bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f4dc40b5640 tx=0x7f4dbc0091d0).ready entity=mon.1 client_cookie=c1d7648c40ba0bca server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:41.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00b680 con 0x7f4dc40b0660 2021-10-21T00:11:41.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00b7e0 con 0x7f4dc40b0660 2021-10-21T00:11:41.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc1ffb700 1 -- 172.21.15.41:0/676636267 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00b950 con 0x7f4dc40b0660 2021-10-21T00:11:41.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- 172.21.15.41:0/676636267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 msgr2=0x7f4dc40b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 --2- 172.21.15.41:0/676636267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40b3bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f4dc40b5640 tx=0x7f4dbc0091d0).stop 2021-10-21T00:11:41.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- 172.21.15.41:0/676636267 shutdown_connections 2021-10-21T00:11:41.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 --2- 172.21.15.41:0/676636267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40b3bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- 172.21.15.41:0/676636267 >> 172.21.15.41:0/676636267 conn(0x7f4dc4062f00 msgr2=0x7f4dc40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:41.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- 172.21.15.41:0/676636267 shutdown_connections 2021-10-21T00:11:41.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.670+0000 7f4dc9413700 1 -- 172.21.15.41:0/676636267 wait complete. 2021-10-21T00:11:41.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 Processor -- start 2021-10-21T00:11:41.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- start start 2021-10-21T00:11:41.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dc40b9c70 0x7f4dc4112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4112ab0 con 0x7f4dc4143a40 2021-10-21T00:11:41.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4112d50 con 0x7f4dc40b0660 2021-10-21T00:11:41.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4112ff0 con 0x7f4dc40b9c70 2021-10-21T00:11:41.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37350/0 (socket says 172.21.15.41:37350) 2021-10-21T00:11:41.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 -- 172.21.15.41:0/1626403013 learned_addr learned my addr 172.21.15.41:0/1626403013 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:41.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc2ffd700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc27fc700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dc40b9c70 0x7f4dc4112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 -- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dc40b9c70 msgr2=0x7f4dc4112410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dc40b9c70 0x7f4dc4112410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 -- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 msgr2=0x7f4dc40af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 -- 172.21.15.41:0/1626403013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009470 con 0x7f4dc4143a40 2021-10-21T00:11:41.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc2ffd700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:41.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc37fe700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f4dc40b5640 tx=0x7f4dbc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:41.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00b680 con 0x7f4dc4143a40 2021-10-21T00:11:41.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc021630 con 0x7f4dc4143a40 2021-10-21T00:11:41.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc41150e0 con 0x7f4dc4143a40 2021-10-21T00:11:41.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc021990 con 0x7f4dc4143a40 2021-10-21T00:11:41.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.674+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc4155d50 con 0x7f4dc4143a40 2021-10-21T00:11:41.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4112900 con 0x7f4dc4143a40 2021-10-21T00:11:41.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4dbc027020 con 0x7f4dc4143a40 2021-10-21T00:11:41.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dbbfff700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 0x7f4da8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f4dbc06cdd0 con 0x7f4dc4143a40 2021-10-21T00:11:41.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dc2ffd700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 0x7f4da8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.678+0000 7f4dc2ffd700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 0x7f4da8055b60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4db400d000 tx=0x7f4db4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:41.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.686+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4dbc043ea0 con 0x7f4dc4143a40 2021-10-21T00:11:41.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.850+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4dc4146050 con 0x7f4dc4143a40 2021-10-21T00:11:41.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.862+0000 7f4dbbfff700 1 -- 172.21.15.41:0/1626403013 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4dbc015020 con 0x7f4dc4143a40 2021-10-21T00:11:41.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 msgr2=0x7f4da8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 0x7f4da8055b60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4db400d000 tx=0x7f4db4009040).stop 2021-10-21T00:11:41.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 msgr2=0x7f4dc4155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f4dc40b5640 tx=0x7f4dbc016000).stop 2021-10-21T00:11:41.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 shutdown_connections 2021-10-21T00:11:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4da80536a0 0x7f4da8055b60 secure :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0x7f4db400d000 tx=0x7f4db4009040).stop 2021-10-21T00:11:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dc4143a40 0x7f4dc4155860 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dc40b9c70 0x7f4dc4112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 --2- 172.21.15.41:0/1626403013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40b0660 0x7f4dc40af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 >> 172.21.15.41:0/1626403013 conn(0x7f4dc4062f00 msgr2=0x7f4dc4140120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 shutdown_connections 2021-10-21T00:11:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.866+0000 7f4dc9413700 1 -- 172.21.15.41:0/1626403013 wait complete. 2021-10-21T00:11:41.878 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 25 and data pool 26 2021-10-21T00:11:41.889 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:41.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.978+0000 7f2521f99700 1 Processor -- start 2021-10-21T00:11:41.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.978+0000 7f2521f99700 1 -- start start 2021-10-21T00:11:41.989 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521f99700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 0x7f251c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.990 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521f99700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521f99700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c05fdd0 con 0x7f251c05f9f0 2021-10-21T00:11:41.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521f99700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c140400 con 0x7f251c0b0730 2021-10-21T00:11:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521f99700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b27c0 con 0x7f251c0b3370 2021-10-21T00:11:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521798700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 0x7f251c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:41.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521798700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49288/0 (socket says 172.21.15.41:49288) 2021-10-21T00:11:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521798700 1 -- 172.21.15.41:0/4052056093 learned_addr learned my addr 172.21.15.41:0/4052056093 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:41.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2520f97700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f251c05f9f0 0x7f251c0b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:43192/0 (socket says 172.21.15.41:43192) 2021-10-21T00:11:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 -- 172.21.15.41:0/4052056093 >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 msgr2=0x7f251c138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 --2- 172.21.15.41:0/4052056093 >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 -- 172.21.15.41:0/4052056093 >> v1:172.21.15.62:6789/0 conn(0x7f251c05f9f0 legacy=0x7f251c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 -- 172.21.15.41:0/4052056093 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c140080 con 0x7f251c0b3370 2021-10-21T00:11:41.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f2521798700 1 --2- 172.21.15.41:0/4052056093 >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:41.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251bfff700 1 --2- 172.21.15.41:0/4052056093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 0x7f251c0b0e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2508002f70 tx=0x7f2508006df0).ready entity=mon.2 client_cookie=7ee2eaf94bd76305 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:41.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251b7fe700 1 -- 172.21.15.41:0/4052056093 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250800d570 con 0x7f251c0b3370 2021-10-21T00:11:41.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251b7fe700 1 -- 172.21.15.41:0/4052056093 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508000e90 con 0x7f251c0b3370 2021-10-21T00:11:41.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.982+0000 7f251b7fe700 1 -- 172.21.15.41:0/4052056093 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250800d8c0 con 0x7f251c0b3370 2021-10-21T00:11:41.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- 172.21.15.41:0/4052056093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 msgr2=0x7f251c0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:41.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 --2- 172.21.15.41:0/4052056093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 0x7f251c0b0e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2508002f70 tx=0x7f2508006df0).stop 2021-10-21T00:11:41.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- 172.21.15.41:0/4052056093 shutdown_connections 2021-10-21T00:11:41.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 --2- 172.21.15.41:0/4052056093 >> v2:172.21.15.62:3300/0 conn(0x7f251c0b0730 0x7f251c138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 --2- 172.21.15.41:0/4052056093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c0b3370 0x7f251c0b0e50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:41.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- 172.21.15.41:0/4052056093 >> 172.21.15.41:0/4052056093 conn(0x7f251c0637b0 msgr2=0x7f251c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:41.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- 172.21.15.41:0/4052056093 shutdown_connections 2021-10-21T00:11:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- 172.21.15.41:0/4052056093 wait complete. 2021-10-21T00:11:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 Processor -- start 2021-10-21T00:11:42.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.986+0000 7f2521f99700 1 -- start start 2021-10-21T00:11:42.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c05f9f0 0x7f251c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f251c0b0730 0x7f251c065cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0649d0 con 0x7f251c0b3370 2021-10-21T00:11:42.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c064c70 con 0x7f251c0b0730 2021-10-21T00:11:42.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c064f10 con 0x7f251c05f9f0 2021-10-21T00:11:42.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f251bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f251c0b0730 0x7f251c065cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37376/0 (socket says 172.21.15.41:37376) 2021-10-21T00:11:42.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 -- 172.21.15.41:0/3514031983 learned_addr learned my addr 172.21.15.41:0/3514031983 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:42.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2520f97700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c05f9f0 0x7f251c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 -- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c05f9f0 msgr2=0x7f251c152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c05f9f0 0x7f251c152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 -- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f251c0b0730 msgr2=0x7f251c065cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f251c0b0730 0x7f251c065cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 -- 172.21.15.41:0/3514031983 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009530 con 0x7f251c0b3370 2021-10-21T00:11:42.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521798700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f2514006ec0 tx=0x7f2514009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251400c850 con 0x7f251c0b3370 2021-10-21T00:11:42.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400c9b0 con 0x7f251c0b3370 2021-10-21T00:11:42.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251400cd10 con 0x7f251c0b3370 2021-10-21T00:11:42.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250800b180 con 0x7f251c0b3370 2021-10-21T00:11:42.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.990+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c065a00 con 0x7f251c0b3370 2021-10-21T00:11:42.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c057350 con 0x7f251c0b3370 2021-10-21T00:11:42.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2514022070 con 0x7f251c0b3370 2021-10-21T00:11:42.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2519ffb700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 0x7f24fc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f251406c1f0 con 0x7f251c0b3370 2021-10-21T00:11:42.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2520f97700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 0x7f24fc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.994+0000 7f2520f97700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 0x7f24fc055b60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f251000d000 tx=0x7f2510007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:41.998+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2514043240 con 0x7f251c0b3370 2021-10-21T00:11:42.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.122+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f251c05f100 con 0x7f251c0b3370 2021-10-21T00:11:42.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2519ffb700 1 -- 172.21.15.41:0/3514031983 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f2514016090 con 0x7f251c0b3370 2021-10-21T00:11:42.132 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:42.133 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":126,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:41.853758+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 msgr2=0x7f24fc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 0x7f24fc055b60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f251000d000 tx=0x7f2510007b70).stop 2021-10-21T00:11:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 msgr2=0x7f251c0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f2514006ec0 tx=0x7f2514009290).stop 2021-10-21T00:11:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 shutdown_connections 2021-10-21T00:11:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f24fc0536a0 0x7f24fc055b60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f251c0b3370 0x7f251c0661c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f251c0b0730 0x7f251c065cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 --2- 172.21.15.41:0/3514031983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f251c05f9f0 0x7f251c152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 >> 172.21.15.41:0/3514031983 conn(0x7f251c0637b0 msgr2=0x7f251c13f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:42.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 shutdown_connections 2021-10-21T00:11:42.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.126+0000 7f2521f99700 1 -- 172.21.15.41:0/3514031983 wait complete. 2021-10-21T00:11:42.146 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 Processor -- start 2021-10-21T00:11:42.250 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 -- start start 2021-10-21T00:11:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdfc8067a80 0x7fdfc8149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80b0b50 con 0x7fdfc80b2170 2021-10-21T00:11:42.251 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80b2550 con 0x7fdfc8067a80 2021-10-21T00:11:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80b0d90 con 0x7fdfc80af620 2021-10-21T00:11:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdfc8067a80 0x7fdfc8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.252 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fdfc8067a80 0x7fdfc8149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37384/0 (socket says 172.21.15.41:37384) 2021-10-21T00:11:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 -- 172.21.15.41:0/3894128111 learned_addr learned my addr 172.21.15.41:0/3894128111 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc6ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdfc80b2170 0x7fdfc80ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35150/0 (socket says 172.21.15.41:35150) 2021-10-21T00:11:42.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc67fc700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 -- 172.21.15.41:0/3894128111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 msgr2=0x7fdfc80ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:42.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 -- 172.21.15.41:0/3894128111 >> v1:172.21.15.41:6789/0 conn(0x7fdfc80b2170 legacy=0x7fdfc80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 -- 172.21.15.41:0/3894128111 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80b1030 con 0x7fdfc8067a80 2021-10-21T00:11:42.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc5ffb700 1 -- 172.21.15.41:0/3894128111 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083706629 0 0) 0x7fdfbc001110 con 0x7fdfc80b2170 2021-10-21T00:11:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.242+0000 7fdfc77fe700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8149320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fdfc00032f0 tx=0x7fdfc0009290).ready entity=mon.0 client_cookie=320a81745748bfce server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc5ffb700 1 -- 172.21.15.41:0/3894128111 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc000b8a0 con 0x7fdfc8067a80 2021-10-21T00:11:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc5ffb700 1 -- 172.21.15.41:0/3894128111 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc000ba00 con 0x7fdfc8067a80 2021-10-21T00:11:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc5ffb700 1 -- 172.21.15.41:0/3894128111 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc000bb70 con 0x7fdfc8067a80 2021-10-21T00:11:42.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- 172.21.15.41:0/3894128111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 msgr2=0x7fdfc8149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8149320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fdfc00032f0 tx=0x7fdfc0009290).stop 2021-10-21T00:11:42.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- 172.21.15.41:0/3894128111 shutdown_connections 2021-10-21T00:11:42.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8149320 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/3894128111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- 172.21.15.41:0/3894128111 >> 172.21.15.41:0/3894128111 conn(0x7fdfc80b5700 msgr2=0x7fdfc80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- 172.21.15.41:0/3894128111 shutdown_connections 2021-10-21T00:11:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- 172.21.15.41:0/3894128111 wait complete. 2021-10-21T00:11:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 Processor -- start 2021-10-21T00:11:42.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- start start 2021-10-21T00:11:42.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc80b2170 0x7fdfc80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81570c0 con 0x7fdfc8067a80 2021-10-21T00:11:42.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc8148180 con 0x7fdfc80b2170 2021-10-21T00:11:42.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc8148420 con 0x7fdfc80af620 2021-10-21T00:11:42.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37386/0 (socket says 172.21.15.41:37386) 2021-10-21T00:11:42.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.246+0000 7fdfc6ffd700 1 -- 172.21.15.41:0/2058298291 learned_addr learned my addr 172.21.15.41:0/2058298291 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:42.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc67fc700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc77fe700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc80b2170 0x7fdfc80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 -- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 msgr2=0x7fdfc80b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 -- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc80b2170 msgr2=0x7fdfc80ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc80b2170 0x7fdfc80ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 -- 172.21.15.41:0/2058298291 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009530 con 0x7fdfc8067a80 2021-10-21T00:11:42.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc6ffd700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fdfbc000ed0 tx=0x7fdfbc007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfbc00ce40 con 0x7fdfc8067a80 2021-10-21T00:11:42.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0072e0 con 0x7fdfc8067a80 2021-10-21T00:11:42.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc81486c0 con 0x7fdfc8067a80 2021-10-21T00:11:42.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfbc005740 con 0x7fdfc8067a80 2021-10-21T00:11:42.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc8147c00 con 0x7fdfc8067a80 2021-10-21T00:11:42.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfbc01a060 con 0x7fdfc8067a80 2021-10-21T00:11:42.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc80b12d0 con 0x7fdfc8067a80 2021-10-21T00:11:42.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 0x7fdfa4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfbc06afa0 con 0x7fdfc8067a80 2021-10-21T00:11:42.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.250+0000 7fdfc67fc700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 0x7fdfa4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.254+0000 7fdfc67fc700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 0x7fdfa4055b60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdfb800b000 tx=0x7fdfb8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.258+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfbc042100 con 0x7fdfc8067a80 2021-10-21T00:11:42.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.386+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc80b0b30 con 0x7fdfc8067a80 2021-10-21T00:11:42.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.386+0000 7fdfb7fff700 1 -- 172.21.15.41:0/2058298291 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fdfbc018070 con 0x7fdfc8067a80 2021-10-21T00:11:42.394 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:42.394 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":126,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:41.853758+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:42.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.386+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 msgr2=0x7fdfa4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 0x7fdfa4055b60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdfb800b000 tx=0x7fdfb8006df0).stop 2021-10-21T00:11:42.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 msgr2=0x7fdfc8156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.396 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fdfbc000ed0 tx=0x7fdfbc007920).stop 2021-10-21T00:11:42.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 shutdown_connections 2021-10-21T00:11:42.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdfa40536a0 0x7fdfa4055b60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc80b2170 0x7fdfc80ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfc80af620 0x7fdfc80b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 --2- 172.21.15.41:0/2058298291 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdfc8067a80 0x7fdfc8156160 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 >> 172.21.15.41:0/2058298291 conn(0x7fdfc80b5700 msgr2=0x7fdfc805f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:42.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 shutdown_connections 2021-10-21T00:11:42.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.390+0000 7fdfc7fff700 1 -- 172.21.15.41:0/2058298291 wait complete. 2021-10-21T00:11:42.408 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:11:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 Processor -- start 2021-10-21T00:11:42.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 -- start start 2021-10-21T00:11:42.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f646c0b3a20 0x7f646c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c05bd40 con 0x7f646c062330 2021-10-21T00:11:42.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c05bf70 con 0x7f646c0b3a20 2021-10-21T00:11:42.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f6470bc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c142cb0 con 0x7f646c062f70 2021-10-21T00:11:42.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f646c0b3a20 0x7f646c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f646c0b3a20 0x7f646c13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37398/0 (socket says 172.21.15.41:37398) 2021-10-21T00:11:42.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 -- 172.21.15.41:0/2122173452 learned_addr learned my addr 172.21.15.41:0/2122173452 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:42.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646affd700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 -- 172.21.15.41:0/2122173452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 msgr2=0x7f646c05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c05c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 -- 172.21.15.41:0/2122173452 >> v1:172.21.15.62:6789/0 conn(0x7f646c062330 legacy=0x7f646c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 -- 172.21.15.41:0/2122173452 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c142950 con 0x7f646c0b3a20 2021-10-21T00:11:42.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646affd700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.506+0000 7f646bfff700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c0b3a20 0x7f646c13c510 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f64640032f0 tx=0x7f6464009290).ready entity=mon.0 client_cookie=190855c3804c3057 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f646a7fc700 1 -- 172.21.15.41:0/2122173452 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646400b8a0 con 0x7f646c0b3a20 2021-10-21T00:11:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f646a7fc700 1 -- 172.21.15.41:0/2122173452 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646400ba00 con 0x7f646c0b3a20 2021-10-21T00:11:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f646a7fc700 1 -- 172.21.15.41:0/2122173452 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646400bb70 con 0x7f646c0b3a20 2021-10-21T00:11:42.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- 172.21.15.41:0/2122173452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c0b3a20 msgr2=0x7f646c13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c0b3a20 0x7f646c13c510 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f64640032f0 tx=0x7f6464009290).stop 2021-10-21T00:11:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- 172.21.15.41:0/2122173452 shutdown_connections 2021-10-21T00:11:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c0b3a20 0x7f646c13c510 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- 172.21.15.41:0/2122173452 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- 172.21.15.41:0/2122173452 >> 172.21.15.41:0/2122173452 conn(0x7f646c0b9080 msgr2=0x7f646c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- 172.21.15.41:0/2122173452 shutdown_connections 2021-10-21T00:11:42.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- 172.21.15.41:0/2122173452 wait complete. 2021-10-21T00:11:42.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 Processor -- start 2021-10-21T00:11:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- start start 2021-10-21T00:11:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c0b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c0b3a20 0x7f646c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1447b0 con 0x7f646c062330 2021-10-21T00:11:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c144a50 con 0x7f646c0b3a20 2021-10-21T00:11:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f6470bc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1554d0 con 0x7f646c062f70 2021-10-21T00:11:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.510+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37400/0 (socket says 172.21.15.41:37400) 2021-10-21T00:11:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 -- 172.21.15.41:0/898880722 learned_addr learned my addr 172.21.15.41:0/898880722 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646bfff700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c0b3a20 0x7f646c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646affd700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c0b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 -- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 msgr2=0x7f646c0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c0b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 -- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c0b3a20 msgr2=0x7f646c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c0b3a20 0x7f646c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 -- 172.21.15.41:0/898880722 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009530 con 0x7f646c062330 2021-10-21T00:11:42.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f646b7fe700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f646c0b6d90 tx=0x7f6454007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6454007030 con 0x7f646c062330 2021-10-21T00:11:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454007190 con 0x7f646c062330 2021-10-21T00:11:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c0b1e90 con 0x7f646c062330 2021-10-21T00:11:42.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6454006510 con 0x7f646c062330 2021-10-21T00:11:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c143e70 con 0x7f646c062330 2021-10-21T00:11:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c155690 con 0x7f646c062330 2021-10-21T00:11:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.514+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6454010030 con 0x7f646c062330 2021-10-21T00:11:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.518+0000 7f6468ff9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 0x7f6450055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:42.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.518+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f645406b400 con 0x7f646c062330 2021-10-21T00:11:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.518+0000 7f646affd700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 0x7f6450055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.518+0000 7f646affd700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 0x7f6450055b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f645c00c000 tx=0x7f645c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:42.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.522+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6454042560 con 0x7f646c062330 2021-10-21T00:11:42.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.682+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f646c057350 con 0x7f646c062330 2021-10-21T00:11:42.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.870+0000 7f6468ff9700 1 -- 172.21.15.41:0/898880722 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6454045b80 con 0x7f646c062330 2021-10-21T00:11:42.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.870+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 msgr2=0x7f6450055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.870+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 0x7f6450055b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f645c00c000 tx=0x7f645c008040).stop 2021-10-21T00:11:42.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.870+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 msgr2=0x7f646c151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:42.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.870+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f646c0b6d90 tx=0x7f6454007c10).stop 2021-10-21T00:11:42.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 shutdown_connections 2021-10-21T00:11:42.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64500536a0 0x7f6450055b60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c0b3a20 0x7f646c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f646c062f70 0x7f646c0b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 --2- 172.21.15.41:0/898880722 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f646c062330 0x7f646c151f00 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:42.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 >> 172.21.15.41:0/898880722 conn(0x7f646c0b9080 msgr2=0x7f646c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:42.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 shutdown_connections 2021-10-21T00:11:42.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.874+0000 7f6470bc9700 1 -- 172.21.15.41:0/898880722 wait complete. 2021-10-21T00:11:42.895 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:43.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 Processor -- start 2021-10-21T00:11:43.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- start start 2021-10-21T00:11:43.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efe1005f9f0 0x7efe1014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efe1014b350 0x7efe100af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe100609d0 con 0x7efe100aa750 2021-10-21T00:11:43.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100b1620 con 0x7efe1005f9f0 2021-10-21T00:11:43.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1005fdd0 con 0x7efe1014b350 2021-10-21T00:11:43.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efe1005f9f0 0x7efe1014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efe1005f9f0 0x7efe1014a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37408/0 (socket says 172.21.15.41:37408) 2021-10-21T00:11:43.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 -- 172.21.15.41:0/3609525580 learned_addr learned my addr 172.21.15.41:0/3609525580 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0ed9d700 1 --2- 172.21.15.41:0/3609525580 >> v2:172.21.15.62:3300/0 conn(0x7efe1014b350 0x7efe100af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 -- 172.21.15.41:0/3609525580 >> v2:172.21.15.62:3300/0 conn(0x7efe1014b350 msgr2=0x7efe100af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 --2- 172.21.15.41:0/3609525580 >> v2:172.21.15.62:3300/0 conn(0x7efe1014b350 0x7efe100af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 -- 172.21.15.41:0/3609525580 >> v1:172.21.15.62:6789/0 conn(0x7efe100aa750 legacy=0x7efe1014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 -- 172.21.15.41:0/3609525580 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100b1380 con 0x7efe1005f9f0 2021-10-21T00:11:43.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0e59c700 1 --2- 172.21.15.41:0/3609525580 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe1014a750 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7efdf8002f70 tx=0x7efdf8006eb0).ready entity=mon.0 client_cookie=7b333ebf55ede879 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0d59a700 1 -- 172.21.15.41:0/3609525580 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf800d5c0 con 0x7efe1005f9f0 2021-10-21T00:11:43.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0d59a700 1 -- 172.21.15.41:0/3609525580 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8000e90 con 0x7efe1005f9f0 2021-10-21T00:11:43.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe0d59a700 1 -- 172.21.15.41:0/3609525580 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf800d950 con 0x7efe1005f9f0 2021-10-21T00:11:43.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- 172.21.15.41:0/3609525580 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 msgr2=0x7efe1014a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3609525580 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe1014a750 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7efdf8002f70 tx=0x7efdf8006eb0).stop 2021-10-21T00:11:43.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- 172.21.15.41:0/3609525580 shutdown_connections 2021-10-21T00:11:43.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3609525580 >> v2:172.21.15.62:3300/0 conn(0x7efe1014b350 0x7efe100af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3609525580 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe1014a750 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- 172.21.15.41:0/3609525580 >> 172.21.15.41:0/3609525580 conn(0x7efe1005bca0 msgr2=0x7efe1005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- 172.21.15.41:0/3609525580 shutdown_connections 2021-10-21T00:11:43.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:42.998+0000 7efe14ba0700 1 -- 172.21.15.41:0/3609525580 wait complete. 2021-10-21T00:11:43.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 Processor -- start 2021-10-21T00:11:43.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 -- start start 2021-10-21T00:11:43.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe100aa750 0x7efe10146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe1014b350 0x7efe10063230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe100ac6a0 con 0x7efe1005f9f0 2021-10-21T00:11:43.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10156f90 con 0x7efe100aa750 2021-10-21T00:11:43.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe14ba0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe10157230 con 0x7efe1014b350 2021-10-21T00:11:43.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37414/0 (socket says 172.21.15.41:37414) 2021-10-21T00:11:43.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 -- 172.21.15.41:0/3918498161 learned_addr learned my addr 172.21.15.41:0/3918498161 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0ed9d700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe1014b350 0x7efe10063230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0dd9b700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe100aa750 0x7efe10146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 -- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe1014b350 msgr2=0x7efe10063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe1014b350 0x7efe10063230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 -- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe100aa750 msgr2=0x7efe10146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe100aa750 0x7efe10146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 -- 172.21.15.41:0/3918498161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf800b1e0 con 0x7efe1005f9f0 2021-10-21T00:11:43.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe0e59c700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7efdf8002f70 tx=0x7efdf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.002+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf8011860 con 0x7efe1005f9f0 2021-10-21T00:11:43.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80119c0 con 0x7efe1005f9f0 2021-10-21T00:11:43.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf8011d20 con 0x7efe1005f9f0 2021-10-21T00:11:43.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe100ac880 con 0x7efe1005f9f0 2021-10-21T00:11:43.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe10063720 con 0x7efe1005f9f0 2021-10-21T00:11:43.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efdf801a040 con 0x7efe1005f9f0 2021-10-21T00:11:43.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe101575b0 con 0x7efe1005f9f0 2021-10-21T00:11:43.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe077fe700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 0x7efdf4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efdf806c8f0 con 0x7efe1005f9f0 2021-10-21T00:11:43.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe0dd9b700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 0x7efdf4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.006+0000 7efe0dd9b700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 0x7efdf4055ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7efe0800d000 tx=0x7efe08007f10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.014+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdf8047480 con 0x7efe1005f9f0 2021-10-21T00:11:43.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.182+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe100678f0 con 0x7efe1005f9f0 2021-10-21T00:11:43.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.182+0000 7efe077fe700 1 -- 172.21.15.41:0/3918498161 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7efdf8023020 con 0x7efe1005f9f0 2021-10-21T00:11:43.191 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:43.191 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:43.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 msgr2=0x7efdf4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 0x7efdf4055ad0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7efe0800d000 tx=0x7efe08007f10).stop 2021-10-21T00:11:43.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 msgr2=0x7efe10146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7efdf8002f70 tx=0x7efdf8015000).stop 2021-10-21T00:11:43.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 shutdown_connections 2021-10-21T00:11:43.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efdf4053610 0x7efdf4055ad0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe1014b350 0x7efe10063230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe100aa750 0x7efe10146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 --2- 172.21.15.41:0/3918498161 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efe1005f9f0 0x7efe10146490 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 >> 172.21.15.41:0/3918498161 conn(0x7efe1005bca0 msgr2=0x7efe1005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 shutdown_connections 2021-10-21T00:11:43.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.186+0000 7efe14ba0700 1 -- 172.21.15.41:0/3918498161 wait complete. 2021-10-21T00:11:43.196 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:43.204 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:43.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.298+0000 7f9e1be99700 1 Processor -- start 2021-10-21T00:11:43.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.298+0000 7f9e1be99700 1 -- start start 2021-10-21T00:11:43.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 0x7f9e1414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9e1414b350 0x7f9e140af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140609d0 con 0x7f9e140aa750 2021-10-21T00:11:43.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140b1620 con 0x7f9e1405f9f0 2021-10-21T00:11:43.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1405fdd0 con 0x7f9e1414b350 2021-10-21T00:11:43.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e19c35700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 0x7f9e1414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e19c35700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 0x7f9e1414a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37424/0 (socket says 172.21.15.41:37424) 2021-10-21T00:11:43.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9e1414b350 0x7f9e140af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e19c35700 1 -- 172.21.15.41:0/791841111 learned_addr learned my addr 172.21.15.41:0/791841111 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 -- 172.21.15.41:0/791841111 >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 msgr2=0x7f9e1414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 --2- 172.21.15.41:0/791841111 >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 0x7f9e1414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 -- 172.21.15.41:0/791841111 >> v1:172.21.15.62:6789/0 conn(0x7f9e140aa750 legacy=0x7f9e1414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 -- 172.21.15.41:0/791841111 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140b1380 con 0x7f9e1414b350 2021-10-21T00:11:43.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1a436700 1 --2- 172.21.15.41:0/791841111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1414b350 0x7f9e140af7c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f9e0c0032f0 tx=0x7f9e0c0091d0).ready entity=mon.1 client_cookie=ddb57cc775539c13 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e18c33700 1 -- 172.21.15.41:0/791841111 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c00b680 con 0x7f9e1414b350 2021-10-21T00:11:43.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e18c33700 1 -- 172.21.15.41:0/791841111 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00b7e0 con 0x7f9e1414b350 2021-10-21T00:11:43.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e18c33700 1 -- 172.21.15.41:0/791841111 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c00b950 con 0x7f9e1414b350 2021-10-21T00:11:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- 172.21.15.41:0/791841111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1414b350 msgr2=0x7f9e140af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 --2- 172.21.15.41:0/791841111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1414b350 0x7f9e140af7c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f9e0c0032f0 tx=0x7f9e0c0091d0).stop 2021-10-21T00:11:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- 172.21.15.41:0/791841111 shutdown_connections 2021-10-21T00:11:43.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 --2- 172.21.15.41:0/791841111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1414b350 0x7f9e140af7c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 --2- 172.21.15.41:0/791841111 >> v2:172.21.15.41:3300/0 conn(0x7f9e1405f9f0 0x7f9e1414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- 172.21.15.41:0/791841111 >> 172.21.15.41:0/791841111 conn(0x7f9e1405bca0 msgr2=0x7f9e1405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- 172.21.15.41:0/791841111 shutdown_connections 2021-10-21T00:11:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.302+0000 7f9e1be99700 1 -- 172.21.15.41:0/791841111 wait complete. 2021-10-21T00:11:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 Processor -- start 2021-10-21T00:11:43.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- start start 2021-10-21T00:11:43.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1405f9f0 0x7f9e14063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e140aa750 0x7f9e1408f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14159940 con 0x7f9e1414b350 2021-10-21T00:11:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1408f8b0 con 0x7f9e1405f9f0 2021-10-21T00:11:43.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1408fb40 con 0x7f9e140aa750 2021-10-21T00:11:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37432/0 (socket says 172.21.15.41:37432) 2021-10-21T00:11:43.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 -- 172.21.15.41:0/581530289 learned_addr learned my addr 172.21.15.41:0/581530289 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e19c35700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1405f9f0 0x7f9e14063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e19434700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e140aa750 0x7f9e1408f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 -- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e140aa750 msgr2=0x7f9e1408f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e140aa750 0x7f9e1408f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 -- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1405f9f0 msgr2=0x7f9e14063c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1405f9f0 0x7f9e14063c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 -- 172.21.15.41:0/581530289 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c009470 con 0x7f9e1414b350 2021-10-21T00:11:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1a436700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f9e0c0032f0 tx=0x7f9e0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c011e20 con 0x7f9e1414b350 2021-10-21T00:11:43.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c021440 con 0x7f9e1414b350 2021-10-21T00:11:43.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e14159b70 con 0x7f9e1414b350 2021-10-21T00:11:43.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0c0217a0 con 0x7f9e1414b350 2021-10-21T00:11:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.306+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e140673c0 con 0x7f9e1414b350 2021-10-21T00:11:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e0c027020 con 0x7f9e1414b350 2021-10-21T00:11:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e14159d00 con 0x7f9e1414b350 2021-10-21T00:11:43.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e02ffd700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 0x7f9df4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e0c06cce0 con 0x7f9e1414b350 2021-10-21T00:11:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e19c35700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 0x7f9df4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.310+0000 7f9e19c35700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 0x7f9df4055ad0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f9e04008000 tx=0x7f9e04008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.314+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e0c043e40 con 0x7f9e1414b350 2021-10-21T00:11:43.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.442+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e140678f0 con 0x7f9e1414b350 2021-10-21T00:11:43.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e02ffd700 1 -- 172.21.15.41:0/581530289 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f9e0c015020 con 0x7f9e1414b350 2021-10-21T00:11:43.452 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:43.452 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":127,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:42.857688+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:43.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 msgr2=0x7f9df4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 0x7f9df4055ad0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f9e04008000 tx=0x7f9e04008040).stop 2021-10-21T00:11:43.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 msgr2=0x7f9e14156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f9e0c0032f0 tx=0x7f9e0c016000).stop 2021-10-21T00:11:43.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 shutdown_connections 2021-10-21T00:11:43.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9df4053610 0x7f9df4055ad0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e1414b350 0x7f9e14156330 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e140aa750 0x7f9e1408f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 --2- 172.21.15.41:0/581530289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e1405f9f0 0x7f9e14063c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 >> 172.21.15.41:0/581530289 conn(0x7f9e1405bca0 msgr2=0x7f9e140b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 shutdown_connections 2021-10-21T00:11:43.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.446+0000 7f9e1be99700 1 -- 172.21.15.41:0/581530289 wait complete. 2021-10-21T00:11:43.465 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 Processor -- start 2021-10-21T00:11:43.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 -- start start 2021-10-21T00:11:43.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd38c0b9c70 0x7fd38c143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b3bc0 0x7fd38c143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd38c143a00 0x7fd38c05bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c1429a0 con 0x7fd38c143a00 2021-10-21T00:11:43.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c142bc0 con 0x7fd38c0b9c70 2021-10-21T00:11:43.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.570+0000 7fd393968700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0ba050 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd38c143a00 0x7fd38c05bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd38c143a00 0x7fd38c05bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37438/0 (socket says 172.21.15.41:37438) 2021-10-21T00:11:43.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 -- 172.21.15.41:0/1609749035 learned_addr learned my addr 172.21.15.41:0/1609749035 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd390f03700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b3bc0 0x7fd38c143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391704700 1 --2- 172.21.15.41:0/1609749035 >> v2:172.21.15.62:3300/0 conn(0x7fd38c0b9c70 0x7fd38c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 -- 172.21.15.41:0/1609749035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b3bc0 msgr2=0x7fd38c143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b3bc0 0x7fd38c143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 -- 172.21.15.41:0/1609749035 >> v2:172.21.15.62:3300/0 conn(0x7fd38c0b9c70 msgr2=0x7fd38c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 --2- 172.21.15.41:0/1609749035 >> v2:172.21.15.62:3300/0 conn(0x7fd38c0b9c70 0x7fd38c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 -- 172.21.15.41:0/1609749035 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c1463c0 con 0x7fd38c143a00 2021-10-21T00:11:43.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd391f05700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c05bca0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fd38c0b1ab0 tx=0x7fd384009290).ready entity=mon.0 client_cookie=a0d96bc54101a820 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd38bfff700 1 -- 172.21.15.41:0/1609749035 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38400b680 con 0x7fd38c143a00 2021-10-21T00:11:43.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd38bfff700 1 -- 172.21.15.41:0/1609749035 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400b7e0 con 0x7fd38c143a00 2021-10-21T00:11:43.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd38bfff700 1 -- 172.21.15.41:0/1609749035 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38400b950 con 0x7fd38c143a00 2021-10-21T00:11:43.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 -- 172.21.15.41:0/1609749035 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 msgr2=0x7fd38c05bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c05bca0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fd38c0b1ab0 tx=0x7fd384009290).stop 2021-10-21T00:11:43.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 -- 172.21.15.41:0/1609749035 shutdown_connections 2021-10-21T00:11:43.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c05bca0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 --2- 172.21.15.41:0/1609749035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b3bc0 0x7fd38c143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 --2- 172.21.15.41:0/1609749035 >> v2:172.21.15.62:3300/0 conn(0x7fd38c0b9c70 0x7fd38c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 -- 172.21.15.41:0/1609749035 >> 172.21.15.41:0/1609749035 conn(0x7fd38c062e80 msgr2=0x7fd38c0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 -- 172.21.15.41:0/1609749035 shutdown_connections 2021-10-21T00:11:43.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 -- 172.21.15.41:0/1609749035 wait complete. 2021-10-21T00:11:43.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.574+0000 7fd393968700 1 Processor -- start 2021-10-21T00:11:43.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- start start 2021-10-21T00:11:43.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 0x7fd38c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b9c70 0x7fd38c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c13e620 con 0x7fd38c143a00 2021-10-21T00:11:43.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0af150 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0af3f0 con 0x7fd38c0b9c70 2021-10-21T00:11:43.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391f05700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 0x7fd38c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391f05700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37446/0 (socket says 172.21.15.41:37446) 2021-10-21T00:11:43.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391f05700 1 -- 172.21.15.41:0/4198505694 learned_addr learned my addr 172.21.15.41:0/4198505694 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd390f03700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b9c70 0x7fd38c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 -- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b9c70 msgr2=0x7fd38c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b9c70 0x7fd38c1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 -- 172.21.15.41:0/4198505694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 msgr2=0x7fd38c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 -- 172.21.15.41:0/4198505694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009530 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd391704700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 0x7fd38c0aeab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fd38c1421c0 tx=0x7fd37c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c010780 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c0108e0 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c0af690 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37c010c40 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.578+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c1555d0 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd37c01c460 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c13f850 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd38a7fc700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 0x7fd36c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd37c06bd90 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd390f03700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 0x7fd36c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.582+0000 7fd390f03700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 0x7fd36c055b60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fd38000b000 tx=0x7fd380006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.590+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd38c13f850 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.761+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd38c13f850 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.769+0000 7fd38a7fc700 1 -- 172.21.15.41:0/4198505694 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd38c13f850 con 0x7fd38c0b3bc0 2021-10-21T00:11:43.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 msgr2=0x7fd36c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 0x7fd36c055b60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fd38000b000 tx=0x7fd380006df0).stop 2021-10-21T00:11:43.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 msgr2=0x7fd38c0aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 0x7fd38c0aeab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fd38c1421c0 tx=0x7fd37c006df0).stop 2021-10-21T00:11:43.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 shutdown_connections 2021-10-21T00:11:43.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd36c0536a0 0x7fd36c055b60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd38c143a00 0x7fd38c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd38c0b9c70 0x7fd38c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 --2- 172.21.15.41:0/4198505694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd38c0b3bc0 0x7fd38c0aeab0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 >> 172.21.15.41:0/4198505694 conn(0x7fd38c062e80 msgr2=0x7fd38c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 shutdown_connections 2021-10-21T00:11:43.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.773+0000 7fd393968700 1 -- 172.21.15.41:0/4198505694 wait complete. 2021-10-21T00:11:43.785 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:11:43.797 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:43.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 Processor -- start 2021-10-21T00:11:43.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 -- start start 2021-10-21T00:11:43.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad80062330 0x7fad800b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad8013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad80142ad0 con 0x7fad80142f00 2021-10-21T00:11:43.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800b3520 con 0x7fad80062330 2021-10-21T00:11:43.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.901+0000 7fad7f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad80143c40 con 0x7fad8013c510 2021-10-21T00:11:43.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fad80142f00 0x7fad80143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35224/0 (socket says 172.21.15.41:35224) 2021-10-21T00:11:43.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 -- 172.21.15.41:0/799121966 learned_addr learned my addr 172.21.15.41:0/799121966 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:43.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7e59c700 1 --2- 172.21.15.41:0/799121966 >> v2:172.21.15.62:3300/0 conn(0x7fad80062330 0x7fad800b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7dd9b700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad8013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392783713 0 0) 0x7fad80142ad0 con 0x7fad80142f00 2021-10-21T00:11:43.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad64003260 con 0x7fad80142f00 2021-10-21T00:11:43.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567259695 0 0) 0x7fad64003260 con 0x7fad80142f00 2021-10-21T00:11:43.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 msgr2=0x7fad8013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad8013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 >> v2:172.21.15.62:3300/0 conn(0x7fad80062330 msgr2=0x7fad800b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 --2- 172.21.15.41:0/799121966 >> v2:172.21.15.62:3300/0 conn(0x7fad80062330 0x7fad800b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8013ce60 con 0x7fad80142f00 2021-10-21T00:11:43.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fad780019e0 con 0x7fad80142f00 2021-10-21T00:11:43.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 >> v1:172.21.15.41:6789/0 conn(0x7fad80142f00 legacy=0x7fad80143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad64003750 0x7fad64003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad64004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad640049f0 0x7fad64004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad800b3520 con 0x7fad640049f0 2021-10-21T00:11:43.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64004330 con 0x7fad64003750 2021-10-21T00:11:43.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6400b7a0 con 0x7fad8013c510 2021-10-21T00:11:43.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad640049f0 0x7fad64004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7e59c700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad64003750 0x7fad64003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7dd9b700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad64004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 -- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 msgr2=0x7fad64004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad8013c510 0x7fad64004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 -- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad64003750 msgr2=0x7fad64003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:43.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad64003750 0x7fad64003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 -- 172.21.15.41:0/799121966 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64003260 con 0x7fad640049f0 2021-10-21T00:11:43.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad640049f0 0x7fad64004e70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fad64004470 tx=0x7fad780021d0).ready entity=mon.0 client_cookie=f3909413e394d5c1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7800cc70 con 0x7fad640049f0 2021-10-21T00:11:43.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800cdd0 con 0x7fad640049f0 2021-10-21T00:11:43.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7d59a700 1 -- 172.21.15.41:0/799121966 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad78005b80 con 0x7fad640049f0 2021-10-21T00:11:43.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 -- 172.21.15.41:0/799121966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad640049f0 msgr2=0x7fad64004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 --2- 172.21.15.41:0/799121966 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad640049f0 0x7fad64004e70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fad64004470 tx=0x7fad780021d0).stop 2021-10-21T00:11:43.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7ed9d700 1 -- 172.21.15.41:0/799121966 reap_dead start 2021-10-21T00:11:43.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 -- 172.21.15.41:0/799121966 shutdown_connections 2021-10-21T00:11:43.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 -- 172.21.15.41:0/799121966 >> 172.21.15.41:0/799121966 conn(0x7fad800b9080 msgr2=0x7fad800b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:43.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 -- 172.21.15.41:0/799121966 shutdown_connections 2021-10-21T00:11:43.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.905+0000 7fad7f59e700 1 -- 172.21.15.41:0/799121966 wait complete. 2021-10-21T00:11:43.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 Processor -- start 2021-10-21T00:11:43.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 -- start start 2021-10-21T00:11:43.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 0x7fad800b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 0x7fad8013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 0x7fad8013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80146f70 con 0x7fad80151880 2021-10-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8013dac0 con 0x7fad640049f0 2021-10-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8013cff0 con 0x7fad800af0e0 2021-10-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7ed9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 0x7fad8013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7dd9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 0x7fad8013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 0x7fad800b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 0x7fad800b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49380/0 (socket says 172.21.15.41:49380) 2021-10-21T00:11:43.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7dd9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 0x7fad8013e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:55962/0 (socket says 172.21.15.41:55962) 2021-10-21T00:11:43.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7e59c700 1 -- 172.21.15.41:0/3944826673 learned_addr learned my addr 172.21.15.41:0/3944826673 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:43.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7ed9d700 1 -- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 msgr2=0x7fad8013e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 0x7fad8013e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7ed9d700 1 -- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 msgr2=0x7fad800b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:43.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.909+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 0x7fad800b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:43.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad7ed9d700 1 -- 172.21.15.41:0/3944826673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8013ec30 con 0x7fad80151880 2021-10-21T00:11:43.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad7ed9d700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 0x7fad8013e740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad8005cdd0 tx=0x7fad78015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad780072c0 con 0x7fad80151880 2021-10-21T00:11:43.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78007420 con 0x7fad80151880 2021-10-21T00:11:43.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad801401e0 con 0x7fad80151880 2021-10-21T00:11:43.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad78007780 con 0x7fad80151880 2021-10-21T00:11:43.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad800ad9c0 con 0x7fad80151880 2021-10-21T00:11:43.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad80140370 con 0x7fad80151880 2021-10-21T00:11:43.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad7801d070 con 0x7fad80151880 2021-10-21T00:11:43.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 0x7fad5c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:43.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.913+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad7806c600 con 0x7fad80151880 2021-10-21T00:11:43.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.917+0000 7fad7e59c700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 0x7fad5c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:43.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.917+0000 7fad7e59c700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 0x7fad5c055b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fad7400b000 tx=0x7fad74006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:43.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:43.921+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad780436c0 con 0x7fad80151880 2021-10-21T00:11:44.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.089+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fad8013dc80 con 0x7fad80151880 2021-10-21T00:11:44.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.097+0000 7fad6f7fe700 1 -- 172.21.15.41:0/3944826673 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7fad78046ce0 con 0x7fad80151880 2021-10-21T00:11:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 msgr2=0x7fad5c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 0x7fad5c055b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fad7400b000 tx=0x7fad74006df0).stop 2021-10-21T00:11:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 msgr2=0x7fad8013e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 0x7fad8013e740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad8005cdd0 tx=0x7fad78015000).stop 2021-10-21T00:11:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 shutdown_connections 2021-10-21T00:11:44.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad5c053640 0x7fad5c055b00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad80151880 0x7fad8013e740 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad800af0e0 0x7fad8013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 --2- 172.21.15.41:0/3944826673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad640049f0 0x7fad800b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 >> 172.21.15.41:0/3944826673 conn(0x7fad800b9080 msgr2=0x7fad800b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:44.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 shutdown_connections 2021-10-21T00:11:44.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.101+0000 7fad7f59e700 1 -- 172.21.15.41:0/3944826673 wait complete. 2021-10-21T00:11:44.112 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:11:44.124 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:11:44.240 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 Processor -- start 2021-10-21T00:11:44.241 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 -- start start 2021-10-21T00:11:44.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97d40b9c70 0x7f97d4143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 0x7f97d4141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4142bc0 con 0x7f97d40b3bc0 2021-10-21T00:11:44.244 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d41429a0 con 0x7f97d40b9c70 2021-10-21T00:11:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97dafcc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40ba050 con 0x7f97d41418f0 2021-10-21T00:11:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d3fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f97d40b3bc0 0x7f97d4143510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35242/0 (socket says 172.21.15.41:35242) 2021-10-21T00:11:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d3fff700 1 -- 172.21.15.41:0/1665236486 learned_addr learned my addr 172.21.15.41:0/1665236486 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:44.245 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d9569700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 0x7f97d4141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 --2- 172.21.15.41:0/1665236486 >> v2:172.21.15.62:3300/0 conn(0x7f97d40b9c70 0x7f97d4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d37fe700 1 -- 172.21.15.41:0/1665236486 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040694044 0 0) 0x7f97d4142bc0 con 0x7f97d40b3bc0 2021-10-21T00:11:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d37fe700 1 -- 172.21.15.41:0/1665236486 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b4003260 con 0x7f97d40b3bc0 2021-10-21T00:11:44.246 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 -- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 msgr2=0x7f97d4141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 0x7f97d4141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 -- 172.21.15.41:0/1665236486 >> v1:172.21.15.41:6789/0 conn(0x7f97d40b3bc0 legacy=0x7f97d4143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 -- 172.21.15.41:0/1665236486 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d41463c0 con 0x7f97d40b9c70 2021-10-21T00:11:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d9569700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 0x7f97d4141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:44.247 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.233+0000 7f97d8d68700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b9c70 0x7f97d4143020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f97c4002f70 tx=0x7f97c4006df0).ready entity=mon.1 client_cookie=b16d092895372264 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97d37fe700 1 -- 172.21.15.41:0/1665236486 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c400d4a0 con 0x7f97d40b9c70 2021-10-21T00:11:44.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97d37fe700 1 -- 172.21.15.41:0/1665236486 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4000e90 con 0x7f97d40b9c70 2021-10-21T00:11:44.249 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97d37fe700 1 -- 172.21.15.41:0/1665236486 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c400d7f0 con 0x7f97d40b9c70 2021-10-21T00:11:44.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b9c70 msgr2=0x7f97d4143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b9c70 0x7f97d4143020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f97c4002f70 tx=0x7f97c4006df0).stop 2021-10-21T00:11:44.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- 172.21.15.41:0/1665236486 shutdown_connections 2021-10-21T00:11:44.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d41418f0 0x7f97d4141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- 172.21.15.41:0/1665236486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b9c70 0x7f97d4143020 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- 172.21.15.41:0/1665236486 >> 172.21.15.41:0/1665236486 conn(0x7f97d4062e80 msgr2=0x7f97d40b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:44.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- 172.21.15.41:0/1665236486 shutdown_connections 2021-10-21T00:11:44.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- 172.21.15.41:0/1665236486 wait complete. 2021-10-21T00:11:44.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 Processor -- start 2021-10-21T00:11:44.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- start start 2021-10-21T00:11:44.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b3bc0 0x7f97d40af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d40b9c70 0x7f97d4114750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4114c40 con 0x7f97d41418f0 2021-10-21T00:11:44.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d413e6a0 con 0x7f97d40b3bc0 2021-10-21T00:11:44.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.237+0000 7f97dafcc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40ae0f0 con 0x7f97d40b9c70 2021-10-21T00:11:44.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37480/0 (socket says 172.21.15.41:37480) 2021-10-21T00:11:44.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 -- 172.21.15.41:0/2102175438 learned_addr learned my addr 172.21.15.41:0/2102175438 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:44.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d8d68700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b3bc0 0x7f97d40af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d3fff700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d40b9c70 0x7f97d4114750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 -- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d40b9c70 msgr2=0x7f97d4114750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d40b9c70 0x7f97d4114750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 -- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b3bc0 msgr2=0x7f97d40af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b3bc0 0x7f97d40af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 -- 172.21.15.41:0/2102175438 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009470 con 0x7f97d41418f0 2021-10-21T00:11:44.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d9569700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f97cc00c000 tx=0x7f97cc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97cc00ee60 con 0x7f97d41418f0 2021-10-21T00:11:44.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00c850 con 0x7f97d41418f0 2021-10-21T00:11:44.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c400b180 con 0x7f97d41418f0 2021-10-21T00:11:44.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97cc00cbb0 con 0x7f97d41418f0 2021-10-21T00:11:44.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d41142b0 con 0x7f97d41418f0 2021-10-21T00:11:44.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d41140f0 con 0x7f97d41418f0 2021-10-21T00:11:44.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.241+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97cc022070 con 0x7f97d41418f0 2021-10-21T00:11:44.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.245+0000 7f97d1ffb700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 0x7f97b80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.245+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f97cc06c0c0 con 0x7f97d41418f0 2021-10-21T00:11:44.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.245+0000 7f97d8d68700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 0x7f97b80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.245+0000 7f97d8d68700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 0x7f97b80559b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f97c401a000 tx=0x7f97c4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.249+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97cc043180 con 0x7f97d41418f0 2021-10-21T00:11:44.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.417+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f97d4114470 con 0x7f97d41418f0 2021-10-21T00:11:44.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97d1ffb700 1 -- 172.21.15.41:0/2102175438 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f97cc0467a0 con 0x7f97d41418f0 2021-10-21T00:11:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 msgr2=0x7f97b80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 0x7f97b80559b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f97c401a000 tx=0x7f97c4014000).stop 2021-10-21T00:11:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 msgr2=0x7f97d413e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f97cc00c000 tx=0x7f97cc0091d0).stop 2021-10-21T00:11:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 shutdown_connections 2021-10-21T00:11:44.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97b80534f0 0x7f97b80559b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f97d41418f0 0x7f97d413e1b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97d40b9c70 0x7f97d4114750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 --2- 172.21.15.41:0/2102175438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97d40b3bc0 0x7f97d40af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 >> 172.21.15.41:0/2102175438 conn(0x7f97d4062e80 msgr2=0x7f97d40b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:44.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 shutdown_connections 2021-10-21T00:11:44.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.425+0000 7f97dafcc700 1 -- 172.21.15.41:0/2102175438 wait complete. 2021-10-21T00:11:44.438 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:11:44.448 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:44.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.541+0000 7fa9f85a8700 1 Processor -- start 2021-10-21T00:11:44.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.541+0000 7fa9f85a8700 1 -- start start 2021-10-21T00:11:44.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f85a8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f85a8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa9f00aa750 0x7fa9f014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f85a8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f00609d0 con 0x7fa9f014b130 2021-10-21T00:11:44.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f85a8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00b1620 con 0x7fa9f00aa750 2021-10-21T00:11:44.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f85a8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f005fdd0 con 0x7fa9f005f9f0 2021-10-21T00:11:44.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa9f00aa750 0x7fa9f014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f6b45700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa9f014b130 0x7fa9f01495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:43312/0 (socket says 172.21.15.41:43312) 2021-10-21T00:11:44.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f6b45700 1 -- 172.21.15.41:0/1726215757 learned_addr learned my addr 172.21.15.41:0/1726215757 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:44.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f6344700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5342700 1 -- 172.21.15.41:0/1726215757 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955327777 0 0) 0x7fa9f00609d0 con 0x7fa9f014b130 2021-10-21T00:11:44.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 -- 172.21.15.41:0/1726215757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 msgr2=0x7fa9f014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:44.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 -- 172.21.15.41:0/1726215757 >> v1:172.21.15.62:6789/0 conn(0x7fa9f014b130 legacy=0x7fa9f01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 -- 172.21.15.41:0/1726215757 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00b1380 con 0x7fa9f00aa750 2021-10-21T00:11:44.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5b43700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f014ac40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa9e4002f70 tx=0x7fa9e4006df0).ready entity=mon.0 client_cookie=7779c12cd70da0ce server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5342700 1 -- 172.21.15.41:0/1726215757 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e400d570 con 0x7fa9f00aa750 2021-10-21T00:11:44.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5342700 1 -- 172.21.15.41:0/1726215757 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e4000e90 con 0x7fa9f00aa750 2021-10-21T00:11:44.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.545+0000 7fa9f5342700 1 -- 172.21.15.41:0/1726215757 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e400d8c0 con 0x7fa9f00aa750 2021-10-21T00:11:44.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- 172.21.15.41:0/1726215757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 msgr2=0x7fa9f014ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f014ac40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa9e4002f70 tx=0x7fa9e4006df0).stop 2021-10-21T00:11:44.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- 172.21.15.41:0/1726215757 shutdown_connections 2021-10-21T00:11:44.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f014ac40 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/1726215757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- 172.21.15.41:0/1726215757 >> 172.21.15.41:0/1726215757 conn(0x7fa9f005bca0 msgr2=0x7fa9f005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:44.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- 172.21.15.41:0/1726215757 shutdown_connections 2021-10-21T00:11:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- 172.21.15.41:0/1726215757 wait complete. 2021-10-21T00:11:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 Processor -- start 2021-10-21T00:11:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.549+0000 7fa9f85a8700 1 -- start start 2021-10-21T00:11:44.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f0156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f014b130 0x7fa9f0064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00674d0 con 0x7fa9f00aa750 2021-10-21T00:11:44.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00ad020 con 0x7fa9f014b130 2021-10-21T00:11:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00ad2c0 con 0x7fa9f005f9f0 2021-10-21T00:11:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37492/0 (socket says 172.21.15.41:37492) 2021-10-21T00:11:44.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 -- 172.21.15.41:0/2054907627 learned_addr learned my addr 172.21.15.41:0/2054907627 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f6b45700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f014b130 0x7fa9f0064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f6344700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 -- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 msgr2=0x7fa9f0156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f0156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 -- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f014b130 msgr2=0x7fa9f0064320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f014b130 0x7fa9f0064320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 -- 172.21.15.41:0/2054907627 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e400b180 con 0x7fa9f00aa750 2021-10-21T00:11:44.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f5b43700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fa9e4002f70 tx=0x7fa9e4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e4016070 con 0x7fa9f00aa750 2021-10-21T00:11:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e40138d0 con 0x7fa9f00aa750 2021-10-21T00:11:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00acb10 con 0x7fa9f00aa750 2021-10-21T00:11:44.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e4013c30 con 0x7fa9f00aa750 2021-10-21T00:11:44.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f0156aa0 con 0x7fa9f00aa750 2021-10-21T00:11:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00ace20 con 0x7fa9f00aa750 2021-10-21T00:11:44.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.553+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9e4025030 con 0x7fa9f00aa750 2021-10-21T00:11:44.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.557+0000 7fa9ef7fe700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 0x7fa9d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:44.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.557+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa9e406c890 con 0x7fa9f00aa750 2021-10-21T00:11:44.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.557+0000 7fa9f6344700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 0x7fa9d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:44.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.557+0000 7fa9f6344700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 0x7fa9d0055a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fa9e800b000 tx=0x7fa9e80091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:44.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.561+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9e40439f0 con 0x7fa9f00aa750 2021-10-21T00:11:44.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9f014b550 con 0x7fa9f00aa750 2021-10-21T00:11:44.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9ef7fe700 1 -- 172.21.15.41:0/2054907627 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fa9e4023020 con 0x7fa9f00aa750 2021-10-21T00:11:44.733 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:44.733 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:44.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 msgr2=0x7fa9d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 0x7fa9d0055a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fa9e800b000 tx=0x7fa9e80091d0).stop 2021-10-21T00:11:44.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 msgr2=0x7fa9f00981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:44.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fa9e4002f70 tx=0x7fa9e4014000).stop 2021-10-21T00:11:44.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 shutdown_connections 2021-10-21T00:11:44.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa9d0053580 0x7fa9d0055a40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9f014b130 0x7fa9f0064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa9f00aa750 0x7fa9f00981a0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 --2- 172.21.15.41:0/2054907627 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9f005f9f0 0x7fa9f0156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:44.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 >> 172.21.15.41:0/2054907627 conn(0x7fa9f005bca0 msgr2=0x7fa9f00b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:44.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 shutdown_connections 2021-10-21T00:11:44.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:44.725+0000 7fa9f85a8700 1 -- 172.21.15.41:0/2054907627 wait complete. 2021-10-21T00:11:44.738 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:44.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:41.854126+0000', 'modified': '2021-10-21T00:11:42.858043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/204327833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 204327833}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 204327833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:44.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:44.950 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:11:45.067 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8091,"want_state":"up:active","state":"up:active","rank_uptime":3.1961806359999998,"mdsmap_epoch":66,"osdmap_epoch":127,"osdmap_epoch_barrier":126,"uptime":7.9354262029999996} 2021-10-21T00:11:45.068 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8091, "mdsmap_epoch": 66, "osdmap_epoch": 127, "osdmap_epoch_barrier": 126, "rank_uptime": 3.196180636, "state": "up:active", "uptime": 7.935426203, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:45.069 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:45.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 Processor -- start 2021-10-21T00:11:45.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 -- start start 2021-10-21T00:11:45.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f07e00b4380 0x7f07e005f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 0x7f07e0140d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00b4760 con 0x7f07e00b1830 2021-10-21T00:11:45.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00ad4c0 con 0x7f07e00b4380 2021-10-21T00:11:45.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e6320700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00ad760 con 0x7f07e0140890 2021-10-21T00:11:45.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f07e00b4380 0x7f07e005f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e4b1d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f07e00b1830 0x7f07e005fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35268/0 (socket says 172.21.15.41:35268) 2021-10-21T00:11:45.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e4b1d700 1 -- 172.21.15.41:0/1227448280 learned_addr learned my addr 172.21.15.41:0/1227448280 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:45.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e5b1f700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 0x7f07e0140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 -- 172.21.15.41:0/1227448280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 msgr2=0x7f07e0140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:45.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 0x7f07e0140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07d7fff700 1 -- 172.21.15.41:0/1227448280 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200096337 0 0) 0x7f07e00b4760 con 0x7f07e00b1830 2021-10-21T00:11:45.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 -- 172.21.15.41:0/1227448280 >> v1:172.21.15.41:6789/0 conn(0x7f07e00b1830 legacy=0x7f07e005fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 -- 172.21.15.41:0/1227448280 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00ada00 con 0x7f07e00b4380 2021-10-21T00:11:45.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e5b1f700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 0x7f07e0140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:45.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07e531e700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e005f7c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f07d0002f70 tx=0x7f07d0006df0).ready entity=mon.0 client_cookie=44378b23a442af55 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07d7fff700 1 -- 172.21.15.41:0/1227448280 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d000d570 con 0x7f07e00b4380 2021-10-21T00:11:45.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.161+0000 7f07d7fff700 1 -- 172.21.15.41:0/1227448280 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0000e90 con 0x7f07e00b4380 2021-10-21T00:11:45.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07d7fff700 1 -- 172.21.15.41:0/1227448280 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d000d8c0 con 0x7f07e00b4380 2021-10-21T00:11:45.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- 172.21.15.41:0/1227448280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 msgr2=0x7f07e005f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e005f7c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f07d0002f70 tx=0x7f07d0006df0).stop 2021-10-21T00:11:45.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- 172.21.15.41:0/1227448280 shutdown_connections 2021-10-21T00:11:45.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e0140890 0x7f07e0140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 --2- 172.21.15.41:0/1227448280 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e005f7c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- 172.21.15.41:0/1227448280 >> 172.21.15.41:0/1227448280 conn(0x7f07e00b7910 msgr2=0x7f07e00b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- 172.21.15.41:0/1227448280 shutdown_connections 2021-10-21T00:11:45.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- 172.21.15.41:0/1227448280 wait complete. 2021-10-21T00:11:45.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 Processor -- start 2021-10-21T00:11:45.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.165+0000 7f07e6320700 1 -- start start 2021-10-21T00:11:45.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e00b1830 0x7f07e00b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 0x7f07e00b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01438d0 con 0x7f07e00b4380 2021-10-21T00:11:45.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00b0710 con 0x7f07e0140890 2021-10-21T00:11:45.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0143e70 con 0x7f07e00b1830 2021-10-21T00:11:45.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37504/0 (socket says 172.21.15.41:37504) 2021-10-21T00:11:45.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 -- 172.21.15.41:0/3909114732 learned_addr learned my addr 172.21.15.41:0/3909114732 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:45.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e531e700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e00b1830 0x7f07e00b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e5b1f700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 0x7f07e00b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 -- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e00b1830 msgr2=0x7f07e00b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e00b1830 0x7f07e00b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 -- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 msgr2=0x7f07e00b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 0x7f07e00b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 -- 172.21.15.41:0/3909114732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d000b180 con 0x7f07e00b4380 2021-10-21T00:11:45.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e5b1f700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 0x7f07e00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:45.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e4b1d700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f07dc000ed0 tx=0x7f07dc007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07dc0070d0 con 0x7f07e00b4380 2021-10-21T00:11:45.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc007230 con 0x7f07e00b4380 2021-10-21T00:11:45.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01422a0 con 0x7f07e00b4380 2021-10-21T00:11:45.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07dc005610 con 0x7f07e00b4380 2021-10-21T00:11:45.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.169+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00b1240 con 0x7f07e00b4380 2021-10-21T00:11:45.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f07dc01a060 con 0x7f07e00b4380 2021-10-21T00:11:45.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e0143a40 con 0x7f07e00b4380 2021-10-21T00:11:45.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07d67fc700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 0x7f07c8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07dc06b1e0 con 0x7f07e00b4380 2021-10-21T00:11:45.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07e531e700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 0x7f07c8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.173+0000 7f07e531e700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 0x7f07c8055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f07d001c000 tx=0x7f07d0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.177+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07e0143a40 con 0x7f07e00b4380 2021-10-21T00:11:45.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.301+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e00b08d0 con 0x7f07e00b4380 2021-10-21T00:11:45.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07d67fc700 1 -- 172.21.15.41:0/3909114732 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f07dc018020 con 0x7f07e00b4380 2021-10-21T00:11:45.313 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:45.313 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":127,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:42.857688+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:45.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 msgr2=0x7f07c8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 0x7f07c8055b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f07d001c000 tx=0x7f07d0015000).stop 2021-10-21T00:11:45.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 msgr2=0x7f07e0141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f07dc000ed0 tx=0x7f07dc007a80).stop 2021-10-21T00:11:45.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 shutdown_connections 2021-10-21T00:11:45.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f07c8053640 0x7f07c8055b00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07e0140890 0x7f07e00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f07e00b4380 0x7f07e0141db0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 --2- 172.21.15.41:0/3909114732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07e00b1830 0x7f07e00b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 >> 172.21.15.41:0/3909114732 conn(0x7f07e00b7910 msgr2=0x7f07e013a600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 shutdown_connections 2021-10-21T00:11:45.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.305+0000 7f07e6320700 1 -- 172.21.15.41:0/3909114732 wait complete. 2021-10-21T00:11:45.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:11:39.909885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:11:40.867103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:11:45.329 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.429+0000 7f31c6a15700 1 Processor -- start 2021-10-21T00:11:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.429+0000 7f31c6a15700 1 -- start start 2021-10-21T00:11:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 0x7f31c00ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31c01433e0 0x7f31c0062940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c00ae020 con 0x7f31c00b4380 2021-10-21T00:11:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00ade00 con 0x7f31c01433e0 2021-10-21T00:11:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c005fe50 con 0x7f31c00b1830 2021-10-21T00:11:45.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31c01433e0 0x7f31c0062940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c5a13700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f31c00b4380 0x7f31c005f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35280/0 (socket says 172.21.15.41:35280) 2021-10-21T00:11:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c5a13700 1 -- 172.21.15.41:0/438971472 learned_addr learned my addr 172.21.15.41:0/438971472 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c5212700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 0x7f31c00ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 -- 172.21.15.41:0/438971472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 msgr2=0x7f31c00ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 0x7f31c00ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 -- 172.21.15.41:0/438971472 >> v1:172.21.15.41:6789/0 conn(0x7f31c00b4380 legacy=0x7f31c005f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c4a11700 1 -- 172.21.15.41:0/438971472 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586690337 0 0) 0x7f31c00ae020 con 0x7f31c00b4380 2021-10-21T00:11:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 -- 172.21.15.41:0/438971472 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00b4760 con 0x7f31c01433e0 2021-10-21T00:11:45.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c5212700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 0x7f31c00ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6214700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c01433e0 0x7f31c0062940 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f31b80032f0 tx=0x7f31b80091d0).ready entity=mon.0 client_cookie=ca9a66fc93585acc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c4a11700 1 -- 172.21.15.41:0/438971472 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b8009ea0 con 0x7f31c01433e0 2021-10-21T00:11:45.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c4a11700 1 -- 172.21.15.41:0/438971472 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800b8a0 con 0x7f31c01433e0 2021-10-21T00:11:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c4a11700 1 -- 172.21.15.41:0/438971472 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31b800ba10 con 0x7f31c01433e0 2021-10-21T00:11:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- 172.21.15.41:0/438971472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c01433e0 msgr2=0x7f31c0062940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c01433e0 0x7f31c0062940 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f31b80032f0 tx=0x7f31b80091d0).stop 2021-10-21T00:11:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- 172.21.15.41:0/438971472 shutdown_connections 2021-10-21T00:11:45.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c01433e0 0x7f31c0062940 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 --2- 172.21.15.41:0/438971472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c00b1830 0x7f31c00ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- 172.21.15.41:0/438971472 >> 172.21.15.41:0/438971472 conn(0x7f31c00b7910 msgr2=0x7f31c00b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- 172.21.15.41:0/438971472 shutdown_connections 2021-10-21T00:11:45.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.433+0000 7f31c6a15700 1 -- 172.21.15.41:0/438971472 wait complete. 2021-10-21T00:11:45.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 Processor -- start 2021-10-21T00:11:45.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- start start 2021-10-21T00:11:45.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 0x7f31c009a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c01433e0 0x7f31c0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c009ce10 con 0x7f31c00b4380 2021-10-21T00:11:45.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0156180 con 0x7f31c00b1830 2021-10-21T00:11:45.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0156420 con 0x7f31c01433e0 2021-10-21T00:11:45.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37520/0 (socket says 172.21.15.41:37520) 2021-10-21T00:11:45.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 -- 172.21.15.41:0/2054097105 learned_addr learned my addr 172.21.15.41:0/2054097105 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:45.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5a13700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 0x7f31c009a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6214700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c01433e0 0x7f31c0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 -- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c01433e0 msgr2=0x7f31c0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c01433e0 0x7f31c0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 -- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 msgr2=0x7f31c009a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 0x7f31c009a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 -- 172.21.15.41:0/2054097105 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009470 con 0x7f31c00b4380 2021-10-21T00:11:45.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5a13700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 0x7f31c009a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:45.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c5212700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f31bc00a000 tx=0x7f31bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31bc011780 con 0x7f31c00b4380 2021-10-21T00:11:45.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0118e0 con 0x7f31c00b4380 2021-10-21T00:11:45.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31bc011c40 con 0x7f31c00b4380 2021-10-21T00:11:45.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c009a540 con 0x7f31c00b4380 2021-10-21T00:11:45.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.437+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c0152300 con 0x7f31c00b4380 2021-10-21T00:11:45.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c01565e0 con 0x7f31c00b4380 2021-10-21T00:11:45.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31bc01c460 con 0x7f31c00b4380 2021-10-21T00:11:45.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31aeffd700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 0x7f31a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31bc06c4e0 con 0x7f31c00b4380 2021-10-21T00:11:45.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31c5a13700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 0x7f31a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.441+0000 7f31c5a13700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 0x7f31a0055ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f31b000b000 tx=0x7f31b0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.445+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31bc0434d0 con 0x7f31c00b4380 2021-10-21T00:11:45.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.573+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f31c0142ca0 con 0x7f31c00b4380 2021-10-21T00:11:45.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.573+0000 7f31aeffd700 1 -- 172.21.15.41:0/2054097105 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7f31bc046af0 con 0x7f31c00b4380 2021-10-21T00:11:45.583 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:45.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 msgr2=0x7f31a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 0x7f31a0055ad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f31b000b000 tx=0x7f31b0009040).stop 2021-10-21T00:11:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 msgr2=0x7f31c0152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f31bc00a000 tx=0x7f31bc008040).stop 2021-10-21T00:11:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 shutdown_connections 2021-10-21T00:11:45.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f31a0053610 0x7f31a0055ad0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f31c01433e0 0x7f31c0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31c00b4380 0x7f31c0152af0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 --2- 172.21.15.41:0/2054097105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31c00b1830 0x7f31c009a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 >> 172.21.15.41:0/2054097105 conn(0x7f31c00b7910 msgr2=0x7f31c00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 shutdown_connections 2021-10-21T00:11:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.577+0000 7f31c6a15700 1 -- 172.21.15.41:0/2054097105 wait complete. 2021-10-21T00:11:45.599 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.697+0000 7fc29f3ac700 1 Processor -- start 2021-10-21T00:11:45.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.697+0000 7fc29f3ac700 1 -- start start 2021-10-21T00:11:45.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.697+0000 7fc29f3ac700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc29805bfe0 0x7fc2981461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.697+0000 7fc29f3ac700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29805c3c0 con 0x7fc298146ba0 2021-10-21T00:11:45.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2980b1920 con 0x7fc29805bfe0 2021-10-21T00:11:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980b27a0 con 0x7fc298067a00 2021-10-21T00:11:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29e3aa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc29805bfe0 0x7fc2981461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.712 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29ebab700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc298146ba0 0x7fc29805f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:43354/0 (socket says 172.21.15.41:43354) 2021-10-21T00:11:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29ebab700 1 -- 172.21.15.41:0/3983766053 learned_addr learned my addr 172.21.15.41:0/3983766053 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56024/0 (socket says 172.21.15.41:56024) 2021-10-21T00:11:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 -- 172.21.15.41:0/3983766053 >> v2:172.21.15.62:3300/0 conn(0x7fc29805bfe0 msgr2=0x7fc2981461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 --2- 172.21.15.41:0/3983766053 >> v2:172.21.15.62:3300/0 conn(0x7fc29805bfe0 0x7fc2981461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 -- 172.21.15.41:0/3983766053 >> v1:172.21.15.62:6789/0 conn(0x7fc298146ba0 legacy=0x7fc29805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29d3a8700 1 -- 172.21.15.41:0/3983766053 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387670084 0 0) 0x7fc29805c3c0 con 0x7fc298146ba0 2021-10-21T00:11:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 -- 172.21.15.41:0/3983766053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980b2a40 con 0x7fc298067a00 2021-10-21T00:11:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29dba9700 1 --2- 172.21.15.41:0/3983766053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc288002f70 tx=0x7fc288006df0).ready entity=mon.2 client_cookie=4c83d9e896a04bca server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29d3a8700 1 -- 172.21.15.41:0/3983766053 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28800d570 con 0x7fc298067a00 2021-10-21T00:11:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29d3a8700 1 -- 172.21.15.41:0/3983766053 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288000e90 con 0x7fc298067a00 2021-10-21T00:11:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29d3a8700 1 -- 172.21.15.41:0/3983766053 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28800d8c0 con 0x7fc298067a00 2021-10-21T00:11:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- 172.21.15.41:0/3983766053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 msgr2=0x7fc2981466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/3983766053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc288002f70 tx=0x7fc288006df0).stop 2021-10-21T00:11:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- 172.21.15.41:0/3983766053 shutdown_connections 2021-10-21T00:11:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/3983766053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc2981466b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/3983766053 >> v2:172.21.15.62:3300/0 conn(0x7fc29805bfe0 0x7fc2981461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- 172.21.15.41:0/3983766053 >> 172.21.15.41:0/3983766053 conn(0x7fc2980637b0 msgr2=0x7fc298063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- 172.21.15.41:0/3983766053 shutdown_connections 2021-10-21T00:11:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.701+0000 7fc29f3ac700 1 -- 172.21.15.41:0/3983766053 wait complete. 2021-10-21T00:11:45.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 Processor -- start 2021-10-21T00:11:45.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- start start 2021-10-21T00:11:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 0x7fc2980b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc298142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980adf10 con 0x7fc29805bfe0 2021-10-21T00:11:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980ae1b0 con 0x7fc298146ba0 2021-10-21T00:11:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc298114040 con 0x7fc298067a00 2021-10-21T00:11:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29e3aa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 0x7fc2980b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49450/0 (socket says 172.21.15.41:49450) 2021-10-21T00:11:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29e3aa700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 0x7fc2980b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37530/0 (socket says 172.21.15.41:37530) 2021-10-21T00:11:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 -- 172.21.15.41:0/343564023 learned_addr learned my addr 172.21.15.41:0/343564023 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29dba9700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc298142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 -- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 msgr2=0x7fc298142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc298142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 -- 172.21.15.41:0/343564023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 msgr2=0x7fc2980b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 0x7fc2980b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 -- 172.21.15.41:0/343564023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28800b180 con 0x7fc298146ba0 2021-10-21T00:11:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29ebab700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc290000f40 tx=0x7fc290007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc29000cea0 con 0x7fc298146ba0 2021-10-21T00:11:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290005ba0 con 0x7fc298146ba0 2021-10-21T00:11:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2981142e0 con 0x7fc298146ba0 2021-10-21T00:11:45.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2900070d0 con 0x7fc298146ba0 2021-10-21T00:11:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.705+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2980ad240 con 0x7fc298146ba0 2021-10-21T00:11:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2980b1480 con 0x7fc298146ba0 2021-10-21T00:11:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc290010070 con 0x7fc298146ba0 2021-10-21T00:11:45.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc2877fe700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 0x7fc278055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc29006b1f0 con 0x7fc298146ba0 2021-10-21T00:11:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc29e3aa700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 0x7fc278055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.709+0000 7fc29e3aa700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 0x7fc278055a40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc294006000 tx=0x7fc294006d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.721+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2900422b0 con 0x7fc298146ba0 2021-10-21T00:11:45.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.849+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc298057350 con 0x7fc298146ba0 2021-10-21T00:11:45.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc2877fe700 1 -- 172.21.15.41:0/343564023 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2900458d0 con 0x7fc298146ba0 2021-10-21T00:11:45.860 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:45.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 msgr2=0x7fc278055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 0x7fc278055a40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc294006000 tx=0x7fc294006d90).stop 2021-10-21T00:11:45.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 msgr2=0x7fc2980ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc290000f40 tx=0x7fc290007f40).stop 2021-10-21T00:11:45.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 shutdown_connections 2021-10-21T00:11:45.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc278053580 0x7fc278055a40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc298146ba0 0x7fc2980ae770 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc298067a00 0x7fc298142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 --2- 172.21.15.41:0/343564023 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc29805bfe0 0x7fc2980b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 >> 172.21.15.41:0/343564023 conn(0x7fc2980637b0 msgr2=0x7fc2981489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:45.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 shutdown_connections 2021-10-21T00:11:45.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.853+0000 7fc29f3ac700 1 -- 172.21.15.41:0/343564023 wait complete. 2021-10-21T00:11:45.881 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:11:45.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 Processor -- start 2021-10-21T00:11:45.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 -- start start 2021-10-21T00:11:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6640b2730 0x7ff66405c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:45.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66414b140 con 0x7ff66405bca0 2021-10-21T00:11:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66414aea0 con 0x7ff6640b2730 2021-10-21T00:11:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff668a24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640ac9a0 con 0x7ff6640b2e00 2021-10-21T00:11:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6637fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff66405bca0 0x7ff664146c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35308/0 (socket says 172.21.15.41:35308) 2021-10-21T00:11:45.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6637fe700 1 -- 172.21.15.41:0/609676380 learned_addr learned my addr 172.21.15.41:0/609676380 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff662ffd700 1 --2- 172.21.15.41:0/609676380 >> v2:172.21.15.62:3300/0 conn(0x7ff6640b2730 0x7ff66405c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 --2- 172.21.15.41:0/609676380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570039175 0 0) 0x7ff66414b140 con 0x7ff66405bca0 2021-10-21T00:11:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650003260 con 0x7ff66405bca0 2021-10-21T00:11:45.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704335590 0 0) 0x7ff650003260 con 0x7ff66405bca0 2021-10-21T00:11:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 -- 172.21.15.41:0/609676380 >> v2:172.21.15.62:3300/0 conn(0x7ff6640b2730 msgr2=0x7ff66405c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 --2- 172.21.15.41:0/609676380 >> v2:172.21.15.62:3300/0 conn(0x7ff6640b2730 0x7ff66405c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 -- 172.21.15.41:0/609676380 >> v1:172.21.15.41:6789/0 conn(0x7ff66405bca0 legacy=0x7ff664146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:45.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 -- 172.21.15.41:0/609676380 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6640677b0 con 0x7ff6640b2e00 2021-10-21T00:11:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff663fff700 1 --2- 172.21.15.41:0/609676380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640672c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff654001800 tx=0x7ff65c0091d0).ready entity=mon.2 client_cookie=bf584e97ffc15166 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff654001660 con 0x7ff6640b2e00 2021-10-21T00:11:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c00f510 con 0x7ff6640b2e00 2021-10-21T00:11:45.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.985+0000 7ff6627fc700 1 -- 172.21.15.41:0/609676380 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65c00f680 con 0x7ff6640b2e00 2021-10-21T00:11:46.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- 172.21.15.41:0/609676380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 msgr2=0x7ff6640672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- 172.21.15.41:0/609676380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640672c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff654001800 tx=0x7ff65c0091d0).stop 2021-10-21T00:11:46.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- 172.21.15.41:0/609676380 shutdown_connections 2021-10-21T00:11:46.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- 172.21.15.41:0/609676380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640672c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- 172.21.15.41:0/609676380 >> v2:172.21.15.62:3300/0 conn(0x7ff6640b2730 0x7ff66405c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- 172.21.15.41:0/609676380 >> 172.21.15.41:0/609676380 conn(0x7ff664069df0 msgr2=0x7ff664063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- 172.21.15.41:0/609676380 shutdown_connections 2021-10-21T00:11:46.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- 172.21.15.41:0/609676380 wait complete. 2021-10-21T00:11:46.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 Processor -- start 2021-10-21T00:11:46.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- start start 2021-10-21T00:11:46.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 0x7ff664143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640af4d0 con 0x7ff66405bca0 2021-10-21T00:11:46.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640acf50 con 0x7ff6640b2730 2021-10-21T00:11:46.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.989+0000 7ff668a24700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff664143c60 con 0x7ff6640b2e00 2021-10-21T00:11:46.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37544/0 (socket says 172.21.15.41:37544) 2021-10-21T00:11:46.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 -- 172.21.15.41:0/2171040641 learned_addr learned my addr 172.21.15.41:0/2171040641 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:46.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff663fff700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff662ffd700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 0x7ff664143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 -- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 msgr2=0x7ff6640b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 -- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 msgr2=0x7ff664143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 0x7ff664143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 -- 172.21.15.41:0/2171040641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c009470 con 0x7ff66405bca0 2021-10-21T00:11:46.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff662ffd700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 0x7ff664143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:46.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff6637fe700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7ff6640b0690 tx=0x7ff6540011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff654007170 con 0x7ff66405bca0 2021-10-21T00:11:46.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540072d0 con 0x7ff66405bca0 2021-10-21T00:11:46.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff664156bb0 con 0x7ff66405bca0 2021-10-21T00:11:46.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff654004920 con 0x7ff66405bca0 2021-10-21T00:11:46.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6640b1e00 con 0x7ff66405bca0 2021-10-21T00:11:46.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.993+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6640ad0e0 con 0x7ff66405bca0 2021-10-21T00:11:46.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.997+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff654004a80 con 0x7ff66405bca0 2021-10-21T00:11:46.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.997+0000 7ff660ff9700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 0x7ff644055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.997+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff65406b5e0 con 0x7ff66405bca0 2021-10-21T00:11:46.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.997+0000 7ff662ffd700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 0x7ff644055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:45.997+0000 7ff662ffd700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 0x7ff644055ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7ff65800b000 tx=0x7ff658008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.001+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff6640ad0e0 con 0x7ff66405bca0 2021-10-21T00:11:46.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6640ad0e0 con 0x7ff66405bca0 2021-10-21T00:11:46.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff660ff9700 1 -- 172.21.15.41:0/2171040641 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff6640ad0e0 con 0x7ff66405bca0 2021-10-21T00:11:46.141 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:46.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 msgr2=0x7ff644055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 0x7ff644055ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7ff65800b000 tx=0x7ff658008040).stop 2021-10-21T00:11:46.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 msgr2=0x7ff664143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7ff6640b0690 tx=0x7ff6540011a0).stop 2021-10-21T00:11:46.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 shutdown_connections 2021-10-21T00:11:46.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff644053610 0x7ff644055ad0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff6640b2e00 0x7ff6640b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6640b2730 0x7ff664143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 --2- 172.21.15.41:0/2171040641 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff66405bca0 0x7ff664143280 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 >> 172.21.15.41:0/2171040641 conn(0x7ff664069df0 msgr2=0x7ff6640b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 shutdown_connections 2021-10-21T00:11:46.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.133+0000 7ff668a24700 1 -- 172.21.15.41:0/2171040641 wait complete. 2021-10-21T00:11:46.154 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:11:46.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 Processor -- start 2021-10-21T00:11:46.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 -- start start 2021-10-21T00:11:46.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03c00b5270 0x7f03c0146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00ba080 con 0x7f03c00b9ca0 2021-10-21T00:11:46.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00b11f0 con 0x7f03c00b5270 2021-10-21T00:11:46.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c838e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00b0220 con 0x7f03c00b3e00 2021-10-21T00:11:46.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f03c00b5270 0x7f03c0146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c612a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f03c00b9ca0 0x7f03c0146590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35322/0 (socket says 172.21.15.41:35322) 2021-10-21T00:11:46.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c612a700 1 -- 172.21.15.41:0/1438349412 learned_addr learned my addr 172.21.15.41:0/1438349412 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:46.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c692b700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 -- 172.21.15.41:0/1438349412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 msgr2=0x7f03c00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:46.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 -- 172.21.15.41:0/1438349412 >> v1:172.21.15.41:6789/0 conn(0x7f03c00b9ca0 legacy=0x7f03c0146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 -- 172.21.15.41:0/1438349412 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00b4b30 con 0x7f03c00b5270 2021-10-21T00:11:46.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c692b700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:46.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5929700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0146ca0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f03b0002f70 tx=0x7f03b0006df0).ready entity=mon.0 client_cookie=167e9e80cbb62d04 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5128700 1 -- 172.21.15.41:0/1438349412 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03b000d570 con 0x7f03c00b5270 2021-10-21T00:11:46.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5128700 1 -- 172.21.15.41:0/1438349412 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0000e90 con 0x7f03c00b5270 2021-10-21T00:11:46.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.261+0000 7f03c5128700 1 -- 172.21.15.41:0/1438349412 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03b000d8c0 con 0x7f03c00b5270 2021-10-21T00:11:46.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- 172.21.15.41:0/1438349412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 msgr2=0x7f03c0146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0146ca0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f03b0002f70 tx=0x7f03b0006df0).stop 2021-10-21T00:11:46.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- 172.21.15.41:0/1438349412 shutdown_connections 2021-10-21T00:11:46.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- 172.21.15.41:0/1438349412 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0146ca0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- 172.21.15.41:0/1438349412 >> 172.21.15.41:0/1438349412 conn(0x7f03c0062f00 msgr2=0x7f03c00b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- 172.21.15.41:0/1438349412 shutdown_connections 2021-10-21T00:11:46.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- 172.21.15.41:0/1438349412 wait complete. 2021-10-21T00:11:46.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 Processor -- start 2021-10-21T00:11:46.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- start start 2021-10-21T00:11:46.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c0148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0067180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03c00b9ca0 0x7f03c0149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01486c0 con 0x7f03c00b5270 2021-10-21T00:11:46.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c014b170 con 0x7f03c00b9ca0 2021-10-21T00:11:46.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c838e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c014b410 con 0x7f03c00b3e00 2021-10-21T00:11:46.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c5929700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c5929700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0067180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37560/0 (socket says 172.21.15.41:37560) 2021-10-21T00:11:46.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c5929700 1 -- 172.21.15.41:0/2850233439 learned_addr learned my addr 172.21.15.41:0/2850233439 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:46.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c612a700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c0148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.265+0000 7f03c692b700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03c00b9ca0 0x7f03c0149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 -- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03c00b9ca0 msgr2=0x7f03c0149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03c00b9ca0 0x7f03c0149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 -- 172.21.15.41:0/2850233439 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 msgr2=0x7f03c0067180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0067180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 -- 172.21.15.41:0/2850233439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b000b180 con 0x7f03c00b3e00 2021-10-21T00:11:46.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c612a700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c0148af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f03c00633e0 tx=0x7f03bc007ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc007e10 con 0x7f03c00b3e00 2021-10-21T00:11:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c0063930 con 0x7f03c00b3e00 2021-10-21T00:11:46.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0063640 con 0x7f03c00b3e00 2021-10-21T00:11:46.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc007110 con 0x7f03c00b3e00 2021-10-21T00:11:46.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc007470 con 0x7f03c00b3e00 2021-10-21T00:11:46.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c01569a0 con 0x7f03c00b3e00 2021-10-21T00:11:46.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03bc01b070 con 0x7f03c00b3e00 2021-10-21T00:11:46.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 0x7f03a0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03bc06adb0 con 0x7f03c00b3e00 2021-10-21T00:11:46.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.269+0000 7f03c5929700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 0x7f03a0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.273+0000 7f03c5929700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 0x7f03a0055a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f03b001c000 tx=0x7f03b0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.281+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03bc06f070 con 0x7f03c00b3e00 2021-10-21T00:11:46.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03c0057350 con 0x7f03c00b3e00 2021-10-21T00:11:46.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03af7fe700 1 -- 172.21.15.41:0/2850233439 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+10 (secure 0 0 0) 0x7f03bc041d80 con 0x7f03c00b3e00 2021-10-21T00:11:46.421 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:46.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 msgr2=0x7f03a0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 0x7f03a0055a40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f03b001c000 tx=0x7f03b0015000).stop 2021-10-21T00:11:46.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 msgr2=0x7f03c0148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c0148af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f03c00633e0 tx=0x7f03bc007ba0).stop 2021-10-21T00:11:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 shutdown_connections 2021-10-21T00:11:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03a0053580 0x7f03a0055a40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03c00b9ca0 0x7f03c0149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03c00b5270 0x7f03c0067180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 --2- 172.21.15.41:0/2850233439 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03c00b3e00 0x7f03c0148af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.413+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 >> 172.21.15.41:0/2850233439 conn(0x7f03c0062f00 msgr2=0x7f03c0143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.417+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 shutdown_connections 2021-10-21T00:11:46.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.417+0000 7f03c838e700 1 -- 172.21.15.41:0/2850233439 wait complete. 2021-10-21T00:11:46.435 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:11:46.436 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:46.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 Processor -- start 2021-10-21T00:11:46.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 -- start start 2021-10-21T00:11:46.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b9005fb00 0x7f0b900ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b90143000 0x7f0b9013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9005fee0 con 0x7f0b90142480 2021-10-21T00:11:46.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b90060640 con 0x7f0b90143000 2021-10-21T00:11:46.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b900aa0a0 con 0x7f0b9005fb00 2021-10-21T00:11:46.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b9005fb00 0x7f0b900ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b9005fb00 0x7f0b900ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49484/0 (socket says 172.21.15.41:49484) 2021-10-21T00:11:46.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8e59c700 1 -- 172.21.15.41:0/2143301354 learned_addr learned my addr 172.21.15.41:0/2143301354 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:46.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.533+0000 7f0b8ed9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0b90143000 0x7f0b9013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8e59c700 1 -- 172.21.15.41:0/2143301354 >> v2:172.21.15.41:3300/0 conn(0x7f0b90143000 msgr2=0x7f0b9013f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:46.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8e59c700 1 --2- 172.21.15.41:0/2143301354 >> v2:172.21.15.41:3300/0 conn(0x7f0b90143000 0x7f0b9013f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8e59c700 1 -- 172.21.15.41:0/2143301354 >> v1:172.21.15.62:6789/0 conn(0x7f0b90142480 legacy=0x7f0b901428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8e59c700 1 -- 172.21.15.41:0/2143301354 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900aa340 con 0x7f0b9005fb00 2021-10-21T00:11:46.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8e59c700 1 --2- 172.21.15.41:0/2143301354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b9005fb00 0x7f0b900ab9a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f0b80002f70 tx=0x7f0b80006eb0).ready entity=mon.1 client_cookie=13af4d0765177083 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8d59a700 1 -- 172.21.15.41:0/2143301354 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8000fa60 con 0x7f0b9005fb00 2021-10-21T00:11:46.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8d59a700 1 -- 172.21.15.41:0/2143301354 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80000e90 con 0x7f0b9005fb00 2021-10-21T00:11:46.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8d59a700 1 -- 172.21.15.41:0/2143301354 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8000fdb0 con 0x7f0b9005fb00 2021-10-21T00:11:46.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- 172.21.15.41:0/2143301354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b9005fb00 msgr2=0x7f0b900ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/2143301354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b9005fb00 0x7f0b900ab9a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f0b80002f70 tx=0x7f0b80006eb0).stop 2021-10-21T00:11:46.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- 172.21.15.41:0/2143301354 shutdown_connections 2021-10-21T00:11:46.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/2143301354 >> v2:172.21.15.41:3300/0 conn(0x7f0b90143000 0x7f0b9013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/2143301354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b9005fb00 0x7f0b900ab9a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- 172.21.15.41:0/2143301354 >> 172.21.15.41:0/2143301354 conn(0x7f0b900b5700 msgr2=0x7f0b900b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- 172.21.15.41:0/2143301354 shutdown_connections 2021-10-21T00:11:46.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- 172.21.15.41:0/2143301354 wait complete. 2021-10-21T00:11:46.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 Processor -- start 2021-10-21T00:11:46.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.537+0000 7f0b8f59e700 1 -- start start 2021-10-21T00:11:46.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b9005fb00 0x7f0b90146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b90143000 0x7f0b900ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90063af0 con 0x7f0b90142480 2021-10-21T00:11:46.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900ae9e0 con 0x7f0b90143000 2021-10-21T00:11:46.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900aec80 con 0x7f0b9005fb00 2021-10-21T00:11:46.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37574/0 (socket says 172.21.15.41:37574) 2021-10-21T00:11:46.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 -- 172.21.15.41:0/3375299830 learned_addr learned my addr 172.21.15.41:0/3375299830 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:46.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8e59c700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b9005fb00 0x7f0b90146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8ed9d700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b90143000 0x7f0b900ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 -- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b9005fb00 msgr2=0x7f0b90146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b9005fb00 0x7f0b90146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 -- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b90143000 msgr2=0x7f0b900ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b90143000 0x7f0b900ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 -- 172.21.15.41:0/3375299830 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8000b1e0 con 0x7f0b90142480 2021-10-21T00:11:46.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8dd9b700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f0b900ab1d0 tx=0x7f0b84007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b84007030 con 0x7f0b90142480 2021-10-21T00:11:46.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b84007190 con 0x7f0b90142480 2021-10-21T00:11:46.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b900ac640 con 0x7f0b90142480 2021-10-21T00:11:46.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b84006510 con 0x7f0b90142480 2021-10-21T00:11:46.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b90063800 con 0x7f0b90142480 2021-10-21T00:11:46.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.541+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90151410 con 0x7f0b90142480 2021-10-21T00:11:46.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.545+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b84006670 con 0x7f0b90142480 2021-10-21T00:11:46.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.545+0000 7f0b7f7fe700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 0x7f0b6c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:46.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.545+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b8406b330 con 0x7f0b90142480 2021-10-21T00:11:46.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.545+0000 7f0b8e59c700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 0x7f0b6c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:46.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.545+0000 7f0b8e59c700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 0x7f0b6c0559b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f0b8001e000 tx=0x7f0b80017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:46.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.549+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b84042320 con 0x7f0b90142480 2021-10-21T00:11:46.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b900aee40 con 0x7f0b90142480 2021-10-21T00:11:46.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b7f7fe700 1 -- 172.21.15.41:0/3375299830 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f0b84045940 con 0x7f0b90142480 2021-10-21T00:11:46.721 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:46.721 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 msgr2=0x7f0b6c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 0x7f0b6c0559b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f0b8001e000 tx=0x7f0b80017000).stop 2021-10-21T00:11:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 msgr2=0x7f0b90141c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f0b900ab1d0 tx=0x7f0b84007be0).stop 2021-10-21T00:11:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 shutdown_connections 2021-10-21T00:11:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0b6c0534f0 0x7f0b6c0559b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b90143000 0x7f0b900ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0b90142480 0x7f0b90141c50 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 --2- 172.21.15.41:0/3375299830 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0b9005fb00 0x7f0b90146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:46.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 >> 172.21.15.41:0/3375299830 conn(0x7f0b900b5700 msgr2=0x7f0b9005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:46.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 shutdown_connections 2021-10-21T00:11:46.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:46.713+0000 7f0b8f59e700 1 -- 172.21.15.41:0/3375299830 wait complete. 2021-10-21T00:11:46.726 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:46.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:41.854126+0000', 'modified': '2021-10-21T00:11:42.858043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/204327833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 204327833}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 204327833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:46.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:46.938 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:11:47.052 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8091,"want_state":"up:active","state":"up:active","rank_uptime":5.1815513170000003,"mdsmap_epoch":66,"osdmap_epoch":127,"osdmap_epoch_barrier":126,"uptime":9.9207975570000002} 2021-10-21T00:11:47.053 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8091, "mdsmap_epoch": 66, "osdmap_epoch": 127, "osdmap_epoch_barrier": 126, "rank_uptime": 5.181551317, "state": "up:active", "uptime": 9.920797557, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:47.054 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:11:47.054 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:11:47.054 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:11:47.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:47.056 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:47.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:47.081 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:47.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:47.140 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:47.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:47.141 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:47.148 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:11:47.148 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:47.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:47.171 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:47.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:47.226 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:47.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:11:47.218+0000 7fab1bf36080 -1 init, newargv = 0x55c79d3a3700 newargc=9ceph-fuse[15020 2021-10-21T00:11:47.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:]: starting ceph client 2021-10-21T00:11:47.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:47.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:47.229 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:47.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15020]: starting fuse 2021-10-21T00:11:48.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:11:48.362 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:48.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:48.421 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:48.422 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:48.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:48.423 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:11:48.430 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:11:48.431 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:11:48.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:48.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:11:48.432 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:11:48.432 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:11:48.433 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:11:48.433 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:11:48.434 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:48.434 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:11:48.434 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:11:48.435 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:11:48.435 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:48.436 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:11:48.437 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:11:48.437 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:11:48.438 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:11:48.438 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:48.439 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:11:48.440 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:11:48.440 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:11:48.441 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:11:48.441 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:11:48.441 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:48.442 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:11:48.442 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:11:48.486 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.15020.asok 2021-10-21T00:11:48.492 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15020.asok 2021-10-21T00:11:48.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:48.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15020.asok status 2021-10-21T00:11:48.583 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:11:48.584 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:11:48.584 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:11:48.584 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:11:48.584 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:11:48.584 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:11:48.585 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:11:48.585 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "15020", 2021-10-21T00:11:48.586 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:11:48.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:48.586 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:11:48.586 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:11:48.587 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 8259, 2021-10-21T00:11:48.587 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:11:48.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:11:48.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:11:48.587 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 8259 2021-10-21T00:11:48.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:48.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:11:48.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:11:48.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:11:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1591757054 2021-10-21T00:11:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:11:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:11:48.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:11:48.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:11:48.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1591757054 2021-10-21T00:11:48.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:11:48.590 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.8259 172.21.15.71:0/1591757054", 2021-10-21T00:11:48.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/1591757054", 2021-10-21T00:11:48.591 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:11:48.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 66, 2021-10-21T00:11:48.592 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 127, 2021-10-21T00:11:48.592 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:11:48.592 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:11:48.592 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:11:48.592 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:11:48.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:48.594 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:48.595 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:48.602 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:48.603 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:48.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:48.604 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:48.623 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:48.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 Processor -- start 2021-10-21T00:11:48.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- start start 2021-10-21T00:11:48.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f005f9f0 0x7f40f014a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40f00aa750 0x7f40f014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f40f014b130 0x7f40f01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00b1620 con 0x7f40f00aa750 2021-10-21T00:11:48.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00609d0 con 0x7f40f014b130 2021-10-21T00:11:48.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f005fdd0 con 0x7f40f005f9f0 2021-10-21T00:11:48.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40f00aa750 0x7f40f014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f40f00aa750 0x7f40f014ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37580/0 (socket says 172.21.15.41:37580) 2021-10-21T00:11:48.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 -- 172.21.15.41:0/3426531770 learned_addr learned my addr 172.21.15.41:0/3426531770 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:48.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40effff700 1 --2- 172.21.15.41:0/3426531770 >> v2:172.21.15.62:3300/0 conn(0x7f40f014b130 0x7f40f01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40ef7fe700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f005f9f0 0x7f40f014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 -- 172.21.15.41:0/3426531770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f005f9f0 msgr2=0x7f40f014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:48.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f005f9f0 0x7f40f014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 -- 172.21.15.41:0/3426531770 >> v2:172.21.15.62:3300/0 conn(0x7f40f014b130 msgr2=0x7f40f01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:48.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 --2- 172.21.15.41:0/3426531770 >> v2:172.21.15.62:3300/0 conn(0x7f40f014b130 0x7f40f01495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 -- 172.21.15.41:0/3426531770 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00b1380 con 0x7f40f00aa750 2021-10-21T00:11:48.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40eeffd700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f00aa750 0x7f40f014ac40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f40e80032f0 tx=0x7f40e8009290).ready entity=mon.0 client_cookie=73d9d8ab76da2327 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:48.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40ee7fc700 1 -- 172.21.15.41:0/3426531770 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e800b870 con 0x7f40f00aa750 2021-10-21T00:11:48.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40ee7fc700 1 -- 172.21.15.41:0/3426531770 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e800b9d0 con 0x7f40f00aa750 2021-10-21T00:11:48.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40ee7fc700 1 -- 172.21.15.41:0/3426531770 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e800bb40 con 0x7f40f00aa750 2021-10-21T00:11:48.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- 172.21.15.41:0/3426531770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f00aa750 msgr2=0x7f40f014ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:48.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f00aa750 0x7f40f014ac40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f40e80032f0 tx=0x7f40e8009290).stop 2021-10-21T00:11:48.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- 172.21.15.41:0/3426531770 shutdown_connections 2021-10-21T00:11:48.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f00aa750 0x7f40f014ac40 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/3426531770 >> v2:172.21.15.62:3300/0 conn(0x7f40f014b130 0x7f40f01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/3426531770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f005f9f0 0x7f40f014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- 172.21.15.41:0/3426531770 >> 172.21.15.41:0/3426531770 conn(0x7f40f005bca0 msgr2=0x7f40f005c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:48.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- 172.21.15.41:0/3426531770 shutdown_connections 2021-10-21T00:11:48.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.729+0000 7f40f5ce9700 1 -- 172.21.15.41:0/3426531770 wait complete. 2021-10-21T00:11:48.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 Processor -- start 2021-10-21T00:11:48.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 -- start start 2021-10-21T00:11:48.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 0x7f40f00b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f014b130 0x7f40f0145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f015a720 con 0x7f40f005f9f0 2021-10-21T00:11:48.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00994e0 con 0x7f40f00aa750 2021-10-21T00:11:48.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40f5ce9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0099780 con 0x7f40f014b130 2021-10-21T00:11:48.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37586/0 (socket says 172.21.15.41:37586) 2021-10-21T00:11:48.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 -- 172.21.15.41:0/2464217747 learned_addr learned my addr 172.21.15.41:0/2464217747 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:48.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40eeffd700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 0x7f40f00b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40effff700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f014b130 0x7f40f0145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 -- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f014b130 msgr2=0x7f40f0145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:48.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f014b130 0x7f40f0145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 -- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 msgr2=0x7f40f00b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:48.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 0x7f40f00b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40ef7fe700 1 -- 172.21.15.41:0/2464217747 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009530 con 0x7f40f005f9f0 2021-10-21T00:11:48.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.733+0000 7f40eeffd700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 0x7f40f00b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:48.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ef7fe700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f40e40030b0 tx=0x7f40e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:48.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e4011780 con 0x7f40f005f9f0 2021-10-21T00:11:48.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40118e0 con 0x7f40f005f9f0 2021-10-21T00:11:48.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f0099a20 con 0x7f40f005f9f0 2021-10-21T00:11:48.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e4011c40 con 0x7f40f005f9f0 2021-10-21T00:11:48.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f00ad880 con 0x7f40f005f9f0 2021-10-21T00:11:48.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f014b550 con 0x7f40f005f9f0 2021-10-21T00:11:48.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f40e4012420 con 0x7f40f005f9f0 2021-10-21T00:11:48.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 0x7f40d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:48.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.737+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f40e406b7b0 con 0x7f40f005f9f0 2021-10-21T00:11:48.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.741+0000 7f40eeffd700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 0x7f40d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:48.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.741+0000 7f40eeffd700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 0x7f40d0055a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f40e8019000 tx=0x7f40e8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:48.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.745+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40e40428b0 con 0x7f40f005f9f0 2021-10-21T00:11:48.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.873+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40f0057350 con 0x7f40f005f9f0 2021-10-21T00:11:48.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.873+0000 7f40ecff9700 1 -- 172.21.15.41:0/2464217747 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f40e4045ed0 con 0x7f40f005f9f0 2021-10-21T00:11:48.883 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:48.884 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":127,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:42.857688+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:48.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 msgr2=0x7f40d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:48.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 0x7f40d0055a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f40e8019000 tx=0x7f40e8016000).stop 2021-10-21T00:11:48.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 msgr2=0x7f40f00aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:48.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f40e40030b0 tx=0x7f40e4008040).stop 2021-10-21T00:11:48.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 shutdown_connections 2021-10-21T00:11:48.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f40d0053580 0x7f40d0055a40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f40f014b130 0x7f40f0145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40f00aa750 0x7f40f00b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 --2- 172.21.15.41:0/2464217747 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f40f005f9f0 0x7f40f00aedc0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:48.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 >> 172.21.15.41:0/2464217747 conn(0x7f40f005bca0 msgr2=0x7f40f00b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:48.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 shutdown_connections 2021-10-21T00:11:48.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:48.877+0000 7f40f5ce9700 1 -- 172.21.15.41:0/2464217747 wait complete. 2021-10-21T00:11:48.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:11:39.909885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:11:40.867103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:11:48.905 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:49.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 Processor -- start 2021-10-21T00:11:49.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 -- start start 2021-10-21T00:11:49.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9034062330 0x7f90340b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903405bd40 con 0x7f9034062f70 2021-10-21T00:11:49.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903405bf70 con 0x7f90340b3a20 2021-10-21T00:11:49.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f903a08a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9034142cb0 con 0x7f9034062330 2021-10-21T00:11:49.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9039088700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9034062330 0x7f90340b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9038887700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9034062f70 0x7f903405c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35366/0 (socket says 172.21.15.41:35366) 2021-10-21T00:11:49.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9038887700 1 -- 172.21.15.41:0/1295667554 learned_addr learned my addr 172.21.15.41:0/1295667554 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:49.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9039088700 1 -- 172.21.15.41:0/1295667554 >> v1:172.21.15.62:6789/0 conn(0x7f90340b3a20 legacy=0x7f903413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9039088700 1 -- 172.21.15.41:0/1295667554 >> v1:172.21.15.41:6789/0 conn(0x7f9034062f70 legacy=0x7f903405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9039088700 1 -- 172.21.15.41:0/1295667554 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034142950 con 0x7f9034062330 2021-10-21T00:11:49.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f9039088700 1 --2- 172.21.15.41:0/1295667554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062330 0x7f90340b3f30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f9030002f70 tx=0x7f9030006df0).ready entity=mon.0 client_cookie=a5841307eded4f48 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f902bfff700 1 -- 172.21.15.41:0/1295667554 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000d610 con 0x7f9034062330 2021-10-21T00:11:49.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f902bfff700 1 -- 172.21.15.41:0/1295667554 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030000e90 con 0x7f9034062330 2021-10-21T00:11:49.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.009+0000 7f902bfff700 1 -- 172.21.15.41:0/1295667554 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000d960 con 0x7f9034062330 2021-10-21T00:11:49.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- 172.21.15.41:0/1295667554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062330 msgr2=0x7f90340b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 --2- 172.21.15.41:0/1295667554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062330 0x7f90340b3f30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f9030002f70 tx=0x7f9030006df0).stop 2021-10-21T00:11:49.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- 172.21.15.41:0/1295667554 shutdown_connections 2021-10-21T00:11:49.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 --2- 172.21.15.41:0/1295667554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062330 0x7f90340b3f30 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- 172.21.15.41:0/1295667554 >> 172.21.15.41:0/1295667554 conn(0x7f90340b9080 msgr2=0x7f90340b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- 172.21.15.41:0/1295667554 shutdown_connections 2021-10-21T00:11:49.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- 172.21.15.41:0/1295667554 wait complete. 2021-10-21T00:11:49.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 Processor -- start 2021-10-21T00:11:49.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.013+0000 7f903a08a700 1 -- start start 2021-10-21T00:11:49.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9034062330 0x7f90340aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90340b3a20 0x7f9034155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034155620 con 0x7f9034062f70 2021-10-21T00:11:49.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034113440 con 0x7f90340b3a20 2021-10-21T00:11:49.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9034146c90 con 0x7f9034062330 2021-10-21T00:11:49.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9039088700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9034062330 0x7f90340aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37602/0 (socket says 172.21.15.41:37602) 2021-10-21T00:11:49.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 -- 172.21.15.41:0/2189029086 learned_addr learned my addr 172.21.15.41:0/2189029086 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:49.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9039889700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90340b3a20 0x7f9034155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 -- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9034062330 msgr2=0x7f90340aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9034062330 0x7f90340aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 -- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90340b3a20 msgr2=0x7f9034155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90340b3a20 0x7f9034155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 -- 172.21.15.41:0/2189029086 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903000b180 con 0x7f9034062f70 2021-10-21T00:11:49.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f9038887700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f90340b6d50 tx=0x7f9024007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90240070d0 con 0x7f9034062f70 2021-10-21T00:11:49.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024007230 con 0x7f9034062f70 2021-10-21T00:11:49.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90341455d0 con 0x7f9034062f70 2021-10-21T00:11:49.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9024005610 con 0x7f9034062f70 2021-10-21T00:11:49.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.017+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90341563f0 con 0x7f9034062f70 2021-10-21T00:11:49.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034146ab0 con 0x7f9034062f70 2021-10-21T00:11:49.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9024010070 con 0x7f9034062f70 2021-10-21T00:11:49.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f902a7fc700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 0x7f901c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f902406ae80 con 0x7f9034062f70 2021-10-21T00:11:49.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f9039088700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 0x7f901c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.021+0000 7f9039088700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 0x7f901c055ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f903001c000 tx=0x7f9030015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.029+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9024041ed0 con 0x7f9034062f70 2021-10-21T00:11:49.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.157+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9034057350 con 0x7f9034062f70 2021-10-21T00:11:49.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.157+0000 7f902a7fc700 1 -- 172.21.15.41:0/2189029086 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7f90240454f0 con 0x7f9034062f70 2021-10-21T00:11:49.165 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 msgr2=0x7f901c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 0x7f901c055ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f903001c000 tx=0x7f9030015000).stop 2021-10-21T00:11:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 msgr2=0x7f9034155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f90340b6d50 tx=0x7f9024007c10).stop 2021-10-21T00:11:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 shutdown_connections 2021-10-21T00:11:49.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f901c053610 0x7f901c055ad0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90340b3a20 0x7f9034155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9034062f70 0x7f9034155a10 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 --2- 172.21.15.41:0/2189029086 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9034062330 0x7f90340aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 >> 172.21.15.41:0/2189029086 conn(0x7f90340b9080 msgr2=0x7f90340b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 shutdown_connections 2021-10-21T00:11:49.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.161+0000 7f903a08a700 1 -- 172.21.15.41:0/2189029086 wait complete. 2021-10-21T00:11:49.183 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:49.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 Processor -- start 2021-10-21T00:11:49.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- start start 2021-10-21T00:11:49.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 0x7f60280b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f60280b0730 0x7f60280b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f6028142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602805fdd0 con 0x7f60280b0730 2021-10-21T00:11:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6028140400 con 0x7f602805f9f0 2021-10-21T00:11:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60280b27c0 con 0x7f60280b3150 2021-10-21T00:11:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f60280b0730 0x7f60280b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f60280b0730 0x7f60280b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37608/0 (socket says 172.21.15.41:37608) 2021-10-21T00:11:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 -- 172.21.15.41:0/710825174 learned_addr learned my addr 172.21.15.41:0/710825174 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f60277fe700 1 --2- 172.21.15.41:0/710825174 >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 0x7f60280b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6027fff700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f6028142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 -- 172.21.15.41:0/710825174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 msgr2=0x7f6028142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:49.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f6028142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 -- 172.21.15.41:0/710825174 >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 msgr2=0x7f60280b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 --2- 172.21.15.41:0/710825174 >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 0x7f60280b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 -- 172.21.15.41:0/710825174 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280b35a0 con 0x7f60280b0730 2021-10-21T00:11:49.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f60277fe700 1 --2- 172.21.15.41:0/710825174 >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 0x7f60280b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f6026ffd700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60280b0730 0x7f60280b2c60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f602813f630 tx=0x7f6018006eb0).ready entity=mon.0 client_cookie=d575e34f07688d48 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f60267fc700 1 -- 172.21.15.41:0/710825174 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601800e610 con 0x7f60280b0730 2021-10-21T00:11:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f60267fc700 1 -- 172.21.15.41:0/710825174 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018000e90 con 0x7f60280b0730 2021-10-21T00:11:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f60267fc700 1 -- 172.21.15.41:0/710825174 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601800e9a0 con 0x7f60280b0730 2021-10-21T00:11:49.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- 172.21.15.41:0/710825174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60280b0730 msgr2=0x7f60280b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60280b0730 0x7f60280b2c60 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f602813f630 tx=0x7f6018006eb0).stop 2021-10-21T00:11:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- 172.21.15.41:0/710825174 shutdown_connections 2021-10-21T00:11:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f60280b0730 0x7f60280b2c60 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- 172.21.15.41:0/710825174 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f6028142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 --2- 172.21.15.41:0/710825174 >> v2:172.21.15.62:3300/0 conn(0x7f602805f9f0 0x7f60280b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- 172.21.15.41:0/710825174 >> 172.21.15.41:0/710825174 conn(0x7f60280637b0 msgr2=0x7f6028063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.285+0000 7f602c8df700 1 -- 172.21.15.41:0/710825174 shutdown_connections 2021-10-21T00:11:49.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- 172.21.15.41:0/710825174 wait complete. 2021-10-21T00:11:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 Processor -- start 2021-10-21T00:11:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- start start 2021-10-21T00:11:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60280b0730 0x7f602813d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f602813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602813a1c0 con 0x7f602805f9f0 2021-10-21T00:11:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602813aee0 con 0x7f60280b0730 2021-10-21T00:11:49.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602813ac40 con 0x7f60280b3150 2021-10-21T00:11:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37614/0 (socket says 172.21.15.41:37614) 2021-10-21T00:11:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 -- 172.21.15.41:0/2342858766 learned_addr learned my addr 172.21.15.41:0/2342858766 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f6027fff700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f602813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f6026ffd700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60280b0730 0x7f602813d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 -- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 msgr2=0x7f602813d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f602813d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 -- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60280b0730 msgr2=0x7f602813d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60280b0730 0x7f602813d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 -- 172.21.15.41:0/2342858766 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601000b120 con 0x7f602805f9f0 2021-10-21T00:11:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f60277fe700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f601000c000 tx=0x7f6010008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601000c670 con 0x7f602805f9f0 2021-10-21T00:11:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601000c7d0 con 0x7f602805f9f0 2021-10-21T00:11:49.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601800b1e0 con 0x7f602805f9f0 2021-10-21T00:11:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601000cb30 con 0x7f602805f9f0 2021-10-21T00:11:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.289+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028143890 con 0x7f602805f9f0 2021-10-21T00:11:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6010022070 con 0x7f602805f9f0 2021-10-21T00:11:49.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6028140080 con 0x7f602805f9f0 2021-10-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f6024ff9700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 0x7f600c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f601006bfc0 con 0x7f602805f9f0 2021-10-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f6026ffd700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 0x7f600c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.293+0000 7f6026ffd700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 0x7f600c055a40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f601801a000 tx=0x7f6018015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.301+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6010043080 con 0x7f602805f9f0 2021-10-21T00:11:49.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.425+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6028057350 con 0x7f602805f9f0 2021-10-21T00:11:49.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f6024ff9700 1 -- 172.21.15.41:0/2342858766 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60100466a0 con 0x7f602805f9f0 2021-10-21T00:11:49.436 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 msgr2=0x7f600c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 0x7f600c055a40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f601801a000 tx=0x7f6018015000).stop 2021-10-21T00:11:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 msgr2=0x7f60280ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f601000c000 tx=0x7f6010008040).stop 2021-10-21T00:11:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 shutdown_connections 2021-10-21T00:11:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f600c053580 0x7f600c055a40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f60280b3150 0x7f602813d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60280b0730 0x7f602813d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 --2- 172.21.15.41:0/2342858766 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f602805f9f0 0x7f60280ae690 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 >> 172.21.15.41:0/2342858766 conn(0x7f60280637b0 msgr2=0x7f6028063b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 shutdown_connections 2021-10-21T00:11:49.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.429+0000 7f602c8df700 1 -- 172.21.15.41:0/2342858766 wait complete. 2021-10-21T00:11:49.454 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:11:49.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 Processor -- start 2021-10-21T00:11:49.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 -- start start 2021-10-21T00:11:49.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f140aede0 0x7f5f14143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5f140b23b0 0x7f5f1413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f141419a0 con 0x7f5f1405c810 2021-10-21T00:11:49.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140af1c0 con 0x7f5f140b23b0 2021-10-21T00:11:49.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f14064e80 con 0x7f5f140aede0 2021-10-21T00:11:49.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f12d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5f140b23b0 0x7f5f1413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f11d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5f1405c810 0x7f5f140b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35396/0 (socket says 172.21.15.41:35396) 2021-10-21T00:11:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f11d9b700 1 -- 172.21.15.41:0/4253646720 learned_addr learned my addr 172.21.15.41:0/4253646720 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1259c700 1 --2- 172.21.15.41:0/4253646720 >> v2:172.21.15.62:3300/0 conn(0x7f5f140aede0 0x7f5f14143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f12d9d700 1 -- 172.21.15.41:0/4253646720 >> v2:172.21.15.62:3300/0 conn(0x7f5f140aede0 msgr2=0x7f5f14143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:49.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f12d9d700 1 --2- 172.21.15.41:0/4253646720 >> v2:172.21.15.62:3300/0 conn(0x7f5f140aede0 0x7f5f14143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f12d9d700 1 -- 172.21.15.41:0/4253646720 >> v1:172.21.15.41:6789/0 conn(0x7f5f1405c810 legacy=0x7f5f140b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f1159a700 1 -- 172.21.15.41:0/4253646720 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064988546 0 0) 0x7f5f141419a0 con 0x7f5f1405c810 2021-10-21T00:11:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.553+0000 7f5f12d9d700 1 -- 172.21.15.41:0/4253646720 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14065120 con 0x7f5f140b23b0 2021-10-21T00:11:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f12d9d700 1 --2- 172.21.15.41:0/4253646720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f1413f6d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c006df0).ready entity=mon.0 client_cookie=55ad3622e6c6ed99 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1159a700 1 -- 172.21.15.41:0/4253646720 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c00d570 con 0x7f5f140b23b0 2021-10-21T00:11:49.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1159a700 1 -- 172.21.15.41:0/4253646720 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c000e90 con 0x7f5f140b23b0 2021-10-21T00:11:49.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1159a700 1 -- 172.21.15.41:0/4253646720 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c00d8c0 con 0x7f5f140b23b0 2021-10-21T00:11:49.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- 172.21.15.41:0/4253646720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 msgr2=0x7f5f1413f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- 172.21.15.41:0/4253646720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f1413f6d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c006df0).stop 2021-10-21T00:11:49.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- 172.21.15.41:0/4253646720 shutdown_connections 2021-10-21T00:11:49.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- 172.21.15.41:0/4253646720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f1413f6d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- 172.21.15.41:0/4253646720 >> v2:172.21.15.62:3300/0 conn(0x7f5f140aede0 0x7f5f14143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- 172.21.15.41:0/4253646720 >> 172.21.15.41:0/4253646720 conn(0x7f5f140627b0 msgr2=0x7f5f14062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- 172.21.15.41:0/4253646720 shutdown_connections 2021-10-21T00:11:49.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- 172.21.15.41:0/4253646720 wait complete. 2021-10-21T00:11:49.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 Processor -- start 2021-10-21T00:11:49.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- start start 2021-10-21T00:11:49.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 0x7f5f1410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f140aede0 0x7f5f140b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.557+0000 7f5f1359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1413c490 con 0x7f5f140b23b0 2021-10-21T00:11:49.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1410e9b0 con 0x7f5f1405c810 2021-10-21T00:11:49.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1410e710 con 0x7f5f140aede0 2021-10-21T00:11:49.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37632/0 (socket says 172.21.15.41:37632) 2021-10-21T00:11:49.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 -- 172.21.15.41:0/75948888 learned_addr learned my addr 172.21.15.41:0/75948888 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:49.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1259c700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 0x7f5f1410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f11d9b700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f140aede0 0x7f5f140b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 -- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f140aede0 msgr2=0x7f5f140b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f140aede0 0x7f5f140b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 -- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 msgr2=0x7f5f1410ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 0x7f5f1410ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 -- 172.21.15.41:0/75948888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c00b180 con 0x7f5f140b23b0 2021-10-21T00:11:49.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1259c700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 0x7f5f1410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:49.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f12d9d700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c016070 con 0x7f5f140b23b0 2021-10-21T00:11:49.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00de10 con 0x7f5f140b23b0 2021-10-21T00:11:49.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f14150820 con 0x7f5f140b23b0 2021-10-21T00:11:49.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0c01e450 con 0x7f5f140b23b0 2021-10-21T00:11:49.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f141107e0 con 0x7f5f140b23b0 2021-10-21T00:11:49.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f141509e0 con 0x7f5f140b23b0 2021-10-21T00:11:49.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f0c025030 con 0x7f5f140b23b0 2021-10-21T00:11:49.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 0x7f5ef8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f0c06c870 con 0x7f5f140b23b0 2021-10-21T00:11:49.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.561+0000 7f5f1259c700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 0x7f5ef8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.565+0000 7f5f1259c700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 0x7f5ef8055b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5efc00b000 tx=0x7f5efc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.569+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f0c0439d0 con 0x7f5f140b23b0 2021-10-21T00:11:49.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.689+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f14057350 con 0x7f5f140b23b0 2021-10-21T00:11:49.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f0b7fe700 1 -- 172.21.15.41:0/75948888 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5f0c023020 con 0x7f5f140b23b0 2021-10-21T00:11:49.700 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:49.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 msgr2=0x7f5ef8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 0x7f5ef8055b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f5efc00b000 tx=0x7f5efc008040).stop 2021-10-21T00:11:49.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 msgr2=0x7f5f140b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f5f0c002f70 tx=0x7f5f0c014000).stop 2021-10-21T00:11:49.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 shutdown_connections 2021-10-21T00:11:49.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5ef80536a0 0x7f5ef8055b60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5f140b23b0 0x7f5f140b5450 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f140aede0 0x7f5f140b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 --2- 172.21.15.41:0/75948888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1405c810 0x7f5f1410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 >> 172.21.15.41:0/75948888 conn(0x7f5f140627b0 msgr2=0x7f5f1413cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 shutdown_connections 2021-10-21T00:11:49.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.693+0000 7f5f1359e700 1 -- 172.21.15.41:0/75948888 wait complete. 2021-10-21T00:11:49.718 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:11:49.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 Processor -- start 2021-10-21T00:11:49.833 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 -- start start 2021-10-21T00:11:49.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 0x7f52e005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f52e00b3a20 0x7f52e013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e005bd40 con 0x7f52e0062330 2021-10-21T00:11:49.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e005bf70 con 0x7f52e00b3a20 2021-10-21T00:11:49.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e73dc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0142cb0 con 0x7f52e0062f70 2021-10-21T00:11:49.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e63da700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f52e0062330 0x7f52e00b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35406/0 (socket says 172.21.15.41:35406) 2021-10-21T00:11:49.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e63da700 1 -- 172.21.15.41:0/3525776524 learned_addr learned my addr 172.21.15.41:0/3525776524 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:49.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 --2- 172.21.15.41:0/3525776524 >> v2:172.21.15.41:3300/0 conn(0x7f52e00b3a20 0x7f52e013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e5bd9700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 0x7f52e005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e53d8700 1 -- 172.21.15.41:0/3525776524 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049493975 0 0) 0x7f52e005bd40 con 0x7f52e0062330 2021-10-21T00:11:49.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 -- 172.21.15.41:0/3525776524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 msgr2=0x7f52e005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:49.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 0x7f52e005c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 -- 172.21.15.41:0/3525776524 >> v1:172.21.15.41:6789/0 conn(0x7f52e0062330 legacy=0x7f52e00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 -- 172.21.15.41:0/3525776524 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0142950 con 0x7f52e00b3a20 2021-10-21T00:11:49.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e5bd9700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 0x7f52e005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:49.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e6bdb700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e00b3a20 0x7f52e013c510 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d80091d0).ready entity=mon.0 client_cookie=b1804273f11754cb server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e53d8700 1 -- 172.21.15.41:0/3525776524 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8009ea0 con 0x7f52e00b3a20 2021-10-21T00:11:49.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e53d8700 1 -- 172.21.15.41:0/3525776524 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800b8a0 con 0x7f52e00b3a20 2021-10-21T00:11:49.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.825+0000 7f52e53d8700 1 -- 172.21.15.41:0/3525776524 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800ba10 con 0x7f52e00b3a20 2021-10-21T00:11:49.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/3525776524 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e00b3a20 msgr2=0x7f52e013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e00b3a20 0x7f52e013c510 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f52d80032f0 tx=0x7f52d80091d0).stop 2021-10-21T00:11:49.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/3525776524 shutdown_connections 2021-10-21T00:11:49.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e00b3a20 0x7f52e013c510 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- 172.21.15.41:0/3525776524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e0062f70 0x7f52e005c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/3525776524 >> 172.21.15.41:0/3525776524 conn(0x7f52e00b9080 msgr2=0x7f52e00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/3525776524 shutdown_connections 2021-10-21T00:11:49.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/3525776524 wait complete. 2021-10-21T00:11:49.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 Processor -- start 2021-10-21T00:11:49.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- start start 2021-10-21T00:11:49.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e0062f70 0x7f52e0114310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.851 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e00b3a20 0x7f52e0114800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00aeb70 con 0x7f52e0062330 2021-10-21T00:11:49.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00ae630 con 0x7f52e0062f70 2021-10-21T00:11:49.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00ae8d0 con 0x7f52e00b3a20 2021-10-21T00:11:49.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37642/0 (socket says 172.21.15.41:37642) 2021-10-21T00:11:49.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 -- 172.21.15.41:0/929113514 learned_addr learned my addr 172.21.15.41:0/929113514 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:49.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e6bdb700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e00b3a20 0x7f52e0114800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e5bd9700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e0062f70 0x7f52e0114310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 -- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e00b3a20 msgr2=0x7f52e0114800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e00b3a20 0x7f52e0114800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 -- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e0062f70 msgr2=0x7f52e0114310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e0062f70 0x7f52e0114310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 -- 172.21.15.41:0/929113514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8009470 con 0x7f52e0062330 2021-10-21T00:11:49.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e63da700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f52dc000ed0 tx=0x7f52dc007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc0070d0 con 0x7f52e0062330 2021-10-21T00:11:49.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc007230 con 0x7f52e0062330 2021-10-21T00:11:49.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e0146c60 con 0x7f52e0062330 2021-10-21T00:11:49.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc005610 con 0x7f52e0062330 2021-10-21T00:11:49.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.829+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e0114cf0 con 0x7f52e0062330 2021-10-21T00:11:49.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.833+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e0057350 con 0x7f52e0062330 2021-10-21T00:11:49.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.833+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52dc010070 con 0x7f52e0062330 2021-10-21T00:11:49.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.833+0000 7f52cf7fe700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 0x7f52c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:49.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.833+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f52dc06b030 con 0x7f52e0062330 2021-10-21T00:11:49.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.833+0000 7f52e5bd9700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 0x7f52c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:49.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.837+0000 7f52e5bd9700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 0x7f52c0055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f52d000c000 tx=0x7f52d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:49.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.841+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52dc0420f0 con 0x7f52e0062330 2021-10-21T00:11:49.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.973+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52e0062d50 con 0x7f52e0062330 2021-10-21T00:11:49.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.973+0000 7f52cf7fe700 1 -- 172.21.15.41:0/929113514 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+10 (secure 0 0 0) 0x7f52dc045710 con 0x7f52e0062330 2021-10-21T00:11:49.982 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:49.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 msgr2=0x7f52c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 0x7f52c0055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f52d000c000 tx=0x7f52d0008040).stop 2021-10-21T00:11:49.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 msgr2=0x7f52e0146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:49.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f52dc000ed0 tx=0x7f52dc007ac0).stop 2021-10-21T00:11:49.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 shutdown_connections 2021-10-21T00:11:49.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f52c0053610 0x7f52c0055ad0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e00b3a20 0x7f52e0114800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e0062f70 0x7f52e0114310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 --2- 172.21.15.41:0/929113514 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f52e0062330 0x7f52e0146770 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:49.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 >> 172.21.15.41:0/929113514 conn(0x7f52e00b9080 msgr2=0x7f52e013fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:49.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 shutdown_connections 2021-10-21T00:11:49.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:49.977+0000 7f52e73dc700 1 -- 172.21.15.41:0/929113514 wait complete. 2021-10-21T00:11:49.998 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:11:49.999 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:50.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 Processor -- start 2021-10-21T00:11:50.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- start start 2021-10-21T00:11:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f99600b5f70 0x7f996013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f9960140030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996013f710 con 0x7f99600af700 2021-10-21T00:11:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600adf10 con 0x7f99600b5f70 2021-10-21T00:11:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99600ad9b0 con 0x7f996006a190 2021-10-21T00:11:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f99600b5f70 0x7f996013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f99600b5f70 0x7f996013fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37650/0 (socket says 172.21.15.41:37650) 2021-10-21T00:11:50.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 -- 172.21.15.41:0/2221702899 learned_addr learned my addr 172.21.15.41:0/2221702899 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:50.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99648c7700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f9960140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 -- 172.21.15.41:0/2221702899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 msgr2=0x7f9960140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:50.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f9960140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 -- 172.21.15.41:0/2221702899 >> v1:172.21.15.62:6789/0 conn(0x7f99600af700 legacy=0x7f9960142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 -- 172.21.15.41:0/2221702899 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600b6350 con 0x7f99600b5f70 2021-10-21T00:11:50.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99650c8700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600b5f70 0x7f996013fb40 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f99600adaf0 tx=0x7f9958009290).ready entity=mon.0 client_cookie=c8549a8b338d2b28 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:50.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f995ffff700 1 -- 172.21.15.41:0/2221702899 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f995800b860 con 0x7f99600b5f70 2021-10-21T00:11:50.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f995ffff700 1 -- 172.21.15.41:0/2221702899 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800b9c0 con 0x7f99600b5f70 2021-10-21T00:11:50.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f995ffff700 1 -- 172.21.15.41:0/2221702899 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f995800bb30 con 0x7f99600b5f70 2021-10-21T00:11:50.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- 172.21.15.41:0/2221702899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600b5f70 msgr2=0x7f996013fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600b5f70 0x7f996013fb40 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f99600adaf0 tx=0x7f9958009290).stop 2021-10-21T00:11:50.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- 172.21.15.41:0/2221702899 shutdown_connections 2021-10-21T00:11:50.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f9960140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 --2- 172.21.15.41:0/2221702899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600b5f70 0x7f996013fb40 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- 172.21.15.41:0/2221702899 >> 172.21.15.41:0/2221702899 conn(0x7f99600639f0 msgr2=0x7f99600b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:50.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- 172.21.15.41:0/2221702899 shutdown_connections 2021-10-21T00:11:50.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.105+0000 7f99660ca700 1 -- 172.21.15.41:0/2221702899 wait complete. 2021-10-21T00:11:50.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 Processor -- start 2021-10-21T00:11:50.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 -- start start 2021-10-21T00:11:50.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f99600b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99600b5f70 0x7f99601511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99601429f0 con 0x7f99600af700 2021-10-21T00:11:50.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99600653a0 con 0x7f99600b5f70 2021-10-21T00:11:50.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9960065640 con 0x7f996006a190 2021-10-21T00:11:50.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37658/0 (socket says 172.21.15.41:37658) 2021-10-21T00:11:50.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99650c8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f99600b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 -- 172.21.15.41:0/1845395098 learned_addr learned my addr 172.21.15.41:0/1845395098 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:50.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99658c9700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99600b5f70 0x7f99601511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 -- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 msgr2=0x7f99600b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f99600b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 -- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99600b5f70 msgr2=0x7f99601511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99600b5f70 0x7f99601511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 -- 172.21.15.41:0/1845395098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009530 con 0x7f99600af700 2021-10-21T00:11:50.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99648c7700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f995400a000 tx=0x7f9954008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:50.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9954011780 con 0x7f99600af700 2021-10-21T00:11:50.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99540118e0 con 0x7f99600af700 2021-10-21T00:11:50.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9960065fd0 con 0x7f99600af700 2021-10-21T00:11:50.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.109+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9954011c40 con 0x7f99600af700 2021-10-21T00:11:50.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9960066ee0 con 0x7f99600af700 2021-10-21T00:11:50.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9960067600 con 0x7f99600af700 2021-10-21T00:11:50.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9954012420 con 0x7f99600af700 2021-10-21T00:11:50.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f995e7fc700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 0x7f9940055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:50.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f995406b6d0 con 0x7f99600af700 2021-10-21T00:11:50.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f99650c8700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 0x7f9940055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:50.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.113+0000 7f99650c8700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 0x7f9940055a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f995801b000 tx=0x7f9958016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:50.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.117+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99540427d0 con 0x7f99600af700 2021-10-21T00:11:50.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.281+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9960057350 con 0x7f99600af700 2021-10-21T00:11:50.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f995e7fc700 1 -- 172.21.15.41:0/1845395098 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f995400de60 con 0x7f99600af700 2021-10-21T00:11:50.292 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:50.292 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:50.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 msgr2=0x7f9940055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 0x7f9940055a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f995801b000 tx=0x7f9958016000).stop 2021-10-21T00:11:50.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 msgr2=0x7f9960065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:50.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f995400a000 tx=0x7f9954008040).stop 2021-10-21T00:11:50.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 shutdown_connections 2021-10-21T00:11:50.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9940053580 0x7f9940055a40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99600b5f70 0x7f99601511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99600af700 0x7f9960065ae0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 --2- 172.21.15.41:0/1845395098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f996006a190 0x7f99600b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:50.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 >> 172.21.15.41:0/1845395098 conn(0x7f99600639f0 msgr2=0x7f99601392a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:50.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 shutdown_connections 2021-10-21T00:11:50.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:50.285+0000 7f99660ca700 1 -- 172.21.15.41:0/1845395098 wait complete. 2021-10-21T00:11:50.298 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:50.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:41.854126+0000', 'modified': '2021-10-21T00:11:42.858043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/204327833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 204327833}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 204327833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:50.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:50.509 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:11:50.625 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8091,"want_state":"up:active","state":"up:active","rank_uptime":8.7540742999999992,"mdsmap_epoch":66,"osdmap_epoch":127,"osdmap_epoch_barrier":126,"uptime":13.493316022} 2021-10-21T00:11:50.626 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8091, "mdsmap_epoch": 66, "osdmap_epoch": 127, "osdmap_epoch_barrier": 126, "rank_uptime": 8.7540743, "state": "up:active", "uptime": 13.493316022, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:50.626 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:11:50.627 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:11:50.627 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:11:50.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.628 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:50.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:50.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:50.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:50.713 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:50.714 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:50.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.717 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:50.724 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:11:50.724 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:50.729 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:50.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:50.746 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:50.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:11:50.793+0000 7f05950b9080 -1 init, newargv = 0x55d07a9b68c0 newargc=9 2021-10-21T00:11:50.802 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14402]: starting ceph client 2021-10-21T00:11:50.805 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:50.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:50.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.807 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:50.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14402]: starting fuse 2021-10-21T00:11:50.813 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:11:50.814 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:11:50.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:11:50.815 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:11:50.815 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:11:50.816 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:11:50.816 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:11:50.817 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:50.817 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:11:50.818 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:11:50.818 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:11:50.818 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:50.819 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:11:50.819 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:11:50.820 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:11:50.820 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:11:50.821 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:50.821 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:11:50.821 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:11:50.822 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:11:50.822 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:11:50.823 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:11:50.823 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:50.824 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:11:50.824 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:11:50.866 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14402.asok 2021-10-21T00:11:50.871 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14402.asok 2021-10-21T00:11:50.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14402.asok status 2021-10-21T00:11:50.963 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:11:50.964 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:11:50.964 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:11:50.964 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:11:50.964 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:11:50.965 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:11:50.965 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:11:50.965 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14402", 2021-10-21T00:11:50.965 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:11:50.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:50.966 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:11:50.966 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:11:50.966 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 7166, 2021-10-21T00:11:50.966 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:11:50.967 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:11:50.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:11:50.967 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 7166 2021-10-21T00:11:50.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:50.968 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:50.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:50.968 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:50.968 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4014751231 2021-10-21T00:11:50.969 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:11:50.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:50.969 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:50.970 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:50.970 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:50.970 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4014751231 2021-10-21T00:11:50.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:50.971 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.7166 172.21.15.99:0/4014751231", 2021-10-21T00:11:50.971 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/4014751231", 2021-10-21T00:11:50.971 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:11:50.971 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 66, 2021-10-21T00:11:50.972 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 127, 2021-10-21T00:11:50.972 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:11:50.972 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:11:50.972 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:11:50.972 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:11:50.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.974 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:50.975 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:50.984 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:50.986 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:50.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:50.987 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:51.006 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:51.007 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.056 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:51.058 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:51.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:51.059 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:51.059 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.068 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:51.069 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:51.070 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:11:51.071 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:11:51.072 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14402]: fuse finished with error 0 and tester_r 0 2021-10-21T00:11:51.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:51.131 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:51.132 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.139 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:11:51.140 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:11:51.140 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:11:51.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:51.193 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:51.201 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:11:51.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:11:51.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:11:51.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:11:51.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:11:51.248 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2021-10-21T00:11:51.248 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2021-10-21T00:11:51.248 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:11:51.248 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2021-10-21T00:11:51.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.249 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2021-10-21T00:11:51.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.249 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2021-10-21T00:11:51.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.250 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2021-10-21T00:11:51.250 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2021-10-21T00:11:51.250 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.250 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2021-10-21T00:11:51.251 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2021-10-21T00:11:51.251 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.251 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:11:51.251 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2021-10-21T00:11:51.251 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.252 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:11:51.252 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:11:51.252 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.253 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2021-10-21T00:11:51.253 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.253 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2021-10-21T00:11:51.253 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2021-10-21T00:11:51.253 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:11:51.254 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:11:51.254 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2021-10-21T00:11:51.254 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:11:51.254 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2021-10-21T00:11:51.255 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:11:51.255 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:11:51.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.255 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:11:51.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.256 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2021-10-21T00:11:51.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.256 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2021-10-21T00:11:51.257 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.257 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2021-10-21T00:11:51.257 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2021-10-21T00:11:51.257 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2021-10-21T00:11:51.258 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:11:51.258 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:11:51.258 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.258 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2021-10-21T00:11:51.258 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2021-10-21T00:11:51.259 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.259 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2021-10-21T00:11:51.259 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2021-10-21T00:11:51.259 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.260 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2021-10-21T00:11:51.260 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2021-10-21T00:11:51.260 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.260 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2021-10-21T00:11:51.260 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2021-10-21T00:11:51.261 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2021-10-21T00:11:51.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.261 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2021-10-21T00:11:51.261 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2021-10-21T00:11:51.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.262 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:11:51.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.262 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2021-10-21T00:11:51.262 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.263 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2021-10-21T00:11:51.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.263 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:11:51.263 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2021-10-21T00:11:51.263 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.264 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2021-10-21T00:11:51.264 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2021-10-21T00:11:51.264 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:11:51.264 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2021-10-21T00:11:51.264 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = filestore 2021-10-21T00:11:51.265 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:11:51.265 INFO:teuthology.orchestra.run.smithi071.stdout: osd sloppy crc = True 2021-10-21T00:11:51.265 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.265 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2021-10-21T00:11:51.266 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:11:51.266 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2021-10-21T00:11:51.266 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:11:51.267 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:11:51.267 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.267 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.267 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2021-10-21T00:11:51.267 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.268 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2021-10-21T00:11:51.268 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:11:51.268 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:11:51.268 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2021-10-21T00:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2021-10-21T00:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2021-10-21T00:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.269 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2021-10-21T00:11:51.270 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2021-10-21T00:11:51.270 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.270 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.270 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:11:51.271 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:11:51.271 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:11:51.271 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.271 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:11:51.271 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:11:51.272 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:11:51.272 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2021-10-21T00:11:51.272 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:11:51.272 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2021-10-21T00:11:51.272 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2021-10-21T00:11:51.273 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2021-10-21T00:11:51.273 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2021-10-21T00:11:51.273 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:11:51.273 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:11:51.273 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2021-10-21T00:11:51.274 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2021-10-21T00:11:51.274 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:11:51.274 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.274 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.275 INFO:teuthology.orchestra.run.smithi071.stdout: client debug getattr caps = true 2021-10-21T00:11:51.275 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2021-10-21T00:11:51.275 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2021-10-21T00:11:51.275 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2021-10-21T00:11:51.275 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2021-10-21T00:11:51.276 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2021-10-21T00:11:51.276 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2021-10-21T00:11:51.276 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2021-10-21T00:11:51.276 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:11:51.277 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal frag = True 2021-10-21T00:11:51.277 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal fragment size max = 10000 2021-10-21T00:11:51.277 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal merge size = 5 2021-10-21T00:11:51.277 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split bits = 3 2021-10-21T00:11:51.277 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split size = 100 2021-10-21T00:11:51.278 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2021-10-21T00:11:51.278 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2021-10-21T00:11:51.278 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2021-10-21T00:11:51.278 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2021-10-21T00:11:51.278 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:11:51.279 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.279 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.279 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-10-21T00:11:51.279 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-10-21T00:11:51.280 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:11:51.280 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-10-21T00:11:51.280 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.280 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-10-21T00:11:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-10-21T00:11:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-10-21T00:11:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-10-21T00:11:51.282 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.282 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-10-21T00:11:51.282 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-10-21T00:11:51.282 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.282 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:11:51.283 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-10-21T00:11:51.283 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.283 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:11:51.283 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:11:51.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.284 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-10-21T00:11:51.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.284 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-10-21T00:11:51.284 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-10-21T00:11:51.285 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:11:51.285 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:11:51.285 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-10-21T00:11:51.285 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:11:51.286 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-10-21T00:11:51.286 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:11:51.286 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:11:51.286 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.286 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:11:51.287 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.287 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-10-21T00:11:51.287 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.287 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-10-21T00:11:51.287 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.288 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-10-21T00:11:51.288 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-10-21T00:11:51.288 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-10-21T00:11:51.288 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:11:51.289 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:11:51.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.289 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-10-21T00:11:51.289 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-10-21T00:11:51.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.290 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-10-21T00:11:51.290 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-10-21T00:11:51.290 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.290 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-10-21T00:11:51.290 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-10-21T00:11:51.291 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.291 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-10-21T00:11:51.291 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-10-21T00:11:51.291 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-10-21T00:11:51.292 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.292 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-10-21T00:11:51.292 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-10-21T00:11:51.292 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.292 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:11:51.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.293 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-10-21T00:11:51.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.293 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-10-21T00:11:51.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.294 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:11:51.294 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-10-21T00:11:51.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.294 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-10-21T00:11:51.295 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-10-21T00:11:51.295 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:11:51.295 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-10-21T00:11:51.295 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = filestore 2021-10-21T00:11:51.295 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:11:51.296 INFO:teuthology.orchestra.run.smithi062.stdout: osd sloppy crc = True 2021-10-21T00:11:51.296 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.296 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-10-21T00:11:51.296 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:11:51.296 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-10-21T00:11:51.297 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:11:51.297 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:11:51.297 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.297 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.297 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-10-21T00:11:51.298 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.298 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-10-21T00:11:51.298 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:11:51.298 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:11:51.299 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-10-21T00:11:51.299 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:11:51.299 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-10-21T00:11:51.299 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-10-21T00:11:51.299 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.300 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-10-21T00:11:51.300 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-10-21T00:11:51.300 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.300 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.301 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:11:51.301 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:11:51.301 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:11:51.301 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.301 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:11:51.302 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:11:51.302 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:11:51.302 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-10-21T00:11:51.302 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:11:51.302 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-10-21T00:11:51.303 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-10-21T00:11:51.303 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-10-21T00:11:51.303 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-10-21T00:11:51.303 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:11:51.304 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:11:51.304 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-10-21T00:11:51.304 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-10-21T00:11:51.304 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:11:51.304 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.305 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.305 INFO:teuthology.orchestra.run.smithi062.stdout: client debug getattr caps = true 2021-10-21T00:11:51.305 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-10-21T00:11:51.305 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-10-21T00:11:51.305 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-10-21T00:11:51.306 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-10-21T00:11:51.306 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-10-21T00:11:51.306 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-10-21T00:11:51.306 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-10-21T00:11:51.307 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:11:51.307 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-10-21T00:11:51.307 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-10-21T00:11:51.307 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-10-21T00:11:51.307 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-10-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-10-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-10-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-10-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-10-21T00:11:51.308 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-10-21T00:11:51.309 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:11:51.309 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.309 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.309 INFO:teuthology.orchestra.run.smithi041.stdout:[global] 2021-10-21T00:11:51.310 INFO:teuthology.orchestra.run.smithi041.stdout: chdir = "" 2021-10-21T00:11:51.310 INFO:teuthology.orchestra.run.smithi041.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:11:51.310 INFO:teuthology.orchestra.run.smithi041.stdout: auth supported = cephx 2021-10-21T00:11:51.310 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.311 INFO:teuthology.orchestra.run.smithi041.stdout: filestore xattr use omap = true 2021-10-21T00:11:51.311 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.311 INFO:teuthology.orchestra.run.smithi041.stdout: mon clock drift allowed = 1.000 2021-10-21T00:11:51.311 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.311 INFO:teuthology.orchestra.run.smithi041.stdout: osd crush chooseleaf type = 0 2021-10-21T00:11:51.312 INFO:teuthology.orchestra.run.smithi041.stdout: auth debug = true 2021-10-21T00:11:51.312 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.312 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on old message = true 2021-10-21T00:11:51.312 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on bug = true 2021-10-21T00:11:51.313 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.313 INFO:teuthology.orchestra.run.smithi041.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:11:51.313 INFO:teuthology.orchestra.run.smithi041.stdout: mon pg warn max object skew = 0 2021-10-21T00:11:51.313 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.313 INFO:teuthology.orchestra.run.smithi041.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:11:51.314 INFO:teuthology.orchestra.run.smithi041.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:11:51.314 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.314 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default size = 2 2021-10-21T00:11:51.314 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.314 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow primary affinity = true 2021-10-21T00:11:51.315 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow pg remap = true 2021-10-21T00:11:51.315 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:11:51.315 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:11:51.315 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on no sortbitwise = false 2021-10-21T00:11:51.316 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:11:51.316 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on too few osds = false 2021-10-21T00:11:51.316 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:11:51.316 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:11:51.316 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.317 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:11:51.317 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.317 INFO:teuthology.orchestra.run.smithi041.stdout: osd default data pool replay window = 5 2021-10-21T00:11:51.317 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.317 INFO:teuthology.orchestra.run.smithi041.stdout: mon allow pool delete = true 2021-10-21T00:11:51.318 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.318 INFO:teuthology.orchestra.run.smithi041.stdout: mon cluster log file level = debug 2021-10-21T00:11:51.318 INFO:teuthology.orchestra.run.smithi041.stdout: debug asserts on shutdown = true 2021-10-21T00:11:51.318 INFO:teuthology.orchestra.run.smithi041.stdout: mon health detail to clog = false 2021-10-21T00:11:51.319 INFO:teuthology.orchestra.run.smithi041.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:11:51.319 INFO:teuthology.orchestra.run.smithi041.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:11:51.319 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.319 INFO:teuthology.orchestra.run.smithi041.stdout:[osd] 2021-10-21T00:11:51.319 INFO:teuthology.orchestra.run.smithi041.stdout: osd journal size = 100 2021-10-21T00:11:51.320 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.320 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub load threshold = 5.0 2021-10-21T00:11:51.320 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub max interval = 600 2021-10-21T00:11:51.320 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.320 INFO:teuthology.orchestra.run.smithi041.stdout: osd recover clone overlap = true 2021-10-21T00:11:51.321 INFO:teuthology.orchestra.run.smithi041.stdout: osd recovery max chunk = 1048576 2021-10-21T00:11:51.321 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.321 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug shutdown = true 2021-10-21T00:11:51.321 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug op order = true 2021-10-21T00:11:51.322 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug verify stray on activate = true 2021-10-21T00:11:51.322 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.322 INFO:teuthology.orchestra.run.smithi041.stdout: osd open classes on start = true 2021-10-21T00:11:51.322 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug pg log writeout = true 2021-10-21T00:11:51.322 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.323 INFO:teuthology.orchestra.run.smithi041.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:11:51.323 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.323 INFO:teuthology.orchestra.run.smithi041.stdout: osd map max advance = 10 2021-10-21T00:11:51.323 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.324 INFO:teuthology.orchestra.run.smithi041.stdout: journal zero on create = true 2021-10-21T00:11:51.324 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.324 INFO:teuthology.orchestra.run.smithi041.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:11:51.324 INFO:teuthology.orchestra.run.smithi041.stdout: filestore apply finisher threads = 3 2021-10-21T00:11:51.324 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.325 INFO:teuthology.orchestra.run.smithi041.stdout: bdev debug aio = true 2021-10-21T00:11:51.325 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug misdirected ops = true 2021-10-21T00:11:51.325 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:11:51.325 INFO:teuthology.orchestra.run.smithi041.stdout: debug osd = 20 2021-10-21T00:11:51.325 INFO:teuthology.orchestra.run.smithi041.stdout: osd objectstore = filestore 2021-10-21T00:11:51.326 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:11:51.326 INFO:teuthology.orchestra.run.smithi041.stdout: osd sloppy crc = True 2021-10-21T00:11:51.326 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.326 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr] 2021-10-21T00:11:51.327 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:11:51.327 INFO:teuthology.orchestra.run.smithi041.stdout: debug mgr = 20 2021-10-21T00:11:51.327 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:11:51.327 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:11:51.327 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.328 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.328 INFO:teuthology.orchestra.run.smithi041.stdout: mgr/telemetry/nag = false 2021-10-21T00:11:51.328 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.328 INFO:teuthology.orchestra.run.smithi041.stdout:[mon] 2021-10-21T00:11:51.328 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:11:51.329 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:11:51.329 INFO:teuthology.orchestra.run.smithi041.stdout: debug paxos = 20 2021-10-21T00:11:51.329 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:11:51.329 INFO:teuthology.orchestra.run.smithi041.stdout: mon data avail warn = 5 2021-10-21T00:11:51.329 INFO:teuthology.orchestra.run.smithi041.stdout: mon mgr mkfs grace = 240 2021-10-21T00:11:51.330 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.330 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd reporter subtree level = osd 2021-10-21T00:11:51.330 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd prime pg temp = true 2021-10-21T00:11:51.330 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.331 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.331 INFO:teuthology.orchestra.run.smithi041.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:11:51.331 INFO:teuthology.orchestra.run.smithi041.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:11:51.331 INFO:teuthology.orchestra.run.smithi041.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:11:51.331 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.332 INFO:teuthology.orchestra.run.smithi041.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:11:51.332 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:11:51.332 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:11:51.332 INFO:teuthology.orchestra.run.smithi041.stdout: mon op complaint time = 120 2021-10-21T00:11:51.333 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.333 INFO:teuthology.orchestra.run.smithi041.stdout:[client] 2021-10-21T00:11:51.333 INFO:teuthology.orchestra.run.smithi041.stdout: rgw cache enabled = true 2021-10-21T00:11:51.333 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable ops log = true 2021-10-21T00:11:51.333 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable usage log = true 2021-10-21T00:11:51.334 INFO:teuthology.orchestra.run.smithi041.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:11:51.334 INFO:teuthology.orchestra.run.smithi041.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:11:51.334 INFO:teuthology.orchestra.run.smithi041.stdout: client mount timeout = 600 2021-10-21T00:11:51.334 INFO:teuthology.orchestra.run.smithi041.stdout: debug client = 20 2021-10-21T00:11:51.334 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:11:51.335 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.335 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.335 INFO:teuthology.orchestra.run.smithi041.stdout: client debug getattr caps = true 2021-10-21T00:11:51.335 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.a] 2021-10-21T00:11:51.336 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.b] 2021-10-21T00:11:51.336 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.c] 2021-10-21T00:11:51.336 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2021-10-21T00:11:51.336 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2021-10-21T00:11:51.336 INFO:teuthology.orchestra.run.smithi041.stdout:[mds] 2021-10-21T00:11:51.337 INFO:teuthology.orchestra.run.smithi041.stdout: debug mds = 20 2021-10-21T00:11:51.337 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:11:51.337 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal frag = True 2021-10-21T00:11:51.337 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal fragment size max = 10000 2021-10-21T00:11:51.337 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal merge size = 5 2021-10-21T00:11:51.338 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split bits = 3 2021-10-21T00:11:51.338 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split size = 100 2021-10-21T00:11:51.338 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug frag = True 2021-10-21T00:11:51.338 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug scatterstat = True 2021-10-21T00:11:51.338 INFO:teuthology.orchestra.run.smithi041.stdout: mds op complaint time = 180 2021-10-21T00:11:51.339 INFO:teuthology.orchestra.run.smithi041.stdout: mds verify scatter = True 2021-10-21T00:11:51.339 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:11:51.339 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.339 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.343 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-10-21T00:11:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-10-21T00:11:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:11:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-10-21T00:11:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-10-21T00:11:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-10-21T00:11:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-10-21T00:11:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-10-21T00:11:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-10-21T00:11:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-10-21T00:11:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:11:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-10-21T00:11:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:11:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:11:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-10-21T00:11:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-10-21T00:11:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-10-21T00:11:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:11:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:11:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-10-21T00:11:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:11:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-10-21T00:11:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:11:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:11:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:11:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-10-21T00:11:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-10-21T00:11:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-10-21T00:11:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-10-21T00:11:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-10-21T00:11:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:11:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:11:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.353 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-10-21T00:11:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-10-21T00:11:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-10-21T00:11:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-10-21T00:11:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-10-21T00:11:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-10-21T00:11:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-10-21T00:11:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-10-21T00:11:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-10-21T00:11:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-10-21T00:11:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-10-21T00:11:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:11:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-10-21T00:11:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-10-21T00:11:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:11:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-10-21T00:11:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-10-21T00:11:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-10-21T00:11:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:11:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-10-21T00:11:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = filestore 2021-10-21T00:11:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:11:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: osd sloppy crc = True 2021-10-21T00:11:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.360 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-10-21T00:11:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:11:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-10-21T00:11:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:11:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:11:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-10-21T00:11:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.362 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-10-21T00:11:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:11:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:11:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-10-21T00:11:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:11:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-10-21T00:11:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-10-21T00:11:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-10-21T00:11:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-10-21T00:11:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:11:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:11:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:11:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:11:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:11:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:11:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-10-21T00:11:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:11:51.367 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-10-21T00:11:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-10-21T00:11:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-10-21T00:11:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-10-21T00:11:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:11:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:11:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-10-21T00:11:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-10-21T00:11:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:11:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: client debug getattr caps = true 2021-10-21T00:11:51.369 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-10-21T00:11:51.369 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-10-21T00:11:51.370 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-10-21T00:11:51.370 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-10-21T00:11:51.370 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-10-21T00:11:51.370 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-10-21T00:11:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-10-21T00:11:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:11:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-10-21T00:11:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-10-21T00:11:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-10-21T00:11:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-10-21T00:11:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-10-21T00:11:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-10-21T00:11:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-10-21T00:11:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-10-21T00:11:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-10-21T00:11:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:11:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2021-10-21T00:11:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2021-10-21T00:11:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:11:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2021-10-21T00:11:51.374 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2021-10-21T00:11:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2021-10-21T00:11:51.375 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2021-10-21T00:11:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2021-10-21T00:11:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2021-10-21T00:11:51.376 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2021-10-21T00:11:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:11:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2021-10-21T00:11:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:11:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:11:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2021-10-21T00:11:51.378 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2021-10-21T00:11:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2021-10-21T00:11:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:11:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:11:51.379 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2021-10-21T00:11:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:11:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2021-10-21T00:11:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:11:51.380 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:11:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:11:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2021-10-21T00:11:51.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2021-10-21T00:11:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2021-10-21T00:11:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2021-10-21T00:11:51.382 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2021-10-21T00:11:51.383 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:11:51.383 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:11:51.383 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.383 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2021-10-21T00:11:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2021-10-21T00:11:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2021-10-21T00:11:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2021-10-21T00:11:51.384 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2021-10-21T00:11:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2021-10-21T00:11:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2021-10-21T00:11:51.385 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2021-10-21T00:11:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2021-10-21T00:11:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2021-10-21T00:11:51.386 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2021-10-21T00:11:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:11:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2021-10-21T00:11:51.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2021-10-21T00:11:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:11:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2021-10-21T00:11:51.388 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2021-10-21T00:11:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2021-10-21T00:11:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:11:51.389 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2021-10-21T00:11:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = filestore 2021-10-21T00:11:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:11:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: osd sloppy crc = True 2021-10-21T00:11:51.390 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.390 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2021-10-21T00:11:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:11:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2021-10-21T00:11:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:11:51.391 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:11:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2021-10-21T00:11:51.392 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.392 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2021-10-21T00:11:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:11:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:11:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2021-10-21T00:11:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:11:51.393 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2021-10-21T00:11:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2021-10-21T00:11:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:11:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2021-10-21T00:11:51.394 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2021-10-21T00:11:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:11:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:11:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:11:51.395 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:11:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:11:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:11:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:11:51.396 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2021-10-21T00:11:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:11:51.397 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2021-10-21T00:11:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2021-10-21T00:11:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2021-10-21T00:11:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2021-10-21T00:11:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:11:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:11:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2021-10-21T00:11:51.398 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2021-10-21T00:11:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:11:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.399 INFO:teuthology.orchestra.run.smithi099.stdout: client debug getattr caps = true 2021-10-21T00:11:51.400 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2021-10-21T00:11:51.400 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2021-10-21T00:11:51.400 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2021-10-21T00:11:51.400 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2021-10-21T00:11:51.400 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2021-10-21T00:11:51.401 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2021-10-21T00:11:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2021-10-21T00:11:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:11:51.401 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal frag = True 2021-10-21T00:11:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal fragment size max = 10000 2021-10-21T00:11:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal merge size = 5 2021-10-21T00:11:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split bits = 3 2021-10-21T00:11:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split size = 100 2021-10-21T00:11:51.402 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2021-10-21T00:11:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2021-10-21T00:11:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2021-10-21T00:11:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2021-10-21T00:11:51.403 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:11:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:11:51.404 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:11:51.404 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:11:51.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.509+0000 7face1f78700 1 Processor -- start 2021-10-21T00:11:51.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.509+0000 7face1f78700 1 -- start start 2021-10-21T00:11:51.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7facdc05cba0 0x7facdc143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc0af370 0x7facdc140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc0644a0 con 0x7facdc05fd00 2021-10-21T00:11:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc05cf80 con 0x7facdc05cba0 2021-10-21T00:11:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc060760 con 0x7facdc0af370 2021-10-21T00:11:51.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7facdc05cba0 0x7facdc143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7facdc05fd00 0x7facdc1443f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:43490/0 (socket says 172.21.15.41:43490) 2021-10-21T00:11:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdaffd700 1 -- 172.21.15.41:0/1220226345 learned_addr learned my addr 172.21.15.41:0/1220226345 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdbfff700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc0af370 0x7facdc140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facda7fc700 1 -- 172.21.15.41:0/1220226345 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978445475 0 0) 0x7facdc0644a0 con 0x7facdc05fd00 2021-10-21T00:11:51.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facda7fc700 1 -- 172.21.15.41:0/1220226345 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facbc003260 con 0x7facdc05fd00 2021-10-21T00:11:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 -- 172.21.15.41:0/1220226345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc0af370 msgr2=0x7facdc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc0af370 0x7facdc140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 -- 172.21.15.41:0/1220226345 >> v1:172.21.15.62:6789/0 conn(0x7facdc05fd00 legacy=0x7facdc1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 -- 172.21.15.41:0/1220226345 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0604c0 con 0x7facdc05cba0 2021-10-21T00:11:51.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facdb7fe700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05cba0 0x7facdc143f00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7facc4002f70 tx=0x7facc4006df0).ready entity=mon.0 client_cookie=d480c80bd39b61ef server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facda7fc700 1 -- 172.21.15.41:0/1220226345 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc400d4a0 con 0x7facdc05cba0 2021-10-21T00:11:51.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facda7fc700 1 -- 172.21.15.41:0/1220226345 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4000e90 con 0x7facdc05cba0 2021-10-21T00:11:51.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7facda7fc700 1 -- 172.21.15.41:0/1220226345 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc400d7f0 con 0x7facdc05cba0 2021-10-21T00:11:51.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- 172.21.15.41:0/1220226345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05cba0 msgr2=0x7facdc143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05cba0 0x7facdc143f00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7facc4002f70 tx=0x7facc4006df0).stop 2021-10-21T00:11:51.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- 172.21.15.41:0/1220226345 shutdown_connections 2021-10-21T00:11:51.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc0af370 0x7facdc140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 --2- 172.21.15.41:0/1220226345 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05cba0 0x7facdc143f00 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- 172.21.15.41:0/1220226345 >> 172.21.15.41:0/1220226345 conn(0x7facdc05bd40 msgr2=0x7facdc05c150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:51.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- 172.21.15.41:0/1220226345 shutdown_connections 2021-10-21T00:11:51.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.513+0000 7face1f78700 1 -- 172.21.15.41:0/1220226345 wait complete. 2021-10-21T00:11:51.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 Processor -- start 2021-10-21T00:11:51.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 -- start start 2021-10-21T00:11:51.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc05cba0 0x7facdc0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 0x7facdc1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc08fdc0 con 0x7facdc05fd00 2021-10-21T00:11:51.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc08f880 con 0x7facdc0af370 2021-10-21T00:11:51.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7face1f78700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc08fb20 con 0x7facdc05cba0 2021-10-21T00:11:51.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7facdaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7facdaffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37672/0 (socket says 172.21.15.41:37672) 2021-10-21T00:11:51.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7facdaffd700 1 -- 172.21.15.41:0/18338554 learned_addr learned my addr 172.21.15.41:0/18338554 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:51.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7facdb7fe700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc05cba0 0x7facdc0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.517+0000 7facdbfff700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 0x7facdc1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 -- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc05cba0 msgr2=0x7facdc0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc05cba0 0x7facdc0b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 -- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 msgr2=0x7facdc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 0x7facdc1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 -- 172.21.15.41:0/18338554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc400b180 con 0x7facdc05fd00 2021-10-21T00:11:51.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdbfff700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 0x7facdc1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:51.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdaffd700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7faccc001110 tx=0x7faccc007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00ce20 con 0x7facdc05fd00 2021-10-21T00:11:51.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0072e0 con 0x7facdc05fd00 2021-10-21T00:11:51.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc0993d0 con 0x7facdc05fd00 2021-10-21T00:11:51.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc005800 con 0x7facdc05fd00 2021-10-21T00:11:51.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc155990 con 0x7facdc05fd00 2021-10-21T00:11:51.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc060a10 con 0x7facdc05fd00 2021-10-21T00:11:51.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faccc010070 con 0x7facdc05fd00 2021-10-21T00:11:51.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 0x7facc0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faccc06b1e0 con 0x7facdc05fd00 2021-10-21T00:11:51.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.521+0000 7facdb7fe700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 0x7facc0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.525+0000 7facdb7fe700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 0x7facc0055b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7facc401a000 tx=0x7facc4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.525+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faccc0421b0 con 0x7facdc05fd00 2021-10-21T00:11:51.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.653+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facdc057350 con 0x7facdc05fd00 2021-10-21T00:11:51.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7facd8ff9700 1 -- 172.21.15.41:0/18338554 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16052 (secure 0 0 0) 0x7faccc018030 con 0x7facdc05fd00 2021-10-21T00:11:51.665 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:51.666 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":127,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:11:42.857688+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:11:39.909885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-10-21T00:11:40.867103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:11:51.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 msgr2=0x7facc0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 0x7facc0055b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7facc401a000 tx=0x7facc4014000).stop 2021-10-21T00:11:51.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 msgr2=0x7facdc093610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7faccc001110 tx=0x7faccc007ad0).stop 2021-10-21T00:11:51.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 shutdown_connections 2021-10-21T00:11:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7facc00536a0 0x7facc0055b60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facdc0af370 0x7facdc1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7facdc05fd00 0x7facdc093610 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 --2- 172.21.15.41:0/18338554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facdc05cba0 0x7facdc0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 >> 172.21.15.41:0/18338554 conn(0x7facdc05bd40 msgr2=0x7facdc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 shutdown_connections 2021-10-21T00:11:51.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.657+0000 7face1f78700 1 -- 172.21.15.41:0/18338554 wait complete. 2021-10-21T00:11:51.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:11:39.909885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:11:40.867103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:11:51.680 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:11:51.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 Processor -- start 2021-10-21T00:11:51.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 -- start start 2021-10-21T00:11:51.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7d0064280 0x7fc7d00b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00b2670 con 0x7fc7d0060020 2021-10-21T00:11:51.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d005fdd0 con 0x7fc7d0064280 2021-10-21T00:11:51.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d6309700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b1810 con 0x7fc7d005f9f0 2021-10-21T00:11:51.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d48a6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d48a6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37680/0 (socket says 172.21.15.41:37680) 2021-10-21T00:11:51.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7d0064280 0x7fc7d00b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d48a6700 1 -- 172.21.15.41:0/1466773044 learned_addr learned my addr 172.21.15.41:0/1466773044 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:51.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cffff700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 msgr2=0x7fc7d0143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:51.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1466773044 >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 msgr2=0x7fc7d00b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:51.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1466773044 >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1466773044 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00b2a40 con 0x7fc7d0064280 2021-10-21T00:11:51.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7d48a6700 1 --2- 172.21.15.41:0/1466773044 >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:51.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00b1c90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc7c4002f70 tx=0x7fc7c4006df0).ready entity=mon.1 client_cookie=ea76ca320fd1cb17 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7ceffd700 1 -- 172.21.15.41:0/1466773044 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400d4a0 con 0x7fc7d0064280 2021-10-21T00:11:51.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7ceffd700 1 -- 172.21.15.41:0/1466773044 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4000e90 con 0x7fc7d0064280 2021-10-21T00:11:51.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.777+0000 7fc7ceffd700 1 -- 172.21.15.41:0/1466773044 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400d7f0 con 0x7fc7d0064280 2021-10-21T00:11:51.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 msgr2=0x7fc7d00b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00b1c90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc7c4002f70 tx=0x7fc7c4006df0).stop 2021-10-21T00:11:51.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- 172.21.15.41:0/1466773044 shutdown_connections 2021-10-21T00:11:51.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1466773044 >> v2:172.21.15.41:3300/0 conn(0x7fc7d0060020 0x7fc7d00b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00b1c90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1466773044 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- 172.21.15.41:0/1466773044 >> 172.21.15.41:0/1466773044 conn(0x7fc7d00ac9d0 msgr2=0x7fc7d00637e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:51.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- 172.21.15.41:0/1466773044 shutdown_connections 2021-10-21T00:11:51.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- 172.21.15.41:0/1466773044 wait complete. 2021-10-21T00:11:51.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 Processor -- start 2021-10-21T00:11:51.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 -- start start 2021-10-21T00:11:51.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.781+0000 7fc7d6309700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01475a0 con 0x7fc7d0060020 2021-10-21T00:11:51.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d0145b50 con 0x7fc7d0064280 2021-10-21T00:11:51.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d0145740 con 0x7fc7d005f9f0 2021-10-21T00:11:51.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37686/0 (socket says 172.21.15.41:37686) 2021-10-21T00:11:51.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1499290941 learned_addr learned my addr 172.21.15.41:0/1499290941 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:51.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d48a6700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cffff700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 msgr2=0x7fc7d0150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 msgr2=0x7fc7d00ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 -- 172.21.15.41:0/1499290941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c8009530 con 0x7fc7d0060020 2021-10-21T00:11:51.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cf7fe700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc7d0145c90 tx=0x7fc7c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c4013bb0 con 0x7fc7d0060020 2021-10-21T00:11:51.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4013d10 con 0x7fc7d0060020 2021-10-21T00:11:51.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c400b180 con 0x7fc7d0060020 2021-10-21T00:11:51.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c401e5f0 con 0x7fc7d0060020 2021-10-21T00:11:51.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d0145410 con 0x7fc7d0060020 2021-10-21T00:11:51.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.785+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d0147130 con 0x7fc7d0060020 2021-10-21T00:11:51.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.789+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc7c4025030 con 0x7fc7d0060020 2021-10-21T00:11:51.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.789+0000 7fc7cd7fa700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 0x7fc7b0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:51.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.789+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc7c406c460 con 0x7fc7d0060020 2021-10-21T00:11:51.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.789+0000 7fc7cffff700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 0x7fc7b0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:51.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.789+0000 7fc7cffff700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 0x7fc7b0055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc7c000b000 tx=0x7fc7c0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:51.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.797+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc7c4043600 con 0x7fc7d0060020 2021-10-21T00:11:51.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc7d01509c0 con 0x7fc7d0060020 2021-10-21T00:11:51.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7cd7fa700 1 -- 172.21.15.41:0/1499290941 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc7c4023020 con 0x7fc7d0060020 2021-10-21T00:11:51.933 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:11:51.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 msgr2=0x7fc7b0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 0x7fc7b0055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc7c000b000 tx=0x7fc7c0006df0).stop 2021-10-21T00:11:51.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 msgr2=0x7fc7d0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc7d0145c90 tx=0x7fc7c4014000).stop 2021-10-21T00:11:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 shutdown_connections 2021-10-21T00:11:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc7b0053610 0x7fc7b0055ad0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d0064280 0x7fc7d00ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc7d0060020 0x7fc7d0146c40 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 --2- 172.21.15.41:0/1499290941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d005f9f0 0x7fc7d0150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:51.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 >> 172.21.15.41:0/1499290941 conn(0x7fc7d00ac9d0 msgr2=0x7fc7d0142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:51.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 shutdown_connections 2021-10-21T00:11:51.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:51.925+0000 7fc7d6309700 1 -- 172.21.15.41:0/1499290941 wait complete. 2021-10-21T00:11:51.947 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:11:52.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 Processor -- start 2021-10-21T00:11:52.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 -- start start 2021-10-21T00:11:52.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a5c0b2b30 0x7f4a5c1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c0b34e0 con 0x7f4a5c0b7a60 2021-10-21T00:11:52.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b7e40 con 0x7f4a5c144ca0 2021-10-21T00:11:52.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a61db9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b3240 con 0x7f4a5c0b2b30 2021-10-21T00:11:52.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.061+0000 7f4a615b8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37694/0 (socket says 172.21.15.41:37694) 2021-10-21T00:11:52.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 -- 172.21.15.41:0/3230683650 learned_addr learned my addr 172.21.15.41:0/3230683650 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a5bfff700 1 --2- 172.21.15.41:0/3230683650 >> v2:172.21.15.62:3300/0 conn(0x7f4a5c0b2b30 0x7f4a5c1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 -- 172.21.15.41:0/3230683650 >> v2:172.21.15.62:3300/0 conn(0x7f4a5c0b2b30 msgr2=0x7f4a5c1447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:52.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 --2- 172.21.15.41:0/3230683650 >> v2:172.21.15.62:3300/0 conn(0x7f4a5c0b2b30 0x7f4a5c1447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 -- 172.21.15.41:0/3230683650 >> v1:172.21.15.62:6789/0 conn(0x7f4a5c0b7a60 legacy=0x7f4a5c140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:52.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 -- 172.21.15.41:0/3230683650 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c144310 con 0x7f4a5c144ca0 2021-10-21T00:11:52.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a615b8700 1 --2- 172.21.15.41:0/3230683650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f4a5c062930 tx=0x7f4a54009290).ready entity=mon.0 client_cookie=dde5684388ae63c2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a5b7fe700 1 -- 172.21.15.41:0/3230683650 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5400b830 con 0x7f4a5c144ca0 2021-10-21T00:11:52.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a5b7fe700 1 -- 172.21.15.41:0/3230683650 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5400b990 con 0x7f4a5c144ca0 2021-10-21T00:11:52.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a5b7fe700 1 -- 172.21.15.41:0/3230683650 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5400bb40 con 0x7f4a5c144ca0 2021-10-21T00:11:52.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 -- 172.21.15.41:0/3230683650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 msgr2=0x7f4a5c0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3230683650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f4a5c062930 tx=0x7f4a54009290).stop 2021-10-21T00:11:52.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 -- 172.21.15.41:0/3230683650 shutdown_connections 2021-10-21T00:11:52.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3230683650 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0b1f30 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3230683650 >> v2:172.21.15.62:3300/0 conn(0x7f4a5c0b2b30 0x7f4a5c1447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 -- 172.21.15.41:0/3230683650 >> 172.21.15.41:0/3230683650 conn(0x7f4a5c065170 msgr2=0x7f4a5c0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 -- 172.21.15.41:0/3230683650 shutdown_connections 2021-10-21T00:11:52.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.065+0000 7f4a61db9700 1 -- 172.21.15.41:0/3230683650 wait complete. 2021-10-21T00:11:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 Processor -- start 2021-10-21T00:11:52.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- start start 2021-10-21T00:11:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a5c0b2b30 0x7f4a5c0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5c0b7a60 0x7f4a5c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c09af20 con 0x7f4a5c144ca0 2021-10-21T00:11:52.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c09b160 con 0x7f4a5c0b2b30 2021-10-21T00:11:52.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c09b400 con 0x7f4a5c0b7a60 2021-10-21T00:11:52.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37702/0 (socket says 172.21.15.41:37702) 2021-10-21T00:11:52.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 -- 172.21.15.41:0/3564814 learned_addr learned my addr 172.21.15.41:0/3564814 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a5bfff700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5c0b7a60 0x7f4a5c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a60db7700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a5c0b2b30 0x7f4a5c0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 -- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5c0b7a60 msgr2=0x7f4a5c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5c0b7a60 0x7f4a5c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 -- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a5c0b2b30 msgr2=0x7f4a5c0ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a5c0b2b30 0x7f4a5c0ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 -- 172.21.15.41:0/3564814 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54009530 con 0x7f4a5c144ca0 2021-10-21T00:11:52.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a615b8700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f4a5c062930 tx=0x7f4a54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a540032d0 con 0x7f4a5c144ca0 2021-10-21T00:11:52.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54006b00 con 0x7f4a5c144ca0 2021-10-21T00:11:52.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c0ac2b0 con 0x7f4a5c144ca0 2021-10-21T00:11:52.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a54021630 con 0x7f4a5c144ca0 2021-10-21T00:11:52.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.069+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c0acde0 con 0x7f4a5c144ca0 2021-10-21T00:11:52.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c0aab60 con 0x7f4a5c144ca0 2021-10-21T00:11:52.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a54027020 con 0x7f4a5c144ca0 2021-10-21T00:11:52.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a59ffb700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 0x7f4a3c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a5406ca70 con 0x7f4a5c144ca0 2021-10-21T00:11:52.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a60db7700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 0x7f4a3c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.073+0000 7f4a60db7700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 0x7f4a3c055b90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4a5000d000 tx=0x7f4a50007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.081+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a5c0aab60 con 0x7f4a5c144ca0 2021-10-21T00:11:52.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.205+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a5c0aab60 con 0x7f4a5c144ca0 2021-10-21T00:11:52.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.205+0000 7f4a59ffb700 1 -- 172.21.15.41:0/3564814 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a5c0aab60 con 0x7f4a5c144ca0 2021-10-21T00:11:52.218 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:52.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 msgr2=0x7f4a3c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 0x7f4a3c055b90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4a5000d000 tx=0x7f4a50007b70).stop 2021-10-21T00:11:52.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 msgr2=0x7f4a5c0ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f4a5c062930 tx=0x7f4a54016000).stop 2021-10-21T00:11:52.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 shutdown_connections 2021-10-21T00:11:52.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4a3c0536d0 0x7f4a3c055b90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4a5c144ca0 0x7f4a5c0ac750 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4a5c0b7a60 0x7f4a5c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 --2- 172.21.15.41:0/3564814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a5c0b2b30 0x7f4a5c0ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 >> 172.21.15.41:0/3564814 conn(0x7f4a5c065170 msgr2=0x7f4a5c143130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 shutdown_connections 2021-10-21T00:11:52.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.209+0000 7f4a61db9700 1 -- 172.21.15.41:0/3564814 wait complete. 2021-10-21T00:11:52.228 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:11:52.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.325+0000 7fc402ef4700 1 Processor -- start 2021-10-21T00:11:52.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.325+0000 7fc402ef4700 1 -- start start 2021-10-21T00:11:52.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc3fc0b44f0 0x7fc3fc146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc3fc0b2080 0x7fc3fc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0b1dd0 con 0x7fc3fc0b33a0 2021-10-21T00:11:52.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0ac360 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0b48d0 con 0x7fc3fc0b2080 2021-10-21T00:11:52.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc3fc0b44f0 0x7fc3fc146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc3fc0b44f0 0x7fc3fc146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37706/0 (socket says 172.21.15.41:37706) 2021-10-21T00:11:52.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc4016f1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc3fc0b2080 0x7fc3fc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 -- 172.21.15.41:0/4124660414 learned_addr learned my addr 172.21.15.41:0/4124660414 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 -- 172.21.15.41:0/4124660414 >> v2:172.21.15.62:3300/0 conn(0x7fc3fc0b2080 msgr2=0x7fc3fc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:52.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 --2- 172.21.15.41:0/4124660414 >> v2:172.21.15.62:3300/0 conn(0x7fc3fc0b2080 0x7fc3fc0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 -- 172.21.15.41:0/4124660414 >> v1:172.21.15.62:6789/0 conn(0x7fc3fc0b33a0 legacy=0x7fc3fc141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 -- 172.21.15.41:0/4124660414 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0b2b50 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc401ef2700 1 --2- 172.21.15.41:0/4124660414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc146020 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc3ec002f70 tx=0x7fc3ec006eb0).ready entity=mon.0 client_cookie=e2f715700b683d52 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc400ef0700 1 -- 172.21.15.41:0/4124660414 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3ec00d5c0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc400ef0700 1 -- 172.21.15.41:0/4124660414 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec000e90 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc400ef0700 1 -- 172.21.15.41:0/4124660414 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3ec00d950 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- 172.21.15.41:0/4124660414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 msgr2=0x7fc3fc146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 --2- 172.21.15.41:0/4124660414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc146020 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc3ec002f70 tx=0x7fc3ec006eb0).stop 2021-10-21T00:11:52.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- 172.21.15.41:0/4124660414 shutdown_connections 2021-10-21T00:11:52.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 --2- 172.21.15.41:0/4124660414 >> v2:172.21.15.62:3300/0 conn(0x7fc3fc0b2080 0x7fc3fc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 --2- 172.21.15.41:0/4124660414 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc146020 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- 172.21.15.41:0/4124660414 >> 172.21.15.41:0/4124660414 conn(0x7fc3fc0b7b10 msgr2=0x7fc3fc0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- 172.21.15.41:0/4124660414 shutdown_connections 2021-10-21T00:11:52.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.329+0000 7fc402ef4700 1 -- 172.21.15.41:0/4124660414 wait complete. 2021-10-21T00:11:52.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 Processor -- start 2021-10-21T00:11:52.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 -- start start 2021-10-21T00:11:52.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3fc0b2080 0x7fc3fc09bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3fc0b33a0 0x7fc3fc066730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0b0db0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0afc90 con 0x7fc3fc0b2080 2021-10-21T00:11:52.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc402ef4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0b0fe0 con 0x7fc3fc0b33a0 2021-10-21T00:11:52.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37716/0 (socket says 172.21.15.41:37716) 2021-10-21T00:11:52.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 -- 172.21.15.41:0/2095694904 learned_addr learned my addr 172.21.15.41:0/2095694904 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4016f1700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3fc0b33a0 0x7fc3fc066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc401ef2700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3fc0b2080 0x7fc3fc09bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 -- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3fc0b33a0 msgr2=0x7fc3fc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3fc0b33a0 0x7fc3fc066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 -- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3fc0b2080 msgr2=0x7fc3fc09bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3fc0b2080 0x7fc3fc09bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 -- 172.21.15.41:0/2095694904 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec00b1e0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.333+0000 7fc4026f3700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fc3fc05cd80 tx=0x7fc3f4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f4013450 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f40135b0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc0afef0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f4013910 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc09cb80 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc0b00d0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3f4010070 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 0x7fc3dc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc3f406af40 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.337+0000 7fc401ef2700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 0x7fc3dc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.341+0000 7fc401ef2700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 0x7fc3dc055b90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fc3ec01c000 tx=0x7fc3ec015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.345+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3fc0b00d0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.473+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3fc0b00d0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.473+0000 7fc3f2ffd700 1 -- 172.21.15.41:0/2095694904 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc3fc0b00d0 con 0x7fc3fc0b44f0 2021-10-21T00:11:52.482 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:52.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 msgr2=0x7fc3dc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 0x7fc3dc055b90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fc3ec01c000 tx=0x7fc3ec015000).stop 2021-10-21T00:11:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 msgr2=0x7fc3fc066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fc3fc05cd80 tx=0x7fc3f4007b90).stop 2021-10-21T00:11:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 shutdown_connections 2021-10-21T00:11:52.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc3dc0536d0 0x7fc3dc055b90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc3fc0b44f0 0x7fc3fc066c20 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3fc0b33a0 0x7fc3fc066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 --2- 172.21.15.41:0/2095694904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3fc0b2080 0x7fc3fc09bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 >> 172.21.15.41:0/2095694904 conn(0x7fc3fc0b7b10 msgr2=0x7fc3fc0b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 shutdown_connections 2021-10-21T00:11:52.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.477+0000 7fc402ef4700 1 -- 172.21.15.41:0/2095694904 wait complete. 2021-10-21T00:11:52.498 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:11:52.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.605+0000 7f0d1c8e9700 1 Processor -- start 2021-10-21T00:11:52.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.605+0000 7f0d1c8e9700 1 -- start start 2021-10-21T00:11:52.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d180b22f0 0x7f0d180b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180609d0 con 0x7f0d18097f60 2021-10-21T00:11:52.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d180b26d0 con 0x7f0d180b13c0 2021-10-21T00:11:52.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d180af290 con 0x7f0d180b22f0 2021-10-21T00:11:52.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d180b22f0 0x7f0d180b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0d180b22f0 0x7f0d180b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37720/0 (socket says 172.21.15.41:37720) 2021-10-21T00:11:52.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 -- 172.21.15.41:0/91192914 learned_addr learned my addr 172.21.15.41:0/91192914 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d16ffd700 1 --1- 172.21.15.41:0/91192914 >> v1:172.21.15.41:6789/0 conn(0x7f0d18097f60 0x7f0d180af7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35492/0 (socket says 172.21.15.41:35492) 2021-10-21T00:11:52.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 -- 172.21.15.41:0/91192914 >> v1:172.21.15.62:6789/0 conn(0x7f0d180b13c0 legacy=0x7f0d180afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 -- 172.21.15.41:0/91192914 >> v1:172.21.15.41:6789/0 conn(0x7f0d18097f60 legacy=0x7f0d180af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d167fc700 1 -- 172.21.15.41:0/91192914 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943458461 0 0) 0x7f0d180609d0 con 0x7f0d18097f60 2021-10-21T00:11:52.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 -- 172.21.15.41:0/91192914 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180b05c0 con 0x7f0d180b22f0 2021-10-21T00:11:52.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d177fe700 1 --2- 172.21.15.41:0/91192914 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b22f0 0x7f0d180b0ed0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f0d08002f70 tx=0x7f0d08006f40).ready entity=mon.0 client_cookie=aecd1a007b9a8623 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d167fc700 1 -- 172.21.15.41:0/91192914 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0800dc70 con 0x7f0d180b22f0 2021-10-21T00:11:52.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d167fc700 1 -- 172.21.15.41:0/91192914 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08000e90 con 0x7f0d180b22f0 2021-10-21T00:11:52.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d167fc700 1 -- 172.21.15.41:0/91192914 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0800be90 con 0x7f0d180b22f0 2021-10-21T00:11:52.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/91192914 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b22f0 msgr2=0x7f0d180b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/91192914 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b22f0 0x7f0d180b0ed0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f0d08002f70 tx=0x7f0d08006f40).stop 2021-10-21T00:11:52.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/91192914 shutdown_connections 2021-10-21T00:11:52.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/91192914 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b22f0 0x7f0d180b0ed0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/91192914 >> 172.21.15.41:0/91192914 conn(0x7f0d180b58d0 msgr2=0x7f0d180b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/91192914 shutdown_connections 2021-10-21T00:11:52.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.609+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/91192914 wait complete. 2021-10-21T00:11:52.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 Processor -- start 2021-10-21T00:11:52.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 -- start start 2021-10-21T00:11:52.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d18097f60 0x7f0d180ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d180b22f0 0x7f0d18063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18066370 con 0x7f0d180b13c0 2021-10-21T00:11:52.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180665d0 con 0x7f0d18097f60 2021-10-21T00:11:52.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d1c8e9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18066870 con 0x7f0d180b22f0 2021-10-21T00:11:52.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d177fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d18097f60 0x7f0d180ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d16ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37728/0 (socket says 172.21.15.41:37728) 2021-10-21T00:11:52.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d16ffd700 1 -- 172.21.15.41:0/3026381353 learned_addr learned my addr 172.21.15.41:0/3026381353 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.613+0000 7f0d17fff700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d180b22f0 0x7f0d18063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 -- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d180b22f0 msgr2=0x7f0d18063740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d180b22f0 0x7f0d18063740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 -- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d18097f60 msgr2=0x7f0d180ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d18097f60 0x7f0d180ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 -- 172.21.15.41:0/3026381353 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0800b460 con 0x7f0d180b13c0 2021-10-21T00:11:52.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d16ffd700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f0d00000ed0 tx=0x7f0d00007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d0000ce50 con 0x7f0d180b13c0 2021-10-21T00:11:52.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d000070d0 con 0x7f0d180b13c0 2021-10-21T00:11:52.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d180abaf0 con 0x7f0d180b13c0 2021-10-21T00:11:52.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d00007430 con 0x7f0d180b13c0 2021-10-21T00:11:52.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d18066ad0 con 0x7f0d180b13c0 2021-10-21T00:11:52.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d18057350 con 0x7f0d180b13c0 2021-10-21T00:11:52.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.617+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d0001a060 con 0x7f0d180b13c0 2021-10-21T00:11:52.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.621+0000 7f0d14ff9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 0x7f0cfc0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.621+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0d0006ac40 con 0x7f0d180b13c0 2021-10-21T00:11:52.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.621+0000 7f0d177fe700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 0x7f0cfc0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.621+0000 7f0d177fe700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 0x7f0cfc0559e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0d0801e000 tx=0x7f0d08006f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.625+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d00041da0 con 0x7f0d180b13c0 2021-10-21T00:11:52.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d1806a320 con 0x7f0d180b13c0 2021-10-21T00:11:52.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d14ff9700 1 -- 172.21.15.41:0/3026381353 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0d000453c0 con 0x7f0d180b13c0 2021-10-21T00:11:52.761 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:11:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 msgr2=0x7f0cfc0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 0x7f0cfc0559e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0d0801e000 tx=0x7f0d08006f40).stop 2021-10-21T00:11:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 msgr2=0x7f0d180aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f0d00000ed0 tx=0x7f0d00007c80).stop 2021-10-21T00:11:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 shutdown_connections 2021-10-21T00:11:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0cfc053520 0x7f0cfc0559e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d180b22f0 0x7f0d18063740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0d180b13c0 0x7f0d180aa5e0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 --2- 172.21.15.41:0/3026381353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d18097f60 0x7f0d180ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 >> 172.21.15.41:0/3026381353 conn(0x7f0d180b58d0 msgr2=0x7f0d180ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 shutdown_connections 2021-10-21T00:11:52.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.753+0000 7f0d1c8e9700 1 -- 172.21.15.41:0/3026381353 wait complete. 2021-10-21T00:11:52.775 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:11:52.775 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:52.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 Processor -- start 2021-10-21T00:11:52.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 -- start start 2021-10-21T00:11:52.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a9005bee0 0x7f9a90143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9a900b3570 0x7f9a9013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a901404c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a90144f00 con 0x7f9a900b3570 2021-10-21T00:11:52.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900b2500 con 0x7f9a9005bee0 2021-10-21T00:11:52.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a96f9c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9005cf40 con 0x7f9a900b1b10 2021-10-21T00:11:52.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9a900b3570 0x7f9a9013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9a900b3570 0x7f9a9013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37734/0 (socket says 172.21.15.41:37734) 2021-10-21T00:11:52.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 -- 172.21.15.41:0/2155028316 learned_addr learned my addr 172.21.15.41:0/2155028316 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a95539700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a901404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a94d38700 1 --2- 172.21.15.41:0/2155028316 >> v2:172.21.15.62:3300/0 conn(0x7f9a9005bee0 0x7f9a90143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 -- 172.21.15.41:0/2155028316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 msgr2=0x7f9a901404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:52.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a901404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 -- 172.21.15.41:0/2155028316 >> v2:172.21.15.62:3300/0 conn(0x7f9a9005bee0 msgr2=0x7f9a90143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:52.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 --2- 172.21.15.41:0/2155028316 >> v2:172.21.15.62:3300/0 conn(0x7f9a9005bee0 0x7f9a90143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 -- 172.21.15.41:0/2155028316 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9005cca0 con 0x7f9a900b3570 2021-10-21T00:11:52.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a95539700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a901404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:52.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8ffff700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a900b3570 0x7f9a9013ffd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f9a800032f0 tx=0x7f9a80009290).ready entity=mon.0 client_cookie=b3ec028647865420 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.869+0000 7f9a8f7fe700 1 -- 172.21.15.41:0/2155028316 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a8000b870 con 0x7f9a900b3570 2021-10-21T00:11:52.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a8f7fe700 1 -- 172.21.15.41:0/2155028316 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8000b9d0 con 0x7f9a900b3570 2021-10-21T00:11:52.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a8f7fe700 1 -- 172.21.15.41:0/2155028316 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a8000bb40 con 0x7f9a900b3570 2021-10-21T00:11:52.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- 172.21.15.41:0/2155028316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a900b3570 msgr2=0x7f9a9013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a900b3570 0x7f9a9013ffd0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f9a800032f0 tx=0x7f9a80009290).stop 2021-10-21T00:11:52.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- 172.21.15.41:0/2155028316 shutdown_connections 2021-10-21T00:11:52.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a900b3570 0x7f9a9013ffd0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/2155028316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a901404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/2155028316 >> v2:172.21.15.62:3300/0 conn(0x7f9a9005bee0 0x7f9a90143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- 172.21.15.41:0/2155028316 >> 172.21.15.41:0/2155028316 conn(0x7f9a900652d0 msgr2=0x7f9a900b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:52.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- 172.21.15.41:0/2155028316 shutdown_connections 2021-10-21T00:11:52.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- 172.21.15.41:0/2155028316 wait complete. 2021-10-21T00:11:52.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 Processor -- start 2021-10-21T00:11:52.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- start start 2021-10-21T00:11:52.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a900ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a900b3570 0x7f9a9008f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90150da0 con 0x7f9a9005bee0 2021-10-21T00:11:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90150890 con 0x7f9a900b3570 2021-10-21T00:11:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a96f9c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900ad910 con 0x7f9a900b1b10 2021-10-21T00:11:52.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a94d38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a8ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a900ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a95539700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a900b3570 0x7f9a9008f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a94d38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37740/0 (socket says 172.21.15.41:37740) 2021-10-21T00:11:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.873+0000 7f9a94d38700 1 -- 172.21.15.41:0/3209514513 learned_addr learned my addr 172.21.15.41:0/3209514513 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:52.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 -- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 msgr2=0x7f9a900ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a900ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 -- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a900b3570 msgr2=0x7f9a9008f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:52.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a900b3570 0x7f9a9008f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 -- 172.21.15.41:0/3209514513 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009530 con 0x7f9a9005bee0 2021-10-21T00:11:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a94d38700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f9a840030b0 tx=0x7f9a84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a84011780 con 0x7f9a9005bee0 2021-10-21T00:11:52.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a840118e0 con 0x7f9a9005bee0 2021-10-21T00:11:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a900addb0 con 0x7f9a9005bee0 2021-10-21T00:11:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a84011c40 con 0x7f9a9005bee0 2021-10-21T00:11:52.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a90062730 con 0x7f9a9005bee0 2021-10-21T00:11:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a900adad0 con 0x7f9a9005bee0 2021-10-21T00:11:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.877+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a84012420 con 0x7f9a9005bee0 2021-10-21T00:11:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.881+0000 7f9a8dffb700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 0x7f9a70055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:52.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.881+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9a8406b800 con 0x7f9a9005bee0 2021-10-21T00:11:52.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.881+0000 7f9a8ffff700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 0x7f9a70055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:52.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.881+0000 7f9a8ffff700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 0x7f9a70055b20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f9a8001a000 tx=0x7f9a80016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:52.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:52.885+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a840427f0 con 0x7f9a9005bee0 2021-10-21T00:11:53.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.049+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a901506c0 con 0x7f9a9005bee0 2021-10-21T00:11:53.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.049+0000 7f9a8dffb700 1 -- 172.21.15.41:0/3209514513 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f9a84045e10 con 0x7f9a9005bee0 2021-10-21T00:11:53.057 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:53.058 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:53.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 msgr2=0x7f9a70055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:53.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 0x7f9a70055b20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f9a8001a000 tx=0x7f9a80016000).stop 2021-10-21T00:11:53.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 msgr2=0x7f9a90061e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:53.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f9a840030b0 tx=0x7f9a84008040).stop 2021-10-21T00:11:53.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 shutdown_connections 2021-10-21T00:11:53.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9a70053660 0x7f9a70055b20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:53.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a900b3570 0x7f9a9008f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:53.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a900b1b10 0x7f9a900ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:53.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 --2- 172.21.15.41:0/3209514513 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9a9005bee0 0x7f9a90061e10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:53.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 >> 172.21.15.41:0/3209514513 conn(0x7f9a900652d0 msgr2=0x7f9a900b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:53.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 shutdown_connections 2021-10-21T00:11:53.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:53.053+0000 7f9a96f9c700 1 -- 172.21.15.41:0/3209514513 wait complete. 2021-10-21T00:11:53.064 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:53.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:11:41.854126+0000', 'modified': '2021-10-21T00:11:42.858043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8091}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8091': {'gid': 8091, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/204327833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 204327833}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 204327833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:11:53.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:11:53.279 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:11:53.396 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8091,"want_state":"up:active","state":"up:active","rank_uptime":11.524665694999999,"mdsmap_epoch":66,"osdmap_epoch":127,"osdmap_epoch_barrier":126,"uptime":16.263919601000001} 2021-10-21T00:11:53.396 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8091, "mdsmap_epoch": 66, "osdmap_epoch": 127, "osdmap_epoch_barrier": 126, "rank_uptime": 11.524665695, "state": "up:active", "uptime": 16.263919601, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:11:53.397 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:11:53.397 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:11:53.398 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:11:53.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:53.399 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:53.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:53.466 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:53.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:53.484 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:53.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:53.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:53.487 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:53.494 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:11:53.495 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:53.539 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:53.556 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:53.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:53.566 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:53.567 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:53.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:53.568 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:53.613 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:11:53.605+0000 7f53b5324080 -1 init, newargv = 0x5619bf6d98b0 newargc=9 2021-10-21T00:11:53.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14481]: starting ceph client 2021-10-21T00:11:53.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14481]: starting fuse 2021-10-21T00:11:54.716 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:11:54.734 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:11:54.735 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:11:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:11:54.793 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:11:54.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:54.795 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:11:54.799 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:11:54.800 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:11:54.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:54.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:11:54.801 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:11:54.802 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:11:54.802 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:11:54.803 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:11:54.803 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:54.803 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:11:54.804 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:11:54.804 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:11:54.805 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:54.805 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:11:54.806 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:11:54.807 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:11:54.808 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:11:54.808 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:54.808 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:11:54.809 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:11:54.809 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:11:54.810 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:11:54.810 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:11:54.811 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:11:54.811 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:11:54.811 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:11:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14481.asok 2021-10-21T00:11:54.889 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14481.asok 2021-10-21T00:11:54.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:54.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14481.asok status 2021-10-21T00:11:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:11:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:11:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:11:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:11:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:11:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:11:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:11:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14481", 2021-10-21T00:11:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:11:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:11:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:11:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 8161, 2021-10-21T00:11:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:11:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:11:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:11:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 8161 2021-10-21T00:11:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1924243157 2021-10-21T00:11:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:11:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:11:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:11:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:11:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1924243157 2021-10-21T00:11:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:11:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.8161 172.21.15.99:0/1924243157", 2021-10-21T00:11:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/1924243157", 2021-10-21T00:11:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:11:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 66, 2021-10-21T00:11:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 127, 2021-10-21T00:11:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:11:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:11:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:11:54.993 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:11:54.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:54.994 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:54.995 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:55.002 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:55.003 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:55.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:55.004 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:55.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:55.064 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:55.065 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:55.074 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:55.075 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:55.076 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-10-21T00:11:55.076 DEBUG:teuthology.orchestra.run.smithi071:> import time 2021-10-21T00:11:55.077 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:11:55.077 DEBUG:teuthology.orchestra.run.smithi071:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-10-21T00:11:55.077 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content'"'"') 2021-10-21T00:11:55.078 DEBUG:teuthology.orchestra.run.smithi071:> f.flush() 2021-10-21T00:11:55.078 DEBUG:teuthology.orchestra.run.smithi071:> f.write('"'"'content2'"'"') 2021-10-21T00:11:55.079 DEBUG:teuthology.orchestra.run.smithi071:> while True: 2021-10-21T00:11:55.080 DEBUG:teuthology.orchestra.run.smithi071:> time.sleep(1) 2021-10-21T00:11:55.080 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:11:55.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-10-21T00:11:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-10-21T00:11:55.104 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-10-21T00:11:56.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-10-21T00:11:56.123 INFO:teuthology.orchestra.run.smithi071.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-10-21T00:11:56.125 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-10-21T00:11:56.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-10-21T00:11:56.160 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-10-21T00:11:56.162 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-10-21T00:11:56.163 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-21T00:11:56.164 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-10-21T00:11:56.204 INFO:teuthology.orchestra.run.smithi099.stdout:content 2021-10-21T00:11:56.220 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:11:56.220 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:56.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:56.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:56.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:56.306 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:11:56.327 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:11:56.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:56.329 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:56.329 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:56.339 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:11:56.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:11:56.340 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:11:56.340 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:11:56.341 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:56.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15020]: fuse finished with error 0 and tester_r 0 2021-10-21T00:11:56.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:56.361 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:56.361 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:56.368 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:11:56.371 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:11:56.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:56.431 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:11:56.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:56.439 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:56.440 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:56.447 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:11:56.449 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:11:56.449 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:11:56.449 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:11:56.450 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:56.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14481]: fuse finished with error 0 and tester_r 0 2021-10-21T00:11:56.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:56.508 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:56.508 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:56.515 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:11:56.516 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:11:56.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:56.613 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:11:56.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:11:56.622 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:11:56.622 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:11:56.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:56.631 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:11:56.632 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:11:56.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:11:56.633 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:11:56.640 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:11:56.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:11:56.641 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:11:56.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 Processor -- start 2021-10-21T00:11:56.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 -- start start 2021-10-21T00:11:56.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f864c0b1fb0 0x7f864c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:56.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c1473c0 con 0x7f864c0af7a0 2021-10-21T00:11:56.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c14a670 con 0x7f864c097830 2021-10-21T00:11:56.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f8650dd8700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c14a910 con 0x7f864c0b1fb0 2021-10-21T00:11:56.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f864b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f864c0b1fb0 0x7f864c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:56.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f864bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f864c0af7a0 0x7f864c0afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35522/0 (socket says 172.21.15.41:35522) 2021-10-21T00:11:56.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f864bfff700 1 -- 172.21.15.41:0/334559898 learned_addr learned my addr 172.21.15.41:0/334559898 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:56.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.745+0000 7f864b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f864c0b1fb0 0x7f864c0b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37748/0 (socket says 172.21.15.41:37748) 2021-10-21T00:11:56.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862215854 0 0) 0x7f864c1473c0 con 0x7f864c0af7a0 2021-10-21T00:11:56.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8638003260 con 0x7f864c0af7a0 2021-10-21T00:11:56.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935275090 0 0) 0x7f864c14a670 con 0x7f864c097830 2021-10-21T00:11:56.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c1473c0 con 0x7f864c097830 2021-10-21T00:11:56.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864b7fe700 1 -- 172.21.15.41:0/334559898 >> v1:172.21.15.62:6789/0 conn(0x7f864c097830 legacy=0x7f864c14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:56.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864b7fe700 1 -- 172.21.15.41:0/334559898 >> v1:172.21.15.41:6789/0 conn(0x7f864c0af7a0 legacy=0x7f864c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:56.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864b7fe700 1 -- 172.21.15.41:0/334559898 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c14b4c0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864b7fe700 1 --2- 172.21.15.41:0/334559898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0b2390 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f86440032f0 tx=0x7f86440091d0).ready entity=mon.0 client_cookie=e7b38acad9ef7dd6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:56.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864400b600 con 0x7f864c0b1fb0 2021-10-21T00:11:56.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864400b760 con 0x7f864c0b1fb0 2021-10-21T00:11:56.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f864a7fc700 1 -- 172.21.15.41:0/334559898 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864400b8d0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 -- 172.21.15.41:0/334559898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 msgr2=0x7f864c0b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:56.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 --2- 172.21.15.41:0/334559898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0b2390 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f86440032f0 tx=0x7f86440091d0).stop 2021-10-21T00:11:56.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 -- 172.21.15.41:0/334559898 shutdown_connections 2021-10-21T00:11:56.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 --2- 172.21.15.41:0/334559898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0b2390 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:56.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 -- 172.21.15.41:0/334559898 >> 172.21.15.41:0/334559898 conn(0x7f864c0b58d0 msgr2=0x7f864c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:56.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 -- 172.21.15.41:0/334559898 shutdown_connections 2021-10-21T00:11:56.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.749+0000 7f8650dd8700 1 -- 172.21.15.41:0/334559898 wait complete. 2021-10-21T00:11:56.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 Processor -- start 2021-10-21T00:11:56.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 -- start start 2021-10-21T00:11:56.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f864c097830 0x7f864c0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:56.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f864c0af7a0 0x7f864c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:56.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:56.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0aefb0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15a4b0 con 0x7f864c097830 2021-10-21T00:11:56.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f8650dd8700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15a750 con 0x7f864c0af7a0 2021-10-21T00:11:56.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f864bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:56.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f864bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37758/0 (socket says 172.21.15.41:37758) 2021-10-21T00:11:56.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f864bfff700 1 -- 172.21.15.41:0/3744783797 learned_addr learned my addr 172.21.15.41:0/3744783797 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:56.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f864b7fe700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f864c097830 0x7f864c0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:56.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.753+0000 7f864affd700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f864c0af7a0 0x7f864c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:56.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 -- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f864c0af7a0 msgr2=0x7f864c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:56.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f864c0af7a0 0x7f864c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:56.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 -- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f864c097830 msgr2=0x7f864c0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:56.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f864c097830 0x7f864c0aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:56.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 -- 172.21.15.41:0/3744783797 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644009470 con 0x7f864c0b1fb0 2021-10-21T00:11:56.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f864bfff700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f863c001040 tx=0x7f863c007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:56.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c0070d0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c007230 con 0x7f864c0b1fb0 2021-10-21T00:11:56.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c0aa890 con 0x7f864c0b1fb0 2021-10-21T00:11:56.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c005610 con 0x7f864c0b1fb0 2021-10-21T00:11:56.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0adec0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c0b02e0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.757+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f863c010070 con 0x7f864c0b1fb0 2021-10-21T00:11:56.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.761+0000 7f8648ff9700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 0x7f862c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:56.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.761+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f863c06aef0 con 0x7f864c0b1fb0 2021-10-21T00:11:56.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.761+0000 7f864b7fe700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 0x7f862c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:56.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.761+0000 7f864b7fe700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 0x7f862c055a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f8644019000 tx=0x7f8644016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:56.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.765+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f863c042050 con 0x7f864c0b1fb0 2021-10-21T00:11:56.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.897+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f864c15a920 con 0x7f864c0b1fb0 2021-10-21T00:11:56.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.897+0000 7f8648ff9700 1 -- 172.21.15.41:0/3744783797 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v127) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f863c045670 con 0x7f864c0b1fb0 2021-10-21T00:11:56.906 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:56.907 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:11:56.907 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 127, 2021-10-21T00:11:56.907 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:11:56.907 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:11:56.908 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:11:42.857688+0000", 2021-10-21T00:11:56.908 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:56.908 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:11:56.908 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:11:56.908 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:11:56.909 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:11:56.909 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:11:56.909 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:11:56.909 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:11:56.910 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:11:56.910 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:56.910 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:11:56.910 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:11:56.911 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:11:56.911 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:11:56.911 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:11:56.911 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 26, 2021-10-21T00:11:56.911 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:11:56.912 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:11:56.912 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:11:56.912 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:11:56.912 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:11:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:11:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:11:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:11:56.913 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:56.914 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:56.914 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:56.914 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:56.914 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:56.915 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:56.916 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:56.916 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:56.917 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:11:56.917 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:11:56.918 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:11:56.918 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:11:56.918 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:11:56.919 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:56.919 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:56.920 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:56.920 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:56.921 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:56.921 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:56.922 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:56.922 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.923 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:11:56.923 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:56.923 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:56.924 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:56.924 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:56.925 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:56.925 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:56.925 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:56.926 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:56.926 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:56.927 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:56.927 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:56.927 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:56.927 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:56.928 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:56.928 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:56.929 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:56.929 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:56.929 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:56.930 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:56.930 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:56.930 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:56.930 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:56.931 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:56.931 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:56.932 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:56.932 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:56.932 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.933 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:56.933 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:56.933 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:56.933 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:56.934 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:56.934 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:56.934 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:56.935 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:56.935 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:56.935 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:56.936 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:56.936 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:11:56.937 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:11:56.937 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.938 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:56.938 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:11:56.939 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.939 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.939 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.940 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:11:56.942 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:11:56.942 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:11:56.943 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:56.943 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:56.943 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:56.943 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:56.943 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:56.944 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:56.944 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:56.944 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:56.944 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:56.945 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:56.945 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:56.945 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:56.945 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:56.945 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:56.946 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:56.946 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:56.946 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:56.946 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:56.947 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:56.947 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:56.947 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.947 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:11:56.948 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:56.948 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:56.948 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:56.948 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:56.948 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:56.949 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:56.949 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:56.949 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:56.949 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:56.950 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:56.950 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:56.950 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:56.951 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:56.951 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:56.951 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:56.951 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:56.952 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:56.952 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:56.952 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:56.952 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:56.953 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:56.953 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:56.953 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:56.953 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:56.953 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:56.954 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:56.954 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.954 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:56.954 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:56.955 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:56.955 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:56.955 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:56.955 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:56.955 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:56.956 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:56.956 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:56.956 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:56.956 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:56.956 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:11:56.957 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:56.957 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:11:56.957 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.957 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.958 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.958 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 25, 2021-10-21T00:11:56.958 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:11:56.958 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:11:39.909885+0000", 2021-10-21T00:11:56.959 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:56.959 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:56.959 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:56.959 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:56.959 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:56.960 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:56.960 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:56.960 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:56.960 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:56.960 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:56.961 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:56.961 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:56.961 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:56.962 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:56.962 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:56.962 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:56.962 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:56.964 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:56.964 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:56.964 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:56.964 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "126", 2021-10-21T00:11:56.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:56.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:56.965 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:56.965 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:56.966 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:56.966 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:56.966 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:56.966 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:56.967 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:56.967 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:56.967 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:56.967 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:56.968 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:56.969 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:56.969 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:56.969 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:56.969 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:56.969 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:56.970 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:56.970 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:56.970 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:56.970 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:56.971 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.971 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:56.971 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:56.971 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:56.972 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:56.972 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:56.972 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:56.972 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:56.972 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:56.973 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:56.973 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:56.973 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:56.973 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:11:56.973 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:11:56.974 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:11:56.974 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:11:56.974 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.974 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:56.975 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:11:56.975 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:11:56.975 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.975 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.975 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.976 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.976 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 26, 2021-10-21T00:11:56.976 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:11:56.976 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:11:40.867103+0000", 2021-10-21T00:11:56.977 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:11:56.977 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:11:56.977 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:11:56.978 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:11:56.978 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:11:56.978 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:11:56.978 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:11:56.979 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:11:56.979 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:11:56.979 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:11:56.980 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:11:56.980 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:11:56.980 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:11:56.980 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:11:56.980 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:11:56.981 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:11:56.981 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:11:56.981 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:11:56.981 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:11:56.982 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:11:56.982 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.982 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "127", 2021-10-21T00:11:56.982 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:11:56.982 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:11:56.983 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:11:56.983 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:11:56.983 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:11:56.984 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:11:56.984 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:11:56.984 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:11:56.984 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:11:56.984 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:11:56.985 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:11:56.985 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:11:56.985 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:11:56.985 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:11:56.986 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:11:56.986 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:11:56.986 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:11:56.986 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:11:56.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:11:56.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:11:56.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:11:56.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:11:56.987 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:11:56.988 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:11:56.988 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:11:56.988 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:11:56.988 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.989 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:11:56.989 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:11:56.989 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:11:56.989 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:11:56.989 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:11:56.990 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:11:56.990 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:11:56.990 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:11:56.990 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:11:56.991 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:11:56.991 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:11:56.991 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:11:56.991 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:11:56.991 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:11:56.992 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:11:56.992 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.992 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.992 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:56.993 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:56.993 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:11:56.993 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.993 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:56.993 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:11:56.994 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:56.994 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:56.994 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:56.995 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:56.995 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:56.995 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:56.995 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:56.995 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:11:56.996 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:56.996 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:56.996 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:56.996 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:56.997 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.997 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:56.997 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:11:56.998 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:56.998 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:56.998 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:56.999 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:56.999 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:11:56.999 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:56.999 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.000 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.000 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.000 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.000 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.000 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.001 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.001 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:11:57.001 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.001 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.002 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.002 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.002 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:11:57.002 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.003 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.003 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.003 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.003 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.004 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.004 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.004 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.004 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:11:57.005 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.005 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.005 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.005 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.005 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:11:57.006 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.006 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.006 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.006 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.007 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.007 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.007 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.008 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.008 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:11:57.008 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.008 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.009 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.009 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.009 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:11:57.009 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:11:57.009 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.010 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.010 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.010 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:11:57.010 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:11:57.011 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:11:57.011 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:11:57.011 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.011 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.012 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.012 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.012 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.012 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.013 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:57.013 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:11:57.014 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.014 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.014 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.014 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.015 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.015 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.015 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.015 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:11:57.015 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.016 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.016 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.016 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.016 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.017 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.017 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:11:57.017 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.017 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.017 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.018 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.018 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:11:57.018 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.018 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.019 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.019 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.019 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.019 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.019 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.020 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.020 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:11:57.020 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.020 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.021 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.021 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.021 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:11:57.021 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.021 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.022 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.022 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.022 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.022 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.023 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.023 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.023 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:11:57.023 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.024 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.024 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.024 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.024 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:11:57.025 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.025 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.025 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.025 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.025 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.026 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.026 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.026 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.026 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:11:57.027 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.027 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.027 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.027 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.028 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:11:57.028 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:11:57.028 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.028 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.028 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.029 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:11:57.029 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:11:57.029 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:11:57.029 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:11:57.030 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.030 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.030 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.030 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.030 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.031 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.031 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:57.031 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:11:57.031 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.032 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.032 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.032 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.032 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.033 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.033 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.033 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:11:57.033 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.033 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.034 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.034 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.034 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.034 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.035 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:11:57.035 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.035 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.035 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.036 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.037 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:11:57.037 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.038 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.038 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.038 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.038 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.038 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.039 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.039 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.039 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:11:57.039 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.040 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.040 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.040 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.040 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:11:57.041 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.041 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.041 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.041 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.041 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.042 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.042 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.042 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.042 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:11:57.043 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.043 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.043 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.043 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.043 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:11:57.044 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.044 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.044 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.044 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.045 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.045 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.045 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.045 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.045 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:11:57.046 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.046 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.046 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.046 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.047 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:11:57.047 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:11:57.047 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.047 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.047 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.048 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:11:57.048 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:11:57.048 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:11:57.048 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:11:57.049 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.049 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.049 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.049 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.049 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.050 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.050 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:57.050 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:11:57.050 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.051 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.051 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.051 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.051 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.052 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.052 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.052 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:11:57.052 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.053 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.053 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.053 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.053 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.053 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.054 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:11:57.054 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.054 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.054 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.055 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.055 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:11:57.055 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.055 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.056 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.056 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.056 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.056 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.056 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.057 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.057 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:11:57.057 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.057 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.058 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.058 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.058 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:11:57.058 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.058 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.059 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.059 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.059 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.059 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.060 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.060 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.060 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:11:57.060 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.060 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.061 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.061 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.061 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:11:57.061 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.062 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.062 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.062 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.062 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.062 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.063 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.063 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.063 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:11:57.064 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.064 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.064 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.064 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.064 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:11:57.065 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:11:57.065 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.065 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.065 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.066 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:11:57.066 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:11:57.066 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:11:57.066 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:11:57.067 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.067 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.067 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.067 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.067 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.068 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.068 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:57.068 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:11:57.068 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.069 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.069 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.069 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.069 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.070 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.071 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.071 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.071 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.071 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.072 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:11:57.072 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.072 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.072 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.072 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.073 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:11:57.073 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.073 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.073 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.074 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.074 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.074 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.074 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.075 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.075 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:11:57.075 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.075 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.075 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.076 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.076 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:11:57.076 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.076 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.077 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.077 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.077 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.077 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.077 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.078 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.078 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:11:57.078 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.078 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.079 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.079 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.079 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:11:57.079 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.079 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.080 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.080 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.080 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.080 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.081 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.081 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.081 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:11:57.081 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.082 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.082 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.082 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.082 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:11:57.082 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:11:57.083 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.083 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.083 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.084 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:11:57.084 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:11:57.084 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:11:57.084 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:11:57.087 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.087 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.088 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.088 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.088 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.088 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.089 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:57.089 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:11:57.089 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.089 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.089 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.090 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.090 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.090 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.090 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.091 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:11:57.091 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.091 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.091 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.091 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.092 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.092 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.092 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:11:57.093 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.093 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.093 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.093 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.094 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:11:57.094 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.094 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.094 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.095 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.095 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.095 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.096 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.096 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.096 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:11:57.096 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.096 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.097 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.097 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.097 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:11:57.097 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.098 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.098 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.098 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.098 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.098 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.099 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.099 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.099 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:11:57.099 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.100 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.100 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.100 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.100 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:11:57.100 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.101 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.101 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.101 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.101 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.102 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.102 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.102 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.102 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:11:57.102 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.103 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.103 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.103 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.103 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:11:57.104 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:11:57.104 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.104 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.104 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.104 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:11:57.106 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:11:57.106 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:11:57.106 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:11:57.106 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.107 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.107 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.107 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.107 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.108 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.108 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:57.108 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:11:57.108 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.108 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.109 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.109 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.109 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.109 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.109 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.110 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:11:57.110 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.110 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.110 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.111 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.111 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.111 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.111 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:11:57.112 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.112 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.112 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.112 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.113 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:11:57.113 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.113 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.113 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.113 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.114 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.114 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.114 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.114 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.115 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:11:57.115 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.115 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.115 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.116 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.116 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:11:57.116 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.118 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.118 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.118 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.118 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.119 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.119 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.119 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.119 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:11:57.120 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.120 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.120 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.120 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.121 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:11:57.121 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.121 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.121 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.121 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.122 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.122 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.122 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.122 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.123 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:11:57.123 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.123 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.123 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.124 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.124 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:11:57.124 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:11:57.124 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.125 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.126 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.126 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:11:57.127 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:11:57.127 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:11:57.127 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:11:57.128 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.128 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.128 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.129 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.129 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.129 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.130 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:57.130 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:11:57.130 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:11:57.130 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:11:57.131 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:11:57.131 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:11:57.131 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:11:57.132 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:11:57.133 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:11:57.133 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:11:57.133 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:11:57.133 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:11:57.134 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:11:57.134 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.135 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.135 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.135 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:11:57.135 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.135 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.136 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.136 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.137 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:11:57.137 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.137 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.137 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.138 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.138 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:11:57.138 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.139 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.139 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.139 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:11:57.139 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.140 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.140 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.140 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.140 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:11:57.141 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.141 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.141 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.141 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.142 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:11:57.142 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.142 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.143 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.143 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:11:57.143 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.143 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.144 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.144 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.144 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:11:57.145 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.145 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.145 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.145 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.146 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:11:57.146 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:11:57.146 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.146 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:11:57.147 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:11:57.147 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.147 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.147 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.148 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:11:57.148 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:11:57.150 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:11:57.150 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.150 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.150 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.151 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:11:57.151 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:11:57.151 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:11:57.151 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:11:57.152 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:11:57.152 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:11:57.152 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:11:57.152 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:11:57.153 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.153 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:57.153 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:11:57.153 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.154 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:11:57.154 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.154 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.154 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.154 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.155 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.155 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:11:57.155 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.155 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.156 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.157 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:11:57.157 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.157 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.158 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.158 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.158 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.158 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:11:57.159 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.159 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.159 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.159 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:11:57.160 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.160 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.160 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.160 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.161 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.161 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:11:57.161 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.161 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.161 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.162 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:11:57.162 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.162 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.162 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.163 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.163 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.163 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:11:57.163 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.163 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.164 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.164 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:11:57.164 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.164 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.165 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.165 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.165 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.165 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:11:57.165 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.166 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.166 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.166 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:11:57.166 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.166 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.167 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.167 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.167 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.167 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:11:57.168 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.168 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.168 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.168 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:11:57.168 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.169 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.169 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.169 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.169 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.169 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:11:57.170 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.170 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.170 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:11:57.170 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:11:57.171 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:11:57.171 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:11:57.171 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:11:57.171 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:11:57.171 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:11:57.172 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:11:57.172 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:11:57.172 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.172 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:11:57.172 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:11:57.173 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:11:57.173 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:11:57.173 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:11:57.173 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:11:57.174 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:11:57.174 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:11:57.174 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:11:57.174 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:11:57.174 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:11:57.175 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:11:57.175 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:11:57.175 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:11:57.176 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:11:57.176 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:11:57.176 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:11:57.176 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:11:57.176 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:11:57.177 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:11:57.177 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:11:57.177 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:11:57.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.897+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 msgr2=0x7f862c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.897+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 0x7f862c055a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f8644019000 tx=0x7f8644016000).stop 2021-10-21T00:11:57.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 msgr2=0x7f864c0ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f863c001040 tx=0x7f863c007af0).stop 2021-10-21T00:11:57.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 shutdown_connections 2021-10-21T00:11:57.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f862c053580 0x7f862c055a40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f864c0b1fb0 0x7f864c0ac170 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f864c0af7a0 0x7f864c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 --2- 172.21.15.41:0/3744783797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f864c097830 0x7f864c0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 >> 172.21.15.41:0/3744783797 conn(0x7f864c0b58d0 msgr2=0x7f864c144f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:57.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 shutdown_connections 2021-10-21T00:11:57.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:56.901+0000 7f8650dd8700 1 -- 172.21.15.41:0/3744783797 wait complete. 2021-10-21T00:11:57.184 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:57.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 Processor -- start 2021-10-21T00:11:57.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- start start 2021-10-21T00:11:57.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7ea005cba0 0x7f7ea009ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea005cf80 con 0x7f7ea00b0f50 2021-10-21T00:11:57.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea0098490 con 0x7f7ea0097ff0 2021-10-21T00:11:57.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea0098f10 con 0x7f7ea005cba0 2021-10-21T00:11:57.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7ea005cba0 0x7f7ea009ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7ea005cba0 0x7f7ea009ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49680/0 (socket says 172.21.15.41:49680) 2021-10-21T00:11:57.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 -- 172.21.15.41:0/1588289979 learned_addr learned my addr 172.21.15.41:0/1588289979 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:57.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 -- 172.21.15.41:0/1588289979 >> v1:172.21.15.62:6789/0 conn(0x7f7ea0097ff0 legacy=0x7f7ea0099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 -- 172.21.15.41:0/1588289979 >> v1:172.21.15.41:6789/0 conn(0x7f7ea00b0f50 legacy=0x7f7ea013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 -- 172.21.15.41:0/1588289979 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00b0ab0 con 0x7f7ea005cba0 2021-10-21T00:11:57.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea57a5700 1 --2- 172.21.15.41:0/1588289979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea005cba0 0x7f7ea009ac50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f7ea00b0720 tx=0x7f7e9c006eb0).ready entity=mon.1 client_cookie=b53edb588e6c782f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7e8ffff700 1 -- 172.21.15.41:0/1588289979 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9c00d660 con 0x7f7ea005cba0 2021-10-21T00:11:57.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7e8ffff700 1 -- 172.21.15.41:0/1588289979 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c000e90 con 0x7f7ea005cba0 2021-10-21T00:11:57.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7e8ffff700 1 -- 172.21.15.41:0/1588289979 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9c00d9f0 con 0x7f7ea005cba0 2021-10-21T00:11:57.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- 172.21.15.41:0/1588289979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea005cba0 msgr2=0x7f7ea009ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/1588289979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea005cba0 0x7f7ea009ac50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f7ea00b0720 tx=0x7f7e9c006eb0).stop 2021-10-21T00:11:57.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- 172.21.15.41:0/1588289979 shutdown_connections 2021-10-21T00:11:57.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/1588289979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea005cba0 0x7f7ea009ac50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- 172.21.15.41:0/1588289979 >> 172.21.15.41:0/1588289979 conn(0x7f7ea005bd40 msgr2=0x7f7ea005c150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:57.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- 172.21.15.41:0/1588289979 shutdown_connections 2021-10-21T00:11:57.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.289+0000 7f7ea7a09700 1 -- 172.21.15.41:0/1588289979 wait complete. 2021-10-21T00:11:57.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 Processor -- start 2021-10-21T00:11:57.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- start start 2021-10-21T00:11:57.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 0x7f7ea0152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea00b0f50 0x7f7ea00ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0151ea0 con 0x7f7ea005cba0 2021-10-21T00:11:57.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0152090 con 0x7f7ea00b0f50 2021-10-21T00:11:57.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0152330 con 0x7f7ea0097ff0 2021-10-21T00:11:57.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37768/0 (socket says 172.21.15.41:37768) 2021-10-21T00:11:57.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 -- 172.21.15.41:0/3839283347 learned_addr learned my addr 172.21.15.41:0/3839283347 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:57.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea5fa6700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea00b0f50 0x7f7ea00ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea4fa4700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 0x7f7ea0152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 -- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 msgr2=0x7f7ea0152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 0x7f7ea0152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 -- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea00b0f50 msgr2=0x7f7ea00ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea00b0f50 0x7f7ea00ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 -- 172.21.15.41:0/3839283347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c00b1e0 con 0x7f7ea005cba0 2021-10-21T00:11:57.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea4fa4700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 0x7f7ea0152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:11:57.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea57a5700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f7ea00b0720 tx=0x7f7e9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9c011ab0 con 0x7f7ea005cba0 2021-10-21T00:11:57.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c011c10 con 0x7f7ea005cba0 2021-10-21T00:11:57.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea0152f60 con 0x7f7ea005cba0 2021-10-21T00:11:57.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e9c01d450 con 0x7f7ea005cba0 2021-10-21T00:11:57.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.293+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea0065710 con 0x7f7ea005cba0 2021-10-21T00:11:57.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea0098730 con 0x7f7ea005cba0 2021-10-21T00:11:57.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e9c024030 con 0x7f7ea005cba0 2021-10-21T00:11:57.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7e8e7fc700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 0x7f7e80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e9c06cdd0 con 0x7f7ea005cba0 2021-10-21T00:11:57.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7ea4fa4700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 0x7f7e80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.297+0000 7f7ea4fa4700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 0x7f7e80055b60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7e90008000 tx=0x7f7e90009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.305+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e9c043f30 con 0x7f7ea005cba0 2021-10-21T00:11:57.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.473+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ea0057350 con 0x7f7ea005cba0 2021-10-21T00:11:57.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.473+0000 7f7e8e7fc700 1 -- 172.21.15.41:0/3839283347 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f7e9c022070 con 0x7f7ea005cba0 2021-10-21T00:11:57.484 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:57.484 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:42.858043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/204327833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":204327833},{"type":"v1","addr":"172.21.15.41:6833","nonce":204327833}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:57.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 msgr2=0x7f7e80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 0x7f7e80055b60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f7e90008000 tx=0x7f7e90009040).stop 2021-10-21T00:11:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 msgr2=0x7f7ea0066b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f7ea00b0720 tx=0x7f7e9c015000).stop 2021-10-21T00:11:57.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 shutdown_connections 2021-10-21T00:11:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7e800536a0 0x7f7e80055b60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ea00b0f50 0x7f7ea00ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ea0097ff0 0x7f7ea0152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 --2- 172.21.15.41:0/3839283347 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7ea005cba0 0x7f7ea0066b70 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 >> 172.21.15.41:0/3839283347 conn(0x7f7ea005bd40 msgr2=0x7f7ea00b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 shutdown_connections 2021-10-21T00:11:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.477+0000 7f7ea7a09700 1 -- 172.21.15.41:0/3839283347 wait complete. 2021-10-21T00:11:57.489 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 66 2021-10-21T00:11:57.500 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:11:57.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.597+0000 7fc8c7d5a700 1 Processor -- start 2021-10-21T00:11:57.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.597+0000 7fc8c7d5a700 1 -- start start 2021-10-21T00:11:57.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 0x7fc8c005cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c0060950 con 0x7fc8c005c860 2021-10-21T00:11:57.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c0060b80 con 0x7fc8c014aea0 2021-10-21T00:11:57.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00afb00 con 0x7fc8c00af270 2021-10-21T00:11:57.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c5af6700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fc8c005c860 0x7fc8c01465d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35546/0 (socket says 172.21.15.41:35546) 2021-10-21T00:11:57.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c5af6700 1 -- 172.21.15.41:0/3932379504 learned_addr learned my addr 172.21.15.41:0/3932379504 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:57.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c62f7700 1 --2- 172.21.15.41:0/3932379504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 0x7fc8c005cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937604640 0 0) 0x7fc8c0060950 con 0x7fc8c005c860 2021-10-21T00:11:57.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a8003260 con 0x7fc8c005c860 2021-10-21T00:11:57.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655676549 0 0) 0x7fc8c0060b80 con 0x7fc8c014aea0 2021-10-21T00:11:57.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c0060950 con 0x7fc8c014aea0 2021-10-21T00:11:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799084271 0 0) 0x7fc8a8003260 con 0x7fc8c005c860 2021-10-21T00:11:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c62f7700 1 -- 172.21.15.41:0/3932379504 >> v1:172.21.15.62:6789/0 conn(0x7fc8c014aea0 legacy=0x7fc8c00b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c62f7700 1 -- 172.21.15.41:0/3932379504 >> v1:172.21.15.41:6789/0 conn(0x7fc8c005c860 legacy=0x7fc8c01465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c62f7700 1 -- 172.21.15.41:0/3932379504 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c014b3a0 con 0x7fc8c00af270 2021-10-21T00:11:57.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c62f7700 1 --2- 172.21.15.41:0/3932379504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 0x7fc8c005cc40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc8b0001110 tx=0x7fc8b8006df0).ready entity=mon.2 client_cookie=de8dec4b74f46519 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b0001660 con 0x7fc8c00af270 2021-10-21T00:11:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8000e90 con 0x7fc8c00af270 2021-10-21T00:11:57.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c4af4700 1 -- 172.21.15.41:0/3932379504 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b8011400 con 0x7fc8c00af270 2021-10-21T00:11:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/3932379504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 msgr2=0x7fc8c005cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/3932379504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 0x7fc8c005cc40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc8b0001110 tx=0x7fc8b8006df0).stop 2021-10-21T00:11:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/3932379504 shutdown_connections 2021-10-21T00:11:57.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/3932379504 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c00af270 0x7fc8c005cc40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/3932379504 >> 172.21.15.41:0/3932379504 conn(0x7fc8c005bd40 msgr2=0x7fc8c005c150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/3932379504 shutdown_connections 2021-10-21T00:11:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.601+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/3932379504 wait complete. 2021-10-21T00:11:57.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.605+0000 7fc8c7d5a700 1 Processor -- start 2021-10-21T00:11:57.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.605+0000 7fc8c7d5a700 1 -- start start 2021-10-21T00:11:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c005c860 0x7fc8c0063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00af270 0x7fc8c00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00aedd0 con 0x7fc8c014aea0 2021-10-21T00:11:57.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0065800 con 0x7fc8c00af270 2021-10-21T00:11:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0064e20 con 0x7fc8c005c860 2021-10-21T00:11:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37786/0 (socket says 172.21.15.41:37786) 2021-10-21T00:11:57.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 -- 172.21.15.41:0/2293990093 learned_addr learned my addr 172.21.15.41:0/2293990093 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c5af6700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c005c860 0x7fc8c0063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c52f5700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00af270 0x7fc8c00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 -- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c005c860 msgr2=0x7fc8c0063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c005c860 0x7fc8c0063940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 -- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00af270 msgr2=0x7fc8c00ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:57.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00af270 0x7fc8c00ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:57.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 -- 172.21.15.41:0/2293990093 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b800b180 con 0x7fc8c014aea0 2021-10-21T00:11:57.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c62f7700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fc8b0001110 tx=0x7fc8c0060190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b8015070 con 0x7fc8c014aea0 2021-10-21T00:11:57.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c00650c0 con 0x7fc8c014aea0 2021-10-21T00:11:57.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800d5e0 con 0x7fc8c014aea0 2021-10-21T00:11:57.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c00649f0 con 0x7fc8c014aea0 2021-10-21T00:11:57.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8b800d940 con 0x7fc8c014aea0 2021-10-21T00:11:57.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c0057350 con 0x7fc8c014aea0 2021-10-21T00:11:57.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.609+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc8b8024030 con 0x7fc8c014aea0 2021-10-21T00:11:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.613+0000 7fc8aeffd700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 0x7fc8a0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.613+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc8b806c3a0 con 0x7fc8c014aea0 2021-10-21T00:11:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.613+0000 7fc8c5af6700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 0x7fc8a0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:57.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.613+0000 7fc8c5af6700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 0x7fc8a0055a40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fc8b000d000 tx=0x7fc8b0000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:57.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.617+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc8b8069e90 con 0x7fc8c014aea0 2021-10-21T00:11:57.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:57.777+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc8c005da10 con 0x7fc8c014aea0 2021-10-21T00:11:58.361 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:11:58.353+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:11:58.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.365+0000 7fc8aeffd700 1 -- 172.21.15.41:0/2293990093 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc8b8022070 con 0x7fc8c014aea0 2021-10-21T00:11:58.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 msgr2=0x7fc8a0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 0x7fc8a0055a40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fc8b000d000 tx=0x7fc8b0000bc0).stop 2021-10-21T00:11:58.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 msgr2=0x7fc8c00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fc8b0001110 tx=0x7fc8c0060190).stop 2021-10-21T00:11:58.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 shutdown_connections 2021-10-21T00:11:58.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc8a0053580 0x7fc8a0055a40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc8c014aea0 0x7fc8c00ae8e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8c00af270 0x7fc8c00ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 --2- 172.21.15.41:0/2293990093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8c005c860 0x7fc8c0063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 >> 172.21.15.41:0/2293990093 conn(0x7fc8c005bd40 msgr2=0x7fc8c00b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:58.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 shutdown_connections 2021-10-21T00:11:58.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.369+0000 7fc8c7d5a700 1 -- 172.21.15.41:0/2293990093 wait complete. 2021-10-21T00:11:58.383 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:11:58.394 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:11:58.409 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:11:58.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 Processor -- start 2021-10-21T00:11:58.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 -- start start 2021-10-21T00:11:58.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb63005c080 0x7fb630146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb630143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63005d050 con 0x7fb6300986f0 2021-10-21T00:11:58.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63005c460 con 0x7fb63005c080 2021-10-21T00:11:58.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630142e80 con 0x7fb6301435c0 2021-10-21T00:11:58.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62e7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb6300986f0 0x7fb6300b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35576/0 (socket says 172.21.15.41:35576) 2021-10-21T00:11:58.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62e7fc700 1 -- 172.21.15.41:0/1674033135 learned_addr learned my addr 172.21.15.41:0/1674033135 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:58.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62effd700 1 --2- 172.21.15.41:0/1674033135 >> v2:172.21.15.62:3300/0 conn(0x7fb63005c080 0x7fb630146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62f7fe700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb630143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.489+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434767410 0 0) 0x7fb63005d050 con 0x7fb6300986f0 2021-10-21T00:11:58.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb610003260 con 0x7fb6300986f0 2021-10-21T00:11:58.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62effd700 1 -- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 msgr2=0x7fb630143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:58.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62effd700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb630143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239963903 0 0) 0x7fb610003260 con 0x7fb6300986f0 2021-10-21T00:11:58.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62effd700 1 -- 172.21.15.41:0/1674033135 >> v1:172.21.15.41:6789/0 conn(0x7fb6300986f0 legacy=0x7fb6300b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62effd700 1 -- 172.21.15.41:0/1674033135 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630143120 con 0x7fb63005c080 2021-10-21T00:11:58.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62f7fe700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb630143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:58.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62effd700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63005c080 0x7fb630146bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fb620001b80 tx=0x7fb618006df0).ready entity=mon.1 client_cookie=ab52ae6055248652 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6200019e0 con 0x7fb63005c080 2021-10-21T00:11:58.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618000e90 con 0x7fb63005c080 2021-10-21T00:11:58.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62dffb700 1 -- 172.21.15.41:0/1674033135 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb618012460 con 0x7fb63005c080 2021-10-21T00:11:58.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63005c080 msgr2=0x7fb630146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63005c080 0x7fb630146bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fb620001b80 tx=0x7fb618006df0).stop 2021-10-21T00:11:58.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- 172.21.15.41:0/1674033135 shutdown_connections 2021-10-21T00:11:58.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb630143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1674033135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63005c080 0x7fb630146bb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- 172.21.15.41:0/1674033135 >> 172.21.15.41:0/1674033135 conn(0x7fb6300b9220 msgr2=0x7fb6300b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:58.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- 172.21.15.41:0/1674033135 shutdown_connections 2021-10-21T00:11:58.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- 172.21.15.41:0/1674033135 wait complete. 2021-10-21T00:11:58.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 Processor -- start 2021-10-21T00:11:58.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.493+0000 7fb62ffff700 1 -- start start 2021-10-21T00:11:58.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 0x7fb6301521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb63009ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63009db40 con 0x7fb63005c080 2021-10-21T00:11:58.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630152890 con 0x7fb6300986f0 2021-10-21T00:11:58.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630152b30 con 0x7fb6301435c0 2021-10-21T00:11:58.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37808/0 (socket says 172.21.15.41:37808) 2021-10-21T00:11:58.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 -- 172.21.15.41:0/1017433745 learned_addr learned my addr 172.21.15.41:0/1017433745 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:58.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62e7fc700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 0x7fb6301521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62f7fe700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb63009ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 -- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 msgr2=0x7fb63009ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb63009ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 -- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 msgr2=0x7fb6301521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 0x7fb6301521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 -- 172.21.15.41:0/1017433745 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62800b180 con 0x7fb63005c080 2021-10-21T00:11:58.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62e7fc700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 0x7fb6301521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:11:58.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62effd700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fb620001b80 tx=0x7fb618014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb618016030 con 0x7fb63005c080 2021-10-21T00:11:58.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618013e40 con 0x7fb63005c080 2021-10-21T00:11:58.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61800b180 con 0x7fb63005c080 2021-10-21T00:11:58.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61800de60 con 0x7fb63005c080 2021-10-21T00:11:58.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6300ad110 con 0x7fb63005c080 2021-10-21T00:11:58.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.497+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6301526e0 con 0x7fb63005c080 2021-10-21T00:11:58.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.501+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb618024020 con 0x7fb63005c080 2021-10-21T00:11:58.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.501+0000 7fb627fff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 0x7fb6140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.501+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb618017070 con 0x7fb63005c080 2021-10-21T00:11:58.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.501+0000 7fb62e7fc700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 0x7fb6140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.501+0000 7fb62e7fc700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 0x7fb6140559b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb62000b000 tx=0x7fb620009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.505+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb618043ae0 con 0x7fb63005c080 2021-10-21T00:11:58.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6300ad500 con 0x7fb63005c080 2021-10-21T00:11:58.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb627fff700 1 -- 172.21.15.41:0/1017433745 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fb618047100 con 0x7fb63005c080 2021-10-21T00:11:58.677 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:11:58.677 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:11:41.854126+0000","modified":"2021-10-21T00:11:58.356608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":128,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-10-21T00:11:58.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 msgr2=0x7fb6140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 0x7fb6140559b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fb62000b000 tx=0x7fb620009040).stop 2021-10-21T00:11:58.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 msgr2=0x7fb630151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fb620001b80 tx=0x7fb618014000).stop 2021-10-21T00:11:58.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 shutdown_connections 2021-10-21T00:11:58.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb6140534f0 0x7fb6140559b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb6301435c0 0x7fb63009ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6300986f0 0x7fb6301521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 --2- 172.21.15.41:0/1017433745 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb63005c080 0x7fb630151d00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 >> 172.21.15.41:0/1017433745 conn(0x7fb6300b9220 msgr2=0x7fb6300b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:58.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 shutdown_connections 2021-10-21T00:11:58.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.669+0000 7fb62ffff700 1 -- 172.21.15.41:0/1017433745 wait complete. 2021-10-21T00:11:58.682 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 67 2021-10-21T00:11:58.690 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:11:58.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 Processor -- start 2021-10-21T00:11:58.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- start start 2021-10-21T00:11:58.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0da80b1fb0 0x7f0da80b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da8097830 0x7f0da814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da81473c0 con 0x7f0da80af7a0 2021-10-21T00:11:58.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da814a670 con 0x7f0da80b1fb0 2021-10-21T00:11:58.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da814a910 con 0x7f0da8097830 2021-10-21T00:11:58.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0da80b1fb0 0x7f0da80b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dad3a8700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f0da80af7a0 0x7f0da80afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35590/0 (socket says 172.21.15.41:35590) 2021-10-21T00:11:58.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dad3a8700 1 -- 172.21.15.41:0/3032364111 learned_addr learned my addr 172.21.15.41:0/3032364111 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:58.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0d9ffff700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da8097830 0x7f0da814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0d9f7fe700 1 -- 172.21.15.41:0/3032364111 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791724998 0 0) 0x7f0da81473c0 con 0x7f0da80af7a0 2021-10-21T00:11:58.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 -- 172.21.15.41:0/3032364111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da8097830 msgr2=0x7f0da814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:58.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da8097830 0x7f0da814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 -- 172.21.15.41:0/3032364111 >> v1:172.21.15.41:6789/0 conn(0x7f0da80af7a0 legacy=0x7f0da80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 -- 172.21.15.41:0/3032364111 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da80b02e0 con 0x7f0da80b1fb0 2021-10-21T00:11:58.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dacba7700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da80b1fb0 0x7f0da80b2390 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f0da4002f70 tx=0x7f0da4006df0).ready entity=mon.0 client_cookie=9143a36f9a31ad47 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0d9f7fe700 1 -- 172.21.15.41:0/3032364111 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da400d570 con 0x7f0da80b1fb0 2021-10-21T00:11:58.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0d9f7fe700 1 -- 172.21.15.41:0/3032364111 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da4000e90 con 0x7f0da80b1fb0 2021-10-21T00:11:58.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0d9f7fe700 1 -- 172.21.15.41:0/3032364111 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da400d8c0 con 0x7f0da80b1fb0 2021-10-21T00:11:58.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- 172.21.15.41:0/3032364111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da80b1fb0 msgr2=0x7f0da80b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da80b1fb0 0x7f0da80b2390 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f0da4002f70 tx=0x7f0da4006df0).stop 2021-10-21T00:11:58.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- 172.21.15.41:0/3032364111 shutdown_connections 2021-10-21T00:11:58.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da8097830 0x7f0da814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 --2- 172.21.15.41:0/3032364111 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da80b1fb0 0x7f0da80b2390 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- 172.21.15.41:0/3032364111 >> 172.21.15.41:0/3032364111 conn(0x7f0da80b58d0 msgr2=0x7f0da80b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:58.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- 172.21.15.41:0/3032364111 shutdown_connections 2021-10-21T00:11:58.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.789+0000 7f0dadba9700 1 -- 172.21.15.41:0/3032364111 wait complete. 2021-10-21T00:11:58.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 Processor -- start 2021-10-21T00:11:58.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- start start 2021-10-21T00:11:58.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da80af7a0 0x7f0da80aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0da80b1fb0 0x7f0da8144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8156460 con 0x7f0da8097830 2021-10-21T00:11:58.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8098cd0 con 0x7f0da80b1fb0 2021-10-21T00:11:58.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80677b0 con 0x7f0da80af7a0 2021-10-21T00:11:58.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37822/0 (socket says 172.21.15.41:37822) 2021-10-21T00:11:58.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 -- 172.21.15.41:0/1164599092 learned_addr learned my addr 172.21.15.41:0/1164599092 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:58.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dad3a8700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0da80b1fb0 0x7f0da8144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0d9ffff700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da80af7a0 0x7f0da80aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 -- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da80af7a0 msgr2=0x7f0da80aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da80af7a0 0x7f0da80aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 -- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0da80b1fb0 msgr2=0x7f0da8144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:58.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0da80b1fb0 0x7f0da8144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:58.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 -- 172.21.15.41:0/1164599092 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da400b180 con 0x7f0da8097830 2021-10-21T00:11:58.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dacba7700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f0da4002f70 tx=0x7f0da4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4016070 con 0x7f0da8097830 2021-10-21T00:11:58.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40139c0 con 0x7f0da8097830 2021-10-21T00:11:58.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80a93a0 con 0x7f0da8097830 2021-10-21T00:11:58.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0da4013d20 con 0x7f0da8097830 2021-10-21T00:11:58.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.793+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da8144f30 con 0x7f0da8097830 2021-10-21T00:11:58.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da8067970 con 0x7f0da8097830 2021-10-21T00:11:58.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0da400f030 con 0x7f0da8097830 2021-10-21T00:11:58.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0d9dffb700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 0x7f0d88055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:58.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0da406c620 con 0x7f0da8097830 2021-10-21T00:11:58.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0d9ffff700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 0x7f0d88055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:58.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.797+0000 7f0d9ffff700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 0x7f0d88055a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f0d9800b000 tx=0x7f0d98006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:58.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.801+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0da4043710 con 0x7f0da8097830 2021-10-21T00:11:58.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:58.965+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0da81454c0 con 0x7f0da8097830 2021-10-21T00:11:59.088 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:59.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:59.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:59.098 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:59.100 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:11:59.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.373+0000 7f0d9dffb700 1 -- 172.21.15.41:0/1164599092 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0da4046cb0 con 0x7f0da8097830 2021-10-21T00:11:59.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 msgr2=0x7f0d88055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 0x7f0d88055a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f0d9800b000 tx=0x7f0d98006df0).stop 2021-10-21T00:11:59.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 msgr2=0x7f0da80aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f0da4002f70 tx=0x7f0da4014000).stop 2021-10-21T00:11:59.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 shutdown_connections 2021-10-21T00:11:59.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0d88053580 0x7f0d88055a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0da80b1fb0 0x7f0da8144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0da80af7a0 0x7f0da80aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 --2- 172.21.15.41:0/1164599092 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0da8097830 0x7f0da80aa030 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 >> 172.21.15.41:0/1164599092 conn(0x7f0da80b58d0 msgr2=0x7f0da80afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:59.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 shutdown_connections 2021-10-21T00:11:59.390 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.377+0000 7f0dadba9700 1 -- 172.21.15.41:0/1164599092 wait complete. 2021-10-21T00:11:59.403 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:11:59.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.509+0000 7f41db59e700 1 Processor -- start 2021-10-21T00:11:59.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.509+0000 7f41db59e700 1 -- start start 2021-10-21T00:11:59.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 0x7f41dc0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 0x7f41dc146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc146150 con 0x7f41dc0b3cc0 2021-10-21T00:11:59.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0b0110 con 0x7f41dc067300 2021-10-21T00:11:59.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc067720 con 0x7f41dc060d60 2021-10-21T00:11:59.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41dad9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f41dc0b3cc0 0x7f41dc0b4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35602/0 (socket says 172.21.15.41:35602) 2021-10-21T00:11:59.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41dad9d700 1 -- 172.21.15.41:0/2357297856 learned_addr learned my addr 172.21.15.41:0/2357297856 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:11:59.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d9d9b700 1 --2- 172.21.15.41:0/2357297856 >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 0x7f41dc146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 --2- 172.21.15.41:0/2357297856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 0x7f41dc0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.524 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d959a700 1 -- 172.21.15.41:0/2357297856 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875287735 0 0) 0x7f41dc146150 con 0x7f41dc0b3cc0 2021-10-21T00:11:59.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d959a700 1 -- 172.21.15.41:0/2357297856 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41bc003260 con 0x7f41dc0b3cc0 2021-10-21T00:11:59.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 -- 172.21.15.41:0/2357297856 >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 msgr2=0x7f41dc146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:11:59.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 --2- 172.21.15.41:0/2357297856 >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 0x7f41dc146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 -- 172.21.15.41:0/2357297856 >> v1:172.21.15.41:6789/0 conn(0x7f41dc0b3cc0 legacy=0x7f41dc0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 -- 172.21.15.41:0/2357297856 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc146380 con 0x7f41dc060d60 2021-10-21T00:11:59.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d9d9b700 1 --2- 172.21.15.41:0/2357297856 >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 0x7f41dc146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:11:59.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41da59c700 1 --2- 172.21.15.41:0/2357297856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 0x7f41dc0aee60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4006df0).ready entity=mon.2 client_cookie=a332c621a8131ec6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:59.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d959a700 1 -- 172.21.15.41:0/2357297856 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400d4a0 con 0x7f41dc060d60 2021-10-21T00:11:59.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d959a700 1 -- 172.21.15.41:0/2357297856 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4000e90 con 0x7f41dc060d60 2021-10-21T00:11:59.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41d959a700 1 -- 172.21.15.41:0/2357297856 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400d7f0 con 0x7f41dc060d60 2021-10-21T00:11:59.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- 172.21.15.41:0/2357297856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 msgr2=0x7f41dc0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 --2- 172.21.15.41:0/2357297856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 0x7f41dc0aee60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4006df0).stop 2021-10-21T00:11:59.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- 172.21.15.41:0/2357297856 shutdown_connections 2021-10-21T00:11:59.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 --2- 172.21.15.41:0/2357297856 >> v2:172.21.15.41:3300/0 conn(0x7f41dc067300 0x7f41dc146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 --2- 172.21.15.41:0/2357297856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc060d60 0x7f41dc0aee60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- 172.21.15.41:0/2357297856 >> 172.21.15.41:0/2357297856 conn(0x7f41dc0b6720 msgr2=0x7f41dc0604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:11:59.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- 172.21.15.41:0/2357297856 shutdown_connections 2021-10-21T00:11:59.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.513+0000 7f41db59e700 1 -- 172.21.15.41:0/2357297856 wait complete. 2021-10-21T00:11:59.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 Processor -- start 2021-10-21T00:11:59.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- start start 2021-10-21T00:11:59.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc067300 0x7f41dc1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41dc0b3cc0 0x7f41dc099570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc09f0b0 con 0x7f41dc060d60 2021-10-21T00:11:59.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc099140 con 0x7f41dc0b3cc0 2021-10-21T00:11:59.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc09e990 con 0x7f41dc067300 2021-10-21T00:11:59.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37834/0 (socket says 172.21.15.41:37834) 2021-10-21T00:11:59.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 -- 172.21.15.41:0/3657817032 learned_addr learned my addr 172.21.15.41:0/3657817032 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:11:59.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41d9d9b700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc067300 0x7f41dc1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41dad9d700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41dc0b3cc0 0x7f41dc099570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 -- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc067300 msgr2=0x7f41dc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc067300 0x7f41dc1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 -- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41dc0b3cc0 msgr2=0x7f41dc099570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:11:59.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41dc0b3cc0 0x7f41dc099570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:11:59.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 -- 172.21.15.41:0/3657817032 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc00b180 con 0x7f41dc060d60 2021-10-21T00:11:59.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41da59c700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:59.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c4012930 con 0x7f41dc060d60 2021-10-21T00:11:59.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4012a90 con 0x7f41dc060d60 2021-10-21T00:11:59.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c400b180 con 0x7f41dc060d60 2021-10-21T00:11:59.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c4012df0 con 0x7f41dc060d60 2021-10-21T00:11:59.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.517+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc09d9d0 con 0x7f41dc060d60 2021-10-21T00:11:59.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc09c550 con 0x7f41dc060d60 2021-10-21T00:11:59.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f41c401c070 con 0x7f41dc060d60 2021-10-21T00:11:59.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41d37fe700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 0x7f41c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:11:59.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f41c406c610 con 0x7f41dc060d60 2021-10-21T00:11:59.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41d9d9b700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 0x7f41c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:11:59.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.521+0000 7f41d9d9b700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 0x7f41c0055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f41cc00b000 tx=0x7f41cc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:11:59.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.525+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41c4043650 con 0x7f41dc060d60 2021-10-21T00:11:59.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:11:59.649+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f41dc057350 con 0x7f41dc060d60 2021-10-21T00:12:00.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.377+0000 7f41d37fe700 1 -- 172.21.15.41:0/3657817032 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 185+0+0 (secure 0 0 0) 0x7f41c4019070 con 0x7f41dc060d60 2021-10-21T00:12:00.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.381+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 msgr2=0x7f41c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.381+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 0x7f41c0055b60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f41cc00b000 tx=0x7f41cc006df0).stop 2021-10-21T00:12:00.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.381+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 msgr2=0x7f41dc1453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.381+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4014000).stop 2021-10-21T00:12:00.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 shutdown_connections 2021-10-21T00:12:00.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f41c00536a0 0x7f41c0055b60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41dc0b3cc0 0x7f41dc099570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.393 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41dc067300 0x7f41dc1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 --2- 172.21.15.41:0/3657817032 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f41dc060d60 0x7f41dc1453b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 >> 172.21.15.41:0/3657817032 conn(0x7f41dc0b6720 msgr2=0x7f41dc1441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:00.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 shutdown_connections 2021-10-21T00:12:00.394 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.385+0000 7f41db59e700 1 -- 172.21.15.41:0/3657817032 wait complete. 2021-10-21T00:12:00.395 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:12:00.406 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:12:00.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 Processor -- start 2021-10-21T00:12:00.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 -- start start 2021-10-21T00:12:00.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26c813f440 0x7f26c8142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f26c80b2410 0x7f26c8143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c80ab830 con 0x7f26c80b2dc0 2021-10-21T00:12:00.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80aae50 con 0x7f26c80b2410 2021-10-21T00:12:00.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.517+0000 7f26c7fff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c80ab0f0 con 0x7f26c813f440 2021-10-21T00:12:00.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c6ffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f26c80b2dc0 0x7f26c813ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35612/0 (socket says 172.21.15.41:35612) 2021-10-21T00:12:00.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c6ffd700 1 -- 172.21.15.41:0/411656443 learned_addr learned my addr 172.21.15.41:0/411656443 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:00.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 --2- 172.21.15.41:0/411656443 >> v2:172.21.15.41:3300/0 conn(0x7f26c80b2410 0x7f26c8143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c67fc700 1 --2- 172.21.15.41:0/411656443 >> v2:172.21.15.62:3300/0 conn(0x7f26c813f440 0x7f26c8142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c5ffb700 1 -- 172.21.15.41:0/411656443 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474178674 0 0) 0x7f26c80ab830 con 0x7f26c80b2dc0 2021-10-21T00:12:00.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c5ffb700 1 -- 172.21.15.41:0/411656443 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a8003260 con 0x7f26c80b2dc0 2021-10-21T00:12:00.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 -- 172.21.15.41:0/411656443 >> v2:172.21.15.62:3300/0 conn(0x7f26c813f440 msgr2=0x7f26c8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:00.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 --2- 172.21.15.41:0/411656443 >> v2:172.21.15.62:3300/0 conn(0x7f26c813f440 0x7f26c8142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 -- 172.21.15.41:0/411656443 >> v1:172.21.15.41:6789/0 conn(0x7f26c80b2dc0 legacy=0x7f26c813ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 -- 172.21.15.41:0/411656443 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80ab390 con 0x7f26c80b2410 2021-10-21T00:12:00.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c77fe700 1 --2- 172.21.15.41:0/411656443 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c8143210 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f26b80032f0 tx=0x7f26b80091d0).ready entity=mon.0 client_cookie=bc3892f55b90e9b9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:00.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c5ffb700 1 -- 172.21.15.41:0/411656443 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b800b600 con 0x7f26c80b2410 2021-10-21T00:12:00.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c5ffb700 1 -- 172.21.15.41:0/411656443 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b760 con 0x7f26c80b2410 2021-10-21T00:12:00.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c5ffb700 1 -- 172.21.15.41:0/411656443 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26b800b8d0 con 0x7f26c80b2410 2021-10-21T00:12:00.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- 172.21.15.41:0/411656443 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 msgr2=0x7f26c8143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 --2- 172.21.15.41:0/411656443 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c8143210 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f26b80032f0 tx=0x7f26b80091d0).stop 2021-10-21T00:12:00.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- 172.21.15.41:0/411656443 shutdown_connections 2021-10-21T00:12:00.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 --2- 172.21.15.41:0/411656443 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c8143210 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 --2- 172.21.15.41:0/411656443 >> v2:172.21.15.62:3300/0 conn(0x7f26c813f440 0x7f26c8142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- 172.21.15.41:0/411656443 >> 172.21.15.41:0/411656443 conn(0x7f26c805f6b0 msgr2=0x7f26c805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:00.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- 172.21.15.41:0/411656443 shutdown_connections 2021-10-21T00:12:00.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- 172.21.15.41:0/411656443 wait complete. 2021-10-21T00:12:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 Processor -- start 2021-10-21T00:12:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.521+0000 7f26c7fff700 1 -- start start 2021-10-21T00:12:00.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26c80b2dc0 0x7f26c8151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26c813f440 0x7f26c8152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8152e60 con 0x7f26c80b2410 2021-10-21T00:12:00.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8065000 con 0x7f26c80b2dc0 2021-10-21T00:12:00.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c809a610 con 0x7f26c813f440 2021-10-21T00:12:00.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37848/0 (socket says 172.21.15.41:37848) 2021-10-21T00:12:00.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 -- 172.21.15.41:0/958268269 learned_addr learned my addr 172.21.15.41:0/958268269 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:00.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c67fc700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26c80b2dc0 0x7f26c8151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c77fe700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26c813f440 0x7f26c8152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 -- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26c813f440 msgr2=0x7f26c8152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26c813f440 0x7f26c8152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 -- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26c80b2dc0 msgr2=0x7f26c8151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:00.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26c80b2dc0 0x7f26c8151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:00.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 -- 172.21.15.41:0/958268269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009470 con 0x7f26c80b2410 2021-10-21T00:12:00.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c6ffd700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f26c0001110 tx=0x7f26c0007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:00.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c000ce80 con 0x7f26c80b2410 2021-10-21T00:12:00.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00070d0 con 0x7f26c80b2410 2021-10-21T00:12:00.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c8064d60 con 0x7f26c80b2410 2021-10-21T00:12:00.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26c0007430 con 0x7f26c80b2410 2021-10-21T00:12:00.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c80b4290 con 0x7f26c80b2410 2021-10-21T00:12:00.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c8152850 con 0x7f26c80b2410 2021-10-21T00:12:00.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.525+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f26c0010070 con 0x7f26c80b2410 2021-10-21T00:12:00.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.529+0000 7f26bffff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 0x7f26ac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:00.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.529+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f26c006ad00 con 0x7f26c80b2410 2021-10-21T00:12:00.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.529+0000 7f26c67fc700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 0x7f26ac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:00.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.529+0000 7f26c67fc700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 0x7f26ac055b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f26b000b000 tx=0x7f26b0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:00.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.533+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f26c006e030 con 0x7f26c80b2410 2021-10-21T00:12:00.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:00.661+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26c8152b70 con 0x7f26c80b2410 2021-10-21T00:12:01.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.393+0000 7f26bffff700 1 -- 172.21.15.41:0/958268269 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 173+0+0 (secure 0 0 0) 0x7f26c0041fc0 con 0x7f26c80b2410 2021-10-21T00:12:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 msgr2=0x7f26ac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 0x7f26ac055b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f26b000b000 tx=0x7f26b0006df0).stop 2021-10-21T00:12:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 msgr2=0x7f26c80643d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f26c0001110 tx=0x7f26c0007aa0).stop 2021-10-21T00:12:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 shutdown_connections 2021-10-21T00:12:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f26ac053640 0x7f26ac055b00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f26c813f440 0x7f26c8152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26c80b2dc0 0x7f26c8151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 --2- 172.21.15.41:0/958268269 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f26c80b2410 0x7f26c80643d0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 >> 172.21.15.41:0/958268269 conn(0x7f26c805f6b0 msgr2=0x7f26c809b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 shutdown_connections 2021-10-21T00:12:01.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.397+0000 7f26c7fff700 1 -- 172.21.15.41:0/958268269 wait complete. 2021-10-21T00:12:01.408 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:12:01.422 DEBUG:teuthology.orchestra.run.smithi041:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:12:01.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:12:01.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:12:01.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:12:01.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-10-21T00:12:01.457 INFO:teuthology.orchestra.run.smithi041.stdout:[global] 2021-10-21T00:12:01.458 INFO:teuthology.orchestra.run.smithi041.stdout: chdir = "" 2021-10-21T00:12:01.458 INFO:teuthology.orchestra.run.smithi041.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:12:01.459 INFO:teuthology.orchestra.run.smithi041.stdout: auth supported = cephx 2021-10-21T00:12:01.459 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.459 INFO:teuthology.orchestra.run.smithi041.stdout: filestore xattr use omap = true 2021-10-21T00:12:01.459 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.459 INFO:teuthology.orchestra.run.smithi041.stdout: mon clock drift allowed = 1.000 2021-10-21T00:12:01.460 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.462 INFO:teuthology.orchestra.run.smithi041.stdout: osd crush chooseleaf type = 0 2021-10-21T00:12:01.462 INFO:teuthology.orchestra.run.smithi041.stdout: auth debug = true 2021-10-21T00:12:01.463 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.463 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on old message = true 2021-10-21T00:12:01.463 INFO:teuthology.orchestra.run.smithi041.stdout: ms die on bug = true 2021-10-21T00:12:01.463 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.464 INFO:teuthology.orchestra.run.smithi041.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:12:01.465 INFO:teuthology.orchestra.run.smithi041.stdout: mon pg warn max object skew = 0 2021-10-21T00:12:01.465 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.465 INFO:teuthology.orchestra.run.smithi041.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:12:01.465 INFO:teuthology.orchestra.run.smithi041.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:12:01.466 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.466 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default size = 2 2021-10-21T00:12:01.466 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.466 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow primary affinity = true 2021-10-21T00:12:01.467 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd allow pg remap = true 2021-10-21T00:12:01.467 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:12:01.467 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:12:01.467 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on no sortbitwise = false 2021-10-21T00:12:01.467 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:12:01.468 INFO:teuthology.orchestra.run.smithi041.stdout: mon warn on too few osds = false 2021-10-21T00:12:01.468 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:12:01.468 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:12:01.468 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.469 INFO:teuthology.orchestra.run.smithi041.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:12:01.469 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.469 INFO:teuthology.orchestra.run.smithi041.stdout: osd default data pool replay window = 5 2021-10-21T00:12:01.469 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.469 INFO:teuthology.orchestra.run.smithi041.stdout: mon allow pool delete = true 2021-10-21T00:12:01.470 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.470 INFO:teuthology.orchestra.run.smithi041.stdout: mon cluster log file level = debug 2021-10-21T00:12:01.470 INFO:teuthology.orchestra.run.smithi041.stdout: debug asserts on shutdown = true 2021-10-21T00:12:01.470 INFO:teuthology.orchestra.run.smithi041.stdout: mon health detail to clog = false 2021-10-21T00:12:01.470 INFO:teuthology.orchestra.run.smithi041.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:12:01.471 INFO:teuthology.orchestra.run.smithi041.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:12:01.471 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.471 INFO:teuthology.orchestra.run.smithi041.stdout:[osd] 2021-10-21T00:12:01.471 INFO:teuthology.orchestra.run.smithi041.stdout: osd journal size = 100 2021-10-21T00:12:01.472 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.472 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub load threshold = 5.0 2021-10-21T00:12:01.472 INFO:teuthology.orchestra.run.smithi041.stdout: osd scrub max interval = 600 2021-10-21T00:12:01.473 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.473 INFO:teuthology.orchestra.run.smithi041.stdout: osd recover clone overlap = true 2021-10-21T00:12:01.473 INFO:teuthology.orchestra.run.smithi041.stdout: osd recovery max chunk = 1048576 2021-10-21T00:12:01.474 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.474 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug shutdown = true 2021-10-21T00:12:01.474 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug op order = true 2021-10-21T00:12:01.474 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug verify stray on activate = true 2021-10-21T00:12:01.474 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.475 INFO:teuthology.orchestra.run.smithi041.stdout: osd open classes on start = true 2021-10-21T00:12:01.475 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug pg log writeout = true 2021-10-21T00:12:01.475 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.475 INFO:teuthology.orchestra.run.smithi041.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:12:01.476 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.476 INFO:teuthology.orchestra.run.smithi041.stdout: osd map max advance = 10 2021-10-21T00:12:01.476 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.476 INFO:teuthology.orchestra.run.smithi041.stdout: journal zero on create = true 2021-10-21T00:12:01.476 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.477 INFO:teuthology.orchestra.run.smithi041.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:12:01.477 INFO:teuthology.orchestra.run.smithi041.stdout: filestore apply finisher threads = 3 2021-10-21T00:12:01.477 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.477 INFO:teuthology.orchestra.run.smithi041.stdout: bdev debug aio = true 2021-10-21T00:12:01.477 INFO:teuthology.orchestra.run.smithi041.stdout: osd debug misdirected ops = true 2021-10-21T00:12:01.478 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:12:01.478 INFO:teuthology.orchestra.run.smithi041.stdout: debug osd = 20 2021-10-21T00:12:01.478 INFO:teuthology.orchestra.run.smithi041.stdout: osd objectstore = filestore 2021-10-21T00:12:01.478 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:12:01.478 INFO:teuthology.orchestra.run.smithi041.stdout: osd sloppy crc = True 2021-10-21T00:12:01.479 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.479 INFO:teuthology.orchestra.run.smithi041.stdout:[mgr] 2021-10-21T00:12:01.479 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:12:01.479 INFO:teuthology.orchestra.run.smithi041.stdout: debug mgr = 20 2021-10-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.480 INFO:teuthology.orchestra.run.smithi041.stdout: mgr/telemetry/nag = false 2021-10-21T00:12:01.481 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.481 INFO:teuthology.orchestra.run.smithi041.stdout:[mon] 2021-10-21T00:12:01.481 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:12:01.481 INFO:teuthology.orchestra.run.smithi041.stdout: debug mon = 20 2021-10-21T00:12:01.481 INFO:teuthology.orchestra.run.smithi041.stdout: debug paxos = 20 2021-10-21T00:12:01.482 INFO:teuthology.orchestra.run.smithi041.stdout: debug auth = 20 2021-10-21T00:12:01.482 INFO:teuthology.orchestra.run.smithi041.stdout: mon data avail warn = 5 2021-10-21T00:12:01.482 INFO:teuthology.orchestra.run.smithi041.stdout: mon mgr mkfs grace = 240 2021-10-21T00:12:01.482 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.483 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd reporter subtree level = osd 2021-10-21T00:12:01.484 INFO:teuthology.orchestra.run.smithi041.stdout: mon osd prime pg temp = true 2021-10-21T00:12:01.484 INFO:teuthology.orchestra.run.smithi041.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.484 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.484 INFO:teuthology.orchestra.run.smithi041.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:12:01.485 INFO:teuthology.orchestra.run.smithi041.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:12:01.485 INFO:teuthology.orchestra.run.smithi041.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:12:01.485 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.485 INFO:teuthology.orchestra.run.smithi041.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:12:01.485 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:12:01.486 INFO:teuthology.orchestra.run.smithi041.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:12:01.486 INFO:teuthology.orchestra.run.smithi041.stdout: mon op complaint time = 120 2021-10-21T00:12:01.486 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:01.486 INFO:teuthology.orchestra.run.smithi041.stdout:[client] 2021-10-21T00:12:01.486 INFO:teuthology.orchestra.run.smithi041.stdout: rgw cache enabled = true 2021-10-21T00:12:01.487 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable ops log = true 2021-10-21T00:12:01.488 INFO:teuthology.orchestra.run.smithi041.stdout: rgw enable usage log = true 2021-10-21T00:12:01.488 INFO:teuthology.orchestra.run.smithi041.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:12:01.489 INFO:teuthology.orchestra.run.smithi041.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:12:01.489 INFO:teuthology.orchestra.run.smithi041.stdout: client mount timeout = 600 2021-10-21T00:12:01.490 INFO:teuthology.orchestra.run.smithi041.stdout: debug client = 20 2021-10-21T00:12:01.490 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:12:01.490 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.490 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.491 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.a] 2021-10-21T00:12:01.491 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.b] 2021-10-21T00:12:01.491 INFO:teuthology.orchestra.run.smithi041.stdout:[mon.c] 2021-10-21T00:12:01.491 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.a] 2021-10-21T00:12:01.491 INFO:teuthology.orchestra.run.smithi041.stdout:[mds.b] 2021-10-21T00:12:01.492 INFO:teuthology.orchestra.run.smithi041.stdout:[mds] 2021-10-21T00:12:01.492 INFO:teuthology.orchestra.run.smithi041.stdout: debug mds = 20 2021-10-21T00:12:01.492 INFO:teuthology.orchestra.run.smithi041.stdout: debug ms = 1 2021-10-21T00:12:01.492 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal frag = True 2021-10-21T00:12:01.493 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal fragment size max = 10000 2021-10-21T00:12:01.493 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal merge size = 5 2021-10-21T00:12:01.493 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split bits = 3 2021-10-21T00:12:01.493 INFO:teuthology.orchestra.run.smithi041.stdout: mds bal split size = 100 2021-10-21T00:12:01.493 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug frag = True 2021-10-21T00:12:01.494 INFO:teuthology.orchestra.run.smithi041.stdout: mds debug scatterstat = True 2021-10-21T00:12:01.494 INFO:teuthology.orchestra.run.smithi041.stdout: mds op complaint time = 180 2021-10-21T00:12:01.494 INFO:teuthology.orchestra.run.smithi041.stdout: mds verify scatter = True 2021-10-21T00:12:01.494 INFO:teuthology.orchestra.run.smithi041.stdout: osd op complaint time = 180 2021-10-21T00:12:01.495 INFO:teuthology.orchestra.run.smithi041.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.495 INFO:teuthology.orchestra.run.smithi041.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.499 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-10-21T00:12:01.500 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-10-21T00:12:01.500 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:12:01.500 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-10-21T00:12:01.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.501 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-10-21T00:12:01.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.501 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-10-21T00:12:01.501 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-10-21T00:12:01.502 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-10-21T00:12:01.502 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.503 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-10-21T00:12:01.503 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-10-21T00:12:01.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.503 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:12:01.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-10-21T00:12:01.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.504 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:12:01.504 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:12:01.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.505 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-10-21T00:12:01.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-10-21T00:12:01.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-10-21T00:12:01.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:12:01.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:12:01.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-10-21T00:12:01.507 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:12:01.507 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-10-21T00:12:01.507 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:12:01.507 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:12:01.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:12:01.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-10-21T00:12:01.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-10-21T00:12:01.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-10-21T00:12:01.510 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-10-21T00:12:01.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-10-21T00:12:01.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:12:01.511 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:12:01.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.511 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-10-21T00:12:01.511 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-10-21T00:12:01.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.512 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-10-21T00:12:01.512 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-10-21T00:12:01.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.513 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-10-21T00:12:01.513 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-10-21T00:12:01.513 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.513 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-10-21T00:12:01.514 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-10-21T00:12:01.514 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-10-21T00:12:01.514 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.514 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-10-21T00:12:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-10-21T00:12:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:12:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-10-21T00:12:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-10-21T00:12:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:12:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-10-21T00:12:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-10-21T00:12:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-10-21T00:12:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:12:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-10-21T00:12:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = filestore 2021-10-21T00:12:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:12:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: osd sloppy crc = True 2021-10-21T00:12:01.520 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.520 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-10-21T00:12:01.521 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:12:01.521 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-10-21T00:12:01.522 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:12:01.522 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:12:01.522 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.522 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.523 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-10-21T00:12:01.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.523 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-10-21T00:12:01.524 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:12:01.524 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-10-21T00:12:01.524 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-10-21T00:12:01.524 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-10-21T00:12:01.525 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-10-21T00:12:01.525 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-10-21T00:12:01.525 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.525 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-10-21T00:12:01.525 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-10-21T00:12:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:12:01.526 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:12:01.527 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:12:01.527 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.527 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:12:01.527 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:12:01.528 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:12:01.528 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-10-21T00:12:01.528 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-10-21T00:12:01.528 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-10-21T00:12:01.529 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-10-21T00:12:01.529 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-10-21T00:12:01.529 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-10-21T00:12:01.529 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:12:01.530 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:12:01.530 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-10-21T00:12:01.530 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-10-21T00:12:01.530 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:12:01.531 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.531 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.531 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-10-21T00:12:01.531 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-10-21T00:12:01.532 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-10-21T00:12:01.532 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-10-21T00:12:01.532 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-10-21T00:12:01.532 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-10-21T00:12:01.533 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-10-21T00:12:01.533 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-10-21T00:12:01.533 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-10-21T00:12:01.533 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-10-21T00:12:01.534 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-10-21T00:12:01.534 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-10-21T00:12:01.534 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-10-21T00:12:01.534 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-10-21T00:12:01.535 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-10-21T00:12:01.535 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-10-21T00:12:01.535 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-10-21T00:12:01.535 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-10-21T00:12:01.536 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.536 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.536 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2021-10-21T00:12:01.537 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2021-10-21T00:12:01.537 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:12:01.537 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2021-10-21T00:12:01.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.538 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2021-10-21T00:12:01.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.538 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2021-10-21T00:12:01.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.539 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2021-10-21T00:12:01.539 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2021-10-21T00:12:01.539 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.539 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2021-10-21T00:12:01.540 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2021-10-21T00:12:01.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.540 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:12:01.541 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2021-10-21T00:12:01.541 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.541 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:12:01.541 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:12:01.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.542 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2021-10-21T00:12:01.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.542 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2021-10-21T00:12:01.543 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2021-10-21T00:12:01.543 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:12:01.543 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:12:01.543 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2021-10-21T00:12:01.544 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:12:01.544 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2021-10-21T00:12:01.544 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:12:01.544 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:12:01.545 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.545 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:12:01.545 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.546 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2021-10-21T00:12:01.546 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.546 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2021-10-21T00:12:01.546 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.547 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2021-10-21T00:12:01.547 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2021-10-21T00:12:01.547 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2021-10-21T00:12:01.547 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:12:01.548 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:12:01.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.548 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2021-10-21T00:12:01.548 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2021-10-21T00:12:01.549 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.549 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2021-10-21T00:12:01.549 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2021-10-21T00:12:01.549 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.550 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2021-10-21T00:12:01.550 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2021-10-21T00:12:01.550 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.550 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2021-10-21T00:12:01.551 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2021-10-21T00:12:01.551 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2021-10-21T00:12:01.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.551 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2021-10-21T00:12:01.552 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2021-10-21T00:12:01.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.552 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:12:01.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2021-10-21T00:12:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2021-10-21T00:12:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.553 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:12:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2021-10-21T00:12:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2021-10-21T00:12:01.554 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2021-10-21T00:12:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:12:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2021-10-21T00:12:01.555 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = filestore 2021-10-21T00:12:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:12:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: osd sloppy crc = True 2021-10-21T00:12:01.556 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.556 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2021-10-21T00:12:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:12:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2021-10-21T00:12:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:12:01.557 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:12:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2021-10-21T00:12:01.558 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.559 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2021-10-21T00:12:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:12:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2021-10-21T00:12:01.559 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2021-10-21T00:12:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2021-10-21T00:12:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2021-10-21T00:12:01.560 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2021-10-21T00:12:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2021-10-21T00:12:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2021-10-21T00:12:01.561 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.562 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.562 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:12:01.562 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:12:01.563 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:12:01.563 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.563 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:12:01.563 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:12:01.564 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:12:01.564 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2021-10-21T00:12:01.564 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-10-21T00:12:01.564 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2021-10-21T00:12:01.565 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2021-10-21T00:12:01.565 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2021-10-21T00:12:01.565 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2021-10-21T00:12:01.565 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:12:01.566 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:12:01.566 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2021-10-21T00:12:01.566 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2021-10-21T00:12:01.567 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:12:01.567 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.567 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2021-10-21T00:12:01.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2021-10-21T00:12:01.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2021-10-21T00:12:01.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2021-10-21T00:12:01.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2021-10-21T00:12:01.571 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2021-10-21T00:12:01.571 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2021-10-21T00:12:01.571 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2021-10-21T00:12:01.571 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal frag = True 2021-10-21T00:12:01.572 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal fragment size max = 10000 2021-10-21T00:12:01.572 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal merge size = 5 2021-10-21T00:12:01.572 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split bits = 3 2021-10-21T00:12:01.572 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split size = 100 2021-10-21T00:12:01.573 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2021-10-21T00:12:01.573 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2021-10-21T00:12:01.573 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2021-10-21T00:12:01.573 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2021-10-21T00:12:01.573 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2021-10-21T00:12:01.574 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.574 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2021-10-21T00:12:01.574 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2021-10-21T00:12:01.575 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:12:01.575 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2021-10-21T00:12:01.576 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.576 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2021-10-21T00:12:01.576 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.576 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2021-10-21T00:12:01.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.577 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2021-10-21T00:12:01.577 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2021-10-21T00:12:01.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.577 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2021-10-21T00:12:01.578 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2021-10-21T00:12:01.578 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.578 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:12:01.578 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2021-10-21T00:12:01.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.579 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:12:01.579 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:12:01.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.579 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2021-10-21T00:12:01.580 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.580 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2021-10-21T00:12:01.580 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2021-10-21T00:12:01.580 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:12:01.580 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:12:01.581 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2021-10-21T00:12:01.581 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:12:01.581 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2021-10-21T00:12:01.581 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:12:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:12:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:12:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.582 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2021-10-21T00:12:01.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.583 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2021-10-21T00:12:01.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.583 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2021-10-21T00:12:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2021-10-21T00:12:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2021-10-21T00:12:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:12:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:12:01.584 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.585 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2021-10-21T00:12:01.585 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2021-10-21T00:12:01.585 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.586 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2021-10-21T00:12:01.586 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2021-10-21T00:12:01.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.586 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2021-10-21T00:12:01.587 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2021-10-21T00:12:01.587 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.587 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2021-10-21T00:12:01.587 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2021-10-21T00:12:01.588 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2021-10-21T00:12:01.588 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.588 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2021-10-21T00:12:01.588 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2021-10-21T00:12:01.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.589 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:12:01.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.589 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2021-10-21T00:12:01.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.590 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2021-10-21T00:12:01.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.590 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:12:01.590 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2021-10-21T00:12:01.591 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.591 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2021-10-21T00:12:01.591 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2021-10-21T00:12:01.591 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:12:01.591 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2021-10-21T00:12:01.592 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = filestore 2021-10-21T00:12:01.592 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:12:01.592 INFO:teuthology.orchestra.run.smithi071.stdout: osd sloppy crc = True 2021-10-21T00:12:01.592 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.592 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2021-10-21T00:12:01.593 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:12:01.593 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2021-10-21T00:12:01.593 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:12:01.593 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:12:01.594 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.594 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.594 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2021-10-21T00:12:01.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2021-10-21T00:12:01.595 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:12:01.595 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2021-10-21T00:12:01.595 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2021-10-21T00:12:01.596 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2021-10-21T00:12:01.596 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2021-10-21T00:12:01.596 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2021-10-21T00:12:01.597 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.597 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2021-10-21T00:12:01.597 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2021-10-21T00:12:01.597 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.598 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:12:01.598 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:12:01.598 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:12:01.598 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.599 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:12:01.599 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:12:01.599 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:12:01.599 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2021-10-21T00:12:01.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2021-10-21T00:12:01.600 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2021-10-21T00:12:01.600 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2021-10-21T00:12:01.600 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2021-10-21T00:12:01.600 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2021-10-21T00:12:01.601 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:12:01.601 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:12:01.601 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2021-10-21T00:12:01.601 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2021-10-21T00:12:01.601 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:12:01.602 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.602 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2021-10-21T00:12:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2021-10-21T00:12:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2021-10-21T00:12:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2021-10-21T00:12:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2021-10-21T00:12:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2021-10-21T00:12:01.603 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2021-10-21T00:12:01.604 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2021-10-21T00:12:01.604 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal frag = True 2021-10-21T00:12:01.604 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal fragment size max = 10000 2021-10-21T00:12:01.604 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal merge size = 5 2021-10-21T00:12:01.604 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split bits = 3 2021-10-21T00:12:01.605 INFO:teuthology.orchestra.run.smithi071.stdout: mds bal split size = 100 2021-10-21T00:12:01.605 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2021-10-21T00:12:01.605 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2021-10-21T00:12:01.605 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2021-10-21T00:12:01.606 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2021-10-21T00:12:01.606 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2021-10-21T00:12:01.606 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.606 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.607 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2021-10-21T00:12:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2021-10-21T00:12:01.607 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-10-21T00:12:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2021-10-21T00:12:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2021-10-21T00:12:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2021-10-21T00:12:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2021-10-21T00:12:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2021-10-21T00:12:01.609 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2021-10-21T00:12:01.610 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2021-10-21T00:12:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2021-10-21T00:12:01.611 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2021-10-21T00:12:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.612 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2021-10-21T00:12:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2021-10-21T00:12:01.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2021-10-21T00:12:01.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2021-10-21T00:12:01.615 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2021-10-21T00:12:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2021-10-21T00:12:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2021-10-21T00:12:01.616 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2021-10-21T00:12:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2021-10-21T00:12:01.617 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2021-10-21T00:12:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-10-21T00:12:01.618 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2021-10-21T00:12:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.619 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-10-21T00:12:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2021-10-21T00:12:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2021-10-21T00:12:01.620 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.621 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2021-10-21T00:12:01.621 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2021-10-21T00:12:01.621 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2021-10-21T00:12:01.621 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.41,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2021-10-21T00:12:01.622 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 2ab49014-dc00-4ddf-b4a9-8b85c10c4d60 2021-10-21T00:12:01.622 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.622 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2021-10-21T00:12:01.622 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2021-10-21T00:12:01.622 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.623 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2021-10-21T00:12:01.623 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2021-10-21T00:12:01.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.624 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2021-10-21T00:12:01.624 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2021-10-21T00:12:01.624 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.625 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2021-10-21T00:12:01.625 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2021-10-21T00:12:01.626 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2021-10-21T00:12:01.626 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.627 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2021-10-21T00:12:01.627 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2021-10-21T00:12:01.627 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.627 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2021-10-21T00:12:01.628 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.628 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2021-10-21T00:12:01.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.629 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2021-10-21T00:12:01.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.629 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2021-10-21T00:12:01.629 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2021-10-21T00:12:01.630 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.630 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2021-10-21T00:12:01.630 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2021-10-21T00:12:01.630 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:12:01.631 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2021-10-21T00:12:01.631 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = filestore 2021-10-21T00:12:01.631 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:12:01.631 INFO:teuthology.orchestra.run.smithi062.stdout: osd sloppy crc = True 2021-10-21T00:12:01.632 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2021-10-21T00:12:01.632 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:12:01.632 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2021-10-21T00:12:01.632 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:12:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:12:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2021-10-21T00:12:01.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.634 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2021-10-21T00:12:01.634 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:12:01.634 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2021-10-21T00:12:01.634 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2021-10-21T00:12:01.635 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2021-10-21T00:12:01.635 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2021-10-21T00:12:01.635 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2021-10-21T00:12:01.635 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2021-10-21T00:12:01.636 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2021-10-21T00:12:01.636 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2021-10-21T00:12:01.636 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2021-10-21T00:12:01.637 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.637 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-10-21T00:12:01.637 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2021-10-21T00:12:01.637 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2021-10-21T00:12:01.637 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.638 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2021-10-21T00:12:01.638 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-10-21T00:12:01.638 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-10-21T00:12:01.638 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2021-10-21T00:12:01.639 INFO:teuthology.orchestra.run.smithi062.stdout: 2021-10-21T00:12:01.639 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2021-10-21T00:12:01.639 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2021-10-21T00:12:01.639 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2021-10-21T00:12:01.639 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2021-10-21T00:12:01.640 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-10-21T00:12:01.640 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-10-21T00:12:01.640 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2021-10-21T00:12:01.640 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2021-10-21T00:12:01.641 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:12:01.641 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.641 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2021-10-21T00:12:01.641 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2021-10-21T00:12:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2021-10-21T00:12:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2021-10-21T00:12:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2021-10-21T00:12:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2021-10-21T00:12:01.643 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2021-10-21T00:12:01.643 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2021-10-21T00:12:01.643 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal frag = True 2021-10-21T00:12:01.643 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2021-10-21T00:12:01.643 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2021-10-21T00:12:01.644 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2021-10-21T00:12:01.644 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2021-10-21T00:12:01.644 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2021-10-21T00:12:01.644 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2021-10-21T00:12:01.644 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2021-10-21T00:12:01.645 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2021-10-21T00:12:01.645 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2021-10-21T00:12:01.645 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 15m 2021-10-21T00:12:01.645 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 15m 2021-10-21T00:12:01.646 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:12:01.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.753+0000 7fbc1bfff700 1 Processor -- start 2021-10-21T00:12:01.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.753+0000 7fbc1bfff700 1 -- start start 2021-10-21T00:12:01.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc1c0b9c20 0x7fbc1c0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c0ba000 con 0x7fbc1c05c860 2021-10-21T00:12:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c142ad0 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c143bc0 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1a7fc700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fbc1c05c860 0x7fbc1c1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35626/0 (socket says 172.21.15.41:35626) 2021-10-21T00:12:01.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1a7fc700 1 -- 172.21.15.41:0/529630349 learned_addr learned my addr 172.21.15.41:0/529630349 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:01.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1affd700 1 --2- 172.21.15.41:0/529630349 >> v2:172.21.15.41:3300/0 conn(0x7fbc1c0b9c20 0x7fbc1c0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:01.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390119447 0 0) 0x7fbc1c0ba000 con 0x7fbc1c05c860 2021-10-21T00:12:01.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc00003260 con 0x7fbc1c05c860 2021-10-21T00:12:01.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544717454 0 0) 0x7fbc1c142ad0 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c0ba000 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1affd700 1 -- 172.21.15.41:0/529630349 >> v1:172.21.15.62:6789/0 conn(0x7fbc1c0b41a0 legacy=0x7fbc1c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1affd700 1 -- 172.21.15.41:0/529630349 >> v1:172.21.15.41:6789/0 conn(0x7fbc1c05c860 legacy=0x7fbc1c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1affd700 1 -- 172.21.15.41:0/529630349 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c142d70 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1affd700 1 --2- 172.21.15.41:0/529630349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c0acd30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fbc10002f70 tx=0x7fbc10006df0).ready entity=mon.0 client_cookie=33dc5f81c293da13 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:01.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1000e4c0 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10000e90 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc19ffb700 1 -- 172.21.15.41:0/529630349 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1000e810 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- 172.21.15.41:0/529630349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b9c20 msgr2=0x7fbc1c0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/529630349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c0acd30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fbc10002f70 tx=0x7fbc10006df0).stop 2021-10-21T00:12:01.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- 172.21.15.41:0/529630349 shutdown_connections 2021-10-21T00:12:01.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/529630349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c0acd30 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- 172.21.15.41:0/529630349 >> 172.21.15.41:0/529630349 conn(0x7fbc1c062f00 msgr2=0x7fbc1c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:01.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- 172.21.15.41:0/529630349 shutdown_connections 2021-10-21T00:12:01.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.757+0000 7fbc1bfff700 1 -- 172.21.15.41:0/529630349 wait complete. 2021-10-21T00:12:01.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 Processor -- start 2021-10-21T00:12:01.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- start start 2021-10-21T00:12:01.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 0x7fbc1c145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:01.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:01.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:01.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c1529f0 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c155020 con 0x7fbc1c0b9c20 2021-10-21T00:12:01.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0afed0 con 0x7fbc1c05c860 2021-10-21T00:12:01.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:01.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37862/0 (socket says 172.21.15.41:37862) 2021-10-21T00:12:01.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 -- 172.21.15.41:0/3602497682 learned_addr learned my addr 172.21.15.41:0/3602497682 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:01.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1affd700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 0x7fbc1c145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:01.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1b7fe700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:01.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 -- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 msgr2=0x7fbc1c145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 0x7fbc1c145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 -- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1c0b9c20 msgr2=0x7fbc1c13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c13e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 -- 172.21.15.41:0/3602497682 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1000b120 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1affd700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 0x7fbc1c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:01.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1a7fc700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fbc0c0011d0 tx=0x7fbc0c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:01.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0c0070d0 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c007230 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c0b0170 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0c005610 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.761+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c0af030 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c057350 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc0c01a060 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc0bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 0x7fbbf8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:01.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbc0c06adf0 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc1affd700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 0x7fbbf8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:01.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.765+0000 7fbc1affd700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 0x7fbbf8055a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fbc10015000 tx=0x7fbc10014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:01.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.769+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc0c042230 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.897+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc1c05ef30 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc0bfff700 1 -- 172.21.15.41:0/3602497682 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc0c018020 con 0x7fbc1c0b41a0 2021-10-21T00:12:01.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 msgr2=0x7fbbf8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 0x7fbbf8055a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fbc10015000 tx=0x7fbc10014000).stop 2021-10-21T00:12:01.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 msgr2=0x7fbc1c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:01.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fbc0c0011d0 tx=0x7fbc0c007b50).stop 2021-10-21T00:12:01.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 shutdown_connections 2021-10-21T00:12:01.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf80535b0 0x7fbbf8055a70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1c0b9c20 0x7fbc1c13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc1c0b41a0 0x7fbc1c151a00 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 --2- 172.21.15.41:0/3602497682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc1c05c860 0x7fbc1c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:01.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 >> 172.21.15.41:0/3602497682 conn(0x7fbc1c062f00 msgr2=0x7fbc1c13f290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:01.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 shutdown_connections 2021-10-21T00:12:01.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:01.905+0000 7fbc1bfff700 1 -- 172.21.15.41:0/3602497682 wait complete. 2021-10-21T00:12:01.928 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-10-21T00:12:02.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 Processor -- start 2021-10-21T00:12:02.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 -- start start 2021-10-21T00:12:02.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6ed0062f70 0x7f6ed005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed005bd40 con 0x7f6ed0062330 2021-10-21T00:12:02.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed005bf70 con 0x7f6ed0062f70 2021-10-21T00:12:02.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed7075700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0142cb0 con 0x7f6ed00b3a20 2021-10-21T00:12:02.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6ed0062f70 0x7f6ed005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f6ed0062f70 0x7f6ed005c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37874/0 (socket says 172.21.15.41:37874) 2021-10-21T00:12:02.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 -- 172.21.15.41:0/931423683 learned_addr learned my addr 172.21.15.41:0/931423683 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:02.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed6874700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 -- 172.21.15.41:0/931423683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 msgr2=0x7f6ed013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:02.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 -- 172.21.15.41:0/931423683 >> v1:172.21.15.62:6789/0 conn(0x7f6ed0062330 legacy=0x7f6ed00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.025+0000 7f6ed5872700 1 -- 172.21.15.41:0/931423683 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0142950 con 0x7f6ed0062f70 2021-10-21T00:12:02.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed5872700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed005c410 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f6ecc002f70 tx=0x7f6ecc006eb0).ready entity=mon.0 client_cookie=a7eded624b427dc5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed5071700 1 -- 172.21.15.41:0/931423683 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ecc00d570 con 0x7f6ed0062f70 2021-10-21T00:12:02.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed5071700 1 -- 172.21.15.41:0/931423683 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc000e90 con 0x7f6ed0062f70 2021-10-21T00:12:02.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed5071700 1 -- 172.21.15.41:0/931423683 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ecc00d900 con 0x7f6ed0062f70 2021-10-21T00:12:02.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- 172.21.15.41:0/931423683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 msgr2=0x7f6ed005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed005c410 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f6ecc002f70 tx=0x7f6ecc006eb0).stop 2021-10-21T00:12:02.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- 172.21.15.41:0/931423683 shutdown_connections 2021-10-21T00:12:02.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 --2- 172.21.15.41:0/931423683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed005c410 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- 172.21.15.41:0/931423683 >> 172.21.15.41:0/931423683 conn(0x7f6ed00b9080 msgr2=0x7f6ed00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:02.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- 172.21.15.41:0/931423683 shutdown_connections 2021-10-21T00:12:02.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- 172.21.15.41:0/931423683 wait complete. 2021-10-21T00:12:02.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 Processor -- start 2021-10-21T00:12:02.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.029+0000 7f6ed7075700 1 -- start start 2021-10-21T00:12:02.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed0062330 0x7f6ed0112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed013c9d0 con 0x7f6ed0062f70 2021-10-21T00:12:02.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed013cbf0 con 0x7f6ed0062330 2021-10-21T00:12:02.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed013ce90 con 0x7f6ed00b3a20 2021-10-21T00:12:02.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed6874700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37878/0 (socket says 172.21.15.41:37878) 2021-10-21T00:12:02.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 -- 172.21.15.41:0/725192720 learned_addr learned my addr 172.21.15.41:0/725192720 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:02.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed6073700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed0062330 0x7f6ed0112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 -- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 msgr2=0x7f6ed013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 -- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed0062330 msgr2=0x7f6ed0112df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed0062330 0x7f6ed0112df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 -- 172.21.15.41:0/725192720 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc00b1e0 con 0x7f6ed0062f70 2021-10-21T00:12:02.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed5872700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f6ecc002f70 tx=0x7f6ecc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ecc006b40 con 0x7f6ed0062f70 2021-10-21T00:12:02.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc00d8f0 con 0x7f6ed0062f70 2021-10-21T00:12:02.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed013d130 con 0x7f6ed0062f70 2021-10-21T00:12:02.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ecc011e20 con 0x7f6ed0062f70 2021-10-21T00:12:02.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0155920 con 0x7f6ed0062f70 2021-10-21T00:12:02.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ecc01a040 con 0x7f6ed0062f70 2021-10-21T00:12:02.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed013d2c0 con 0x7f6ed0062f70 2021-10-21T00:12:02.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 0x7f6eb0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f6ecc06c580 con 0x7f6ed0062f70 2021-10-21T00:12:02.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.033+0000 7f6ed6073700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 0x7f6eb0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.037+0000 7f6ed6073700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 0x7f6eb0055a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f6ec000b000 tx=0x7f6ec0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.041+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ecc047350 con 0x7f6ed0062f70 2021-10-21T00:12:02.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.209+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f6ed0057350 con 0x7f6ed0062f70 2021-10-21T00:12:02.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.393+0000 7f6ebf7fe700 1 -- 172.21.15.41:0/725192720 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v418) v1 ==== 128+0+0 (secure 0 0 0) 0x7f6ecc046f40 con 0x7f6ed0062f70 2021-10-21T00:12:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 msgr2=0x7f6eb0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 0x7f6eb0055a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f6ec000b000 tx=0x7f6ec0009040).stop 2021-10-21T00:12:02.406 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 msgr2=0x7f6ed01443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f6ecc002f70 tx=0x7f6ecc015000).stop 2021-10-21T00:12:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 shutdown_connections 2021-10-21T00:12:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6eb0053580 0x7f6eb0055a40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.407 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6ed00b3a20 0x7f6ed013c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6ed0062f70 0x7f6ed01443b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 --2- 172.21.15.41:0/725192720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed0062330 0x7f6ed0112df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 >> 172.21.15.41:0/725192720 conn(0x7f6ed00b9080 msgr2=0x7f6ed013de90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 shutdown_connections 2021-10-21T00:12:02.408 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.397+0000 7f6ed7075700 1 -- 172.21.15.41:0/725192720 wait complete. 2021-10-21T00:12:02.421 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:12:02.422 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:12:02.423 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-10-21T00:12:02.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 Processor -- start 2021-10-21T00:12:02.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 -- start start 2021-10-21T00:12:02.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffa580b4380 0x7ffa5805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 0x7ffa5805fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 0x7ffa58143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580b4760 con 0x7ffa580b4380 2021-10-21T00:12:02.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580ad4c0 con 0x7ffa580601a0 2021-10-21T00:12:02.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.525+0000 7ffa5e252700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580ad760 con 0x7ffa580b1830 2021-10-21T00:12:02.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffa580b4380 0x7ffa5805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ffa580b4380 0x7ffa5805f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37884/0 (socket says 172.21.15.41:37884) 2021-10-21T00:12:02.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 -- 172.21.15.41:0/1218664812 learned_addr learned my addr 172.21.15.41:0/1218664812 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:02.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5da51700 1 --2- 172.21.15.41:0/1218664812 >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 0x7ffa58143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5ca4f700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 0x7ffa5805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 -- 172.21.15.41:0/1218664812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 msgr2=0x7ffa5805fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:02.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 0x7ffa5805fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 -- 172.21.15.41:0/1218664812 >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 msgr2=0x7ffa58143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:02.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 --2- 172.21.15.41:0/1218664812 >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 0x7ffa58143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 -- 172.21.15.41:0/1218664812 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580ada00 con 0x7ffa580b4380 2021-10-21T00:12:02.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5ca4f700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 0x7ffa5805fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5da51700 1 --2- 172.21.15.41:0/1218664812 >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 0x7ffa58143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:02.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5d250700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580b4380 0x7ffa5805f7c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48006eb0).ready entity=mon.0 client_cookie=2a53a022871ea030 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa4ffff700 1 -- 172.21.15.41:0/1218664812 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4800d570 con 0x7ffa580b4380 2021-10-21T00:12:02.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa4ffff700 1 -- 172.21.15.41:0/1218664812 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48000e90 con 0x7ffa580b4380 2021-10-21T00:12:02.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa4ffff700 1 -- 172.21.15.41:0/1218664812 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4800d900 con 0x7ffa580b4380 2021-10-21T00:12:02.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- 172.21.15.41:0/1218664812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580b4380 msgr2=0x7ffa5805f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580b4380 0x7ffa5805f7c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48006eb0).stop 2021-10-21T00:12:02.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- 172.21.15.41:0/1218664812 shutdown_connections 2021-10-21T00:12:02.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 --2- 172.21.15.41:0/1218664812 >> v2:172.21.15.62:3300/0 conn(0x7ffa580601a0 0x7ffa58143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b1830 0x7ffa5805fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 --2- 172.21.15.41:0/1218664812 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580b4380 0x7ffa5805f7c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- 172.21.15.41:0/1218664812 >> 172.21.15.41:0/1218664812 conn(0x7ffa580b7910 msgr2=0x7ffa580b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:02.555 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- 172.21.15.41:0/1218664812 shutdown_connections 2021-10-21T00:12:02.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- 172.21.15.41:0/1218664812 wait complete. 2021-10-21T00:12:02.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 Processor -- start 2021-10-21T00:12:02.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.529+0000 7ffa5e252700 1 -- start start 2021-10-21T00:12:02.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa580b1830 0x7ffa5813e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b4380 0x7ffa5813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5809c0c0 con 0x7ffa580601a0 2021-10-21T00:12:02.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5809c360 con 0x7ffa580b1830 2021-10-21T00:12:02.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5809bbf0 con 0x7ffa580b4380 2021-10-21T00:12:02.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37890/0 (socket says 172.21.15.41:37890) 2021-10-21T00:12:02.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5ca4f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa580b1830 0x7ffa5813e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.565 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 -- 172.21.15.41:0/2402092955 learned_addr learned my addr 172.21.15.41:0/2402092955 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:02.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5da51700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b4380 0x7ffa5813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 -- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b4380 msgr2=0x7ffa5813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b4380 0x7ffa5813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 -- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa580b1830 msgr2=0x7ffa5813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:02.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa580b1830 0x7ffa5813e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:02.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 -- 172.21.15.41:0/2402092955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50009470 con 0x7ffa580601a0 2021-10-21T00:12:02.568 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5d250700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa480117e0 con 0x7ffa580601a0 2021-10-21T00:12:02.569 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48011940 con 0x7ffa580601a0 2021-10-21T00:12:02.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5400b180 con 0x7ffa580601a0 2021-10-21T00:12:02.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa48011ca0 con 0x7ffa580601a0 2021-10-21T00:12:02.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4800b1e0 con 0x7ffa580601a0 2021-10-21T00:12:02.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.533+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5809c560 con 0x7ffa580601a0 2021-10-21T00:12:02.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.537+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa4801a040 con 0x7ffa580601a0 2021-10-21T00:12:02.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.537+0000 7ffa4e7fc700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 0x7ffa40055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:02.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.537+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ffa4806c5c0 con 0x7ffa580601a0 2021-10-21T00:12:02.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.537+0000 7ffa5ca4f700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 0x7ffa40055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:02.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.537+0000 7ffa5ca4f700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 0x7ffa40055a40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7ffa5400b000 tx=0x7ffa54006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:02.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.545+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa5809c560 con 0x7ffa580601a0 2021-10-21T00:12:02.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:02.717+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7ffa5809c560 con 0x7ffa580601a0 2021-10-21T00:12:03.405 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.397+0000 7ffa4e7fc700 1 -- 172.21.15.41:0/2402092955 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v419) v1 ==== 130+0+0 (secure 0 0 0) 0x7ffa5809c560 con 0x7ffa580601a0 2021-10-21T00:12:03.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 msgr2=0x7ffa40055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.409 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 0x7ffa40055a40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7ffa5400b000 tx=0x7ffa54006df0).stop 2021-10-21T00:12:03.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 msgr2=0x7ffa58144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48015000).stop 2021-10-21T00:12:03.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 shutdown_connections 2021-10-21T00:12:03.410 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ffa40053580 0x7ffa40055a40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa580b4380 0x7ffa5813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa580b1830 0x7ffa5813e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.411 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 --2- 172.21.15.41:0/2402092955 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ffa580601a0 0x7ffa58144400 secure :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48015000).stop 2021-10-21T00:12:03.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 >> 172.21.15.41:0/2402092955 conn(0x7ffa580b7910 msgr2=0x7ffa580b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:03.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 shutdown_connections 2021-10-21T00:12:03.412 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.401+0000 7ffa5e252700 1 -- 172.21.15.41:0/2402092955 wait complete. 2021-10-21T00:12:03.427 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:12:03.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.533+0000 7f541762b700 1 Processor -- start 2021-10-21T00:12:03.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.533+0000 7f541762b700 1 -- start start 2021-10-21T00:12:03.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.533+0000 7f541762b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5410060c60 0x7f5410065a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54100b0430 con 0x7f54100b0620 2021-10-21T00:12:03.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54100b1a90 con 0x7f54100ac390 2021-10-21T00:12:03.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5410067180 con 0x7f5410060c60 2021-10-21T00:12:03.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f54153c7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f5410060c60 0x7f5410065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f5415bc8700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f54100b0620 0x7f541013ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35674/0 (socket says 172.21.15.41:35674) 2021-10-21T00:12:03.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f5415bc8700 1 -- 172.21.15.41:0/3077893695 learned_addr learned my addr 172.21.15.41:0/3077893695 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:03.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166901645 0 0) 0x7f54100b0430 con 0x7f54100b0620 2021-10-21T00:12:03.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003260 con 0x7f54100b0620 2021-10-21T00:12:03.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f54153c7700 1 -- 172.21.15.41:0/3077893695 >> v1:172.21.15.62:6789/0 conn(0x7f54100ac390 legacy=0x7f54100b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237895815 0 0) 0x7f54100b1a90 con 0x7f54100ac390 2021-10-21T00:12:03.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f54153c7700 1 -- 172.21.15.41:0/3077893695 >> v1:172.21.15.41:6789/0 conn(0x7f54100b0620 legacy=0x7f541013ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f54153c7700 1 -- 172.21.15.41:0/3077893695 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410061040 con 0x7f5410060c60 2021-10-21T00:12:03.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f54153c7700 1 --2- 172.21.15.41:0/3077893695 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f5410065a00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f5408001ba0 tx=0x7f540c006df0).ready entity=mon.0 client_cookie=31b4053d7cb8b28f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5408001a00 con 0x7f5410060c60 2021-10-21T00:12:03.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c000e90 con 0x7f5410060c60 2021-10-21T00:12:03.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f53fffff700 1 -- 172.21.15.41:0/3077893695 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c011400 con 0x7f5410060c60 2021-10-21T00:12:03.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- 172.21.15.41:0/3077893695 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 msgr2=0x7f5410065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 --2- 172.21.15.41:0/3077893695 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f5410065a00 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f5408001ba0 tx=0x7f540c006df0).stop 2021-10-21T00:12:03.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- 172.21.15.41:0/3077893695 shutdown_connections 2021-10-21T00:12:03.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 --2- 172.21.15.41:0/3077893695 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f5410065a00 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- 172.21.15.41:0/3077893695 >> 172.21.15.41:0/3077893695 conn(0x7f5410063b70 msgr2=0x7f5410060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:03.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- 172.21.15.41:0/3077893695 shutdown_connections 2021-10-21T00:12:03.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.537+0000 7f541762b700 1 -- 172.21.15.41:0/3077893695 wait complete. 2021-10-21T00:12:03.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 Processor -- start 2021-10-21T00:12:03.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 -- start start 2021-10-21T00:12:03.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.556 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54100ac390 0x7f541009dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54100b0620 0x7f54100b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a04e0 con 0x7f5410060c60 2021-10-21T00:12:03.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a0740 con 0x7f54100ac390 2021-10-21T00:12:03.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.541+0000 7f541762b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541009e4c0 con 0x7f54100b0620 2021-10-21T00:12:03.557 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37906/0 (socket says 172.21.15.41:37906) 2021-10-21T00:12:03.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 -- 172.21.15.41:0/3870656334 learned_addr learned my addr 172.21.15.41:0/3870656334 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:03.558 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f5414bc6700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54100ac390 0x7f541009dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f5415bc8700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54100b0620 0x7f54100b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 -- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54100b0620 msgr2=0x7f54100b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54100b0620 0x7f54100b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 -- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54100ac390 msgr2=0x7f541009dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.561 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54100ac390 0x7f541009dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 -- 172.21.15.41:0/3870656334 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c00b180 con 0x7f5410060c60 2021-10-21T00:12:03.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f54153c7700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f5408001ba0 tx=0x7f5410065190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.562 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00d920 con 0x7f5410060c60 2021-10-21T00:12:03.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00da80 con 0x7f5410060c60 2021-10-21T00:12:03.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54100b48a0 con 0x7f5410060c60 2021-10-21T00:12:03.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00dde0 con 0x7f5410060c60 2021-10-21T00:12:03.563 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54100adfa0 con 0x7f5410060c60 2021-10-21T00:12:03.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.545+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54100ae280 con 0x7f5410060c60 2021-10-21T00:12:03.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.549+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f540c024030 con 0x7f5410060c60 2021-10-21T00:12:03.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.549+0000 7f53fe7fc700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 0x7f53f0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.549+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f540c06be80 con 0x7f5410060c60 2021-10-21T00:12:03.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.549+0000 7f5414bc6700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 0x7f53f0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.549+0000 7f5414bc6700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 0x7f53f0055ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f540000d000 tx=0x7f5400007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.557+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f540c0432c0 con 0x7f5410060c60 2021-10-21T00:12:03.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.685+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5410066ee0 con 0x7f5410060c60 2021-10-21T00:12:03.700 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f53fe7fc700 1 -- 172.21.15.41:0/3870656334 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f540c022070 con 0x7f5410060c60 2021-10-21T00:12:03.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 msgr2=0x7f53f0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 0x7f53f0055ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f540000d000 tx=0x7f5400007a00).stop 2021-10-21T00:12:03.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 msgr2=0x7f541014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f5408001ba0 tx=0x7f5410065190).stop 2021-10-21T00:12:03.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 shutdown_connections 2021-10-21T00:12:03.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f53f0053610 0x7f53f0055ad0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54100b0620 0x7f54100b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54100ac390 0x7f541009dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 --2- 172.21.15.41:0/3870656334 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5410060c60 0x7f541014ebf0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 >> 172.21.15.41:0/3870656334 conn(0x7f5410063b70 msgr2=0x7f541013bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:03.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 shutdown_connections 2021-10-21T00:12:03.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.693+0000 7f541762b700 1 -- 172.21.15.41:0/3870656334 wait complete. 2021-10-21T00:12:03.716 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:12:03.716 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:03.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:03.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:03.777 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:03.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:03.819 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:12:03.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:03.821 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:03.821 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:03.828 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:12:03.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:03.830 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:12:03.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:03.831 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:03.831 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:12:03.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:03.840 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:03.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:03.841 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:03.841 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:12:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:12:03.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:03.851 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:12:03.852 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:12:03.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 Processor -- start 2021-10-21T00:12:03.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 -- start start 2021-10-21T00:12:03.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f272c0af620 0x7f272c0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f272c067a80 0x7f272c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0b0b50 con 0x7f272c0b2170 2021-10-21T00:12:03.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b2550 con 0x7f272c0af620 2021-10-21T00:12:03.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.953+0000 7f27309b6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b0d90 con 0x7f272c067a80 2021-10-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f272c0af620 0x7f272c0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272ad9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f272c0b2170 0x7f272c0ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35686/0 (socket says 172.21.15.41:35686) 2021-10-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272ad9d700 1 -- 172.21.15.41:0/110120507 learned_addr learned my addr 172.21.15.41:0/110120507 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 --2- 172.21.15.41:0/110120507 >> v2:172.21.15.41:3300/0 conn(0x7f272c0af620 0x7f272c0ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37914/0 (socket says 172.21.15.41:37914) 2021-10-21T00:12:03.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272b59e700 1 --2- 172.21.15.41:0/110120507 >> v2:172.21.15.62:3300/0 conn(0x7f272c067a80 0x7f272c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 -- 172.21.15.41:0/110120507 >> v2:172.21.15.62:3300/0 conn(0x7f272c067a80 msgr2=0x7f272c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:03.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 --2- 172.21.15.41:0/110120507 >> v2:172.21.15.62:3300/0 conn(0x7f272c067a80 0x7f272c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 -- 172.21.15.41:0/110120507 >> v1:172.21.15.41:6789/0 conn(0x7f272c0b2170 legacy=0x7f272c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f2729d9b700 1 -- 172.21.15.41:0/110120507 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672192172 0 0) 0x7f2720001110 con 0x7f272c0b2170 2021-10-21T00:12:03.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 -- 172.21.15.41:0/110120507 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0b1030 con 0x7f272c0af620 2021-10-21T00:12:03.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f272a59c700 1 --2- 172.21.15.41:0/110120507 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c0af620 0x7f272c0ab880 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f272c0aafa0 tx=0x7f271c006df0).ready entity=mon.0 client_cookie=908f3a96946452d4 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f2729d9b700 1 -- 172.21.15.41:0/110120507 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271c00d5c0 con 0x7f272c0af620 2021-10-21T00:12:03.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f2729d9b700 1 -- 172.21.15.41:0/110120507 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c000e90 con 0x7f272c0af620 2021-10-21T00:12:03.970 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f2729d9b700 1 -- 172.21.15.41:0/110120507 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271c00d910 con 0x7f272c0af620 2021-10-21T00:12:03.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- 172.21.15.41:0/110120507 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c0af620 msgr2=0x7f272c0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 --2- 172.21.15.41:0/110120507 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c0af620 0x7f272c0ab880 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f272c0aafa0 tx=0x7f271c006df0).stop 2021-10-21T00:12:03.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- 172.21.15.41:0/110120507 shutdown_connections 2021-10-21T00:12:03.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 --2- 172.21.15.41:0/110120507 >> v2:172.21.15.62:3300/0 conn(0x7f272c067a80 0x7f272c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 --2- 172.21.15.41:0/110120507 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c0af620 0x7f272c0ab880 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- 172.21.15.41:0/110120507 >> 172.21.15.41:0/110120507 conn(0x7f272c0b5700 msgr2=0x7f272c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:03.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- 172.21.15.41:0/110120507 shutdown_connections 2021-10-21T00:12:03.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- 172.21.15.41:0/110120507 wait complete. 2021-10-21T00:12:03.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 Processor -- start 2021-10-21T00:12:03.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.957+0000 7f27309b6700 1 -- start start 2021-10-21T00:12:03.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f272c0af620 0x7f272c0ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 0x7f272c066e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c064710 con 0x7f272c067a80 2021-10-21T00:12:03.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0635e0 con 0x7f272c0b2170 2021-10-21T00:12:03.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0ad320 con 0x7f272c0af620 2021-10-21T00:12:03.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 0x7f272c066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37924/0 (socket says 172.21.15.41:37924) 2021-10-21T00:12:03.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 0x7f272c066e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49840/0 (socket says 172.21.15.41:49840) 2021-10-21T00:12:03.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 -- 172.21.15.41:0/3041717517 learned_addr learned my addr 172.21.15.41:0/3041717517 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:03.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272a59c700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f272c0af620 0x7f272c0ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 -- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f272c0af620 msgr2=0x7f272c0ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f272c0af620 0x7f272c0ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 -- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 msgr2=0x7f272c066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:03.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 0x7f272c066e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:03.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 -- 172.21.15.41:0/3041717517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c00b180 con 0x7f272c067a80 2021-10-21T00:12:03.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f272ad9d700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f2720000ed0 tx=0x7f2720007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27200070d0 con 0x7f272c067a80 2021-10-21T00:12:03.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720007230 con 0x7f272c067a80 2021-10-21T00:12:03.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c064940 con 0x7f272c067a80 2021-10-21T00:12:03.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2720005610 con 0x7f272c067a80 2021-10-21T00:12:03.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.961+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c0ac9d0 con 0x7f272c067a80 2021-10-21T00:12:03.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c0b12d0 con 0x7f272c067a80 2021-10-21T00:12:03.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2720010070 con 0x7f272c067a80 2021-10-21T00:12:03.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f271bfff700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 0x7f2708055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:03.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f272006aab0 con 0x7f272c067a80 2021-10-21T00:12:03.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f272a59c700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 0x7f2708055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:03.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.965+0000 7f272a59c700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 0x7f2708055b00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f271c01a000 tx=0x7f271c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:03.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:03.973+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2720041ef0 con 0x7f272c067a80 2021-10-21T00:12:04.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.097+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f272c0b0b30 con 0x7f272c067a80 2021-10-21T00:12:04.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.097+0000 7f271bfff700 1 -- 172.21.15.41:0/3041717517 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v130) v1 ==== 81+0+28835 (secure 0 0 0) 0x7f2720045510 con 0x7f272c067a80 2021-10-21T00:12:04.108 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:04.108 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:04.108 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 130, 2021-10-21T00:12:04.108 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:12:04.109 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:12:04.109 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:12:01.379286+0000", 2021-10-21T00:12:04.109 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:04.109 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:04.109 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:12:04.110 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:12:04.110 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:12:04.110 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:12:04.110 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:12:04.111 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:12:04.111 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:12:04.111 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:04.112 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:12:04.112 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:12:04.113 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:12:04.113 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:12:04.113 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:12:04.113 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 26, 2021-10-21T00:12:04.114 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:12:04.114 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:12:04.115 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:12:04.115 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:12:04.115 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:12:04.116 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.116 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:12:04.117 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:12:04.117 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:12:04.117 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:04.118 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:04.118 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:04.119 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:04.119 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:04.120 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:04.120 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:04.121 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:04.121 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:12:04.122 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:12:04.122 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:12:04.123 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:12:04.123 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:12:04.123 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:04.124 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:04.124 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:04.125 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:04.126 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:04.126 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:04.126 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:04.127 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.127 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:12:04.128 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:04.128 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:04.129 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:04.129 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:04.129 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:04.130 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:04.130 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:04.131 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:04.131 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:04.132 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:04.139 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:04.139 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:04.140 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:04.140 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:04.141 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:04.141 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:04.141 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:04.141 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:04.142 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:04.142 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:04.142 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:04.142 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:04.142 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:04.143 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:04.143 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:04.143 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:04.143 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.144 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:04.144 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:04.144 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:04.144 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:04.144 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:04.145 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:04.145 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:04.145 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:04.145 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:04.146 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:04.146 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:04.146 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:04.146 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:12:04.146 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.147 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:04.147 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:12:04.147 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.148 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.148 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.149 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:12:04.149 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:12:04.150 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:12:04.150 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:04.150 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:04.150 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:04.150 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:04.151 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:04.151 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:04.151 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:04.151 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:04.153 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:04.153 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:04.153 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:04.154 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:04.154 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:04.155 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:04.155 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:04.156 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:04.156 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:04.156 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:04.157 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:04.157 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:04.158 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.158 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:12:04.159 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:04.159 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:04.159 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:04.160 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:04.160 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:04.161 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:04.161 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:04.162 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:04.162 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:04.162 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:04.163 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:04.163 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:04.164 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:04.164 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:04.165 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:04.165 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:04.165 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:04.166 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:04.166 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:04.167 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:04.167 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:04.168 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:04.168 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:04.168 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:04.169 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:04.169 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:04.169 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.170 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:04.170 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:04.171 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:04.172 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:04.172 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:04.172 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:04.172 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:04.173 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:04.173 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:04.173 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:04.173 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:04.174 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:04.174 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:04.174 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:12:04.174 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.174 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.175 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:04.175 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:12:04.175 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.175 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:04.176 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:12:04.176 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.176 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.176 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.177 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.177 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.178 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.178 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.178 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:12:04.179 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.179 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.180 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.180 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.181 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.181 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.181 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:12:04.182 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.183 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.183 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.183 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.184 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:12:04.184 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.185 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.185 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.185 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.186 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.186 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.186 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.186 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.187 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:12:04.187 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.187 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.187 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.188 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.188 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:12:04.188 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.188 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.188 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.189 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.189 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.189 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.189 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.189 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.190 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:12:04.190 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.191 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.191 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.192 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.192 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:12:04.193 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.193 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.193 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.194 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.194 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.195 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.195 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.195 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.196 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:12:04.196 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.197 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.197 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.198 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.198 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:12:04.198 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:04.199 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.199 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.200 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.200 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:12:04.201 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:12:04.201 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:12:04.201 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:12:04.202 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.202 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.203 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.203 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.203 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.204 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.204 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:04.205 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:12:04.205 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.205 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.206 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.206 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.206 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.206 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.207 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.207 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:12:04.207 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.207 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.207 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.208 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.208 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.208 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.208 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:12:04.209 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.209 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.209 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.209 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.209 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:12:04.210 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.210 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.210 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.210 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.210 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.211 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.211 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.211 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:12:04.212 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.212 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.212 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.212 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.212 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:12:04.213 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.213 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.213 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.213 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.213 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.214 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.214 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.214 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.214 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:12:04.215 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.215 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.215 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.215 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.215 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:12:04.216 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.216 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.216 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.216 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.216 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.217 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.217 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.217 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:12:04.217 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.218 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.218 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.218 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.218 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:12:04.219 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:04.219 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.219 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.219 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.219 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:12:04.220 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:12:04.220 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:12:04.220 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:12:04.220 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.220 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.221 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.221 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.221 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.221 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.222 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:04.222 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:12:04.222 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.222 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.222 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.223 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.223 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.223 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.223 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.223 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:12:04.224 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.224 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.224 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.224 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.225 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.225 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.225 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:12:04.225 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.225 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.226 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.226 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.226 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:12:04.226 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.226 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.227 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.227 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.227 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.227 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.227 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.228 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.228 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:12:04.228 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.228 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.229 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.229 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.229 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:12:04.229 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.229 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.230 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.230 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.230 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.230 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.230 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.231 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.231 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:12:04.231 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.231 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.232 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.232 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.232 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:12:04.232 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.233 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.233 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.233 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.233 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.234 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.234 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.234 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.234 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:12:04.234 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.235 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.235 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.235 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.235 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:12:04.235 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:04.236 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.236 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.236 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.236 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:12:04.237 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:12:04.237 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:12:04.237 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:12:04.237 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.237 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.238 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.238 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.238 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.238 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.238 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:04.239 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:12:04.239 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.239 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.239 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.240 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.240 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.240 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.240 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.240 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:12:04.241 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.241 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.241 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.241 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.241 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.242 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.242 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:12:04.242 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.242 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.242 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.243 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.243 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:12:04.243 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.243 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.244 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.244 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.244 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.244 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.244 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.245 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.245 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:12:04.245 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.245 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.245 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.246 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.246 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:12:04.246 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.246 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.247 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.247 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.247 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.247 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.247 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.248 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.248 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:12:04.248 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.248 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.248 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.249 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.249 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:12:04.249 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.249 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.249 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.250 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.250 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.250 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.250 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.251 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.251 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:12:04.251 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.251 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.251 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.252 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.252 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:12:04.252 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:04.252 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.252 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.253 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.253 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:12:04.253 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:12:04.253 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:12:04.254 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:12:04.254 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.254 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.254 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.254 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.255 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.255 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.255 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:04.255 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:12:04.255 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.256 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.256 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.256 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.256 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.257 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.257 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.257 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:12:04.257 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.257 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.258 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.258 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.258 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.258 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:12:04.259 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.259 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.259 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.259 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.259 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:12:04.260 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.260 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.260 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.260 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.261 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.261 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.261 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.261 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.261 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:12:04.262 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.262 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.262 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.262 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.263 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:12:04.263 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.263 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.263 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.263 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.264 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.264 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.264 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.264 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.264 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:12:04.265 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.265 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.265 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.265 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.265 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:12:04.266 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.266 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.266 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.266 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.267 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.267 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.267 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.267 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.267 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:12:04.268 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.268 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.268 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.268 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.268 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:12:04.269 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:04.269 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.269 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.269 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.270 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:12:04.270 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:12:04.270 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:12:04.270 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:12:04.270 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.271 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.271 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.271 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.271 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.271 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.272 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:04.272 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:12:04.272 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.273 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.273 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.273 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.273 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.274 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.274 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.274 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 117, 2021-10-21T00:12:04.274 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.274 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.275 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.275 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.275 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.275 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.275 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:12:04.276 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.276 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.276 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.276 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.276 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:12:04.277 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.277 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.277 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.277 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.278 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.278 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.278 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.278 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:12:04.279 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.279 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.279 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.279 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.279 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:12:04.280 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.280 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.280 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.280 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.281 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.281 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.281 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.281 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:12:04.282 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.282 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.282 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.282 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.282 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:12:04.283 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.283 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.283 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.284 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.284 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.284 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.284 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.284 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.285 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:12:04.285 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.285 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.285 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.285 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.286 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:12:04.286 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:04.286 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.286 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.287 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.287 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:12:04.287 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:12:04.287 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:12:04.287 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:12:04.288 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.288 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.288 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.288 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.288 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.289 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.289 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:04.289 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:12:04.289 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.290 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.290 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.290 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.290 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.290 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.291 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.291 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:12:04.291 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.291 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.292 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.292 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.292 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.292 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.293 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:12:04.293 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.293 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.293 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.294 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.294 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:12:04.294 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.294 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.294 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.295 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.295 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.295 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.295 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.295 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.296 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:12:04.296 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.296 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.296 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.297 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.297 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:12:04.297 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.297 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.297 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.298 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.298 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.298 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.298 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.298 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.299 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:12:04.299 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.299 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.299 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.300 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.300 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:12:04.300 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.300 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.300 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.301 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.301 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.301 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.301 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.302 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.302 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:12:04.302 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.302 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.302 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.303 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.303 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:12:04.303 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:04.303 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.303 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.304 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.304 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:12:04.304 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:12:04.304 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:12:04.305 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:12:04.305 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.305 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.305 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.305 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.306 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.306 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.306 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:04.306 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:12:04.306 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:04.307 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:04.307 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:04.307 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:04.307 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:04.308 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:04.308 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:04.308 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 125, 2021-10-21T00:12:04.308 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:04.308 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:04.309 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:04.309 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.309 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.309 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.309 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:12:04.310 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.310 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.310 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.310 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.310 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:12:04.311 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.311 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.311 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.311 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.312 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:04.312 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.312 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.312 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.312 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:12:04.313 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.313 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.313 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.313 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.313 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:12:04.314 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.314 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.314 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.314 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.314 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:04.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.315 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.315 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.315 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:12:04.316 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.316 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.316 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.316 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.316 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:12:04.317 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.317 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.317 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.317 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.317 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:04.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:04.318 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.318 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:04.318 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:12:04.319 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.319 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.319 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.319 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:04.319 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:12:04.320 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:04.320 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.320 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.320 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.321 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:12:04.321 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:12:04.321 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:12:04.321 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:12:04.321 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:04.322 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:04.322 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:04.322 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:04.322 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.322 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:04.323 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:12:04.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.323 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:04.323 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.323 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.324 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.324 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.324 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.324 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:12:04.325 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.325 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.325 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.325 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:04.325 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.326 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.326 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.326 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.326 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.327 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:12:04.327 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.327 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.327 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.327 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:04.328 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.328 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.328 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.328 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.328 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.329 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:12:04.329 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.329 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.329 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.330 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:04.330 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.330 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.330 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.330 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.331 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.331 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:12:04.331 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.331 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.331 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.332 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:04.332 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.332 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.333 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.333 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.333 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.333 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:12:04.334 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.334 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.334 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.334 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:04.334 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.335 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.335 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.335 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.335 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.335 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:12:04.336 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.336 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.336 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.336 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:04.337 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.337 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.337 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.337 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.337 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.338 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:12:04.338 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.338 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.338 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:04.338 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:04.339 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:04.339 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:04.339 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:04.339 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:04.340 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:04.340 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:12:04.340 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:04.340 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.340 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:04.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:12:04.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:12:04.341 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:12:04.341 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:12:04.341 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:12:04.342 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6833/204327833": "2021-10-22T00:11:57.782681+0000", 2021-10-21T00:12:04.343 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.41:6832/204327833": "2021-10-22T00:11:57.782681+0000" 2021-10-21T00:12:04.343 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.343 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:12:04.343 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:12:04.343 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:12:04.344 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:12:04.344 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:12:04.344 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:12:04.344 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:12:04.345 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:12:04.345 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:04.346 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:04.347 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:12:04.347 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:12:04.348 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:12:04.348 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:12:04.348 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:12:04.348 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 msgr2=0x7f2708055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 0x7f2708055b00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f271c01a000 tx=0x7f271c014000).stop 2021-10-21T00:12:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 msgr2=0x7f272c08f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f2720000ed0 tx=0x7f2720007ce0).stop 2021-10-21T00:12:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 shutdown_connections 2021-10-21T00:12:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2708053640 0x7f2708055b00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f272c0b2170 0x7f272c066e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f272c0af620 0x7f272c0ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 --2- 172.21.15.41:0/3041717517 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f272c067a80 0x7f272c08f3c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 >> 172.21.15.41:0/3041717517 conn(0x7f272c0b5700 msgr2=0x7f272c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 shutdown_connections 2021-10-21T00:12:04.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.101+0000 7f27309b6700 1 -- 172.21.15.41:0/3041717517 wait complete. 2021-10-21T00:12:04.354 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:04.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 Processor -- start 2021-10-21T00:12:04.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 -- start start 2021-10-21T00:12:04.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55b80b2170 0x7f55b80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f55b80af620 0x7f55b80ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80b0b50 con 0x7f55b80abb50 2021-10-21T00:12:04.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80b2550 con 0x7f55b80af620 2021-10-21T00:12:04.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55bcaba700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80b0d90 con 0x7f55b80b2170 2021-10-21T00:12:04.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f55b80af620 0x7f55b80ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f55b80af620 0x7f55b80ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37928/0 (socket says 172.21.15.41:37928) 2021-10-21T00:12:04.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 -- 172.21.15.41:0/2288281031 learned_addr learned my addr 172.21.15.41:0/2288281031 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:04.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b77fe700 1 --2- 172.21.15.41:0/2288281031 >> v2:172.21.15.62:3300/0 conn(0x7f55b80b2170 0x7f55b80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 -- 172.21.15.41:0/2288281031 >> v2:172.21.15.62:3300/0 conn(0x7f55b80b2170 msgr2=0x7f55b80ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:04.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 --2- 172.21.15.41:0/2288281031 >> v2:172.21.15.62:3300/0 conn(0x7f55b80b2170 0x7f55b80ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 -- 172.21.15.41:0/2288281031 >> v1:172.21.15.62:6789/0 conn(0x7f55b80abb50 legacy=0x7f55b814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 -- 172.21.15.41:0/2288281031 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80b1030 con 0x7f55b80af620 2021-10-21T00:12:04.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.457+0000 7f55b6ffd700 1 --2- 172.21.15.41:0/2288281031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80af620 0x7f55b80ab660 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f55a8002f70 tx=0x7f55a8006eb0).ready entity=mon.0 client_cookie=add7912f0f9dc418 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55b67fc700 1 -- 172.21.15.41:0/2288281031 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a800d610 con 0x7f55b80af620 2021-10-21T00:12:04.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55b67fc700 1 -- 172.21.15.41:0/2288281031 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8000e90 con 0x7f55b80af620 2021-10-21T00:12:04.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55b67fc700 1 -- 172.21.15.41:0/2288281031 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a800d9a0 con 0x7f55b80af620 2021-10-21T00:12:04.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- 172.21.15.41:0/2288281031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80af620 msgr2=0x7f55b80ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 --2- 172.21.15.41:0/2288281031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80af620 0x7f55b80ab660 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f55a8002f70 tx=0x7f55a8006eb0).stop 2021-10-21T00:12:04.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- 172.21.15.41:0/2288281031 shutdown_connections 2021-10-21T00:12:04.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 --2- 172.21.15.41:0/2288281031 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80af620 0x7f55b80ab660 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 --2- 172.21.15.41:0/2288281031 >> v2:172.21.15.62:3300/0 conn(0x7f55b80b2170 0x7f55b80ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- 172.21.15.41:0/2288281031 >> 172.21.15.41:0/2288281031 conn(0x7f55b80b5700 msgr2=0x7f55b80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:04.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- 172.21.15.41:0/2288281031 shutdown_connections 2021-10-21T00:12:04.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- 172.21.15.41:0/2288281031 wait complete. 2021-10-21T00:12:04.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 Processor -- start 2021-10-21T00:12:04.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.461+0000 7f55bcaba700 1 -- start start 2021-10-21T00:12:04.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55b80abb50 0x7f55b8066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55b80af620 0x7f55b80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80668d0 con 0x7f55b80b2170 2021-10-21T00:12:04.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8066b00 con 0x7f55b80abb50 2021-10-21T00:12:04.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8063760 con 0x7f55b80af620 2021-10-21T00:12:04.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37938/0 (socket says 172.21.15.41:37938) 2021-10-21T00:12:04.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 -- 172.21.15.41:0/3032892370 learned_addr learned my addr 172.21.15.41:0/3032892370 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:04.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b6ffd700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55b80af620 0x7f55b80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b77fe700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55b80abb50 0x7f55b8066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 -- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55b80af620 msgr2=0x7f55b80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55b80af620 0x7f55b80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 -- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55b80abb50 msgr2=0x7f55b8066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55b80abb50 0x7f55b8066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 -- 172.21.15.41:0/3032892370 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a800b1e0 con 0x7f55b80b2170 2021-10-21T00:12:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b7fff700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f55b8062470 tx=0x7f55b0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b0006aa0 con 0x7f55b80b2170 2021-10-21T00:12:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0006c00 con 0x7f55b80b2170 2021-10-21T00:12:04.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b80673c0 con 0x7f55b80b2170 2021-10-21T00:12:04.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b0007030 con 0x7f55b80b2170 2021-10-21T00:12:04.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.465+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b80ae690 con 0x7f55b80b2170 2021-10-21T00:12:04.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55b0010030 con 0x7f55b80b2170 2021-10-21T00:12:04.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b8066cc0 con 0x7f55b80b2170 2021-10-21T00:12:04.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55b4ff9700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 0x7f5598055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f55b006b300 con 0x7f55b80b2170 2021-10-21T00:12:04.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55b77fe700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 0x7f5598055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.469+0000 7f55b77fe700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 0x7f5598055bb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f55ac00c000 tx=0x7f55ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.477+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55b0042740 con 0x7f55b80b2170 2021-10-21T00:12:04.649 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.641+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55b80b0b50 con 0x7f55b80b2170 2021-10-21T00:12:04.650 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.641+0000 7f55b4ff9700 1 -- 172.21.15.41:0/3032892370 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f55b80b0b50 con 0x7f55b80b2170 2021-10-21T00:12:04.651 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:04.651 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/3165137519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3165137519},{"type":"v1","addr":"172.21.15.41:6833","nonce":3165137519}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[]} 2021-10-21T00:12:04.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 msgr2=0x7f5598055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.652 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 0x7f5598055bb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f55ac00c000 tx=0x7f55ac008040).stop 2021-10-21T00:12:04.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 msgr2=0x7f55b8064050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.653 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f55b8062470 tx=0x7f55b0007f70).stop 2021-10-21T00:12:04.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 shutdown_connections 2021-10-21T00:12:04.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55980536f0 0x7f5598055bb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55b80b2170 0x7f55b8064050 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.654 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55b80af620 0x7f55b80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 --2- 172.21.15.41:0/3032892370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55b80abb50 0x7f55b8066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 >> 172.21.15.41:0/3032892370 conn(0x7f55b80b5700 msgr2=0x7f55b8149230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:04.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 shutdown_connections 2021-10-21T00:12:04.655 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.645+0000 7f55bcaba700 1 -- 172.21.15.41:0/3032892370 wait complete. 2021-10-21T00:12:04.656 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 69 2021-10-21T00:12:04.664 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:04.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 Processor -- start 2021-10-21T00:12:04.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 -- start start 2021-10-21T00:12:04.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f92c40aa750 0x7f92c414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40609d0 con 0x7f92c414b350 2021-10-21T00:12:04.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c405fdd0 con 0x7f92c405f9f0 2021-10-21T00:12:04.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c9836700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40b1620 con 0x7f92c40aa750 2021-10-21T00:12:04.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f92c414b350 0x7f92c40af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35716/0 (socket says 172.21.15.41:35716) 2021-10-21T00:12:04.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c37fe700 1 -- 172.21.15.41:0/4189131978 learned_addr learned my addr 172.21.15.41:0/4189131978 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:04.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4189131978 >> v2:172.21.15.41:3300/0 conn(0x7f92c40aa750 0x7f92c414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222914727 0 0) 0x7f92c40609d0 con 0x7f92c414b350 2021-10-21T00:12:04.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a8003260 con 0x7f92c414b350 2021-10-21T00:12:04.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905902161 0 0) 0x7f92c405fdd0 con 0x7f92c405f9f0 2021-10-21T00:12:04.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c40609d0 con 0x7f92c405f9f0 2021-10-21T00:12:04.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953650097 0 0) 0x7f92a8003260 con 0x7f92c414b350 2021-10-21T00:12:04.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 >> v2:172.21.15.41:3300/0 conn(0x7f92c40aa750 msgr2=0x7f92c414ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:04.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 --2- 172.21.15.41:0/4189131978 >> v2:172.21.15.41:3300/0 conn(0x7f92c40aa750 0x7f92c414ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 >> v1:172.21.15.62:6789/0 conn(0x7f92c405f9f0 legacy=0x7f92c414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40b1380 con 0x7f92c414b350 2021-10-21T00:12:04.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f92bc0019e0 con 0x7f92c414b350 2021-10-21T00:12:04.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 >> v1:172.21.15.41:6789/0 conn(0x7f92c414b350 legacy=0x7f92c40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 0x7f92a8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a8004500 0x7f92a8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92a8004e70 0x7f92a800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b1620 con 0x7f92a80038e0 2021-10-21T00:12:04.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a800bcf0 con 0x7f92a8004500 2021-10-21T00:12:04.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a800beb0 con 0x7f92a8004e70 2021-10-21T00:12:04.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 0x7f92a8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4189131978 >> v2:172.21.15.41:3300/0 conn(0x7f92c40aa750 0x7f92c414ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:04.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c37fe700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92a8004e70 0x7f92a800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a8004500 0x7f92a8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92a8004e70 msgr2=0x7f92a800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:04.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92a8004e70 0x7f92a800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a8004500 msgr2=0x7f92a8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:04.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a8004500 0x7f92a8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4189131978 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a8003260 con 0x7f92a80038e0 2021-10-21T00:12:04.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a8004500 0x7f92a8004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:04.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c37fe700 1 -- 172.21.15.41:0/4189131978 reap_dead start 2021-10-21T00:12:04.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 0x7f92a8003ce0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f92b8001110 tx=0x7f92b80079c0).ready entity=mon.0 client_cookie=981799d40a8c5ad5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b8007cd0 con 0x7f92a80038e0 2021-10-21T00:12:04.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8007030 con 0x7f92a80038e0 2021-10-21T00:12:04.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.761+0000 7f92c1ffb700 1 -- 172.21.15.41:0/4189131978 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b8007390 con 0x7f92a80038e0 2021-10-21T00:12:04.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 msgr2=0x7f92a8003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 0x7f92a8003ce0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f92b8001110 tx=0x7f92b80079c0).stop 2021-10-21T00:12:04.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- 172.21.15.41:0/4189131978 shutdown_connections 2021-10-21T00:12:04.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 --2- 172.21.15.41:0/4189131978 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92a80038e0 0x7f92a8003ce0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- 172.21.15.41:0/4189131978 >> 172.21.15.41:0/4189131978 conn(0x7f92c405bca0 msgr2=0x7f92c405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:04.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- 172.21.15.41:0/4189131978 shutdown_connections 2021-10-21T00:12:04.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- 172.21.15.41:0/4189131978 wait complete. 2021-10-21T00:12:04.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 Processor -- start 2021-10-21T00:12:04.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- start start 2021-10-21T00:12:04.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 0x7f92c41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 0x7f92c414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92c40aecf0 0x7f92c4156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4159840 con 0x7f92c4063530 2021-10-21T00:12:04.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c41485e0 con 0x7f92a80038e0 2021-10-21T00:12:04.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c9836700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40adef0 con 0x7f92c40aecf0 2021-10-21T00:12:04.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 0x7f92c414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 0x7f92c414df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37956/0 (socket says 172.21.15.41:37956) 2021-10-21T00:12:04.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c27fc700 1 -- 172.21.15.41:0/4004029845 learned_addr learned my addr 172.21.15.41:0/4004029845 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:04.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 0x7f92c41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.765+0000 7f92c37fe700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92c40aecf0 0x7f92c4156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92c40aecf0 msgr2=0x7f92c4156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92c40aecf0 0x7f92c4156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4004029845 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 msgr2=0x7f92c414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 0x7f92c414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 -- 172.21.15.41:0/4004029845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40ae190 con 0x7f92a80038e0 2021-10-21T00:12:04.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c2ffd700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 0x7f92c41562b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f92b8001110 tx=0x7f92b8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b8007cd0 con 0x7f92a80038e0 2021-10-21T00:12:04.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8020600 con 0x7f92a80038e0 2021-10-21T00:12:04.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40ae430 con 0x7f92a80038e0 2021-10-21T00:12:04.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b8020960 con 0x7f92a80038e0 2021-10-21T00:12:04.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c41570b0 con 0x7f92a80038e0 2021-10-21T00:12:04.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c40ae5c0 con 0x7f92a80038e0 2021-10-21T00:12:04.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.769+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f92b8020ac0 con 0x7f92a80038e0 2021-10-21T00:12:04.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.773+0000 7f92b3fff700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 0x7f92a0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:04.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.773+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f92b801c040 con 0x7f92a80038e0 2021-10-21T00:12:04.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.773+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 0x7f92a0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:04.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.773+0000 7f92c27fc700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 0x7f92a0055b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f92b400b000 tx=0x7f92b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:04.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.781+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92b8043710 con 0x7f92a80038e0 2021-10-21T00:12:04.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.941+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92c40678f0 con 0x7f92a80038e0 2021-10-21T00:12:04.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.941+0000 7f92b3fff700 1 -- 172.21.15.41:0/4004029845 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f92b8046d30 con 0x7f92a80038e0 2021-10-21T00:12:04.952 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:04.952 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7004,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/305417750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":305417750},{"type":"v1","addr":"172.21.15.62:6835","nonce":305417750}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/3165137519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":3165137519},{"type":"v1","addr":"172.21.15.41:6833","nonce":3165137519}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[]} 2021-10-21T00:12:04.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 msgr2=0x7f92a0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 0x7f92a0055b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f92b400b000 tx=0x7f92b4008040).stop 2021-10-21T00:12:04.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 msgr2=0x7f92c41562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:04.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 0x7f92c41562b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f92b8001110 tx=0x7f92b8015000).stop 2021-10-21T00:12:04.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 shutdown_connections 2021-10-21T00:12:04.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f92a00536d0 0x7f92a0055b90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f92c40aecf0 0x7f92c4156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.957 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f92c4063530 0x7f92c414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 --2- 172.21.15.41:0/4004029845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92a80038e0 0x7f92c41562b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:04.958 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 >> 172.21.15.41:0/4004029845 conn(0x7f92c405bca0 msgr2=0x7f92c40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:04.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 shutdown_connections 2021-10-21T00:12:04.959 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:04.945+0000 7f92c9836700 1 -- 172.21.15.41:0/4004029845 wait complete. 2021-10-21T00:12:04.960 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 69 2021-10-21T00:12:04.971 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:12:04.972 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:12:04.972 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:12:04.973 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:12:04.973 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:12:04.974 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:12:04.974 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:12:04.975 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:12:04.988 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:12:04.989 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:12:04.992 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:12:04.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:12:04.993 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:12:04.994 DEBUG:teuthology.parallel:result is None 2021-10-21T00:12:04.996 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:12:04.997 DEBUG:teuthology.parallel:result is None 2021-10-21T00:12:04.998 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:12:05.066 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:12:05.072 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:12:05.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 Processor -- start 2021-10-21T00:12:05.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 -- start start 2021-10-21T00:12:05.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4e200b3370 0x7f4e200b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4e200b0730 0x7f4e20138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2005fdd0 con 0x7f4e2005f9f0 2021-10-21T00:12:05.122 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e20140400 con 0x7f4e200b0730 2021-10-21T00:12:05.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e24d62700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200b27c0 con 0x7f4e200b3370 2021-10-21T00:12:05.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1f7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4e2005f9f0 0x7f4e200b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35750/0 (socket says 172.21.15.41:35750) 2021-10-21T00:12:05.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1f7fe700 1 -- 172.21.15.41:0/1810542239 learned_addr learned my addr 172.21.15.41:0/1810542239 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:05.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 --2- 172.21.15.41:0/1810542239 >> v2:172.21.15.41:3300/0 conn(0x7f4e200b0730 0x7f4e20138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1effd700 1 --2- 172.21.15.41:0/1810542239 >> v2:172.21.15.62:3300/0 conn(0x7f4e200b3370 0x7f4e200b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1e7fc700 1 -- 172.21.15.41:0/1810542239 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597303469 0 0) 0x7f4e2005fdd0 con 0x7f4e2005f9f0 2021-10-21T00:12:05.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1e7fc700 1 -- 172.21.15.41:0/1810542239 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e00003260 con 0x7f4e2005f9f0 2021-10-21T00:12:05.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 -- 172.21.15.41:0/1810542239 >> v2:172.21.15.62:3300/0 conn(0x7f4e200b3370 msgr2=0x7f4e200b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:05.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 --2- 172.21.15.41:0/1810542239 >> v2:172.21.15.62:3300/0 conn(0x7f4e200b3370 0x7f4e200b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:05.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 -- 172.21.15.41:0/1810542239 >> v1:172.21.15.41:6789/0 conn(0x7f4e2005f9f0 legacy=0x7f4e200b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:05.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 -- 172.21.15.41:0/1810542239 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20140080 con 0x7f4e200b0730 2021-10-21T00:12:05.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1ffff700 1 --2- 172.21.15.41:0/1810542239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20138b60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f4e2013f630 tx=0x7f4e18006df0).ready entity=mon.0 client_cookie=2a8472af90f9a424 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:05.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1e7fc700 1 -- 172.21.15.41:0/1810542239 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1800d5c0 con 0x7f4e200b0730 2021-10-21T00:12:05.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1e7fc700 1 -- 172.21.15.41:0/1810542239 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18000e90 con 0x7f4e200b0730 2021-10-21T00:12:05.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.089+0000 7f4e1e7fc700 1 -- 172.21.15.41:0/1810542239 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1800d910 con 0x7f4e200b0730 2021-10-21T00:12:05.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- 172.21.15.41:0/1810542239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 msgr2=0x7f4e20138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:05.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1810542239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20138b60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f4e2013f630 tx=0x7f4e18006df0).stop 2021-10-21T00:12:05.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- 172.21.15.41:0/1810542239 shutdown_connections 2021-10-21T00:12:05.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1810542239 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20138b60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:05.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1810542239 >> v2:172.21.15.62:3300/0 conn(0x7f4e200b3370 0x7f4e200b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:05.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- 172.21.15.41:0/1810542239 >> 172.21.15.41:0/1810542239 conn(0x7f4e200637b0 msgr2=0x7f4e20063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:05.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- 172.21.15.41:0/1810542239 shutdown_connections 2021-10-21T00:12:05.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- 172.21.15.41:0/1810542239 wait complete. 2021-10-21T00:12:05.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 Processor -- start 2021-10-21T00:12:05.128 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- start start 2021-10-21T00:12:05.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e2005f9f0 0x7f4e2013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e200b3370 0x7f4e20132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20066b80 con 0x7f4e200b0730 2021-10-21T00:12:05.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20140db0 con 0x7f4e2005f9f0 2021-10-21T00:12:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e24d62700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2013a8c0 con 0x7f4e200b3370 2021-10-21T00:12:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e1effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:37988/0 (socket says 172.21.15.41:37988) 2021-10-21T00:12:05.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e1effd700 1 -- 172.21.15.41:0/1102157386 learned_addr learned my addr 172.21.15.41:0/1102157386 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:05.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e1ffff700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e200b3370 0x7f4e20132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.093+0000 7f4e1f7fe700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e2005f9f0 0x7f4e2013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 -- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e200b3370 msgr2=0x7f4e20132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:05.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e200b3370 0x7f4e20132a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 -- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e2005f9f0 msgr2=0x7f4e2013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e2005f9f0 0x7f4e2013dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 -- 172.21.15.41:0/1102157386 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1800b180 con 0x7f4e200b0730 2021-10-21T00:12:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.097+0000 7f4e1effd700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f4e080030b0 tx=0x7f4e08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:05.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e08011780 con 0x7f4e200b0730 2021-10-21T00:12:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2013ae00 con 0x7f4e200b0730 2021-10-21T00:12:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2013b320 con 0x7f4e200b0730 2021-10-21T00:12:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080118e0 con 0x7f4e200b0730 2021-10-21T00:12:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e08011c40 con 0x7f4e200b0730 2021-10-21T00:12:05.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8003410 con 0x7f4e200b0730 2021-10-21T00:12:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e08012420 con 0x7f4e200b0730 2021-10-21T00:12:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.101+0000 7f4e1cff9700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 0x7f4e04055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.105+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4e0806b5c0 con 0x7f4e200b0730 2021-10-21T00:12:05.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.105+0000 7f4e1f7fe700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 0x7f4e04055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.105+0000 7f4e1f7fe700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 0x7f4e04055a40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4e1000b000 tx=0x7f4e10009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:05.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.109+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e08042810 con 0x7f4e200b0730 2021-10-21T00:12:05.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:05.249+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4df8003c40 con 0x7f4e200b0730 2021-10-21T00:12:06.141 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.121+0000 7f4e1cff9700 1 -- 172.21.15.41:0/1102157386 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e08045e30 con 0x7f4e200b0730 2021-10-21T00:12:06.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.121+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 msgr2=0x7f4e04055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.121+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 0x7f4e04055a40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4e1000b000 tx=0x7f4e10009040).stop 2021-10-21T00:12:06.142 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.121+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 msgr2=0x7f4e20132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f4e080030b0 tx=0x7f4e08008040).stop 2021-10-21T00:12:06.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 shutdown_connections 2021-10-21T00:12:06.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e04053580 0x7f4e04055a40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e200b3370 0x7f4e20132a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e200b0730 0x7f4e20132510 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 --2- 172.21.15.41:0/1102157386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e2005f9f0 0x7f4e2013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 >> 172.21.15.41:0/1102157386 conn(0x7f4e200637b0 msgr2=0x7f4e200b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 shutdown_connections 2021-10-21T00:12:06.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.125+0000 7f4e24d62700 1 -- 172.21.15.41:0/1102157386 wait complete. 2021-10-21T00:12:06.145 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:12:06.150 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:12:06.151 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:12:06.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 Processor -- start 2021-10-21T00:12:06.262 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 -- start start 2021-10-21T00:12:06.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f34c80b9c70 0x7f34c8143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c8142bc0 con 0x7f34c80b3bc0 2021-10-21T00:12:06.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c81429a0 con 0x7f34c80b9c70 2021-10-21T00:12:06.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cf59f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80ba050 con 0x7f34c81418f0 2021-10-21T00:12:06.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34cd33b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f34c80b9c70 0x7f34c8143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34ccb3a700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f34c80b3bc0 0x7f34c8143510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35766/0 (socket says 172.21.15.41:35766) 2021-10-21T00:12:06.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.253+0000 7f34ccb3a700 1 -- 172.21.15.41:0/3061792687 learned_addr learned my addr 172.21.15.41:0/3061792687 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:06.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cdb3c700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cd33b700 1 -- 172.21.15.41:0/3061792687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 msgr2=0x7f34c8141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:06.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cd33b700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cd33b700 1 -- 172.21.15.41:0/3061792687 >> v1:172.21.15.41:6789/0 conn(0x7f34c80b3bc0 legacy=0x7f34c8143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34bffff700 1 -- 172.21.15.41:0/3061792687 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532017463 0 0) 0x7f34c8142bc0 con 0x7f34c80b3bc0 2021-10-21T00:12:06.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cd33b700 1 -- 172.21.15.41:0/3061792687 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c81463c0 con 0x7f34c80b9c70 2021-10-21T00:12:06.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cd33b700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8143020 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f34b8002f70 tx=0x7f34b8006df0).ready entity=mon.0 client_cookie=68d2e45837d0bd34 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34bffff700 1 -- 172.21.15.41:0/3061792687 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b800d570 con 0x7f34c80b9c70 2021-10-21T00:12:06.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34bffff700 1 -- 172.21.15.41:0/3061792687 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8000e90 con 0x7f34c80b9c70 2021-10-21T00:12:06.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34bffff700 1 -- 172.21.15.41:0/3061792687 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b800d8c0 con 0x7f34c80b9c70 2021-10-21T00:12:06.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 -- 172.21.15.41:0/3061792687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 msgr2=0x7f34c8143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8143020 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f34b8002f70 tx=0x7f34b8006df0).stop 2021-10-21T00:12:06.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 -- 172.21.15.41:0/3061792687 shutdown_connections 2021-10-21T00:12:06.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3061792687 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8143020 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 -- 172.21.15.41:0/3061792687 >> 172.21.15.41:0/3061792687 conn(0x7f34c8062e80 msgr2=0x7f34c80b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 -- 172.21.15.41:0/3061792687 shutdown_connections 2021-10-21T00:12:06.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.257+0000 7f34cf59f700 1 -- 172.21.15.41:0/3061792687 wait complete. 2021-10-21T00:12:06.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 Processor -- start 2021-10-21T00:12:06.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 -- start start 2021-10-21T00:12:06.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34c80b3bc0 0x7f34c80ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80ade40 con 0x7f34c80b9c70 2021-10-21T00:12:06.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8113c50 con 0x7f34c80b3bc0 2021-10-21T00:12:06.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cf59f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8113ef0 con 0x7f34c81418f0 2021-10-21T00:12:06.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38002/0 (socket says 172.21.15.41:38002) 2021-10-21T00:12:06.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 -- 172.21.15.41:0/3720752155 learned_addr learned my addr 172.21.15.41:0/3720752155 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:06.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cdb3c700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34cd33b700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34c80b3bc0 0x7f34c80ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 -- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 msgr2=0x7f34c8112410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8112410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 -- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34c80b3bc0 msgr2=0x7f34c80ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34c80b3bc0 0x7f34c80ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.261+0000 7f34ccb3a700 1 -- 172.21.15.41:0/3720752155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b800b180 con 0x7f34c80b9c70 2021-10-21T00:12:06.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34ccb3a700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f34c4000ed0 tx=0x7f34c4007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c40070d0 con 0x7f34c80b9c70 2021-10-21T00:12:06.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c4007230 con 0x7f34c80b9c70 2021-10-21T00:12:06.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c8114880 con 0x7f34c80b9c70 2021-10-21T00:12:06.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c4005610 con 0x7f34c80b9c70 2021-10-21T00:12:06.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c8112900 con 0x7f34c80b9c70 2021-10-21T00:12:06.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c80adc90 con 0x7f34c80b9c70 2021-10-21T00:12:06.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.265+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f34c401a060 con 0x7f34c80b9c70 2021-10-21T00:12:06.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.269+0000 7f34be7fc700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 0x7f34b00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.269+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f34c406adb0 con 0x7f34c80b9c70 2021-10-21T00:12:06.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.269+0000 7f34cd33b700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 0x7f34b00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.269+0000 7f34cd33b700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 0x7f34b00559b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f34b801a000 tx=0x7f34b8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.273+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f34c4042240 con 0x7f34c80b9c70 2021-10-21T00:12:06.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.441+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f34c8146120 con 0x7f34c80b9c70 2021-10-21T00:12:06.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34be7fc700 1 -- 172.21.15.41:0/3720752155 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f34c4018070 con 0x7f34c80b9c70 2021-10-21T00:12:06.453 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:06.453 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:06.454 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:12:06.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.455 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:12:06.455 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:12:06.455 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:06.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.456 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.456 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.456 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.457 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.457 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.457 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:12:06.457 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:12:06.457 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:06.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.458 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.458 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.459 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.459 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.459 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.459 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:12:06.459 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:12:06.460 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.460 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.460 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.460 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.461 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.461 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.461 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:12:06.461 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:12:06.462 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.462 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.462 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.462 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.462 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.463 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.463 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:12:06.463 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:12:06.464 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.464 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.464 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.464 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.465 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.465 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:12:06.465 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:12:06.466 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.466 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.466 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.466 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.467 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.467 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.467 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.467 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:12:06.467 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:12:06.468 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.468 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.468 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.468 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.469 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.469 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.469 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:12:06.470 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:12:06.470 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.470 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.470 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.470 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.471 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.471 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.471 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.471 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:12:06.471 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:12:06.472 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.472 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.472 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.472 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.473 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.473 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:12:06.473 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:12:06.474 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.474 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.474 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.474 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.475 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.475 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.475 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.475 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:12:06.476 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:12:06.476 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.476 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:06.476 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:06.476 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:06.477 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.479 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.479 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.479 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:12:06.480 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:12:06.480 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.480 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:06.481 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:06.481 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:06.481 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.481 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.481 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.482 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:12:06.482 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:12:06.482 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.482 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:06.483 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:06.483 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:06.483 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.483 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.483 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.484 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:12:06.484 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:12:06.484 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.485 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:06.485 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:06.485 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:06.485 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.485 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.486 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.486 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:12:06.486 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:12:06.487 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.487 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:06.487 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:12:06.487 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.487 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.488 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:06.488 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:06.488 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:12:06.488 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:12:06.489 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:06.489 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:06.489 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:12:06.490 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:06.490 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.490 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:06.490 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:06.490 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:06.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 msgr2=0x7f34b00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 0x7f34b00559b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f34b801a000 tx=0x7f34b8014000).stop 2021-10-21T00:12:06.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 msgr2=0x7f34c8114390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f34c4000ed0 tx=0x7f34c4007ac0).stop 2021-10-21T00:12:06.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 shutdown_connections 2021-10-21T00:12:06.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f34b00534f0 0x7f34b00559b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34c81418f0 0x7f34c8112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f34c80b9c70 0x7f34c8114390 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 --2- 172.21.15.41:0/3720752155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34c80b3bc0 0x7f34c80ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 >> 172.21.15.41:0/3720752155 conn(0x7f34c8062e80 msgr2=0x7f34c8140e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 shutdown_connections 2021-10-21T00:12:06.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.445+0000 7f34cf59f700 1 -- 172.21.15.41:0/3720752155 wait complete. 2021-10-21T00:12:06.499 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:06.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 Processor -- start 2021-10-21T00:12:06.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- start start 2021-10-21T00:12:06.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36e40ac640 0x7f36e40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f36e40b25d0 0x7f36e4147690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40acae0 con 0x7f36e405f850 2021-10-21T00:12:06.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40acd80 con 0x7f36e40b25d0 2021-10-21T00:12:06.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40ad020 con 0x7f36e40ac640 2021-10-21T00:12:06.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e8cd9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f36e405f850 0x7f36e40b19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35780/0 (socket says 172.21.15.41:35780) 2021-10-21T00:12:06.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e8cd9700 1 -- 172.21.15.41:0/2778626188 learned_addr learned my addr 172.21.15.41:0/2778626188 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:06.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e94da700 1 --2- 172.21.15.41:0/2778626188 >> v2:172.21.15.41:3300/0 conn(0x7f36e40b25d0 0x7f36e4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 --2- 172.21.15.41:0/2778626188 >> v2:172.21.15.62:3300/0 conn(0x7f36e40ac640 0x7f36e40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e37fe700 1 -- 172.21.15.41:0/2778626188 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279385904 0 0) 0x7f36e40acae0 con 0x7f36e405f850 2021-10-21T00:12:06.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e37fe700 1 -- 172.21.15.41:0/2778626188 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c4003260 con 0x7f36e405f850 2021-10-21T00:12:06.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 -- 172.21.15.41:0/2778626188 >> v2:172.21.15.41:3300/0 conn(0x7f36e40b25d0 msgr2=0x7f36e4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:06.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 --2- 172.21.15.41:0/2778626188 >> v2:172.21.15.41:3300/0 conn(0x7f36e40b25d0 0x7f36e4147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 -- 172.21.15.41:0/2778626188 >> v1:172.21.15.41:6789/0 conn(0x7f36e405f850 legacy=0x7f36e40b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 -- 172.21.15.41:0/2778626188 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e405fc30 con 0x7f36e40ac640 2021-10-21T00:12:06.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e3fff700 1 --2- 172.21.15.41:0/2778626188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40ac640 0x7f36e40b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f36d4002f70 tx=0x7f36d4006df0).ready entity=mon.1 client_cookie=b07de28cef5465fc server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e37fe700 1 -- 172.21.15.41:0/2778626188 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36d400d4f0 con 0x7f36e40ac640 2021-10-21T00:12:06.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e37fe700 1 -- 172.21.15.41:0/2778626188 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d4000e90 con 0x7f36e40ac640 2021-10-21T00:12:06.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36e37fe700 1 -- 172.21.15.41:0/2778626188 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36d400d840 con 0x7f36e40ac640 2021-10-21T00:12:06.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- 172.21.15.41:0/2778626188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40ac640 msgr2=0x7f36e40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/2778626188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40ac640 0x7f36e40b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f36d4002f70 tx=0x7f36d4006df0).stop 2021-10-21T00:12:06.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- 172.21.15.41:0/2778626188 shutdown_connections 2021-10-21T00:12:06.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/2778626188 >> v2:172.21.15.41:3300/0 conn(0x7f36e40b25d0 0x7f36e4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/2778626188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40ac640 0x7f36e40b20e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- 172.21.15.41:0/2778626188 >> 172.21.15.41:0/2778626188 conn(0x7f36e40b7030 msgr2=0x7f36e40b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- 172.21.15.41:0/2778626188 shutdown_connections 2021-10-21T00:12:06.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.601+0000 7f36eaf3d700 1 -- 172.21.15.41:0/2778626188 wait complete. 2021-10-21T00:12:06.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 Processor -- start 2021-10-21T00:12:06.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- start start 2021-10-21T00:12:06.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36e40ac640 0x7f36e414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 0x7f36e40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4067500 con 0x7f36e405f850 2021-10-21T00:12:06.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40af430 con 0x7f36e40b25d0 2021-10-21T00:12:06.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4065520 con 0x7f36e40ac640 2021-10-21T00:12:06.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e94da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 0x7f36e40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38016/0 (socket says 172.21.15.41:38016) 2021-10-21T00:12:06.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36e40ac640 0x7f36e414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 -- 172.21.15.41:0/260762791 learned_addr learned my addr 172.21.15.41:0/260762791 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:06.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 -- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36e40ac640 msgr2=0x7f36e414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36e40ac640 0x7f36e414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 -- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 msgr2=0x7f36e40af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 0x7f36e40af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 -- 172.21.15.41:0/260762791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d400b180 con 0x7f36e405f850 2021-10-21T00:12:06.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e94da700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 0x7f36e40af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:06.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e8cd9700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f36cc001110 tx=0x7f36cc007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc00ce20 con 0x7f36e405f850 2021-10-21T00:12:06.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc0070d0 con 0x7f36e405f850 2021-10-21T00:12:06.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e40b0f70 con 0x7f36e405f850 2021-10-21T00:12:06.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc007430 con 0x7f36e405f850 2021-10-21T00:12:06.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.605+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e40b0bf0 con 0x7f36e405f850 2021-10-21T00:12:06.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.609+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e40adf70 con 0x7f36e405f850 2021-10-21T00:12:06.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.609+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f36cc010070 con 0x7f36e405f850 2021-10-21T00:12:06.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.609+0000 7f36e1ffb700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 0x7f36c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.609+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f36cc06aae0 con 0x7f36e405f850 2021-10-21T00:12:06.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.609+0000 7f36e3fff700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 0x7f36c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.613+0000 7f36e3fff700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 0x7f36c8055ad0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f36d401a000 tx=0x7f36d4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.617+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f36cc045e60 con 0x7f36e405f850 2021-10-21T00:12:06.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.745+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36e4057350 con 0x7f36e405f850 2021-10-21T00:12:06.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.745+0000 7f36e1ffb700 1 -- 172.21.15.41:0/260762791 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f36cc045e60 con 0x7f36e405f850 2021-10-21T00:12:06.755 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:06.755 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":132,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:06.115122+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:06.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 msgr2=0x7f36c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 0x7f36c8055ad0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f36d401a000 tx=0x7f36d4014000).stop 2021-10-21T00:12:06.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 msgr2=0x7f36e4147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f36cc001110 tx=0x7f36cc007aa0).stop 2021-10-21T00:12:06.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 shutdown_connections 2021-10-21T00:12:06.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f36c8053610 0x7f36c8055ad0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36e40b25d0 0x7f36e40af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f36e40ac640 0x7f36e414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 --2- 172.21.15.41:0/260762791 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f36e405f850 0x7f36e4147750 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 >> 172.21.15.41:0/260762791 conn(0x7f36e40b7030 msgr2=0x7f36e40b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 shutdown_connections 2021-10-21T00:12:06.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.749+0000 7f36eaf3d700 1 -- 172.21.15.41:0/260762791 wait complete. 2021-10-21T00:12:06.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:12:06.771 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:06.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 Processor -- start 2021-10-21T00:12:06.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 -- start start 2021-10-21T00:12:06.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c640639e0 0x7f6c64142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c6413c7a0 0x7f6c6413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6405c430 con 0x7f6c640b0eb0 2021-10-21T00:12:06.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6405fb60 con 0x7f6c640639e0 2021-10-21T00:12:06.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6bbc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6405c6d0 con 0x7f6c6413c7a0 2021-10-21T00:12:06.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c640639e0 0x7f6c64142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c6a166700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c6413c7a0 0x7f6c6413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c640639e0 0x7f6c64142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:49940/0 (socket says 172.21.15.41:49940) 2021-10-21T00:12:06.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 -- 172.21.15.41:0/1380592215 learned_addr learned my addr 172.21.15.41:0/1380592215 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:06.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 -- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c6413c7a0 msgr2=0x7f6c6413cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:06.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 --2- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c6413c7a0 0x7f6c6413cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 -- 172.21.15.41:0/1380592215 >> v1:172.21.15.62:6789/0 conn(0x7f6c640b0eb0 legacy=0x7f6c6405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.873+0000 7f6c69965700 1 -- 172.21.15.41:0/1380592215 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6405c970 con 0x7f6c640639e0 2021-10-21T00:12:06.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c69965700 1 --2- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c640639e0 0x7f6c64142bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6c600032f0 tx=0x7f6c60009290).ready entity=mon.1 client_cookie=a1f8feeb3c6ea443 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c68963700 1 -- 172.21.15.41:0/1380592215 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6000b8a0 con 0x7f6c640639e0 2021-10-21T00:12:06.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c68963700 1 -- 172.21.15.41:0/1380592215 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000ba00 con 0x7f6c640639e0 2021-10-21T00:12:06.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c68963700 1 -- 172.21.15.41:0/1380592215 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6000bb70 con 0x7f6c640639e0 2021-10-21T00:12:06.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c640639e0 msgr2=0x7f6c64142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c640639e0 0x7f6c64142bf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f6c600032f0 tx=0x7f6c60009290).stop 2021-10-21T00:12:06.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1380592215 shutdown_connections 2021-10-21T00:12:06.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c6413c7a0 0x7f6c6413cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1380592215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c640639e0 0x7f6c64142bf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1380592215 >> 172.21.15.41:0/1380592215 conn(0x7f6c64061e00 msgr2=0x7f6c64069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:06.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1380592215 shutdown_connections 2021-10-21T00:12:06.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1380592215 wait complete. 2021-10-21T00:12:06.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 Processor -- start 2021-10-21T00:12:06.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 -- start start 2021-10-21T00:12:06.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.877+0000 7f6c6bbc9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c640639e0 0x7f6c64152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 0x7f6c64064ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 0x7f6c64066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64142860 con 0x7f6c640b0eb0 2021-10-21T00:12:06.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64065e90 con 0x7f6c6413c7a0 2021-10-21T00:12:06.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64066130 con 0x7f6c640639e0 2021-10-21T00:12:06.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c69164700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 0x7f6c64064ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 0x7f6c64066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c69965700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c640639e0 0x7f6c64152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c69164700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 0x7f6c64064ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38032/0 (socket says 172.21.15.41:38032) 2021-10-21T00:12:06.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c69164700 1 -- 172.21.15.41:0/1983886079 learned_addr learned my addr 172.21.15.41:0/1983886079 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:06.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 -- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c640639e0 msgr2=0x7f6c64152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c640639e0 0x7f6c64152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 -- 172.21.15.41:0/1983886079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 msgr2=0x7f6c64064ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:06.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 0x7f6c64064ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:06.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 -- 172.21.15.41:0/1983886079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009530 con 0x7f6c6413c7a0 2021-10-21T00:12:06.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6a166700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 0x7f6c64066870 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f6c5c00c000 tx=0x7f6c5c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c011750 con 0x7f6c6413c7a0 2021-10-21T00:12:06.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0118b0 con 0x7f6c6413c7a0 2021-10-21T00:12:06.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640663d0 con 0x7f6c6413c7a0 2021-10-21T00:12:06.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c5c011c10 con 0x7f6c6413c7a0 2021-10-21T00:12:06.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c64066d60 con 0x7f6c6413c7a0 2021-10-21T00:12:06.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c64066590 con 0x7f6c6413c7a0 2021-10-21T00:12:06.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.881+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c5c011d70 con 0x7f6c6413c7a0 2021-10-21T00:12:06.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.885+0000 7f6c52ffd700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 0x7f6c44055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:06.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.885+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6c5c06b8a0 con 0x7f6c6413c7a0 2021-10-21T00:12:06.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.885+0000 7f6c69965700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 0x7f6c44055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:06.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.885+0000 7f6c69965700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 0x7f6c44055a70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f6c6001b000 tx=0x7f6c60016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:06.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:06.893+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c5c042d30 con 0x7f6c6413c7a0 2021-10-21T00:12:07.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.021+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6c64063e30 con 0x7f6c6413c7a0 2021-10-21T00:12:07.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.021+0000 7f6c52ffd700 1 -- 172.21.15.41:0/1983886079 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v132) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6c5c046350 con 0x7f6c6413c7a0 2021-10-21T00:12:07.030 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:07.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 msgr2=0x7f6c44055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 0x7f6c44055a70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f6c6001b000 tx=0x7f6c60016000).stop 2021-10-21T00:12:07.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 msgr2=0x7f6c64066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 0x7f6c64066870 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f6c5c00c000 tx=0x7f6c5c006df0).stop 2021-10-21T00:12:07.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 shutdown_connections 2021-10-21T00:12:07.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f6c440535b0 0x7f6c44055a70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c6413c7a0 0x7f6c64066870 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f6c640b0eb0 0x7f6c64064ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 --2- 172.21.15.41:0/1983886079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c640639e0 0x7f6c64152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 >> 172.21.15.41:0/1983886079 conn(0x7f6c64061e00 msgr2=0x7f6c641440c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 shutdown_connections 2021-10-21T00:12:07.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.025+0000 7f6c6bbc9700 1 -- 172.21.15.41:0/1983886079 wait complete. 2021-10-21T00:12:07.049 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:07.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 Processor -- start 2021-10-21T00:12:07.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 -- start start 2021-10-21T00:12:07.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4cc0b31e0 0x7fd4cc0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc0ba080 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc05c670 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4d0b5a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc05c8e0 con 0x7fd4cc0b24b0 2021-10-21T00:12:07.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38036/0 (socket says 172.21.15.41:38036) 2021-10-21T00:12:07.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 -- 172.21.15.41:0/4202687500 learned_addr learned my addr 172.21.15.41:0/4202687500 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4cad9d700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4c3fff700 1 --2- 172.21.15.41:0/4202687500 >> v2:172.21.15.62:3300/0 conn(0x7fd4cc0b31e0 0x7fd4cc0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 -- 172.21.15.41:0/4202687500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 msgr2=0x7fd4cc0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:07.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 -- 172.21.15.41:0/4202687500 >> v2:172.21.15.62:3300/0 conn(0x7fd4cc0b31e0 msgr2=0x7fd4cc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:07.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/4202687500 >> v2:172.21.15.62:3300/0 conn(0x7fd4cc0b31e0 0x7fd4cc0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 -- 172.21.15.41:0/4202687500 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc05cb80 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fd4bc002f70 tx=0x7fd4bc006eb0).ready entity=mon.0 client_cookie=be76506d99616e3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.149+0000 7fd4c9d9b700 1 -- 172.21.15.41:0/4202687500 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc00d570 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4c9d9b700 1 -- 172.21.15.41:0/4202687500 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc000e90 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4c9d9b700 1 -- 172.21.15.41:0/4202687500 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc00d900 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/4202687500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b9ca0 msgr2=0x7fd4cc0b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fd4bc002f70 tx=0x7fd4bc006eb0).stop 2021-10-21T00:12:07.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/4202687500 shutdown_connections 2021-10-21T00:12:07.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/4202687500 >> v2:172.21.15.62:3300/0 conn(0x7fd4cc0b31e0 0x7fd4cc0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/4202687500 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc0b0690 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/4202687500 >> 172.21.15.41:0/4202687500 conn(0x7fd4cc062f00 msgr2=0x7fd4cc0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/4202687500 shutdown_connections 2021-10-21T00:12:07.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/4202687500 wait complete. 2021-10-21T00:12:07.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 Processor -- start 2021-10-21T00:12:07.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.153+0000 7fd4d0b5a700 1 -- start start 2021-10-21T00:12:07.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0afdb0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0aed90 con 0x7fd4cc0b9ca0 2021-10-21T00:12:07.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0b9110 con 0x7fd4cc0b24b0 2021-10-21T00:12:07.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38044/0 (socket says 172.21.15.41:38044) 2021-10-21T00:12:07.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 -- 172.21.15.41:0/404712349 learned_addr learned my addr 172.21.15.41:0/404712349 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4cad9d700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 -- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 msgr2=0x7fd4cc0b8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 -- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 msgr2=0x7fd4cc141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 -- 172.21.15.41:0/404712349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc00b1e0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4cad9d700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:07.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c3fff700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd4b400c000 tx=0x7fd4b4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b4010780 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc155340 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40108e0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b4010c40 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc0afa30 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc057350 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.157+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4b4026430 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.161+0000 7fd4c37fe700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 0x7fd4b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.161+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd4b406c4b0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.161+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 0x7fd4b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.161+0000 7fd4ca59c700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 0x7fd4b0055b60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fd4bc01c000 tx=0x7fd4bc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.169+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4b40438e0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.293+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4cc0affd0 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.293+0000 7fd4c37fe700 1 -- 172.21.15.41:0/404712349 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4b4046f00 con 0x7fd4cc0b31e0 2021-10-21T00:12:07.304 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:07.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 msgr2=0x7fd4b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 0x7fd4b0055b60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fd4bc01c000 tx=0x7fd4bc015000).stop 2021-10-21T00:12:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 msgr2=0x7fd4cc140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd4b400c000 tx=0x7fd4b4006df0).stop 2021-10-21T00:12:07.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 shutdown_connections 2021-10-21T00:12:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd4b00536a0 0x7fd4b0055b60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4cc0b9ca0 0x7fd4cc141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd4cc0b31e0 0x7fd4cc140c80 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 --2- 172.21.15.41:0/404712349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4cc0b24b0 0x7fd4cc0b8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 >> 172.21.15.41:0/404712349 conn(0x7fd4cc062f00 msgr2=0x7fd4cc142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 shutdown_connections 2021-10-21T00:12:07.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.297+0000 7fd4d0b5a700 1 -- 172.21.15.41:0/404712349 wait complete. 2021-10-21T00:12:07.316 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:12:07.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.409+0000 7fca7c85a700 1 Processor -- start 2021-10-21T00:12:07.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.409+0000 7fca7c85a700 1 -- start start 2021-10-21T00:12:07.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780601b0 0x7fca78143250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca780b09e0 0x7fca7813f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fca7813f680 0x7fca7805f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca78142870 con 0x7fca7813f680 2021-10-21T00:12:07.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca78142b10 con 0x7fca780b09e0 2021-10-21T00:12:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7c85a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca78142db0 con 0x7fca780601b0 2021-10-21T00:12:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fca7813f680 0x7fca7805f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca75d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca780b09e0 0x7fca7813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fca7813f680 0x7fca7805f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38054/0 (socket says 172.21.15.41:38054) 2021-10-21T00:12:07.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca7659c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780601b0 0x7fca78143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 -- 172.21.15.41:0/351413717 learned_addr learned my addr 172.21.15.41:0/351413717 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 -- 172.21.15.41:0/351413717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780601b0 msgr2=0x7fca78143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:07.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 --2- 172.21.15.41:0/351413717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780601b0 0x7fca78143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 -- 172.21.15.41:0/351413717 >> v2:172.21.15.62:3300/0 conn(0x7fca780b09e0 msgr2=0x7fca7813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:07.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 --2- 172.21.15.41:0/351413717 >> v2:172.21.15.62:3300/0 conn(0x7fca780b09e0 0x7fca7813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 -- 172.21.15.41:0/351413717 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78060590 con 0x7fca7813f680 2021-10-21T00:12:07.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.413+0000 7fca76d9d700 1 --2- 172.21.15.41:0/351413717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7805f780 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fca700032f0 tx=0x7fca70009290).ready entity=mon.0 client_cookie=9dbbfc7eca8e670d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7559a700 1 -- 172.21.15.41:0/351413717 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7000b680 con 0x7fca7813f680 2021-10-21T00:12:07.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7559a700 1 -- 172.21.15.41:0/351413717 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000b7e0 con 0x7fca7813f680 2021-10-21T00:12:07.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7559a700 1 -- 172.21.15.41:0/351413717 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7000b950 con 0x7fca7813f680 2021-10-21T00:12:07.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- 172.21.15.41:0/351413717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 msgr2=0x7fca7805f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.432 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 --2- 172.21.15.41:0/351413717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7805f780 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fca700032f0 tx=0x7fca70009290).stop 2021-10-21T00:12:07.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- 172.21.15.41:0/351413717 shutdown_connections 2021-10-21T00:12:07.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 --2- 172.21.15.41:0/351413717 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7805f780 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 --2- 172.21.15.41:0/351413717 >> v2:172.21.15.62:3300/0 conn(0x7fca780b09e0 0x7fca7813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 --2- 172.21.15.41:0/351413717 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780601b0 0x7fca78143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- 172.21.15.41:0/351413717 >> 172.21.15.41:0/351413717 conn(0x7fca7805bca0 msgr2=0x7fca7805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- 172.21.15.41:0/351413717 shutdown_connections 2021-10-21T00:12:07.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- 172.21.15.41:0/351413717 wait complete. 2021-10-21T00:12:07.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 Processor -- start 2021-10-21T00:12:07.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.417+0000 7fca7c85a700 1 -- start start 2021-10-21T00:12:07.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca780601b0 0x7fca78066de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780b09e0 0x7fca78138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780ad2a0 con 0x7fca7813f680 2021-10-21T00:12:07.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca781395c0 con 0x7fca780601b0 2021-10-21T00:12:07.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca78138530 con 0x7fca780b09e0 2021-10-21T00:12:07.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38060/0 (socket says 172.21.15.41:38060) 2021-10-21T00:12:07.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 -- 172.21.15.41:0/4291162867 learned_addr learned my addr 172.21.15.41:0/4291162867 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7659c700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca780601b0 0x7fca78066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca75d9b700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780b09e0 0x7fca78138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 -- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780b09e0 msgr2=0x7fca78138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780b09e0 0x7fca78138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 -- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca780601b0 msgr2=0x7fca78066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca780601b0 0x7fca78066de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 -- 172.21.15.41:0/4291162867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70009530 con 0x7fca7813f680 2021-10-21T00:12:07.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca76d9d700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fca700032f0 tx=0x7fca70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7001f070 con 0x7fca7813f680 2021-10-21T00:12:07.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70011e80 con 0x7fca7813f680 2021-10-21T00:12:07.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781397b0 con 0x7fca7813f680 2021-10-21T00:12:07.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca7000b680 con 0x7fca7813f680 2021-10-21T00:12:07.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7813e640 con 0x7fca7813f680 2021-10-21T00:12:07.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.421+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca780ac630 con 0x7fca7813f680 2021-10-21T00:12:07.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.425+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca7000f070 con 0x7fca7813f680 2021-10-21T00:12:07.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.425+0000 7fca677fe700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 0x7fca540559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.425+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fca7006cb90 con 0x7fca7813f680 2021-10-21T00:12:07.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.425+0000 7fca7659c700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 0x7fca540559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.425+0000 7fca7659c700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 0x7fca540559e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fca6c00b000 tx=0x7fca6c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.429+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca70043f10 con 0x7fca7813f680 2021-10-21T00:12:07.566 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.557+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca78057350 con 0x7fca7813f680 2021-10-21T00:12:07.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.557+0000 7fca677fe700 1 -- 172.21.15.41:0/4291162867 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+143 (secure 0 0 0) 0x7fca7000bea0 con 0x7fca7813f680 2021-10-21T00:12:07.612 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:07.612 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:12:07.612 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:07.612 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:12:07.613 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:12:07.613 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:07.613 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:07.613 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:12:07.614 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:12:07.614 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:07.614 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:12:07.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 msgr2=0x7fca540559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 0x7fca540559e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fca6c00b000 tx=0x7fca6c006df0).stop 2021-10-21T00:12:07.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 msgr2=0x7fca7813e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fca700032f0 tx=0x7fca70017000).stop 2021-10-21T00:12:07.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 shutdown_connections 2021-10-21T00:12:07.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fca54053520 0x7fca540559e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fca7813f680 0x7fca7813e150 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca780b09e0 0x7fca78138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 --2- 172.21.15.41:0/4291162867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca780601b0 0x7fca78066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 >> 172.21.15.41:0/4291162867 conn(0x7fca7805bca0 msgr2=0x7fca780985a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 shutdown_connections 2021-10-21T00:12:07.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.561+0000 7fca7c85a700 1 -- 172.21.15.41:0/4291162867 wait complete. 2021-10-21T00:12:07.619 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:12:07.619 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:12:07.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.721+0000 7f21393f9700 1 Processor -- start 2021-10-21T00:12:07.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.721+0000 7f21393f9700 1 -- start start 2021-10-21T00:12:07.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b5e90 0x7f21340b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f21340b1d10 0x7f21340ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340afb40 con 0x7f21340b13a0 2021-10-21T00:12:07.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340b0e00 con 0x7f21340b1d10 2021-10-21T00:12:07.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340af7a0 con 0x7f21340b5e90 2021-10-21T00:12:07.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f21340b1d10 0x7f21340ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f21340b1d10 0x7f21340ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38066/0 (socket says 172.21.15.41:38066) 2021-10-21T00:12:07.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 -- 172.21.15.41:0/1650137652 learned_addr learned my addr 172.21.15.41:0/1650137652 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f2133fff700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b5e90 0x7f21340b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 -- 172.21.15.41:0/1650137652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b5e90 msgr2=0x7f21340b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:07.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b5e90 0x7f21340b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 -- 172.21.15.41:0/1650137652 >> v1:172.21.15.62:6789/0 conn(0x7f21340b13a0 legacy=0x7f2134142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 -- 172.21.15.41:0/1650137652 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340af910 con 0x7f21340b1d10 2021-10-21T00:12:07.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21337fe700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b1d10 0x7f21340ad280 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f213413f3d0 tx=0x7f2128006eb0).ready entity=mon.0 client_cookie=7bc04edd2df3ebb6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f2132ffd700 1 -- 172.21.15.41:0/1650137652 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2128014070 con 0x7f21340b1d10 2021-10-21T00:12:07.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f2132ffd700 1 -- 172.21.15.41:0/1650137652 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128000e90 con 0x7f21340b1d10 2021-10-21T00:12:07.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f2132ffd700 1 -- 172.21.15.41:0/1650137652 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f212800eaf0 con 0x7f21340b1d10 2021-10-21T00:12:07.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- 172.21.15.41:0/1650137652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b1d10 msgr2=0x7f21340ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b1d10 0x7f21340ad280 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f213413f3d0 tx=0x7f2128006eb0).stop 2021-10-21T00:12:07.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- 172.21.15.41:0/1650137652 shutdown_connections 2021-10-21T00:12:07.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b1d10 0x7f21340ad280 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 --2- 172.21.15.41:0/1650137652 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b5e90 0x7f21340b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.725+0000 7f21393f9700 1 -- 172.21.15.41:0/1650137652 >> 172.21.15.41:0/1650137652 conn(0x7f2134063b80 msgr2=0x7f21340b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:07.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- 172.21.15.41:0/1650137652 shutdown_connections 2021-10-21T00:12:07.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- 172.21.15.41:0/1650137652 wait complete. 2021-10-21T00:12:07.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 Processor -- start 2021-10-21T00:12:07.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- start start 2021-10-21T00:12:07.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 0x7f2134065c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 0x7f213413bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134065530 con 0x7f21340b13a0 2021-10-21T00:12:07.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134064f20 con 0x7f21340b5e90 2021-10-21T00:12:07.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f21393f9700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2134065760 con 0x7f21340b1d10 2021-10-21T00:12:07.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f2133fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f2133fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38070/0 (socket says 172.21.15.41:38070) 2021-10-21T00:12:07.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.729+0000 7f2133fff700 1 -- 172.21.15.41:0/741749147 learned_addr learned my addr 172.21.15.41:0/741749147 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:07.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2138bf8700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 0x7f213413bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21337fe700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 0x7f2134065c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 -- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 msgr2=0x7f2134065c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 0x7f2134065c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 -- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 msgr2=0x7f213413bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:07.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 0x7f213413bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:07.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 -- 172.21.15.41:0/741749147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212800b1e0 con 0x7f21340b13a0 2021-10-21T00:12:07.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2138bf8700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 0x7f213413bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:07.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21337fe700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 0x7f2134065c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:07.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f2133fff700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f212400c000 tx=0x7f2124006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2124010780 con 0x7f21340b13a0 2021-10-21T00:12:07.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21240108e0 con 0x7f21340b13a0 2021-10-21T00:12:07.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2124010c40 con 0x7f21340b13a0 2021-10-21T00:12:07.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21340660f0 con 0x7f21340b13a0 2021-10-21T00:12:07.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2134142420 con 0x7f21340b13a0 2021-10-21T00:12:07.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2134065920 con 0x7f21340b13a0 2021-10-21T00:12:07.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f212401c460 con 0x7f21340b13a0 2021-10-21T00:12:07.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 0x7f2114055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:07.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f212406bb00 con 0x7f21340b13a0 2021-10-21T00:12:07.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.733+0000 7f21337fe700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 0x7f2114055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:07.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.737+0000 7f21337fe700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 0x7f2114055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2128017000 tx=0x7f2128016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:07.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.741+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2124042e90 con 0x7f21340b13a0 2021-10-21T00:12:07.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:07.865+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f21341428f0 con 0x7f21340b13a0 2021-10-21T00:12:08.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.429+0000 7f21317fa700 1 -- 172.21.15.41:0/741749147 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v133) v1 ==== 133+0+0 (secure 0 0 0) 0x7f21240464b0 con 0x7f21340b13a0 2021-10-21T00:12:08.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 msgr2=0x7f2114055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 0x7f2114055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2128017000 tx=0x7f2128016000).stop 2021-10-21T00:12:08.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 msgr2=0x7f21340b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f212400c000 tx=0x7f2124006df0).stop 2021-10-21T00:12:08.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 shutdown_connections 2021-10-21T00:12:08.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2114053610 0x7f2114055ad0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21340b5e90 0x7f213413bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340b1d10 0x7f2134065c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 --2- 172.21.15.41:0/741749147 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f21340b13a0 0x7f21340b4be0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 >> 172.21.15.41:0/741749147 conn(0x7f2134063b80 msgr2=0x7f2134142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:08.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 shutdown_connections 2021-10-21T00:12:08.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.437+0000 7f21393f9700 1 -- 172.21.15.41:0/741749147 wait complete. 2021-10-21T00:12:08.448 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:12:08.460 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:12:08.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.565+0000 7f476ffff700 1 Processor -- start 2021-10-21T00:12:08.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.565+0000 7f476ffff700 1 -- start start 2021-10-21T00:12:08.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f47700b5f70 0x7f47700b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f47701423a0 0x7f47700672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700b6350 con 0x7f47700677e0 2021-10-21T00:12:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47700b0e10 con 0x7f47700b5f70 2021-10-21T00:12:08.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47700b10b0 con 0x7f47701423a0 2021-10-21T00:12:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f47700b5f70 0x7f47700b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f47700b5f70 0x7f47700b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38078/0 (socket says 172.21.15.41:38078) 2021-10-21T00:12:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 -- 172.21.15.41:0/1449539692 learned_addr learned my addr 172.21.15.41:0/1449539692 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:08.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f4767fff700 1 --2- 172.21.15.41:0/1449539692 >> v2:172.21.15.62:3300/0 conn(0x7f47701423a0 0x7f47700672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 -- 172.21.15.41:0/1449539692 >> v2:172.21.15.62:3300/0 conn(0x7f47701423a0 msgr2=0x7f47700672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:08.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 --2- 172.21.15.41:0/1449539692 >> v2:172.21.15.62:3300/0 conn(0x7f47701423a0 0x7f47700672f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 -- 172.21.15.41:0/1449539692 >> v1:172.21.15.62:6789/0 conn(0x7f47700677e0 legacy=0x7f477013ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 -- 172.21.15.41:0/1449539692 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700b1350 con 0x7f47700b5f70 2021-10-21T00:12:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476effd700 1 --2- 172.21.15.41:0/1449539692 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f47700b1a90 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4760002f70 tx=0x7f4760006e40).ready entity=mon.0 client_cookie=5a554246bd90e0c8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476e7fc700 1 -- 172.21.15.41:0/1449539692 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f476000bcb0 con 0x7f47700b5f70 2021-10-21T00:12:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476e7fc700 1 -- 172.21.15.41:0/1449539692 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4760000e90 con 0x7f47700b5f70 2021-10-21T00:12:08.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476e7fc700 1 -- 172.21.15.41:0/1449539692 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47600153f0 con 0x7f47700b5f70 2021-10-21T00:12:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 -- 172.21.15.41:0/1449539692 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 msgr2=0x7f47700b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.569+0000 7f476ffff700 1 --2- 172.21.15.41:0/1449539692 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f47700b1a90 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f4760002f70 tx=0x7f4760006e40).stop 2021-10-21T00:12:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- 172.21.15.41:0/1449539692 shutdown_connections 2021-10-21T00:12:08.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 --2- 172.21.15.41:0/1449539692 >> v2:172.21.15.62:3300/0 conn(0x7f47701423a0 0x7f47700672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 --2- 172.21.15.41:0/1449539692 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f47700b1a90 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- 172.21.15.41:0/1449539692 >> 172.21.15.41:0/1449539692 conn(0x7f47700639f0 msgr2=0x7f47700b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- 172.21.15.41:0/1449539692 shutdown_connections 2021-10-21T00:12:08.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- 172.21.15.41:0/1449539692 wait complete. 2021-10-21T00:12:08.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 Processor -- start 2021-10-21T00:12:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- start start 2021-10-21T00:12:08.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47700677e0 0x7f47701127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47701423a0 0x7f477013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770067610 con 0x7f47700b5f70 2021-10-21T00:12:08.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477010ff00 con 0x7f47701423a0 2021-10-21T00:12:08.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47701101a0 con 0x7f47700677e0 2021-10-21T00:12:08.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f4767fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f4767fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38084/0 (socket says 172.21.15.41:38084) 2021-10-21T00:12:08.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f4767fff700 1 -- 172.21.15.41:0/970868793 learned_addr learned my addr 172.21.15.41:0/970868793 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:08.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476effd700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47700677e0 0x7f47701127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.573+0000 7f476f7fe700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47701423a0 0x7f477013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 -- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47700677e0 msgr2=0x7f47701127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47700677e0 0x7f47701127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 -- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47701423a0 msgr2=0x7f477013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:08.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47701423a0 0x7f477013c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:08.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 -- 172.21.15.41:0/970868793 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476000d4d0 con 0x7f47700b5f70 2021-10-21T00:12:08.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f4767fff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f475800c000 tx=0x7f4758006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:08.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4758011750 con 0x7f47700b5f70 2021-10-21T00:12:08.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47580118b0 con 0x7f47700b5f70 2021-10-21T00:12:08.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770110440 con 0x7f47700b5f70 2021-10-21T00:12:08.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4758011c10 con 0x7f47700b5f70 2021-10-21T00:12:08.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477010f890 con 0x7f47700b5f70 2021-10-21T00:12:08.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47700b15f0 con 0x7f47700b5f70 2021-10-21T00:12:08.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.577+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4758011d70 con 0x7f47700b5f70 2021-10-21T00:12:08.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.581+0000 7f476cff9700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 0x7f4754055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:08.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.581+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f475806bb70 con 0x7f47700b5f70 2021-10-21T00:12:08.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.581+0000 7f476effd700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 0x7f4754055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:08.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.581+0000 7f476effd700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 0x7f4754055ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f4760006fc0 tx=0x7f4760018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:08.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.585+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4758042e40 con 0x7f47700b5f70 2021-10-21T00:12:08.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:08.713+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4770057350 con 0x7f47700b5f70 2021-10-21T00:12:09.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.113+0000 7f476cff9700 1 -- 172.21.15.41:0/970868793 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v134) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4758046460 con 0x7f47700b5f70 2021-10-21T00:12:09.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 msgr2=0x7f4754055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.129 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 0x7f4754055ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f4760006fc0 tx=0x7f4760018000).stop 2021-10-21T00:12:09.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 msgr2=0x7f477010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f475800c000 tx=0x7f4758006df0).stop 2021-10-21T00:12:09.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 shutdown_connections 2021-10-21T00:12:09.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4754053610 0x7f4754055ad0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47701423a0 0x7f477013c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f47700b5f70 0x7f477010ea50 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 --2- 172.21.15.41:0/970868793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47700677e0 0x7f47701127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 >> 172.21.15.41:0/970868793 conn(0x7f47700639f0 msgr2=0x7f47700b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 shutdown_connections 2021-10-21T00:12:09.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.121+0000 7f476ffff700 1 -- 172.21.15.41:0/970868793 wait complete. 2021-10-21T00:12:09.132 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:12:09.143 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:12:09.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 Processor -- start 2021-10-21T00:12:09.253 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 -- start start 2021-10-21T00:12:09.254 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f467c0b4040 0x7f467c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c05f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.256 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c1409d0 con 0x7f467c0ad1b0 2021-10-21T00:12:09.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c140c70 con 0x7f467c0b4040 2021-10-21T00:12:09.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f4680a35700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c067c70 con 0x7f467c0b1830 2021-10-21T00:12:09.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f467c0b4040 0x7f467c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f467c0b4040 0x7f467c0b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38092/0 (socket says 172.21.15.41:38092) 2021-10-21T00:12:09.257 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 -- 172.21.15.41:0/3119857680 learned_addr learned my addr 172.21.15.41:0/3119857680 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:09.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467bfff700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c05f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 -- 172.21.15.41:0/3119857680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 msgr2=0x7f467c05f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c05f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 -- 172.21.15.41:0/3119857680 >> v1:172.21.15.62:6789/0 conn(0x7f467c0ad1b0 legacy=0x7f467c141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 -- 172.21.15.41:0/3119857680 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c05fcb0 con 0x7f467c0b4040 2021-10-21T00:12:09.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.245+0000 7f467b7fe700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c0b4420 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f466c002f70 tx=0x7f466c006eb0).ready entity=mon.0 client_cookie=6c92db9e88d74eee server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f467affd700 1 -- 172.21.15.41:0/3119857680 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466c00d570 con 0x7f467c0b4040 2021-10-21T00:12:09.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f467affd700 1 -- 172.21.15.41:0/3119857680 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c000e90 con 0x7f467c0b4040 2021-10-21T00:12:09.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f467affd700 1 -- 172.21.15.41:0/3119857680 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466c00d900 con 0x7f467c0b4040 2021-10-21T00:12:09.263 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- 172.21.15.41:0/3119857680 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 msgr2=0x7f467c0b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c0b4420 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f466c002f70 tx=0x7f466c006eb0).stop 2021-10-21T00:12:09.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- 172.21.15.41:0/3119857680 shutdown_connections 2021-10-21T00:12:09.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c05f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 --2- 172.21.15.41:0/3119857680 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c0b4420 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.264 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- 172.21.15.41:0/3119857680 >> 172.21.15.41:0/3119857680 conn(0x7f467c0b7960 msgr2=0x7f467c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- 172.21.15.41:0/3119857680 shutdown_connections 2021-10-21T00:12:09.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- 172.21.15.41:0/3119857680 wait complete. 2021-10-21T00:12:09.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 Processor -- start 2021-10-21T00:12:09.265 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.249+0000 7f4680a35700 1 -- start start 2021-10-21T00:12:09.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 0x7f467c143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c061b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c061470 con 0x7f467c0b4040 2021-10-21T00:12:09.266 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c156090 con 0x7f467c0ad1b0 2021-10-21T00:12:09.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0616a0 con 0x7f467c0b1830 2021-10-21T00:12:09.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c061b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 0x7f467c143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 0x7f467c143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50016/0 (socket says 172.21.15.41:50016) 2021-10-21T00:12:09.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467b7fe700 1 -- 172.21.15.41:0/4124402040 learned_addr learned my addr 172.21.15.41:0/4124402040 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:09.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4672ffd700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 -- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 msgr2=0x7f467c153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 -- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 msgr2=0x7f467c143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 0x7f467c143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 -- 172.21.15.41:0/4124402040 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c00b1e0 con 0x7f467c0b4040 2021-10-21T00:12:09.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f467bfff700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c061b40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f467400c000 tx=0x7f46740091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.269 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467400c670 con 0x7f467c0b4040 2021-10-21T00:12:09.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400c7d0 con 0x7f467c0b4040 2021-10-21T00:12:09.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c155cc0 con 0x7f467c0b4040 2021-10-21T00:12:09.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f467400cb30 con 0x7f467c0b4040 2021-10-21T00:12:09.270 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.253+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c09a430 con 0x7f467c0b4040 2021-10-21T00:12:09.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c057350 con 0x7f467c0b4040 2021-10-21T00:12:09.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4674022070 con 0x7f467c0b4040 2021-10-21T00:12:09.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f46797fa700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 0x7f4660055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f467406bed0 con 0x7f467c0b4040 2021-10-21T00:12:09.273 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f467b7fe700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 0x7f4660055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.257+0000 7f467b7fe700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 0x7f4660055a40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f466c01c000 tx=0x7f466c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.274 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.261+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46740430a0 con 0x7f467c0b4040 2021-10-21T00:12:09.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.429+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f467c061870 con 0x7f467c0b4040 2021-10-21T00:12:09.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.441+0000 7f46797fa700 1 -- 172.21.15.41:0/4124402040 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v71) v1 ==== 189+0+0 (secure 0 0 0) 0x7f46740160d0 con 0x7f467c0b4040 2021-10-21T00:12:09.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 msgr2=0x7f4660055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 0x7f4660055a40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f466c01c000 tx=0x7f466c015000).stop 2021-10-21T00:12:09.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 msgr2=0x7f467c061b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c061b40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f467400c000 tx=0x7f46740091d0).stop 2021-10-21T00:12:09.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 shutdown_connections 2021-10-21T00:12:09.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4660053580 0x7f4660055a40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f467c0b4040 0x7f467c061b40 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f467c0b1830 0x7f467c153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 --2- 172.21.15.41:0/4124402040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467c0ad1b0 0x7f467c143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 >> 172.21.15.41:0/4124402040 conn(0x7f467c0b7960 msgr2=0x7f467c0abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 shutdown_connections 2021-10-21T00:12:09.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.445+0000 7f4680a35700 1 -- 172.21.15.41:0/4124402040 wait complete. 2021-10-21T00:12:09.456 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 27 and data pool 28 2021-10-21T00:12:09.471 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:09.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 Processor -- start 2021-10-21T00:12:09.567 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 -- start start 2021-10-21T00:12:09.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcacc067a80 0x7fcacc0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0b0b50 con 0x7fcacc0af620 2021-10-21T00:12:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0b2550 con 0x7fcacc0b2170 2021-10-21T00:12:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad2765700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0b0d90 con 0x7fcacc067a80 2021-10-21T00:12:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad0f62700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fcacc0af620 0x7fcacc149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35878/0 (socket says 172.21.15.41:35878) 2021-10-21T00:12:09.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.557+0000 7fcad0f62700 1 -- 172.21.15.41:0/3627961765 learned_addr learned my addr 172.21.15.41:0/3627961765 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112255698 0 0) 0x7fcabc001110 con 0x7fcacc0af620 2021-10-21T00:12:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad1f64700 1 --2- 172.21.15.41:0/3627961765 >> v2:172.21.15.62:3300/0 conn(0x7fcacc067a80 0x7fcacc0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab4003260 con 0x7fcacc0af620 2021-10-21T00:12:09.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2745370387 0 0) 0x7fcab4003260 con 0x7fcacc0af620 2021-10-21T00:12:09.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 >> v2:172.21.15.62:3300/0 conn(0x7fcacc067a80 msgr2=0x7fcacc0ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 --2- 172.21.15.41:0/3627961765 >> v2:172.21.15.62:3300/0 conn(0x7fcacc067a80 0x7fcacc0ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 >> v1:172.21.15.62:6789/0 conn(0x7fcacc0b2170 legacy=0x7fcacc0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.577 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0b1030 con 0x7fcacc0af620 2021-10-21T00:12:09.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7fcabc0017f0 con 0x7fcacc0af620 2021-10-21T00:12:09.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 >> v1:172.21.15.41:6789/0 conn(0x7fcacc0af620 legacy=0x7fcacc149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4003780 0x7fcab4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.578 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcab4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4004e70 0x7fcab400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0b0d90 con 0x7fcab4004500 2021-10-21T00:12:09.579 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400bd20 con 0x7fcab4003780 2021-10-21T00:12:09.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400bee0 con 0x7fcab4004e70 2021-10-21T00:12:09.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcab4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad1f64700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4004e70 0x7fcab400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad1763700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4003780 0x7fcab4003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 -- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4004e70 msgr2=0x7fcab400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcab4004e70 0x7fcab400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 -- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4003780 msgr2=0x7fcab4003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4003780 0x7fcab4003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 -- 172.21.15.41:0/3627961765 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4003260 con 0x7fcab4004500 2021-10-21T00:12:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad1f64700 1 -- 172.21.15.41:0/3627961765 reap_dead start 2021-10-21T00:12:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad1763700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcab4003780 0x7fcab4003ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad0f62700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcab4004980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fcabc001500 tx=0x7fcacc0b11c0).ready entity=mon.0 client_cookie=88e27d4cf798f736 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc0070d0 con 0x7fcab4004500 2021-10-21T00:12:09.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc007230 con 0x7fcab4004500 2021-10-21T00:12:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcabbfff700 1 -- 172.21.15.41:0/3627961765 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00c940 con 0x7fcab4004500 2021-10-21T00:12:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 -- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 msgr2=0x7fcab4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcab4004980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fcabc001500 tx=0x7fcacc0b11c0).stop 2021-10-21T00:12:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 -- 172.21.15.41:0/3627961765 shutdown_connections 2021-10-21T00:12:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 --2- 172.21.15.41:0/3627961765 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcab4004980 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 -- 172.21.15.41:0/3627961765 >> 172.21.15.41:0/3627961765 conn(0x7fcacc0b5700 msgr2=0x7fcacc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 -- 172.21.15.41:0/3627961765 shutdown_connections 2021-10-21T00:12:09.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.561+0000 7fcad2765700 1 -- 172.21.15.41:0/3627961765 wait complete. 2021-10-21T00:12:09.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 Processor -- start 2021-10-21T00:12:09.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- start start 2021-10-21T00:12:09.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 0x7fcacc147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcacc147c30 0x7fcacc065b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc066ae0 con 0x7fcab4004500 2021-10-21T00:12:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0aebc0 con 0x7fcacc147c30 2021-10-21T00:12:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1480c0 con 0x7fcacc149c90 2021-10-21T00:12:09.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38120/0 (socket says 172.21.15.41:38120) 2021-10-21T00:12:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 -- 172.21.15.41:0/1810061958 learned_addr learned my addr 172.21.15.41:0/1810061958 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1f64700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcacc147c30 0x7fcacc065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad0f62700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 0x7fcacc147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 -- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 msgr2=0x7fcacc147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 0x7fcacc147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 -- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcacc147c30 msgr2=0x7fcacc065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcacc147c30 0x7fcacc065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 -- 172.21.15.41:0/1810061958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0ae570 con 0x7fcab4004500 2021-10-21T00:12:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad0f62700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 0x7fcacc147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad1763700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fcac800b000 tx=0x7fcac8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8014620 con 0x7fcab4004500 2021-10-21T00:12:09.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8014780 con 0x7fcab4004500 2021-10-21T00:12:09.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc067240 con 0x7fcab4004500 2021-10-21T00:12:09.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8014ae0 con 0x7fcab4004500 2021-10-21T00:12:09.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.565+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc065ff0 con 0x7fcab4004500 2021-10-21T00:12:09.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc066c20 con 0x7fcab4004500 2021-10-21T00:12:09.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcac8014c40 con 0x7fcab4004500 2021-10-21T00:12:09.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcaba7fc700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcac806be40 con 0x7fcab4004500 2021-10-21T00:12:09.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcad0f62700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.569+0000 7fcad0f62700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 0x7fcaac055ad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fcabc006000 tx=0x7fcabc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.573+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcacc066c20 con 0x7fcab4004500 2021-10-21T00:12:09.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.701+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcacc066c20 con 0x7fcab4004500 2021-10-21T00:12:09.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.701+0000 7fcaba7fc700 1 -- 172.21.15.41:0/1810061958 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fcacc066c20 con 0x7fcab4004500 2021-10-21T00:12:09.710 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:09.711 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":135,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:09.433560+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:07.923124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:08.769999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:09.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 msgr2=0x7fcaac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 0x7fcaac055ad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fcabc006000 tx=0x7fcabc015000).stop 2021-10-21T00:12:09.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 msgr2=0x7fcacc0b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fcac800b000 tx=0x7fcac8009040).stop 2021-10-21T00:12:09.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 shutdown_connections 2021-10-21T00:12:09.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fcaac053610 0x7fcaac055ad0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcacc147c30 0x7fcacc065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcacc149c90 0x7fcacc147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 --2- 172.21.15.41:0/1810061958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fcab4004500 0x7fcacc0b37b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 >> 172.21.15.41:0/1810061958 conn(0x7fcacc0b5700 msgr2=0x7fcacc05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 shutdown_connections 2021-10-21T00:12:09.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.705+0000 7fcad2765700 1 -- 172.21.15.41:0/1810061958 wait complete. 2021-10-21T00:12:09.724 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:09.826 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 Processor -- start 2021-10-21T00:12:09.827 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 -- start start 2021-10-21T00:12:09.828 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f15780b2170 0x7f15780ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 0x7f1578149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780b0b50 con 0x7f15780af620 2021-10-21T00:12:09.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780b2550 con 0x7f15780b2170 2021-10-21T00:12:09.829 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157d8c4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780b0d90 con 0x7f1578067a80 2021-10-21T00:12:09.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157c8c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f15780b2170 0x7f15780ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157c8c2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f15780b2170 0x7f15780ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38128/0 (socket says 172.21.15.41:38128) 2021-10-21T00:12:09.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.817+0000 7f157c8c2700 1 -- 172.21.15.41:0/1702795876 learned_addr learned my addr 172.21.15.41:0/1702795876 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:09.830 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d0c3700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 0x7f1578149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157c8c2700 1 -- 172.21.15.41:0/1702795876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 msgr2=0x7f1578149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157c8c2700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 0x7f1578149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157c8c2700 1 -- 172.21.15.41:0/1702795876 >> v1:172.21.15.62:6789/0 conn(0x7f15780af620 legacy=0x7f15780ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:09.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157c8c2700 1 -- 172.21.15.41:0/1702795876 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780b1030 con 0x7f15780b2170 2021-10-21T00:12:09.831 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d0c3700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 0x7f1578149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:09.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157c8c2700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780b2170 0x7f15780ab170 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f157805d270 tx=0x7f1568009290).ready entity=mon.0 client_cookie=20cf516b92983087 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f15777fe700 1 -- 172.21.15.41:0/1702795876 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156800b860 con 0x7f15780b2170 2021-10-21T00:12:09.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f15777fe700 1 -- 172.21.15.41:0/1702795876 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156800b9c0 con 0x7f15780b2170 2021-10-21T00:12:09.832 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f15777fe700 1 -- 172.21.15.41:0/1702795876 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156800bb70 con 0x7f15780b2170 2021-10-21T00:12:09.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- 172.21.15.41:0/1702795876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780b2170 msgr2=0x7f15780ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780b2170 0x7f15780ab170 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f157805d270 tx=0x7f1568009290).stop 2021-10-21T00:12:09.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- 172.21.15.41:0/1702795876 shutdown_connections 2021-10-21T00:12:09.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1578067a80 0x7f1578149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 --2- 172.21.15.41:0/1702795876 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780b2170 0x7f15780ab170 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- 172.21.15.41:0/1702795876 >> 172.21.15.41:0/1702795876 conn(0x7f15780b5700 msgr2=0x7f15780b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.837 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- 172.21.15.41:0/1702795876 shutdown_connections 2021-10-21T00:12:09.838 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- 172.21.15.41:0/1702795876 wait complete. 2021-10-21T00:12:09.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 Processor -- start 2021-10-21T00:12:09.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.821+0000 7f157d8c4700 1 -- start start 2021-10-21T00:12:09.839 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1578067a80 0x7f15780ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15780b2170 0x7f1578064570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780aed70 con 0x7f15780af620 2021-10-21T00:12:09.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780aefa0 con 0x7f1578067a80 2021-10-21T00:12:09.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1578065830 con 0x7f15780b2170 2021-10-21T00:12:09.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38136/0 (socket says 172.21.15.41:38136) 2021-10-21T00:12:09.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 -- 172.21.15.41:0/871196082 learned_addr learned my addr 172.21.15.41:0/871196082 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:09.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157c8c2700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1578067a80 0x7f15780ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d0c3700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15780b2170 0x7f1578064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 -- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15780b2170 msgr2=0x7f1578064570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15780b2170 0x7f1578064570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 -- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1578067a80 msgr2=0x7f15780ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1578067a80 0x7f15780ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 -- 172.21.15.41:0/871196082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568009530 con 0x7f15780af620 2021-10-21T00:12:09.843 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1577fff700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f156c001fa0 tx=0x7f156c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156c007030 con 0x7f15780af620 2021-10-21T00:12:09.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780636f0 con 0x7f15780af620 2021-10-21T00:12:09.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c007190 con 0x7f15780af620 2021-10-21T00:12:09.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f156c006510 con 0x7f15780af620 2021-10-21T00:12:09.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15780ad130 con 0x7f15780af620 2021-10-21T00:12:09.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1578063880 con 0x7f15780af620 2021-10-21T00:12:09.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.825+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f156c010030 con 0x7f15780af620 2021-10-21T00:12:09.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.829+0000 7f1575ffb700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 0x7f1558055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:09.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.829+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f156c06b590 con 0x7f15780af620 2021-10-21T00:12:09.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.829+0000 7f157c8c2700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 0x7f1558055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:09.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.829+0000 7f157c8c2700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 0x7f1558055b60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f156801b000 tx=0x7f1568016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:09.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.833+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f156c042650 con 0x7f15780af620 2021-10-21T00:12:09.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.957+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15780b12d0 con 0x7f15780af620 2021-10-21T00:12:09.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f1575ffb700 1 -- 172.21.15.41:0/871196082 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f156c045c70 con 0x7f15780af620 2021-10-21T00:12:09.969 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:09.970 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":135,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:09.433560+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:07.923124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:08.769999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:09.971 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 msgr2=0x7f1558055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 0x7f1558055b60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f156801b000 tx=0x7f1568016000).stop 2021-10-21T00:12:09.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 msgr2=0x7f1578065340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:09.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f156c001fa0 tx=0x7f156c007c00).stop 2021-10-21T00:12:09.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 shutdown_connections 2021-10-21T00:12:09.972 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f15580536a0 0x7f1558055b60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15780b2170 0x7f1578064570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f15780af620 0x7f1578065340 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 --2- 172.21.15.41:0/871196082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1578067a80 0x7f15780ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:09.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 >> 172.21.15.41:0/871196082 conn(0x7f15780b5700 msgr2=0x7f15780b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:09.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 shutdown_connections 2021-10-21T00:12:09.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:09.961+0000 7f157d8c4700 1 -- 172.21.15.41:0/871196082 wait complete. 2021-10-21T00:12:09.983 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:12:10.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 Processor -- start 2021-10-21T00:12:10.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 -- start start 2021-10-21T00:12:10.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49c0067a80 0x7f49c00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b0b50 con 0x7f49c00b2170 2021-10-21T00:12:10.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b2550 con 0x7f49c00af620 2021-10-21T00:12:10.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c00b0d90 con 0x7f49c0067a80 2021-10-21T00:12:10.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49beffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f49c00b2170 0x7f49c00ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35914/0 (socket says 172.21.15.41:35914) 2021-10-21T00:12:10.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49beffd700 1 -- 172.21.15.41:0/4063437027 learned_addr learned my addr 172.21.15.41:0/4063437027 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:10.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.085+0000 7f49bf7fe700 1 --2- 172.21.15.41:0/4063437027 >> v2:172.21.15.62:3300/0 conn(0x7f49c0067a80 0x7f49c00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bdffb700 1 -- 172.21.15.41:0/4063437027 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003740867 0 0) 0x7f49b4001110 con 0x7f49c00b2170 2021-10-21T00:12:10.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bdffb700 1 -- 172.21.15.41:0/4063437027 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a4003260 con 0x7f49c00b2170 2021-10-21T00:12:10.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bf7fe700 1 -- 172.21.15.41:0/4063437027 >> v1:172.21.15.62:6789/0 conn(0x7f49c00af620 legacy=0x7f49c0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bf7fe700 1 -- 172.21.15.41:0/4063437027 >> v1:172.21.15.41:6789/0 conn(0x7f49c00b2170 legacy=0x7f49c00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bf7fe700 1 -- 172.21.15.41:0/4063437027 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00b1030 con 0x7f49c0067a80 2021-10-21T00:12:10.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bf7fe700 1 --2- 172.21.15.41:0/4063437027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c0067a80 0x7f49c00ab880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f49c00aafa0 tx=0x7f49b80091d0).ready entity=mon.1 client_cookie=ca27855e28af0705 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bdffb700 1 -- 172.21.15.41:0/4063437027 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800b680 con 0x7f49c0067a80 2021-10-21T00:12:10.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bdffb700 1 -- 172.21.15.41:0/4063437027 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b800b7e0 con 0x7f49c0067a80 2021-10-21T00:12:10.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bdffb700 1 -- 172.21.15.41:0/4063437027 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800b950 con 0x7f49c0067a80 2021-10-21T00:12:10.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- 172.21.15.41:0/4063437027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c0067a80 msgr2=0x7f49c00ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 --2- 172.21.15.41:0/4063437027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c0067a80 0x7f49c00ab880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f49c00aafa0 tx=0x7f49b80091d0).stop 2021-10-21T00:12:10.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- 172.21.15.41:0/4063437027 shutdown_connections 2021-10-21T00:12:10.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 --2- 172.21.15.41:0/4063437027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c0067a80 0x7f49c00ab880 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- 172.21.15.41:0/4063437027 >> 172.21.15.41:0/4063437027 conn(0x7f49c00b5700 msgr2=0x7f49c00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:10.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- 172.21.15.41:0/4063437027 shutdown_connections 2021-10-21T00:12:10.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- 172.21.15.41:0/4063437027 wait complete. 2021-10-21T00:12:10.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 Processor -- start 2021-10-21T00:12:10.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.089+0000 7f49bffff700 1 -- start start 2021-10-21T00:12:10.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49c0067a80 0x7f49c0147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c00af620 0x7f49c00ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00ad370 con 0x7f49c00b2170 2021-10-21T00:12:10.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0148000 con 0x7f49c00af620 2021-10-21T00:12:10.109 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0065560 con 0x7f49c0067a80 2021-10-21T00:12:10.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38152/0 (socket says 172.21.15.41:38152) 2021-10-21T00:12:10.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 -- 172.21.15.41:0/3589482626 learned_addr learned my addr 172.21.15.41:0/3589482626 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:10.110 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49beffd700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49c0067a80 0x7f49c0147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49be7fc700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c00af620 0x7f49c00ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 -- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49c0067a80 msgr2=0x7f49c0147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.111 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49c0067a80 0x7f49c0147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 -- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c00af620 msgr2=0x7f49c00ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c00af620 0x7f49c00ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 -- 172.21.15.41:0/3589482626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8009470 con 0x7f49c00b2170 2021-10-21T00:12:10.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bf7fe700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f49c00aafa0 tx=0x7f49b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800b680 con 0x7f49c00b2170 2021-10-21T00:12:10.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8021630 con 0x7f49c00b2170 2021-10-21T00:12:10.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c0065a30 con 0x7f49c00b2170 2021-10-21T00:12:10.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b8021990 con 0x7f49c00b2170 2021-10-21T00:12:10.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c00ad5e0 con 0x7f49c00b2170 2021-10-21T00:12:10.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.093+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f49b8029070 con 0x7f49c00b2170 2021-10-21T00:12:10.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.097+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0065720 con 0x7f49c00b2170 2021-10-21T00:12:10.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.097+0000 7f49affff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 0x7f499c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.097+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49b806c960 con 0x7f49c00b2170 2021-10-21T00:12:10.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.097+0000 7f49beffd700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 0x7f499c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.097+0000 7f49beffd700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 0x7f499c055a40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f49b400d000 tx=0x7f49b40078a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.101+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f49b8043a20 con 0x7f49c00b2170 2021-10-21T00:12:10.271 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.261+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f49c00b12d0 con 0x7f49c00b2170 2021-10-21T00:12:10.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.461+0000 7f49affff700 1 -- 172.21.15.41:0/3589482626 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49b8015020 con 0x7f49c00b2170 2021-10-21T00:12:10.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 msgr2=0x7f499c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 0x7f499c055a40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f49b400d000 tx=0x7f49b40078a0).stop 2021-10-21T00:12:10.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 msgr2=0x7f49c00aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f49c00aafa0 tx=0x7f49b8016000).stop 2021-10-21T00:12:10.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 shutdown_connections 2021-10-21T00:12:10.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f499c053580 0x7f499c055a40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49c00b2170 0x7f49c00aded0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49c00af620 0x7f49c00ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 --2- 172.21.15.41:0/3589482626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49c0067a80 0x7f49c0147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 >> 172.21.15.41:0/3589482626 conn(0x7f49c00b5700 msgr2=0x7f49c0149390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:10.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 shutdown_connections 2021-10-21T00:12:10.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.465+0000 7f49bffff700 1 -- 172.21.15.41:0/3589482626 wait complete. 2021-10-21T00:12:10.491 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:10.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 Processor -- start 2021-10-21T00:12:10.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 -- start start 2021-10-21T00:12:10.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3f00b3a20 0x7fe3f013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f005bd40 con 0x7fe3f0062330 2021-10-21T00:12:10.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f005bf70 con 0x7fe3f00b3a20 2021-10-21T00:12:10.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ef59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0142cb0 con 0x7fe3f0062f70 2021-10-21T00:12:10.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56656/0 (socket says 172.21.15.41:56656) 2021-10-21T00:12:10.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 -- 172.21.15.41:0/4135896539 learned_addr learned my addr 172.21.15.41:0/4135896539 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:10.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3eed9d700 1 --2- 172.21.15.41:0/4135896539 >> v2:172.21.15.62:3300/0 conn(0x7fe3f00b3a20 0x7fe3f013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ed59a700 1 -- 172.21.15.41:0/4135896539 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490708195 0 0) 0x7fe3f005bd40 con 0x7fe3f0062330 2021-10-21T00:12:10.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 -- 172.21.15.41:0/4135896539 >> v2:172.21.15.62:3300/0 conn(0x7fe3f00b3a20 msgr2=0x7fe3f013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:10.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 --2- 172.21.15.41:0/4135896539 >> v2:172.21.15.62:3300/0 conn(0x7fe3f00b3a20 0x7fe3f013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 -- 172.21.15.41:0/4135896539 >> v1:172.21.15.62:6789/0 conn(0x7fe3f0062330 legacy=0x7fe3f00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 -- 172.21.15.41:0/4135896539 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0142950 con 0x7fe3f0062f70 2021-10-21T00:12:10.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3edd9b700 1 --2- 172.21.15.41:0/4135896539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe3e00032f0 tx=0x7fe3e0009290).ready entity=mon.2 client_cookie=881f912a806b0cf5 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ed59a700 1 -- 172.21.15.41:0/4135896539 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e000b8a0 con 0x7fe3f0062f70 2021-10-21T00:12:10.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ed59a700 1 -- 172.21.15.41:0/4135896539 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000ba00 con 0x7fe3f0062f70 2021-10-21T00:12:10.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.597+0000 7fe3ed59a700 1 -- 172.21.15.41:0/4135896539 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e000bb70 con 0x7fe3f0062f70 2021-10-21T00:12:10.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/4135896539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 msgr2=0x7fe3f005c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/4135896539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe3e00032f0 tx=0x7fe3e0009290).stop 2021-10-21T00:12:10.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/4135896539 shutdown_connections 2021-10-21T00:12:10.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/4135896539 >> v2:172.21.15.62:3300/0 conn(0x7fe3f00b3a20 0x7fe3f013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/4135896539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062f70 0x7fe3f005c410 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/4135896539 >> 172.21.15.41:0/4135896539 conn(0x7fe3f00b9080 msgr2=0x7fe3f00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:10.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/4135896539 shutdown_connections 2021-10-21T00:12:10.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/4135896539 wait complete. 2021-10-21T00:12:10.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 Processor -- start 2021-10-21T00:12:10.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- start start 2021-10-21T00:12:10.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062330 0x7fe3f0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00b3a20 0x7fe3f0149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00af7e0 con 0x7fe3f0062f70 2021-10-21T00:12:10.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00ad4f0 con 0x7fe3f00b3a20 2021-10-21T00:12:10.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00ad790 con 0x7fe3f0062330 2021-10-21T00:12:10.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ee59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062330 0x7fe3f0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38164/0 (socket says 172.21.15.41:38164) 2021-10-21T00:12:10.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 -- 172.21.15.41:0/2256498806 learned_addr learned my addr 172.21.15.41:0/2256498806 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:10.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3eed9d700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00b3a20 0x7fe3f0149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 -- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062330 msgr2=0x7fe3f0146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062330 0x7fe3f0146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 -- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00b3a20 msgr2=0x7fe3f0149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00b3a20 0x7fe3f0149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 -- 172.21.15.41:0/2256498806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009530 con 0x7fe3f0062f70 2021-10-21T00:12:10.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3edd9b700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fe3e00032f0 tx=0x7fe3e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e000b8a0 con 0x7fe3f0062f70 2021-10-21T00:12:10.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0145830 con 0x7fe3f0062f70 2021-10-21T00:12:10.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0146350 con 0x7fe3f0062f70 2021-10-21T00:12:10.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000bb70 con 0x7fe3f0062f70 2021-10-21T00:12:10.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.601+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e0021630 con 0x7fe3f0062f70 2021-10-21T00:12:10.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f0057350 con 0x7fe3f0062f70 2021-10-21T00:12:10.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe3e0027020 con 0x7fe3f0062f70 2021-10-21T00:12:10.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3e77fe700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 0x7fe3d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3e006cf60 con 0x7fe3f0062f70 2021-10-21T00:12:10.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3ee59c700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 0x7fe3d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.605+0000 7fe3ee59c700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 0x7fe3d4055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe3d800d000 tx=0x7fe3d8007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.613+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3e0043f30 con 0x7fe3f0062f70 2021-10-21T00:12:10.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f005d080 con 0x7fe3f0062f70 2021-10-21T00:12:10.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3e77fe700 1 -- 172.21.15.41:0/2256498806 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fe3e0015020 con 0x7fe3f0062f70 2021-10-21T00:12:10.785 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:10.785 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:10.459587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8481":{"gid":8481,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2228513289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2228513289},{"type":"v1","addr":"172.21.15.62:6835","nonce":2228513289}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:10.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 msgr2=0x7fe3d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 0x7fe3d4055b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe3d800d000 tx=0x7fe3d8007a00).stop 2021-10-21T00:12:10.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 msgr2=0x7fe3f0145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7fe3e00032f0 tx=0x7fe3e0016000).stop 2021-10-21T00:12:10.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 shutdown_connections 2021-10-21T00:12:10.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe3d4053640 0x7fe3d4055b00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3f00b3a20 0x7fe3f0149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe3f0062f70 0x7fe3f0145340 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 --2- 172.21.15.41:0/2256498806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3f0062330 0x7fe3f0146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 >> 172.21.15.41:0/2256498806 conn(0x7fe3f00b9080 msgr2=0x7fe3f0142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:10.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 shutdown_connections 2021-10-21T00:12:10.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.777+0000 7fe3ef59e700 1 -- 172.21.15.41:0/2256498806 wait complete. 2021-10-21T00:12:10.793 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 72 2021-10-21T00:12:10.804 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:10.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 Processor -- start 2021-10-21T00:12:10.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 -- start start 2021-10-21T00:12:10.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1fc0b5f70 0x7ff1fc05c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc0b6350 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc05cee0 con 0x7ff1fc142520 2021-10-21T00:12:10.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.901+0000 7ff1fb59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc067d00 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fa59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff1fc0b5f70 0x7ff1fc05c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff1fc142520 0x7ff1fc145ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:43998/0 (socket says 172.21.15.41:43998) 2021-10-21T00:12:10.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f3fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff1fc0b1a50 0x7ff1fc141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35944/0 (socket says 172.21.15.41:35944) 2021-10-21T00:12:10.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fad9d700 1 -- 172.21.15.41:0/4124590074 learned_addr learned my addr 172.21.15.41:0/4124590074 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:10.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792775793 0 0) 0x7ff1fc05cee0 con 0x7ff1fc142520 2021-10-21T00:12:10.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1dc003260 con 0x7ff1fc142520 2021-10-21T00:12:10.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fa59c700 1 -- 172.21.15.41:0/4124590074 >> v1:172.21.15.62:6789/0 conn(0x7ff1fc142520 legacy=0x7ff1fc145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fa59c700 1 -- 172.21.15.41:0/4124590074 >> v1:172.21.15.41:6789/0 conn(0x7ff1fc0b1a50 legacy=0x7ff1fc141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205410526 0 0) 0x7ff1fc0b6350 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fa59c700 1 -- 172.21.15.41:0/4124590074 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc05d180 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fa59c700 1 --2- 172.21.15.41:0/4124590074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b5f70 0x7ff1fc05c7c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7ff1ec002f70 tx=0x7ff1ec006df0).ready entity=mon.0 client_cookie=80f149513e45f438 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec00d610 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec000e90 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1f9d9b700 1 -- 172.21.15.41:0/4124590074 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec00d960 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 -- 172.21.15.41:0/4124590074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b5f70 msgr2=0x7ff1fc05c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.919 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/4124590074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b5f70 0x7ff1fc05c7c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7ff1ec002f70 tx=0x7ff1ec006df0).stop 2021-10-21T00:12:10.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 -- 172.21.15.41:0/4124590074 shutdown_connections 2021-10-21T00:12:10.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/4124590074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b5f70 0x7ff1fc05c7c0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 -- 172.21.15.41:0/4124590074 >> 172.21.15.41:0/4124590074 conn(0x7ff1fc0639f0 msgr2=0x7ff1fc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:10.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 -- 172.21.15.41:0/4124590074 shutdown_connections 2021-10-21T00:12:10.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.905+0000 7ff1fb59e700 1 -- 172.21.15.41:0/4124590074 wait complete. 2021-10-21T00:12:10.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 Processor -- start 2021-10-21T00:12:10.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- start start 2021-10-21T00:12:10.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 0x7ff1fc145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1fc142520 0x7ff1fc155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0ae4c0 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0ae220 con 0x7ff1fc142520 2021-10-21T00:12:10.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc1550f0 con 0x7ff1fc0b5f70 2021-10-21T00:12:10.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38176/0 (socket says 172.21.15.41:38176) 2021-10-21T00:12:10.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 -- 172.21.15.41:0/3644391430 learned_addr learned my addr 172.21.15.41:0/3644391430 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:10.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fad9d700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1fc142520 0x7ff1fc155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1f3fff700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 0x7ff1fc145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 -- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 msgr2=0x7ff1fc145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.930 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 0x7ff1fc145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 -- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1fc142520 msgr2=0x7ff1fc155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:10.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1fc142520 0x7ff1fc155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:10.931 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 -- 172.21.15.41:0/3644391430 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec00b180 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1f3fff700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 0x7ff1fc145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:10.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fa59c700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7ff1ec002f70 tx=0x7ff1ec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec016070 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00de90 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc151ea0 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ec013dd0 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.909+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc1460d0 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc057350 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1ec025030 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1f37fe700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 0x7ff1e0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:10.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff1ec06cab0 con 0x7ff1fc0b1a50 2021-10-21T00:12:10.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1f3fff700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 0x7ff1e0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:10.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.913+0000 7ff1f3fff700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 0x7ff1e0055b90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7ff1e400b000 tx=0x7ff1e40070e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:10.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:10.921+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1ec043a80 con 0x7ff1fc0b1a50 2021-10-21T00:12:11.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.045+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1fc0adfe0 con 0x7ff1fc0b1a50 2021-10-21T00:12:11.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1f37fe700 1 -- 172.21.15.41:0/3644391430 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16052 (secure 0 0 0) 0x7ff1ec0470a0 con 0x7ff1fc0b1a50 2021-10-21T00:12:11.057 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:11.058 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":136,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:10.449809+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:07.923124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:08.769999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:11.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 msgr2=0x7ff1e0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 0x7ff1e0055b90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7ff1e400b000 tx=0x7ff1e40070e0).stop 2021-10-21T00:12:11.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 msgr2=0x7ff1fc1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7ff1ec002f70 tx=0x7ff1ec014000).stop 2021-10-21T00:12:11.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 shutdown_connections 2021-10-21T00:12:11.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff1e00536d0 0x7ff1e0055b90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1fc142520 0x7ff1fc155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff1fc0b5f70 0x7ff1fc145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 --2- 172.21.15.41:0/3644391430 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff1fc0b1a50 0x7ff1fc1519b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 >> 172.21.15.41:0/3644391430 conn(0x7ff1fc0639f0 msgr2=0x7ff1fc0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 shutdown_connections 2021-10-21T00:12:11.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.049+0000 7ff1fb59e700 1 -- 172.21.15.41:0/3644391430 wait complete. 2021-10-21T00:12:11.071 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:11.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 Processor -- start 2021-10-21T00:12:11.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- start start 2021-10-21T00:12:11.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fccd005f850 0x7fccd00b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 0x7fccd00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00acae0 con 0x7fccd00b2bf0 2021-10-21T00:12:11.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd00acd80 con 0x7fccd005f850 2021-10-21T00:12:11.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00ad020 con 0x7fccd00ac640 2021-10-21T00:12:11.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fccd005f850 0x7fccd00b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fccd005f850 0x7fccd00b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38184/0 (socket says 172.21.15.41:38184) 2021-10-21T00:12:11.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 -- 172.21.15.41:0/1139901059 learned_addr learned my addr 172.21.15.41:0/1139901059 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:11.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5406700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 0x7fccd00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 -- 172.21.15.41:0/1139901059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 msgr2=0x7fccd00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:11.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 0x7fccd00b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 -- 172.21.15.41:0/1139901059 >> v1:172.21.15.41:6789/0 conn(0x7fccd00b2bf0 legacy=0x7fccd0146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 -- 172.21.15.41:0/1139901059 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd005fc30 con 0x7fccd005f850 2021-10-21T00:12:11.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd4c05700 1 -- 172.21.15.41:0/1139901059 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710951315 0 0) 0x7fccd00acae0 con 0x7fccd00b2bf0 2021-10-21T00:12:11.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5406700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 0x7fccd00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:11.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd5c07700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd00b19d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fcccc002f70 tx=0x7fcccc006eb0).ready entity=mon.0 client_cookie=9b0e45ea1fe99fe1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd4c05700 1 -- 172.21.15.41:0/1139901059 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcccc00d5c0 con 0x7fccd005f850 2021-10-21T00:12:11.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd4c05700 1 -- 172.21.15.41:0/1139901059 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc000e90 con 0x7fccd005f850 2021-10-21T00:12:11.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd4c05700 1 -- 172.21.15.41:0/1139901059 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcccc00d910 con 0x7fccd005f850 2021-10-21T00:12:11.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- 172.21.15.41:0/1139901059 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 msgr2=0x7fccd00b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd00b19d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fcccc002f70 tx=0x7fcccc006eb0).stop 2021-10-21T00:12:11.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 -- 172.21.15.41:0/1139901059 shutdown_connections 2021-10-21T00:12:11.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.177+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00ac640 0x7fccd00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/1139901059 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd00b19d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 -- 172.21.15.41:0/1139901059 >> 172.21.15.41:0/1139901059 conn(0x7fccd00b7030 msgr2=0x7fccd00b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 -- 172.21.15.41:0/1139901059 shutdown_connections 2021-10-21T00:12:11.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 -- 172.21.15.41:0/1139901059 wait complete. 2021-10-21T00:12:11.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 Processor -- start 2021-10-21T00:12:11.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.181+0000 7fccd7e6b700 1 -- start start 2021-10-21T00:12:11.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 0x7fccd0065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00b2bf0 0x7fccd00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0148dc0 con 0x7fccd005f850 2021-10-21T00:12:11.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0156800 con 0x7fccd00ac640 2021-10-21T00:12:11.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0156aa0 con 0x7fccd00b2bf0 2021-10-21T00:12:11.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38190/0 (socket says 172.21.15.41:38190) 2021-10-21T00:12:11.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 -- 172.21.15.41:0/286228204 learned_addr learned my addr 172.21.15.41:0/286228204 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:11.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5406700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 0x7fccd0065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd6408700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00b2bf0 0x7fccd00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 -- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00b2bf0 msgr2=0x7fccd00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00b2bf0 0x7fccd00b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 -- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 msgr2=0x7fccd0065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 0x7fccd0065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 -- 172.21.15.41:0/286228204 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc00b1e0 con 0x7fccd005f850 2021-10-21T00:12:11.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5406700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 0x7fccd0065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:11.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd5c07700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fcccc002f70 tx=0x7fcccc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcccc00d940 con 0x7fccd005f850 2021-10-21T00:12:11.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc006b40 con 0x7fccd005f850 2021-10-21T00:12:11.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd0156d40 con 0x7fccd005f850 2021-10-21T00:12:11.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcccc011d30 con 0x7fccd005f850 2021-10-21T00:12:11.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd01563d0 con 0x7fccd005f850 2021-10-21T00:12:11.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.185+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd0156ed0 con 0x7fccd005f850 2021-10-21T00:12:11.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.189+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcccc025030 con 0x7fccd005f850 2021-10-21T00:12:11.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.189+0000 7fccc6ffd700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 0x7fccb8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.189+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcccc06cb50 con 0x7fccd005f850 2021-10-21T00:12:11.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.189+0000 7fccd5406700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 0x7fccb8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.189+0000 7fccd5406700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 0x7fccb8055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fccc000c000 tx=0x7fccc0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.193+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcccc043ba0 con 0x7fccd005f850 2021-10-21T00:12:11.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.357+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fccd0057350 con 0x7fccd005f850 2021-10-21T00:12:11.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.365+0000 7fccc6ffd700 1 -- 172.21.15.41:0/286228204 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcccc023070 con 0x7fccd005f850 2021-10-21T00:12:11.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 msgr2=0x7fccb8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 0x7fccb8055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fccc000c000 tx=0x7fccc0008040).stop 2021-10-21T00:12:11.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 msgr2=0x7fccd01571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fcccc002f70 tx=0x7fcccc015000).stop 2021-10-21T00:12:11.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 shutdown_connections 2021-10-21T00:12:11.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fccb8053610 0x7fccb8055ad0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fccd00b2bf0 0x7fccd00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccd00ac640 0x7fccd0065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 --2- 172.21.15.41:0/286228204 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fccd005f850 0x7fccd01571e0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 >> 172.21.15.41:0/286228204 conn(0x7fccd00b7030 msgr2=0x7fccd00b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 shutdown_connections 2021-10-21T00:12:11.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.369+0000 7fccd7e6b700 1 -- 172.21.15.41:0/286228204 wait complete. 2021-10-21T00:12:11.384 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:12:11.393 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.497+0000 7f188ef92700 1 Processor -- start 2021-10-21T00:12:11.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.497+0000 7f188ef92700 1 -- start start 2021-10-21T00:12:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f18880b3bc0 0x7f1888143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1888142bc0 con 0x7f18880b9c70 2021-10-21T00:12:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18881429a0 con 0x7f18880b3bc0 2021-10-21T00:12:11.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18880ba050 con 0x7f18881418f0 2021-10-21T00:12:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f1887fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f18880b3bc0 0x7f1888143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56700/0 (socket says 172.21.15.41:56700) 2021-10-21T00:12:11.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 -- 172.21.15.41:0/2088986252 learned_addr learned my addr 172.21.15.41:0/2088986252 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 -- 172.21.15.41:0/2088986252 >> v2:172.21.15.62:3300/0 conn(0x7f18880b3bc0 msgr2=0x7f1888143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 --2- 172.21.15.41:0/2088986252 >> v2:172.21.15.62:3300/0 conn(0x7f18880b3bc0 0x7f1888143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 -- 172.21.15.41:0/2088986252 >> v1:172.21.15.62:6789/0 conn(0x7f18880b9c70 legacy=0x7f1888143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 -- 172.21.15.41:0/2088986252 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18881463c0 con 0x7f18881418f0 2021-10-21T00:12:11.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188d52f700 1 --2- 172.21.15.41:0/2088986252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f18800032f0 tx=0x7f1880009290).ready entity=mon.2 client_cookie=fd77e4961ea4ed23 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f18877fe700 1 -- 172.21.15.41:0/2088986252 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188000b8a0 con 0x7f18881418f0 2021-10-21T00:12:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f18877fe700 1 -- 172.21.15.41:0/2088986252 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188000ba00 con 0x7f18881418f0 2021-10-21T00:12:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f18877fe700 1 -- 172.21.15.41:0/2088986252 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188000bb70 con 0x7f18881418f0 2021-10-21T00:12:11.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- 172.21.15.41:0/2088986252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 msgr2=0x7f1888141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 --2- 172.21.15.41:0/2088986252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f18800032f0 tx=0x7f1880009290).stop 2021-10-21T00:12:11.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- 172.21.15.41:0/2088986252 shutdown_connections 2021-10-21T00:12:11.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 --2- 172.21.15.41:0/2088986252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f1888141d50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 --2- 172.21.15.41:0/2088986252 >> v2:172.21.15.62:3300/0 conn(0x7f18880b3bc0 0x7f1888143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- 172.21.15.41:0/2088986252 >> 172.21.15.41:0/2088986252 conn(0x7f1888062e80 msgr2=0x7f18880b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- 172.21.15.41:0/2088986252 shutdown_connections 2021-10-21T00:12:11.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.501+0000 7f188ef92700 1 -- 172.21.15.41:0/2088986252 wait complete. 2021-10-21T00:12:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 Processor -- start 2021-10-21T00:12:11.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 -- start start 2021-10-21T00:12:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 0x7f1888149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f18880af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.527 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888152a70 con 0x7f18880b9c70 2021-10-21T00:12:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888145ed0 con 0x7f18880b3bc0 2021-10-21T00:12:11.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188ef92700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1888152cd0 con 0x7f18881418f0 2021-10-21T00:12:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38206/0 (socket says 172.21.15.41:38206) 2021-10-21T00:12:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 -- 172.21.15.41:0/1057086435 learned_addr learned my addr 172.21.15.41:0/1057086435 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:11.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188cd2e700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 0x7f1888149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188d52f700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f18880af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 -- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 msgr2=0x7f18880af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f18880af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 -- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 msgr2=0x7f1888149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 0x7f1888149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 -- 172.21.15.41:0/1057086435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009530 con 0x7f18880b9c70 2021-10-21T00:12:11.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f188cd2e700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 0x7f1888149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:11.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1887fff700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f187000c000 tx=0x7f1870006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.505+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1870010780 con 0x7f18880b9c70 2021-10-21T00:12:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700108e0 con 0x7f18880b9c70 2021-10-21T00:12:11.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1888145bc0 con 0x7f18880b9c70 2021-10-21T00:12:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1870010c40 con 0x7f18880b9c70 2021-10-21T00:12:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18880af600 con 0x7f18880b9c70 2021-10-21T00:12:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1888146120 con 0x7f18880b9c70 2021-10-21T00:12:11.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f187001c460 con 0x7f18880b9c70 2021-10-21T00:12:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f1885ffb700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 0x7f186c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f187006bfb0 con 0x7f18880b9c70 2021-10-21T00:12:11.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.509+0000 7f188cd2e700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 0x7f186c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.513+0000 7f188cd2e700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 0x7f186c055a70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f187800b000 tx=0x7f1878009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.517+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1870042f20 con 0x7f18880b9c70 2021-10-21T00:12:11.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.685+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1888057350 con 0x7f18880b9c70 2021-10-21T00:12:11.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.693+0000 7f1885ffb700 1 -- 172.21.15.41:0/1057086435 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1870046540 con 0x7f18880b9c70 2021-10-21T00:12:11.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 msgr2=0x7f186c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 0x7f186c055a70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f187800b000 tx=0x7f1878009040).stop 2021-10-21T00:12:11.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 msgr2=0x7f18880aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f187000c000 tx=0x7f1870006df0).stop 2021-10-21T00:12:11.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 shutdown_connections 2021-10-21T00:12:11.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f186c0535b0 0x7f186c055a70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18881418f0 0x7f18880af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f18880b9c70 0x7f18880aec20 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 --2- 172.21.15.41:0/1057086435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18880b3bc0 0x7f1888149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 >> 172.21.15.41:0/1057086435 conn(0x7f1888062e80 msgr2=0x7f1888146550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 shutdown_connections 2021-10-21T00:12:11.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.697+0000 7f188ef92700 1 -- 172.21.15.41:0/1057086435 wait complete. 2021-10-21T00:12:11.711 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:12:11.718 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:11.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.825+0000 7f4af1917700 1 Processor -- start 2021-10-21T00:12:11.836 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.825+0000 7f4af1917700 1 -- start start 2021-10-21T00:12:11.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec0b9c70 0x7f4aec143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4aec0b3bc0 0x7f4aec143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.840 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec142bc0 con 0x7f4aec143a00 2021-10-21T00:12:11.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec1429a0 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0ba050 con 0x7f4aec0b9c70 2021-10-21T00:12:11.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4aec0b3bc0 0x7f4aec143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.841 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aeb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4aec143a00 0x7f4aec05bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44040/0 (socket says 172.21.15.41:44040) 2021-10-21T00:12:11.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aeb7fe700 1 -- 172.21.15.41:0/1132187990 learned_addr learned my addr 172.21.15.41:0/1132187990 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:11.842 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aeaffd700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec0b9c70 0x7f4aec143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 -- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec0b9c70 msgr2=0x7f4aec143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:11.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec0b9c70 0x7f4aec143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 -- 172.21.15.41:0/1132187990 >> v1:172.21.15.62:6789/0 conn(0x7f4aec143a00 legacy=0x7f4aec05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 -- 172.21.15.41:0/1132187990 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec1463c0 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4aea7fc700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec143510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f4aec0b1ab0 tx=0x7f4adc006df0).ready entity=mon.1 client_cookie=958aff6c5ae4bfcd server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4ae9ffb700 1 -- 172.21.15.41:0/1132187990 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00d570 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4ae9ffb700 1 -- 172.21.15.41:0/1132187990 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc000e90 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.846 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4ae9ffb700 1 -- 172.21.15.41:0/1132187990 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00d8c0 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 -- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 msgr2=0x7f4aec143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec143510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f4aec0b1ab0 tx=0x7f4adc006df0).stop 2021-10-21T00:12:11.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.829+0000 7f4af1917700 1 -- 172.21.15.41:0/1132187990 shutdown_connections 2021-10-21T00:12:11.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec143510 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 --2- 172.21.15.41:0/1132187990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec0b9c70 0x7f4aec143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- 172.21.15.41:0/1132187990 >> 172.21.15.41:0/1132187990 conn(0x7f4aec062e80 msgr2=0x7f4aec0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:11.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- 172.21.15.41:0/1132187990 shutdown_connections 2021-10-21T00:12:11.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- 172.21.15.41:0/1132187990 wait complete. 2021-10-21T00:12:11.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 Processor -- start 2021-10-21T00:12:11.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- start start 2021-10-21T00:12:11.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.854 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec143a00 0x7f4aec140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec144ce0 con 0x7f4aec0b9c70 2021-10-21T00:12:11.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec144f80 con 0x7f4aec0b3bc0 2021-10-21T00:12:11.855 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4af1917700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec140500 con 0x7f4aec143a00 2021-10-21T00:12:11.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aeaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38220/0 (socket says 172.21.15.41:38220) 2021-10-21T00:12:11.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 -- 172.21.15.41:0/2986768690 learned_addr learned my addr 172.21.15.41:0/2986768690 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:11.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aeb7fe700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec143a00 0x7f4aec140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 -- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec143a00 msgr2=0x7f4aec140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec143a00 0x7f4aec140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 -- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 msgr2=0x7f4aec148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:11.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:11.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aea7fc700 1 -- 172.21.15.41:0/2986768690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc00b180 con 0x7f4aec0b9c70 2021-10-21T00:12:11.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.833+0000 7f4aeaffd700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:11.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4aea7fc700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f4aec0b1ab0 tx=0x7f4adc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc016070 con 0x7f4aec0b9c70 2021-10-21T00:12:11.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc002f70 con 0x7f4aec0b9c70 2021-10-21T00:12:11.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec144010 con 0x7f4aec0b9c70 2021-10-21T00:12:11.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc013e50 con 0x7f4aec0b9c70 2021-10-21T00:12:11.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec145680 con 0x7f4aec0b9c70 2021-10-21T00:12:11.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec0b4660 con 0x7f4aec0b9c70 2021-10-21T00:12:11.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4adc025030 con 0x7f4aec0b9c70 2021-10-21T00:12:11.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 0x7f4ac8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:11.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4adc06c870 con 0x7f4aec0b9c70 2021-10-21T00:12:11.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.837+0000 7f4aeaffd700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 0x7f4ac8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:11.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.841+0000 7f4aeaffd700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 0x7f4ac8055a70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f4ae000b000 tx=0x7f4ae0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:11.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:11.845+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4adc0439d0 con 0x7f4aec0b9c70 2021-10-21T00:12:12.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.017+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4aec057350 con 0x7f4aec0b9c70 2021-10-21T00:12:12.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.025+0000 7f4adbfff700 1 -- 172.21.15.41:0/2986768690 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4adc023020 con 0x7f4aec0b9c70 2021-10-21T00:12:12.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 msgr2=0x7f4ac8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 0x7f4ac8055a70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f4ae000b000 tx=0x7f4ae0006df0).stop 2021-10-21T00:12:12.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 msgr2=0x7f4aec13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f4aec0b1ab0 tx=0x7f4adc014000).stop 2021-10-21T00:12:12.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 shutdown_connections 2021-10-21T00:12:12.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4ac80535b0 0x7f4ac8055a70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4aec143a00 0x7f4aec140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4aec0b9c70 0x7f4aec13fb20 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 --2- 172.21.15.41:0/2986768690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aec0b3bc0 0x7f4aec148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 >> 172.21.15.41:0/2986768690 conn(0x7f4aec062e80 msgr2=0x7f4aec141860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:12.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 shutdown_connections 2021-10-21T00:12:12.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.029+0000 7f4af1917700 1 -- 172.21.15.41:0/2986768690 wait complete. 2021-10-21T00:12:12.043 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:12:12.055 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:12.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 Processor -- start 2021-10-21T00:12:12.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 -- start start 2021-10-21T00:12:12.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f747c05c7c0 0x7f747c0b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0b6350 con 0x7f747c0b5f70 2021-10-21T00:12:12.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c05cee0 con 0x7f747c142520 2021-10-21T00:12:12.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f748092b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c067d00 con 0x7f747c05c7c0 2021-10-21T00:12:12.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747ad9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f747c0b5f70 0x7f747c141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:35996/0 (socket says 172.21.15.41:35996) 2021-10-21T00:12:12.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747ad9d700 1 -- 172.21.15.41:0/3801039720 learned_addr learned my addr 172.21.15.41:0/3801039720 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:12.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747b59e700 1 --2- 172.21.15.41:0/3801039720 >> v2:172.21.15.41:3300/0 conn(0x7f747c05c7c0 0x7f747c0b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58766772 0 0) 0x7f747c0b6350 con 0x7f747c0b5f70 2021-10-21T00:12:12.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c003260 con 0x7f747c0b5f70 2021-10-21T00:12:12.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132915335 0 0) 0x7f747c05cee0 con 0x7f747c142520 2021-10-21T00:12:12.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747c0b6350 con 0x7f747c142520 2021-10-21T00:12:12.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747b59e700 1 -- 172.21.15.41:0/3801039720 >> v1:172.21.15.62:6789/0 conn(0x7f747c142520 legacy=0x7f747c145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747b59e700 1 -- 172.21.15.41:0/3801039720 >> v1:172.21.15.41:6789/0 conn(0x7f747c0b5f70 legacy=0x7f747c141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747b59e700 1 -- 172.21.15.41:0/3801039720 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c05d180 con 0x7f747c05c7c0 2021-10-21T00:12:12.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f747b59e700 1 --2- 172.21.15.41:0/3801039720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c0b1a50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f74740032f0 tx=0x7f74740091d0).ready entity=mon.0 client_cookie=b9375324598c813a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.149+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f747400b600 con 0x7f747c05c7c0 2021-10-21T00:12:12.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400b760 con 0x7f747c05c7c0 2021-10-21T00:12:12.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f7479d9b700 1 -- 172.21.15.41:0/3801039720 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f747400b8d0 con 0x7f747c05c7c0 2021-10-21T00:12:12.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- 172.21.15.41:0/3801039720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 msgr2=0x7f747c0b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 --2- 172.21.15.41:0/3801039720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c0b1a50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f74740032f0 tx=0x7f74740091d0).stop 2021-10-21T00:12:12.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- 172.21.15.41:0/3801039720 shutdown_connections 2021-10-21T00:12:12.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 --2- 172.21.15.41:0/3801039720 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c0b1a50 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- 172.21.15.41:0/3801039720 >> 172.21.15.41:0/3801039720 conn(0x7f747c0639f0 msgr2=0x7f747c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:12.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- 172.21.15.41:0/3801039720 shutdown_connections 2021-10-21T00:12:12.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- 172.21.15.41:0/3801039720 wait complete. 2021-10-21T00:12:12.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 Processor -- start 2021-10-21T00:12:12.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.153+0000 7f748092b700 1 -- start start 2021-10-21T00:12:12.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 0x7f747c0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 0x7f747c066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c065af0 con 0x7f747c05c7c0 2021-10-21T00:12:12.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1466c0 con 0x7f747c0b5f70 2021-10-21T00:12:12.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c145540 con 0x7f747c142520 2021-10-21T00:12:12.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38232/0 (socket says 172.21.15.41:38232) 2021-10-21T00:12:12.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 -- 172.21.15.41:0/610524449 learned_addr learned my addr 172.21.15.41:0/610524449 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:12.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747b59e700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 0x7f747c066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747a59c700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 0x7f747c0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 -- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 msgr2=0x7f747c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 0x7f747c066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 -- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 msgr2=0x7f747c0b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 0x7f747c0b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 -- 172.21.15.41:0/610524449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009470 con 0x7f747c05c7c0 2021-10-21T00:12:12.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747a59c700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 0x7f747c0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:12.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747b59e700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 0x7f747c066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:12.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f747ad9d700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f74640011d0 tx=0x7f7464007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f746400ce70 con 0x7f747c05c7c0 2021-10-21T00:12:12.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74640072e0 con 0x7f747c05c7c0 2021-10-21T00:12:12.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c064210 con 0x7f747c05c7c0 2021-10-21T00:12:12.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7464005800 con 0x7f747c05c7c0 2021-10-21T00:12:12.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.157+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c145f40 con 0x7f747c05c7c0 2021-10-21T00:12:12.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0af3f0 con 0x7f747c05c7c0 2021-10-21T00:12:12.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7464010070 con 0x7f747c05c7c0 2021-10-21T00:12:12.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f7473fff700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 0x7f7460055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f746406b200 con 0x7f747c05c7c0 2021-10-21T00:12:12.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f747a59c700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 0x7f7460055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.161+0000 7f747a59c700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 0x7f7460055b60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f746c00b000 tx=0x7f746c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.165+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7464042250 con 0x7f747c05c7c0 2021-10-21T00:12:12.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.329+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f747c057350 con 0x7f747c05c7c0 2021-10-21T00:12:12.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.329+0000 7f7473fff700 1 -- 172.21.15.41:0/610524449 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f7464045870 con 0x7f747c05c7c0 2021-10-21T00:12:12.339 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:12.339 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:10.459587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8481":{"gid":8481,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2228513289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2228513289},{"type":"v1","addr":"172.21.15.62:6835","nonce":2228513289}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 msgr2=0x7f7460055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 0x7f7460055b60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f746c00b000 tx=0x7f746c009040).stop 2021-10-21T00:12:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 msgr2=0x7f747c154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f74640011d0 tx=0x7f7464007b50).stop 2021-10-21T00:12:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 shutdown_connections 2021-10-21T00:12:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f74600536a0 0x7f7460055b60 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f747c142520 0x7f747c066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f747c0b5f70 0x7f747c0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 --2- 172.21.15.41:0/610524449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f747c05c7c0 0x7f747c154fd0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 >> 172.21.15.41:0/610524449 conn(0x7f747c0639f0 msgr2=0x7f747c0b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 shutdown_connections 2021-10-21T00:12:12.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.333+0000 7f748092b700 1 -- 172.21.15.41:0/610524449 wait complete. 2021-10-21T00:12:12.344 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 72 2021-10-21T00:12:12.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:09.433938+0000', 'modified': '2021-10-21T00:12:10.459587+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8481': {'gid': 8481, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/2228513289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 2228513289}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2228513289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:12.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:12.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:12:12.669 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8481,"want_state":"up:active","state":"up:active","rank_uptime":3.2169653619999998,"mdsmap_epoch":72,"osdmap_epoch":136,"osdmap_epoch_barrier":136,"uptime":7.5840716219999997} 2021-10-21T00:12:12.669 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8481, "mdsmap_epoch": 72, "osdmap_epoch": 136, "osdmap_epoch_barrier": 136, "rank_uptime": 3.216965362, "state": "up:active", "uptime": 7.584071622, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:12.670 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:12.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 Processor -- start 2021-10-21T00:12:12.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 -- start start 2021-10-21T00:12:12.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5640b2170 0x7fd5640ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd564067a80 0x7fd564149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5640b0b50 con 0x7fd5640af620 2021-10-21T00:12:12.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640b2550 con 0x7fd564067a80 2021-10-21T00:12:12.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd569113700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640b0d90 con 0x7fd5640b2170 2021-10-21T00:12:12.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd568912700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd564067a80 0x7fd564149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd568912700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd564067a80 0x7fd564149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38244/0 (socket says 172.21.15.41:38244) 2021-10-21T00:12:12.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd568912700 1 -- 172.21.15.41:0/120764442 learned_addr learned my addr 172.21.15.41:0/120764442 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:12.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.773+0000 7fd563fff700 1 --2- 172.21.15.41:0/120764442 >> v2:172.21.15.62:3300/0 conn(0x7fd5640b2170 0x7fd5640ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.787 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd568912700 1 -- 172.21.15.41:0/120764442 >> v2:172.21.15.62:3300/0 conn(0x7fd5640b2170 msgr2=0x7fd5640ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:12.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd568912700 1 --2- 172.21.15.41:0/120764442 >> v2:172.21.15.62:3300/0 conn(0x7fd5640b2170 0x7fd5640ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd568912700 1 -- 172.21.15.41:0/120764442 >> v1:172.21.15.62:6789/0 conn(0x7fd5640af620 legacy=0x7fd5640ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd568912700 1 -- 172.21.15.41:0/120764442 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640b1030 con 0x7fd564067a80 2021-10-21T00:12:12.788 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd568912700 1 --2- 172.21.15.41:0/120764442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564149320 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fd5640aafa0 tx=0x7fd55c009290).ready entity=mon.0 client_cookie=9a7d64055270241a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd562ffd700 1 -- 172.21.15.41:0/120764442 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55c00b860 con 0x7fd564067a80 2021-10-21T00:12:12.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd562ffd700 1 -- 172.21.15.41:0/120764442 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c00b9c0 con 0x7fd564067a80 2021-10-21T00:12:12.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd562ffd700 1 -- 172.21.15.41:0/120764442 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55c00bb30 con 0x7fd564067a80 2021-10-21T00:12:12.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- 172.21.15.41:0/120764442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 msgr2=0x7fd564149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- 172.21.15.41:0/120764442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564149320 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fd5640aafa0 tx=0x7fd55c009290).stop 2021-10-21T00:12:12.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- 172.21.15.41:0/120764442 shutdown_connections 2021-10-21T00:12:12.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- 172.21.15.41:0/120764442 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564149320 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- 172.21.15.41:0/120764442 >> v2:172.21.15.62:3300/0 conn(0x7fd5640b2170 0x7fd5640ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- 172.21.15.41:0/120764442 >> 172.21.15.41:0/120764442 conn(0x7fd5640b5700 msgr2=0x7fd5640b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:12.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- 172.21.15.41:0/120764442 shutdown_connections 2021-10-21T00:12:12.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- 172.21.15.41:0/120764442 wait complete. 2021-10-21T00:12:12.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 Processor -- start 2021-10-21T00:12:12.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- start start 2021-10-21T00:12:12.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5640af620 0x7fd5640ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5640b2170 0x7fd5640635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640aee30 con 0x7fd564067a80 2021-10-21T00:12:12.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd564066ab0 con 0x7fd5640af620 2021-10-21T00:12:12.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.777+0000 7fd569113700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd564066800 con 0x7fd5640b2170 2021-10-21T00:12:12.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38248/0 (socket says 172.21.15.41:38248) 2021-10-21T00:12:12.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 -- 172.21.15.41:0/4177626033 learned_addr learned my addr 172.21.15.41:0/4177626033 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:12.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd5637fe700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5640af620 0x7fd5640ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd568912700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5640b2170 0x7fd5640635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 -- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5640b2170 msgr2=0x7fd5640635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5640b2170 0x7fd5640635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 -- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5640af620 msgr2=0x7fd5640ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5640af620 0x7fd5640ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 -- 172.21.15.41:0/4177626033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009530 con 0x7fd564067a80 2021-10-21T00:12:12.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd563fff700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fd5580030b0 tx=0x7fd558008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd558011780 con 0x7fd564067a80 2021-10-21T00:12:12.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5580118e0 con 0x7fd564067a80 2021-10-21T00:12:12.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd564156ff0 con 0x7fd564067a80 2021-10-21T00:12:12.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd558011c40 con 0x7fd564067a80 2021-10-21T00:12:12.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5640ae0e0 con 0x7fd564067a80 2021-10-21T00:12:12.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5640b12d0 con 0x7fd564067a80 2021-10-21T00:12:12.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.781+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd55801c460 con 0x7fd564067a80 2021-10-21T00:12:12.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.785+0000 7fd5617fa700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 0x7fd544055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:12.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.785+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd55806bb10 con 0x7fd564067a80 2021-10-21T00:12:12.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.785+0000 7fd5637fe700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 0x7fd544055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:12.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.785+0000 7fd5637fe700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 0x7fd544055a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fd55400b000 tx=0x7fd554009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:12.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.785+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd558042c10 con 0x7fd564067a80 2021-10-21T00:12:12.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.913+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd564057350 con 0x7fd564067a80 2021-10-21T00:12:12.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.913+0000 7fd5617fa700 1 -- 172.21.15.41:0/4177626033 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fd558046230 con 0x7fd564067a80 2021-10-21T00:12:12.924 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:12.924 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":136,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:10.449809+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:07.923124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:08.769999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:12.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 msgr2=0x7fd544055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 0x7fd544055a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fd55400b000 tx=0x7fd554009040).stop 2021-10-21T00:12:12.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 msgr2=0x7fd564066310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:12.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fd5580030b0 tx=0x7fd558008040).stop 2021-10-21T00:12:12.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 shutdown_connections 2021-10-21T00:12:12.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd5440535b0 0x7fd544055a70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd5640b2170 0x7fd5640635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5640af620 0x7fd5640ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 --2- 172.21.15.41:0/4177626033 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd564067a80 0x7fd564066310 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:12.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 >> 172.21.15.41:0/4177626033 conn(0x7fd5640b5700 msgr2=0x7fd56405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:12.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 shutdown_connections 2021-10-21T00:12:12.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:12.917+0000 7fd569113700 1 -- 172.21.15.41:0/4177626033 wait complete. 2021-10-21T00:12:12.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:12:07.923124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:12:08.769999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:12:12.939 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:13.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.041+0000 7f10de33b700 1 Processor -- start 2021-10-21T00:12:13.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.041+0000 7f10de33b700 1 -- start start 2021-10-21T00:12:13.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 0x7f10d805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d805bd40 con 0x7f10d8062330 2021-10-21T00:12:13.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d805bf70 con 0x7f10d8062f70 2021-10-21T00:12:13.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8142cb0 con 0x7f10d80b3a20 2021-10-21T00:12:13.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10dcb38700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 0x7f10d805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56756/0 (socket says 172.21.15.41:56756) 2021-10-21T00:12:13.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 -- 172.21.15.41:0/889547920 learned_addr learned my addr 172.21.15.41:0/889547920 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10dd339700 1 --1- 172.21.15.41:0/889547920 >> v1:172.21.15.62:6789/0 conn(0x7f10d8062330 0x7f10d80b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44080/0 (socket says 172.21.15.41:44080) 2021-10-21T00:12:13.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10d7fff700 1 -- 172.21.15.41:0/889547920 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595590120 0 0) 0x7f10d805bd40 con 0x7f10d8062330 2021-10-21T00:12:13.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 -- 172.21.15.41:0/889547920 >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 msgr2=0x7f10d805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 --2- 172.21.15.41:0/889547920 >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 0x7f10d805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 -- 172.21.15.41:0/889547920 >> v1:172.21.15.62:6789/0 conn(0x7f10d8062330 legacy=0x7f10d80b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 -- 172.21.15.41:0/889547920 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8142950 con 0x7f10d80b3a20 2021-10-21T00:12:13.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10dcb38700 1 --2- 172.21.15.41:0/889547920 >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 0x7f10d805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:13.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10ddb3a700 1 --2- 172.21.15.41:0/889547920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f10d0002f70 tx=0x7f10d0006eb0).ready entity=mon.2 client_cookie=4c8e934f9699989b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10d7fff700 1 -- 172.21.15.41:0/889547920 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000d570 con 0x7f10d80b3a20 2021-10-21T00:12:13.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10d7fff700 1 -- 172.21.15.41:0/889547920 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0000e90 con 0x7f10d80b3a20 2021-10-21T00:12:13.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10d7fff700 1 -- 172.21.15.41:0/889547920 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000d8c0 con 0x7f10d80b3a20 2021-10-21T00:12:13.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- 172.21.15.41:0/889547920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 msgr2=0x7f10d813c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 --2- 172.21.15.41:0/889547920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f10d0002f70 tx=0x7f10d0006eb0).stop 2021-10-21T00:12:13.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- 172.21.15.41:0/889547920 shutdown_connections 2021-10-21T00:12:13.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 --2- 172.21.15.41:0/889547920 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d80b3a20 0x7f10d813c510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 --2- 172.21.15.41:0/889547920 >> v2:172.21.15.62:3300/0 conn(0x7f10d8062f70 0x7f10d805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- 172.21.15.41:0/889547920 >> 172.21.15.41:0/889547920 conn(0x7f10d80b9080 msgr2=0x7f10d80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- 172.21.15.41:0/889547920 shutdown_connections 2021-10-21T00:12:13.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.045+0000 7f10de33b700 1 -- 172.21.15.41:0/889547920 wait complete. 2021-10-21T00:12:13.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 Processor -- start 2021-10-21T00:12:13.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- start start 2021-10-21T00:12:13.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d8062330 0x7f10d8152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d80b3a20 0x7f10d8140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80adcf0 con 0x7f10d8062f70 2021-10-21T00:12:13.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80ae940 con 0x7f10d80b3a20 2021-10-21T00:12:13.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80af7e0 con 0x7f10d8062330 2021-10-21T00:12:13.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38262/0 (socket says 172.21.15.41:38262) 2021-10-21T00:12:13.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 -- 172.21.15.41:0/1909573381 learned_addr learned my addr 172.21.15.41:0/1909573381 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dd339700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d8062330 0x7f10d8152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10ddb3a700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d80b3a20 0x7f10d8140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 -- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d8062330 msgr2=0x7f10d8152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d8062330 0x7f10d8152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 -- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d80b3a20 msgr2=0x7f10d8140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d80b3a20 0x7f10d8140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 -- 172.21.15.41:0/1909573381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc00b180 con 0x7f10d8062f70 2021-10-21T00:12:13.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10dcb38700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f10d80acba0 tx=0x7f10cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc010780 con 0x7f10d8062f70 2021-10-21T00:12:13.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0108e0 con 0x7f10d8062f70 2021-10-21T00:12:13.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d000b1e0 con 0x7f10d8062f70 2021-10-21T00:12:13.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc010c40 con 0x7f10d8062f70 2021-10-21T00:12:13.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.049+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d80ae630 con 0x7f10d8062f70 2021-10-21T00:12:13.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80af370 con 0x7f10d8062f70 2021-10-21T00:12:13.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10cc01c460 con 0x7f10d8062f70 2021-10-21T00:12:13.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10d67fc700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 0x7f10b80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f10cc06bf60 con 0x7f10d8062f70 2021-10-21T00:12:13.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10dd339700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 0x7f10b80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.053+0000 7f10dd339700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 0x7f10b80559b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f10c800d000 tx=0x7f10c8007d80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.061+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10cc042f50 con 0x7f10d8062f70 2021-10-21T00:12:13.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.189+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f10d8057350 con 0x7f10d8062f70 2021-10-21T00:12:13.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.189+0000 7f10d67fc700 1 -- 172.21.15.41:0/1909573381 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f10cc046570 con 0x7f10d8062f70 2021-10-21T00:12:13.199 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:13.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 msgr2=0x7f10b80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 0x7f10b80559b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f10c800d000 tx=0x7f10c8007d80).stop 2021-10-21T00:12:13.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 msgr2=0x7f10d80aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f10d80acba0 tx=0x7f10cc006df0).stop 2021-10-21T00:12:13.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 shutdown_connections 2021-10-21T00:12:13.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f10b80534f0 0x7f10b80559b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10d80b3a20 0x7f10d8140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f10d8062f70 0x7f10d80aee80 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 --2- 172.21.15.41:0/1909573381 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10d8062330 0x7f10d8152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 >> 172.21.15.41:0/1909573381 conn(0x7f10d80b9080 msgr2=0x7f10d813fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 shutdown_connections 2021-10-21T00:12:13.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.193+0000 7f10de33b700 1 -- 172.21.15.41:0/1909573381 wait complete. 2021-10-21T00:12:13.212 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:13.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 Processor -- start 2021-10-21T00:12:13.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 -- start start 2021-10-21T00:12:13.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d4065a00 0x7f55d4065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55d4066370 0x7f55d414b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40b76e0 con 0x7f55d40b7300 2021-10-21T00:12:13.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d4144de0 con 0x7f55d4066370 2021-10-21T00:12:13.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d8884700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40ac890 con 0x7f55d4065a00 2021-10-21T00:12:13.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f55d40b7300 0x7f55d413a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36038/0 (socket says 172.21.15.41:36038) 2021-10-21T00:12:13.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d259c700 1 -- 172.21.15.41:0/943169136 learned_addr learned my addr 172.21.15.41:0/943169136 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:13.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 --2- 172.21.15.41:0/943169136 >> v2:172.21.15.62:3300/0 conn(0x7f55d4066370 0x7f55d414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55c9d9b700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d4065a00 0x7f55d4065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d1d9b700 1 -- 172.21.15.41:0/943169136 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127042693 0 0) 0x7f55d40b76e0 con 0x7f55d40b7300 2021-10-21T00:12:13.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d1d9b700 1 -- 172.21.15.41:0/943169136 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b4003260 con 0x7f55d40b7300 2021-10-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 -- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d4065a00 msgr2=0x7f55d4065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d4065a00 0x7f55d4065e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 -- 172.21.15.41:0/943169136 >> v1:172.21.15.41:6789/0 conn(0x7f55d40b7300 legacy=0x7f55d413a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 -- 172.21.15.41:0/943169136 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40acb30 con 0x7f55d4066370 2021-10-21T00:12:13.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.313+0000 7f55d2d9d700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d414b220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f55cc0032f0 tx=0x7f55cc0091d0).ready entity=mon.1 client_cookie=9ad478b77b3335e7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d1d9b700 1 -- 172.21.15.41:0/943169136 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55cc00b600 con 0x7f55d4066370 2021-10-21T00:12:13.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d1d9b700 1 -- 172.21.15.41:0/943169136 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00b760 con 0x7f55d4066370 2021-10-21T00:12:13.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d1d9b700 1 -- 172.21.15.41:0/943169136 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55cc00b8d0 con 0x7f55d4066370 2021-10-21T00:12:13.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 msgr2=0x7f55d414b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d414b220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f55cc0032f0 tx=0x7f55cc0091d0).stop 2021-10-21T00:12:13.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- 172.21.15.41:0/943169136 shutdown_connections 2021-10-21T00:12:13.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d414b220 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- 172.21.15.41:0/943169136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d4065a00 0x7f55d4065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- 172.21.15.41:0/943169136 >> 172.21.15.41:0/943169136 conn(0x7f55d4069df0 msgr2=0x7f55d4064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- 172.21.15.41:0/943169136 shutdown_connections 2021-10-21T00:12:13.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- 172.21.15.41:0/943169136 wait complete. 2021-10-21T00:12:13.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 Processor -- start 2021-10-21T00:12:13.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- start start 2021-10-21T00:12:13.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d4147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d40b7300 0x7f55d414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41419e0 con 0x7f55d4065a00 2021-10-21T00:12:13.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d413e930 con 0x7f55d4066370 2021-10-21T00:12:13.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.317+0000 7f55d8884700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d413ebd0 con 0x7f55d40b7300 2021-10-21T00:12:13.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d40b7300 0x7f55d414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d4147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38278/0 (socket says 172.21.15.41:38278) 2021-10-21T00:12:13.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 -- 172.21.15.41:0/2391576316 learned_addr learned my addr 172.21.15.41:0/2391576316 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 -- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d40b7300 msgr2=0x7f55d414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d40b7300 0x7f55d414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 -- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 msgr2=0x7f55d4147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d4147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 -- 172.21.15.41:0/2391576316 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009470 con 0x7f55d4065a00 2021-10-21T00:12:13.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d259c700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f55c4001110 tx=0x7f55c4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c400ce80 con 0x7f55d4065a00 2021-10-21T00:12:13.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c40070d0 con 0x7f55d4065a00 2021-10-21T00:12:13.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d4141660 con 0x7f55d4065a00 2021-10-21T00:12:13.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c4007430 con 0x7f55d4065a00 2021-10-21T00:12:13.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d414ff70 con 0x7f55d4065a00 2021-10-21T00:12:13.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d413ed90 con 0x7f55d4065a00 2021-10-21T00:12:13.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.321+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f55c401a070 con 0x7f55d4065a00 2021-10-21T00:12:13.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.325+0000 7f55cbfff700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 0x7f55b8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.325+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55c406a980 con 0x7f55d4065a00 2021-10-21T00:12:13.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.325+0000 7f55c9d9b700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 0x7f55b8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.325+0000 7f55c9d9b700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 0x7f55b8055b00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f55bc00b000 tx=0x7f55bc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.329+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55c40419d0 con 0x7f55d4065a00 2021-10-21T00:12:13.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.453+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55d40ad9d0 con 0x7f55d4065a00 2021-10-21T00:12:13.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.453+0000 7f55cbfff700 1 -- 172.21.15.41:0/2391576316 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55c4044ff0 con 0x7f55d4065a00 2021-10-21T00:12:13.463 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:13.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 msgr2=0x7f55b8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 0x7f55b8055b00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f55bc00b000 tx=0x7f55bc006df0).stop 2021-10-21T00:12:13.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 msgr2=0x7f55d40b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f55c4001110 tx=0x7f55c4007aa0).stop 2021-10-21T00:12:13.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 shutdown_connections 2021-10-21T00:12:13.466 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f55b8053640 0x7f55b8055b00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55d40b7300 0x7f55d414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55d4066370 0x7f55d4147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 --2- 172.21.15.41:0/2391576316 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f55d4065a00 0x7f55d40b0390 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 >> 172.21.15.41:0/2391576316 conn(0x7f55d4069df0 msgr2=0x7f55d405c650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.467 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 shutdown_connections 2021-10-21T00:12:13.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.457+0000 7f55d8884700 1 -- 172.21.15.41:0/2391576316 wait complete. 2021-10-21T00:12:13.476 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:12:13.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 Processor -- start 2021-10-21T00:12:13.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 -- start start 2021-10-21T00:12:13.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3bd0066b80 0x7f3bd0066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bd0143c60 0x7f3bd00aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd013a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00acdc0 con 0x7f3bd0143c60 2021-10-21T00:12:13.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00ad060 con 0x7f3bd0066b80 2021-10-21T00:12:13.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd5ec7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd013a870 con 0x7f3bd00b6aa0 2021-10-21T00:12:13.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bd0143c60 0x7f3bd00aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3bd0143c60 0x7f3bd00aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38284/0 (socket says 172.21.15.41:38284) 2021-10-21T00:12:13.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 -- 172.21.15.41:0/1371476200 learned_addr learned my addr 172.21.15.41:0/1371476200 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd56c6700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd013a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bd4ec5700 1 --2- 172.21.15.41:0/1371476200 >> v2:172.21.15.62:3300/0 conn(0x7f3bd0066b80 0x7f3bd0066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 -- 172.21.15.41:0/1371476200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 msgr2=0x7f3bd013a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd013a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 -- 172.21.15.41:0/1371476200 >> v2:172.21.15.62:3300/0 conn(0x7f3bd0066b80 msgr2=0x7f3bd0066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 --2- 172.21.15.41:0/1371476200 >> v2:172.21.15.62:3300/0 conn(0x7f3bd0066b80 0x7f3bd0066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 -- 172.21.15.41:0/1371476200 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd013a9e0 con 0x7f3bd0143c60 2021-10-21T00:12:13.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcffff700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd00aeb60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f3bc4002f70 tx=0x7f3bc4006eb0).ready entity=mon.0 client_cookie=21f944aee033cc16 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcf7fe700 1 -- 172.21.15.41:0/1371476200 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc400d570 con 0x7f3bd0143c60 2021-10-21T00:12:13.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcf7fe700 1 -- 172.21.15.41:0/1371476200 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4000e90 con 0x7f3bd0143c60 2021-10-21T00:12:13.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.581+0000 7f3bcf7fe700 1 -- 172.21.15.41:0/1371476200 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc400d900 con 0x7f3bd0143c60 2021-10-21T00:12:13.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1371476200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 msgr2=0x7f3bd00aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd00aeb60 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f3bc4002f70 tx=0x7f3bc4006eb0).stop 2021-10-21T00:12:13.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1371476200 shutdown_connections 2021-10-21T00:12:13.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd00aeb60 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1371476200 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd013a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1371476200 >> v2:172.21.15.62:3300/0 conn(0x7f3bd0066b80 0x7f3bd0066f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1371476200 >> 172.21.15.41:0/1371476200 conn(0x7f3bd0069df0 msgr2=0x7f3bd0063960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1371476200 shutdown_connections 2021-10-21T00:12:13.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1371476200 wait complete. 2021-10-21T00:12:13.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 Processor -- start 2021-10-21T00:12:13.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- start start 2021-10-21T00:12:13.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bd0066b80 0x7f3bd00afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd01427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b1a40 con 0x7f3bd0143c60 2021-10-21T00:12:13.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00af720 con 0x7f3bd0066b80 2021-10-21T00:12:13.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b08d0 con 0x7f3bd00b6aa0 2021-10-21T00:12:13.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38292/0 (socket says 172.21.15.41:38292) 2021-10-21T00:12:13.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 -- 172.21.15.41:0/1014920499 learned_addr learned my addr 172.21.15.41:0/1014920499 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd4ec5700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bd0066b80 0x7f3bd00afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bcffff700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd01427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 -- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 msgr2=0x7f3bd01427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd01427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 -- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bd0066b80 msgr2=0x7f3bd00afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bd0066b80 0x7f3bd00afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 -- 172.21.15.41:0/1014920499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc400b1e0 con 0x7f3bd0143c60 2021-10-21T00:12:13.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd56c6700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f3bc8006e00 tx=0x7f3bc80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc800eeb0 con 0x7f3bd0143c60 2021-10-21T00:12:13.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc800c850 con 0x7f3bd0143c60 2021-10-21T00:12:13.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00b17a0 con 0x7f3bd0143c60 2021-10-21T00:12:13.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc800cbb0 con 0x7f3bd0143c60 2021-10-21T00:12:13.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.585+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00b1d60 con 0x7f3bd0143c60 2021-10-21T00:12:13.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd00b15e0 con 0x7f3bd0143c60 2021-10-21T00:12:13.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3bc800cd10 con 0x7f3bd0143c60 2021-10-21T00:12:13.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bcdffb700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 0x7f3bb00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3bc806bcf0 con 0x7f3bd0143c60 2021-10-21T00:12:13.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bd4ec5700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 0x7f3bb00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.589+0000 7f3bd4ec5700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 0x7f3bb00559b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f3bc000b000 tx=0x7f3bc0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.593+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3bc8042d40 con 0x7f3bd0143c60 2021-10-21T00:12:13.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.721+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bd00b2c70 con 0x7f3bd0143c60 2021-10-21T00:12:13.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bcdffb700 1 -- 172.21.15.41:0/1014920499 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3bc8046360 con 0x7f3bd0143c60 2021-10-21T00:12:13.733 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:13.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 msgr2=0x7f3bb00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 0x7f3bb00559b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f3bc000b000 tx=0x7f3bc0006df0).stop 2021-10-21T00:12:13.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 msgr2=0x7f3bd0138730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f3bc8006e00 tx=0x7f3bc80091d0).stop 2021-10-21T00:12:13.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 shutdown_connections 2021-10-21T00:12:13.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3bb00534f0 0x7f3bb00559b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3bd0143c60 0x7f3bd0138730 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3bd00b6aa0 0x7f3bd01427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 --2- 172.21.15.41:0/1014920499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bd0066b80 0x7f3bd00afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 >> 172.21.15.41:0/1014920499 conn(0x7f3bd0069df0 msgr2=0x7f3bd01434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 shutdown_connections 2021-10-21T00:12:13.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.725+0000 7f3bd5ec7700 1 -- 172.21.15.41:0/1014920499 wait complete. 2021-10-21T00:12:13.746 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:12:13.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.849+0000 7fc36b59e700 1 Processor -- start 2021-10-21T00:12:13.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.849+0000 7fc36b59e700 1 -- start start 2021-10-21T00:12:13.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc36c0b2170 0x7fc36c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c05fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc36c0602d0 0x7fc36c145e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0aba40 con 0x7fc36c0b2170 2021-10-21T00:12:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0b2550 con 0x7fc36c0602d0 2021-10-21T00:12:13.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0b1350 con 0x7fc36c0ab600 2021-10-21T00:12:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc36c0b2170 0x7fc36c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc36c0b2170 0x7fc36c0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38296/0 (socket says 172.21.15.41:38296) 2021-10-21T00:12:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc369d9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c05fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 -- 172.21.15.41:0/1407660523 learned_addr learned my addr 172.21.15.41:0/1407660523 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36ad9d700 1 --2- 172.21.15.41:0/1407660523 >> v2:172.21.15.62:3300/0 conn(0x7fc36c0602d0 0x7fc36c145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 -- 172.21.15.41:0/1407660523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 msgr2=0x7fc36c05fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1407660523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c05fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 -- 172.21.15.41:0/1407660523 >> v2:172.21.15.62:3300/0 conn(0x7fc36c0602d0 msgr2=0x7fc36c145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:13.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1407660523 >> v2:172.21.15.62:3300/0 conn(0x7fc36c0602d0 0x7fc36c145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 -- 172.21.15.41:0/1407660523 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c05f940 con 0x7fc36c0b2170 2021-10-21T00:12:13.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1407660523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c0b0d20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fc35c002f70 tx=0x7fc35c006eb0).ready entity=mon.0 client_cookie=724b23f7fd220b2b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36959a700 1 -- 172.21.15.41:0/1407660523 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35c00d570 con 0x7fc36c0b2170 2021-10-21T00:12:13.867 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36959a700 1 -- 172.21.15.41:0/1407660523 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c000e90 con 0x7fc36c0b2170 2021-10-21T00:12:13.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36959a700 1 -- 172.21.15.41:0/1407660523 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35c00d900 con 0x7fc36c0b2170 2021-10-21T00:12:13.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- 172.21.15.41:0/1407660523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 msgr2=0x7fc36c0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1407660523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c0b0d20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7fc35c002f70 tx=0x7fc35c006eb0).stop 2021-10-21T00:12:13.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- 172.21.15.41:0/1407660523 shutdown_connections 2021-10-21T00:12:13.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1407660523 >> v2:172.21.15.62:3300/0 conn(0x7fc36c0602d0 0x7fc36c145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1407660523 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c05fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1407660523 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c0b0d20 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- 172.21.15.41:0/1407660523 >> 172.21.15.41:0/1407660523 conn(0x7fc36c0b5700 msgr2=0x7fc36c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:13.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- 172.21.15.41:0/1407660523 shutdown_connections 2021-10-21T00:12:13.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.853+0000 7fc36b59e700 1 -- 172.21.15.41:0/1407660523 wait complete. 2021-10-21T00:12:13.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 Processor -- start 2021-10-21T00:12:13.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- start start 2021-10-21T00:12:13.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36c0602d0 0x7fc36c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c09a390 con 0x7fc36c0b2170 2021-10-21T00:12:13.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0929f0 con 0x7fc36c0602d0 2021-10-21T00:12:13.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c092750 con 0x7fc36c0ab600 2021-10-21T00:12:13.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38306/0 (socket says 172.21.15.41:38306) 2021-10-21T00:12:13.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 -- 172.21.15.41:0/1001996034 learned_addr learned my addr 172.21.15.41:0/1001996034 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:13.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc369d9b700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36c0602d0 0x7fc36c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 -- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 msgr2=0x7fc36c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 -- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36c0602d0 msgr2=0x7fc36c151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:13.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36c0602d0 0x7fc36c151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:13.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 -- 172.21.15.41:0/1001996034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c00b1e0 con 0x7fc36c0b2170 2021-10-21T00:12:13.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36ad9d700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fc36c155180 tx=0x7fc3640091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36400c850 con 0x7fc36c0b2170 2021-10-21T00:12:13.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400c9b0 con 0x7fc36c0b2170 2021-10-21T00:12:13.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c155260 con 0x7fc36c0b2170 2021-10-21T00:12:13.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36400cd10 con 0x7fc36c0b2170 2021-10-21T00:12:13.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.857+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c0b3f00 con 0x7fc36c0b2170 2021-10-21T00:12:13.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c1553f0 con 0x7fc36c0b2170 2021-10-21T00:12:13.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc3640123f0 con 0x7fc36c0b2170 2021-10-21T00:12:13.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc3637fe700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 0x7fc3500559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:13.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc36406bc20 con 0x7fc36c0b2170 2021-10-21T00:12:13.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 0x7fc3500559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:13.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.861+0000 7fc36a59c700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 0x7fc3500559e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc35c01a000 tx=0x7fc35c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:13.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.865+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc364042d20 con 0x7fc36c0b2170 2021-10-21T00:12:14.002 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.993+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc36c060760 con 0x7fc36c0b2170 2021-10-21T00:12:14.003 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.993+0000 7fc3637fe700 1 -- 172.21.15.41:0/1001996034 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc364046340 con 0x7fc36c0b2170 2021-10-21T00:12:14.004 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 msgr2=0x7fc3500559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 0x7fc3500559e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc35c01a000 tx=0x7fc35c015000).stop 2021-10-21T00:12:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 msgr2=0x7fc36c155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fc36c155180 tx=0x7fc3640091d0).stop 2021-10-21T00:12:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 shutdown_connections 2021-10-21T00:12:14.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc350053520 0x7fc3500559e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc36c0b2170 0x7fc36c155700 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc36c0ab600 0x7fc36c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 --2- 172.21.15.41:0/1001996034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36c0602d0 0x7fc36c151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 >> 172.21.15.41:0/1001996034 conn(0x7fc36c0b5700 msgr2=0x7fc36c0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:14.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 shutdown_connections 2021-10-21T00:12:14.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:13.997+0000 7fc36b59e700 1 -- 172.21.15.41:0/1001996034 wait complete. 2021-10-21T00:12:14.016 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:12:14.017 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:14.120 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.109+0000 7f5b01144700 1 Processor -- start 2021-10-21T00:12:14.121 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 -- start start 2021-10-21T00:12:14.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5afc062330 0x7f5afc0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc05bd40 con 0x7f5afc062f70 2021-10-21T00:12:14.123 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc05bf70 con 0x7f5afc062330 2021-10-21T00:12:14.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b01144700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc142cb0 con 0x7f5afc0b3a20 2021-10-21T00:12:14.124 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56812/0 (socket says 172.21.15.41:56812) 2021-10-21T00:12:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 -- 172.21.15.41:0/2705420532 learned_addr learned my addr 172.21.15.41:0/2705420532 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5afbfff700 1 --2- 172.21.15.41:0/2705420532 >> v2:172.21.15.62:3300/0 conn(0x7f5afc062330 0x7f5afc0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.125 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 -- 172.21.15.41:0/2705420532 >> v2:172.21.15.62:3300/0 conn(0x7f5afc062330 msgr2=0x7f5afc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:14.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 --2- 172.21.15.41:0/2705420532 >> v2:172.21.15.62:3300/0 conn(0x7f5afc062330 0x7f5afc0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 -- 172.21.15.41:0/2705420532 >> v1:172.21.15.62:6789/0 conn(0x7f5afc062f70 legacy=0x7f5afc05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 -- 172.21.15.41:0/2705420532 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc142950 con 0x7f5afc0b3a20 2021-10-21T00:12:14.126 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5b00943700 1 --2- 172.21.15.41:0/2705420532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5af40032f0 tx=0x7f5af4009290).ready entity=mon.2 client_cookie=fd3ba759b9e543e8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:14.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5afaffd700 1 -- 172.21.15.41:0/2705420532 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af400b8a0 con 0x7f5afc0b3a20 2021-10-21T00:12:14.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5afaffd700 1 -- 172.21.15.41:0/2705420532 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400ba00 con 0x7f5afc0b3a20 2021-10-21T00:12:14.127 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.113+0000 7f5afaffd700 1 -- 172.21.15.41:0/2705420532 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af400bb70 con 0x7f5afc0b3a20 2021-10-21T00:12:14.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- 172.21.15.41:0/2705420532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 msgr2=0x7f5afc13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.130 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 --2- 172.21.15.41:0/2705420532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5af40032f0 tx=0x7f5af4009290).stop 2021-10-21T00:12:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- 172.21.15.41:0/2705420532 shutdown_connections 2021-10-21T00:12:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 --2- 172.21.15.41:0/2705420532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc0b3a20 0x7f5afc13c510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 --2- 172.21.15.41:0/2705420532 >> v2:172.21.15.62:3300/0 conn(0x7f5afc062330 0x7f5afc0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.131 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- 172.21.15.41:0/2705420532 >> 172.21.15.41:0/2705420532 conn(0x7f5afc0b9080 msgr2=0x7f5afc0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- 172.21.15.41:0/2705420532 shutdown_connections 2021-10-21T00:12:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- 172.21.15.41:0/2705420532 wait complete. 2021-10-21T00:12:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 Processor -- start 2021-10-21T00:12:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.117+0000 7f5b01144700 1 -- start start 2021-10-21T00:12:14.132 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc062330 0x7f5afc0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5afc0b3a20 0x7f5afc1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc141550 con 0x7f5afc062f70 2021-10-21T00:12:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc140820 con 0x7f5afc0b3a20 2021-10-21T00:12:14.133 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0b2b30 con 0x7f5afc062330 2021-10-21T00:12:14.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc062330 0x7f5afc0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38318/0 (socket says 172.21.15.41:38318) 2021-10-21T00:12:14.134 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 -- 172.21.15.41:0/378909941 learned_addr learned my addr 172.21.15.41:0/378909941 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:14.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b00943700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5afc0b3a20 0x7f5afc1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 -- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc062330 msgr2=0x7f5afc0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc062330 0x7f5afc0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.135 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 -- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5afc0b3a20 msgr2=0x7f5afc1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5afc0b3a20 0x7f5afc1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 -- 172.21.15.41:0/378909941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009530 con 0x7f5afc062f70 2021-10-21T00:12:14.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5afb7fe700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f5afc145930 tx=0x7f5aec007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:14.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec012400 con 0x7f5afc062f70 2021-10-21T00:12:14.136 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec012560 con 0x7f5afc062f70 2021-10-21T00:12:14.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc140a50 con 0x7f5afc062f70 2021-10-21T00:12:14.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec0128c0 con 0x7f5afc062f70 2021-10-21T00:12:14.137 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc142560 con 0x7f5afc062f70 2021-10-21T00:12:14.138 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.121+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc057350 con 0x7f5afc062f70 2021-10-21T00:12:14.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.125+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5aec019030 con 0x7f5afc062f70 2021-10-21T00:12:14.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.125+0000 7f5af97fa700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 0x7f5adc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:14.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.125+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5aec06ae50 con 0x7f5afc062f70 2021-10-21T00:12:14.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.125+0000 7f5afbfff700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 0x7f5adc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:14.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.125+0000 7f5afbfff700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 0x7f5adc055ad0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5af000b000 tx=0x7f5af0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:14.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.129+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5aec041e20 con 0x7f5afc062f70 2021-10-21T00:12:14.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.293+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5afc05d080 con 0x7f5afc062f70 2021-10-21T00:12:14.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.293+0000 7f5af97fa700 1 -- 172.21.15.41:0/378909941 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f5aec06c070 con 0x7f5afc062f70 2021-10-21T00:12:14.302 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:14.302 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:10.459587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8481":{"gid":8481,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2228513289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2228513289},{"type":"v1","addr":"172.21.15.62:6835","nonce":2228513289}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:14.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.293+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 msgr2=0x7f5adc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.293+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 0x7f5adc055ad0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5af000b000 tx=0x7f5af0006df0).stop 2021-10-21T00:12:14.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 msgr2=0x7f5afc0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:14.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f5afc145930 tx=0x7f5aec007c20).stop 2021-10-21T00:12:14.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 shutdown_connections 2021-10-21T00:12:14.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5adc053610 0x7f5adc055ad0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5afc0b3a20 0x7f5afc1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5afc062f70 0x7f5afc0ac890 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 --2- 172.21.15.41:0/378909941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5afc062330 0x7f5afc0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:14.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 >> 172.21.15.41:0/378909941 conn(0x7f5afc0b9080 msgr2=0x7f5afc142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:14.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 shutdown_connections 2021-10-21T00:12:14.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:14.297+0000 7f5b01144700 1 -- 172.21.15.41:0/378909941 wait complete. 2021-10-21T00:12:14.307 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 72 2021-10-21T00:12:14.517 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:09.433938+0000', 'modified': '2021-10-21T00:12:10.459587+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8481': {'gid': 8481, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/2228513289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 2228513289}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2228513289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:14.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:14.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:12:14.635 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8481,"want_state":"up:active","state":"up:active","rank_uptime":5.1831337680000003,"mdsmap_epoch":72,"osdmap_epoch":136,"osdmap_epoch_barrier":136,"uptime":9.5502370970000001} 2021-10-21T00:12:14.636 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8481, "mdsmap_epoch": 72, "osdmap_epoch": 136, "osdmap_epoch_barrier": 136, "rank_uptime": 5.183133768, "state": "up:active", "uptime": 9.550237097, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:14.636 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:12:14.637 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:12:14.637 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:12:14.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:14.638 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:14.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:14.706 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:14.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:14.718 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:14.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:14.720 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:14.725 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:12:14.726 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:14.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:14.744 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:14.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:14.804 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:14.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:12:14.798+0000 7f7a498f0080 -1 init, newargv = 0x55a186e1c9d0 newargc=9 2021-10-21T00:12:14.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15136]: starting ceph client 2021-10-21T00:12:14.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:14.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:14.808 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:14.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15136]: starting fuse 2021-10-21T00:12:15.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:15.933 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:15.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:15.989 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:15.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:15.992 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:15.999 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:12:15.999 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:12:16.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:16.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:12:16.001 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:12:16.001 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:12:16.002 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:12:16.002 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:12:16.003 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:16.003 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:12:16.004 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:12:16.004 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:12:16.005 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:16.005 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:12:16.006 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:12:16.006 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:12:16.007 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:12:16.007 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:16.007 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:12:16.008 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:12:16.008 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:12:16.009 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:12:16.009 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:12:16.009 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:16.010 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:12:16.010 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:12:16.053 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.15136.asok 2021-10-21T00:12:16.058 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15136.asok 2021-10-21T00:12:16.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:16.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15136.asok status 2021-10-21T00:12:16.194 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:12:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:12:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:12:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:12:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:12:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:12:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:12:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "15136", 2021-10-21T00:12:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:12:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:12:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:12:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 8425, 2021-10-21T00:12:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:12:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:12:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:12:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 8425 2021-10-21T00:12:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:12:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:12:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:12:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1237921020 2021-10-21T00:12:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:12:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:12:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:12:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:12:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1237921020 2021-10-21T00:12:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.8425 172.21.15.71:0/1237921020", 2021-10-21T00:12:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/1237921020", 2021-10-21T00:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 72, 2021-10-21T00:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 136, 2021-10-21T00:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:12:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:12:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:12:16.203 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:12:16.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:16.205 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:16.205 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:16.212 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:12:16.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:12:16.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:16.214 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:16.230 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:16.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 Processor -- start 2021-10-21T00:12:16.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- start start 2021-10-21T00:12:16.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7effb40aa750 0x7effb414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7effb414b350 0x7effb40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40609d0 con 0x7effb405f9f0 2021-10-21T00:12:16.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40b1620 con 0x7effb414b350 2021-10-21T00:12:16.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb405fdd0 con 0x7effb40aa750 2021-10-21T00:12:16.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb3fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7effb414b350 0x7effb40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7effb405f9f0 0x7effb414a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36094/0 (socket says 172.21.15.41:36094) 2021-10-21T00:12:16.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb37fe700 1 -- 172.21.15.41:0/2204409149 learned_addr learned my addr 172.21.15.41:0/2204409149 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:16.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 --2- 172.21.15.41:0/2204409149 >> v2:172.21.15.62:3300/0 conn(0x7effb40aa750 0x7effb414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb27fc700 1 -- 172.21.15.41:0/2204409149 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312130623 0 0) 0x7effb40609d0 con 0x7effb405f9f0 2021-10-21T00:12:16.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb27fc700 1 -- 172.21.15.41:0/2204409149 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff94003260 con 0x7effb405f9f0 2021-10-21T00:12:16.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 -- 172.21.15.41:0/2204409149 >> v2:172.21.15.41:3300/0 conn(0x7effb414b350 msgr2=0x7effb40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:16.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 --2- 172.21.15.41:0/2204409149 >> v2:172.21.15.41:3300/0 conn(0x7effb414b350 0x7effb40af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 -- 172.21.15.41:0/2204409149 >> v1:172.21.15.41:6789/0 conn(0x7effb405f9f0 legacy=0x7effb414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 -- 172.21.15.41:0/2204409149 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40b1380 con 0x7effb40aa750 2021-10-21T00:12:16.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb2ffd700 1 --2- 172.21.15.41:0/2204409149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb40aa750 0x7effb414ae60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7effa40032f0 tx=0x7effa40091d0).ready entity=mon.1 client_cookie=f01f16055144f688 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb27fc700 1 -- 172.21.15.41:0/2204409149 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa400b600 con 0x7effb40aa750 2021-10-21T00:12:16.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb27fc700 1 -- 172.21.15.41:0/2204409149 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400b760 con 0x7effb40aa750 2021-10-21T00:12:16.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effb27fc700 1 -- 172.21.15.41:0/2204409149 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa400b8d0 con 0x7effb40aa750 2021-10-21T00:12:16.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- 172.21.15.41:0/2204409149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb40aa750 msgr2=0x7effb414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 --2- 172.21.15.41:0/2204409149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb40aa750 0x7effb414ae60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7effa40032f0 tx=0x7effa40091d0).stop 2021-10-21T00:12:16.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- 172.21.15.41:0/2204409149 shutdown_connections 2021-10-21T00:12:16.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 --2- 172.21.15.41:0/2204409149 >> v2:172.21.15.41:3300/0 conn(0x7effb414b350 0x7effb40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 --2- 172.21.15.41:0/2204409149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb40aa750 0x7effb414ae60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- 172.21.15.41:0/2204409149 >> 172.21.15.41:0/2204409149 conn(0x7effb405bca0 msgr2=0x7effb405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:16.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- 172.21.15.41:0/2204409149 shutdown_connections 2021-10-21T00:12:16.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.333+0000 7effba0ec700 1 -- 172.21.15.41:0/2204409149 wait complete. 2021-10-21T00:12:16.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 Processor -- start 2021-10-21T00:12:16.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 -- start start 2021-10-21T00:12:16.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb405f9f0 0x7effb40b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effb40aa750 0x7effb41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4063b20 con 0x7effb414b350 2021-10-21T00:12:16.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40ae6d0 con 0x7effb405f9f0 2021-10-21T00:12:16.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40aedd0 con 0x7effb40aa750 2021-10-21T00:12:16.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38334/0 (socket says 172.21.15.41:38334) 2021-10-21T00:12:16.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb2ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effb40aa750 0x7effb41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 -- 172.21.15.41:0/552768140 learned_addr learned my addr 172.21.15.41:0/552768140 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:16.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb37fe700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb405f9f0 0x7effb40b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 -- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effb40aa750 msgr2=0x7effb41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effb40aa750 0x7effb41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 -- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb405f9f0 msgr2=0x7effb40b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb405f9f0 0x7effb40b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 -- 172.21.15.41:0/552768140 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009470 con 0x7effb414b350 2021-10-21T00:12:16.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb3fff700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7effac00c000 tx=0x7effac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effac011750 con 0x7effb414b350 2021-10-21T00:12:16.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0118b0 con 0x7effb414b350 2021-10-21T00:12:16.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.337+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb40af070 con 0x7effb414b350 2021-10-21T00:12:16.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effac011c10 con 0x7effb414b350 2021-10-21T00:12:16.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40aead0 con 0x7effb414b350 2021-10-21T00:12:16.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7effac011d70 con 0x7effb414b350 2021-10-21T00:12:16.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40ae310 con 0x7effb414b350 2021-10-21T00:12:16.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb0ff9700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 0x7eff98055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7effac06bc20 con 0x7effb414b350 2021-10-21T00:12:16.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb37fe700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 0x7eff98055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.341+0000 7effb37fe700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 0x7eff98055b60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7eff9c00d000 tx=0x7eff9c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.349+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7effb40ae310 con 0x7effb414b350 2021-10-21T00:12:16.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.473+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb40ae310 con 0x7effb414b350 2021-10-21T00:12:16.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.473+0000 7effb0ff9700 1 -- 172.21.15.41:0/552768140 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16052 (secure 0 0 0) 0x7effb40ae310 con 0x7effb414b350 2021-10-21T00:12:16.483 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:16.483 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":136,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:10.449809+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:07.923124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:08.769999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:16.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 msgr2=0x7eff98055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 0x7eff98055b60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7eff9c00d000 tx=0x7eff9c009040).stop 2021-10-21T00:12:16.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 msgr2=0x7effb4066d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7effac00c000 tx=0x7effac006df0).stop 2021-10-21T00:12:16.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 shutdown_connections 2021-10-21T00:12:16.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7eff980536a0 0x7eff98055b60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7effb414b350 0x7effb4066d80 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effb40aa750 0x7effb41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 --2- 172.21.15.41:0/552768140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effb405f9f0 0x7effb40b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 >> 172.21.15.41:0/552768140 conn(0x7effb405bca0 msgr2=0x7effb4146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:16.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 shutdown_connections 2021-10-21T00:12:16.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.477+0000 7effba0ec700 1 -- 172.21.15.41:0/552768140 wait complete. 2021-10-21T00:12:16.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:12:07.923124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:12:08.769999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:12:16.498 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 Processor -- start 2021-10-21T00:12:16.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 -- start start 2021-10-21T00:12:16.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b9ca0 0x7fde740b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fde740b26d0 0x7fde74141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde740ba080 con 0x7fde740b31e0 2021-10-21T00:12:16.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7405c670 con 0x7fde740b26d0 2021-10-21T00:12:16.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde7b496700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7405c8e0 con 0x7fde740b9ca0 2021-10-21T00:12:16.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fde740b26d0 0x7fde74141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fde740b26d0 0x7fde74141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38342/0 (socket says 172.21.15.41:38342) 2021-10-21T00:12:16.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79232700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b9ca0 0x7fde740b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 -- 172.21.15.41:0/521786284 learned_addr learned my addr 172.21.15.41:0/521786284 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:16.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde78a31700 1 --1- 172.21.15.41:0/521786284 >> v1:172.21.15.62:6789/0 conn(0x7fde740b31e0 0x7fde740b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44166/0 (socket says 172.21.15.41:44166) 2021-10-21T00:12:16.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 -- 172.21.15.41:0/521786284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b9ca0 msgr2=0x7fde740b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:16.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 --2- 172.21.15.41:0/521786284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b9ca0 0x7fde740b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 -- 172.21.15.41:0/521786284 >> v1:172.21.15.62:6789/0 conn(0x7fde740b31e0 legacy=0x7fde740b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 -- 172.21.15.41:0/521786284 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7405cb80 con 0x7fde740b26d0 2021-10-21T00:12:16.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde79a33700 1 --2- 172.21.15.41:0/521786284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b26d0 0x7fde74141bc0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fde6c0032f0 tx=0x7fde6c009290).ready entity=mon.0 client_cookie=d4fc1ac792973f20 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde63fff700 1 -- 172.21.15.41:0/521786284 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c00b8a0 con 0x7fde740b26d0 2021-10-21T00:12:16.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde63fff700 1 -- 172.21.15.41:0/521786284 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ba00 con 0x7fde740b26d0 2021-10-21T00:12:16.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.597+0000 7fde63fff700 1 -- 172.21.15.41:0/521786284 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde6c00bb70 con 0x7fde740b26d0 2021-10-21T00:12:16.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- 172.21.15.41:0/521786284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b26d0 msgr2=0x7fde74141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- 172.21.15.41:0/521786284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b26d0 0x7fde74141bc0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fde6c0032f0 tx=0x7fde6c009290).stop 2021-10-21T00:12:16.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- 172.21.15.41:0/521786284 shutdown_connections 2021-10-21T00:12:16.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- 172.21.15.41:0/521786284 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b26d0 0x7fde74141bc0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- 172.21.15.41:0/521786284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b9ca0 0x7fde740b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- 172.21.15.41:0/521786284 >> 172.21.15.41:0/521786284 conn(0x7fde74062f00 msgr2=0x7fde740b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- 172.21.15.41:0/521786284 shutdown_connections 2021-10-21T00:12:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- 172.21.15.41:0/521786284 wait complete. 2021-10-21T00:12:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 Processor -- start 2021-10-21T00:12:16.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- start start 2021-10-21T00:12:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b26d0 0x7fde740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde740b9ca0 0x7fde74151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74155380 con 0x7fde740b31e0 2021-10-21T00:12:16.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74155620 con 0x7fde740b9ca0 2021-10-21T00:12:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde7b496700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde741558c0 con 0x7fde740b26d0 2021-10-21T00:12:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38346/0 (socket says 172.21.15.41:38346) 2021-10-21T00:12:16.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 -- 172.21.15.41:0/1417971862 learned_addr learned my addr 172.21.15.41:0/1417971862 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:16.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde79232700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b26d0 0x7fde740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde79a33700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde740b9ca0 0x7fde74151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 -- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b26d0 msgr2=0x7fde740b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b26d0 0x7fde740b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 -- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde740b9ca0 msgr2=0x7fde74151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde740b9ca0 0x7fde74151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.601+0000 7fde78a31700 1 -- 172.21.15.41:0/1417971862 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009530 con 0x7fde740b31e0 2021-10-21T00:12:16.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde78a31700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fde740633e0 tx=0x7fde64007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde640070d0 con 0x7fde740b31e0 2021-10-21T00:12:16.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64007230 con 0x7fde740b31e0 2021-10-21T00:12:16.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde740ad950 con 0x7fde740b31e0 2021-10-21T00:12:16.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde64005740 con 0x7fde740b31e0 2021-10-21T00:12:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde740ae130 con 0x7fde740b31e0 2021-10-21T00:12:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde64010070 con 0x7fde740b31e0 2021-10-21T00:12:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 0x7fde54055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde6406ad10 con 0x7fde740b31e0 2021-10-21T00:12:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde741137e0 con 0x7fde740b31e0 2021-10-21T00:12:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde79232700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 0x7fde54055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.605+0000 7fde79232700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 0x7fde54055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fde7000b000 tx=0x7fde70006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.609+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde741137e0 con 0x7fde740b31e0 2021-10-21T00:12:16.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.741+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fde741137e0 con 0x7fde740b31e0 2021-10-21T00:12:16.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde627fc700 1 -- 172.21.15.41:0/1417971862 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7fde741137e0 con 0x7fde740b31e0 2021-10-21T00:12:16.752 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 msgr2=0x7fde54055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 0x7fde54055ad0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fde7000b000 tx=0x7fde70006df0).stop 2021-10-21T00:12:16.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 msgr2=0x7fde74155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fde740633e0 tx=0x7fde64007c00).stop 2021-10-21T00:12:16.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 shutdown_connections 2021-10-21T00:12:16.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fde54053610 0x7fde54055ad0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde740b9ca0 0x7fde74151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fde740b31e0 0x7fde74155d60 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 --2- 172.21.15.41:0/1417971862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde740b26d0 0x7fde740b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 >> 172.21.15.41:0/1417971862 conn(0x7fde74062f00 msgr2=0x7fde74142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:16.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 shutdown_connections 2021-10-21T00:12:16.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.745+0000 7fde7b496700 1 -- 172.21.15.41:0/1417971862 wait complete. 2021-10-21T00:12:16.765 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:16.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 Processor -- start 2021-10-21T00:12:16.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 -- start start 2021-10-21T00:12:16.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2370065a00 0x7f2370065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f237014b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700b76e0 con 0x7f23700b7300 2021-10-21T00:12:16.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2370144de0 con 0x7f2370065a00 2021-10-21T00:12:16.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2377303700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700ac890 con 0x7f2370066370 2021-10-21T00:12:16.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2370065a00 0x7f2370065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f2370065a00 0x7f2370065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38354/0 (socket says 172.21.15.41:38354) 2021-10-21T00:12:16.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237509f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f23700b7300 0x7f237013a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36122/0 (socket says 172.21.15.41:36122) 2021-10-21T00:12:16.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 -- 172.21.15.41:0/2795360560 learned_addr learned my addr 172.21.15.41:0/2795360560 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:16.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f23758a0700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f237014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2367fff700 1 -- 172.21.15.41:0/2795360560 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917167007 0 0) 0x7f23700b76e0 con 0x7f23700b7300 2021-10-21T00:12:16.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 -- 172.21.15.41:0/2795360560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 msgr2=0x7f237014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f237014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 -- 172.21.15.41:0/2795360560 >> v1:172.21.15.41:6789/0 conn(0x7f23700b7300 legacy=0x7f237013a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 -- 172.21.15.41:0/2795360560 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700acb30 con 0x7f2370065a00 2021-10-21T00:12:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f237489e700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f2370065e80 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f2360002f70 tx=0x7f2360006eb0).ready entity=mon.0 client_cookie=c3a3031777b74475 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2367fff700 1 -- 172.21.15.41:0/2795360560 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236000d570 con 0x7f2370065a00 2021-10-21T00:12:16.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2367fff700 1 -- 172.21.15.41:0/2795360560 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360000e90 con 0x7f2370065a00 2021-10-21T00:12:16.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.869+0000 7f2367fff700 1 -- 172.21.15.41:0/2795360560 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236000d8c0 con 0x7f2370065a00 2021-10-21T00:12:16.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- 172.21.15.41:0/2795360560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 msgr2=0x7f2370065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f2370065e80 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f2360002f70 tx=0x7f2360006eb0).stop 2021-10-21T00:12:16.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- 172.21.15.41:0/2795360560 shutdown_connections 2021-10-21T00:12:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f237014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 --2- 172.21.15.41:0/2795360560 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f2370065e80 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- 172.21.15.41:0/2795360560 >> 172.21.15.41:0/2795360560 conn(0x7f2370069df0 msgr2=0x7f2370064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:16.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- 172.21.15.41:0/2795360560 shutdown_connections 2021-10-21T00:12:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- 172.21.15.41:0/2795360560 wait complete. 2021-10-21T00:12:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 Processor -- start 2021-10-21T00:12:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.873+0000 7f2377303700 1 -- start start 2021-10-21T00:12:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f23701505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23700b7300 0x7f23700b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370140e10 con 0x7f2370065a00 2021-10-21T00:12:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237014fd00 con 0x7f23700b7300 2021-10-21T00:12:16.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237013db20 con 0x7f2370066370 2021-10-21T00:12:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38358/0 (socket says 172.21.15.41:38358) 2021-10-21T00:12:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 -- 172.21.15.41:0/1074608038 learned_addr learned my addr 172.21.15.41:0/1074608038 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237489e700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f23701505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23758a0700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23700b7300 0x7f23700b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 -- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 msgr2=0x7f23701505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f23701505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 -- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23700b7300 msgr2=0x7f23700b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:16.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23700b7300 0x7f23700b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 -- 172.21.15.41:0/1074608038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236000b1e0 con 0x7f2370065a00 2021-10-21T00:12:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237489e700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f23701505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f237509f700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f236c000ed0 tx=0x7f236c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c0070d0 con 0x7f2370065a00 2021-10-21T00:12:16.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c007230 con 0x7f2370065a00 2021-10-21T00:12:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2370141440 con 0x7f2370065a00 2021-10-21T00:12:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c005550 con 0x7f2370065a00 2021-10-21T00:12:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370150c70 con 0x7f2370065a00 2021-10-21T00:12:16.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370141770 con 0x7f2370065a00 2021-10-21T00:12:16.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f236c01a060 con 0x7f2370065a00 2021-10-21T00:12:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.877+0000 7f23667fc700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:16.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.881+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f236c06b5b0 con 0x7f2370065a00 2021-10-21T00:12:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.881+0000 7f237489e700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.881+0000 7f237489e700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f2360017000 tx=0x7f2360015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:16.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:16.885+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f236c042710 con 0x7f2370065a00 2021-10-21T00:12:17.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.013+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23700ad9d0 con 0x7f2370065a00 2021-10-21T00:12:17.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.013+0000 7f23667fc700 1 -- 172.21.15.41:0/1074608038 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f236c045d30 con 0x7f2370065a00 2021-10-21T00:12:17.024 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 msgr2=0x7f2358055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 0x7f2358055b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f2360017000 tx=0x7f2360015000).stop 2021-10-21T00:12:17.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 msgr2=0x7f23701400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f236c000ed0 tx=0x7f236c007c80).stop 2021-10-21T00:12:17.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 shutdown_connections 2021-10-21T00:12:17.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f23580536a0 0x7f2358055b60 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23700b7300 0x7f23700b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2370066370 0x7f23701505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 --2- 172.21.15.41:0/1074608038 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2370065a00 0x7f23701400e0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 >> 172.21.15.41:0/1074608038 conn(0x7f2370069df0 msgr2=0x7f237013cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 shutdown_connections 2021-10-21T00:12:17.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.017+0000 7f2377303700 1 -- 172.21.15.41:0/1074608038 wait complete. 2021-10-21T00:12:17.041 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:12:17.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 Processor -- start 2021-10-21T00:12:17.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 -- start start 2021-10-21T00:12:17.168 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1e40b9c20 0x7fa1e40acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e40ba000 con 0x7fa1e405c860 2021-10-21T00:12:17.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e4142ad0 con 0x7fa1e40b41a0 2021-10-21T00:12:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e881c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e4143bc0 con 0x7fa1e40b9c20 2021-10-21T00:12:17.170 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e259c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa1e405c860 0x7fa1e41434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36136/0 (socket says 172.21.15.41:36136) 2021-10-21T00:12:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e259c700 1 -- 172.21.15.41:0/404309628 learned_addr learned my addr 172.21.15.41:0/404309628 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e2d9d700 1 --2- 172.21.15.41:0/404309628 >> v2:172.21.15.62:3300/0 conn(0x7fa1e40b9c20 0x7fa1e40acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868597680 0 0) 0x7fa1e40ba000 con 0x7fa1e405c860 2021-10-21T00:12:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c8003260 con 0x7fa1e405c860 2021-10-21T00:12:17.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338748260 0 0) 0x7fa1e4142ad0 con 0x7fa1e40b41a0 2021-10-21T00:12:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e40ba000 con 0x7fa1e40b41a0 2021-10-21T00:12:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/404309628 >> v1:172.21.15.62:6789/0 conn(0x7fa1e40b41a0 legacy=0x7fa1e4141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431899383 0 0) 0x7fa1c8003260 con 0x7fa1e405c860 2021-10-21T00:12:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/404309628 >> v1:172.21.15.41:6789/0 conn(0x7fa1e405c860 legacy=0x7fa1e41434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.137+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/404309628 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4142d70 con 0x7fa1e40b9c20 2021-10-21T00:12:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e2d9d700 1 --2- 172.21.15.41:0/404309628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e40acd30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa1d4001110 tx=0x7fa1d8006d90).ready entity=mon.1 client_cookie=89f6a20e163a5b1b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d4001660 con 0x7fa1e40b9c20 2021-10-21T00:12:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8000e90 con 0x7fa1e40b9c20 2021-10-21T00:12:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e1d9b700 1 -- 172.21.15.41:0/404309628 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d800beb0 con 0x7fa1e40b9c20 2021-10-21T00:12:17.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- 172.21.15.41:0/404309628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 msgr2=0x7fa1e40acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 --2- 172.21.15.41:0/404309628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e40acd30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa1d4001110 tx=0x7fa1d8006d90).stop 2021-10-21T00:12:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- 172.21.15.41:0/404309628 shutdown_connections 2021-10-21T00:12:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 --2- 172.21.15.41:0/404309628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e40acd30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- 172.21.15.41:0/404309628 >> 172.21.15.41:0/404309628 conn(0x7fa1e4062f00 msgr2=0x7fa1e40b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- 172.21.15.41:0/404309628 shutdown_connections 2021-10-21T00:12:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- 172.21.15.41:0/404309628 wait complete. 2021-10-21T00:12:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 Processor -- start 2021-10-21T00:12:17.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.141+0000 7fa1e881c700 1 -- start start 2021-10-21T00:12:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1e40b41a0 0x7fa1e40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e413e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4151b50 con 0x7fa1e405c860 2021-10-21T00:12:17.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40afb30 con 0x7fa1e40b9c20 2021-10-21T00:12:17.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40afdd0 con 0x7fa1e40b41a0 2021-10-21T00:12:17.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38372/0 (socket says 172.21.15.41:38372) 2021-10-21T00:12:17.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/3145372198 learned_addr learned my addr 172.21.15.41:0/3145372198 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:17.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e359e700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e413e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e259c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1e40b41a0 0x7fa1e40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1e40b41a0 msgr2=0x7fa1e40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1e40b41a0 0x7fa1e40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.182 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 msgr2=0x7fa1e413e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e413e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.183 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 -- 172.21.15.41:0/3145372198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d800b120 con 0x7fa1e405c860 2021-10-21T00:12:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e2d9d700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa1d4001110 tx=0x7fa1d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d801c5f0 con 0x7fa1e405c860 2021-10-21T00:12:17.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d801c750 con 0x7fa1e405c860 2021-10-21T00:12:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e40b0070 con 0x7fa1e405c860 2021-10-21T00:12:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d801cab0 con 0x7fa1e405c860 2021-10-21T00:12:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e40af690 con 0x7fa1e405c860 2021-10-21T00:12:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.145+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e40b0200 con 0x7fa1e405c860 2021-10-21T00:12:17.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.149+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1d800f070 con 0x7fa1e405c860 2021-10-21T00:12:17.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.149+0000 7fa1d3fff700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 0x7fa1c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.186 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.149+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1d806cc60 con 0x7fa1e405c860 2021-10-21T00:12:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.149+0000 7fa1e259c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 0x7fa1c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.187 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.149+0000 7fa1e259c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 0x7fa1c0055a40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fa1d400d000 tx=0x7fa1d4000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.188 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.157+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1d8043c30 con 0x7fa1e405c860 2021-10-21T00:12:17.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.281+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1e4057350 con 0x7fa1e405c860 2021-10-21T00:12:17.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.281+0000 7fa1d3fff700 1 -- 172.21.15.41:0/3145372198 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa1d8047250 con 0x7fa1e405c860 2021-10-21T00:12:17.291 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:17.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 msgr2=0x7fa1c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 0x7fa1c0055a40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fa1d400d000 tx=0x7fa1d4000bc0).stop 2021-10-21T00:12:17.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 msgr2=0x7fa1e4146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa1d4001110 tx=0x7fa1d8014000).stop 2021-10-21T00:12:17.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 shutdown_connections 2021-10-21T00:12:17.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1c0053580 0x7fa1c0055a40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1e40b9c20 0x7fa1e413e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1e40b41a0 0x7fa1e40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 --2- 172.21.15.41:0/3145372198 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1e405c860 0x7fa1e4146a10 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 >> 172.21.15.41:0/3145372198 conn(0x7fa1e4062f00 msgr2=0x7fa1e40b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 shutdown_connections 2021-10-21T00:12:17.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.285+0000 7fa1e881c700 1 -- 172.21.15.41:0/3145372198 wait complete. 2021-10-21T00:12:17.304 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:12:17.413 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 Processor -- start 2021-10-21T00:12:17.414 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 -- start start 2021-10-21T00:12:17.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.419 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 0x7f849c13ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c0b6350 con 0x7f849c0b5f70 2021-10-21T00:12:17.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0b0e10 con 0x7f849c1423a0 2021-10-21T00:12:17.420 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a1709700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0b10b0 con 0x7f849c067a00 2021-10-21T00:12:17.421 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56880/0 (socket says 172.21.15.41:56880) 2021-10-21T00:12:17.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 -- 172.21.15.41:0/2756646745 learned_addr learned my addr 172.21.15.41:0/2756646745 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:17.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a0f08700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 0x7f849c13ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.422 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 -- 172.21.15.41:0/2756646745 >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 msgr2=0x7f849c13ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 --2- 172.21.15.41:0/2756646745 >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 0x7f849c13ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 -- 172.21.15.41:0/2756646745 >> v1:172.21.15.62:6789/0 conn(0x7f849c0b5f70 legacy=0x7f849c0672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.423 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849b7fe700 1 -- 172.21.15.41:0/2756646745 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0b1350 con 0x7f849c067a00 2021-10-21T00:12:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f84a0f08700 1 --2- 172.21.15.41:0/2756646745 >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 0x7f849c13ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.405+0000 7f849affd700 1 -- 172.21.15.41:0/2756646745 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565430664 0 0) 0x7f849c0b6350 con 0x7f849c0b5f70 2021-10-21T00:12:17.424 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f849b7fe700 1 --2- 172.21.15.41:0/2756646745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8490002f70 tx=0x7f8490006eb0).ready entity=mon.2 client_cookie=22ea1850e21cdfe1 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f849affd700 1 -- 172.21.15.41:0/2756646745 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f849000d570 con 0x7f849c067a00 2021-10-21T00:12:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f849affd700 1 -- 172.21.15.41:0/2756646745 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490000e90 con 0x7f849c067a00 2021-10-21T00:12:17.425 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f849affd700 1 -- 172.21.15.41:0/2756646745 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f849000d8c0 con 0x7f849c067a00 2021-10-21T00:12:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- 172.21.15.41:0/2756646745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 msgr2=0x7f849c0b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 --2- 172.21.15.41:0/2756646745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8490002f70 tx=0x7f8490006eb0).stop 2021-10-21T00:12:17.426 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- 172.21.15.41:0/2756646745 shutdown_connections 2021-10-21T00:12:17.427 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 --2- 172.21.15.41:0/2756646745 >> v2:172.21.15.62:3300/0 conn(0x7f849c1423a0 0x7f849c13ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 --2- 172.21.15.41:0/2756646745 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c067a00 0x7f849c0b1a90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- 172.21.15.41:0/2756646745 >> 172.21.15.41:0/2756646745 conn(0x7f849c0639f0 msgr2=0x7f849c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- 172.21.15.41:0/2756646745 shutdown_connections 2021-10-21T00:12:17.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- 172.21.15.41:0/2756646745 wait complete. 2021-10-21T00:12:17.429 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 Processor -- start 2021-10-21T00:12:17.430 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.409+0000 7f84a1709700 1 -- start start 2021-10-21T00:12:17.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f849c067a00 0x7f849c064700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 0x7f849c13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c139e80 con 0x7f849c1423a0 2021-10-21T00:12:17.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c13a120 con 0x7f849c067a00 2021-10-21T00:12:17.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c13a3c0 con 0x7f849c0b5f70 2021-10-21T00:12:17.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a0f08700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f849c067a00 0x7f849c064700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 0x7f849c13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a0f08700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38390/0 (socket says 172.21.15.41:38390) 2021-10-21T00:12:17.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a0f08700 1 -- 172.21.15.41:0/907105591 learned_addr learned my addr 172.21.15.41:0/907105591 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:17.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 -- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f849c067a00 msgr2=0x7f849c064700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f849c067a00 0x7f849c064700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.437 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 -- 172.21.15.41:0/907105591 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 msgr2=0x7f849c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 -- 172.21.15.41:0/907105591 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009470 con 0x7f849c0b5f70 2021-10-21T00:12:17.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a0f08700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:17.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f849b7fe700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 0x7f849c13dde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8490002f70 tx=0x7f8490015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8490011760 con 0x7f849c0b5f70 2021-10-21T00:12:17.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84900118c0 con 0x7f849c0b5f70 2021-10-21T00:12:17.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849000b1e0 con 0x7f849c0b5f70 2021-10-21T00:12:17.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8490011c20 con 0x7f849c0b5f70 2021-10-21T00:12:17.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c13e7c0 con 0x7f849c0b5f70 2021-10-21T00:12:17.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.413+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c13a580 con 0x7f849c0b5f70 2021-10-21T00:12:17.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.417+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8490025030 con 0x7f849c0b5f70 2021-10-21T00:12:17.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.417+0000 7f84997fa700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 0x7f847c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.417+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f849006c8a0 con 0x7f849c0b5f70 2021-10-21T00:12:17.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.417+0000 7f849bfff700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 0x7f847c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.417+0000 7f849bfff700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 0x7f847c055b00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f848c00d000 tx=0x7f848c007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.425+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8490043a00 con 0x7f849c0b5f70 2021-10-21T00:12:17.559 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.549+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f849c0b15f0 con 0x7f849c0b5f70 2021-10-21T00:12:17.560 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84997fa700 1 -- 172.21.15.41:0/907105591 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+10 (secure 0 0 0) 0x7f84900230a0 con 0x7f849c0b5f70 2021-10-21T00:12:17.560 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:17.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 msgr2=0x7f847c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 0x7f847c055b00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f848c00d000 tx=0x7f848c007a00).stop 2021-10-21T00:12:17.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 msgr2=0x7f849c13dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 0x7f849c13dde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8490002f70 tx=0x7f8490015000).stop 2021-10-21T00:12:17.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 shutdown_connections 2021-10-21T00:12:17.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f847c053640 0x7f847c055b00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f849c1423a0 0x7f849c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.573 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f849c0b5f70 0x7f849c13dde0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.574 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 --2- 172.21.15.41:0/907105591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f849c067a00 0x7f849c064700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.575 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 >> 172.21.15.41:0/907105591 conn(0x7f849c0639f0 msgr2=0x7f849c0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 shutdown_connections 2021-10-21T00:12:17.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.553+0000 7f84a1709700 1 -- 172.21.15.41:0/907105591 wait complete. 2021-10-21T00:12:17.580 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:12:17.581 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:17.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 Processor -- start 2021-10-21T00:12:17.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 -- start start 2021-10-21T00:12:17.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a4c0b2170 0x7f8a4c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 0x7f8a4c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0b0b50 con 0x7f8a4c0abb50 2021-10-21T00:12:17.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0b2550 con 0x7f8a4c0b2170 2021-10-21T00:12:17.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.677+0000 7f8a50c76700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0b0d90 con 0x7f8a4c0af620 2021-10-21T00:12:17.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f8a4c0abb50 0x7f8a4c14a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36168/0 (socket says 172.21.15.41:36168) 2021-10-21T00:12:17.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4bfff700 1 -- 172.21.15.41:0/499952033 learned_addr learned my addr 172.21.15.41:0/499952033 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:17.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 --2- 172.21.15.41:0/499952033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 0x7f8a4c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4b7fe700 1 --2- 172.21.15.41:0/499952033 >> v2:172.21.15.62:3300/0 conn(0x7f8a4c0b2170 0x7f8a4c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4a7fc700 1 -- 172.21.15.41:0/499952033 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754675400 0 0) 0x7f8a44001490 con 0x7f8a4c0abb50 2021-10-21T00:12:17.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4a7fc700 1 -- 172.21.15.41:0/499952033 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a38003260 con 0x7f8a4c0abb50 2021-10-21T00:12:17.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 -- 172.21.15.41:0/499952033 >> v2:172.21.15.62:3300/0 conn(0x7f8a4c0b2170 msgr2=0x7f8a4c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:17.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 --2- 172.21.15.41:0/499952033 >> v2:172.21.15.62:3300/0 conn(0x7f8a4c0b2170 0x7f8a4c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 -- 172.21.15.41:0/499952033 >> v1:172.21.15.41:6789/0 conn(0x7f8a4c0abb50 legacy=0x7f8a4c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 -- 172.21.15.41:0/499952033 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0b1030 con 0x7f8a4c0af620 2021-10-21T00:12:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4affd700 1 --2- 172.21.15.41:0/499952033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 0x7f8a4c0ab660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8a3c002f70 tx=0x7f8a3c006df0).ready entity=mon.2 client_cookie=49a4b539925a2142 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4a7fc700 1 -- 172.21.15.41:0/499952033 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a3c00d4a0 con 0x7f8a4c0af620 2021-10-21T00:12:17.694 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4a7fc700 1 -- 172.21.15.41:0/499952033 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c000e90 con 0x7f8a4c0af620 2021-10-21T00:12:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a4a7fc700 1 -- 172.21.15.41:0/499952033 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a3c00d7f0 con 0x7f8a4c0af620 2021-10-21T00:12:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- 172.21.15.41:0/499952033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 msgr2=0x7f8a4c0ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 --2- 172.21.15.41:0/499952033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 0x7f8a4c0ab660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8a3c002f70 tx=0x7f8a3c006df0).stop 2021-10-21T00:12:17.695 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- 172.21.15.41:0/499952033 shutdown_connections 2021-10-21T00:12:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 --2- 172.21.15.41:0/499952033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0af620 0x7f8a4c0ab660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 --2- 172.21.15.41:0/499952033 >> v2:172.21.15.62:3300/0 conn(0x7f8a4c0b2170 0x7f8a4c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- 172.21.15.41:0/499952033 >> 172.21.15.41:0/499952033 conn(0x7f8a4c0b5700 msgr2=0x7f8a4c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- 172.21.15.41:0/499952033 shutdown_connections 2021-10-21T00:12:17.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- 172.21.15.41:0/499952033 wait complete. 2021-10-21T00:12:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 Processor -- start 2021-10-21T00:12:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.681+0000 7f8a50c76700 1 -- start start 2021-10-21T00:12:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a4c0af620 0x7f8a4c0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 0x7f8a4c066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c146ab0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0af090 con 0x7f8a4c0af620 2021-10-21T00:12:17.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c065270 con 0x7f8a4c0b2170 2021-10-21T00:12:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38400/0 (socket says 172.21.15.41:38400) 2021-10-21T00:12:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 -- 172.21.15.41:0/3147816411 learned_addr learned my addr 172.21.15.41:0/3147816411 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4affd700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a4c0af620 0x7f8a4c0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4bfff700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 0x7f8a4c066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 -- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 msgr2=0x7f8a4c066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 0x7f8a4c066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 -- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a4c0af620 msgr2=0x7f8a4c0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a4c0af620 0x7f8a4c0acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 -- 172.21.15.41:0/3147816411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c00b180 con 0x7f8a4c0abb50 2021-10-21T00:12:17.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4bfff700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 0x7f8a4c066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:17.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a4b7fe700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f8a4000c000 tx=0x7f8a40006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a40010780 con 0x7f8a4c0abb50 2021-10-21T00:12:17.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a400108e0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c0ac1a0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a40010c40 con 0x7f8a4c0abb50 2021-10-21T00:12:17.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c0ad8d0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c065430 con 0x7f8a4c0abb50 2021-10-21T00:12:17.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.685+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a4001c460 con 0x7f8a4c0abb50 2021-10-21T00:12:17.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.689+0000 7f8a48ff9700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 0x7f8a2c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:17.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.689+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8a4006bd90 con 0x7f8a4c0abb50 2021-10-21T00:12:17.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.689+0000 7f8a4affd700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 0x7f8a2c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:17.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.689+0000 7f8a4affd700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 0x7f8a2c055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f8a3c018000 tx=0x7f8a3c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:17.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.693+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a40042e90 con 0x7f8a4c0abb50 2021-10-21T00:12:17.863 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.853+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a4c0650a0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.864 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.853+0000 7f8a48ff9700 1 -- 172.21.15.41:0/3147816411 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f8a400464b0 con 0x7f8a4c0abb50 2021-10-21T00:12:17.865 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:17.866 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:10.459587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8481":{"gid":8481,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2228513289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2228513289},{"type":"v1","addr":"172.21.15.62:6835","nonce":2228513289}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:17.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 msgr2=0x7f8a2c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 0x7f8a2c055ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f8a3c018000 tx=0x7f8a3c014000).stop 2021-10-21T00:12:17.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 msgr2=0x7f8a4c064bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:17.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f8a4000c000 tx=0x7f8a40006df0).stop 2021-10-21T00:12:17.870 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 shutdown_connections 2021-10-21T00:12:17.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8a2c053610 0x7f8a2c055ad0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a4c0b2170 0x7f8a4c066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a4c0af620 0x7f8a4c0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 --2- 172.21.15.41:0/3147816411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8a4c0abb50 0x7f8a4c064bb0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:17.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 >> 172.21.15.41:0/3147816411 conn(0x7f8a4c0b5700 msgr2=0x7f8a4c149020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:17.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 shutdown_connections 2021-10-21T00:12:17.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:17.857+0000 7f8a50c76700 1 -- 172.21.15.41:0/3147816411 wait complete. 2021-10-21T00:12:17.874 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 72 2021-10-21T00:12:18.078 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:09.433938+0000', 'modified': '2021-10-21T00:12:10.459587+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8481': {'gid': 8481, 'name': 'b', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/2228513289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 2228513289}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2228513289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:18.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:18.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-10-21T00:12:18.197 INFO:teuthology.orchestra.run.smithi062.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8481,"want_state":"up:active","state":"up:active","rank_uptime":8.7456271230000002,"mdsmap_epoch":72,"osdmap_epoch":136,"osdmap_epoch_barrier":136,"uptime":13.112731752} 2021-10-21T00:12:18.198 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8481, "mdsmap_epoch": 72, "osdmap_epoch": 136, "osdmap_epoch_barrier": 136, "rank_uptime": 8.745627123, "state": "up:active", "uptime": 13.112731752, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:18.199 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:12:18.199 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:12:18.200 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:12:18.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:18.201 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:18.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:18.270 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:18.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:18.286 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:18.286 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:18.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:18.288 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:18.295 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:12:18.295 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:18.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:18.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:18.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:18.368 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:18.369 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:18.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:18.371 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:18.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:12:18.405+0000 7f92bcb2e080 -1 init, newargv = 0x55b540545650 newargc=9ceph-fuse[14579]: starting ceph client 2021-10-21T00:12:18.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr: 2021-10-21T00:12:18.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14579]: starting fuse 2021-10-21T00:12:19.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:19.541 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:19.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:19.596 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:19.598 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:19.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.599 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:12:19.606 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:12:19.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:12:19.608 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:12:19.608 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:12:19.609 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:12:19.609 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:12:19.610 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:19.610 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:12:19.611 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:12:19.611 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:12:19.611 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:19.612 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:12:19.612 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:12:19.613 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:12:19.613 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:12:19.614 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:19.614 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:12:19.615 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:12:19.615 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:12:19.615 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:12:19.616 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:12:19.616 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:19.617 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:12:19.617 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:12:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14579.asok 2021-10-21T00:12:19.665 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14579.asok 2021-10-21T00:12:19.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14579.asok status 2021-10-21T00:12:19.804 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:12:19.804 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:12:19.805 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:12:19.805 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:12:19.805 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:12:19.805 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:12:19.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:12:19.806 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14579", 2021-10-21T00:12:19.806 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:12:19.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:19.807 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:12:19.807 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:12:19.807 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 8470, 2021-10-21T00:12:19.807 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:12:19.807 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:12:19.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:12:19.808 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 8470 2021-10-21T00:12:19.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:19.808 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:12:19.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:12:19.809 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:12:19.809 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3133636014 2021-10-21T00:12:19.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:12:19.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:19.810 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:12:19.810 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:12:19.810 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:12:19.811 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3133636014 2021-10-21T00:12:19.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:19.811 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.8470 172.21.15.99:0/3133636014", 2021-10-21T00:12:19.811 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/3133636014", 2021-10-21T00:12:19.811 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:12:19.812 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 72, 2021-10-21T00:12:19.812 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 136, 2021-10-21T00:12:19.812 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:12:19.812 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:12:19.813 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:12:19.813 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:12:19.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.814 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:19.815 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:19.823 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:12:19.824 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:19.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.826 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:19.847 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-21T00:12:19.848 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-10-21T00:12:19.885 INFO:teuthology.orchestra.run.smithi071.stdout:1634775139.840804921 2021-10-21T00:12:19.885 INFO:tasks.cephfs.test_misc:rctime = 1634775139.840804921 2021-10-21T00:12:19.886 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:12:19.886 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:19.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:19.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:19.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:19.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:19.998 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:12:19.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:19.999 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:19.999 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:20.008 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:12:20.009 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:12:20.009 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2021-10-21T00:12:20.010 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:12:20.010 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:20.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15136]: fuse finished with error 0 and tester_r 0 2021-10-21T00:12:20.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:20.027 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:20.028 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:20.034 INFO:teuthology.orchestra.run.smithi071.stdout:ext2/ext3 2021-10-21T00:12:20.035 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:12:20.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:12:20.154 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:20.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:20.202 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:20.203 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:20.211 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:12:20.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:20.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:12:20.215 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:12:20.215 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:20.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14579]: fuse finished with error 0 and tester_r 0 2021-10-21T00:12:20.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:20.276 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:20.276 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:20.283 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:12:20.288 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:12:20.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:12:20.406 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:20.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:20.457 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:20.458 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:12:20.465 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:12:20.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:20.466 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:12:20.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:12:20.468 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:12:20.475 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:12:20.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:20.476 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:12:20.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 Processor -- start 2021-10-21T00:12:20.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- start start 2021-10-21T00:12:20.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 0x7fe1d414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 0x7fe1d40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40609d0 con 0x7fe1d405f9f0 2021-10-21T00:12:20.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d40b1620 con 0x7fe1d414b350 2021-10-21T00:12:20.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d405fdd0 con 0x7fe1d40aa750 2021-10-21T00:12:20.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1da874700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 0x7fe1d40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 0x7fe1d414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1da073700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe1d405f9f0 0x7fe1d414a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44234/0 (socket says 172.21.15.41:44234) 2021-10-21T00:12:20.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1da073700 1 -- 172.21.15.41:0/2557628130 learned_addr learned my addr 172.21.15.41:0/2557628130 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:20.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 -- 172.21.15.41:0/2557628130 >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 msgr2=0x7fe1d40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:20.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 --2- 172.21.15.41:0/2557628130 >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 0x7fe1d40af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 -- 172.21.15.41:0/2557628130 >> v1:172.21.15.62:6789/0 conn(0x7fe1d405f9f0 legacy=0x7fe1d414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 -- 172.21.15.41:0/2557628130 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40b1380 con 0x7fe1d40aa750 2021-10-21T00:12:20.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1da874700 1 --2- 172.21.15.41:0/2557628130 >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 0x7fe1d40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:20.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9872700 1 --2- 172.21.15.41:0/2557628130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 0x7fe1d414ae60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe1c4001490 tx=0x7fe1c8006df0).ready entity=mon.2 client_cookie=79d3b0ed8abc725c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:20.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9071700 1 -- 172.21.15.41:0/2557628130 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c800d4a0 con 0x7fe1d40aa750 2021-10-21T00:12:20.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9071700 1 -- 172.21.15.41:0/2557628130 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8000e90 con 0x7fe1d40aa750 2021-10-21T00:12:20.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1d9071700 1 -- 172.21.15.41:0/2557628130 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c800d7f0 con 0x7fe1d40aa750 2021-10-21T00:12:20.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/2557628130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 msgr2=0x7fe1d414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.596 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/2557628130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 0x7fe1d414ae60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe1c4001490 tx=0x7fe1c8006df0).stop 2021-10-21T00:12:20.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/2557628130 shutdown_connections 2021-10-21T00:12:20.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/2557628130 >> v2:172.21.15.62:3300/0 conn(0x7fe1d414b350 0x7fe1d40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/2557628130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d40aa750 0x7fe1d414ae60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.597 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/2557628130 >> 172.21.15.41:0/2557628130 conn(0x7fe1d405bca0 msgr2=0x7fe1d405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:20.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/2557628130 shutdown_connections 2021-10-21T00:12:20.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.580+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/2557628130 wait complete. 2021-10-21T00:12:20.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 Processor -- start 2021-10-21T00:12:20.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- start start 2021-10-21T00:12:20.598 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d405f9f0 0x7fe1d40ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d414b350 0x7fe1d415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d414db10 con 0x7fe1d40aa750 2021-10-21T00:12:20.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d414d5d0 con 0x7fe1d405f9f0 2021-10-21T00:12:20.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d414d870 con 0x7fe1d414b350 2021-10-21T00:12:20.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1da073700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d405f9f0 0x7fe1d40ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38416/0 (socket says 172.21.15.41:38416) 2021-10-21T00:12:20.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 -- 172.21.15.41:0/4202441605 learned_addr learned my addr 172.21.15.41:0/4202441605 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:20.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1da874700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d414b350 0x7fe1d415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 -- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d414b350 msgr2=0x7fe1d415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d414b350 0x7fe1d415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 -- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d405f9f0 msgr2=0x7fe1d40ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d405f9f0 0x7fe1d40ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 -- 172.21.15.41:0/4202441605 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc00b180 con 0x7fe1d40aa750 2021-10-21T00:12:20.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d9872700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fe1c4001490 tx=0x7fe1c8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:20.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c8012930 con 0x7fe1d40aa750 2021-10-21T00:12:20.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8012a90 con 0x7fe1d40aa750 2021-10-21T00:12:20.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c8012df0 con 0x7fe1d40aa750 2021-10-21T00:12:20.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c800b180 con 0x7fe1d40aa750 2021-10-21T00:12:20.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.584+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40630a0 con 0x7fe1d40aa750 2021-10-21T00:12:20.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d40678f0 con 0x7fe1d40aa750 2021-10-21T00:12:20.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe1c801c070 con 0x7fe1d40aa750 2021-10-21T00:12:20.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1d37fe700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 0x7fe1b4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:20.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe1c806c470 con 0x7fe1d40aa750 2021-10-21T00:12:20.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1da073700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 0x7fe1b4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:20.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.588+0000 7fe1da073700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 0x7fe1b4055b60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fe1c400d000 tx=0x7fe1c4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:20.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.592+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1c8043680 con 0x7fe1d40aa750 2021-10-21T00:12:20.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.720+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe1d4057350 con 0x7fe1d40aa750 2021-10-21T00:12:20.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1d37fe700 1 -- 172.21.15.41:0/4202441605 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+33659 (secure 0 0 0) 0x7fe1c8019020 con 0x7fe1d40aa750 2021-10-21T00:12:20.734 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:20.734 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:20.734 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 136, 2021-10-21T00:12:20.734 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:12:20.735 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:12:20.735 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:12:10.449809+0000", 2021-10-21T00:12:20.735 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:20.735 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:20.736 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:12:20.736 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:12:20.737 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:12:20.737 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:12:20.737 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:12:20.737 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:12:20.738 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:12:20.738 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:20.738 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:12:20.738 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:12:20.739 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:12:20.739 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:12:20.739 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:12:20.740 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 28, 2021-10-21T00:12:20.740 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:12:20.740 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:12:20.740 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:12:20.741 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:12:20.741 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:12:20.741 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.742 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:12:20.743 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:12:20.743 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:12:20.743 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:20.744 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:20.744 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:20.744 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:20.745 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:20.745 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:20.746 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:20.746 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:20.746 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:12:20.746 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:12:20.747 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:12:20.747 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:12:20.747 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:12:20.747 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:20.747 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:20.748 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:20.748 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:20.748 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:20.749 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:20.749 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:20.749 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.749 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:12:20.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:20.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:20.750 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:20.750 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:20.750 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:20.751 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:20.751 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:20.751 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:20.751 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:20.752 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:20.752 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:20.752 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:20.752 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:20.753 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:20.753 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:20.753 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:20.753 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:20.754 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:20.754 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:20.754 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:20.754 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:20.754 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:20.755 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:20.755 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:20.755 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:20.755 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:20.755 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.756 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:20.756 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:20.756 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:20.756 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:20.757 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:20.757 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:20.757 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:20.757 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:20.757 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:20.758 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:20.758 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:20.758 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:20.758 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:12:20.758 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.759 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:20.759 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:12:20.759 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.759 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.760 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.760 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:12:20.760 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:12:20.760 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:12:20.760 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:20.761 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:20.761 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:20.761 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:20.761 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:20.761 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:20.762 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:20.762 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:20.762 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:20.762 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:20.762 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:20.763 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:20.763 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:20.763 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:20.763 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:20.763 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:20.764 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:20.764 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:20.764 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:20.764 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:20.765 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.765 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:12:20.765 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:20.765 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:20.765 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:20.766 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:20.766 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:20.766 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:20.766 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:20.766 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:20.767 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:20.767 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:20.767 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:20.767 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:20.767 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:20.768 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:20.768 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:20.768 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:20.768 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:20.769 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:20.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:20.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:20.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:20.769 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:20.770 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:20.770 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:20.770 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:20.770 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:20.770 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.771 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:20.771 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:20.771 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:20.771 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:20.772 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:20.772 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:20.772 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:20.772 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:20.772 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:20.773 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:20.773 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:20.773 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:20.773 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:20.773 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:12:20.774 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.774 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.774 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.774 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 27, 2021-10-21T00:12:20.775 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:12:20.775 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:12:07.923124+0000", 2021-10-21T00:12:20.775 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:20.775 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:20.775 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:20.776 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:20.776 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:20.776 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:20.776 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:20.776 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:20.777 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:20.778 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:20.778 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:20.778 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:20.778 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:20.779 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:20.779 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:20.779 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:20.779 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.779 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "135", 2021-10-21T00:12:20.780 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:20.780 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:20.780 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:20.780 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:20.780 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:20.781 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:20.781 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:20.781 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:20.781 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:20.781 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:20.782 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:20.782 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:20.782 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:20.783 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:20.783 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:20.783 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:20.783 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:20.783 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:20.784 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:20.784 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:20.784 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:20.784 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:20.784 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:20.785 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:20.785 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:20.785 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:20.785 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.786 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:20.786 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:20.786 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:20.786 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:20.786 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:20.787 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:20.787 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:20.787 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:20.787 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:20.787 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:20.788 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:20.788 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:20.788 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:12:20.789 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:12:20.789 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:12:20.789 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.789 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:20.789 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:12:20.790 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:12:20.790 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.790 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.790 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.790 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.791 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 28, 2021-10-21T00:12:20.791 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:12:20.791 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:12:08.769999+0000", 2021-10-21T00:12:20.791 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:20.792 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:20.792 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:20.792 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:20.792 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:20.793 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:20.793 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:20.793 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:20.793 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:20.793 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:20.794 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:20.794 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:20.794 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:20.794 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:20.795 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:20.795 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:20.795 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:20.795 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:20.796 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:20.796 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:20.796 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.796 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "136", 2021-10-21T00:12:20.797 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:20.797 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:20.797 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:20.797 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:20.797 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:20.798 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:20.798 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:20.798 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:20.798 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:20.799 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:20.799 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:20.799 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:20.799 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:20.799 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:20.800 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:20.800 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:20.800 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:20.800 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:20.801 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:20.801 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:20.801 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:20.801 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:20.801 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:20.802 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:20.802 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:20.802 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:20.802 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.803 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:20.803 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:20.803 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:20.803 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:20.804 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:20.804 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:20.804 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:20.804 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:20.804 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:20.805 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:20.805 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:20.805 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:20.805 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:20.806 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:12:20.806 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:12:20.806 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.806 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.806 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.807 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:20.807 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:12:20.807 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.807 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:20.807 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:12:20.808 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.808 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.808 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.808 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.809 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.809 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.809 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.809 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:20.809 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.810 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.810 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.810 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.810 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.810 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.811 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:12:20.811 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.811 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.811 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.811 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.812 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:12:20.812 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.812 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.812 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.812 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.813 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.813 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.813 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.813 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.813 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:12:20.814 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.814 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.814 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.814 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.815 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:12:20.815 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.815 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.815 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.815 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.816 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.816 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.816 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.816 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.816 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:12:20.817 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.817 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.817 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.817 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.818 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:12:20.818 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.818 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.818 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.818 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.819 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.819 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.819 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.819 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.819 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:12:20.820 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.820 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.820 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.820 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.820 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:12:20.821 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:20.821 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.821 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.821 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.821 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:12:20.822 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:12:20.822 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:12:20.822 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:12:20.822 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.823 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.823 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.823 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.823 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.823 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.824 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:20.824 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:12:20.824 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.824 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.824 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.825 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.825 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.825 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.825 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.825 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:20.826 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.826 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.826 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.826 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.827 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.827 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.827 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:12:20.827 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.828 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.828 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.828 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.828 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:12:20.828 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.829 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.829 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.829 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.829 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.829 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.830 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.830 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.830 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:12:20.830 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.831 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.831 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.831 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.831 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:12:20.831 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.832 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.832 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.832 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.832 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.833 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.833 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.833 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.833 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:12:20.833 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.834 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.834 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.834 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.834 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:12:20.834 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.835 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.835 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.835 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.835 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.836 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.836 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.836 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.836 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:12:20.836 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.837 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.837 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.837 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.837 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:12:20.837 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:20.838 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.838 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.838 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.838 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:12:20.838 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:12:20.839 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:12:20.839 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:12:20.839 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.839 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.839 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.840 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.840 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.840 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.840 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:20.840 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:12:20.841 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.841 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.841 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.841 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.842 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.842 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.842 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.842 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 133, 2021-10-21T00:12:20.843 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.843 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.843 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.843 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.843 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.844 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.844 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:12:20.844 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.844 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.844 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.845 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.845 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:12:20.845 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.845 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.846 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.846 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.846 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.846 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.846 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.847 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.847 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:12:20.847 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.847 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.847 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.848 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.848 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:12:20.848 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.848 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.848 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.849 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.849 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.849 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.849 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.849 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.850 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:12:20.850 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.850 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.850 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.851 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.851 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:12:20.851 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.851 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.851 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.852 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.852 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.852 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.852 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.852 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.853 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:12:20.853 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.853 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.853 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.853 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.854 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:12:20.854 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:20.854 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.854 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.855 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.855 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:12:20.855 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:12:20.855 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:12:20.855 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:12:20.856 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.856 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.856 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.856 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.856 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.857 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.857 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:20.857 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:12:20.857 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.857 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.858 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.858 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.858 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.858 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.859 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.859 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:12:20.859 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.859 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.859 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.860 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.860 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.860 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.860 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:12:20.860 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.861 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.861 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.861 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.861 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:12:20.861 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.862 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.862 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.862 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.862 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.863 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.863 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.863 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.863 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:12:20.863 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.864 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.864 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.864 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.864 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:12:20.864 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.865 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.865 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.865 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.865 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.865 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.866 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.866 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.866 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:12:20.866 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.867 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.867 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.867 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.867 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:12:20.867 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.868 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.868 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.868 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.868 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.868 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.869 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.869 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.869 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:12:20.869 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.869 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.870 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.870 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.870 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:12:20.870 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:20.871 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.871 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.871 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.871 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:12:20.871 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:12:20.872 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:12:20.872 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:12:20.872 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.872 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.872 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.873 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.873 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.873 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.873 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:20.873 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:12:20.874 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.874 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.874 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.874 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.875 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.875 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.875 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.875 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 133, 2021-10-21T00:12:20.875 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.876 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.876 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.876 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.876 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.876 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.877 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:12:20.877 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.877 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.877 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.877 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.878 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:12:20.878 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.878 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.878 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.879 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.879 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.879 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.879 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.879 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.880 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:12:20.880 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.880 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.880 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.880 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.881 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:12:20.881 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.881 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.881 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.881 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.882 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.882 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.882 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.883 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.883 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:12:20.883 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.883 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.883 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.884 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.884 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:12:20.884 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.884 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.885 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.885 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.885 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.885 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.885 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.886 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.886 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:12:20.886 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.886 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.886 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.887 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.887 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:12:20.887 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:20.887 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.887 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.888 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.888 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:12:20.888 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:12:20.888 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:12:20.888 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:12:20.889 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.889 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.889 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.889 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.889 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.890 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.890 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:20.890 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:12:20.890 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.891 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.891 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.891 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.891 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.891 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.892 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.892 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:20.892 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.892 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.893 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.893 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.893 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.893 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.893 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:12:20.894 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.894 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.894 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.894 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.894 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:12:20.895 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.895 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.895 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.895 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.895 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.896 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.896 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.896 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.896 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:12:20.897 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.897 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.897 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.897 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.897 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:12:20.898 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.898 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.898 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.898 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.898 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.899 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.899 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.899 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.899 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:12:20.899 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.900 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.900 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.900 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.900 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:12:20.901 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.901 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.901 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.901 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.901 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.902 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.902 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.902 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.902 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:12:20.902 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.903 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.903 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.903 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.903 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:12:20.904 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:20.904 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.904 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.904 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.904 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:12:20.905 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:12:20.905 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:12:20.905 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:12:20.905 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.905 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.906 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.906 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.906 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.906 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.906 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:20.907 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:12:20.907 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.907 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.907 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.908 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.908 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.908 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.908 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.908 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:20.909 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.909 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.909 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.909 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.909 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.910 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.910 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:12:20.910 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.910 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.911 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.911 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.911 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:12:20.911 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.911 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.912 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.912 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.912 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.912 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.912 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.913 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.913 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:12:20.913 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.913 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.913 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.914 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.914 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:12:20.914 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.914 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.914 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.915 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.915 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.915 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.915 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.915 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.916 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:12:20.916 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.916 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.916 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.917 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.917 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:12:20.917 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.917 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.917 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.918 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.918 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.918 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.918 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.918 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.919 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:12:20.919 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.919 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.919 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.920 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.920 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:12:20.920 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:20.920 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.920 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.921 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.921 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:12:20.921 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:12:20.921 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:12:20.921 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:12:20.922 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.922 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.922 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.922 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.923 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.923 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.923 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:20.923 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:12:20.923 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:20.924 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:20.924 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:20.924 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:20.924 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:20.924 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:20.925 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:20.925 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:20.925 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:20.925 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:20.925 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:20.926 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.926 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.926 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.926 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:12:20.926 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.927 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.927 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.927 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.927 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:12:20.928 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.928 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.928 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.928 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.928 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:20.929 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.929 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.929 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.929 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:12:20.929 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.930 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.930 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.930 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.930 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:12:20.930 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.931 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.931 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.931 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.931 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:20.932 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.932 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.932 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.932 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:12:20.932 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.933 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.933 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.933 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.933 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:12:20.933 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.934 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.934 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.934 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.934 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:20.935 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:20.935 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.935 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:20.935 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:12:20.935 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.936 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.936 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.936 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:20.936 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:12:20.936 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:20.937 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.937 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.937 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.937 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:12:20.937 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:12:20.938 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:12:20.938 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:12:20.938 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:20.938 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:20.939 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:20.939 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:20.939 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.939 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:20.939 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:12:20.940 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.940 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:20.940 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.940 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.940 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.941 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.941 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.941 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:12:20.941 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.941 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.942 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.942 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:20.942 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.942 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.943 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.943 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.943 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.943 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:12:20.943 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.944 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.944 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.944 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:20.944 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.944 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.945 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.945 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.945 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.945 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:12:20.945 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.946 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.946 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.946 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:20.946 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.946 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.947 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.947 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.947 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.947 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:12:20.948 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.948 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.948 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.948 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:20.948 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.949 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.949 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.949 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.949 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.949 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:12:20.950 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.950 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.950 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.950 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:20.950 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.951 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.951 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.951 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.951 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.951 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:12:20.952 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.952 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.952 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.952 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:20.953 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.953 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.953 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.953 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.953 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.954 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:12:20.954 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.954 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.954 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:20.954 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:20.955 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:20.955 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:20.955 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:20.955 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:20.955 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:20.956 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:12:20.956 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:20.956 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.956 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:20.956 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:12:20.957 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:12:20.957 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:12:20.957 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:12:20.957 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:12:20.957 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:12:20.958 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:12:20.958 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:12:20.958 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:12:20.958 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:12:20.959 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:12:20.959 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:12:20.959 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:12:20.959 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:20.959 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:20.960 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:12:20.960 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:12:20.960 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:12:20.960 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:12:20.960 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:12:20.961 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:20.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 msgr2=0x7fe1b4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 0x7fe1b4055b60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fe1c400d000 tx=0x7fe1c4009040).stop 2021-10-21T00:12:20.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 msgr2=0x7fe1d415a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:20.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fe1c4001490 tx=0x7fe1c8014000).stop 2021-10-21T00:12:20.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 shutdown_connections 2021-10-21T00:12:20.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1b40536a0 0x7fe1b4055b60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1d414b350 0x7fe1d415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.964 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1d40aa750 0x7fe1d415a020 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 --2- 172.21.15.41:0/4202441605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d405f9f0 0x7fe1d40ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:20.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 >> 172.21.15.41:0/4202441605 conn(0x7fe1d405bca0 msgr2=0x7fe1d40b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:20.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 shutdown_connections 2021-10-21T00:12:20.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:20.724+0000 7fe1dc2d7700 1 -- 172.21.15.41:0/4202441605 wait complete. 2021-10-21T00:12:20.966 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:21.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 Processor -- start 2021-10-21T00:12:21.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 -- start start 2021-10-21T00:12:21.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f866005bfe0 0x7f866014a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866005c3c0 con 0x7f866005f780 2021-10-21T00:12:21.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600b0c40 con 0x7f866014a3b0 2021-10-21T00:12:21.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f866651d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8660141370 con 0x7f866005bfe0 2021-10-21T00:12:21.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f8664aba700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f866005f780 0x7f8660064ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36196/0 (socket says 172.21.15.41:36196) 2021-10-21T00:12:21.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f8664aba700 1 -- 172.21.15.41:0/3418579409 learned_addr learned my addr 172.21.15.41:0/3418579409 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:21.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865ffff700 1 --2- 172.21.15.41:0/3418579409 >> v2:172.21.15.62:3300/0 conn(0x7f866005bfe0 0x7f866014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189813383 0 0) 0x7f86600b0c40 con 0x7f866014a3b0 2021-10-21T00:12:21.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8644003260 con 0x7f866014a3b0 2021-10-21T00:12:21.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676064602 0 0) 0x7f866005c3c0 con 0x7f866005f780 2021-10-21T00:12:21.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86600b0c40 con 0x7f866005f780 2021-10-21T00:12:21.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865ffff700 1 -- 172.21.15.41:0/3418579409 >> v1:172.21.15.62:6789/0 conn(0x7f866014a3b0 legacy=0x7f866014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865ffff700 1 -- 172.21.15.41:0/3418579409 >> v1:172.21.15.41:6789/0 conn(0x7f866005f780 legacy=0x7f8660064ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865ffff700 1 -- 172.21.15.41:0/3418579409 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600b0ee0 con 0x7f866005bfe0 2021-10-21T00:12:21.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865ffff700 1 --2- 172.21.15.41:0/3418579409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f866005bfe0 0x7f866014a870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f86600b3c00 tx=0x7f8648006df0).ready entity=mon.1 client_cookie=4a71a90dae5e195c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864800d610 con 0x7f866005bfe0 2021-10-21T00:12:21.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8648000e90 con 0x7f866005bfe0 2021-10-21T00:12:21.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.068+0000 7f865effd700 1 -- 172.21.15.41:0/3418579409 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864800d960 con 0x7f866005bfe0 2021-10-21T00:12:21.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- 172.21.15.41:0/3418579409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f866005bfe0 msgr2=0x7f866014a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 --2- 172.21.15.41:0/3418579409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f866005bfe0 0x7f866014a870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f86600b3c00 tx=0x7f8648006df0).stop 2021-10-21T00:12:21.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- 172.21.15.41:0/3418579409 shutdown_connections 2021-10-21T00:12:21.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 --2- 172.21.15.41:0/3418579409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f866005bfe0 0x7f866014a870 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- 172.21.15.41:0/3418579409 >> 172.21.15.41:0/3418579409 conn(0x7f86600639f0 msgr2=0x7f8660063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:21.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- 172.21.15.41:0/3418579409 shutdown_connections 2021-10-21T00:12:21.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- 172.21.15.41:0/3418579409 wait complete. 2021-10-21T00:12:21.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 Processor -- start 2021-10-21T00:12:21.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- start start 2021-10-21T00:12:21.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f866005bfe0 0x7f8660065f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86601427f0 0x7f866013fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600af0a0 con 0x7f866005f780 2021-10-21T00:12:21.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600ad100 con 0x7f86601427f0 2021-10-21T00:12:21.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f866651d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600ad3a0 con 0x7f866005bfe0 2021-10-21T00:12:21.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f865f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f865f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38430/0 (socket says 172.21.15.41:38430) 2021-10-21T00:12:21.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f865f7fe700 1 -- 172.21.15.41:0/1545087449 learned_addr learned my addr 172.21.15.41:0/1545087449 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:21.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f8664aba700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86601427f0 0x7f866013fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.072+0000 7f865ffff700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f866005bfe0 0x7f8660065f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 -- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f866005bfe0 msgr2=0x7f8660065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f866005bfe0 0x7f8660065f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 -- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86601427f0 msgr2=0x7f866013fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86601427f0 0x7f866013fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 -- 172.21.15.41:0/1545087449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864800b180 con 0x7f866005f780 2021-10-21T00:12:21.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865f7fe700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f8650001490 tx=0x7f8650007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865000f470 con 0x7f866005f780 2021-10-21T00:12:21.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000f5d0 con 0x7f866005f780 2021-10-21T00:12:21.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8660066b30 con 0x7f866005f780 2021-10-21T00:12:21.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865000f930 con 0x7f866005f780 2021-10-21T00:12:21.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600b0040 con 0x7f866005f780 2021-10-21T00:12:21.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86600b1180 con 0x7f866005f780 2021-10-21T00:12:21.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8650019030 con 0x7f866005f780 2021-10-21T00:12:21.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.076+0000 7f865d7fa700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 0x7f8638055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.080+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f865006b1a0 con 0x7f866005f780 2021-10-21T00:12:21.103 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.080+0000 7f865ffff700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 0x7f8638055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.080+0000 7f865ffff700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 0x7f8638055b00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f864801a000 tx=0x7f8648014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.084+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8650042260 con 0x7f866005f780 2021-10-21T00:12:21.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.244+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8660057350 con 0x7f866005f780 2021-10-21T00:12:21.255 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.244+0000 7f865d7fa700 1 -- 172.21.15.41:0/1545087449 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f8650045880 con 0x7f866005f780 2021-10-21T00:12:21.256 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:21.256 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:10.459587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8481":{"gid":8481,"name":"b","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2228513289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2228513289},{"type":"v1","addr":"172.21.15.62:6835","nonce":2228513289}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:21.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 msgr2=0x7f8638055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 0x7f8638055b00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f864801a000 tx=0x7f8648014000).stop 2021-10-21T00:12:21.258 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 msgr2=0x7f866013f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f8650001490 tx=0x7f8650007e80).stop 2021-10-21T00:12:21.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 shutdown_connections 2021-10-21T00:12:21.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8638053640 0x7f8638055b00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.259 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86601427f0 0x7f866013fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f866005f780 0x7f866013f580 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 --2- 172.21.15.41:0/1545087449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f866005bfe0 0x7f8660065f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 >> 172.21.15.41:0/1545087449 conn(0x7f86600639f0 msgr2=0x7f86601408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:21.260 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 shutdown_connections 2021-10-21T00:12:21.261 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.248+0000 7f866651d700 1 -- 172.21.15.41:0/1545087449 wait complete. 2021-10-21T00:12:21.261 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 72 2021-10-21T00:12:21.269 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:12:21.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 Processor -- start 2021-10-21T00:12:21.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 -- start start 2021-10-21T00:12:21.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 0x7f38ac0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.378 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 0x7f38ac0672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0b6350 con 0x7f38ac0677e0 2021-10-21T00:12:21.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac06a500 con 0x7f38ac1423a0 2021-10-21T00:12:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b267d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0b0e10 con 0x7f38ac0b5f70 2021-10-21T00:12:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b1e7c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f38ac0677e0 0x7f38ac069df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36210/0 (socket says 172.21.15.41:36210) 2021-10-21T00:12:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b1e7c700 1 -- 172.21.15.41:0/3463931539 learned_addr learned my addr 172.21.15.41:0/3463931539 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b0e7a700 1 --2- 172.21.15.41:0/3463931539 >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 0x7f38ac0672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b167b700 1 --2- 172.21.15.41:0/3463931539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 0x7f38ac0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182182613 0 0) 0x7f38ac0b6350 con 0x7f38ac0677e0 2021-10-21T00:12:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3898003260 con 0x7f38ac0677e0 2021-10-21T00:12:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b167b700 1 -- 172.21.15.41:0/3463931539 >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 msgr2=0x7f38ac0672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.364+0000 7f38b167b700 1 --2- 172.21.15.41:0/3463931539 >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 0x7f38ac0672f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b167b700 1 -- 172.21.15.41:0/3463931539 >> v1:172.21.15.41:6789/0 conn(0x7f38ac0677e0 legacy=0x7f38ac069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3571768888 0 0) 0x7f3898003260 con 0x7f38ac0677e0 2021-10-21T00:12:21.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b167b700 1 -- 172.21.15.41:0/3463931539 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0b10b0 con 0x7f38ac0b5f70 2021-10-21T00:12:21.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b0e7a700 1 --2- 172.21.15.41:0/3463931539 >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 0x7f38ac0672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:21.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b167b700 1 --2- 172.21.15.41:0/3463931539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 0x7f38ac0b1a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f38a4001b80 tx=0x7f389c006df0).ready entity=mon.2 client_cookie=458449eeca1376c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.384 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a40019e0 con 0x7f38ac0b5f70 2021-10-21T00:12:21.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c000e90 con 0x7f38ac0b5f70 2021-10-21T00:12:21.387 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38a3fff700 1 -- 172.21.15.41:0/3463931539 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389c012460 con 0x7f38ac0b5f70 2021-10-21T00:12:21.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- 172.21.15.41:0/3463931539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 msgr2=0x7f38ac0b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- 172.21.15.41:0/3463931539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 0x7f38ac0b1a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f38a4001b80 tx=0x7f389c006df0).stop 2021-10-21T00:12:21.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- 172.21.15.41:0/3463931539 shutdown_connections 2021-10-21T00:12:21.388 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- 172.21.15.41:0/3463931539 >> v2:172.21.15.62:3300/0 conn(0x7f38ac1423a0 0x7f38ac0672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- 172.21.15.41:0/3463931539 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0b5f70 0x7f38ac0b1a90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.389 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- 172.21.15.41:0/3463931539 >> 172.21.15.41:0/3463931539 conn(0x7f38ac0639f0 msgr2=0x7f38ac0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:21.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- 172.21.15.41:0/3463931539 shutdown_connections 2021-10-21T00:12:21.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- 172.21.15.41:0/3463931539 wait complete. 2021-10-21T00:12:21.391 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 Processor -- start 2021-10-21T00:12:21.392 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- start start 2021-10-21T00:12:21.395 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0677e0 0x7f38ac13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 0x7f38ac063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0657f0 con 0x7f38ac1423a0 2021-10-21T00:12:21.397 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac065550 con 0x7f38ac0b5f70 2021-10-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b267d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac10fba0 con 0x7f38ac0677e0 2021-10-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b1e7c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b0e7a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 0x7f38ac063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.398 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b1e7c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38446/0 (socket says 172.21.15.41:38446) 2021-10-21T00:12:21.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b167b700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0677e0 0x7f38ac13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.368+0000 7f38b1e7c700 1 -- 172.21.15.41:0/1117482714 learned_addr learned my addr 172.21.15.41:0/1117482714 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:21.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 -- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0677e0 msgr2=0x7f38ac13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.399 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0677e0 0x7f38ac13d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 -- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 msgr2=0x7f38ac063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:21.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 0x7f38ac063f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:21.400 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 -- 172.21.15.41:0/1117482714 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a800b180 con 0x7f38ac1423a0 2021-10-21T00:12:21.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b0e7a700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 0x7f38ac063f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:21.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b1e7c700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f38a4001bc0 tx=0x7f38a4001ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a4004ab0 con 0x7f38ac1423a0 2021-10-21T00:12:21.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4004c10 con 0x7f38ac1423a0 2021-10-21T00:12:21.401 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a4007170 con 0x7f38ac1423a0 2021-10-21T00:12:21.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c00b180 con 0x7f38ac1423a0 2021-10-21T00:12:21.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac065b80 con 0x7f38ac1423a0 2021-10-21T00:12:21.402 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.372+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac0b1350 con 0x7f38ac1423a0 2021-10-21T00:12:21.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.376+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38a40072d0 con 0x7f38ac1423a0 2021-10-21T00:12:21.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.376+0000 7f38a27fc700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 0x7f388c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:21.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.376+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f38a406b560 con 0x7f38ac1423a0 2021-10-21T00:12:21.403 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.376+0000 7f38b167b700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 0x7f388c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:21.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.376+0000 7f38b167b700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 0x7f388c055a70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f389c01a000 tx=0x7f389c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:21.404 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.380+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38a40426c0 con 0x7f38ac1423a0 2021-10-21T00:12:21.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:21.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f38ac057350 con 0x7f38ac1423a0 2021-10-21T00:12:22.534 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:12:22.524+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:12:22.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.536+0000 7f38a27fc700 1 -- 172.21.15.41:0/1117482714 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f38a4045ce0 con 0x7f38ac1423a0 2021-10-21T00:12:22.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 msgr2=0x7f388c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 0x7f388c055a70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f389c01a000 tx=0x7f389c014000).stop 2021-10-21T00:12:22.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 msgr2=0x7f38ac110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f38a4001bc0 tx=0x7f38a4001ac0).stop 2021-10-21T00:12:22.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 shutdown_connections 2021-10-21T00:12:22.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f388c0535b0 0x7f388c055a70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f38ac1423a0 0x7f38ac110040 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ac0b5f70 0x7f38ac063f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 --2- 172.21.15.41:0/1117482714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38ac0677e0 0x7f38ac13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 >> 172.21.15.41:0/1117482714 conn(0x7f38ac0639f0 msgr2=0x7f38ac13f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:22.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 shutdown_connections 2021-10-21T00:12:22.554 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.540+0000 7f38b267d700 1 -- 172.21.15.41:0/1117482714 wait complete. 2021-10-21T00:12:22.554 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:12:22.567 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:22.575 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:12:22.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 Processor -- start 2021-10-21T00:12:22.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 -- start start 2021-10-21T00:12:22.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9e34062330 0x7f9e340b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e340b3a20 0x7f9e3413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3405bd40 con 0x7f9e34062f70 2021-10-21T00:12:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3405bf70 con 0x7f9e340b3a20 2021-10-21T00:12:22.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39918700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e34142cb0 con 0x7f9e34062330 2021-10-21T00:12:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e340b3a20 0x7f9e3413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f9e34062f70 0x7f9e3405c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36222/0 (socket says 172.21.15.41:36222) 2021-10-21T00:12:22.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f9e340b3a20 0x7f9e3413c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38454/0 (socket says 172.21.15.41:38454) 2021-10-21T00:12:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2bfff700 1 -- 172.21.15.41:0/4248960162 learned_addr learned my addr 172.21.15.41:0/4248960162 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e38916700 1 --2- 172.21.15.41:0/4248960162 >> v2:172.21.15.62:3300/0 conn(0x7f9e34062330 0x7f9e340b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 -- 172.21.15.41:0/4248960162 >> v2:172.21.15.62:3300/0 conn(0x7f9e34062330 msgr2=0x7f9e340b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 --2- 172.21.15.41:0/4248960162 >> v2:172.21.15.62:3300/0 conn(0x7f9e34062330 0x7f9e340b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 -- 172.21.15.41:0/4248960162 >> v1:172.21.15.41:6789/0 conn(0x7f9e34062f70 legacy=0x7f9e3405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 -- 172.21.15.41:0/4248960162 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34142950 con 0x7f9e340b3a20 2021-10-21T00:12:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2b7fe700 1 -- 172.21.15.41:0/4248960162 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094868166 0 0) 0x7f9e3405bd40 con 0x7f9e34062f70 2021-10-21T00:12:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e39117700 1 --2- 172.21.15.41:0/4248960162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e340b3a20 0x7f9e3413c510 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f9e2c0032f0 tx=0x7f9e2c0091d0).ready entity=mon.0 client_cookie=b4512eabaa5c0639 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:22.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2b7fe700 1 -- 172.21.15.41:0/4248960162 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2c00b680 con 0x7f9e340b3a20 2021-10-21T00:12:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2b7fe700 1 -- 172.21.15.41:0/4248960162 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00b7e0 con 0x7f9e340b3a20 2021-10-21T00:12:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.668+0000 7f9e2b7fe700 1 -- 172.21.15.41:0/4248960162 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2c00b950 con 0x7f9e340b3a20 2021-10-21T00:12:22.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- 172.21.15.41:0/4248960162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e340b3a20 msgr2=0x7f9e3413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- 172.21.15.41:0/4248960162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e340b3a20 0x7f9e3413c510 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f9e2c0032f0 tx=0x7f9e2c0091d0).stop 2021-10-21T00:12:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- 172.21.15.41:0/4248960162 shutdown_connections 2021-10-21T00:12:22.689 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- 172.21.15.41:0/4248960162 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e340b3a20 0x7f9e3413c510 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- 172.21.15.41:0/4248960162 >> v2:172.21.15.62:3300/0 conn(0x7f9e34062330 0x7f9e340b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- 172.21.15.41:0/4248960162 >> 172.21.15.41:0/4248960162 conn(0x7f9e340b9080 msgr2=0x7f9e340b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:22.690 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- 172.21.15.41:0/4248960162 shutdown_connections 2021-10-21T00:12:22.691 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- 172.21.15.41:0/4248960162 wait complete. 2021-10-21T00:12:22.692 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 Processor -- start 2021-10-21T00:12:22.693 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- start start 2021-10-21T00:12:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.696 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34062f70 0x7f9e34112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e340b3a20 0x7f9e34112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340aeeb0 con 0x7f9e34062330 2021-10-21T00:12:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340af150 con 0x7f9e34062f70 2021-10-21T00:12:22.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39918700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340af3f0 con 0x7f9e340b3a20 2021-10-21T00:12:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38456/0 (socket says 172.21.15.41:38456) 2021-10-21T00:12:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 -- 172.21.15.41:0/2436549358 learned_addr learned my addr 172.21.15.41:0/2436549358 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:22.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e39117700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e340b3a20 0x7f9e34112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e2bfff700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34062f70 0x7f9e34112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 -- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e340b3a20 msgr2=0x7f9e34112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e340b3a20 0x7f9e34112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 -- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34062f70 msgr2=0x7f9e34112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.701 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34062f70 0x7f9e34112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.672+0000 7f9e38916700 1 -- 172.21.15.41:0/2436549358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009470 con 0x7f9e34062330 2021-10-21T00:12:22.702 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e38916700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f9e3000c000 tx=0x7f9e30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:22.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e30010780 con 0x7f9e34062330 2021-10-21T00:12:22.703 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300108e0 con 0x7f9e34062330 2021-10-21T00:12:22.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3413d850 con 0x7f9e34062330 2021-10-21T00:12:22.704 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e30010c40 con 0x7f9e34062330 2021-10-21T00:12:22.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3413dcc0 con 0x7f9e34062330 2021-10-21T00:12:22.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34057350 con 0x7f9e34062330 2021-10-21T00:12:22.705 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e3001c460 con 0x7f9e34062330 2021-10-21T00:12:22.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.676+0000 7f9e29ffb700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 0x7f9e14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.680+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9e3006be60 con 0x7f9e34062330 2021-10-21T00:12:22.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.680+0000 7f9e2bfff700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 0x7f9e14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.707 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.680+0000 7f9e2bfff700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 0x7f9e14055ad0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f9e2400d000 tx=0x7f9e240011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:22.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.684+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e30042e00 con 0x7f9e34062330 2021-10-21T00:12:22.865 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.856+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e3405d080 con 0x7f9e34062330 2021-10-21T00:12:22.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.856+0000 7f9e29ffb700 1 -- 172.21.15.41:0/2436549358 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+1782 (secure 0 0 0) 0x7f9e30046420 con 0x7f9e34062330 2021-10-21T00:12:22.867 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:22.867 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:09.433938+0000","modified":"2021-10-21T00:12:22.529218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-10-21T00:12:22.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 msgr2=0x7f9e14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 0x7f9e14055ad0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f9e2400d000 tx=0x7f9e240011a0).stop 2021-10-21T00:12:22.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 msgr2=0x7f9e341462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:22.869 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f9e3000c000 tx=0x7f9e30006df0).stop 2021-10-21T00:12:22.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 shutdown_connections 2021-10-21T00:12:22.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f9e14053610 0x7f9e14055ad0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e340b3a20 0x7f9e34112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34062f70 0x7f9e34112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 --2- 172.21.15.41:0/2436549358 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9e34062330 0x7f9e341462c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:22.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 >> 172.21.15.41:0/2436549358 conn(0x7f9e340b9080 msgr2=0x7f9e3413fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:22.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 shutdown_connections 2021-10-21T00:12:22.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.860+0000 7f9e39918700 1 -- 172.21.15.41:0/2436549358 wait complete. 2021-10-21T00:12:22.874 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 73 2021-10-21T00:12:22.881 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:12:22.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.976+0000 7fa2f301c700 1 Processor -- start 2021-10-21T00:12:22.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.976+0000 7fa2f301c700 1 -- start start 2021-10-21T00:12:22.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 0x7fa2ec05bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2ec05c190 0x7fa2ec0ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:22.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec143dc0 con 0x7fa2ec142b80 2021-10-21T00:12:22.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec064190 con 0x7fa2ec05c190 2021-10-21T00:12:22.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec064430 con 0x7fa2ec13cb80 2021-10-21T00:12:22.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa2ec05c190 0x7fa2ec0ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f15b9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fa2ec142b80 0x7fa2ec0ad930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36234/0 (socket says 172.21.15.41:36234) 2021-10-21T00:12:22.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f15b9700 1 -- 172.21.15.41:0/3731707139 learned_addr learned my addr 172.21.15.41:0/3731707139 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:22.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f0db8700 1 --2- 172.21.15.41:0/3731707139 >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 0x7fa2ec05bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:22.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2eb7fe700 1 -- 172.21.15.41:0/3731707139 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891871655 0 0) 0x7fa2ec143dc0 con 0x7fa2ec142b80 2021-10-21T00:12:22.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2eb7fe700 1 -- 172.21.15.41:0/3731707139 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d8003260 con 0x7fa2ec142b80 2021-10-21T00:12:22.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 -- 172.21.15.41:0/3731707139 >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 msgr2=0x7fa2ec05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:22.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/3731707139 >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 0x7fa2ec05bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 -- 172.21.15.41:0/3731707139 >> v1:172.21.15.41:6789/0 conn(0x7fa2ec142b80 legacy=0x7fa2ec0ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 -- 172.21.15.41:0/3731707139 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec05f6b0 con 0x7fa2ec05c190 2021-10-21T00:12:23.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f0db8700 1 --2- 172.21.15.41:0/3731707139 >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 0x7fa2ec05bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:23.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/3731707139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec0ad440 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc006df0).ready entity=mon.0 client_cookie=7e62126e37c9a953 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2eb7fe700 1 -- 172.21.15.41:0/3731707139 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00d4f0 con 0x7fa2ec05c190 2021-10-21T00:12:23.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2eb7fe700 1 -- 172.21.15.41:0/3731707139 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc000e90 con 0x7fa2ec05c190 2021-10-21T00:12:23.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2eb7fe700 1 -- 172.21.15.41:0/3731707139 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc00d840 con 0x7fa2ec05c190 2021-10-21T00:12:23.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- 172.21.15.41:0/3731707139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 msgr2=0x7fa2ec0ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 --2- 172.21.15.41:0/3731707139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec0ad440 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fa2dc002f70 tx=0x7fa2dc006df0).stop 2021-10-21T00:12:23.004 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- 172.21.15.41:0/3731707139 shutdown_connections 2021-10-21T00:12:23.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 --2- 172.21.15.41:0/3731707139 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec0ad440 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 --2- 172.21.15.41:0/3731707139 >> v2:172.21.15.62:3300/0 conn(0x7fa2ec13cb80 0x7fa2ec05bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- 172.21.15.41:0/3731707139 >> 172.21.15.41:0/3731707139 conn(0x7fa2ec061d80 msgr2=0x7fa2ec063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:23.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- 172.21.15.41:0/3731707139 shutdown_connections 2021-10-21T00:12:23.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.980+0000 7fa2f301c700 1 -- 172.21.15.41:0/3731707139 wait complete. 2021-10-21T00:12:23.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 Processor -- start 2021-10-21T00:12:23.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 -- start start 2021-10-21T00:12:23.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 0x7fa2ec065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2ec142b80 0x7fa2ec065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec152820 con 0x7fa2ec05c190 2021-10-21T00:12:23.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec146be0 con 0x7fa2ec142b80 2021-10-21T00:12:23.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f301c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec152a60 con 0x7fa2ec13cb80 2021-10-21T00:12:23.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38472/0 (socket says 172.21.15.41:38472) 2021-10-21T00:12:23.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 -- 172.21.15.41:0/1792686458 learned_addr learned my addr 172.21.15.41:0/1792686458 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:23.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 0x7fa2ec065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f15b9700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2ec142b80 0x7fa2ec065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 -- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 msgr2=0x7fa2ec065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 0x7fa2ec065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 -- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2ec142b80 msgr2=0x7fa2ec065d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2ec142b80 0x7fa2ec065d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 -- 172.21.15.41:0/1792686458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e000b180 con 0x7fa2ec05c190 2021-10-21T00:12:23.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 0x7fa2ec065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:23.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.984+0000 7fa2f0db8700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fa2e000c000 tx=0x7fa2e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e000c5f0 con 0x7fa2ec05c190 2021-10-21T00:12:23.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000c750 con 0x7fa2ec05c190 2021-10-21T00:12:23.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc00b180 con 0x7fa2ec05c190 2021-10-21T00:12:23.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2e000cab0 con 0x7fa2ec05c190 2021-10-21T00:12:23.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec066220 con 0x7fa2ec05c190 2021-10-21T00:12:23.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec152c20 con 0x7fa2ec05c190 2021-10-21T00:12:23.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa2e000cc10 con 0x7fa2ec05c190 2021-10-21T00:12:23.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 0x7fa2cc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.988+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa2e006be40 con 0x7fa2ec05c190 2021-10-21T00:12:23.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.992+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 0x7fa2cc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.992+0000 7fa2ebfff700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 0x7fa2cc055a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fa2dc01a000 tx=0x7fa2dc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:22.996+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2e0042f50 con 0x7fa2ec05c190 2021-10-21T00:12:23.169 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.160+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2ec057350 con 0x7fa2ec05c190 2021-10-21T00:12:23.564 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.552+0000 7fa2e9ffb700 1 -- 172.21.15.41:0/1792686458 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2e0046570 con 0x7fa2ec05c190 2021-10-21T00:12:23.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 msgr2=0x7fa2cc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 0x7fa2cc055a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fa2dc01a000 tx=0x7fa2dc014000).stop 2021-10-21T00:12:23.570 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 msgr2=0x7fa2ec13d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fa2e000c000 tx=0x7fa2e0006df0).stop 2021-10-21T00:12:23.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 shutdown_connections 2021-10-21T00:12:23.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa2cc0535b0 0x7fa2cc055a70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2ec142b80 0x7fa2ec065d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.571 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2ec13cb80 0x7fa2ec065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 --2- 172.21.15.41:0/1792686458 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa2ec05c190 0x7fa2ec13d5d0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.556+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 >> 172.21.15.41:0/1792686458 conn(0x7fa2ec061d80 msgr2=0x7fa2ec140af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:23.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.560+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 shutdown_connections 2021-10-21T00:12:23.572 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.560+0000 7fa2f301c700 1 -- 172.21.15.41:0/1792686458 wait complete. 2021-10-21T00:12:23.585 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:12:23.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 Processor -- start 2021-10-21T00:12:23.706 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 -- start start 2021-10-21T00:12:23.710 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbcf405f9f0 0x7fbcf40af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcf40b0730 0x7fbcf40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf405fdd0 con 0x7fbcf4067a90 2021-10-21T00:12:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf40ae3c0 con 0x7fbcf405f9f0 2021-10-21T00:12:23.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf8f3f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf40ae660 con 0x7fbcf40b0730 2021-10-21T00:12:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbcf405f9f0 0x7fbcf40af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbcf405f9f0 0x7fbcf40af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38478/0 (socket says 172.21.15.41:38478) 2021-10-21T00:12:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf37fe700 1 -- 172.21.15.41:0/2180676899 learned_addr learned my addr 172.21.15.41:0/2180676899 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:23.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.696+0000 7fbcf3fff700 1 --2- 172.21.15.41:0/2180676899 >> v2:172.21.15.62:3300/0 conn(0x7fbcf40b0730 0x7fbcf40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf37fe700 1 -- 172.21.15.41:0/2180676899 >> v2:172.21.15.62:3300/0 conn(0x7fbcf40b0730 msgr2=0x7fbcf40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf37fe700 1 --2- 172.21.15.41:0/2180676899 >> v2:172.21.15.62:3300/0 conn(0x7fbcf40b0730 0x7fbcf40b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf37fe700 1 -- 172.21.15.41:0/2180676899 >> v1:172.21.15.62:6789/0 conn(0x7fbcf4067a90 legacy=0x7fbcf40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf37fe700 1 -- 172.21.15.41:0/2180676899 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40ae900 con 0x7fbcf405f9f0 2021-10-21T00:12:23.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf37fe700 1 --2- 172.21.15.41:0/2180676899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf405f9f0 0x7fbcf40af040 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbcf40ad230 tx=0x7fbce4006eb0).ready entity=mon.0 client_cookie=bdc4145a311bc68 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf27fc700 1 -- 172.21.15.41:0/2180676899 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce400d610 con 0x7fbcf405f9f0 2021-10-21T00:12:23.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf27fc700 1 -- 172.21.15.41:0/2180676899 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4000e90 con 0x7fbcf405f9f0 2021-10-21T00:12:23.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf27fc700 1 -- 172.21.15.41:0/2180676899 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbce400d9a0 con 0x7fbcf405f9f0 2021-10-21T00:12:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/2180676899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf405f9f0 msgr2=0x7fbcf40af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/2180676899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf405f9f0 0x7fbcf40af040 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fbcf40ad230 tx=0x7fbce4006eb0).stop 2021-10-21T00:12:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/2180676899 shutdown_connections 2021-10-21T00:12:23.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/2180676899 >> v2:172.21.15.62:3300/0 conn(0x7fbcf40b0730 0x7fbcf40b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/2180676899 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf405f9f0 0x7fbcf40af040 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/2180676899 >> 172.21.15.41:0/2180676899 conn(0x7fbcf40637b0 msgr2=0x7fbcf4063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/2180676899 shutdown_connections 2021-10-21T00:12:23.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/2180676899 wait complete. 2021-10-21T00:12:23.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 Processor -- start 2021-10-21T00:12:23.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- start start 2021-10-21T00:12:23.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcf405f9f0 0x7fbcf4139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 0x7fbcf40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4141de0 con 0x7fbcf40b0730 2021-10-21T00:12:23.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4142080 con 0x7fbcf4067a90 2021-10-21T00:12:23.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.700+0000 7fbcf8f3f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4143310 con 0x7fbcf405f9f0 2021-10-21T00:12:23.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38488/0 (socket says 172.21.15.41:38488) 2021-10-21T00:12:23.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 -- 172.21.15.41:0/3447452071 learned_addr learned my addr 172.21.15.41:0/3447452071 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:23.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf37fe700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcf405f9f0 0x7fbcf4139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf2ffd700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 0x7fbcf40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 -- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcf405f9f0 msgr2=0x7fbcf4139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcf405f9f0 0x7fbcf4139d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 -- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 msgr2=0x7fbcf40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:23.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 0x7fbcf40b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:23.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 -- 172.21.15.41:0/3447452071 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce400b1e0 con 0x7fbcf40b0730 2021-10-21T00:12:23.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf2ffd700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 0x7fbcf40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:23.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf3fff700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbcec00c000 tx=0x7fbcec0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec00ee70 con 0x7fbcf40b0730 2021-10-21T00:12:23.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00c850 con 0x7fbcf40b0730 2021-10-21T00:12:23.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf413d6d0 con 0x7fbcf40b0730 2021-10-21T00:12:23.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec00cbb0 con 0x7fbcf40b0730 2021-10-21T00:12:23.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf4143810 con 0x7fbcf40b0730 2021-10-21T00:12:23.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf40aeba0 con 0x7fbcf40b0730 2021-10-21T00:12:23.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.704+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbcec022070 con 0x7fbcf40b0730 2021-10-21T00:12:23.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.708+0000 7fbcf0ff9700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 0x7fbcd4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:23.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.708+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbcec06c030 con 0x7fbcf40b0730 2021-10-21T00:12:23.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.708+0000 7fbcf37fe700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 0x7fbcd4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:23.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.708+0000 7fbcf37fe700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 0x7fbcd4055ad0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fbce401a000 tx=0x7fbce4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:23.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.712+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbcec043140 con 0x7fbcf40b0730 2021-10-21T00:12:23.852 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:23.844+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcf4057350 con 0x7fbcf40b0730 2021-10-21T00:12:24.576 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.568+0000 7fbcf0ff9700 1 -- 172.21.15.41:0/3447452071 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbcec016020 con 0x7fbcf40b0730 2021-10-21T00:12:24.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 msgr2=0x7fbcd4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.581 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 0x7fbcd4055ad0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fbce401a000 tx=0x7fbce4015000).stop 2021-10-21T00:12:24.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 msgr2=0x7fbcf413b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fbcec00c000 tx=0x7fbcec0091d0).stop 2021-10-21T00:12:24.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 shutdown_connections 2021-10-21T00:12:24.582 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbcd4053610 0x7fbcd4055ad0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbcf40b0730 0x7fbcf413b270 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcf4067a90 0x7fbcf40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 --2- 172.21.15.41:0/3447452071 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcf405f9f0 0x7fbcf4139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.583 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 >> 172.21.15.41:0/3447452071 conn(0x7fbcf40637b0 msgr2=0x7fbcf413de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:24.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 shutdown_connections 2021-10-21T00:12:24.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.572+0000 7fbcf8f3f700 1 -- 172.21.15.41:0/3447452071 wait complete. 2021-10-21T00:12:24.587 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:12:24.596 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:12:24.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 Processor -- start 2021-10-21T00:12:24.711 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 -- start start 2021-10-21T00:12:24.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 0x7f20140b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:24.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20140ba050 con 0x7f20140b0660 2021-10-21T00:12:24.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2014146360 con 0x7f20140b9c70 2021-10-21T00:12:24.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.700+0000 7f2019d30700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2014142bf0 con 0x7f2014143a40 2021-10-21T00:12:24.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2013fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f20140b0660 0x7f20141419c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36266/0 (socket says 172.21.15.41:36266) 2021-10-21T00:12:24.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2013fff700 1 -- 172.21.15.41:0/2164548810 learned_addr learned my addr 172.21.15.41:0/2164548810 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:24.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2012ffd700 1 --2- 172.21.15.41:0/2164548810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 0x7f20140b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:24.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994692492 0 0) 0x7f20140ba050 con 0x7f20140b0660 2021-10-21T00:12:24.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2000003260 con 0x7f20140b0660 2021-10-21T00:12:24.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504340053 0 0) 0x7f2014146360 con 0x7f20140b9c70 2021-10-21T00:12:24.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20140ba050 con 0x7f20140b9c70 2021-10-21T00:12:24.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2012ffd700 1 -- 172.21.15.41:0/2164548810 >> v1:172.21.15.62:6789/0 conn(0x7f20140b9c70 legacy=0x7f2014143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2012ffd700 1 -- 172.21.15.41:0/2164548810 >> v1:172.21.15.41:6789/0 conn(0x7f20140b0660 legacy=0x7f20141419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2012ffd700 1 -- 172.21.15.41:0/2164548810 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014142e90 con 0x7f2014143a40 2021-10-21T00:12:24.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2012ffd700 1 --2- 172.21.15.41:0/2164548810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 0x7f20140b3bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f2004002f70 tx=0x7f2004006df0).ready entity=mon.2 client_cookie=3180bc3aaf890e7c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:24.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200400d5c0 con 0x7f2014143a40 2021-10-21T00:12:24.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2004000e90 con 0x7f2014143a40 2021-10-21T00:12:24.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f20127fc700 1 -- 172.21.15.41:0/2164548810 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200400d910 con 0x7f2014143a40 2021-10-21T00:12:24.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 -- 172.21.15.41:0/2164548810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 msgr2=0x7f20140b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 --2- 172.21.15.41:0/2164548810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 0x7f20140b3bc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f2004002f70 tx=0x7f2004006df0).stop 2021-10-21T00:12:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 -- 172.21.15.41:0/2164548810 shutdown_connections 2021-10-21T00:12:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 --2- 172.21.15.41:0/2164548810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2014143a40 0x7f20140b3bc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 -- 172.21.15.41:0/2164548810 >> 172.21.15.41:0/2164548810 conn(0x7f2014062f00 msgr2=0x7f20140b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 -- 172.21.15.41:0/2164548810 shutdown_connections 2021-10-21T00:12:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.704+0000 7f2019d30700 1 -- 172.21.15.41:0/2164548810 wait complete. 2021-10-21T00:12:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 Processor -- start 2021-10-21T00:12:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 -- start start 2021-10-21T00:12:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 0x7f2014135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 0x7f201413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20141337e0 con 0x7f2014143a40 2021-10-21T00:12:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014135450 con 0x7f20140b0660 2021-10-21T00:12:24.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2019d30700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2014136220 con 0x7f20140b9c70 2021-10-21T00:12:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2013fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2012ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 0x7f201413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f20137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 0x7f2014135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:24.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2012ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 0x7f201413ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:56998/0 (socket says 172.21.15.41:56998) 2021-10-21T00:12:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f2013fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38502/0 (socket says 172.21.15.41:38502) 2021-10-21T00:12:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2012ffd700 1 -- 172.21.15.41:0/1401975958 learned_addr learned my addr 172.21.15.41:0/1401975958 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.708+0000 7f20137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 0x7f2014135990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50416/0 (socket says 172.21.15.41:50416) 2021-10-21T00:12:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 -- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 msgr2=0x7f201413ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 0x7f201413ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 -- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 msgr2=0x7f2014135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 0x7f2014135990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 -- 172.21.15.41:0/1401975958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200400b180 con 0x7f2014143a40 2021-10-21T00:12:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2013fff700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f200c001490 tx=0x7f200c007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200c005ba0 con 0x7f2014143a40 2021-10-21T00:12:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c005d00 con 0x7f2014143a40 2021-10-21T00:12:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2014135e80 con 0x7f2014143a40 2021-10-21T00:12:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f200c0072c0 con 0x7f2014143a40 2021-10-21T00:12:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2014152fa0 con 0x7f2014143a40 2021-10-21T00:12:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014146050 con 0x7f2014143a40 2021-10-21T00:12:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.712+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f200c010070 con 0x7f2014143a40 2021-10-21T00:12:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.716+0000 7f2010ff9700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 0x7f1ff4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.716+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f200c06af30 con 0x7f2014143a40 2021-10-21T00:12:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.716+0000 7f20137fe700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 0x7f1ff4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.716+0000 7f20137fe700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 0x7f1ff4055b90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f200800d000 tx=0x7f2008007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.720+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f200c0421f0 con 0x7f2014143a40 2021-10-21T00:12:24.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:24.848+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2014057350 con 0x7f2014143a40 2021-10-21T00:12:25.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.572+0000 7f2010ff9700 1 -- 172.21.15.41:0/1401975958 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) v1 ==== 173+0+0 (secure 0 0 0) 0x7f200c018030 con 0x7f2014143a40 2021-10-21T00:12:25.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 msgr2=0x7f1ff4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 0x7f1ff4055b90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f200800d000 tx=0x7f2008007a20).stop 2021-10-21T00:12:25.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 msgr2=0x7f2014137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f200c001490 tx=0x7f200c007d60).stop 2021-10-21T00:12:25.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 shutdown_connections 2021-10-21T00:12:25.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f1ff40536d0 0x7f1ff4055b90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f2014143a40 0x7f2014137d20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20140b9c70 0x7f201413ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 --2- 172.21.15.41:0/1401975958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20140b0660 0x7f2014135990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 >> 172.21.15.41:0/1401975958 conn(0x7f2014062f00 msgr2=0x7f20140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:25.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 shutdown_connections 2021-10-21T00:12:25.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.576+0000 7f2019d30700 1 -- 172.21.15.41:0/1401975958 wait complete. 2021-10-21T00:12:25.588 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:12:25.601 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-10-21T00:12:25.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.704+0000 7efc5d61d700 1 Processor -- start 2021-10-21T00:12:25.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.704+0000 7efc5d61d700 1 -- start start 2021-10-21T00:12:25.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc5805c6f0 0x7efc581440f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc58140e80 0x7efc581412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc580aed90 con 0x7efc580ae490 2021-10-21T00:12:25.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580a9f00 con 0x7efc58140e80 2021-10-21T00:12:25.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5805cad0 con 0x7efc5805c6f0 2021-10-21T00:12:25.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc58140e80 0x7efc581412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7efc58140e80 0x7efc581412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38510/0 (socket says 172.21.15.41:38510) 2021-10-21T00:12:25.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 -- 172.21.15.41:0/1539695003 learned_addr learned my addr 172.21.15.41:0/1539695003 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:25.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc56ffd700 1 --2- 172.21.15.41:0/1539695003 >> v2:172.21.15.62:3300/0 conn(0x7efc5805c6f0 0x7efc581440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 -- 172.21.15.41:0/1539695003 >> v2:172.21.15.62:3300/0 conn(0x7efc5805c6f0 msgr2=0x7efc581440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:25.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 --2- 172.21.15.41:0/1539695003 >> v2:172.21.15.62:3300/0 conn(0x7efc5805c6f0 0x7efc581440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 -- 172.21.15.41:0/1539695003 >> v1:172.21.15.62:6789/0 conn(0x7efc580ae490 legacy=0x7efc581445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 -- 172.21.15.41:0/1539695003 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58060bf0 con 0x7efc58140e80 2021-10-21T00:12:25.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc577fe700 1 --2- 172.21.15.41:0/1539695003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc581412c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7efc500032f0 tx=0x7efc50009290).ready entity=mon.0 client_cookie=4466c8245e2299d server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:25.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc55ffb700 1 -- 172.21.15.41:0/1539695003 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5000b870 con 0x7efc58140e80 2021-10-21T00:12:25.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc55ffb700 1 -- 172.21.15.41:0/1539695003 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5000b9d0 con 0x7efc58140e80 2021-10-21T00:12:25.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc55ffb700 1 -- 172.21.15.41:0/1539695003 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5000bb40 con 0x7efc58140e80 2021-10-21T00:12:25.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- 172.21.15.41:0/1539695003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 msgr2=0x7efc581412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1539695003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc581412c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7efc500032f0 tx=0x7efc50009290).stop 2021-10-21T00:12:25.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- 172.21.15.41:0/1539695003 shutdown_connections 2021-10-21T00:12:25.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1539695003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc581412c0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1539695003 >> v2:172.21.15.62:3300/0 conn(0x7efc5805c6f0 0x7efc581440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- 172.21.15.41:0/1539695003 >> 172.21.15.41:0/1539695003 conn(0x7efc580b2380 msgr2=0x7efc5805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:25.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- 172.21.15.41:0/1539695003 shutdown_connections 2021-10-21T00:12:25.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.708+0000 7efc5d61d700 1 -- 172.21.15.41:0/1539695003 wait complete. 2021-10-21T00:12:25.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 Processor -- start 2021-10-21T00:12:25.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 -- start start 2021-10-21T00:12:25.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc5805c6f0 0x7efc580670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc580ae490 0x7efc58155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5809a2f0 con 0x7efc58140e80 2021-10-21T00:12:25.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58156230 con 0x7efc580ae490 2021-10-21T00:12:25.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.712+0000 7efc5d61d700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5813f7e0 con 0x7efc5805c6f0 2021-10-21T00:12:25.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38516/0 (socket says 172.21.15.41:38516) 2021-10-21T00:12:25.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 -- 172.21.15.41:0/1148174463 learned_addr learned my addr 172.21.15.41:0/1148174463 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:25.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc56ffd700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc5805c6f0 0x7efc580670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc567fc700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc580ae490 0x7efc58155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 -- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc5805c6f0 msgr2=0x7efc580670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc5805c6f0 0x7efc580670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 -- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc580ae490 msgr2=0x7efc58155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc580ae490 0x7efc58155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 -- 172.21.15.41:0/1148174463 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50009530 con 0x7efc58140e80 2021-10-21T00:12:25.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc577fe700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7efc500032f0 tx=0x7efc50016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:25.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5000b870 con 0x7efc58140e80 2021-10-21T00:12:25.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50021630 con 0x7efc58140e80 2021-10-21T00:12:25.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc58098eb0 con 0x7efc58140e80 2021-10-21T00:12:25.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc50021990 con 0x7efc58140e80 2021-10-21T00:12:25.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc580983b0 con 0x7efc58140e80 2021-10-21T00:12:25.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc58098cf0 con 0x7efc58140e80 2021-10-21T00:12:25.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.716+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc50027020 con 0x7efc58140e80 2021-10-21T00:12:25.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.720+0000 7efc47fff700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 0x7efc34055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.720+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efc5006c9b0 con 0x7efc58140e80 2021-10-21T00:12:25.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.720+0000 7efc56ffd700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 0x7efc34055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.720+0000 7efc56ffd700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 0x7efc34055b90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7efc4c00c000 tx=0x7efc4c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:25.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.724+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc58098cf0 con 0x7efc58140e80 2021-10-21T00:12:25.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.848+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efc58098cf0 con 0x7efc58140e80 2021-10-21T00:12:25.868 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc47fff700 1 -- 172.21.15.41:0/1148174463 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc58098cf0 con 0x7efc58140e80 2021-10-21T00:12:25.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 msgr2=0x7efc34055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 0x7efc34055b90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7efc4c00c000 tx=0x7efc4c008040).stop 2021-10-21T00:12:25.871 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 msgr2=0x7efc58155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7efc500032f0 tx=0x7efc50016000).stop 2021-10-21T00:12:25.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 shutdown_connections 2021-10-21T00:12:25.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7efc340536d0 0x7efc34055b90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7efc58140e80 0x7efc58155d40 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc580ae490 0x7efc58155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 --2- 172.21.15.41:0/1148174463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc5805c6f0 0x7efc580670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 >> 172.21.15.41:0/1148174463 conn(0x7efc580b2380 msgr2=0x7efc58140490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:25.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 shutdown_connections 2021-10-21T00:12:25.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.860+0000 7efc5d61d700 1 -- 172.21.15.41:0/1148174463 wait complete. 2021-10-21T00:12:25.887 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-10-21T00:12:25.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 Processor -- start 2021-10-21T00:12:25.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 -- start start 2021-10-21T00:12:25.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c05f9f0 0x7fb43c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb43c14b350 0x7fb43c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:25.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0609d0 con 0x7fb43c0aa750 2021-10-21T00:12:25.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0b1620 con 0x7fb43c14b350 2021-10-21T00:12:25.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb441e2b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c05fdd0 con 0x7fb43c05f9f0 2021-10-21T00:12:25.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb43c14b350 0x7fb43c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43affd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb43c0aa750 0x7fb43c14ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36290/0 (socket says 172.21.15.41:36290) 2021-10-21T00:12:25.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43affd700 1 -- 172.21.15.41:0/3322935584 learned_addr learned my addr 172.21.15.41:0/3322935584 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:25.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43b7fe700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c05f9f0 0x7fb43c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:25.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505984237 0 0) 0x7fb43c0609d0 con 0x7fb43c0aa750 2021-10-21T00:12:25.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb428003260 con 0x7fb43c0aa750 2021-10-21T00:12:25.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 -- 172.21.15.41:0/3322935584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c05f9f0 msgr2=0x7fb43c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:25.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c05f9f0 0x7fb43c14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:25.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 -- 172.21.15.41:0/3322935584 >> v1:172.21.15.41:6789/0 conn(0x7fb43c0aa750 legacy=0x7fb43c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:25.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375163510 0 0) 0x7fb428003260 con 0x7fb43c0aa750 2021-10-21T00:12:25.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 -- 172.21.15.41:0/3322935584 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0b1380 con 0x7fb43c14b350 2021-10-21T00:12:25.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43bfff700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c0af7c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb4340091d0).ready entity=mon.0 client_cookie=a37243483777ffa8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:25.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b600 con 0x7fb43c14b350 2021-10-21T00:12:25.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400b760 con 0x7fb43c14b350 2021-10-21T00:12:26.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.984+0000 7fb43a7fc700 1 -- 172.21.15.41:0/3322935584 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b8d0 con 0x7fb43c14b350 2021-10-21T00:12:26.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- 172.21.15.41:0/3322935584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 msgr2=0x7fb43c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c0af7c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb4340091d0).stop 2021-10-21T00:12:26.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- 172.21.15.41:0/3322935584 shutdown_connections 2021-10-21T00:12:26.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c0af7c0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- 172.21.15.41:0/3322935584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c05f9f0 0x7fb43c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- 172.21.15.41:0/3322935584 >> 172.21.15.41:0/3322935584 conn(0x7fb43c05bca0 msgr2=0x7fb43c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:26.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- 172.21.15.41:0/3322935584 shutdown_connections 2021-10-21T00:12:26.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- 172.21.15.41:0/3322935584 wait complete. 2021-10-21T00:12:26.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 Processor -- start 2021-10-21T00:12:26.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- start start 2021-10-21T00:12:26.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb43c05f9f0 0x7fb43c0ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c0aa750 0x7fb43c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0983e0 con 0x7fb43c14b350 2021-10-21T00:12:26.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c15a1b0 con 0x7fb43c05f9f0 2021-10-21T00:12:26.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb441e2b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0ad250 con 0x7fb43c0aa750 2021-10-21T00:12:26.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb43bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb43b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb43c05f9f0 0x7fb43c0ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb43bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38530/0 (socket says 172.21.15.41:38530) 2021-10-21T00:12:26.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.988+0000 7fb43bfff700 1 -- 172.21.15.41:0/1262659118 learned_addr learned my addr 172.21.15.41:0/1262659118 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:26.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43affd700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c0aa750 0x7fb43c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 -- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c0aa750 msgr2=0x7fb43c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c0aa750 0x7fb43c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 -- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb43c05f9f0 msgr2=0x7fb43c0ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb43c05f9f0 0x7fb43c0ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 -- 172.21.15.41:0/1262659118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434009470 con 0x7fb43c14b350 2021-10-21T00:12:26.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb43bfff700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb434016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:26.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b8d0 con 0x7fb43c14b350 2021-10-21T00:12:26.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43401f3f0 con 0x7fb43c14b350 2021-10-21T00:12:26.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c0acec0 con 0x7fb43c14b350 2021-10-21T00:12:26.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b600 con 0x7fb43c14b350 2021-10-21T00:12:26.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.992+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c144210 con 0x7fb43c14b350 2021-10-21T00:12:26.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb434026030 con 0x7fb43c14b350 2021-10-21T00:12:26.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c0678f0 con 0x7fb43c14b350 2021-10-21T00:12:26.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb438ff9700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 0x7fb41c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb43406c1e0 con 0x7fb43c14b350 2021-10-21T00:12:26.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb43b7fe700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 0x7fb41c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:25.996+0000 7fb43b7fe700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 0x7fb41c055a70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb43000b000 tx=0x7fb430006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:26.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.000+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4340435c0 con 0x7fb43c14b350 2021-10-21T00:12:26.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.168+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fb43c057350 con 0x7fb43c14b350 2021-10-21T00:12:26.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.576+0000 7fb438ff9700 1 -- 172.21.15.41:0/1262659118 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v440) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb4340150c0 con 0x7fb43c14b350 2021-10-21T00:12:26.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 msgr2=0x7fb41c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 0x7fb41c055a70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb43000b000 tx=0x7fb430006df0).stop 2021-10-21T00:12:26.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 msgr2=0x7fb43c143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb434016000).stop 2021-10-21T00:12:26.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 shutdown_connections 2021-10-21T00:12:26.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb41c0535b0 0x7fb41c055a70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb43c14b350 0x7fb43c143b80 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb43c0aa750 0x7fb43c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 --2- 172.21.15.41:0/1262659118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb43c05f9f0 0x7fb43c0ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 >> 172.21.15.41:0/1262659118 conn(0x7fb43c05bca0 msgr2=0x7fb43c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:26.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 shutdown_connections 2021-10-21T00:12:26.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.580+0000 7fb441e2b700 1 -- 172.21.15.41:0/1262659118 wait complete. 2021-10-21T00:12:26.606 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-10-21T00:12:26.607 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:12:26.608 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-10-21T00:12:26.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.708+0000 7ff00b59e700 1 Processor -- start 2021-10-21T00:12:26.720 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.708+0000 7ff00b59e700 1 -- start start 2021-10-21T00:12:26.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff00c149240 0x7ff00c14b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c0b4760 con 0x7ff00c0b4380 2021-10-21T00:12:26.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c0ad4c0 con 0x7ff00c0b1830 2021-10-21T00:12:26.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c0ad760 con 0x7ff00c149240 2021-10-21T00:12:26.725 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00a59c700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7ff00c0b4380 0x7ff00c05f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36306/0 (socket says 172.21.15.41:36306) 2021-10-21T00:12:26.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00a59c700 1 -- 172.21.15.41:0/2003156881 learned_addr learned my addr 172.21.15.41:0/2003156881 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:26.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00ad9d700 1 --2- 172.21.15.41:0/2003156881 >> v2:172.21.15.62:3300/0 conn(0x7ff00c149240 0x7ff00c14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00959a700 1 -- 172.21.15.41:0/2003156881 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705871202 0 0) 0x7ff00c0b4760 con 0x7ff00c0b4380 2021-10-21T00:12:26.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00959a700 1 -- 172.21.15.41:0/2003156881 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff0003260 con 0x7ff00c0b4380 2021-10-21T00:12:26.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00ad9d700 1 -- 172.21.15.41:0/2003156881 >> v1:172.21.15.62:6789/0 conn(0x7ff00c0b1830 legacy=0x7ff00c05fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00ad9d700 1 -- 172.21.15.41:0/2003156881 >> v1:172.21.15.41:6789/0 conn(0x7ff00c0b4380 legacy=0x7ff00c05f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00ad9d700 1 -- 172.21.15.41:0/2003156881 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0ada00 con 0x7ff00c149240 2021-10-21T00:12:26.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00ad9d700 1 --2- 172.21.15.41:0/2003156881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c14b630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff004002f70 tx=0x7ff004006df0).ready entity=mon.1 client_cookie=8af5e3ae7e987606 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:26.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00959a700 1 -- 172.21.15.41:0/2003156881 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00400d610 con 0x7ff00c149240 2021-10-21T00:12:26.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00959a700 1 -- 172.21.15.41:0/2003156881 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004000e90 con 0x7ff00c149240 2021-10-21T00:12:26.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00959a700 1 -- 172.21.15.41:0/2003156881 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00400d960 con 0x7ff00c149240 2021-10-21T00:12:26.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- 172.21.15.41:0/2003156881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 msgr2=0x7ff00c14b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 --2- 172.21.15.41:0/2003156881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c14b630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ff004002f70 tx=0x7ff004006df0).stop 2021-10-21T00:12:26.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- 172.21.15.41:0/2003156881 shutdown_connections 2021-10-21T00:12:26.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 --2- 172.21.15.41:0/2003156881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c14b630 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- 172.21.15.41:0/2003156881 >> 172.21.15.41:0/2003156881 conn(0x7ff00c0b7910 msgr2=0x7ff00c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:26.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- 172.21.15.41:0/2003156881 shutdown_connections 2021-10-21T00:12:26.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.712+0000 7ff00b59e700 1 -- 172.21.15.41:0/2003156881 wait complete. 2021-10-21T00:12:26.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 Processor -- start 2021-10-21T00:12:26.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- start start 2021-10-21T00:12:26.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff00c0b4380 0x7ff00c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c144ac0 con 0x7ff00c0b1830 2021-10-21T00:12:26.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c09b2e0 con 0x7ff00c149240 2021-10-21T00:12:26.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c156a20 con 0x7ff00c0b4380 2021-10-21T00:12:26.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38540/0 (socket says 172.21.15.41:38540) 2021-10-21T00:12:26.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 -- 172.21.15.41:0/1925709422 learned_addr learned my addr 172.21.15.41:0/1925709422 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:26.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00ad9d700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff009d9b700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff00c0b4380 0x7ff00c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 -- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff00c0b4380 msgr2=0x7ff00c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff00c0b4380 0x7ff00c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 -- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 msgr2=0x7ff00c099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:26.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:26.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 -- 172.21.15.41:0/1925709422 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00400b180 con 0x7ff00c0b1830 2021-10-21T00:12:26.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00a59c700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff00c156bb0 tx=0x7ff000007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:26.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0000070d0 con 0x7ff00c0b1830 2021-10-21T00:12:26.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000007230 con 0x7ff00c0b1830 2021-10-21T00:12:26.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c144820 con 0x7ff00c0b1830 2021-10-21T00:12:26.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff000005610 con 0x7ff00c0b1830 2021-10-21T00:12:26.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.716+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c1432b0 con 0x7ff00c0b1830 2021-10-21T00:12:26.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c1417c0 con 0x7ff00c0b1830 2021-10-21T00:12:26.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff00001a060 con 0x7ff00c0b1830 2021-10-21T00:12:26.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7feffb7fe700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 0x7fefe8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:26.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff00006ae30 con 0x7ff00c0b1830 2021-10-21T00:12:26.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7ff009d9b700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 0x7fefe8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:26.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.720+0000 7ff009d9b700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 0x7fefe8055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7feffc00d000 tx=0x7feffc000f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:26.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.728+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff000042160 con 0x7ff00c0b1830 2021-10-21T00:12:26.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:26.892+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7ff00c057350 con 0x7ff00c0b1830 2021-10-21T00:12:27.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.576+0000 7feffb7fe700 1 -- 172.21.15.41:0/1925709422 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v441) v1 ==== 139+0+0 (secure 0 0 0) 0x7ff000018030 con 0x7ff00c0b1830 2021-10-21T00:12:27.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 msgr2=0x7fefe8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 0x7fefe8055ad0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7feffc00d000 tx=0x7feffc000f40).stop 2021-10-21T00:12:27.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 msgr2=0x7ff00c0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7ff00c156bb0 tx=0x7ff000007ad0).stop 2021-10-21T00:12:27.601 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 shutdown_connections 2021-10-21T00:12:27.602 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fefe8053610 0x7fefe8055ad0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff00c149240 0x7ff00c099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff00c0b4380 0x7ff00c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 --2- 172.21.15.41:0/1925709422 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff00c0b1830 0x7ff00c0b5af0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 >> 172.21.15.41:0/1925709422 conn(0x7ff00c0b7910 msgr2=0x7ff00c0b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:27.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 shutdown_connections 2021-10-21T00:12:27.608 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.580+0000 7ff00b59e700 1 -- 172.21.15.41:0/1925709422 wait complete. 2021-10-21T00:12:27.618 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-10-21T00:12:27.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.720+0000 7fe8addc3700 1 Processor -- start 2021-10-21T00:12:27.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.720+0000 7fe8addc3700 1 -- start start 2021-10-21T00:12:27.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a8097950 con 0x7fe8a80ac3c0 2021-10-21T00:12:27.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a8097dd0 con 0x7fe8a80b3480 2021-10-21T00:12:27.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80acd70 con 0x7fe8a80b2a20 2021-10-21T00:12:27.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe8a80ac3c0 0x7fe8a8099270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44374/0 (socket says 172.21.15.41:44374) 2021-10-21T00:12:27.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a77fe700 1 -- 172.21.15.41:0/1546350257 learned_addr learned my addr 172.21.15.41:0/1546350257 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:27.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57050/0 (socket says 172.21.15.41:57050) 2021-10-21T00:12:27.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50468/0 (socket says 172.21.15.41:50468) 2021-10-21T00:12:27.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a67fc700 1 -- 172.21.15.41:0/1546350257 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641068682 0 0) 0x7fe8a8097950 con 0x7fe8a80ac3c0 2021-10-21T00:12:27.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a67fc700 1 -- 172.21.15.41:0/1546350257 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003260 con 0x7fe8a80ac3c0 2021-10-21T00:12:27.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 -- 172.21.15.41:0/1546350257 >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 msgr2=0x7fe8a80ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:27.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 --2- 172.21.15.41:0/1546350257 >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 -- 172.21.15.41:0/1546350257 >> v1:172.21.15.62:6789/0 conn(0x7fe8a80ac3c0 legacy=0x7fe8a8099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 -- 172.21.15.41:0/1546350257 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8099980 con 0x7fe8a80b2a20 2021-10-21T00:12:27.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a6ffd700 1 --2- 172.21.15.41:0/1546350257 >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:27.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a7fff700 1 --2- 172.21.15.41:0/1546350257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0006df0).ready entity=mon.2 client_cookie=f1f1aa631a0fb3ed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:27.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a67fc700 1 -- 172.21.15.41:0/1546350257 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a000d4a0 con 0x7fe8a80b2a20 2021-10-21T00:12:27.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a67fc700 1 -- 172.21.15.41:0/1546350257 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0000e90 con 0x7fe8a80b2a20 2021-10-21T00:12:27.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8a67fc700 1 -- 172.21.15.41:0/1546350257 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a000d7f0 con 0x7fe8a80b2a20 2021-10-21T00:12:27.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- 172.21.15.41:0/1546350257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 msgr2=0x7fe8a8097f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1546350257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0006df0).stop 2021-10-21T00:12:27.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- 172.21.15.41:0/1546350257 shutdown_connections 2021-10-21T00:12:27.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1546350257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b2a20 0x7fe8a8097f80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1546350257 >> v2:172.21.15.62:3300/0 conn(0x7fe8a80b3480 0x7fe8a80ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- 172.21.15.41:0/1546350257 >> 172.21.15.41:0/1546350257 conn(0x7fe8a80b45d0 msgr2=0x7fe8a805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:27.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- 172.21.15.41:0/1546350257 shutdown_connections 2021-10-21T00:12:27.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.724+0000 7fe8addc3700 1 -- 172.21.15.41:0/1546350257 wait complete. 2021-10-21T00:12:27.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 Processor -- start 2021-10-21T00:12:27.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- start start 2021-10-21T00:12:27.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b3480 0x7fe8a809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a809ad10 con 0x7fe8a80b2a20 2021-10-21T00:12:27.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a809a7d0 con 0x7fe8a80ac3c0 2021-10-21T00:12:27.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a809aa70 con 0x7fe8a80b3480 2021-10-21T00:12:27.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50472/0 (socket says 172.21.15.41:50472) 2021-10-21T00:12:27.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38556/0 (socket says 172.21.15.41:38556) 2021-10-21T00:12:27.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a77fe700 1 -- 172.21.15.41:0/1359841411 learned_addr learned my addr 172.21.15.41:0/1359841411 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:27.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a7fff700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b3480 0x7fe8a809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 -- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b3480 msgr2=0x7fe8a809bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b3480 0x7fe8a809bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 -- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 msgr2=0x7fe8a80af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 -- 172.21.15.41:0/1359841411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c00b180 con 0x7fe8a80b2a20 2021-10-21T00:12:27.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a77fe700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:27.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a6ffd700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fe89c00c000 tx=0x7fe89c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:27.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c010780 con 0x7fe8a80b2a20 2021-10-21T00:12:27.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a000b180 con 0x7fe8a80b2a20 2021-10-21T00:12:27.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a80b1660 con 0x7fe8a80b2a20 2021-10-21T00:12:27.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0108e0 con 0x7fe8a80b2a20 2021-10-21T00:12:27.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.728+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c010c40 con 0x7fe8a80b2a20 2021-10-21T00:12:27.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe89c01c460 con 0x7fe8a80b2a20 2021-10-21T00:12:27.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a80b2790 con 0x7fe8a80b2a20 2021-10-21T00:12:27.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8a4ff9700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 0x7fe888055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:27.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe89c06bba0 con 0x7fe8a80b2a20 2021-10-21T00:12:27.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8a77fe700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 0x7fe888055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:27.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.732+0000 7fe8a77fe700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 0x7fe888055a70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fe89800d000 tx=0x7fe898009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:27.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.740+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe89c042df0 con 0x7fe8a80b2a20 2021-10-21T00:12:27.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.872+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe8a8057350 con 0x7fe8a80b2a20 2021-10-21T00:12:27.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.876+0000 7fe8a4ff9700 1 -- 172.21.15.41:0/1359841411 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe89c046410 con 0x7fe8a80b2a20 2021-10-21T00:12:27.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.876+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 msgr2=0x7fe888055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.876+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 0x7fe888055a70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fe89800d000 tx=0x7fe898009040).stop 2021-10-21T00:12:27.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.876+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 msgr2=0x7fe8a8098350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:27.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.876+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fe89c00c000 tx=0x7fe89c006df0).stop 2021-10-21T00:12:27.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 shutdown_connections 2021-10-21T00:12:27.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe8880535b0 0x7fe888055a70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a80b3480 0x7fe8a809bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe8a80b2a20 0x7fe8a8098350 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 --2- 172.21.15.41:0/1359841411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a80ac3c0 0x7fe8a80af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:27.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 >> 172.21.15.41:0/1359841411 conn(0x7fe8a80b45d0 msgr2=0x7fe8a805c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:27.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 shutdown_connections 2021-10-21T00:12:27.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:27.880+0000 7fe8addc3700 1 -- 172.21.15.41:0/1359841411 wait complete. 2021-10-21T00:12:27.899 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:12:27.900 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:27.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:27.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:27.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:27.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:12:28.008 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:12:28.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:28.009 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:28.010 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-10-21T00:12:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:28.019 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-10-21T00:12:28.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:28.020 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:28.020 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-10-21T00:12:28.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:28.039 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:28.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:28.040 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:28.040 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-10-21T00:12:28.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:12:28.049 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-10-21T00:12:28.049 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-10-21T00:12:28.050 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:12:28.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.148+0000 7fe4d505e700 1 Processor -- start 2021-10-21T00:12:28.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.148+0000 7fe4d505e700 1 -- start start 2021-10-21T00:12:28.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 0x7fe4d0143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4d01418f0 0x7fe4d0141da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d0142bc0 con 0x7fe4d00b9c70 2021-10-21T00:12:28.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d01429a0 con 0x7fe4d01418f0 2021-10-21T00:12:28.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00ba050 con 0x7fe4d00b3bc0 2021-10-21T00:12:28.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4ced9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe4d00b9c70 0x7fe4d0143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36332/0 (socket says 172.21.15.41:36332) 2021-10-21T00:12:28.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4ced9d700 1 -- 172.21.15.41:0/1181405562 learned_addr learned my addr 172.21.15.41:0/1181405562 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:28.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4ce59c700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 0x7fe4d0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/1181405562 >> v2:172.21.15.62:3300/0 conn(0x7fe4d01418f0 0x7fe4d0141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cdd9b700 1 -- 172.21.15.41:0/1181405562 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277107028 0 0) 0x7fe4d0142bc0 con 0x7fe4d00b9c70 2021-10-21T00:12:28.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cdd9b700 1 -- 172.21.15.41:0/1181405562 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003260 con 0x7fe4d00b9c70 2021-10-21T00:12:28.165 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 -- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 msgr2=0x7fe4d0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:28.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 0x7fe4d0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 -- 172.21.15.41:0/1181405562 >> v1:172.21.15.41:6789/0 conn(0x7fe4d00b9c70 legacy=0x7fe4d0143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 -- 172.21.15.41:0/1181405562 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d01463c0 con 0x7fe4d01418f0 2021-10-21T00:12:28.166 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4ce59c700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 0x7fe4d0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:28.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d01418f0 0x7fe4d0141da0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fe4d00b1ab0 tx=0x7fe4c80091d0).ready entity=mon.1 client_cookie=b42b81dfd80bf0c0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cdd9b700 1 -- 172.21.15.41:0/1181405562 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c800b600 con 0x7fe4d01418f0 2021-10-21T00:12:28.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cdd9b700 1 -- 172.21.15.41:0/1181405562 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800b760 con 0x7fe4d01418f0 2021-10-21T00:12:28.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4cdd9b700 1 -- 172.21.15.41:0/1181405562 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c800b8d0 con 0x7fe4d01418f0 2021-10-21T00:12:28.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d01418f0 msgr2=0x7fe4d0141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d01418f0 0x7fe4d0141da0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fe4d00b1ab0 tx=0x7fe4c80091d0).stop 2021-10-21T00:12:28.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- 172.21.15.41:0/1181405562 shutdown_connections 2021-10-21T00:12:28.171 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d01418f0 0x7fe4d0141da0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 --2- 172.21.15.41:0/1181405562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b3bc0 0x7fe4d0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- 172.21.15.41:0/1181405562 >> 172.21.15.41:0/1181405562 conn(0x7fe4d0062e80 msgr2=0x7fe4d00b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:28.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- 172.21.15.41:0/1181405562 shutdown_connections 2021-10-21T00:12:28.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.152+0000 7fe4d505e700 1 -- 172.21.15.41:0/1181405562 wait complete. 2021-10-21T00:12:28.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 Processor -- start 2021-10-21T00:12:28.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 -- start start 2021-10-21T00:12:28.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d00b3bc0 0x7fe4d0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 0x7fe4d00aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d013f460 con 0x7fe4d01418f0 2021-10-21T00:12:28.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0114d80 con 0x7fe4d00b3bc0 2021-10-21T00:12:28.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4d505e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0115000 con 0x7fe4d00b9c70 2021-10-21T00:12:28.174 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38572/0 (socket says 172.21.15.41:38572) 2021-10-21T00:12:28.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 -- 172.21.15.41:0/2582217738 learned_addr learned my addr 172.21.15.41:0/2582217738 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:28.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4ced9d700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d00b3bc0 0x7fe4d0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4ce59c700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 0x7fe4d00aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 -- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 msgr2=0x7fe4d00aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 0x7fe4d00aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 -- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d00b3bc0 msgr2=0x7fe4d0113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d00b3bc0 0x7fe4d0113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4cf59e700 1 -- 172.21.15.41:0/2582217738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c000b180 con 0x7fe4d01418f0 2021-10-21T00:12:28.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.156+0000 7fe4ce59c700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 0x7fe4d00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:28.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4cf59e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fe4d00b1ab0 tx=0x7fe4c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c800b8d0 con 0x7fe4d01418f0 2021-10-21T00:12:28.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c80032f0 con 0x7fe4d01418f0 2021-10-21T00:12:28.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c800b600 con 0x7fe4d01418f0 2021-10-21T00:12:28.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c8009470 con 0x7fe4d01418f0 2021-10-21T00:12:28.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d0115540 con 0x7fe4d01418f0 2021-10-21T00:12:28.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d0146120 con 0x7fe4d01418f0 2021-10-21T00:12:28.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe4c8026030 con 0x7fe4d01418f0 2021-10-21T00:12:28.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 0x7fe4b40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe4c806c030 con 0x7fe4d01418f0 2021-10-21T00:12:28.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.160+0000 7fe4ced9d700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 0x7fe4b40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.184 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.164+0000 7fe4ced9d700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 0x7fe4b40559e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fe4b800d000 tx=0x7fe4b8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.168+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4c8043410 con 0x7fe4d01418f0 2021-10-21T00:12:28.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.304+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe4d00b1210 con 0x7fe4d01418f0 2021-10-21T00:12:28.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4c7fff700 1 -- 172.21.15.41:0/2582217738 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+28837 (secure 0 0 0) 0x7fe4c8024090 con 0x7fe4d01418f0 2021-10-21T00:12:28.316 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:28.317 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:28.317 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 139, 2021-10-21T00:12:28.317 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:12:28.317 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:12:28.318 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:12:25.568149+0000", 2021-10-21T00:12:28.318 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:28.318 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:28.319 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:12:28.319 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:12:28.319 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:12:28.319 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:12:28.320 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:12:28.320 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:12:28.320 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:12:28.320 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:28.321 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:12:28.321 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:12:28.321 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:12:28.321 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:12:28.321 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:12:28.322 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 28, 2021-10-21T00:12:28.322 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:12:28.322 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:12:28.322 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:12:28.323 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:12:28.323 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:12:28.323 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.323 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:12:28.324 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:12:28.324 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:12:28.324 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:28.325 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:28.325 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:28.325 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:28.325 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:28.326 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:28.326 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:28.326 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:28.326 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:12:28.326 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:12:28.327 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:12:28.327 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:12:28.327 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:12:28.327 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:28.328 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:28.328 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:28.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:28.328 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:28.329 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:28.329 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:28.331 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.331 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:12:28.331 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:28.332 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:28.332 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:28.333 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:28.333 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:28.333 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:28.334 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:28.334 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:28.335 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:28.335 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:28.335 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:28.335 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:28.336 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:28.336 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:28.336 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:28.336 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:28.336 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:28.337 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:28.337 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:28.337 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:28.337 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:28.338 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:28.338 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:28.338 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:28.339 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:28.339 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:28.340 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.341 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:28.341 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:28.341 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:28.342 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:28.342 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:28.342 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:28.342 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:28.343 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:28.343 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:28.343 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:28.343 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:28.344 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:28.344 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:12:28.344 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.344 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:28.345 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:12:28.345 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.345 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.345 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.345 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:12:28.346 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:12:28.346 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:12:28.346 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:28.346 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:28.347 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:28.347 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:28.347 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:28.347 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:28.348 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:28.348 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:28.348 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:28.348 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:28.349 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:28.349 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:28.349 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:28.350 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:28.350 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:28.350 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:28.350 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:28.351 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:28.351 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:28.352 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.353 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:12:28.354 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:28.355 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:28.355 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:28.355 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:28.355 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:28.356 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:28.356 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:28.356 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:28.356 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:28.356 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:28.357 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:28.357 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:28.357 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:28.357 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:28.358 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:28.358 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:28.358 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:28.358 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:28.358 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:28.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:28.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:28.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:28.359 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:28.360 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:28.360 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:28.360 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:28.361 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.361 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:28.362 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:28.362 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:28.362 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:28.363 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:28.363 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:28.363 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:28.363 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:28.364 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:28.364 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:28.364 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:28.364 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:28.365 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:28.365 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:12:28.365 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.366 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.366 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:28.366 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:12:28.366 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.367 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:28.367 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:12:28.367 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.367 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.368 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.368 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.368 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.368 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.368 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.369 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:28.369 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.369 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.369 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.370 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.371 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.371 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.371 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:12:28.371 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.372 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.372 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.372 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.372 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:12:28.373 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.373 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.373 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.373 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.374 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.374 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.374 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.375 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.375 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:12:28.375 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.375 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.375 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.376 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.376 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:12:28.376 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.376 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.377 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.377 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.377 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.377 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.378 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.383 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.383 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:12:28.383 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.384 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.384 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.384 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.385 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:12:28.385 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.385 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.386 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.386 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.386 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.387 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.387 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.387 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.388 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:12:28.388 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.388 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.388 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.389 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.389 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:12:28.389 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:28.390 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.390 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.390 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.390 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:12:28.391 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:12:28.391 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:12:28.392 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:12:28.392 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.392 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.393 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.393 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.393 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.393 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.394 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:28.394 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:12:28.394 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.395 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.395 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.395 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.395 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.396 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.396 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.396 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:28.396 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.396 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.397 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.397 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.397 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.397 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.398 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:12:28.398 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.398 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.398 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.399 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.399 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:12:28.399 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.399 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.399 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.400 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.400 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.400 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.400 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.401 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.401 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:12:28.401 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.401 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.401 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.402 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.402 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:12:28.402 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.403 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.403 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.403 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.403 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.404 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.404 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.404 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:12:28.404 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.405 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.405 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.405 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.405 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:12:28.406 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.406 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.406 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.406 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.407 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.407 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.407 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.407 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:12:28.408 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.408 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.408 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.408 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.409 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:12:28.409 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:28.409 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.409 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.409 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.410 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:12:28.410 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:12:28.410 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:12:28.410 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:12:28.411 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.411 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.411 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.411 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.412 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.412 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.412 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:28.412 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:12:28.412 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.413 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.413 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.413 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.415 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.415 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.415 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.415 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 133, 2021-10-21T00:12:28.416 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.416 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.416 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.416 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.417 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.417 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.417 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:12:28.417 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.417 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.418 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.418 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.418 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:12:28.418 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.419 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.419 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.419 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.419 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.419 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.420 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.420 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.420 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:12:28.420 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.420 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.421 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.421 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.421 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:12:28.422 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.422 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.422 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.422 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.423 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.423 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.423 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.423 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:12:28.424 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.424 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.424 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.424 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.424 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:12:28.425 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.425 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.425 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.425 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.425 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.426 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.426 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.426 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.426 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:12:28.427 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.427 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.427 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.427 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.427 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:12:28.428 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:28.428 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.428 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.428 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.429 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:12:28.429 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:12:28.429 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:12:28.429 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:12:28.429 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.430 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.430 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.431 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.431 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.431 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.431 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:28.432 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:12:28.432 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.432 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.432 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.433 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.433 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.433 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.433 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.433 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 124, 2021-10-21T00:12:28.434 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.434 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.434 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.434 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.434 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.435 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.435 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:12:28.435 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.435 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.436 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.436 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.436 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:12:28.436 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.437 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.437 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.437 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.437 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.437 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.438 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.438 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.438 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:12:28.438 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.438 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.439 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.439 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.439 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:12:28.439 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.440 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.440 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.440 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.440 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.440 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.441 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.441 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.441 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:12:28.441 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.442 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.442 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.442 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.442 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:12:28.442 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.443 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.443 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.443 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.443 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.444 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.444 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.444 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.444 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:12:28.444 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.445 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.445 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.445 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.445 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:12:28.445 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:28.446 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.446 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.446 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.446 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:12:28.447 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:12:28.447 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:12:28.447 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:12:28.447 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.447 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.448 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.448 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.448 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.448 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.448 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:12:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.449 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.450 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.450 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.450 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.450 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 133, 2021-10-21T00:12:28.451 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.451 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.451 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.451 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.451 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.452 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.452 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:12:28.452 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.452 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.453 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.453 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.453 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:12:28.453 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.453 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.454 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.454 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.454 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.454 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.455 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.455 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.455 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:12:28.455 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.455 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.456 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.456 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.456 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:12:28.456 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.457 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.457 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.457 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.457 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.457 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.458 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.458 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:12:28.458 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.458 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.459 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.459 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.459 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:12:28.459 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.460 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.460 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.460 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.460 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.460 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.461 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.461 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.461 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:12:28.461 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.461 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.462 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.462 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.462 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:12:28.462 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:28.463 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.463 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.463 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:12:28.463 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:12:28.464 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:12:28.464 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:12:28.464 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.464 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.464 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.465 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.465 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.465 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.465 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:28.465 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:12:28.466 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.466 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.466 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.466 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.467 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.467 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.467 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.467 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:28.467 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.468 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.468 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.468 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.468 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.468 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.469 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:12:28.469 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.469 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.469 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.469 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.470 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:12:28.470 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.470 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.470 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.471 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.471 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.471 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.471 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.471 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.472 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:12:28.472 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.472 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.472 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.473 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.473 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:12:28.473 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.473 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.474 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.474 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.474 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.474 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.474 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.475 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:12:28.475 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.475 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.475 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.476 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.476 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:12:28.476 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.476 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.476 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.477 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.477 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.477 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.477 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.477 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.478 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:12:28.478 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.478 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.478 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.479 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.479 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:12:28.479 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:28.479 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.479 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.480 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.480 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:12:28.480 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:12:28.480 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:12:28.480 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:12:28.481 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.481 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.481 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.481 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.481 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.482 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.482 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:28.482 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:12:28.482 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.483 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.483 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.483 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.483 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.483 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.484 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.484 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:28.484 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.484 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.484 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.485 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.485 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.485 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.485 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:12:28.485 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.486 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.486 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.486 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.486 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:12:28.487 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.487 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.487 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.487 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.487 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.488 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.488 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.488 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.488 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:12:28.489 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.489 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.489 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.489 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.489 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:12:28.490 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.490 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.490 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.490 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.490 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.491 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.491 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.491 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.491 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:12:28.491 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.492 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.492 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.492 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.492 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:12:28.493 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.493 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.493 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.493 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.493 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.494 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.494 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.494 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.494 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:12:28.495 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.495 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.495 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.495 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.495 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:12:28.496 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:28.496 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.496 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.496 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.496 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:12:28.497 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:12:28.497 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:12:28.497 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:12:28.497 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.498 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.498 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.498 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.498 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.498 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.499 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:28.499 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:12:28.499 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:28.499 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:28.499 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:28.500 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:28.500 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:28.500 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:28.500 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:28.500 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 134, 2021-10-21T00:12:28.501 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:28.501 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:28.501 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:28.501 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.502 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.502 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.502 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:12:28.502 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.502 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.503 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.503 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.503 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:12:28.503 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.503 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.504 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.504 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:28.504 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.504 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.505 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.505 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:12:28.505 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.505 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.505 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.506 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.506 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:12:28.506 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.506 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.507 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.507 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.507 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:28.507 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.507 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.508 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.508 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:12:28.508 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.508 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.508 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.509 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.509 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:12:28.509 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.509 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.510 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.510 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.510 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:28.510 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:28.510 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.511 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:28.511 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:12:28.511 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.511 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.511 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.512 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:28.512 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:12:28.512 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:28.512 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.512 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.513 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.513 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:12:28.513 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:12:28.513 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:12:28.513 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:12:28.514 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:28.514 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:28.514 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:28.514 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:28.515 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.515 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:28.515 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:12:28.515 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.516 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:28.516 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.516 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.516 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.517 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.517 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.517 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:12:28.517 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.517 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.518 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.518 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:28.518 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.518 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.519 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.519 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.519 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.519 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:12:28.519 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.520 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.520 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.520 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:28.520 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.520 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.521 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.521 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.521 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.521 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:12:28.522 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.522 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.522 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.522 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:28.523 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.523 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.523 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.523 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.523 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.524 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:12:28.524 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.524 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.524 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.524 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:28.525 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.525 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.525 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.525 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.526 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.526 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:12:28.526 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.526 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.526 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.527 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:28.527 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.527 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.527 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.527 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.528 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.528 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:12:28.528 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.528 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.528 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.529 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:28.529 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.529 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.529 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.530 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.530 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.530 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:12:28.530 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.531 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.531 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:28.531 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:28.531 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:28.531 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:28.532 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:28.532 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:28.532 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:28.532 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:12:28.533 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:28.533 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.533 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:28.533 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:12:28.533 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:12:28.534 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:12:28.534 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:12:28.534 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": { 2021-10-21T00:12:28.534 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6835/2228513289": "2021-10-22T00:12:21.545014+0000", 2021-10-21T00:12:28.534 INFO:teuthology.orchestra.run.smithi041.stdout: "172.21.15.62:6834/2228513289": "2021-10-22T00:12:21.545014+0000" 2021-10-21T00:12:28.535 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.535 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:12:28.535 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:12:28.535 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:12:28.536 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:12:28.536 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:12:28.536 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:12:28.536 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:12:28.536 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:12:28.537 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:28.537 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:28.537 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:12:28.537 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:12:28.537 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:12:28.538 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:12:28.538 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:12:28.538 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:28.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 msgr2=0x7fe4b40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 0x7fe4b40559e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fe4b800d000 tx=0x7fe4b8009040).stop 2021-10-21T00:12:28.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 msgr2=0x7fe4d0155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fe4d00b1ab0 tx=0x7fe4c8016000).stop 2021-10-21T00:12:28.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 shutdown_connections 2021-10-21T00:12:28.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe4b4053520 0x7fe4b40559e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe4d01418f0 0x7fe4d0155710 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4d00b9c70 0x7fe4d00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 --2- 172.21.15.41:0/2582217738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4d00b3bc0 0x7fe4d0113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 >> 172.21.15.41:0/2582217738 conn(0x7fe4d0062e80 msgr2=0x7fe4d0142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:28.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 shutdown_connections 2021-10-21T00:12:28.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.308+0000 7fe4d505e700 1 -- 172.21.15.41:0/2582217738 wait complete. 2021-10-21T00:12:28.544 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:28.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 Processor -- start 2021-10-21T00:12:28.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 -- start start 2021-10-21T00:12:28.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdec8062330 0x7fdec80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec80b3a20 0x7fdec813c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.661 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec805bd40 con 0x7fdec8062f70 2021-10-21T00:12:28.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec805bf70 con 0x7fdec8062330 2021-10-21T00:12:28.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.648+0000 7fdecdbbe700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec8142cb0 con 0x7fdec80b3a20 2021-10-21T00:12:28.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecd3bd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec80b3a20 0x7fdec813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdec8062330 0x7fdec80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdec8062f70 0x7fdec805c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44402/0 (socket says 172.21.15.41:44402) 2021-10-21T00:12:28.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebffff700 1 -- 172.21.15.41:0/3916738043 learned_addr learned my addr 172.21.15.41:0/3916738043 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:28.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 -- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec80b3a20 msgr2=0x7fdec813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:28.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 --2- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec80b3a20 0x7fdec813c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.664 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 -- 172.21.15.41:0/3916738043 >> v1:172.21.15.62:6789/0 conn(0x7fdec8062f70 legacy=0x7fdec805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebf7fe700 1 -- 172.21.15.41:0/3916738043 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387931051 0 0) 0x7fdec805bd40 con 0x7fdec8062f70 2021-10-21T00:12:28.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 -- 172.21.15.41:0/3916738043 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8142950 con 0x7fdec8062330 2021-10-21T00:12:28.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdeccbbc700 1 --2- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec80b3f30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdec4002f70 tx=0x7fdec4006df0).ready entity=mon.1 client_cookie=85202f9ff3aef859 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebf7fe700 1 -- 172.21.15.41:0/3916738043 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400d570 con 0x7fdec8062330 2021-10-21T00:12:28.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebf7fe700 1 -- 172.21.15.41:0/3916738043 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4000e90 con 0x7fdec8062330 2021-10-21T00:12:28.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdebf7fe700 1 -- 172.21.15.41:0/3916738043 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400d8c0 con 0x7fdec8062330 2021-10-21T00:12:28.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 -- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 msgr2=0x7fdec80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec80b3f30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdec4002f70 tx=0x7fdec4006df0).stop 2021-10-21T00:12:28.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 -- 172.21.15.41:0/3916738043 shutdown_connections 2021-10-21T00:12:28.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec80b3a20 0x7fdec813c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/3916738043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec80b3f30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 -- 172.21.15.41:0/3916738043 >> 172.21.15.41:0/3916738043 conn(0x7fdec80b9080 msgr2=0x7fdec80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:28.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 -- 172.21.15.41:0/3916738043 shutdown_connections 2021-10-21T00:12:28.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.652+0000 7fdecdbbe700 1 -- 172.21.15.41:0/3916738043 wait complete. 2021-10-21T00:12:28.674 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 Processor -- start 2021-10-21T00:12:28.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- start start 2021-10-21T00:12:28.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec81449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec8062f70 0x7fdec8145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80ae930 con 0x7fdec80b3a20 2021-10-21T00:12:28.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80aebd0 con 0x7fdec8062330 2021-10-21T00:12:28.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80aee70 con 0x7fdec8062f70 2021-10-21T00:12:28.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdebffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec8062f70 0x7fdec8145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdeccbbc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec81449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.677 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38586/0 (socket says 172.21.15.41:38586) 2021-10-21T00:12:28.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 -- 172.21.15.41:0/1958800621 learned_addr learned my addr 172.21.15.41:0/1958800621 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:28.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 -- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec8062f70 msgr2=0x7fdec8145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec8062f70 0x7fdec8145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 -- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 msgr2=0x7fdec81449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec81449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 -- 172.21.15.41:0/1958800621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec400b180 con 0x7fdec80b3a20 2021-10-21T00:12:28.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecd3bd700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fdec000c000 tx=0x7fdec00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec0012600 con 0x7fdec80b3a20 2021-10-21T00:12:28.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec80af490 con 0x7fdec80b3a20 2021-10-21T00:12:28.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0012760 con 0x7fdec80b3a20 2021-10-21T00:12:28.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec80ae680 con 0x7fdec80b3a20 2021-10-21T00:12:28.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.656+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec0012ac0 con 0x7fdec80b3a20 2021-10-21T00:12:28.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.660+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec8145af0 con 0x7fdec80b3a20 2021-10-21T00:12:28.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.660+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdec0022070 con 0x7fdec80b3a20 2021-10-21T00:12:28.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.660+0000 7fdebdffb700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 0x7fdea8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.660+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdec006bc40 con 0x7fdec80b3a20 2021-10-21T00:12:28.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.660+0000 7fdeccbbc700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 0x7fdea8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.664+0000 7fdeccbbc700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 0x7fdea8055a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fdec401a000 tx=0x7fdec4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.668+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdec8145af0 con 0x7fdec80b3a20 2021-10-21T00:12:28.844 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec8145af0 con 0x7fdec80b3a20 2021-10-21T00:12:28.845 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdebdffb700 1 -- 172.21.15.41:0/1958800621 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fdec8145af0 con 0x7fdec80b3a20 2021-10-21T00:12:28.845 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:28.846 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1022614740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1022614740},{"type":"v1","addr":"172.21.15.62:6835","nonce":1022614740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[]} 2021-10-21T00:12:28.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 msgr2=0x7fdea8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.847 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 0x7fdea8055a70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fdec401a000 tx=0x7fdec4014000).stop 2021-10-21T00:12:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 msgr2=0x7fdec8146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fdec000c000 tx=0x7fdec00091d0).stop 2021-10-21T00:12:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 shutdown_connections 2021-10-21T00:12:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdea80535b0 0x7fdea8055a70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdec80b3a20 0x7fdec8146340 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdec8062f70 0x7fdec8145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 --2- 172.21.15.41:0/1958800621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdec8062330 0x7fdec81449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 >> 172.21.15.41:0/1958800621 conn(0x7fdec80b9080 msgr2=0x7fdec8142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:28.849 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 shutdown_connections 2021-10-21T00:12:28.850 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.836+0000 7fdecdbbe700 1 -- 172.21.15.41:0/1958800621 wait complete. 2021-10-21T00:12:28.850 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 74 2021-10-21T00:12:28.859 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:28.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 Processor -- start 2021-10-21T00:12:28.963 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 -- start start 2021-10-21T00:12:28.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f595805f9f0 0x7f595814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.965 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 0x7f595814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580609d0 con 0x7f595814b130 2021-10-21T00:12:28.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580b1620 con 0x7f595805f9f0 2021-10-21T00:12:28.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f5960614700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595805fdd0 con 0x7f59580aa750 2021-10-21T00:12:28.966 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.952+0000 7f595ebb1700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f595814b130 0x7f59581495e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36364/0 (socket says 172.21.15.41:36364) 2021-10-21T00:12:28.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595ebb1700 1 -- 172.21.15.41:0/3757393127 learned_addr learned my addr 172.21.15.41:0/3757393127 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:28.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595e3b0700 1 --2- 172.21.15.41:0/3757393127 >> v2:172.21.15.62:3300/0 conn(0x7f595805f9f0 0x7f595814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 --2- 172.21.15.41:0/3757393127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 0x7f595814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239279965 0 0) 0x7f59580609d0 con 0x7f595814b130 2021-10-21T00:12:28.967 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940003260 con 0x7f595814b130 2021-10-21T00:12:28.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 -- 172.21.15.41:0/3757393127 >> v2:172.21.15.62:3300/0 conn(0x7f595805f9f0 msgr2=0x7f595814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:28.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 --2- 172.21.15.41:0/3757393127 >> v2:172.21.15.62:3300/0 conn(0x7f595805f9f0 0x7f595814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886647544 0 0) 0x7f5940003260 con 0x7f595814b130 2021-10-21T00:12:28.968 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 -- 172.21.15.41:0/3757393127 >> v1:172.21.15.41:6789/0 conn(0x7f595814b130 legacy=0x7f59581495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 -- 172.21.15.41:0/3757393127 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580b1380 con 0x7f59580aa750 2021-10-21T00:12:28.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595dbaf700 1 --2- 172.21.15.41:0/3757393127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 0x7f595814ac40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5950001800 tx=0x7f59540091d0).ready entity=mon.2 client_cookie=386bf0d20b6fcfe0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5950001660 con 0x7f59580aa750 2021-10-21T00:12:28.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400f510 con 0x7f59580aa750 2021-10-21T00:12:28.969 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f595d3ae700 1 -- 172.21.15.41:0/3757393127 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595400f680 con 0x7f59580aa750 2021-10-21T00:12:28.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- 172.21.15.41:0/3757393127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 msgr2=0x7f595814ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.973 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 --2- 172.21.15.41:0/3757393127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 0x7f595814ac40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5950001800 tx=0x7f59540091d0).stop 2021-10-21T00:12:28.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- 172.21.15.41:0/3757393127 shutdown_connections 2021-10-21T00:12:28.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 --2- 172.21.15.41:0/3757393127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59580aa750 0x7f595814ac40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 --2- 172.21.15.41:0/3757393127 >> v2:172.21.15.62:3300/0 conn(0x7f595805f9f0 0x7f595814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.974 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- 172.21.15.41:0/3757393127 >> 172.21.15.41:0/3757393127 conn(0x7f595805bca0 msgr2=0x7f595805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:28.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- 172.21.15.41:0/3757393127 shutdown_connections 2021-10-21T00:12:28.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- 172.21.15.41:0/3757393127 wait complete. 2021-10-21T00:12:28.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 Processor -- start 2021-10-21T00:12:28.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.956+0000 7f5960614700 1 -- start start 2021-10-21T00:12:28.975 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f595805f9f0 0x7f5958098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 0x7f59580991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958146410 con 0x7f595814b130 2021-10-21T00:12:28.976 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958145ed0 con 0x7f59580aa750 2021-10-21T00:12:28.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958146170 con 0x7f595805f9f0 2021-10-21T00:12:28.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38600/0 (socket says 172.21.15.41:38600) 2021-10-21T00:12:28.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 -- 172.21.15.41:0/3476746179 learned_addr learned my addr 172.21.15.41:0/3476746179 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:28.977 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595e3b0700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f595805f9f0 0x7f5958098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595dbaf700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 0x7f59580991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 -- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f595805f9f0 msgr2=0x7f5958098d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f595805f9f0 0x7f5958098d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 -- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 msgr2=0x7f59580991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:28.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 0x7f59580991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:28.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 -- 172.21.15.41:0/3476746179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009470 con 0x7f595814b130 2021-10-21T00:12:28.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595dbaf700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 0x7f59580991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:28.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f595ebb1700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f59500018c0 tx=0x7f59500019e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5950007170 con 0x7f595814b130 2021-10-21T00:12:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500072d0 con 0x7f595814b130 2021-10-21T00:12:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5950004920 con 0x7f595814b130 2021-10-21T00:12:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5958146620 con 0x7f595814b130 2021-10-21T00:12:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958159a70 con 0x7f595814b130 2021-10-21T00:12:28.980 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.960+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5958098880 con 0x7f595814b130 2021-10-21T00:12:28.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.964+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f595001b070 con 0x7f595814b130 2021-10-21T00:12:28.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.964+0000 7f59477fe700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 0x7f5938055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:28.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.964+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f595006af30 con 0x7f595814b130 2021-10-21T00:12:28.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.964+0000 7f595e3b0700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 0x7f5938055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:28.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.964+0000 7f595e3b0700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 0x7f5938055b00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f594800b000 tx=0x7f5948008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:28.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:28.968+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5958098880 con 0x7f595814b130 2021-10-21T00:12:29.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.132+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5958098880 con 0x7f595814b130 2021-10-21T00:12:29.147 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f59477fe700 1 -- 172.21.15.41:0/3476746179 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f5958098880 con 0x7f595814b130 2021-10-21T00:12:29.147 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:29.148 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.41:6833/2192379044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":2192379044},{"type":"v1","addr":"172.21.15.41:6833","nonce":2192379044}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1022614740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1022614740},{"type":"v1","addr":"172.21.15.62:6835","nonce":1022614740}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[]} 2021-10-21T00:12:29.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 msgr2=0x7f5938055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 0x7f5938055b00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f594800b000 tx=0x7f5948008040).stop 2021-10-21T00:12:29.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 msgr2=0x7f59580ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f59500018c0 tx=0x7f59500019e0).stop 2021-10-21T00:12:29.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 shutdown_connections 2021-10-21T00:12:29.150 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5938053640 0x7f5938055b00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f595814b130 0x7f59580ae950 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59580aa750 0x7f59580991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.151 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 --2- 172.21.15.41:0/3476746179 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f595805f9f0 0x7f5958098d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 >> 172.21.15.41:0/3476746179 conn(0x7f595805bca0 msgr2=0x7f59580b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:29.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 shutdown_connections 2021-10-21T00:12:29.152 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.136+0000 7f5960614700 1 -- 172.21.15.41:0/3476746179 wait complete. 2021-10-21T00:12:29.152 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 74 2021-10-21T00:12:29.159 INFO:tasks.ceph.mds.a:Restarting daemon 2021-10-21T00:12:29.160 INFO:tasks.ceph.mds.a:Stopping old one... 2021-10-21T00:12:29.161 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:12:29.161 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:12:29.161 INFO:tasks.ceph.mds.b:Restarting daemon 2021-10-21T00:12:29.162 INFO:tasks.ceph.mds.b:Stopping old one... 2021-10-21T00:12:29.162 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:12:29.162 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:12:29.177 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:12:29.178 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-10-21T00:12:29.180 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:12:29.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-10-21T00:12:29.185 INFO:tasks.ceph.mds.a:Started 2021-10-21T00:12:29.186 DEBUG:teuthology.parallel:result is None 2021-10-21T00:12:29.188 INFO:tasks.ceph.mds.b:Started 2021-10-21T00:12:29.188 DEBUG:teuthology.parallel:result is None 2021-10-21T00:12:29.189 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-10-21T00:12:29.190 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:29.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:29.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:29.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:29.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:29.256 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2021-10-21T00:12:29.259 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:12:29.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.280+0000 7f4e29ff4700 1 Processor -- start 2021-10-21T00:12:29.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.280+0000 7f4e29ff4700 1 -- start start 2021-10-21T00:12:29.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e29ff4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4e24062f70 0x7f4e2405c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e29ff4700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2405bd40 con 0x7f4e240b3a20 2021-10-21T00:12:29.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e29ff4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2405bf70 con 0x7f4e24062330 2021-10-21T00:12:29.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e29ff4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e24142cb0 con 0x7f4e24062f70 2021-10-21T00:12:29.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e297f3700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4e240b3a20 0x7f4e2413c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36396/0 (socket says 172.21.15.41:36396) 2021-10-21T00:12:29.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e297f3700 1 -- 172.21.15.41:0/2303437540 learned_addr learned my addr 172.21.15.41:0/2303437540 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:29.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e23fff700 1 --2- 172.21.15.41:0/2303437540 >> v2:172.21.15.62:3300/0 conn(0x7f4e24062f70 0x7f4e2405c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217644770 0 0) 0x7f4e2405bd40 con 0x7f4e240b3a20 2021-10-21T00:12:29.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e04003260 con 0x7f4e240b3a20 2021-10-21T00:12:29.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892567316 0 0) 0x7f4e04003260 con 0x7f4e240b3a20 2021-10-21T00:12:29.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 >> v2:172.21.15.62:3300/0 conn(0x7f4e24062f70 msgr2=0x7f4e2405c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:29.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 --2- 172.21.15.41:0/2303437540 >> v2:172.21.15.62:3300/0 conn(0x7f4e24062f70 0x7f4e2405c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 >> v1:172.21.15.62:6789/0 conn(0x7f4e24062330 legacy=0x7f4e240b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24142950 con 0x7f4e240b3a20 2021-10-21T00:12:29.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f4e14001660 con 0x7f4e240b3a20 2021-10-21T00:12:29.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 >> v1:172.21.15.41:6789/0 conn(0x7f4e240b3a20 legacy=0x7f4e2413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e04003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e04004500 0x7f4e04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e04004e70 0x7f4e0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24142cb0 con 0x7f4e04004500 2021-10-21T00:12:29.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0400bd20 con 0x7f4e04004e70 2021-10-21T00:12:29.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0400bee0 con 0x7f4e04003750 2021-10-21T00:12:29.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e04003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e297f3700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e04004e70 0x7f4e0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 -- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e04004e70 msgr2=0x7f4e0400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:29.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e04004e70 0x7f4e0400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 -- 172.21.15.41:0/2303437540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e04004500 msgr2=0x7f4e04004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:29.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e04004500 0x7f4e04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-10-21T00:12:29.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 -- 172.21.15.41:0/2303437540 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04003260 con 0x7f4e04003750 2021-10-21T00:12:29.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e297f3700 1 -- 172.21.15.41:0/2303437540 reap_dead start 2021-10-21T00:12:29.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e04003b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f4e240b6d90 tx=0x7f4e1c007d80).ready entity=mon.2 client_cookie=292c759da73c48 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:29.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c001620 con 0x7f4e04003750 2021-10-21T00:12:29.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c006890 con 0x7f4e04003750 2021-10-21T00:12:29.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.284+0000 7f4e237fe700 1 -- 172.21.15.41:0/2303437540 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c006bf0 con 0x7f4e04003750 2021-10-21T00:12:29.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 msgr2=0x7f4e04003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e04003b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f4e240b6d90 tx=0x7f4e1c007d80).stop 2021-10-21T00:12:29.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2303437540 shutdown_connections 2021-10-21T00:12:29.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2303437540 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e04003b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2303437540 >> 172.21.15.41:0/2303437540 conn(0x7f4e240b9080 msgr2=0x7f4e240b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:29.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2303437540 shutdown_connections 2021-10-21T00:12:29.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2303437540 wait complete. 2021-10-21T00:12:29.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 Processor -- start 2021-10-21T00:12:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- start start 2021-10-21T00:12:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e240ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24141340 0x7f4e24151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240acf00 con 0x7f4e240addc0 2021-10-21T00:12:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240ae850 con 0x7f4e24141340 2021-10-21T00:12:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240ac920 con 0x7f4e04003750 2021-10-21T00:12:29.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38636/0 (socket says 172.21.15.41:38636) 2021-10-21T00:12:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 -- 172.21.15.41:0/2038500581 learned_addr learned my addr 172.21.15.41:0/2038500581 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e240ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e297f3700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24141340 0x7f4e24151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 -- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 msgr2=0x7f4e240ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e240ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 -- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24141340 msgr2=0x7f4e24151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:29.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24141340 0x7f4e24151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:29.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 -- 172.21.15.41:0/2038500581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e241145b0 con 0x7f4e240addc0 2021-10-21T00:12:29.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e23fff700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f4e0c00c000 tx=0x7f4e0c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:29.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c016070 con 0x7f4e240addc0 2021-10-21T00:12:29.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c000e90 con 0x7f4e240addc0 2021-10-21T00:12:29.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e240acb80 con 0x7f4e240addc0 2021-10-21T00:12:29.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0c010970 con 0x7f4e240addc0 2021-10-21T00:12:29.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.288+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e241417d0 con 0x7f4e240addc0 2021-10-21T00:12:29.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e240ae9c0 con 0x7f4e240addc0 2021-10-21T00:12:29.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e0c010ad0 con 0x7f4e240addc0 2021-10-21T00:12:29.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e21ffb700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 0x7f4e08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:29.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4e0c06b3a0 con 0x7f4e240addc0 2021-10-21T00:12:29.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 0x7f4e08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:29.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.292+0000 7f4e28ff2700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 0x7f4e08055ad0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f4e1c01b000 tx=0x7f4e1c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:29.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.300+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e240ae9c0 con 0x7f4e240addc0 2021-10-21T00:12:29.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:29.440+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4e240ae9c0 con 0x7f4e240addc0 2021-10-21T00:12:30.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.292+0000 7f4e21ffb700 1 -- 172.21.15.41:0/2038500581 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v141) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e240ae9c0 con 0x7f4e240addc0 2021-10-21T00:12:30.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 msgr2=0x7f4e08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 0x7f4e08055ad0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f4e1c01b000 tx=0x7f4e1c016000).stop 2021-10-21T00:12:30.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 msgr2=0x7f4e24140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f4e0c00c000 tx=0x7f4e0c006df0).stop 2021-10-21T00:12:30.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 shutdown_connections 2021-10-21T00:12:30.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4e08053610 0x7f4e08055ad0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24141340 0x7f4e24151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4e240addc0 0x7f4e24140e50 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 --2- 172.21.15.41:0/2038500581 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e04003750 0x7f4e240ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 >> 172.21.15.41:0/2038500581 conn(0x7f4e240b9080 msgr2=0x7f4e240aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:30.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 shutdown_connections 2021-10-21T00:12:30.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.296+0000 7f4e29ff4700 1 -- 172.21.15.41:0/2038500581 wait complete. 2021-10-21T00:12:30.309 INFO:teuthology.orchestra.run.smithi041.stderr: removed all blacklist entries 2021-10-21T00:12:30.322 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-10-21T00:12:30.323 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-10-21T00:12:30.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 Processor -- start 2021-10-21T00:12:30.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 -- start start 2021-10-21T00:12:30.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03d814fc90 0x7f03d8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80609d0 con 0x7f03d805f9f0 2021-10-21T00:12:30.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d805fdd0 con 0x7f03d80aa750 2021-10-21T00:12:30.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03df926700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80b1620 con 0x7f03d814fc90 2021-10-21T00:12:30.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03dd6c2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f03d805f9f0 0x7f03d814a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36414/0 (socket says 172.21.15.41:36414) 2021-10-21T00:12:30.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03dd6c2700 1 -- 172.21.15.41:0/1011411131 learned_addr learned my addr 172.21.15.41:0/1011411131 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:30.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03ddec3700 1 --2- 172.21.15.41:0/1011411131 >> v2:172.21.15.62:3300/0 conn(0x7f03d814fc90 0x7f03d8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889740982 0 0) 0x7f03d80609d0 con 0x7f03d805f9f0 2021-10-21T00:12:30.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03bc003260 con 0x7f03d805f9f0 2021-10-21T00:12:30.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278418122 0 0) 0x7f03d805fdd0 con 0x7f03d80aa750 2021-10-21T00:12:30.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d80609d0 con 0x7f03d80aa750 2021-10-21T00:12:30.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3012844314 0 0) 0x7f03bc003260 con 0x7f03d805f9f0 2021-10-21T00:12:30.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03ddec3700 1 -- 172.21.15.41:0/1011411131 >> v1:172.21.15.62:6789/0 conn(0x7f03d80aa750 legacy=0x7f03d814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03ddec3700 1 -- 172.21.15.41:0/1011411131 >> v1:172.21.15.41:6789/0 conn(0x7f03d805f9f0 legacy=0x7f03d814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03ddec3700 1 -- 172.21.15.41:0/1011411131 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d814b570 con 0x7f03d814fc90 2021-10-21T00:12:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03ddec3700 1 --2- 172.21.15.41:0/1011411131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d814fc90 0x7f03d8152080 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f03d4001110 tx=0x7f03d00091d0).ready entity=mon.1 client_cookie=808cf9b9cc8c6b86 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d4001680 con 0x7f03d814fc90 2021-10-21T00:12:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000f510 con 0x7f03d814fc90 2021-10-21T00:12:30.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.468+0000 7f03cffff700 1 -- 172.21.15.41:0/1011411131 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d000f680 con 0x7f03d814fc90 2021-10-21T00:12:30.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- 172.21.15.41:0/1011411131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d814fc90 msgr2=0x7f03d8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 --2- 172.21.15.41:0/1011411131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d814fc90 0x7f03d8152080 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f03d4001110 tx=0x7f03d00091d0).stop 2021-10-21T00:12:30.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- 172.21.15.41:0/1011411131 shutdown_connections 2021-10-21T00:12:30.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 --2- 172.21.15.41:0/1011411131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d814fc90 0x7f03d8152080 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- 172.21.15.41:0/1011411131 >> 172.21.15.41:0/1011411131 conn(0x7f03d805bca0 msgr2=0x7f03d805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:30.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- 172.21.15.41:0/1011411131 shutdown_connections 2021-10-21T00:12:30.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- 172.21.15.41:0/1011411131 wait complete. 2021-10-21T00:12:30.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 Processor -- start 2021-10-21T00:12:30.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- start start 2021-10-21T00:12:30.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 0x7f03d80ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03d814fc90 0x7f03d80ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80af190 con 0x7f03d80aa750 2021-10-21T00:12:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d809a140 con 0x7f03d805f9f0 2021-10-21T00:12:30.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.472+0000 7f03df926700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80aecf0 con 0x7f03d814fc90 2021-10-21T00:12:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dd6c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 0x7f03d80ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dd6c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 0x7f03d80ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50566/0 (socket says 172.21.15.41:50566) 2021-10-21T00:12:30.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38650/0 (socket says 172.21.15.41:38650) 2021-10-21T00:12:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dd6c2700 1 -- 172.21.15.41:0/3625014186 learned_addr learned my addr 172.21.15.41:0/3625014186 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03ddec3700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03d814fc90 0x7f03d80ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 -- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03d814fc90 msgr2=0x7f03d80ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03d814fc90 0x7f03d80ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 -- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 msgr2=0x7f03d80ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 0x7f03d80ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 -- 172.21.15.41:0/3625014186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0009470 con 0x7f03d80aa750 2021-10-21T00:12:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03dcec1700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f03c8001110 tx=0x7f03c8007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c8012400 con 0x7f03d80aa750 2021-10-21T00:12:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8012560 con 0x7f03d80aa750 2021-10-21T00:12:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80ae940 con 0x7f03d80aa750 2021-10-21T00:12:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c80128c0 con 0x7f03d80aa750 2021-10-21T00:12:30.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d80992e0 con 0x7f03d80aa750 2021-10-21T00:12:30.495 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.476+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d8098e00 con 0x7f03d80aa750 2021-10-21T00:12:30.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.480+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03c8019030 con 0x7f03d80aa750 2021-10-21T00:12:30.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.480+0000 7f03ce7fc700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 0x7f03c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.480+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f03c806a910 con 0x7f03d80aa750 2021-10-21T00:12:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.480+0000 7f03dd6c2700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 0x7f03c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.480+0000 7f03dd6c2700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 0x7f03c0055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f03d400d000 tx=0x7f03d4000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.497 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.484+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03d8098e00 con 0x7f03d80aa750 2021-10-21T00:12:30.659 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.648+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f03d8098e00 con 0x7f03d80aa750 2021-10-21T00:12:30.660 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03ce7fc700 1 -- 172.21.15.41:0/3625014186 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v44) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f03d8098e00 con 0x7f03d80aa750 2021-10-21T00:12:30.661 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:30.661 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:30.661 INFO:teuthology.orchestra.run.smithi041.stdout: "auth_dump": [ 2021-10-21T00:12:30.661 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.662 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.a", 2021-10-21T00:12:30.662 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhtQJ5IhAAZ/IQv2BUGm01zGfn01PvRg==", 2021-10-21T00:12:30.662 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.662 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:30.663 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.663 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.663 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.663 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.664 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.664 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.664 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mds.b", 2021-10-21T00:12:30.664 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhmXz3KBAAEO6BGuqO/fLqVNj5QYXwAg==", 2021-10-21T00:12:30.664 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.665 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:30.665 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.665 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.665 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.666 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.666 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.666 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.666 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.0", 2021-10-21T00:12:30.666 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBh70MTHhAAhpMLTCmsEg7KpisQEouXOQ==", 2021-10-21T00:12:30.667 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.667 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.667 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.667 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.668 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.668 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.668 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.668 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.1", 2021-10-21T00:12:30.668 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAXrnBhP/UnORAAfVeavMA8FlFfU28oh5fePQ==", 2021-10-21T00:12:30.669 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.669 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.669 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.669 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.669 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.670 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.670 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.670 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.2", 2021-10-21T00:12:30.670 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBhq0fQFBAAoeBCmtY4hulmfq5K1I9zGA==", 2021-10-21T00:12:30.671 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.671 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.671 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.671 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.671 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.672 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.672 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.672 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.3", 2021-10-21T00:12:30.672 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAYrnBh9WrxIhAAo5BamE+Kkv449BcNiMZA8g==", 2021-10-21T00:12:30.673 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.673 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.673 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.673 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.673 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.674 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.674 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.674 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.4", 2021-10-21T00:12:30.674 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhcBUjHBAAugVNPrxOVJP0CuBKmlfx1g==", 2021-10-21T00:12:30.675 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.675 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.675 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.675 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.675 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.676 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.676 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.676 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.5", 2021-10-21T00:12:30.676 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAbrnBhp5X8MBAA/J1DTrqi3u/ZYjkWFkYCPw==", 2021-10-21T00:12:30.677 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.677 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.677 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.677 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.678 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.678 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.678 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.678 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.6", 2021-10-21T00:12:30.679 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhoxmOEBAA1Se5n7BlvXdzFBQU5FxXmQ==", 2021-10-21T00:12:30.679 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.679 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.679 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.679 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.680 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.680 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.680 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.680 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "osd.7", 2021-10-21T00:12:30.681 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAcrnBhPaLsMxAANbKy2AKhVNI5ln43xpZOEA==", 2021-10-21T00:12:30.681 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.681 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.681 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.681 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.682 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.682 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.682 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.682 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.0", 2021-10-21T00:12:30.682 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhCeCSLRAAvEXtCi46JmBwNxf7NFIoyg==", 2021-10-21T00:12:30.683 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.683 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:30.683 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:30.684 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:30.684 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.684 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.684 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.684 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.1", 2021-10-21T00:12:30.685 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhvRgEMxAAxLFg7oIyoKhyGY07xVQJsA==", 2021-10-21T00:12:30.685 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.685 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:30.685 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:30.686 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:30.686 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.686 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.686 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.686 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.2", 2021-10-21T00:12:30.687 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhZp1INxAAdAvjY8QzN6VuCUE/X4Ru8A==", 2021-10-21T00:12:30.687 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.687 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow", 2021-10-21T00:12:30.687 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow r", 2021-10-21T00:12:30.688 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow rw pool=cephfs_data" 2021-10-21T00:12:30.688 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.688 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.688 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.688 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "client.admin", 2021-10-21T00:12:30.689 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhlPjIABAAIhEVf90XV6kIZpmOr0/JJQ==", 2021-10-21T00:12:30.689 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.689 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:30.689 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr": "allow *", 2021-10-21T00:12:30.689 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow *", 2021-10-21T00:12:30.690 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.690 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.690 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.690 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.691 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.x", 2021-10-21T00:12:30.691 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBhv3isHxAAvvkNwJgwE/estnBFE+MEgw==", 2021-10-21T00:12:30.691 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.691 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:30.691 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:12:30.692 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.692 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.692 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:30.692 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:30.693 INFO:teuthology.orchestra.run.smithi041.stdout: "entity": "mgr.y", 2021-10-21T00:12:30.693 INFO:teuthology.orchestra.run.smithi041.stdout: "key": "AQAUrnBh45N6GxAA4dOzMNFqAAggDBPifcSyGg==", 2021-10-21T00:12:30.693 INFO:teuthology.orchestra.run.smithi041.stdout: "caps": { 2021-10-21T00:12:30.693 INFO:teuthology.orchestra.run.smithi041.stdout: "mds": "allow *", 2021-10-21T00:12:30.693 INFO:teuthology.orchestra.run.smithi041.stdout: "mon": "allow profile mgr", 2021-10-21T00:12:30.694 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": "allow *" 2021-10-21T00:12:30.694 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.694 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:30.694 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:30.694 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:30.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 msgr2=0x7f03c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 0x7f03c0055ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f03d400d000 tx=0x7f03d4000bc0).stop 2021-10-21T00:12:30.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 msgr2=0x7f03d80ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.697 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f03c8001110 tx=0x7f03c8007a20).stop 2021-10-21T00:12:30.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 shutdown_connections 2021-10-21T00:12:30.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f03c0053610 0x7f03c0055ad0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03d814fc90 0x7f03d80ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f03d80aa750 0x7f03d80ad950 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.698 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 --2- 172.21.15.41:0/3625014186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d805f9f0 0x7f03d80ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 >> 172.21.15.41:0/3625014186 conn(0x7f03d805bca0 msgr2=0x7f03d80b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:30.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 shutdown_connections 2021-10-21T00:12:30.699 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.652+0000 7f03df926700 1 -- 172.21.15.41:0/3625014186 wait complete. 2021-10-21T00:12:30.700 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:30.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.792+0000 7ff3aca95700 1 Processor -- start 2021-10-21T00:12:30.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.792+0000 7ff3aca95700 1 -- start start 2021-10-21T00:12:30.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3a805f9f0 0x7ff3a814a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff3a814b350 0x7ff3a80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a80609d0 con 0x7ff3a80aa750 2021-10-21T00:12:30.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a80b1620 con 0x7ff3a814b350 2021-10-21T00:12:30.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a805fdd0 con 0x7ff3a805f9f0 2021-10-21T00:12:30.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff3a814b350 0x7ff3a80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7ff3a814b350 0x7ff3a80af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38660/0 (socket says 172.21.15.41:38660) 2021-10-21T00:12:30.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 -- 172.21.15.41:0/881364493 learned_addr learned my addr 172.21.15.41:0/881364493 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:30.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a659c700 1 --2- 172.21.15.41:0/881364493 >> v2:172.21.15.62:3300/0 conn(0x7ff3a805f9f0 0x7ff3a814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 -- 172.21.15.41:0/881364493 >> v2:172.21.15.62:3300/0 conn(0x7ff3a805f9f0 msgr2=0x7ff3a814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:30.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 --2- 172.21.15.41:0/881364493 >> v2:172.21.15.62:3300/0 conn(0x7ff3a805f9f0 0x7ff3a814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 -- 172.21.15.41:0/881364493 >> v1:172.21.15.62:6789/0 conn(0x7ff3a80aa750 legacy=0x7ff3a814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 -- 172.21.15.41:0/881364493 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80b1380 con 0x7ff3a814b350 2021-10-21T00:12:30.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a559a700 1 -- 172.21.15.41:0/881364493 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827186243 0 0) 0x7ff3a80609d0 con 0x7ff3a80aa750 2021-10-21T00:12:30.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a6d9d700 1 --2- 172.21.15.41:0/881364493 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a814b350 0x7ff3a80af7c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7ff3a0002f70 tx=0x7ff3a0006eb0).ready entity=mon.0 client_cookie=167ca486c838fcbe server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a559a700 1 -- 172.21.15.41:0/881364493 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a000d5c0 con 0x7ff3a814b350 2021-10-21T00:12:30.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a559a700 1 -- 172.21.15.41:0/881364493 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0000e90 con 0x7ff3a814b350 2021-10-21T00:12:30.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3a559a700 1 -- 172.21.15.41:0/881364493 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a000d910 con 0x7ff3a814b350 2021-10-21T00:12:30.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- 172.21.15.41:0/881364493 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a814b350 msgr2=0x7ff3a80af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 --2- 172.21.15.41:0/881364493 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a814b350 0x7ff3a80af7c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7ff3a0002f70 tx=0x7ff3a0006eb0).stop 2021-10-21T00:12:30.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- 172.21.15.41:0/881364493 shutdown_connections 2021-10-21T00:12:30.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 --2- 172.21.15.41:0/881364493 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a814b350 0x7ff3a80af7c0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 --2- 172.21.15.41:0/881364493 >> v2:172.21.15.62:3300/0 conn(0x7ff3a805f9f0 0x7ff3a814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- 172.21.15.41:0/881364493 >> 172.21.15.41:0/881364493 conn(0x7ff3a805bca0 msgr2=0x7ff3a805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:30.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- 172.21.15.41:0/881364493 shutdown_connections 2021-10-21T00:12:30.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.796+0000 7ff3aca95700 1 -- 172.21.15.41:0/881364493 wait complete. 2021-10-21T00:12:30.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 Processor -- start 2021-10-21T00:12:30.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- start start 2021-10-21T00:12:30.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3a814b350 0x7ff3a80ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a81467a0 con 0x7ff3a80aa750 2021-10-21T00:12:30.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80ac540 con 0x7ff3a805f9f0 2021-10-21T00:12:30.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8145d30 con 0x7ff3a814b350 2021-10-21T00:12:30.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50580/0 (socket says 172.21.15.41:50580) 2021-10-21T00:12:30.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a6d9d700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3a814b350 0x7ff3a80ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38666/0 (socket says 172.21.15.41:38666) 2021-10-21T00:12:30.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a659c700 1 -- 172.21.15.41:0/1416556495 learned_addr learned my addr 172.21.15.41:0/1416556495 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:30.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 -- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3a814b350 msgr2=0x7ff3a80ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3a814b350 0x7ff3a80ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 -- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 msgr2=0x7ff3a8159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 -- 172.21.15.41:0/1416556495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a000b1e0 con 0x7ff3a80aa750 2021-10-21T00:12:30.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a659c700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:30.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3a5d9b700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7ff3a80ac680 tx=0x7ff398007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39800f470 con 0x7ff3a80aa750 2021-10-21T00:12:30.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800f5d0 con 0x7ff3a80aa750 2021-10-21T00:12:30.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a8145fd0 con 0x7ff3a80aa750 2021-10-21T00:12:30.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff39800f930 con 0x7ff3a80aa750 2021-10-21T00:12:30.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.800+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8099460 con 0x7ff3a80aa750 2021-10-21T00:12:30.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a8098870 con 0x7ff3a80aa750 2021-10-21T00:12:30.822 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff398019030 con 0x7ff3a80aa750 2021-10-21T00:12:30.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3977fe700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 0x7ff384055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:30.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff39806aaa0 con 0x7ff3a80aa750 2021-10-21T00:12:30.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3a659c700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 0x7ff384055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:30.823 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.804+0000 7ff3a659c700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 0x7ff384055b90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7ff39c00b000 tx=0x7ff39c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:30.824 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.812+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3a8098870 con 0x7ff3a80aa750 2021-10-21T00:12:30.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3a8098870 con 0x7ff3a80aa750 2021-10-21T00:12:30.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3977fe700 1 -- 172.21.15.41:0/1416556495 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+13191 (secure 0 0 0) 0x7ff3a8098870 con 0x7ff3a80aa750 2021-10-21T00:12:30.950 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:30.951 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":141,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:30.289153+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:30.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 msgr2=0x7ff384055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 0x7ff384055b90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7ff39c00b000 tx=0x7ff39c006df0).stop 2021-10-21T00:12:30.953 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 msgr2=0x7ff3a8143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:30.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7ff3a80ac680 tx=0x7ff398007d80).stop 2021-10-21T00:12:30.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 shutdown_connections 2021-10-21T00:12:30.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7ff3840536d0 0x7ff384055b90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.954 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff3a814b350 0x7ff3a80ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7ff3a80aa750 0x7ff3a8143950 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 --2- 172.21.15.41:0/1416556495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3a805f9f0 0x7ff3a8159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:30.955 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 >> 172.21.15.41:0/1416556495 conn(0x7ff3a805bca0 msgr2=0x7ff3a805c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:30.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 shutdown_connections 2021-10-21T00:12:30.956 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:30.940+0000 7ff3aca95700 1 -- 172.21.15.41:0/1416556495 wait complete. 2021-10-21T00:12:30.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-10-21T00:12:30.964 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:31.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 Processor -- start 2021-10-21T00:12:31.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 -- start start 2021-10-21T00:12:31.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b2170 0x7fe1ec099b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe1ec0af620 0x7fe1ec140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0b1560 con 0x7fe1ec09ab50 2021-10-21T00:12:31.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec0b2550 con 0x7fe1ec0af620 2021-10-21T00:12:31.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1eb59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec09a170 con 0x7fe1ec0b2170 2021-10-21T00:12:31.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe1ec0af620 0x7fe1ec140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe1ec0af620 0x7fe1ec140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38672/0 (socket says 172.21.15.41:38672) 2021-10-21T00:12:31.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 -- 172.21.15.41:0/3420689827 learned_addr learned my addr 172.21.15.41:0/3420689827 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ea59c700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b2170 0x7fe1ec099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 -- 172.21.15.41:0/3420689827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b2170 msgr2=0x7fe1ec099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:31.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b2170 0x7fe1ec099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.084 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 -- 172.21.15.41:0/3420689827 >> v1:172.21.15.62:6789/0 conn(0x7fe1ec09ab50 legacy=0x7fe1ec13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 -- 172.21.15.41:0/3420689827 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec09a410 con 0x7fe1ec0af620 2021-10-21T00:12:31.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1ead9d700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0af620 0x7fe1ec140210 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe1e40032f0 tx=0x7fe1e4009290).ready entity=mon.0 client_cookie=4527b5174f266b2e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1e959a700 1 -- 172.21.15.41:0/3420689827 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e400b8a0 con 0x7fe1ec0af620 2021-10-21T00:12:31.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1e959a700 1 -- 172.21.15.41:0/3420689827 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e400ba00 con 0x7fe1ec0af620 2021-10-21T00:12:31.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.068+0000 7fe1e959a700 1 -- 172.21.15.41:0/3420689827 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e400bb70 con 0x7fe1ec0af620 2021-10-21T00:12:31.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- 172.21.15.41:0/3420689827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0af620 msgr2=0x7fe1ec140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0af620 0x7fe1ec140210 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fe1e40032f0 tx=0x7fe1e4009290).stop 2021-10-21T00:12:31.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- 172.21.15.41:0/3420689827 shutdown_connections 2021-10-21T00:12:31.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0af620 0x7fe1ec140210 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/3420689827 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b2170 0x7fe1ec099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- 172.21.15.41:0/3420689827 >> 172.21.15.41:0/3420689827 conn(0x7fe1ec0b5700 msgr2=0x7fe1ec0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- 172.21.15.41:0/3420689827 shutdown_connections 2021-10-21T00:12:31.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- 172.21.15.41:0/3420689827 wait complete. 2021-10-21T00:12:31.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 Processor -- start 2021-10-21T00:12:31.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- start start 2021-10-21T00:12:31.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0af620 0x7fe1ec142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec0b2170 0x7fe1ec0657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec063760 con 0x7fe1ec0671b0 2021-10-21T00:12:31.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec063a00 con 0x7fe1ec0b2170 2021-10-21T00:12:31.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1eb59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec063ca0 con 0x7fe1ec0af620 2021-10-21T00:12:31.094 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1ead9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1ead9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38680/0 (socket says 172.21.15.41:38680) 2021-10-21T00:12:31.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1ead9d700 1 -- 172.21.15.41:0/1128562013 learned_addr learned my addr 172.21.15.41:0/1128562013 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.095 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.072+0000 7fe1ea59c700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0af620 0x7fe1ec142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1e9d9b700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec0b2170 0x7fe1ec0657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 -- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0af620 msgr2=0x7fe1ec142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0af620 0x7fe1ec142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.096 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 -- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec0b2170 msgr2=0x7fe1ec0657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec0b2170 0x7fe1ec0657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 -- 172.21.15.41:0/1128562013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009530 con 0x7fe1ec0671b0 2021-10-21T00:12:31.097 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ead9d700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fe1e40032f0 tx=0x7fe1e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e400b8a0 con 0x7fe1ec0671b0 2021-10-21T00:12:31.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4021440 con 0x7fe1ec0671b0 2021-10-21T00:12:31.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec0ae410 con 0x7fe1ec0671b0 2021-10-21T00:12:31.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e40217a0 con 0x7fe1ec0671b0 2021-10-21T00:12:31.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec0ae890 con 0x7fe1ec0671b0 2021-10-21T00:12:31.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe1e4027020 con 0x7fe1ec0671b0 2021-10-21T00:12:31.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec09a6b0 con 0x7fe1ec0671b0 2021-10-21T00:12:31.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 0x7fe1c8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe1e406ccc0 con 0x7fe1ec0671b0 2021-10-21T00:12:31.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.076+0000 7fe1ea59c700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 0x7fe1c8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.080+0000 7fe1ea59c700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 0x7fe1c8055b90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fe1e000c000 tx=0x7fe1e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.084+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1e40440b0 con 0x7fe1ec0671b0 2021-10-21T00:12:31.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe1ec057350 con 0x7fe1ec0671b0 2021-10-21T00:12:31.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1db7fe700 1 -- 172.21.15.41:0/1128562013 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v141) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe1e4015070 con 0x7fe1ec0671b0 2021-10-21T00:12:31.223 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:31.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 msgr2=0x7fe1c8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 0x7fe1c8055b90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fe1e000c000 tx=0x7fe1e0008040).stop 2021-10-21T00:12:31.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 msgr2=0x7fe1ec0adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fe1e40032f0 tx=0x7fe1e4016000).stop 2021-10-21T00:12:31.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 shutdown_connections 2021-10-21T00:12:31.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe1c80536d0 0x7fe1c8055b90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe1ec0671b0 0x7fe1ec0adf20 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec0b2170 0x7fe1ec0657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 --2- 172.21.15.41:0/1128562013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0af620 0x7fe1ec142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 >> 172.21.15.41:0/1128562013 conn(0x7fe1ec0b5700 msgr2=0x7fe1ec05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 shutdown_connections 2021-10-21T00:12:31.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.212+0000 7fe1eb59e700 1 -- 172.21.15.41:0/1128562013 wait complete. 2021-10-21T00:12:31.235 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:31.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 Processor -- start 2021-10-21T00:12:31.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 -- start start 2021-10-21T00:12:31.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b1fd0 0x7f0de813fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0de80b0b40 0x7f0de80a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 0x7f0de8097f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de813f560 con 0x7f0de80b0b40 2021-10-21T00:12:31.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de813cfd0 con 0x7f0de80aa190 2021-10-21T00:12:31.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de813f790 con 0x7f0de80b1fd0 2021-10-21T00:12:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de5d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0de80b0b40 0x7f0de80a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de5d9b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0de80b0b40 0x7f0de80a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38686/0 (socket says 172.21.15.41:38686) 2021-10-21T00:12:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.340+0000 7f0de5d9b700 1 -- 172.21.15.41:0/3599616089 learned_addr learned my addr 172.21.15.41:0/3599616089 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de659c700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b1fd0 0x7f0de813fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de6d9d700 1 --2- 172.21.15.41:0/3599616089 >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 0x7f0de8097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 -- 172.21.15.41:0/3599616089 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b1fd0 msgr2=0x7f0de813fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b1fd0 0x7f0de813fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 -- 172.21.15.41:0/3599616089 >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 msgr2=0x7f0de8097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 --2- 172.21.15.41:0/3599616089 >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 0x7f0de8097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 -- 172.21.15.41:0/3599616089 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de813fa30 con 0x7f0de80b0b40 2021-10-21T00:12:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de6d9d700 1 --2- 172.21.15.41:0/3599616089 >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 0x7f0de8097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de5d9b700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b0b40 0x7f0de80a9ca0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f0dd8002f70 tx=0x7f0dd8006eb0).ready entity=mon.0 client_cookie=1dbb57bf760ebc01 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de559a700 1 -- 172.21.15.41:0/3599616089 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd800d570 con 0x7f0de80b0b40 2021-10-21T00:12:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de559a700 1 -- 172.21.15.41:0/3599616089 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd8000e90 con 0x7f0de80b0b40 2021-10-21T00:12:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de559a700 1 -- 172.21.15.41:0/3599616089 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd800d900 con 0x7f0de80b0b40 2021-10-21T00:12:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- 172.21.15.41:0/3599616089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b0b40 msgr2=0x7f0de80a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b0b40 0x7f0de80a9ca0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f0dd8002f70 tx=0x7f0dd8006eb0).stop 2021-10-21T00:12:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- 172.21.15.41:0/3599616089 shutdown_connections 2021-10-21T00:12:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b0b40 0x7f0de80a9ca0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 --2- 172.21.15.41:0/3599616089 >> v2:172.21.15.62:3300/0 conn(0x7f0de80aa190 0x7f0de8097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 --2- 172.21.15.41:0/3599616089 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b1fd0 0x7f0de813fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- 172.21.15.41:0/3599616089 >> 172.21.15.41:0/3599616089 conn(0x7f0de80b5700 msgr2=0x7f0de80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- 172.21.15.41:0/3599616089 shutdown_connections 2021-10-21T00:12:31.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- 172.21.15.41:0/3599616089 wait complete. 2021-10-21T00:12:31.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 Processor -- start 2021-10-21T00:12:31.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.344+0000 7f0de759e700 1 -- start start 2021-10-21T00:12:31.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de80aa190 0x7f0de80602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b0b40 0x7f0de8141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8067bf0 con 0x7f0de80b1fd0 2021-10-21T00:12:31.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8067950 con 0x7f0de80aa190 2021-10-21T00:12:31.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80aeb50 con 0x7f0de80b0b40 2021-10-21T00:12:31.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38694/0 (socket says 172.21.15.41:38694) 2021-10-21T00:12:31.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de80aa190 0x7f0de80602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 -- 172.21.15.41:0/849570003 learned_addr learned my addr 172.21.15.41:0/849570003 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de5d9b700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b0b40 0x7f0de8141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 -- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b0b40 msgr2=0x7f0de8141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b0b40 0x7f0de8141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 -- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de80aa190 msgr2=0x7f0de80602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de80aa190 0x7f0de80602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 -- 172.21.15.41:0/849570003 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0009470 con 0x7f0de80b1fd0 2021-10-21T00:12:31.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de6d9d700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f0de000c000 tx=0x7f0de00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de000c920 con 0x7f0de80b1fd0 2021-10-21T00:12:31.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000ca80 con 0x7f0de80b1fd0 2021-10-21T00:12:31.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de000cde0 con 0x7f0de80b1fd0 2021-10-21T00:12:31.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd800b1e0 con 0x7f0de80b1fd0 2021-10-21T00:12:31.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.348+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8142400 con 0x7f0de80b1fd0 2021-10-21T00:12:31.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de80aed10 con 0x7f0de80b1fd0 2021-10-21T00:12:31.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0de0022070 con 0x7f0de80b1fd0 2021-10-21T00:12:31.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0ddf7fe700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 0x7f0dcc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0de006c0a0 con 0x7f0de80b1fd0 2021-10-21T00:12:31.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0de659c700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 0x7f0dcc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.352+0000 7f0de659c700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 0x7f0dcc055a70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0dd000b000 tx=0x7f0dd0006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.356+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0de0043420 con 0x7f0de80b1fd0 2021-10-21T00:12:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.488+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0de80b1130 con 0x7f0de80b1fd0 2021-10-21T00:12:31.498 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.488+0000 7f0ddf7fe700 1 -- 172.21.15.41:0/849570003 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0de0016020 con 0x7f0de80b1fd0 2021-10-21T00:12:31.499 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:31.500 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 msgr2=0x7f0dcc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 0x7f0dcc055a70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0dd000b000 tx=0x7f0dd0006df0).stop 2021-10-21T00:12:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 msgr2=0x7f0de8141f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f0de000c000 tx=0x7f0de00091d0).stop 2021-10-21T00:12:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 shutdown_connections 2021-10-21T00:12:31.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0dcc0535b0 0x7f0dcc055a70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0de80b1fd0 0x7f0de8141f10 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0de80b0b40 0x7f0de8141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 --2- 172.21.15.41:0/849570003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0de80aa190 0x7f0de80602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 >> 172.21.15.41:0/849570003 conn(0x7f0de80b5700 msgr2=0x7f0de8099dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 shutdown_connections 2021-10-21T00:12:31.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.492+0000 7f0de759e700 1 -- 172.21.15.41:0/849570003 wait complete. 2021-10-21T00:12:31.511 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-10-21T00:12:31.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 Processor -- start 2021-10-21T00:12:31.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 -- start start 2021-10-21T00:12:31.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f66a8062330 0x7f66a80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a805bd40 con 0x7f66a80b3a20 2021-10-21T00:12:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a805bf70 con 0x7f66a8062330 2021-10-21T00:12:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66aca74700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8142cb0 con 0x7f66a8062f70 2021-10-21T00:12:31.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66a77fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f66a8062330 0x7f66a80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66a7fff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f66a80b3a20 0x7f66a813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36472/0 (socket says 172.21.15.41:36472) 2021-10-21T00:12:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.608+0000 7f66a7fff700 1 -- 172.21.15.41:0/544780850 learned_addr learned my addr 172.21.15.41:0/544780850 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a6ffd700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a77fe700 1 -- 172.21.15.41:0/544780850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 msgr2=0x7f66a805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a77fe700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a77fe700 1 -- 172.21.15.41:0/544780850 >> v1:172.21.15.41:6789/0 conn(0x7f66a80b3a20 legacy=0x7f66a813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a77fe700 1 -- 172.21.15.41:0/544780850 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8142950 con 0x7f66a8062330 2021-10-21T00:12:31.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a77fe700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a8062330 0x7f66a80b3f30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6698002f70 tx=0x7f6698006df0).ready entity=mon.0 client_cookie=173c2bfa01e5fdc0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a67fc700 1 -- 172.21.15.41:0/544780850 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669800d570 con 0x7f66a8062330 2021-10-21T00:12:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a67fc700 1 -- 172.21.15.41:0/544780850 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698000e90 con 0x7f66a8062330 2021-10-21T00:12:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66a67fc700 1 -- 172.21.15.41:0/544780850 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669800d8c0 con 0x7f66a8062330 2021-10-21T00:12:31.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- 172.21.15.41:0/544780850 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a8062330 msgr2=0x7f66a80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a8062330 0x7f66a80b3f30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6698002f70 tx=0x7f6698006df0).stop 2021-10-21T00:12:31.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- 172.21.15.41:0/544780850 shutdown_connections 2021-10-21T00:12:31.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 --2- 172.21.15.41:0/544780850 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a8062330 0x7f66a80b3f30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- 172.21.15.41:0/544780850 >> 172.21.15.41:0/544780850 conn(0x7f66a80b9080 msgr2=0x7f66a80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- 172.21.15.41:0/544780850 shutdown_connections 2021-10-21T00:12:31.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- 172.21.15.41:0/544780850 wait complete. 2021-10-21T00:12:31.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 Processor -- start 2021-10-21T00:12:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.612+0000 7f66aca74700 1 -- start start 2021-10-21T00:12:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66a8062330 0x7f66a8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a81527b0 con 0x7f66a80b3a20 2021-10-21T00:12:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8146890 con 0x7f66a8062330 2021-10-21T00:12:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a81529d0 con 0x7f66a8062f70 2021-10-21T00:12:31.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38708/0 (socket says 172.21.15.41:38708) 2021-10-21T00:12:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 -- 172.21.15.41:0/335656278 learned_addr learned my addr 172.21.15.41:0/335656278 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a6ffd700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a77fe700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66a8062330 0x7f66a8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 -- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 msgr2=0x7f66a81522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a81522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 -- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66a8062330 msgr2=0x7f66a8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66a8062330 0x7f66a8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 -- 172.21.15.41:0/335656278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669800b180 con 0x7f66a80b3a20 2021-10-21T00:12:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a7fff700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f66a80b6d90 tx=0x7f66a0007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66a0001d70 con 0x7f66a80b3a20 2021-10-21T00:12:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00070d0 con 0x7f66a80b3a20 2021-10-21T00:12:31.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8152c70 con 0x7f66a80b3a20 2021-10-21T00:12:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66a0007430 con 0x7f66a80b3a20 2021-10-21T00:12:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.616+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a81459b0 con 0x7f66a80b3a20 2021-10-21T00:12:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a8057350 con 0x7f66a80b3a20 2021-10-21T00:12:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66a001a060 con 0x7f66a80b3a20 2021-10-21T00:12:31.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66a4ff9700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 0x7f668c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f66a006ab00 con 0x7f66a80b3a20 2021-10-21T00:12:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66a77fe700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 0x7f668c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.620+0000 7f66a77fe700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 0x7f668c055b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f669801a000 tx=0x7f6698014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.628+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66a0041f90 con 0x7f66a80b3a20 2021-10-21T00:12:31.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.752+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66a805d080 con 0x7f66a80b3a20 2021-10-21T00:12:31.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66a4ff9700 1 -- 172.21.15.41:0/335656278 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v141) v1 ==== 84+0+143 (secure 0 0 0) 0x7f66a0018070 con 0x7f66a80b3a20 2021-10-21T00:12:31.764 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:31.764 INFO:teuthology.orchestra.run.smithi041.stdout:[ 2021-10-21T00:12:31.765 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:31.765 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 1, 2021-10-21T00:12:31.765 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "device_health_metrics" 2021-10-21T00:12:31.765 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:31.766 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:31.766 INFO:teuthology.orchestra.run.smithi041.stdout: "poolnum": 2, 2021-10-21T00:12:31.766 INFO:teuthology.orchestra.run.smithi041.stdout: "poolname": "rbd" 2021-10-21T00:12:31.766 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:31.767 INFO:teuthology.orchestra.run.smithi041.stdout:] 2021-10-21T00:12:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 msgr2=0x7f668c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 0x7f668c055b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f669801a000 tx=0x7f6698014000).stop 2021-10-21T00:12:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 msgr2=0x7f66a81151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f66a80b6d90 tx=0x7f66a0007c30).stop 2021-10-21T00:12:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 shutdown_connections 2021-10-21T00:12:31.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f668c053640 0x7f668c055b00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f66a80b3a20 0x7f66a81151b0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f66a8062f70 0x7f66a81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 --2- 172.21.15.41:0/335656278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66a8062330 0x7f66a8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 >> 172.21.15.41:0/335656278 conn(0x7f66a80b9080 msgr2=0x7f66a80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 shutdown_connections 2021-10-21T00:12:31.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.756+0000 7f66aca74700 1 -- 172.21.15.41:0/335656278 wait complete. 2021-10-21T00:12:31.777 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-10-21T00:12:31.777 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-10-21T00:12:31.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 Processor -- start 2021-10-21T00:12:31.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 -- start start 2021-10-21T00:12:31.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95cc0b2b20 0x7f95cc0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0b2f00 con 0x7f95cc142eb0 2021-10-21T00:12:31.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0b1360 con 0x7f95cc0b2b20 2021-10-21T00:12:31.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95d21ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0b1600 con 0x7f95cc0b0890 2021-10-21T00:12:31.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95caffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95cc0b2b20 0x7f95cc0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95caffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57210/0 (socket says 172.21.15.41:57210) 2021-10-21T00:12:31.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95caffd700 1 -- 172.21.15.41:0/448083722 learned_addr learned my addr 172.21.15.41:0/448083722 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cbfff700 1 --1- 172.21.15.41:0/448083722 >> v1:172.21.15.62:6789/0 conn(0x7f95cc142eb0 0x7f95cc143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44540/0 (socket says 172.21.15.41:44540) 2021-10-21T00:12:31.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 -- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 msgr2=0x7f95cc0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:31.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 -- 172.21.15.41:0/448083722 >> v1:172.21.15.62:6789/0 conn(0x7f95cc142eb0 legacy=0x7f95cc143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 -- 172.21.15.41:0/448083722 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0b18a0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95caffd700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:31.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.880+0000 7f95cb7fe700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b2b20 0x7f95cc0b35a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f95bc0032f0 tx=0x7f95bc0091d0).ready entity=mon.1 client_cookie=4a66b499101bd224 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95ca7fc700 1 -- 172.21.15.41:0/448083722 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95bc00b6c0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95ca7fc700 1 -- 172.21.15.41:0/448083722 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00b820 con 0x7f95cc0b2b20 2021-10-21T00:12:31.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95ca7fc700 1 -- 172.21.15.41:0/448083722 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95bc00b990 con 0x7f95cc0b2b20 2021-10-21T00:12:31.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b2b20 msgr2=0x7f95cc0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b2b20 0x7f95cc0b35a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f95bc0032f0 tx=0x7f95bc0091d0).stop 2021-10-21T00:12:31.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- 172.21.15.41:0/448083722 shutdown_connections 2021-10-21T00:12:31.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0b0890 0x7f95cc0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 --2- 172.21.15.41:0/448083722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b2b20 0x7f95cc0b35a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- 172.21.15.41:0/448083722 >> 172.21.15.41:0/448083722 conn(0x7f95cc0638b0 msgr2=0x7f95cc063cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:31.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- 172.21.15.41:0/448083722 shutdown_connections 2021-10-21T00:12:31.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- 172.21.15.41:0/448083722 wait complete. 2021-10-21T00:12:31.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 Processor -- start 2021-10-21T00:12:31.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.884+0000 7f95d21ca700 1 -- start start 2021-10-21T00:12:31.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 0x7f95cc13c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc142eb0 0x7f95cc13da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc152f50 con 0x7f95cc0b2b20 2021-10-21T00:12:31.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc13ef20 con 0x7f95cc0b0890 2021-10-21T00:12:31.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc152c70 con 0x7f95cc142eb0 2021-10-21T00:12:31.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95cb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 0x7f95cc13c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38720/0 (socket says 172.21.15.41:38720) 2021-10-21T00:12:31.908 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95cbfff700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc142eb0 0x7f95cc13da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 -- 172.21.15.41:0/2945553136 learned_addr learned my addr 172.21.15.41:0/2945553136 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:31.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 -- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc142eb0 msgr2=0x7f95cc13da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc142eb0 0x7f95cc13da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.909 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 -- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 msgr2=0x7f95cc13c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:31.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 0x7f95cc13c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:31.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 -- 172.21.15.41:0/2945553136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c000b1e0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95cb7fe700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 0x7f95cc13c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:31.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95caffd700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f95c000c000 tx=0x7f95c0006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c0012600 con 0x7f95cc0b2b20 2021-10-21T00:12:31.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0012760 con 0x7f95cc0b2b20 2021-10-21T00:12:31.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc009470 con 0x7f95cc0b2b20 2021-10-21T00:12:31.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95c0012ac0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.888+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc13f3c0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc13e540 con 0x7f95cc0b2b20 2021-10-21T00:12:31.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f95c0022070 con 0x7f95cc0b2b20 2021-10-21T00:12:31.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95c8ff9700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 0x7f95ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:31.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f95c006bbe0 con 0x7f95cc0b2b20 2021-10-21T00:12:31.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95cb7fe700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 0x7f95ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:31.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.892+0000 7f95cb7fe700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 0x7f95ac055ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f95bc01b000 tx=0x7f95bc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:31.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:31.896+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95c0042ee0 con 0x7f95cc0b2b20 2021-10-21T00:12:32.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.024+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f95cc13e880 con 0x7f95cc0b2b20 2021-10-21T00:12:32.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.900+0000 7f95c8ff9700 1 -- 172.21.15.41:0/2945553136 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v142) v1 ==== 133+0+0 (secure 0 0 0) 0x7f95c0046500 con 0x7f95cc0b2b20 2021-10-21T00:12:32.914 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 msgr2=0x7f95ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 0x7f95ac055ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f95bc01b000 tx=0x7f95bc016000).stop 2021-10-21T00:12:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 msgr2=0x7f95cc14ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f95c000c000 tx=0x7f95c0006eb0).stop 2021-10-21T00:12:32.915 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 shutdown_connections 2021-10-21T00:12:32.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f95ac053610 0x7f95ac055ad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:32.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc142eb0 0x7f95cc13da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:32.916 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f95cc0b2b20 0x7f95cc14ed00 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:32.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 --2- 172.21.15.41:0/2945553136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0b0890 0x7f95cc13c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:32.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 >> 172.21.15.41:0/2945553136 conn(0x7f95cc0638b0 msgr2=0x7f95cc140300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:32.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 shutdown_connections 2021-10-21T00:12:32.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:32.904+0000 7f95d21ca700 1 -- 172.21.15.41:0/2945553136 wait complete. 2021-10-21T00:12:32.919 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' created 2021-10-21T00:12:32.930 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-10-21T00:12:33.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.036+0000 7f756ba14700 1 Processor -- start 2021-10-21T00:12:33.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.036+0000 7f756ba14700 1 -- start start 2021-10-21T00:12:33.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640ad9d0 con 0x7f75640b1ba0 2021-10-21T00:12:33.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75640adfa0 con 0x7f75640b6130 2021-10-21T00:12:33.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75640b6510 con 0x7f7564143960 2021-10-21T00:12:33.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f75697b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57226/0 (socket says 172.21.15.41:57226) 2021-10-21T00:12:33.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7568faf700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75640b1ba0 0x7f7564143250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44552/0 (socket says 172.21.15.41:44552) 2021-10-21T00:12:33.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f75697b0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50642/0 (socket says 172.21.15.41:50642) 2021-10-21T00:12:33.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 -- 172.21.15.41:0/8428010 learned_addr learned my addr 172.21.15.41:0/8428010 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 -- 172.21.15.41:0/8428010 >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 msgr2=0x7f75640ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:33.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 --2- 172.21.15.41:0/8428010 >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 -- 172.21.15.41:0/8428010 >> v1:172.21.15.62:6789/0 conn(0x7f75640b1ba0 legacy=0x7f7564143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 -- 172.21.15.41:0/8428010 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564067480 con 0x7f7564143960 2021-10-21T00:12:33.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f75697b0700 1 --2- 172.21.15.41:0/8428010 >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:33.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7569fb1700 1 --2- 172.21.15.41:0/8428010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f755c0032f0 tx=0x7f755c00b530).ready entity=mon.2 client_cookie=961c9c4f0844015b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7553fff700 1 -- 172.21.15.41:0/8428010 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c00de20 con 0x7f7564143960 2021-10-21T00:12:33.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7553fff700 1 -- 172.21.15.41:0/8428010 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c010470 con 0x7f7564143960 2021-10-21T00:12:33.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f7553fff700 1 -- 172.21.15.41:0/8428010 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c0107d0 con 0x7f7564143960 2021-10-21T00:12:33.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- 172.21.15.41:0/8428010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 msgr2=0x7f756413ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 --2- 172.21.15.41:0/8428010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f755c0032f0 tx=0x7f755c00b530).stop 2021-10-21T00:12:33.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- 172.21.15.41:0/8428010 shutdown_connections 2021-10-21T00:12:33.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 --2- 172.21.15.41:0/8428010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7564143960 0x7f756413ea70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 --2- 172.21.15.41:0/8428010 >> v2:172.21.15.62:3300/0 conn(0x7f75640b6130 0x7f75640ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- 172.21.15.41:0/8428010 >> 172.21.15.41:0/8428010 conn(0x7f7564063b40 msgr2=0x7f75640b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- 172.21.15.41:0/8428010 shutdown_connections 2021-10-21T00:12:33.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.040+0000 7f756ba14700 1 -- 172.21.15.41:0/8428010 wait complete. 2021-10-21T00:12:33.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.044+0000 7f756ba14700 1 Processor -- start 2021-10-21T00:12:33.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.044+0000 7f756ba14700 1 -- start start 2021-10-21T00:12:33.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.044+0000 7f756ba14700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.044+0000 7f756ba14700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640b4d20 con 0x7f75640b6130 2021-10-21T00:12:33.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756414e170 con 0x7f7564143960 2021-10-21T00:12:33.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756414e390 con 0x7f75640b1ba0 2021-10-21T00:12:33.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75697b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7569fb1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38732/0 (socket says 172.21.15.41:38732) 2021-10-21T00:12:33.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 -- 172.21.15.41:0/3603222078 learned_addr learned my addr 172.21.15.41:0/3603222078 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7569fb1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50652/0 (socket says 172.21.15.41:50652) 2021-10-21T00:12:33.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75697b0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57228/0 (socket says 172.21.15.41:57228) 2021-10-21T00:12:33.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 -- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 msgr2=0x7f7564064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 -- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 msgr2=0x7f756409f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 -- 172.21.15.41:0/3603222078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756000b180 con 0x7f75640b6130 2021-10-21T00:12:33.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7569fb1700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:33.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75697b0700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:33.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f7568faf700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f756414e2b0 tx=0x7f7554007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75540070d0 con 0x7f75640b6130 2021-10-21T00:12:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554007230 con 0x7f75640b6130 2021-10-21T00:12:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c00b7d0 con 0x7f75640b6130 2021-10-21T00:12:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7554005550 con 0x7f75640b6130 2021-10-21T00:12:33.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756414e8d0 con 0x7f75640b6130 2021-10-21T00:12:33.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.048+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7564067720 con 0x7f75640b6130 2021-10-21T00:12:33.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.052+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7554010070 con 0x7f75640b6130 2021-10-21T00:12:33.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.052+0000 7f75527fc700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 0x7f75440559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.052+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f755406ad90 con 0x7f75640b6130 2021-10-21T00:12:33.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.052+0000 7f75697b0700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 0x7f75440559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.052+0000 7f75697b0700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 0x7f75440559e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f756000b000 tx=0x7f7560006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.056+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7554041ff0 con 0x7f75640b6130 2021-10-21T00:12:33.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.188+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7564057350 con 0x7f75640b6130 2021-10-21T00:12:33.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.304+0000 7f75527fc700 1 -- 172.21.15.41:0/3603222078 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v143) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7554045610 con 0x7f75640b6130 2021-10-21T00:12:33.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 msgr2=0x7f75440559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 0x7f75440559e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f756000b000 tx=0x7f7560006df0).stop 2021-10-21T00:12:33.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 msgr2=0x7f756414dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f756414e2b0 tx=0x7f7554007c40).stop 2021-10-21T00:12:33.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 shutdown_connections 2021-10-21T00:12:33.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7544053520 0x7f75440559e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7564143960 0x7f756409f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f75640b6130 0x7f756414dc80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 --2- 172.21.15.41:0/3603222078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75640b1ba0 0x7f7564064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 >> 172.21.15.41:0/3603222078 conn(0x7f7564063b40 msgr2=0x7f756413df00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 shutdown_connections 2021-10-21T00:12:33.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.308+0000 7f756ba14700 1 -- 172.21.15.41:0/3603222078 wait complete. 2021-10-21T00:12:33.321 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' created 2021-10-21T00:12:33.332 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-10-21T00:12:33.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.420+0000 7f7fd3143700 1 Processor -- start 2021-10-21T00:12:33.431 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.420+0000 7f7fd3143700 1 -- start start 2021-10-21T00:12:33.433 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fcc143a40 0x7f7fcc0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0ba050 con 0x7f7fcc0b0660 2021-10-21T00:12:33.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc146360 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc142bf0 con 0x7f7fcc143a40 2021-10-21T00:12:33.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd16e0700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f7fcc0b0660 0x7f7fcc1419c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36510/0 (socket says 172.21.15.41:36510) 2021-10-21T00:12:33.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd16e0700 1 -- 172.21.15.41:0/3221853619 learned_addr learned my addr 172.21.15.41:0/3221853619 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:33.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcbfff700 1 --2- 172.21.15.41:0/3221853619 >> v2:172.21.15.62:3300/0 conn(0x7f7fcc143a40 0x7f7fcc0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcb7fe700 1 -- 172.21.15.41:0/3221853619 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10845211 0 0) 0x7f7fcc0ba050 con 0x7f7fcc0b0660 2021-10-21T00:12:33.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcb7fe700 1 -- 172.21.15.41:0/3221853619 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb8003260 con 0x7f7fcc0b0660 2021-10-21T00:12:33.435 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcbfff700 1 -- 172.21.15.41:0/3221853619 >> v1:172.21.15.62:6789/0 conn(0x7f7fcc0b9c70 legacy=0x7f7fcc143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcbfff700 1 -- 172.21.15.41:0/3221853619 >> v1:172.21.15.41:6789/0 conn(0x7f7fcc0b0660 legacy=0x7f7fcc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcbfff700 1 -- 172.21.15.41:0/3221853619 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc142e90 con 0x7f7fcc143a40 2021-10-21T00:12:33.436 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcbfff700 1 --2- 172.21.15.41:0/3221853619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc0b3bc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7fcc0b5640 tx=0x7f7fbc006df0).ready entity=mon.1 client_cookie=ee73712100465d44 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcb7fe700 1 -- 172.21.15.41:0/3221853619 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc00d610 con 0x7f7fcc143a40 2021-10-21T00:12:33.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcb7fe700 1 -- 172.21.15.41:0/3221853619 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc000e90 con 0x7f7fcc143a40 2021-10-21T00:12:33.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fcb7fe700 1 -- 172.21.15.41:0/3221853619 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc00d960 con 0x7f7fcc143a40 2021-10-21T00:12:33.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- 172.21.15.41:0/3221853619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 msgr2=0x7f7fcc0b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 --2- 172.21.15.41:0/3221853619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc0b3bc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f7fcc0b5640 tx=0x7f7fbc006df0).stop 2021-10-21T00:12:33.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- 172.21.15.41:0/3221853619 shutdown_connections 2021-10-21T00:12:33.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 --2- 172.21.15.41:0/3221853619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc0b3bc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- 172.21.15.41:0/3221853619 >> 172.21.15.41:0/3221853619 conn(0x7f7fcc062f00 msgr2=0x7f7fcc0b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- 172.21.15.41:0/3221853619 shutdown_connections 2021-10-21T00:12:33.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.424+0000 7f7fd3143700 1 -- 172.21.15.41:0/3221853619 wait complete. 2021-10-21T00:12:33.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 Processor -- start 2021-10-21T00:12:33.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- start start 2021-10-21T00:12:33.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 0x7f7fcc0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.443 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0af5f0 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0ae660 con 0x7f7fcc143a40 2021-10-21T00:12:33.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0ae900 con 0x7f7fcc0b0660 2021-10-21T00:12:33.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38746/0 (socket says 172.21.15.41:38746) 2021-10-21T00:12:33.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 -- 172.21.15.41:0/1155497143 learned_addr learned my addr 172.21.15.41:0/1155497143 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd16e0700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd0edf700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 0x7f7fcc0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.445 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 -- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 msgr2=0x7f7fcc0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 0x7f7fcc0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 -- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 msgr2=0x7f7fcc142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.446 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 -- 172.21.15.41:0/1155497143 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc00b180 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd0edf700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 0x7f7fcc0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:33.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fcbfff700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f7fcc0b5640 tx=0x7f7fbc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc016070 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.447 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00de90 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- 172.21.15.41:0/1155497143 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0af2e0 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc013e90 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.448 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.428+0000 7f7fd3143700 1 -- 172.21.15.41:0/1155497143 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc0ac890 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fbc025030 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.449 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fd3143700 1 -- 172.21.15.41:0/1155497143 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0ae360 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fc9ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 0x7f7fac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7fbc06c8d0 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fd0edf700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 0x7f7fac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.450 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.432+0000 7f7fd0edf700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 0x7f7fac055ad0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7fc000b000 tx=0x7f7fc0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.436+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fbc043aa0 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.600+0000 7f7fd3143700 1 -- 172.21.15.41:0/1155497143 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7fcc057350 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.612+0000 7f7fc9ffb700 1 -- 172.21.15.41:0/1155497143 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v76) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7fbc023020 con 0x7f7fcc0b9c70 2021-10-21T00:12:33.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 msgr2=0x7f7fac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 0x7f7fac055ad0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7fc000b000 tx=0x7f7fc0009040).stop 2021-10-21T00:12:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 msgr2=0x7f7fcc141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f7fcc0b5640 tx=0x7f7fbc014000).stop 2021-10-21T00:12:33.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 shutdown_connections 2021-10-21T00:12:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fac053610 0x7f7fac055ad0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fcc143a40 0x7f7fcc142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f7fcc0b9c70 0x7f7fcc141d70 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 --2- 172.21.15.41:0/1155497143 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fcc0b0660 0x7f7fcc0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 >> 172.21.15.41:0/1155497143 conn(0x7f7fcc062f00 msgr2=0x7f7fcc0b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 shutdown_connections 2021-10-21T00:12:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.616+0000 7f7fb1ffb700 1 -- 172.21.15.41:0/1155497143 wait complete. 2021-10-21T00:12:33.629 INFO:teuthology.orchestra.run.smithi041.stderr:new fs with metadata pool 29 and data pool 30 2021-10-21T00:12:33.642 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:33.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.724+0000 7f48be86e700 1 Processor -- start 2021-10-21T00:12:33.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.724+0000 7f48be86e700 1 -- start start 2021-10-21T00:12:33.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 0x7f48b80ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80b0b50 con 0x7f48b80abb50 2021-10-21T00:12:33.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80b2550 con 0x7f48b80af620 2021-10-21T00:12:33.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80b0d90 con 0x7f48b80b2170 2021-10-21T00:12:33.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 0x7f48b80ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd06b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd06b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50678/0 (socket says 172.21.15.41:50678) 2021-10-21T00:12:33.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd06b700 1 -- 172.21.15.41:0/1650898923 learned_addr learned my addr 172.21.15.41:0/1650898923 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be06d700 1 --1- 172.21.15.41:0/1650898923 >> v1:172.21.15.62:6789/0 conn(0x7f48b80abb50 0x7f48b814a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44590/0 (socket says 172.21.15.41:44590) 2021-10-21T00:12:33.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bc86a700 1 -- 172.21.15.41:0/1650898923 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574316071 0 0) 0x7f48b0001490 con 0x7f48b80abb50 2021-10-21T00:12:33.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bc86a700 1 -- 172.21.15.41:0/1650898923 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a0003260 con 0x7f48b80abb50 2021-10-21T00:12:33.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 -- 172.21.15.41:0/1650898923 >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 msgr2=0x7f48b80ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:33.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 --2- 172.21.15.41:0/1650898923 >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 -- 172.21.15.41:0/1650898923 >> v1:172.21.15.62:6789/0 conn(0x7f48b80abb50 legacy=0x7f48b814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 -- 172.21.15.41:0/1650898923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80b1030 con 0x7f48b80b2170 2021-10-21T00:12:33.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd06b700 1 --2- 172.21.15.41:0/1650898923 >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:33.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bd86c700 1 --2- 172.21.15.41:0/1650898923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 0x7f48b80ab170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f48a8002f70 tx=0x7f48a8006df0).ready entity=mon.2 client_cookie=7f88d55fe2c26b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bc86a700 1 -- 172.21.15.41:0/1650898923 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a800d4a0 con 0x7f48b80b2170 2021-10-21T00:12:33.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bc86a700 1 -- 172.21.15.41:0/1650898923 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8000e90 con 0x7f48b80b2170 2021-10-21T00:12:33.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48bc86a700 1 -- 172.21.15.41:0/1650898923 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a800d7f0 con 0x7f48b80b2170 2021-10-21T00:12:33.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- 172.21.15.41:0/1650898923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 msgr2=0x7f48b80ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 --2- 172.21.15.41:0/1650898923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 0x7f48b80ab170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f48a8002f70 tx=0x7f48a8006df0).stop 2021-10-21T00:12:33.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- 172.21.15.41:0/1650898923 shutdown_connections 2021-10-21T00:12:33.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 --2- 172.21.15.41:0/1650898923 >> v2:172.21.15.62:3300/0 conn(0x7f48b80af620 0x7f48b80ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 --2- 172.21.15.41:0/1650898923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80b2170 0x7f48b80ab170 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- 172.21.15.41:0/1650898923 >> 172.21.15.41:0/1650898923 conn(0x7f48b80b5700 msgr2=0x7f48b80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- 172.21.15.41:0/1650898923 shutdown_connections 2021-10-21T00:12:33.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.728+0000 7f48be86e700 1 -- 172.21.15.41:0/1650898923 wait complete. 2021-10-21T00:12:33.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 Processor -- start 2021-10-21T00:12:33.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- start start 2021-10-21T00:12:33.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80abb50 0x7f48b80ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 0x7f48b8142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 0x7f48b8142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80ac680 con 0x7f48b80b2170 2021-10-21T00:12:33.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80ac920 con 0x7f48b80af620 2021-10-21T00:12:33.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81430f0 con 0x7f48b80abb50 2021-10-21T00:12:33.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 0x7f48b8142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48bd06b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 0x7f48b8142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48bd06b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 0x7f48b8142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50684/0 (socket says 172.21.15.41:50684) 2021-10-21T00:12:33.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48bd06b700 1 -- 172.21.15.41:0/244035126 learned_addr learned my addr 172.21.15.41:0/244035126 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48bd86c700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80abb50 0x7f48b80ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 -- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80abb50 msgr2=0x7f48b80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80abb50 0x7f48b80ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 -- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 msgr2=0x7f48b8142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 0x7f48b8142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 -- 172.21.15.41:0/244035126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b400b1e0 con 0x7f48b80b2170 2021-10-21T00:12:33.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be06d700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 0x7f48b8142c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f48b0001620 tx=0x7f48b0007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b0005ae0 con 0x7f48b80b2170 2021-10-21T00:12:33.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b0005c40 con 0x7f48b80b2170 2021-10-21T00:12:33.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a800b180 con 0x7f48b80b2170 2021-10-21T00:12:33.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b00070d0 con 0x7f48b80b2170 2021-10-21T00:12:33.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.732+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8146bc0 con 0x7f48b80b2170 2021-10-21T00:12:33.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.736+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b81563d0 con 0x7f48b80b2170 2021-10-21T00:12:33.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.736+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48b0010070 con 0x7f48b80b2170 2021-10-21T00:12:33.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.736+0000 7f48a6ffd700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 0x7f4898055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.736+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f48b006aec0 con 0x7f48b80b2170 2021-10-21T00:12:33.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.736+0000 7f48bd86c700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 0x7f4898055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.740+0000 7f48bd86c700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 0x7f4898055b60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f48a801a000 tx=0x7f48a8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:33.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.744+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48b0042020 con 0x7f48b80b2170 2021-10-21T00:12:33.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.872+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b80b0b50 con 0x7f48b80b2170 2021-10-21T00:12:33.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.872+0000 7f48a6ffd700 1 -- 172.21.15.41:0/244035126 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f48b80b0b50 con 0x7f48b80b2170 2021-10-21T00:12:33.883 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:33.884 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":144,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:33.607314+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:32.085660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:33.246025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:33.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 msgr2=0x7f4898055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 0x7f4898055b60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f48a801a000 tx=0x7f48a8014000).stop 2021-10-21T00:12:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 msgr2=0x7f48b8142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 0x7f48b8142c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f48b0001620 tx=0x7f48b0007b60).stop 2021-10-21T00:12:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 shutdown_connections 2021-10-21T00:12:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f48980536a0 0x7f4898055b60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f48b80b2170 0x7f48b8142c00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48b80af620 0x7f48b8142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 --2- 172.21.15.41:0/244035126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48b80abb50 0x7f48b80ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:33.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 >> 172.21.15.41:0/244035126 conn(0x7f48b80b5700 msgr2=0x7f48b805f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:33.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 shutdown_connections 2021-10-21T00:12:33.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.876+0000 7f48be86e700 1 -- 172.21.15.41:0/244035126 wait complete. 2021-10-21T00:12:33.897 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:33.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 Processor -- start 2021-10-21T00:12:33.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 -- start start 2021-10-21T00:12:33.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4dd40b1830 0x7f4dd405fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dd4140890 0x7f4dd4140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:33.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd40b4760 con 0x7f4dd40b4380 2021-10-21T00:12:33.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40ad4c0 con 0x7f4dd40b1830 2021-10-21T00:12:33.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.984+0000 7f4dd998b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40ad760 con 0x7f4dd4140890 2021-10-21T00:12:33.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4dd40b1830 0x7f4dd405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4dd40b1830 0x7f4dd405fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38776/0 (socket says 172.21.15.41:38776) 2021-10-21T00:12:33.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 -- 172.21.15.41:0/1043050340 learned_addr learned my addr 172.21.15.41:0/1043050340 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:33.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd918a700 1 --2- 172.21.15.41:0/1043050340 >> v2:172.21.15.62:3300/0 conn(0x7f4dd4140890 0x7f4dd4140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:33.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 -- 172.21.15.41:0/1043050340 >> v2:172.21.15.62:3300/0 conn(0x7f4dd4140890 msgr2=0x7f4dd4140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:34.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 --2- 172.21.15.41:0/1043050340 >> v2:172.21.15.62:3300/0 conn(0x7f4dd4140890 0x7f4dd4140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 -- 172.21.15.41:0/1043050340 >> v1:172.21.15.62:6789/0 conn(0x7f4dd40b4380 legacy=0x7f4dd405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 -- 172.21.15.41:0/1043050340 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40ada00 con 0x7f4dd40b1830 2021-10-21T00:12:34.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcbfff700 1 --2- 172.21.15.41:0/1043050340 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd405fed0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f4dc4002f70 tx=0x7f4dc4006eb0).ready entity=mon.0 client_cookie=cc38381bccf9ac6a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcb7fe700 1 -- 172.21.15.41:0/1043050340 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dc400d5c0 con 0x7f4dd40b1830 2021-10-21T00:12:34.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcb7fe700 1 -- 172.21.15.41:0/1043050340 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4000e90 con 0x7f4dd40b1830 2021-10-21T00:12:34.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dcb7fe700 1 -- 172.21.15.41:0/1043050340 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dc400d950 con 0x7f4dd40b1830 2021-10-21T00:12:34.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 -- 172.21.15.41:0/1043050340 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 msgr2=0x7f4dd405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 --2- 172.21.15.41:0/1043050340 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd405fed0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f4dc4002f70 tx=0x7f4dc4006eb0).stop 2021-10-21T00:12:34.005 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 -- 172.21.15.41:0/1043050340 shutdown_connections 2021-10-21T00:12:34.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 --2- 172.21.15.41:0/1043050340 >> v2:172.21.15.62:3300/0 conn(0x7f4dd4140890 0x7f4dd4140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 --2- 172.21.15.41:0/1043050340 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd405fed0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 -- 172.21.15.41:0/1043050340 >> 172.21.15.41:0/1043050340 conn(0x7f4dd40b7910 msgr2=0x7f4dd40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.006 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 -- 172.21.15.41:0/1043050340 shutdown_connections 2021-10-21T00:12:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.988+0000 7f4dd998b700 1 -- 172.21.15.41:0/1043050340 wait complete. 2021-10-21T00:12:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 Processor -- start 2021-10-21T00:12:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 -- start start 2021-10-21T00:12:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.007 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd40b4380 0x7f4dd409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dd4140890 0x7f4dd4061470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd4143d30 con 0x7f4dd40b1830 2021-10-21T00:12:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40633b0 con 0x7f4dd40b4380 2021-10-21T00:12:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd998b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd4144a50 con 0x7f4dd4140890 2021-10-21T00:12:34.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38780/0 (socket says 172.21.15.41:38780) 2021-10-21T00:12:34.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 -- 172.21.15.41:0/4149156809 learned_addr learned my addr 172.21.15.41:0/4149156809 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:34.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dcbfff700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd40b4380 0x7f4dd409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd918a700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dd4140890 0x7f4dd4061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 -- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dd4140890 msgr2=0x7f4dd4061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dd4140890 0x7f4dd4061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 -- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd40b4380 msgr2=0x7f4dd409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.010 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd40b4380 0x7f4dd409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 -- 172.21.15.41:0/4149156809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc400b1e0 con 0x7f4dd40b1830 2021-10-21T00:12:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.992+0000 7f4dd8989700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f4dd4063d20 tx=0x7f4dd0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd000ce30 con 0x7f4dd40b1830 2021-10-21T00:12:34.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000f470 con 0x7f4dd40b1830 2021-10-21T00:12:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd409b8e0 con 0x7f4dd40b1830 2021-10-21T00:12:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd000f7d0 con 0x7f4dd40b1830 2021-10-21T00:12:34.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd409b0d0 con 0x7f4dd40b1830 2021-10-21T00:12:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd409bad0 con 0x7f4dd40b1830 2021-10-21T00:12:34.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:33.996+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4dd0019030 con 0x7f4dd40b1830 2021-10-21T00:12:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.000+0000 7f4dc9ffb700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 0x7f4db4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.000+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4dd006ae70 con 0x7f4dd40b1830 2021-10-21T00:12:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.000+0000 7f4dcbfff700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 0x7f4db4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.000+0000 7f4dcbfff700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 0x7f4db4055a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f4dc401a000 tx=0x7f4dc4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.004+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4dd0041ea0 con 0x7f4dd40b1830 2021-10-21T00:12:34.139 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.128+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dd40603c0 con 0x7f4dd40b1830 2021-10-21T00:12:34.140 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dc9ffb700 1 -- 172.21.15.41:0/4149156809 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f4dd00454c0 con 0x7f4dd40b1830 2021-10-21T00:12:34.141 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:34.141 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":144,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:33.607314+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:32.085660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:33.246025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:34.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 msgr2=0x7f4db4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 0x7f4db4055a40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f4dc401a000 tx=0x7f4dc4015000).stop 2021-10-21T00:12:34.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 msgr2=0x7f4dd4144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.143 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f4dd4063d20 tx=0x7f4dd0007c50).stop 2021-10-21T00:12:34.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 shutdown_connections 2021-10-21T00:12:34.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4db4053580 0x7f4db4055a40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4dd4140890 0x7f4dd4061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.144 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd40b4380 0x7f4dd409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 --2- 172.21.15.41:0/4149156809 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4dd40b1830 0x7f4dd4144560 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.145 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 >> 172.21.15.41:0/4149156809 conn(0x7f4dd40b7910 msgr2=0x7f4dd4138f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 shutdown_connections 2021-10-21T00:12:34.146 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.132+0000 7f4dd998b700 1 -- 172.21.15.41:0/4149156809 wait complete. 2021-10-21T00:12:34.154 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-10-21T00:12:34.267 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.256+0000 7feaf8f91700 1 Processor -- start 2021-10-21T00:12:34.268 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.256+0000 7feaf8f91700 1 -- start start 2021-10-21T00:12:34.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7feaf40b9ca0 0x7feaf40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40ba080 con 0x7feaf40b31e0 2021-10-21T00:12:34.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf405c670 con 0x7feaf40b26d0 2021-10-21T00:12:34.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf405c8e0 con 0x7feaf40b9ca0 2021-10-21T00:12:34.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7feaf40b9ca0 0x7feaf40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf1d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7feaf40b31e0 0x7feaf40b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36558/0 (socket says 172.21.15.41:36558) 2021-10-21T00:12:34.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf1d9b700 1 -- 172.21.15.41:0/761477509 learned_addr learned my addr 172.21.15.41:0/761477509 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:34.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf159a700 1 -- 172.21.15.41:0/761477509 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875520737 0 0) 0x7feaf40ba080 con 0x7feaf40b31e0 2021-10-21T00:12:34.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf159a700 1 -- 172.21.15.41:0/761477509 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead8003260 con 0x7feaf40b31e0 2021-10-21T00:12:34.281 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf259c700 1 -- 172.21.15.41:0/761477509 >> v1:172.21.15.62:6789/0 conn(0x7feaf40b26d0 legacy=0x7feaf4141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf259c700 1 -- 172.21.15.41:0/761477509 >> v1:172.21.15.41:6789/0 conn(0x7feaf40b31e0 legacy=0x7feaf40b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf259c700 1 -- 172.21.15.41:0/761477509 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf405cb80 con 0x7feaf40b9ca0 2021-10-21T00:12:34.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf259c700 1 --2- 172.21.15.41:0/761477509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b9ca0 0x7feaf40b0690 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7feae4002f70 tx=0x7feae4006df0).ready entity=mon.0 client_cookie=9fcd43e0bb143180 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf159a700 1 -- 172.21.15.41:0/761477509 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae400d610 con 0x7feaf40b9ca0 2021-10-21T00:12:34.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf159a700 1 -- 172.21.15.41:0/761477509 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4000e90 con 0x7feaf40b9ca0 2021-10-21T00:12:34.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf159a700 1 -- 172.21.15.41:0/761477509 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae400d960 con 0x7feaf40b9ca0 2021-10-21T00:12:34.284 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- 172.21.15.41:0/761477509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b9ca0 msgr2=0x7feaf40b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 --2- 172.21.15.41:0/761477509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b9ca0 0x7feaf40b0690 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7feae4002f70 tx=0x7feae4006df0).stop 2021-10-21T00:12:34.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- 172.21.15.41:0/761477509 shutdown_connections 2021-10-21T00:12:34.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 --2- 172.21.15.41:0/761477509 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b9ca0 0x7feaf40b0690 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- 172.21.15.41:0/761477509 >> 172.21.15.41:0/761477509 conn(0x7feaf4062f00 msgr2=0x7feaf40b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- 172.21.15.41:0/761477509 shutdown_connections 2021-10-21T00:12:34.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.260+0000 7feaf8f91700 1 -- 172.21.15.41:0/761477509 wait complete. 2021-10-21T00:12:34.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 Processor -- start 2021-10-21T00:12:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- start start 2021-10-21T00:12:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaf40b26d0 0x7feaf40af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaf40b9ca0 0x7feaf413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf41143f0 con 0x7feaf40b31e0 2021-10-21T00:12:34.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4114150 con 0x7feaf40b26d0 2021-10-21T00:12:34.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40aed00 con 0x7feaf40b9ca0 2021-10-21T00:12:34.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38796/0 (socket says 172.21.15.41:38796) 2021-10-21T00:12:34.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 -- 172.21.15.41:0/2048144941 learned_addr learned my addr 172.21.15.41:0/2048144941 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:34.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf259c700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaf40b26d0 0x7feaf40af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf2d9d700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaf40b9ca0 0x7feaf413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 -- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaf40b9ca0 msgr2=0x7feaf413ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaf40b9ca0 0x7feaf413ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 -- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaf40b26d0 msgr2=0x7feaf40af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaf40b26d0 0x7feaf40af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.294 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 -- 172.21.15.41:0/2048144941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae400b180 con 0x7feaf40b31e0 2021-10-21T00:12:34.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf1d9b700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7feae8001110 tx=0x7feae8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae80070d0 con 0x7feaf40b31e0 2021-10-21T00:12:34.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8007230 con 0x7feaf40b31e0 2021-10-21T00:12:34.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf40afb30 con 0x7feaf40b31e0 2021-10-21T00:12:34.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae8005610 con 0x7feaf40b31e0 2021-10-21T00:12:34.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.264+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf40acd10 con 0x7feaf40b31e0 2021-10-21T00:12:34.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf4113fa0 con 0x7feaf40b31e0 2021-10-21T00:12:34.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feae8010070 con 0x7feaf40b31e0 2021-10-21T00:12:34.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feae37fe700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 0x7fead0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feae806b070 con 0x7feaf40b31e0 2021-10-21T00:12:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feaf259c700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 0x7fead0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.268+0000 7feaf259c700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 0x7fead0055a40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7feae401a000 tx=0x7feae4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.276+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feae80420c0 con 0x7feaf40b31e0 2021-10-21T00:12:34.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.440+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feaf40aeec0 con 0x7feaf40b31e0 2021-10-21T00:12:34.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.612+0000 7feae37fe700 1 -- 172.21.15.41:0/2048144941 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7feae80456e0 con 0x7feaf40b31e0 2021-10-21T00:12:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 msgr2=0x7fead0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 0x7fead0055a40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7feae401a000 tx=0x7feae4014000).stop 2021-10-21T00:12:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 msgr2=0x7feaf413fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7feae8001110 tx=0x7feae8007ad0).stop 2021-10-21T00:12:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 shutdown_connections 2021-10-21T00:12:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fead0053580 0x7fead0055a40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feaf40b9ca0 0x7feaf413ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7feaf40b31e0 0x7feaf413fab0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 --2- 172.21.15.41:0/2048144941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feaf40b26d0 0x7feaf40af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 >> 172.21.15.41:0/2048144941 conn(0x7feaf4062f00 msgr2=0x7feaf4069600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 shutdown_connections 2021-10-21T00:12:34.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.616+0000 7feaf8f91700 1 -- 172.21.15.41:0/2048144941 wait complete. 2021-10-21T00:12:34.643 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:34.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 Processor -- start 2021-10-21T00:12:34.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 -- start start 2021-10-21T00:12:34.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4efc1445a0 0x7f4efc0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc064200 con 0x7f4efc0b1c60 2021-10-21T00:12:34.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc0644a0 con 0x7f4efc0b5f80 2021-10-21T00:12:34.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f03e1e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc0b17c0 con 0x7f4efc1445a0 2021-10-21T00:12:34.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f013b9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f4efc0b1c60 0x7f4efc143e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36574/0 (socket says 172.21.15.41:36574) 2021-10-21T00:12:34.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f013b9700 1 -- 172.21.15.41:0/3282528076 learned_addr learned my addr 172.21.15.41:0/3282528076 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:34.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f023bb700 1 --2- 172.21.15.41:0/3282528076 >> v2:172.21.15.62:3300/0 conn(0x7f4efc1445a0 0x7f4efc0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298752371 0 0) 0x7f4efc064200 con 0x7f4efc0b1c60 2021-10-21T00:12:34.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.744+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee4003260 con 0x7f4efc0b1c60 2021-10-21T00:12:34.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 295108110 0 0) 0x7f4ee4003260 con 0x7f4efc0b1c60 2021-10-21T00:12:34.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 >> v2:172.21.15.62:3300/0 conn(0x7f4efc1445a0 msgr2=0x7f4efc0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:34.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 --2- 172.21.15.41:0/3282528076 >> v2:172.21.15.62:3300/0 conn(0x7f4efc1445a0 0x7f4efc0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 >> v1:172.21.15.62:6789/0 conn(0x7f4efc0b5f80 legacy=0x7f4efc13dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc13e2c0 con 0x7f4efc0b1c60 2021-10-21T00:12:34.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f4eec001660 con 0x7f4efc0b1c60 2021-10-21T00:12:34.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 >> v1:172.21.15.41:6789/0 conn(0x7f4efc0b1c60 legacy=0x7f4efc143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 0x7f4ee4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee4004500 0x7f4ee4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4004e70 0x7f4ee400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0b17c0 con 0x7f4ee4003750 2021-10-21T00:12:34.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee400bdd0 con 0x7f4ee4004500 2021-10-21T00:12:34.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee400bf60 con 0x7f4ee4004e70 2021-10-21T00:12:34.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 0x7f4ee4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f013b9700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee4004500 0x7f4ee4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f023bb700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4004e70 0x7f4ee400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 -- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4004e70 msgr2=0x7f4ee400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:34.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4004e70 0x7f4ee400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 -- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee4004500 msgr2=0x7f4ee4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:34.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee4004500 0x7f4ee4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f023bb700 1 -- 172.21.15.41:0/3282528076 reap_dead start 2021-10-21T00:12:34.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 -- 172.21.15.41:0/3282528076 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4003260 con 0x7f4ee4003750 2021-10-21T00:12:34.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f013b9700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ee4004500 0x7f4ee4004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:34.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 0x7f4ee4003b70 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f4efc06a030 tx=0x7f4ef8007a00).ready entity=mon.0 client_cookie=21c675695173514b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef8007d10 con 0x7f4ee4003750 2021-10-21T00:12:34.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8007030 con 0x7f4ee4003750 2021-10-21T00:12:34.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f00bb8700 1 -- 172.21.15.41:0/3282528076 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef8007390 con 0x7f4ee4003750 2021-10-21T00:12:34.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 msgr2=0x7f4ee4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 0x7f4ee4003b70 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f4efc06a030 tx=0x7f4ef8007a00).stop 2021-10-21T00:12:34.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3282528076 shutdown_connections 2021-10-21T00:12:34.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3282528076 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4ee4003750 0x7f4ee4003b70 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3282528076 >> 172.21.15.41:0/3282528076 conn(0x7f4efc063ae0 msgr2=0x7f4efc0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3282528076 shutdown_connections 2021-10-21T00:12:34.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.748+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3282528076 wait complete. 2021-10-21T00:12:34.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 Processor -- start 2021-10-21T00:12:34.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- start start 2021-10-21T00:12:34.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4003750 0x7f4efc1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4efc144030 0x7f4efc064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc1108e0 con 0x7f4efc153470 2021-10-21T00:12:34.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc110b80 con 0x7f4efc144030 2021-10-21T00:12:34.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc110e20 con 0x7f4ee4003750 2021-10-21T00:12:34.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38818/0 (socket says 172.21.15.41:38818) 2021-10-21T00:12:34.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 -- 172.21.15.41:0/3034305601 learned_addr learned my addr 172.21.15.41:0/3034305601 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:34.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f013b9700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4efc144030 0x7f4efc064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4003750 0x7f4efc1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 -- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4003750 msgr2=0x7f4efc1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4003750 0x7f4efc1439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 -- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4efc144030 msgr2=0x7f4efc064a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4efc144030 0x7f4efc064a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 -- 172.21.15.41:0/3034305601 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc064f80 con 0x7f4efc153470 2021-10-21T00:12:34.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f023bb700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f4ef400b000 tx=0x7f4ef40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef4013750 con 0x7f4efc153470 2021-10-21T00:12:34.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef40138b0 con 0x7f4efc153470 2021-10-21T00:12:34.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef4013c10 con 0x7f4efc153470 2021-10-21T00:12:34.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc1105d0 con 0x7f4efc153470 2021-10-21T00:12:34.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.752+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc153df0 con 0x7f4efc153470 2021-10-21T00:12:34.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ef4013d70 con 0x7f4efc153470 2021-10-21T00:12:34.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc110fe0 con 0x7f4efc153470 2021-10-21T00:12:34.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4eeaffd700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 0x7f4edc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:34.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ef406c050 con 0x7f4efc153470 2021-10-21T00:12:34.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 0x7f4edc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:34.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.756+0000 7f4f01bba700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 0x7f4edc055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4ef801b000 tx=0x7f4ef8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:34.786 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.760+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ef40431b0 con 0x7f4efc153470 2021-10-21T00:12:34.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.924+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4efc057350 con 0x7f4efc153470 2021-10-21T00:12:34.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4eeaffd700 1 -- 172.21.15.41:0/3034305601 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f4ef4018030 con 0x7f4efc153470 2021-10-21T00:12:34.939 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:34.939 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:34.610443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8781":{"gid":8781,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/680865420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":680865420},{"type":"v1","addr":"172.21.15.41:6833","nonce":680865420}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:34.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 msgr2=0x7f4edc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 0x7f4edc055ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f4ef801b000 tx=0x7f4ef8015000).stop 2021-10-21T00:12:34.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 msgr2=0x7f4efc153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:34.943 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f4ef400b000 tx=0x7f4ef40091d0).stop 2021-10-21T00:12:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 shutdown_connections 2021-10-21T00:12:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4edc053610 0x7f4edc055ad0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4efc153470 0x7f4efc153900 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4efc144030 0x7f4efc064a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 --2- 172.21.15.41:0/3034305601 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4ee4003750 0x7f4efc1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:34.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 >> 172.21.15.41:0/3034305601 conn(0x7f4efc063ae0 msgr2=0x7f4efc13b720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 shutdown_connections 2021-10-21T00:12:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:34.928+0000 7f4f03e1e700 1 -- 172.21.15.41:0/3034305601 wait complete. 2021-10-21T00:12:34.946 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 77 2021-10-21T00:12:34.949 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:35.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.040+0000 7f8413158700 1 Processor -- start 2021-10-21T00:12:35.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.040+0000 7f8413158700 1 -- start start 2021-10-21T00:12:35.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f840c05fb00 0x7f840c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f840c142480 0x7f840c1428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 0x7f840c13e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c05fee0 con 0x7f840c05fb00 2021-10-21T00:12:35.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c060640 con 0x7f840c142480 2021-10-21T00:12:35.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0aa0a0 con 0x7f840c142de0 2021-10-21T00:12:35.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f840c05fb00 0x7f840c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f840c05fb00 0x7f840c0ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38822/0 (socket says 172.21.15.41:38822) 2021-10-21T00:12:35.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 -- 172.21.15.41:0/1355315318 learned_addr learned my addr 172.21.15.41:0/1355315318 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8411955700 1 --2- 172.21.15.41:0/1355315318 >> v2:172.21.15.62:3300/0 conn(0x7f840c142480 0x7f840c1428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412957700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 0x7f840c13e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 -- 172.21.15.41:0/1355315318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 msgr2=0x7f840c13e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:35.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 0x7f840c13e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 -- 172.21.15.41:0/1355315318 >> v2:172.21.15.62:3300/0 conn(0x7f840c142480 msgr2=0x7f840c1428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 --2- 172.21.15.41:0/1355315318 >> v2:172.21.15.62:3300/0 conn(0x7f840c142480 0x7f840c1428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 -- 172.21.15.41:0/1355315318 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0aa340 con 0x7f840c05fb00 2021-10-21T00:12:35.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412957700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 0x7f840c13e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8412156700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c0ab9a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8408002f70 tx=0x7f8408006e40).ready entity=mon.0 client_cookie=fb0688fae7ffdd2e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8411154700 1 -- 172.21.15.41:0/1355315318 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840800bb90 con 0x7f840c05fb00 2021-10-21T00:12:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8411154700 1 -- 172.21.15.41:0/1355315318 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408000e90 con 0x7f840c05fb00 2021-10-21T00:12:35.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8411154700 1 -- 172.21.15.41:0/1355315318 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84080153f0 con 0x7f840c05fb00 2021-10-21T00:12:35.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- 172.21.15.41:0/1355315318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 msgr2=0x7f840c0ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c0ab9a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8408002f70 tx=0x7f8408006e40).stop 2021-10-21T00:12:35.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- 172.21.15.41:0/1355315318 shutdown_connections 2021-10-21T00:12:35.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142de0 0x7f840c13e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- 172.21.15.41:0/1355315318 >> v2:172.21.15.62:3300/0 conn(0x7f840c142480 0x7f840c1428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 --2- 172.21.15.41:0/1355315318 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c0ab9a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- 172.21.15.41:0/1355315318 >> 172.21.15.41:0/1355315318 conn(0x7f840c0b5700 msgr2=0x7f840c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- 172.21.15.41:0/1355315318 shutdown_connections 2021-10-21T00:12:35.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.044+0000 7f8413158700 1 -- 172.21.15.41:0/1355315318 wait complete. 2021-10-21T00:12:35.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 Processor -- start 2021-10-21T00:12:35.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- start start 2021-10-21T00:12:35.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142480 0x7f840c13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 0x7f840c13d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0ae0b0 con 0x7f840c05fb00 2021-10-21T00:12:35.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0aeac0 con 0x7f840c142de0 2021-10-21T00:12:35.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0aed20 con 0x7f840c142480 2021-10-21T00:12:35.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38828/0 (socket says 172.21.15.41:38828) 2021-10-21T00:12:35.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 -- 172.21.15.41:0/1525539588 learned_addr learned my addr 172.21.15.41:0/1525539588 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8411955700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142480 0x7f840c13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412957700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 0x7f840c13d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 -- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142480 msgr2=0x7f840c13ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142480 0x7f840c13ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 -- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 msgr2=0x7f840c13d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 0x7f840c13d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 -- 172.21.15.41:0/1525539588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404009470 con 0x7f840c05fb00 2021-10-21T00:12:35.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412957700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 0x7f840c13d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:35.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8412156700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f8408002f70 tx=0x7f8408018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408015890 con 0x7f840c05fb00 2021-10-21T00:12:35.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080159f0 con 0x7f840c05fb00 2021-10-21T00:12:35.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840800d4d0 con 0x7f840c05fb00 2021-10-21T00:12:35.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408015d50 con 0x7f840c05fb00 2021-10-21T00:12:35.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.048+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c0ae5d0 con 0x7f840c05fb00 2021-10-21T00:12:35.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c143210 con 0x7f840c05fb00 2021-10-21T00:12:35.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f840801d040 con 0x7f840c05fb00 2021-10-21T00:12:35.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f83ff7fe700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 0x7f83ec0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f840806ef00 con 0x7f840c05fb00 2021-10-21T00:12:35.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f8411955700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 0x7f83ec0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.052+0000 7f8411955700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 0x7f83ec0559e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f840000b000 tx=0x7f8400006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.056+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8408046070 con 0x7f840c05fb00 2021-10-21T00:12:35.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.184+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f840c057350 con 0x7f840c05fb00 2021-10-21T00:12:35.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.184+0000 7f83ff7fe700 1 -- 172.21.15.41:0/1525539588 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f8408049690 con 0x7f840c05fb00 2021-10-21T00:12:35.195 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:35.195 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":145,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:34.611140+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:32.085660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:33.246025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:35.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 msgr2=0x7f83ec0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 0x7f83ec0559e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f840000b000 tx=0x7f8400006df0).stop 2021-10-21T00:12:35.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 msgr2=0x7f840c09a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f8408002f70 tx=0x7f8408018000).stop 2021-10-21T00:12:35.199 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 shutdown_connections 2021-10-21T00:12:35.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f83ec053520 0x7f83ec0559e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f840c142de0 0x7f840c13d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f840c142480 0x7f840c13ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 --2- 172.21.15.41:0/1525539588 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f840c05fb00 0x7f840c09a4d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.200 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 >> 172.21.15.41:0/1525539588 conn(0x7f840c0b5700 msgr2=0x7f840c13ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 shutdown_connections 2021-10-21T00:12:35.201 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.188+0000 7f8413158700 1 -- 172.21.15.41:0/1525539588 wait complete. 2021-10-21T00:12:35.214 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:35.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 Processor -- start 2021-10-21T00:12:35.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 -- start start 2021-10-21T00:12:35.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 0x7f414c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f414c13c510 0x7f414c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 0x7f414c143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0b3520 con 0x7f414c13c510 2021-10-21T00:12:35.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c143c40 con 0x7f414c062330 2021-10-21T00:12:35.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.320+0000 7f414bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c142ad0 con 0x7f414c142f00 2021-10-21T00:12:35.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f414c13c510 0x7f414c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 0x7f414c143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 0x7f414c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.338 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f414c13c510 0x7f414c13c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38840/0 (socket says 172.21.15.41:38840) 2021-10-21T00:12:35.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 -- 172.21.15.41:0/652809072 learned_addr learned my addr 172.21.15.41:0/652809072 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 -- 172.21.15.41:0/652809072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 msgr2=0x7f414c143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:35.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 0x7f414c143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.339 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 -- 172.21.15.41:0/652809072 >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 msgr2=0x7f414c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:35.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 --2- 172.21.15.41:0/652809072 >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 0x7f414c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 -- 172.21.15.41:0/652809072 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c13ce60 con 0x7f414c13c510 2021-10-21T00:12:35.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414affd700 1 --2- 172.21.15.41:0/652809072 >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 0x7f414c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:35.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414b7fe700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 0x7f414c143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:35.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414a7fc700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13c970 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f414c0b17c0 tx=0x7f4140006eb0).ready entity=mon.0 client_cookie=6e70303d551f23ce server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f4149ffb700 1 -- 172.21.15.41:0/652809072 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414000e610 con 0x7f414c13c510 2021-10-21T00:12:35.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f4149ffb700 1 -- 172.21.15.41:0/652809072 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140000e90 con 0x7f414c13c510 2021-10-21T00:12:35.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f4149ffb700 1 -- 172.21.15.41:0/652809072 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414000e9a0 con 0x7f414c13c510 2021-10-21T00:12:35.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 -- 172.21.15.41:0/652809072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 msgr2=0x7f414c13c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13c970 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f414c0b17c0 tx=0x7f4140006eb0).stop 2021-10-21T00:12:35.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 -- 172.21.15.41:0/652809072 shutdown_connections 2021-10-21T00:12:35.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13c970 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 --2- 172.21.15.41:0/652809072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c142f00 0x7f414c143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 --2- 172.21.15.41:0/652809072 >> v2:172.21.15.62:3300/0 conn(0x7f414c062330 0x7f414c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 -- 172.21.15.41:0/652809072 >> 172.21.15.41:0/652809072 conn(0x7f414c0b9080 msgr2=0x7f414c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 -- 172.21.15.41:0/652809072 shutdown_connections 2021-10-21T00:12:35.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.324+0000 7f414bfff700 1 -- 172.21.15.41:0/652809072 wait complete. 2021-10-21T00:12:35.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 Processor -- start 2021-10-21T00:12:35.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- start start 2021-10-21T00:12:35.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c062330 0x7f414c13d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c142f00 0x7f414c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0ac890 con 0x7f414c13c510 2021-10-21T00:12:35.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c142530 con 0x7f414c142f00 2021-10-21T00:12:35.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c144fb0 con 0x7f414c062330 2021-10-21T00:12:35.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38844/0 (socket says 172.21.15.41:38844) 2021-10-21T00:12:35.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 -- 172.21.15.41:0/3584558231 learned_addr learned my addr 172.21.15.41:0/3584558231 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414b7fe700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c142f00 0x7f414c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414affd700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c062330 0x7f414c13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 -- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c062330 msgr2=0x7f414c13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c062330 0x7f414c13d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 -- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c142f00 msgr2=0x7f414c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c142f00 0x7f414c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 -- 172.21.15.41:0/3584558231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009470 con 0x7f414c13c510 2021-10-21T00:12:35.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414a7fc700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f414c0b17c0 tx=0x7f4140015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41400116e0 con 0x7f414c13c510 2021-10-21T00:12:35.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140011840 con 0x7f414c13c510 2021-10-21T00:12:35.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414400b180 con 0x7f414c13c510 2021-10-21T00:12:35.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4140011ba0 con 0x7f414c13c510 2021-10-21T00:12:35.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.328+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414000b1e0 con 0x7f414c13c510 2021-10-21T00:12:35.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c142350 con 0x7f414c13c510 2021-10-21T00:12:35.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f414000f070 con 0x7f414c13c510 2021-10-21T00:12:35.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f413bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 0x7f4128055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f414006cfe0 con 0x7f414c13c510 2021-10-21T00:12:35.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f414affd700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 0x7f4128055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.332+0000 7f414affd700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 0x7f4128055a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f413c00b000 tx=0x7f413c0091d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.340+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41400440e0 con 0x7f414c13c510 2021-10-21T00:12:35.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.508+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f414c145f90 con 0x7f414c13c510 2021-10-21T00:12:35.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.516+0000 7f413bfff700 1 -- 172.21.15.41:0/3584558231 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4140047700 con 0x7f414c13c510 2021-10-21T00:12:35.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 msgr2=0x7f4128055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 0x7f4128055a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f413c00b000 tx=0x7f413c0091d0).stop 2021-10-21T00:12:35.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 msgr2=0x7f414c13f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f414c0b17c0 tx=0x7f4140015000).stop 2021-10-21T00:12:35.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 shutdown_connections 2021-10-21T00:12:35.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4128053580 0x7f4128055a40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c142f00 0x7f414c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f414c13c510 0x7f414c13f0b0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 --2- 172.21.15.41:0/3584558231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c062330 0x7f414c13d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 >> 172.21.15.41:0/3584558231 conn(0x7f414c0b9080 msgr2=0x7f414c0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 shutdown_connections 2021-10-21T00:12:35.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.520+0000 7f414bfff700 1 -- 172.21.15.41:0/3584558231 wait complete. 2021-10-21T00:12:35.532 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.0 2021-10-21T00:12:35.543 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:35.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.652+0000 7faf60fb0700 1 Processor -- start 2021-10-21T00:12:35.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.652+0000 7faf60fb0700 1 -- start start 2021-10-21T00:12:35.665 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.652+0000 7faf60fb0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf5c05f9f0 0x7faf5c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.652+0000 7faf60fb0700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf5c067a90 0x7faf5c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.666 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.652+0000 7faf60fb0700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c05fdd0 con 0x7faf5c0b0730 2021-10-21T00:12:35.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0ae3c0 con 0x7faf5c067a90 2021-10-21T00:12:35.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0ae660 con 0x7faf5c05f9f0 2021-10-21T00:12:35.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf5c067a90 0x7faf5c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faf5c067a90 0x7faf5c0b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38852/0 (socket says 172.21.15.41:38852) 2021-10-21T00:12:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 -- 172.21.15.41:0/3450244831 learned_addr learned my addr 172.21.15.41:0/3450244831 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5bfff700 1 --1- 172.21.15.41:0/3450244831 >> v1:172.21.15.41:6789/0 conn(0x7faf5c0b0730 0x7faf5c0b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36624/0 (socket says 172.21.15.41:36624) 2021-10-21T00:12:35.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5b7fe700 1 --2- 172.21.15.41:0/3450244831 >> v2:172.21.15.62:3300/0 conn(0x7faf5c05f9f0 0x7faf5c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 -- 172.21.15.41:0/3450244831 >> v2:172.21.15.62:3300/0 conn(0x7faf5c05f9f0 msgr2=0x7faf5c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:35.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 --2- 172.21.15.41:0/3450244831 >> v2:172.21.15.62:3300/0 conn(0x7faf5c05f9f0 0x7faf5c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 -- 172.21.15.41:0/3450244831 >> v1:172.21.15.41:6789/0 conn(0x7faf5c0b0730 legacy=0x7faf5c0b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 -- 172.21.15.41:0/3450244831 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0ae900 con 0x7faf5c067a90 2021-10-21T00:12:35.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5affd700 1 --2- 172.21.15.41:0/3450244831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c067a90 0x7faf5c0b2640 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7faf5c0ad230 tx=0x7faf50006eb0).ready entity=mon.0 client_cookie=a51be6c40129b735 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5a7fc700 1 -- 172.21.15.41:0/3450244831 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5000d610 con 0x7faf5c067a90 2021-10-21T00:12:35.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5a7fc700 1 -- 172.21.15.41:0/3450244831 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50000e90 con 0x7faf5c067a90 2021-10-21T00:12:35.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf5a7fc700 1 -- 172.21.15.41:0/3450244831 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5000d9a0 con 0x7faf5c067a90 2021-10-21T00:12:35.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- 172.21.15.41:0/3450244831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c067a90 msgr2=0x7faf5c0b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 --2- 172.21.15.41:0/3450244831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c067a90 0x7faf5c0b2640 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7faf5c0ad230 tx=0x7faf50006eb0).stop 2021-10-21T00:12:35.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- 172.21.15.41:0/3450244831 shutdown_connections 2021-10-21T00:12:35.678 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 --2- 172.21.15.41:0/3450244831 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c067a90 0x7faf5c0b2640 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 --2- 172.21.15.41:0/3450244831 >> v2:172.21.15.62:3300/0 conn(0x7faf5c05f9f0 0x7faf5c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- 172.21.15.41:0/3450244831 >> 172.21.15.41:0/3450244831 conn(0x7faf5c0637b0 msgr2=0x7faf5c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- 172.21.15.41:0/3450244831 shutdown_connections 2021-10-21T00:12:35.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.656+0000 7faf60fb0700 1 -- 172.21.15.41:0/3450244831 wait complete. 2021-10-21T00:12:35.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 Processor -- start 2021-10-21T00:12:35.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- start start 2021-10-21T00:12:35.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf5c067a90 0x7faf5c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf5c0b0730 0x7faf5c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c10ef80 con 0x7faf5c05f9f0 2021-10-21T00:12:35.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c10f1b0 con 0x7faf5c0b0730 2021-10-21T00:12:35.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c10f450 con 0x7faf5c067a90 2021-10-21T00:12:35.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38856/0 (socket says 172.21.15.41:38856) 2021-10-21T00:12:35.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 -- 172.21.15.41:0/2436664635 learned_addr learned my addr 172.21.15.41:0/2436664635 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5bfff700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf5c0b0730 0x7faf5c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5affd700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf5c067a90 0x7faf5c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 -- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf5c067a90 msgr2=0x7faf5c143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf5c067a90 0x7faf5c143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 -- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf5c0b0730 msgr2=0x7faf5c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf5c0b0730 0x7faf5c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 -- 172.21.15.41:0/2436664635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5000b1e0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf5b7fe700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7faf4c00c000 tx=0x7faf4c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4c010780 con 0x7faf5c05f9f0 2021-10-21T00:12:35.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c0108e0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c05c710 con 0x7faf5c05f9f0 2021-10-21T00:12:35.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4c010c40 con 0x7faf5c05f9f0 2021-10-21T00:12:35.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.660+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c153de0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c1543d0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf4c01c460 con 0x7faf5c05f9f0 2021-10-21T00:12:35.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf58ff9700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 0x7faf3c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf4c06bcf0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf5affd700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 0x7faf3c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.687 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.664+0000 7faf5affd700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 0x7faf3c055ad0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faf5001c000 tx=0x7faf50015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.688 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.668+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf4c042df0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.848 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.836+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faf5c0aeba0 con 0x7faf5c05f9f0 2021-10-21T00:12:35.853 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf58ff9700 1 -- 172.21.15.41:0/2436664635 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7faf4c046410 con 0x7faf5c05f9f0 2021-10-21T00:12:35.856 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 msgr2=0x7faf3c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 0x7faf3c055ad0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faf5001c000 tx=0x7faf50015000).stop 2021-10-21T00:12:35.857 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 msgr2=0x7faf5c112da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7faf4c00c000 tx=0x7faf4c006df0).stop 2021-10-21T00:12:35.858 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 shutdown_connections 2021-10-21T00:12:35.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faf3c053610 0x7faf3c055ad0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf5c0b0730 0x7faf5c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.859 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faf5c067a90 0x7faf5c143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 --2- 172.21.15.41:0/2436664635 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faf5c05f9f0 0x7faf5c112da0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.860 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 >> 172.21.15.41:0/2436664635 conn(0x7faf5c0637b0 msgr2=0x7faf5c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 shutdown_connections 2021-10-21T00:12:35.861 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.844+0000 7faf60fb0700 1 -- 172.21.15.41:0/2436664635 wait complete. 2021-10-21T00:12:35.863 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.1 2021-10-21T00:12:35.868 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-10-21T00:12:35.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 Processor -- start 2021-10-21T00:12:35.981 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 -- start start 2021-10-21T00:12:35.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f893c05f9f0 0x7f893c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c0609d0 con 0x7f893c14b350 2021-10-21T00:12:35.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c05fdd0 con 0x7f893c0aa750 2021-10-21T00:12:35.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f894432c700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0b1620 con 0x7f893c05f9f0 2021-10-21T00:12:35.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89428c9700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f893c14b350 0x7f893c0af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36638/0 (socket says 172.21.15.41:36638) 2021-10-21T00:12:35.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89428c9700 1 -- 172.21.15.41:0/3032391510 learned_addr learned my addr 172.21.15.41:0/3032391510 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:35.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89420c8700 1 --2- 172.21.15.41:0/3032391510 >> v2:172.21.15.62:3300/0 conn(0x7f893c05f9f0 0x7f893c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68320416 0 0) 0x7f893c0609d0 con 0x7f893c14b350 2021-10-21T00:12:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8924003260 con 0x7f893c14b350 2021-10-21T00:12:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298206471 0 0) 0x7f893c05fdd0 con 0x7f893c0aa750 2021-10-21T00:12:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f893c0609d0 con 0x7f893c0aa750 2021-10-21T00:12:35.986 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89420c8700 1 -- 172.21.15.41:0/3032391510 >> v1:172.21.15.62:6789/0 conn(0x7f893c0aa750 legacy=0x7f893c14ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89420c8700 1 -- 172.21.15.41:0/3032391510 >> v1:172.21.15.41:6789/0 conn(0x7f893c14b350 legacy=0x7f893c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89420c8700 1 -- 172.21.15.41:0/3032391510 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0b1380 con 0x7f893c05f9f0 2021-10-21T00:12:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89420c8700 1 --2- 172.21.15.41:0/3032391510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c14a750 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8938002f70 tx=0x7f8938006df0).ready entity=mon.1 client_cookie=574c2e6437c436b2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.987 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893800d540 con 0x7f893c05f9f0 2021-10-21T00:12:35.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938000e90 con 0x7f893c05f9f0 2021-10-21T00:12:35.988 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.972+0000 7f89410c6700 1 -- 172.21.15.41:0/3032391510 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893800d890 con 0x7f893c05f9f0 2021-10-21T00:12:35.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- 172.21.15.41:0/3032391510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 msgr2=0x7f893c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 --2- 172.21.15.41:0/3032391510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c14a750 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8938002f70 tx=0x7f8938006df0).stop 2021-10-21T00:12:35.991 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- 172.21.15.41:0/3032391510 shutdown_connections 2021-10-21T00:12:35.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 --2- 172.21.15.41:0/3032391510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c14a750 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- 172.21.15.41:0/3032391510 >> 172.21.15.41:0/3032391510 conn(0x7f893c05bca0 msgr2=0x7f893c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:35.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- 172.21.15.41:0/3032391510 shutdown_connections 2021-10-21T00:12:35.992 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- 172.21.15.41:0/3032391510 wait complete. 2021-10-21T00:12:35.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 Processor -- start 2021-10-21T00:12:35.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- start start 2021-10-21T00:12:35.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c099d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.993 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f893c0aa750 0x7f893c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:35.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c0af130 con 0x7f893c14b350 2021-10-21T00:12:35.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c146c30 con 0x7f893c05f9f0 2021-10-21T00:12:35.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f894432c700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c0adf40 con 0x7f893c0aa750 2021-10-21T00:12:35.994 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89428c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89420c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89418c7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f893c0aa750 0x7f893c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:35.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89420c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c099d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50788/0 (socket says 172.21.15.41:50788) 2021-10-21T00:12:35.995 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89420c8700 1 -- 172.21.15.41:0/3582469498 learned_addr learned my addr 172.21.15.41:0/3582469498 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:35.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89428c9700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38874/0 (socket says 172.21.15.41:38874) 2021-10-21T00:12:35.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89428c9700 1 -- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f893c0aa750 msgr2=0x7f893c146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.976+0000 7f89428c9700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f893c0aa750 0x7f893c146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f89428c9700 1 -- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 msgr2=0x7f893c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:35.996 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f89428c9700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:35.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f89428c9700 1 -- 172.21.15.41:0/3582469498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893800b180 con 0x7f893c14b350 2021-10-21T00:12:35.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f89428c9700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f8934001490 tx=0x7f8934007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:35.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893400ce90 con 0x7f893c14b350 2021-10-21T00:12:35.997 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934005ba0 con 0x7f893c14b350 2021-10-21T00:12:35.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c0ae1e0 con 0x7f893c14b350 2021-10-21T00:12:35.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89340070d0 con 0x7f893c14b350 2021-10-21T00:12:35.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c065720 con 0x7f893c14b350 2021-10-21T00:12:35.998 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c0aef50 con 0x7f893c14b350 2021-10-21T00:12:35.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8934010070 con 0x7f893c14b350 2021-10-21T00:12:35.999 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 0x7f891c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.980+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f893406b0e0 con 0x7f893c14b350 2021-10-21T00:12:36.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.984+0000 7f89420c8700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 0x7f891c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.000 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.984+0000 7f89420c8700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 0x7f891c055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f893801a000 tx=0x7f8938014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.001 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:35.988+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8934042240 con 0x7f893c14b350 2021-10-21T00:12:36.167 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.156+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f893c0678f0 con 0x7f893c14b350 2021-10-21T00:12:36.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.164+0000 7f892f7fe700 1 -- 172.21.15.41:0/3582469498 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8934045860 con 0x7f893c14b350 2021-10-21T00:12:36.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 msgr2=0x7f891c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 0x7f891c055b60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f893801a000 tx=0x7f8938014000).stop 2021-10-21T00:12:36.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 msgr2=0x7f893c146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f8934001490 tx=0x7f8934007d60).stop 2021-10-21T00:12:36.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 shutdown_connections 2021-10-21T00:12:36.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f891c0536a0 0x7f891c055b60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f893c14b350 0x7f893c146740 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f893c0aa750 0x7f893c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 --2- 172.21.15.41:0/3582469498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f893c05f9f0 0x7f893c099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 >> 172.21.15.41:0/3582469498 conn(0x7f893c05bca0 msgr2=0x7f893c149730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 shutdown_connections 2021-10-21T00:12:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.168+0000 7f894432c700 1 -- 172.21.15.41:0/3582469498 wait complete. 2021-10-21T00:12:36.181 INFO:teuthology.orchestra.run.smithi041.stderr:updated caps for client.2 2021-10-21T00:12:36.191 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:36.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 Processor -- start 2021-10-21T00:12:36.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- start start 2021-10-21T00:12:36.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0b2170 0x7fc05c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc05c0af620 0x7fc05c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0b0b50 con 0x7fc05c0abb50 2021-10-21T00:12:36.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0b2550 con 0x7fc05c0af620 2021-10-21T00:12:36.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0b0d90 con 0x7fc05c0b2170 2021-10-21T00:12:36.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc05b7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0b2170 0x7fc05c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc05c0af620 0x7fc05c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc05c0af620 0x7fc05c0ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:50796/0 (socket says 172.21.15.41:50796) 2021-10-21T00:12:36.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 -- 172.21.15.41:0/3950835661 learned_addr learned my addr 172.21.15.41:0/3950835661 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:36.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 -- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0b2170 msgr2=0x7fc05c0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:36.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 --2- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0b2170 0x7fc05c0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 -- 172.21.15.41:0/3950835661 >> v1:172.21.15.62:6789/0 conn(0x7fc05c0abb50 legacy=0x7fc05c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 -- 172.21.15.41:0/3950835661 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0b1030 con 0x7fc05c0af620 2021-10-21T00:12:36.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc052ffd700 1 --2- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0af620 0x7fc05c0ab660 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fc044002f70 tx=0x7fc044006eb0).ready entity=mon.1 client_cookie=c2c0fa670bee6f08 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc05affd700 1 -- 172.21.15.41:0/3950835661 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04400d570 con 0x7fc05c0af620 2021-10-21T00:12:36.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc05affd700 1 -- 172.21.15.41:0/3950835661 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044000e90 con 0x7fc05c0af620 2021-10-21T00:12:36.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc05affd700 1 -- 172.21.15.41:0/3950835661 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc04400d900 con 0x7fc05c0af620 2021-10-21T00:12:36.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0af620 msgr2=0x7fc05c0ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 --2- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0af620 0x7fc05c0ab660 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fc044002f70 tx=0x7fc044006eb0).stop 2021-10-21T00:12:36.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- 172.21.15.41:0/3950835661 shutdown_connections 2021-10-21T00:12:36.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 --2- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0af620 0x7fc05c0ab660 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 --2- 172.21.15.41:0/3950835661 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0b2170 0x7fc05c0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- 172.21.15.41:0/3950835661 >> 172.21.15.41:0/3950835661 conn(0x7fc05c0b5700 msgr2=0x7fc05c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:36.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- 172.21.15.41:0/3950835661 shutdown_connections 2021-10-21T00:12:36.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.288+0000 7fc060dd5700 1 -- 172.21.15.41:0/3950835661 wait complete. 2021-10-21T00:12:36.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 Processor -- start 2021-10-21T00:12:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- start start 2021-10-21T00:12:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 0x7fc05c0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0b2170 0x7fc05c066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c063ad0 con 0x7fc05c0abb50 2021-10-21T00:12:36.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0661c0 con 0x7fc05c0b2170 2021-10-21T00:12:36.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c066460 con 0x7fc05c0af620 2021-10-21T00:12:36.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc05b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 0x7fc05c0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57382/0 (socket says 172.21.15.41:57382) 2021-10-21T00:12:36.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 -- 172.21.15.41:0/1174911469 learned_addr learned my addr 172.21.15.41:0/1174911469 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:36.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc05b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 0x7fc05c0ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38886/0 (socket says 172.21.15.41:38886) 2021-10-21T00:12:36.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc05bfff700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0b2170 0x7fc05c066ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 -- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0b2170 msgr2=0x7fc05c066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0b2170 0x7fc05c066ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 -- 172.21.15.41:0/1174911469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 msgr2=0x7fc05c0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 0x7fc05c0ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 -- 172.21.15.41:0/1174911469 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04400b1e0 con 0x7fc05c0af620 2021-10-21T00:12:36.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc052ffd700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc044002f70 tx=0x7fc044015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc044011860 con 0x7fc05c0af620 2021-10-21T00:12:36.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c066700 con 0x7fc05c0af620 2021-10-21T00:12:36.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0440119c0 con 0x7fc05c0af620 2021-10-21T00:12:36.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc044011d20 con 0x7fc05c0af620 2021-10-21T00:12:36.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.292+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c0976f0 con 0x7fc05c0af620 2021-10-21T00:12:36.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c159b20 con 0x7fc05c0af620 2021-10-21T00:12:36.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc04401a040 con 0x7fc05c0af620 2021-10-21T00:12:36.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc0597fa700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 0x7fc040055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc04406c8c0 con 0x7fc05c0af620 2021-10-21T00:12:36.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc05b7fe700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 0x7fc040055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.296+0000 7fc05b7fe700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 0x7fc040055b60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fc04c00b000 tx=0x7fc04c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.304+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc05c159b20 con 0x7fc05c0af620 2021-10-21T00:12:36.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.472+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc05c159b20 con 0x7fc05c0af620 2021-10-21T00:12:36.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.472+0000 7fc0597fa700 1 -- 172.21.15.41:0/1174911469 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fc05c159b20 con 0x7fc05c0af620 2021-10-21T00:12:36.482 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:36.482 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:34.610443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8781":{"gid":8781,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/680865420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":680865420},{"type":"v1","addr":"172.21.15.41:6833","nonce":680865420}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 msgr2=0x7fc040055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 0x7fc040055b60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fc04c00b000 tx=0x7fc04c006df0).stop 2021-10-21T00:12:36.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 msgr2=0x7fc05c0635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc044002f70 tx=0x7fc044015000).stop 2021-10-21T00:12:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 shutdown_connections 2021-10-21T00:12:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0400536a0 0x7fc040055b60 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc05c0b2170 0x7fc05c066ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc05c0af620 0x7fc05c0635e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 --2- 172.21.15.41:0/1174911469 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc05c0abb50 0x7fc05c0ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 >> 172.21.15.41:0/1174911469 conn(0x7fc05c0b5700 msgr2=0x7fc05c05c530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:36.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 shutdown_connections 2021-10-21T00:12:36.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.476+0000 7fc060dd5700 1 -- 172.21.15.41:0/1174911469 wait complete. 2021-10-21T00:12:36.488 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 77 2021-10-21T00:12:36.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:33.607687+0000', 'modified': '2021-10-21T00:12:34.610443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8781': {'gid': 8781, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/680865420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 680865420}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 680865420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:36.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:36.702 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:12:36.818 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8781,"want_state":"up:active","state":"up:active","rank_uptime":3.1932064360000001,"mdsmap_epoch":77,"osdmap_epoch":145,"osdmap_epoch_barrier":144,"uptime":7.5484475370000004} 2021-10-21T00:12:36.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8781, "mdsmap_epoch": 77, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "rank_uptime": 3.193206436, "state": "up:active", "uptime": 7.548447537, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:36.820 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:36.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 Processor -- start 2021-10-21T00:12:36.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 -- start start 2021-10-21T00:12:36.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f695c05fb00 0x7f695c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 0x7f695c13f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c05fee0 con 0x7f695c142480 2021-10-21T00:12:36.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c060640 con 0x7f695c05fb00 2021-10-21T00:12:36.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961b64700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0aa0a0 con 0x7f695c143000 2021-10-21T00:12:36.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f695c05fb00 0x7f695c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695bfff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f695c142480 0x7f695c1428f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36664/0 (socket says 172.21.15.41:36664) 2021-10-21T00:12:36.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695bfff700 1 -- 172.21.15.41:0/1425642411 learned_addr learned my addr 172.21.15.41:0/1425642411 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:36.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961363700 1 --2- 172.21.15.41:0/1425642411 >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 0x7f695c13f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520681426 0 0) 0x7f695c05fee0 con 0x7f695c142480 2021-10-21T00:12:36.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948004370 con 0x7f695c142480 2021-10-21T00:12:36.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1447801115 0 0) 0x7f6948004370 con 0x7f695c142480 2021-10-21T00:12:36.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 -- 172.21.15.41:0/1425642411 >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 msgr2=0x7f695c13f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:36.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 --2- 172.21.15.41:0/1425642411 >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 0x7f695c13f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 -- 172.21.15.41:0/1425642411 >> v1:172.21.15.41:6789/0 conn(0x7f695c142480 legacy=0x7f695c1428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 -- 172.21.15.41:0/1425642411 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0aa340 con 0x7f695c05fb00 2021-10-21T00:12:36.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6961363700 1 --2- 172.21.15.41:0/1425642411 >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 0x7f695c13f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:36.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f6960b62700 1 --2- 172.21.15.41:0/1425642411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c0ab9a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f694c001820 tx=0x7f69540091d0).ready entity=mon.0 client_cookie=e581f8a3d9d14750 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694c001680 con 0x7f695c05fb00 2021-10-21T00:12:36.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400b520 con 0x7f695c05fb00 2021-10-21T00:12:36.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.920+0000 7f695b7fe700 1 -- 172.21.15.41:0/1425642411 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695400b690 con 0x7f695c05fb00 2021-10-21T00:12:36.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- 172.21.15.41:0/1425642411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 msgr2=0x7f695c0ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 --2- 172.21.15.41:0/1425642411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c0ab9a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f694c001820 tx=0x7f69540091d0).stop 2021-10-21T00:12:36.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- 172.21.15.41:0/1425642411 shutdown_connections 2021-10-21T00:12:36.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 --2- 172.21.15.41:0/1425642411 >> v2:172.21.15.62:3300/0 conn(0x7f695c143000 0x7f695c13f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 --2- 172.21.15.41:0/1425642411 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c0ab9a0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- 172.21.15.41:0/1425642411 >> 172.21.15.41:0/1425642411 conn(0x7f695c0b5700 msgr2=0x7f695c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:36.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- 172.21.15.41:0/1425642411 shutdown_connections 2021-10-21T00:12:36.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- 172.21.15.41:0/1425642411 wait complete. 2021-10-21T00:12:36.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 Processor -- start 2021-10-21T00:12:36.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.924+0000 7f6961b64700 1 -- start start 2021-10-21T00:12:36.944 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c142480 0x7f695c0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f695c143000 0x7f695c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c132c60 con 0x7f695c05fb00 2021-10-21T00:12:36.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c145d10 con 0x7f695c142480 2021-10-21T00:12:36.945 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c145fb0 con 0x7f695c143000 2021-10-21T00:12:36.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38898/0 (socket says 172.21.15.41:38898) 2021-10-21T00:12:36.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 -- 172.21.15.41:0/1642668339 learned_addr learned my addr 172.21.15.41:0/1642668339 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:36.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961363700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f695c143000 0x7f695c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f695bfff700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c142480 0x7f695c0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 -- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f695c143000 msgr2=0x7f695c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f695c143000 0x7f695c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 -- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c142480 msgr2=0x7f695c0acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:36.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c142480 0x7f695c0acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:36.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 -- 172.21.15.41:0/1642668339 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009470 con 0x7f695c05fb00 2021-10-21T00:12:36.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6960b62700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f694c001820 tx=0x7f6954016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.948 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6954011b80 con 0x7f695c05fb00 2021-10-21T00:12:36.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954011ce0 con 0x7f695c05fb00 2021-10-21T00:12:36.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6954021670 con 0x7f695c05fb00 2021-10-21T00:12:36.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c145790 con 0x7f695c05fb00 2021-10-21T00:12:36.949 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.928+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c153890 con 0x7f695c05fb00 2021-10-21T00:12:36.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c153ee0 con 0x7f695c05fb00 2021-10-21T00:12:36.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f695400f070 con 0x7f695c05fb00 2021-10-21T00:12:36.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f6959ffb700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:36.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f695406c8b0 con 0x7f695c05fb00 2021-10-21T00:12:36.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f695bfff700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:36.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.932+0000 7f695bfff700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 0x7f693c055a40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f694c00d000 tx=0x7f694c001a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:36.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:36.936+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f695c153ee0 con 0x7f695c05fb00 2021-10-21T00:12:37.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.064+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f695c153ee0 con 0x7f695c05fb00 2021-10-21T00:12:37.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.064+0000 7f6959ffb700 1 -- 172.21.15.41:0/1642668339 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f695c153ee0 con 0x7f695c05fb00 2021-10-21T00:12:37.076 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:37.076 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":145,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:34.611140+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:32.085660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:33.246025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:37.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 msgr2=0x7f693c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 0x7f693c055a40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f694c00d000 tx=0x7f694c001a10).stop 2021-10-21T00:12:37.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 msgr2=0x7f695c064f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f694c001820 tx=0x7f6954016000).stop 2021-10-21T00:12:37.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 shutdown_connections 2021-10-21T00:12:37.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f693c053580 0x7f693c055a40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f695c143000 0x7f695c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c142480 0x7f695c0acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 --2- 172.21.15.41:0/1642668339 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f695c05fb00 0x7f695c064f10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 >> 172.21.15.41:0/1642668339 conn(0x7f695c0b5700 msgr2=0x7f695c067730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 shutdown_connections 2021-10-21T00:12:37.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.068+0000 7f6961b64700 1 -- 172.21.15.41:0/1642668339 wait complete. 2021-10-21T00:12:37.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:12:32.085660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:12:33.246025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:12:37.091 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:37.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.192+0000 7fd57c65a700 1 Processor -- start 2021-10-21T00:12:37.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.192+0000 7fd57c65a700 1 -- start start 2021-10-21T00:12:37.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd574146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd5740617f0 0x7fd574061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740adea0 con 0x7fd5740ac890 2021-10-21T00:12:37.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740b77a0 con 0x7fd5740617f0 2021-10-21T00:12:37.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd574067bc0 con 0x7fd57413ca50 2021-10-21T00:12:37.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd5740617f0 0x7fd574061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd5740617f0 0x7fd574061c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38908/0 (socket says 172.21.15.41:38908) 2021-10-21T00:12:37.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd579bf5700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd5740ac890 0x7fd5740ad790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36678/0 (socket says 172.21.15.41:36678) 2021-10-21T00:12:37.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 -- 172.21.15.41:0/2338443401 learned_addr learned my addr 172.21.15.41:0/2338443401 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:37.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57a3f6700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd574146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 -- 172.21.15.41:0/2338443401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 msgr2=0x7fd574146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:37.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd574146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 -- 172.21.15.41:0/2338443401 >> v1:172.21.15.41:6789/0 conn(0x7fd5740ac890 legacy=0x7fd5740ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd5793f4700 1 -- 172.21.15.41:0/2338443401 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862549337 0 0) 0x7fd5740adea0 con 0x7fd5740ac890 2021-10-21T00:12:37.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 -- 172.21.15.41:0/2338443401 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740b6fc0 con 0x7fd5740617f0 2021-10-21T00:12:37.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57abf7700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740617f0 0x7fd574061c40 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fd56c0032f0 tx=0x7fd56c009290).ready entity=mon.0 client_cookie=24d7f511a8d574a6 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd5793f4700 1 -- 172.21.15.41:0/2338443401 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c00b8a0 con 0x7fd5740617f0 2021-10-21T00:12:37.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd5793f4700 1 -- 172.21.15.41:0/2338443401 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00ba00 con 0x7fd5740617f0 2021-10-21T00:12:37.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd5793f4700 1 -- 172.21.15.41:0/2338443401 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c00bb70 con 0x7fd5740617f0 2021-10-21T00:12:37.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- 172.21.15.41:0/2338443401 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740617f0 msgr2=0x7fd574061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740617f0 0x7fd574061c40 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fd56c0032f0 tx=0x7fd56c009290).stop 2021-10-21T00:12:37.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- 172.21.15.41:0/2338443401 shutdown_connections 2021-10-21T00:12:37.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740617f0 0x7fd574061c40 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 --2- 172.21.15.41:0/2338443401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd574146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- 172.21.15.41:0/2338443401 >> 172.21.15.41:0/2338443401 conn(0x7fd574069df0 msgr2=0x7fd574064980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- 172.21.15.41:0/2338443401 shutdown_connections 2021-10-21T00:12:37.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.196+0000 7fd57c65a700 1 -- 172.21.15.41:0/2338443401 wait complete. 2021-10-21T00:12:37.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 Processor -- start 2021-10-21T00:12:37.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 -- start start 2021-10-21T00:12:37.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 0x7fd57413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 0x7fd57413d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd5741551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5741424b0 con 0x7fd5740ac890 2021-10-21T00:12:37.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574152b00 con 0x7fd5740617f0 2021-10-21T00:12:37.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57c65a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57413f380 con 0x7fd57413ca50 2021-10-21T00:12:37.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd579bf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 0x7fd57413d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57abf7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd5741551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd57a3f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 0x7fd57413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd579bf5700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 0x7fd57413d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38914/0 (socket says 172.21.15.41:38914) 2021-10-21T00:12:37.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.200+0000 7fd579bf5700 1 -- 172.21.15.41:0/4288923674 learned_addr learned my addr 172.21.15.41:0/4288923674 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:37.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 -- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 msgr2=0x7fd57413ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 0x7fd57413ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 -- 172.21.15.41:0/4288923674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 msgr2=0x7fd57413d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 0x7fd57413d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 -- 172.21.15.41:0/4288923674 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c009530 con 0x7fd57413ca50 2021-10-21T00:12:37.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57a3f6700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 0x7fd57413ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:37.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57abf7700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd5741551b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fd56c0032f0 tx=0x7fd56c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c00b8a0 con 0x7fd57413ca50 2021-10-21T00:12:37.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c021630 con 0x7fd57413ca50 2021-10-21T00:12:37.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574152660 con 0x7fd57413ca50 2021-10-21T00:12:37.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56c021990 con 0x7fd57413ca50 2021-10-21T00:12:37.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57413d660 con 0x7fd57413ca50 2021-10-21T00:12:37.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd56c00f070 con 0x7fd57413ca50 2021-10-21T00:12:37.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd574144640 con 0x7fd57413ca50 2021-10-21T00:12:37.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 0x7fd554055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd56c06ca90 con 0x7fd57413ca50 2021-10-21T00:12:37.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.204+0000 7fd57a3f6700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 0x7fd554055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.208+0000 7fd57a3f6700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 0x7fd554055b00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fd57000b000 tx=0x7fd570006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.212+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd56c043b50 con 0x7fd57413ca50 2021-10-21T00:12:37.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.340+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd5741527f0 con 0x7fd57413ca50 2021-10-21T00:12:37.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.340+0000 7fd5637fe700 1 -- 172.21.15.41:0/4288923674 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd56c015070 con 0x7fd57413ca50 2021-10-21T00:12:37.351 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:37.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 msgr2=0x7fd554055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 0x7fd554055b00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fd57000b000 tx=0x7fd570006df0).stop 2021-10-21T00:12:37.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 msgr2=0x7fd5741551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd5741551b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fd56c0032f0 tx=0x7fd56c016000).stop 2021-10-21T00:12:37.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 shutdown_connections 2021-10-21T00:12:37.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd554053640 0x7fd554055b00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd57413ca50 0x7fd5741551b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd5740ac890 0x7fd57413d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 --2- 172.21.15.41:0/4288923674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5740617f0 0x7fd57413ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 >> 172.21.15.41:0/4288923674 conn(0x7fd574069df0 msgr2=0x7fd57413b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 shutdown_connections 2021-10-21T00:12:37.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.344+0000 7fd57c65a700 1 -- 172.21.15.41:0/4288923674 wait complete. 2021-10-21T00:12:37.369 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:37.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 Processor -- start 2021-10-21T00:12:37.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 -- start start 2021-10-21T00:12:37.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 0x7f975414b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540b4760 con 0x7f97540b1830 2021-10-21T00:12:37.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540ad4c0 con 0x7f97540b4380 2021-10-21T00:12:37.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975b20e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97540ad760 con 0x7f9754149240 2021-10-21T00:12:37.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f9759a0b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f97540b1830 0x7f975405fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36690/0 (socket says 172.21.15.41:36690) 2021-10-21T00:12:37.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f9759a0b700 1 -- 172.21.15.41:0/2668665025 learned_addr learned my addr 172.21.15.41:0/2668665025 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:37.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975aa0d700 1 --2- 172.21.15.41:0/2668665025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 0x7f975414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106880228 0 0) 0x7f97540b4760 con 0x7f97540b1830 2021-10-21T00:12:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973c003260 con 0x7f97540b1830 2021-10-21T00:12:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636017227 0 0) 0x7f97540ad4c0 con 0x7f97540b4380 2021-10-21T00:12:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97540b4760 con 0x7f97540b4380 2021-10-21T00:12:37.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975aa0d700 1 -- 172.21.15.41:0/2668665025 >> v1:172.21.15.62:6789/0 conn(0x7f97540b4380 legacy=0x7f975405f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975aa0d700 1 -- 172.21.15.41:0/2668665025 >> v1:172.21.15.41:6789/0 conn(0x7f97540b1830 legacy=0x7f975405fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69155605 0 0) 0x7f973c003260 con 0x7f97540b1830 2021-10-21T00:12:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975aa0d700 1 -- 172.21.15.41:0/2668665025 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540ada00 con 0x7f9754149240 2021-10-21T00:12:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975aa0d700 1 --2- 172.21.15.41:0/2668665025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 0x7f975414b630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f974c0032f0 tx=0x7f974c0091d0).ready entity=mon.2 client_cookie=7e5bdaaf0776cf17 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c00b640 con 0x7f9754149240 2021-10-21T00:12:37.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c00b7a0 con 0x7f9754149240 2021-10-21T00:12:37.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.464+0000 7f975920a700 1 -- 172.21.15.41:0/2668665025 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c00b910 con 0x7f9754149240 2021-10-21T00:12:37.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- 172.21.15.41:0/2668665025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 msgr2=0x7f975414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 --2- 172.21.15.41:0/2668665025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 0x7f975414b630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f974c0032f0 tx=0x7f974c0091d0).stop 2021-10-21T00:12:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- 172.21.15.41:0/2668665025 shutdown_connections 2021-10-21T00:12:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 --2- 172.21.15.41:0/2668665025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9754149240 0x7f975414b630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- 172.21.15.41:0/2668665025 >> 172.21.15.41:0/2668665025 conn(0x7f97540b7910 msgr2=0x7f97540b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- 172.21.15.41:0/2668665025 shutdown_connections 2021-10-21T00:12:37.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- 172.21.15.41:0/2668665025 wait complete. 2021-10-21T00:12:37.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 Processor -- start 2021-10-21T00:12:37.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- start start 2021-10-21T00:12:37.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 0x7f97541340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97540b4380 0x7f975413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975413ff60 con 0x7f9754149240 2021-10-21T00:12:37.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975413fb90 con 0x7f97540b1830 2021-10-21T00:12:37.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975b20e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9754140640 con 0x7f97540b4380 2021-10-21T00:12:37.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975aa0d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975aa0d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38928/0 (socket says 172.21.15.41:38928) 2021-10-21T00:12:37.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975aa0d700 1 -- 172.21.15.41:0/3723914586 learned_addr learned my addr 172.21.15.41:0/3723914586 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:37.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f975a20c700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 0x7f97541340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.468+0000 7f9759a0b700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97540b4380 0x7f975413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 -- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97540b4380 msgr2=0x7f975413a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97540b4380 0x7f975413a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 -- 172.21.15.41:0/3723914586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 msgr2=0x7f975409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 -- 172.21.15.41:0/3723914586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c009470 con 0x7f97540b1830 2021-10-21T00:12:37.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975aa0d700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:37.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975a20c700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 0x7f97541340f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f9754099f50 tx=0x7f9748007a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9748012400 con 0x7f97540b1830 2021-10-21T00:12:37.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748012560 con 0x7f97540b1830 2021-10-21T00:12:37.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975413f8f0 con 0x7f97540b1830 2021-10-21T00:12:37.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97480128c0 con 0x7f97540b1830 2021-10-21T00:12:37.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975409a6e0 con 0x7f97540b1830 2021-10-21T00:12:37.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754099f90 con 0x7f97540b1830 2021-10-21T00:12:37.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9748019030 con 0x7f97540b1830 2021-10-21T00:12:37.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 0x7f9734055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f974806abd0 con 0x7f97540b1830 2021-10-21T00:12:37.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.472+0000 7f9759a0b700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 0x7f9734055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.476+0000 7f9759a0b700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 0x7f9734055b60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f975000d000 tx=0x7f9750001740).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.484+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9748041c90 con 0x7f97540b1830 2021-10-21T00:12:37.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.608+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9754057350 con 0x7f97540b1830 2021-10-21T00:12:37.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.608+0000 7f97477fe700 1 -- 172.21.15.41:0/3723914586 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97480452b0 con 0x7f97540b1830 2021-10-21T00:12:37.621 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 msgr2=0x7f9734055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 0x7f9734055b60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f975000d000 tx=0x7f9750001740).stop 2021-10-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 msgr2=0x7f97541340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 0x7f97541340f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f9754099f50 tx=0x7f9748007a20).stop 2021-10-21T00:12:37.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 shutdown_connections 2021-10-21T00:12:37.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f97340536a0 0x7f9734055b60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f9754149240 0x7f975409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97540b4380 0x7f975413a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 --2- 172.21.15.41:0/3723914586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97540b1830 0x7f97541340f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 >> 172.21.15.41:0/3723914586 conn(0x7f97540b7910 msgr2=0x7f9754066890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 shutdown_connections 2021-10-21T00:12:37.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.612+0000 7f975b20e700 1 -- 172.21.15.41:0/3723914586 wait complete. 2021-10-21T00:12:37.640 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:12:37.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 Processor -- start 2021-10-21T00:12:37.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 -- start start 2021-10-21T00:12:37.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5e40b3d30 0x7fe5e4146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e40adb80 0x7fe5e4061b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.754 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe5e4061ff0 0x7fe5e4142050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40acde0 con 0x7fe5e4061ff0 2021-10-21T00:12:37.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40b4110 con 0x7fe5e40b3d30 2021-10-21T00:12:37.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40acb40 con 0x7fe5e40adb80 2021-10-21T00:12:37.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe5e4061ff0 0x7fe5e4142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fe5e4061ff0 0x7fe5e4142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38936/0 (socket says 172.21.15.41:38936) 2021-10-21T00:12:37.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 -- 172.21.15.41:0/3960067779 learned_addr learned my addr 172.21.15.41:0/3960067779 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:37.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e2ffd700 1 --2- 172.21.15.41:0/3960067779 >> v2:172.21.15.62:3300/0 conn(0x7fe5e40b3d30 0x7fe5e4146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e27fc700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e40adb80 0x7fe5e4061b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 -- 172.21.15.41:0/3960067779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e40adb80 msgr2=0x7fe5e4061b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:37.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e40adb80 0x7fe5e4061b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 -- 172.21.15.41:0/3960067779 >> v2:172.21.15.62:3300/0 conn(0x7fe5e40b3d30 msgr2=0x7fe5e4146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:37.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 --2- 172.21.15.41:0/3960067779 >> v2:172.21.15.62:3300/0 conn(0x7fe5e40b3d30 0x7fe5e4146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 -- 172.21.15.41:0/3960067779 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4061660 con 0x7fe5e4061ff0 2021-10-21T00:12:37.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e37fe700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e4061ff0 0x7fe5e4142050 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fe5dc0032f0 tx=0x7fe5dc009290).ready entity=mon.0 client_cookie=9b582c1f061308d9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e1ffb700 1 -- 172.21.15.41:0/3960067779 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5dc00b870 con 0x7fe5e4061ff0 2021-10-21T00:12:37.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e1ffb700 1 -- 172.21.15.41:0/3960067779 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00b9d0 con 0x7fe5e4061ff0 2021-10-21T00:12:37.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e1ffb700 1 -- 172.21.15.41:0/3960067779 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5dc00bb40 con 0x7fe5e4061ff0 2021-10-21T00:12:37.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.740+0000 7fe5e9344700 1 -- 172.21.15.41:0/3960067779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e4061ff0 msgr2=0x7fe5e4142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e4061ff0 0x7fe5e4142050 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fe5dc0032f0 tx=0x7fe5dc009290).stop 2021-10-21T00:12:37.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3960067779 shutdown_connections 2021-10-21T00:12:37.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e4061ff0 0x7fe5e4142050 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3960067779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e40adb80 0x7fe5e4061b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3960067779 >> v2:172.21.15.62:3300/0 conn(0x7fe5e40b3d30 0x7fe5e4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3960067779 >> 172.21.15.41:0/3960067779 conn(0x7fe5e4064910 msgr2=0x7fe5e4064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3960067779 shutdown_connections 2021-10-21T00:12:37.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3960067779 wait complete. 2021-10-21T00:12:37.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 Processor -- start 2021-10-21T00:12:37.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- start start 2021-10-21T00:12:37.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 0x7fe5e4143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5e40b3d30 0x7fe5e40b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40b09e0 con 0x7fe5e40adb80 2021-10-21T00:12:37.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4155930 con 0x7fe5e40b3d30 2021-10-21T00:12:37.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e4155b50 con 0x7fe5e4061ff0 2021-10-21T00:12:37.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38940/0 (socket says 172.21.15.41:38940) 2021-10-21T00:12:37.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 -- 172.21.15.41:0/3862568614 learned_addr learned my addr 172.21.15.41:0/3862568614 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:37.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e37fe700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5e40b3d30 0x7fe5e40b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e2ffd700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 0x7fe5e4143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 -- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 msgr2=0x7fe5e4143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 0x7fe5e4143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 -- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5e40b3d30 msgr2=0x7fe5e40b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5e40b3d30 0x7fe5e40b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 -- 172.21.15.41:0/3862568614 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc009530 con 0x7fe5e40adb80 2021-10-21T00:12:37.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e2ffd700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 0x7fe5e4143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:37.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e27fc700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fe5d40030b0 tx=0x7fe5d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d4011780 con 0x7fe5e40adb80 2021-10-21T00:12:37.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e4155df0 con 0x7fe5e40adb80 2021-10-21T00:12:37.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d40118e0 con 0x7fe5e40adb80 2021-10-21T00:12:37.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d4011c40 con 0x7fe5e40adb80 2021-10-21T00:12:37.769 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.744+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e40b50d0 con 0x7fe5e40adb80 2021-10-21T00:12:37.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5d4012420 con 0x7fe5e40adb80 2021-10-21T00:12:37.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5d3fff700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 0x7fe5c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:37.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e41466f0 con 0x7fe5e40adb80 2021-10-21T00:12:37.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe5d406bbe0 con 0x7fe5e40adb80 2021-10-21T00:12:37.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5e2ffd700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 0x7fe5c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:37.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.748+0000 7fe5e2ffd700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 0x7fe5c0055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe5d800c000 tx=0x7fe5d8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:37.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.756+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5d4042c40 con 0x7fe5e40adb80 2021-10-21T00:12:37.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5e4057350 con 0x7fe5e40adb80 2021-10-21T00:12:37.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5d3fff700 1 -- 172.21.15.41:0/3862568614 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe5d4046260 con 0x7fe5e40adb80 2021-10-21T00:12:37.893 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:37.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 msgr2=0x7fe5c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 0x7fe5c0055ad0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe5d800c000 tx=0x7fe5d8008040).stop 2021-10-21T00:12:37.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 msgr2=0x7fe5e4155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:37.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fe5d40030b0 tx=0x7fe5d4008040).stop 2021-10-21T00:12:37.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 shutdown_connections 2021-10-21T00:12:37.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe5c0053610 0x7fe5c0055ad0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5e40b3d30 0x7fe5e40b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe5e40adb80 0x7fe5e4155440 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 --2- 172.21.15.41:0/3862568614 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5e4061ff0 0x7fe5e4143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:37.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 >> 172.21.15.41:0/3862568614 conn(0x7fe5e4064910 msgr2=0x7fe5e4141210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:37.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 shutdown_connections 2021-10-21T00:12:37.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:37.884+0000 7fe5e9344700 1 -- 172.21.15.41:0/3862568614 wait complete. 2021-10-21T00:12:37.906 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:12:38.008 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 Processor -- start 2021-10-21T00:12:38.009 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 -- start start 2021-10-21T00:12:38.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.011 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f99ac0b0730 0x7f99ac0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac05fdd0 con 0x7f99ac0b3150 2021-10-21T00:12:38.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac140400 con 0x7f99ac0b0730 2021-10-21T00:12:38.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b174f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0b27c0 con 0x7f99ac05f9f0 2021-10-21T00:12:38.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b0f4e700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f99ac0b3150 0x7f99ac142bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36718/0 (socket says 172.21.15.41:36718) 2021-10-21T00:12:38.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99b0f4e700 1 -- 172.21.15.41:0/735445670 learned_addr learned my addr 172.21.15.41:0/735445670 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:38.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 --2- 172.21.15.41:0/735445670 >> v2:172.21.15.41:3300/0 conn(0x7f99ac0b0730 0x7f99ac0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99abfff700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99aaffd700 1 -- 172.21.15.41:0/735445670 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936441133 0 0) 0x7f99ac05fdd0 con 0x7f99ac0b3150 2021-10-21T00:12:38.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99aaffd700 1 -- 172.21.15.41:0/735445670 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9998003260 con 0x7f99ac0b3150 2021-10-21T00:12:38.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 -- 172.21.15.41:0/735445670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 msgr2=0x7f99ac0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:38.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.014 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 -- 172.21.15.41:0/735445670 >> v1:172.21.15.41:6789/0 conn(0x7f99ac0b3150 legacy=0x7f99ac142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 -- 172.21.15.41:0/735445670 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0b35a0 con 0x7f99ac0b0730 2021-10-21T00:12:38.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99abfff700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:38.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99ab7fe700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b0730 0x7f99ac0b2c60 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f99ac05ff60 tx=0x7f99a0006df0).ready entity=mon.0 client_cookie=368b6f7d1e5bec61 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99aaffd700 1 -- 172.21.15.41:0/735445670 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a000d570 con 0x7f99ac0b0730 2021-10-21T00:12:38.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99aaffd700 1 -- 172.21.15.41:0/735445670 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0000e90 con 0x7f99ac0b0730 2021-10-21T00:12:38.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.000+0000 7f99aaffd700 1 -- 172.21.15.41:0/735445670 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a000d8c0 con 0x7f99ac0b0730 2021-10-21T00:12:38.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- 172.21.15.41:0/735445670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b0730 msgr2=0x7f99ac0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b0730 0x7f99ac0b2c60 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f99ac05ff60 tx=0x7f99a0006df0).stop 2021-10-21T00:12:38.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- 172.21.15.41:0/735445670 shutdown_connections 2021-10-21T00:12:38.023 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b0730 0x7f99ac0b2c60 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- 172.21.15.41:0/735445670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- 172.21.15.41:0/735445670 >> 172.21.15.41:0/735445670 conn(0x7f99ac0637b0 msgr2=0x7f99ac063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:38.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- 172.21.15.41:0/735445670 shutdown_connections 2021-10-21T00:12:38.024 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- 172.21.15.41:0/735445670 wait complete. 2021-10-21T00:12:38.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 Processor -- start 2021-10-21T00:12:38.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- start start 2021-10-21T00:12:38.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac067110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0b0730 0x7f99ac13be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac066750 con 0x7f99ac0b3150 2021-10-21T00:12:38.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0653d0 con 0x7f99ac0b0730 2021-10-21T00:12:38.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b174f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac065870 con 0x7f99ac05f9f0 2021-10-21T00:12:38.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b0f4e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b0f4e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38954/0 (socket says 172.21.15.41:38954) 2021-10-21T00:12:38.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99b0f4e700 1 -- 172.21.15.41:0/3599265136 learned_addr learned my addr 172.21.15.41:0/3599265136 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:38.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99abfff700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.004+0000 7f99ab7fe700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0b0730 0x7f99ac13be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 -- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 msgr2=0x7f99ac067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 -- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0b0730 msgr2=0x7f99ac13be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0b0730 0x7f99ac13be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 -- 172.21.15.41:0/3599265136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c00b120 con 0x7f99ac0b3150 2021-10-21T00:12:38.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99abfff700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:38.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b0f4e700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f99a4001490 tx=0x7f99a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a4005ba0 con 0x7f99ac0b3150 2021-10-21T00:12:38.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4005d00 con 0x7f99ac0b3150 2021-10-21T00:12:38.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a000b180 con 0x7f99ac0b3150 2021-10-21T00:12:38.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a40072c0 con 0x7f99ac0b3150 2021-10-21T00:12:38.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac065b60 con 0x7f99ac0b3150 2021-10-21T00:12:38.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac065590 con 0x7f99ac0b3150 2021-10-21T00:12:38.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99a4010070 con 0x7f99ac0b3150 2021-10-21T00:12:38.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 0x7f998c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f99a406b3e0 con 0x7f99ac0b3150 2021-10-21T00:12:38.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99abfff700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 0x7f998c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.008+0000 7f99abfff700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 0x7f998c0559b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f999c008000 tx=0x7f999c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.020+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99a40424a0 con 0x7f99ac0b3150 2021-10-21T00:12:38.155 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.144+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99ac066950 con 0x7f99ac0b3150 2021-10-21T00:12:38.156 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.144+0000 7f99a97fa700 1 -- 172.21.15.41:0/3599265136 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+10 (secure 0 0 0) 0x7f99a4045ac0 con 0x7f99ac0b3150 2021-10-21T00:12:38.156 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:38.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 msgr2=0x7f998c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 0x7f998c0559b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f999c008000 tx=0x7f999c008040).stop 2021-10-21T00:12:38.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 msgr2=0x7f99ac13c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f99a4001490 tx=0x7f99a4007e00).stop 2021-10-21T00:12:38.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 shutdown_connections 2021-10-21T00:12:38.158 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f998c0534f0 0x7f998c0559b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f99ac0b3150 0x7f99ac13c300 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0b0730 0x7f99ac13be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 --2- 172.21.15.41:0/3599265136 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99ac05f9f0 0x7f99ac067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.159 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 >> 172.21.15.41:0/3599265136 conn(0x7f99ac0637b0 msgr2=0x7f99ac05c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:38.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 shutdown_connections 2021-10-21T00:12:38.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.148+0000 7f99b174f700 1 -- 172.21.15.41:0/3599265136 wait complete. 2021-10-21T00:12:38.169 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:12:38.169 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:38.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.260+0000 7f093c656700 1 Processor -- start 2021-10-21T00:12:38.272 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.260+0000 7f093c656700 1 -- start start 2021-10-21T00:12:38.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f09341424d0 0x7f09340ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b19e0 0x7f09340b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.275 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340b0c20 con 0x7f09340b6120 2021-10-21T00:12:38.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340b6500 con 0x7f09341424d0 2021-10-21T00:12:38.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093405cf40 con 0x7f09340b19e0 2021-10-21T00:12:38.276 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f09341424d0 0x7f09340ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f09341424d0 0x7f09340ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38960/0 (socket says 172.21.15.41:38960) 2021-10-21T00:12:38.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 -- 172.21.15.41:0/1964168739 learned_addr learned my addr 172.21.15.41:0/1964168739 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:38.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093abf3700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b19e0 0x7f09340b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.277 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 -- 172.21.15.41:0/1964168739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b19e0 msgr2=0x7f09340b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:38.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b19e0 0x7f09340b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 -- 172.21.15.41:0/1964168739 >> v1:172.21.15.62:6789/0 conn(0x7f09340b6120 legacy=0x7f09340adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 -- 172.21.15.41:0/1964168739 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093405d1e0 con 0x7f09341424d0 2021-10-21T00:12:38.278 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f0939bf1700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340ae6b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0928002f70 tx=0x7f0928006eb0).ready entity=mon.0 client_cookie=76439c59488ebfed server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f09393f0700 1 -- 172.21.15.41:0/1964168739 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092800d570 con 0x7f09341424d0 2021-10-21T00:12:38.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f09393f0700 1 -- 172.21.15.41:0/1964168739 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928000e90 con 0x7f09341424d0 2021-10-21T00:12:38.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f09393f0700 1 -- 172.21.15.41:0/1964168739 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092800d900 con 0x7f09341424d0 2021-10-21T00:12:38.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- 172.21.15.41:0/1964168739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 msgr2=0x7f09340ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.280 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340ae6b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f0928002f70 tx=0x7f0928006eb0).stop 2021-10-21T00:12:38.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- 172.21.15.41:0/1964168739 shutdown_connections 2021-10-21T00:12:38.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b19e0 0x7f09340b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 --2- 172.21.15.41:0/1964168739 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340ae6b0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.282 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- 172.21.15.41:0/1964168739 >> 172.21.15.41:0/1964168739 conn(0x7f0934063ae0 msgr2=0x7f09340b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:38.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- 172.21.15.41:0/1964168739 shutdown_connections 2021-10-21T00:12:38.283 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.264+0000 7f093c656700 1 -- 172.21.15.41:0/1964168739 wait complete. 2021-10-21T00:12:38.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 Processor -- start 2021-10-21T00:12:38.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 -- start start 2021-10-21T00:12:38.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09340b19e0 0x7f09340643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b6120 0x7f093414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934129c30 con 0x7f09341424d0 2021-10-21T00:12:38.287 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934066710 con 0x7f09340b19e0 2021-10-21T00:12:38.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093c656700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340669b0 con 0x7f09340b6120 2021-10-21T00:12:38.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38970/0 (socket says 172.21.15.41:38970) 2021-10-21T00:12:38.288 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 -- 172.21.15.41:0/1215150578 learned_addr learned my addr 172.21.15.41:0/1215150578 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:38.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093a3f2700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09340b19e0 0x7f09340643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f0939bf1700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b6120 0x7f093414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 -- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b6120 msgr2=0x7f093414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b6120 0x7f093414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.289 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 -- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09340b19e0 msgr2=0x7f09340643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.268+0000 7f093abf3700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09340b19e0 0x7f09340643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093abf3700 1 -- 172.21.15.41:0/1215150578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092800b1e0 con 0x7f09341424d0 2021-10-21T00:12:38.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093abf3700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f092c006e00 tx=0x7f092c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.290 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092c00c640 con 0x7f09341424d0 2021-10-21T00:12:38.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00c7a0 con 0x7f09341424d0 2021-10-21T00:12:38.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092c00cb00 con 0x7f09341424d0 2021-10-21T00:12:38.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340b0e50 con 0x7f09341424d0 2021-10-21T00:12:38.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0934150330 con 0x7f09341424d0 2021-10-21T00:12:38.291 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934066b70 con 0x7f09341424d0 2021-10-21T00:12:38.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f092c00cc60 con 0x7f09341424d0 2021-10-21T00:12:38.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 0x7f09140559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:38.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f092c06bb40 con 0x7f09341424d0 2021-10-21T00:12:38.292 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.272+0000 7f093a3f2700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 0x7f09140559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:38.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.276+0000 7f093a3f2700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 0x7f09140559b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f093000d000 tx=0x7f0930007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:38.293 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.280+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f092c042ca0 con 0x7f09341424d0 2021-10-21T00:12:38.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0934057350 con 0x7f09341424d0 2021-10-21T00:12:38.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f09277fe700 1 -- 172.21.15.41:0/1215150578 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f092c0462c0 con 0x7f09341424d0 2021-10-21T00:12:38.454 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:38.454 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:34.610443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8781":{"gid":8781,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/680865420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":680865420},{"type":"v1","addr":"172.21.15.41:6833","nonce":680865420}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:38.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 msgr2=0x7f09140559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 0x7f09140559b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f093000d000 tx=0x7f0930007b90).stop 2021-10-21T00:12:38.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 msgr2=0x7f09340b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:38.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f092c006e00 tx=0x7f092c0091d0).stop 2021-10-21T00:12:38.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 shutdown_connections 2021-10-21T00:12:38.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f09140534f0 0x7f09140559b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f09341424d0 0x7f09340b47d0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09340b6120 0x7f093414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 --2- 172.21.15.41:0/1215150578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09340b19e0 0x7f09340643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:38.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.444+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 >> 172.21.15.41:0/1215150578 conn(0x7f0934063ae0 msgr2=0x7f09340adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:38.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.448+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 shutdown_connections 2021-10-21T00:12:38.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:38.448+0000 7f093c656700 1 -- 172.21.15.41:0/1215150578 wait complete. 2021-10-21T00:12:38.460 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 77 2021-10-21T00:12:38.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:33.607687+0000', 'modified': '2021-10-21T00:12:34.610443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8781': {'gid': 8781, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/680865420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 680865420}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 680865420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:38.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:38.670 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:12:38.787 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8781,"want_state":"up:active","state":"up:active","rank_uptime":5.1614045050000001,"mdsmap_epoch":77,"osdmap_epoch":145,"osdmap_epoch_barrier":144,"uptime":9.5166517249999991} 2021-10-21T00:12:38.787 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8781, "mdsmap_epoch": 77, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "rank_uptime": 5.161404505, "state": "up:active", "uptime": 9.516651725, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:38.788 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:12:38.788 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-10-21T00:12:38.788 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi071.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-10-21T00:12:38.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:38.789 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:38.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:38.859 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:38.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:38.870 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:38.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:38.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:38.872 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:38.879 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:12:38.880 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:38.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:38.901 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:38.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:38.919 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:38.921 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:38.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:38.922 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:38.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2021-10-21T00:12:38.949+0000 7f4d204cb080 -1 init, newargv = 0x562ea4cbfee0 newargc=9ceph-fuse[15227]: starting ceph client 2021-10-21T00:12:38.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr: 2021-10-21T00:12:38.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[15227]: starting fuse 2021-10-21T00:12:40.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2021-10-21T00:12:40.084 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:40.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:40.140 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:40.141 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:40.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:40.143 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2021-10-21T00:12:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:52 2021-10-21T00:12:40.148 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:12:40.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:40.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo python3 -c ' 2021-10-21T00:12:40.149 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2021-10-21T00:12:40.150 DEBUG:teuthology.orchestra.run.smithi071:> import re 2021-10-21T00:12:40.150 DEBUG:teuthology.orchestra.run.smithi071:> import os 2021-10-21T00:12:40.151 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2021-10-21T00:12:40.151 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:40.151 DEBUG:teuthology.orchestra.run.smithi071:> def find_socket(client_name): 2021-10-21T00:12:40.152 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-10-21T00:12:40.152 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2021-10-21T00:12:40.153 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:40.153 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2021-10-21T00:12:40.154 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2021-10-21T00:12:40.154 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2021-10-21T00:12:40.154 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2021-10-21T00:12:40.155 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:40.156 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2021-10-21T00:12:40.156 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:12:40.156 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:12:40.157 DEBUG:teuthology.orchestra.run.smithi071:> return f 2021-10-21T00:12:40.157 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:12:40.158 DEBUG:teuthology.orchestra.run.smithi071:> 2021-10-21T00:12:40.158 DEBUG:teuthology.orchestra.run.smithi071:> print(find_socket("client.0")) 2021-10-21T00:12:40.158 DEBUG:teuthology.orchestra.run.smithi071:> ' 2021-10-21T00:12:40.233 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.15227.asok 2021-10-21T00:12:40.238 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15227.asok 2021-10-21T00:12:40.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:40.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15227.asok status 2021-10-21T00:12:40.330 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2021-10-21T00:12:40.330 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2021-10-21T00:12:40.331 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:12:40.331 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:12:40.331 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2021-10-21T00:12:40.331 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2021-10-21T00:12:40.332 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-10-21T00:12:40.332 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "15227", 2021-10-21T00:12:40.332 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2021-10-21T00:12:40.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:40.332 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2021-10-21T00:12:40.333 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2021-10-21T00:12:40.333 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 7610, 2021-10-21T00:12:40.333 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2021-10-21T00:12:40.333 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2021-10-21T00:12:40.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2021-10-21T00:12:40.334 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 7610 2021-10-21T00:12:40.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:40.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:12:40.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:12:40.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:12:40.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 177664763 2021-10-21T00:12:40.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2021-10-21T00:12:40.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:40.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2021-10-21T00:12:40.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2021-10-21T00:12:40.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:0", 2021-10-21T00:12:40.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 177664763 2021-10-21T00:12:40.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2021-10-21T00:12:40.337 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.7610 172.21.15.71:0/177664763", 2021-10-21T00:12:40.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "172.21.15.71:0/177664763", 2021-10-21T00:12:40.337 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2021-10-21T00:12:40.338 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 77, 2021-10-21T00:12:40.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 145, 2021-10-21T00:12:40.342 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:12:40.343 INFO:teuthology.orchestra.run.smithi071.stdout: "blacklisted": false, 2021-10-21T00:12:40.343 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2021-10-21T00:12:40.343 INFO:teuthology.orchestra.run.smithi071.stdout:} 2021-10-21T00:12:40.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:40.345 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:40.346 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:40.353 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2021-10-21T00:12:40.354 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-10-21T00:12:40.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:40.356 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:12:40.417 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:12:40.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 Processor -- start 2021-10-21T00:12:40.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 -- start start 2021-10-21T00:12:40.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc0dc0b2170 0x7fc0dc0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 0x7fc0dc149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0b0b50 con 0x7fc0dc0af620 2021-10-21T00:12:40.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b2550 con 0x7fc0dc0b2170 2021-10-21T00:12:40.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.520+0000 7fc0dbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b0d90 con 0x7fc0dc067a80 2021-10-21T00:12:40.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0db7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 0x7fc0dc149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc0dc0b2170 0x7fc0dc0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0da7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc0dc0af620 0x7fc0dc0ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44800/0 (socket says 172.21.15.41:44800) 2021-10-21T00:12:40.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0db7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 0x7fc0dc149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57476/0 (socket says 172.21.15.41:57476) 2021-10-21T00:12:40.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0da7fc700 1 -- 172.21.15.41:0/711725970 learned_addr learned my addr 172.21.15.41:0/711725970 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:40.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 -- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 msgr2=0x7fc0dc149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:40.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 --2- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 0x7fc0dc149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 -- 172.21.15.41:0/711725970 >> v1:172.21.15.62:6789/0 conn(0x7fc0dc0af620 legacy=0x7fc0dc0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 -- 172.21.15.41:0/711725970 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0b1030 con 0x7fc0dc0b2170 2021-10-21T00:12:40.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0daffd700 1 --2- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc0ab170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc0d0002f70 tx=0x7fc0d0006df0).ready entity=mon.1 client_cookie=dd7576331f73f90a server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0d9ffb700 1 -- 172.21.15.41:0/711725970 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d000d570 con 0x7fc0dc0b2170 2021-10-21T00:12:40.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0d9ffb700 1 -- 172.21.15.41:0/711725970 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0000e90 con 0x7fc0dc0b2170 2021-10-21T00:12:40.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0d9ffb700 1 -- 172.21.15.41:0/711725970 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d000d8c0 con 0x7fc0dc0b2170 2021-10-21T00:12:40.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 -- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 msgr2=0x7fc0dc0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc0ab170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc0d0002f70 tx=0x7fc0d0006df0).stop 2021-10-21T00:12:40.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 -- 172.21.15.41:0/711725970 shutdown_connections 2021-10-21T00:12:40.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc067a80 0x7fc0dc149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/711725970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc0ab170 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 -- 172.21.15.41:0/711725970 >> 172.21.15.41:0/711725970 conn(0x7fc0dc0b5700 msgr2=0x7fc0dc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:40.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 -- 172.21.15.41:0/711725970 shutdown_connections 2021-10-21T00:12:40.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.524+0000 7fc0dbfff700 1 -- 172.21.15.41:0/711725970 wait complete. 2021-10-21T00:12:40.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 Processor -- start 2021-10-21T00:12:40.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 -- start start 2021-10-21T00:12:40.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0af620 0x7fc0dc0ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1562a0 con 0x7fc0dc067a80 2021-10-21T00:12:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc159a20 con 0x7fc0dc0b2170 2021-10-21T00:12:40.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0dbfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1564c0 con 0x7fc0dc0af620 2021-10-21T00:12:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38980/0 (socket says 172.21.15.41:38980) 2021-10-21T00:12:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 -- 172.21.15.41:0/2835471554 learned_addr learned my addr 172.21.15.41:0/2835471554 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0db7fe700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0da7fc700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0af620 0x7fc0dc0ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 -- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0af620 msgr2=0x7fc0dc0ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0af620 0x7fc0dc0ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 -- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 msgr2=0x7fc0dc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 -- 172.21.15.41:0/2835471554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d000b180 con 0x7fc0dc067a80 2021-10-21T00:12:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0daffd700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fc0d0002f70 tx=0x7fc0d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d0016070 con 0x7fc0dc067a80 2021-10-21T00:12:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.528+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000de30 con 0x7fc0dc067a80 2021-10-21T00:12:40.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc0ad9e0 con 0x7fc0dc067a80 2021-10-21T00:12:40.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d0013da0 con 0x7fc0dc067a80 2021-10-21T00:12:40.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc0ac7e0 con 0x7fc0dc067a80 2021-10-21T00:12:40.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc159c20 con 0x7fc0dc067a80 2021-10-21T00:12:40.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0d0025030 con 0x7fc0dc067a80 2021-10-21T00:12:40.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0cbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 0x7fc0b8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc0d006c920 con 0x7fc0dc067a80 2021-10-21T00:12:40.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0da7fc700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 0x7fc0b8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.532+0000 7fc0da7fc700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 0x7fc0b8055b60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fc0cc00d000 tx=0x7fc0cc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.540+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0d0043a80 con 0x7fc0dc067a80 2021-10-21T00:12:40.675 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.664+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0dc159830 con 0x7fc0dc067a80 2021-10-21T00:12:40.676 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0cbfff700 1 -- 172.21.15.41:0/2835471554 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fc0d0023020 con 0x7fc0dc067a80 2021-10-21T00:12:40.677 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:40.677 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":145,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:34.611140+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-10-21T00:12:32.085660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-10-21T00:12:33.246025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:12:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 msgr2=0x7fc0b8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.679 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 0x7fc0b8055b60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fc0cc00d000 tx=0x7fc0cc009040).stop 2021-10-21T00:12:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 msgr2=0x7fc0dc1470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fc0d0002f70 tx=0x7fc0d0014000).stop 2021-10-21T00:12:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 shutdown_connections 2021-10-21T00:12:40.680 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0b80536a0 0x7fc0b8055b60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc0b2170 0x7fc0dc156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0af620 0x7fc0dc0ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 --2- 172.21.15.41:0/2835471554 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc067a80 0x7fc0dc1470b0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 >> 172.21.15.41:0/2835471554 conn(0x7fc0dc0b5700 msgr2=0x7fc0dc14c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:40.681 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 shutdown_connections 2021-10-21T00:12:40.682 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.668+0000 7fc0dbfff700 1 -- 172.21.15.41:0/2835471554 wait complete. 2021-10-21T00:12:40.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-10-21T00:02:44.355251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-10-21T00:02:53.369001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-10-21T00:12:32.085660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-10-21T00:12:33.246025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-10-21T00:12:40.691 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-10-21T00:12:40.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 Processor -- start 2021-10-21T00:12:40.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 -- start start 2021-10-21T00:12:40.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb33005c6f0 0x7fb3300aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb3300b1100 0x7fb330145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33005cad0 con 0x7fb3300b0560 2021-10-21T00:12:40.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300aece0 con 0x7fb3300b1100 2021-10-21T00:12:40.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb33625b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300ae300 con 0x7fb33005c6f0 2021-10-21T00:12:40.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fb3300b1100 0x7fb330145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32effd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fb3300b0560 0x7fb3300b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36760/0 (socket says 172.21.15.41:36760) 2021-10-21T00:12:40.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32effd700 1 -- 172.21.15.41:0/1039732370 learned_addr learned my addr 172.21.15.41:0/1039732370 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:40.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32f7fe700 1 --2- 172.21.15.41:0/1039732370 >> v2:172.21.15.62:3300/0 conn(0x7fb33005c6f0 0x7fb3300aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 -- 172.21.15.41:0/1039732370 >> v2:172.21.15.62:3300/0 conn(0x7fb33005c6f0 msgr2=0x7fb3300aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:40.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 --2- 172.21.15.41:0/1039732370 >> v2:172.21.15.62:3300/0 conn(0x7fb33005c6f0 0x7fb3300aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 -- 172.21.15.41:0/1039732370 >> v1:172.21.15.41:6789/0 conn(0x7fb3300b0560 legacy=0x7fb3300b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 -- 172.21.15.41:0/1039732370 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300ae5a0 con 0x7fb3300b1100 2021-10-21T00:12:40.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32ffff700 1 --2- 172.21.15.41:0/1039732370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb3300b1100 0x7fb330145dd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fb3280032f0 tx=0x7fb3280091d0).ready entity=mon.0 client_cookie=7c63b0ef785d7b91 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32e7fc700 1 -- 172.21.15.41:0/1039732370 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb32800b680 con 0x7fb3300b1100 2021-10-21T00:12:40.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32e7fc700 1 -- 172.21.15.41:0/1039732370 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32800b7e0 con 0x7fb3300b1100 2021-10-21T00:12:40.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.788+0000 7fb32e7fc700 1 -- 172.21.15.41:0/1039732370 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb32800b950 con 0x7fb3300b1100 2021-10-21T00:12:40.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- 172.21.15.41:0/1039732370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb3300b1100 msgr2=0x7fb330145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 --2- 172.21.15.41:0/1039732370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb3300b1100 0x7fb330145dd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fb3280032f0 tx=0x7fb3280091d0).stop 2021-10-21T00:12:40.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- 172.21.15.41:0/1039732370 shutdown_connections 2021-10-21T00:12:40.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 --2- 172.21.15.41:0/1039732370 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb3300b1100 0x7fb330145dd0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 --2- 172.21.15.41:0/1039732370 >> v2:172.21.15.62:3300/0 conn(0x7fb33005c6f0 0x7fb3300aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- 172.21.15.41:0/1039732370 >> 172.21.15.41:0/1039732370 conn(0x7fb330063210 msgr2=0x7fb33005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:40.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- 172.21.15.41:0/1039732370 shutdown_connections 2021-10-21T00:12:40.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- 172.21.15.41:0/1039732370 wait complete. 2021-10-21T00:12:40.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 Processor -- start 2021-10-21T00:12:40.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.792+0000 7fb33625b700 1 -- start start 2021-10-21T00:12:40.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 0x7fb330149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 0x7fb33014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300a66e0 con 0x7fb33005c6f0 2021-10-21T00:12:40.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300a6980 con 0x7fb3300b1100 2021-10-21T00:12:40.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33014d130 con 0x7fb3300b0560 2021-10-21T00:12:40.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:38994/0 (socket says 172.21.15.41:38994) 2021-10-21T00:12:40.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 -- 172.21.15.41:0/1877764606 learned_addr learned my addr 172.21.15.41:0/1877764606 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:40.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32ffff700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 0x7fb33014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32effd700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 0x7fb330149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 -- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 msgr2=0x7fb330149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 0x7fb330149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 -- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 msgr2=0x7fb33014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 0x7fb33014a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 -- 172.21.15.41:0/1877764606 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328009470 con 0x7fb33005c6f0 2021-10-21T00:12:40.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32ffff700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 0x7fb33014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:40.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32effd700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 0x7fb330149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:40.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32f7fe700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fb32000c000 tx=0x7fb320006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb320010780 con 0x7fb33005c6f0 2021-10-21T00:12:40.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200108e0 con 0x7fb33005c6f0 2021-10-21T00:12:40.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3301486c0 con 0x7fb33005c6f0 2021-10-21T00:12:40.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb320010c40 con 0x7fb33005c6f0 2021-10-21T00:12:40.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.796+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3301431d0 con 0x7fb33005c6f0 2021-10-21T00:12:40.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3300ae840 con 0x7fb33005c6f0 2021-10-21T00:12:40.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb32001c460 con 0x7fb33005c6f0 2021-10-21T00:12:40.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb32cff9700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 0x7fb310055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:40.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb32006bfd0 con 0x7fb33005c6f0 2021-10-21T00:12:40.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb32effd700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 0x7fb310055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:40.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.800+0000 7fb32effd700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 0x7fb310055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb324008000 tx=0x7fb324009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:40.821 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.808+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb320042fc0 con 0x7fb33005c6f0 2021-10-21T00:12:40.946 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.936+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb330057350 con 0x7fb33005c6f0 2021-10-21T00:12:40.947 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.936+0000 7fb32cff9700 1 -- 172.21.15.41:0/1877764606 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb3200465e0 con 0x7fb33005c6f0 2021-10-21T00:12:40.947 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 1 2021-10-21T00:12:40.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 msgr2=0x7fb310055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 0x7fb310055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb324008000 tx=0x7fb324009040).stop 2021-10-21T00:12:40.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 msgr2=0x7fb33014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:40.950 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fb32000c000 tx=0x7fb320006df0).stop 2021-10-21T00:12:40.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 shutdown_connections 2021-10-21T00:12:40.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fb3100536a0 0x7fb310055b60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3300b1100 0x7fb33014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.951 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3300b0560 0x7fb330149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 --2- 172.21.15.41:0/1877764606 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fb33005c6f0 0x7fb33014bf40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:40.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 >> 172.21.15.41:0/1877764606 conn(0x7fb330063210 msgr2=0x7fb3300b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:40.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 shutdown_connections 2021-10-21T00:12:40.952 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:40.940+0000 7fb33625b700 1 -- 172.21.15.41:0/1877764606 wait complete. 2021-10-21T00:12:40.960 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-10-21T00:12:41.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 Processor -- start 2021-10-21T00:12:41.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 -- start start 2021-10-21T00:12:41.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0ba080 con 0x7f0a8c0b24b0 2021-10-21T00:12:41.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c05c670 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.056+0000 7f0a91080700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c05c8e0 con 0x7f0a8c0b31e0 2021-10-21T00:12:41.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39002/0 (socket says 172.21.15.41:39002) 2021-10-21T00:12:41.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8a59c700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8b59e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a8c0b24b0 0x7f0a8c146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44832/0 (socket says 172.21.15.41:44832) 2021-10-21T00:12:41.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 -- 172.21.15.41:0/2660509716 learned_addr learned my addr 172.21.15.41:0/2660509716 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a89d9b700 1 -- 172.21.15.41:0/2660509716 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000269094 0 0) 0x7f0a8c0ba080 con 0x7f0a8c0b24b0 2021-10-21T00:12:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a89d9b700 1 -- 172.21.15.41:0/2660509716 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a70003260 con 0x7f0a8c0b24b0 2021-10-21T00:12:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 -- 172.21.15.41:0/2660509716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 msgr2=0x7f0a8c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 --2- 172.21.15.41:0/2660509716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 -- 172.21.15.41:0/2660509716 >> v1:172.21.15.62:6789/0 conn(0x7f0a8c0b24b0 legacy=0x7f0a8c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 -- 172.21.15.41:0/2660509716 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c05cb80 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a8ad9d700 1 --2- 172.21.15.41:0/2660509716 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f0a80002f70 tx=0x7f0a80006eb0).ready entity=mon.0 client_cookie=ad41d5994557c822 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a89d9b700 1 -- 172.21.15.41:0/2660509716 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8000d5c0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a89d9b700 1 -- 172.21.15.41:0/2660509716 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80000e90 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a89d9b700 1 -- 172.21.15.41:0/2660509716 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8000d950 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 -- 172.21.15.41:0/2660509716 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 msgr2=0x7f0a8c0b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 --2- 172.21.15.41:0/2660509716 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f0a80002f70 tx=0x7f0a80006eb0).stop 2021-10-21T00:12:41.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 -- 172.21.15.41:0/2660509716 shutdown_connections 2021-10-21T00:12:41.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 --2- 172.21.15.41:0/2660509716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 --2- 172.21.15.41:0/2660509716 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0b0690 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 -- 172.21.15.41:0/2660509716 >> 172.21.15.41:0/2660509716 conn(0x7f0a8c062f00 msgr2=0x7f0a8c0b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 -- 172.21.15.41:0/2660509716 shutdown_connections 2021-10-21T00:12:41.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.060+0000 7f0a91080700 1 -- 172.21.15.41:0/2660509716 wait complete. 2021-10-21T00:12:41.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 Processor -- start 2021-10-21T00:12:41.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- start start 2021-10-21T00:12:41.085 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a8c0b24b0 0x7f0a8c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.086 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0b0030 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0af140 con 0x7f0a8c0b24b0 2021-10-21T00:12:41.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0af3c0 con 0x7f0a8c0b31e0 2021-10-21T00:12:41.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.087 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39012/0 (socket says 172.21.15.41:39012) 2021-10-21T00:12:41.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 -- 172.21.15.41:0/1395833683 learned_addr learned my addr 172.21.15.41:0/1395833683 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8ad9d700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a8c0b24b0 0x7f0a8c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8a59c700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 -- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 msgr2=0x7f0a8c0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.088 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 -- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a8c0b24b0 msgr2=0x7f0a8c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a8c0b24b0 0x7f0a8c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 -- 172.21.15.41:0/1395833683 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8000b1e0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.089 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a8b59e700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f0a84001490 tx=0x7f0a84007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a84005bb0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.090 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84005d10 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c0af660 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a840072c0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.064+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c145000 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.091 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a8401a060 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c144ce0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a7bfff700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 0x7f0a68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a8406b110 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.092 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a8ad9d700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 0x7f0a68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.068+0000 7f0a8ad9d700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 0x7f0a68055ad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f0a8001c000 tx=0x7f0a80015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.093 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.072+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a8c144ce0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.204+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a8c144ce0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a7bfff700 1 -- 172.21.15.41:0/1395833683 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a8c144ce0 con 0x7f0a8c0b9ca0 2021-10-21T00:12:41.216 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:41.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 msgr2=0x7f0a68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 0x7f0a68055ad0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f0a8001c000 tx=0x7f0a80015000).stop 2021-10-21T00:12:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 msgr2=0x7f0a8c0ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f0a84001490 tx=0x7f0a84007de0).stop 2021-10-21T00:12:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 shutdown_connections 2021-10-21T00:12:41.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f0a68053610 0x7f0a68055ad0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f0a8c0b9ca0 0x7f0a8c0ad770 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a8c0b31e0 0x7f0a8c0aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 --2- 172.21.15.41:0/1395833683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a8c0b24b0 0x7f0a8c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 >> 172.21.15.41:0/1395833683 conn(0x7f0a8c062f00 msgr2=0x7f0a8c141000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 shutdown_connections 2021-10-21T00:12:41.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.208+0000 7f0a91080700 1 -- 172.21.15.41:0/1395833683 wait complete. 2021-10-21T00:12:41.229 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-10-21T00:12:41.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 Processor -- start 2021-10-21T00:12:41.337 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 -- start start 2021-10-21T00:12:41.340 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5934065190 0x7f593405cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 0x7f593413f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5934061040 con 0x7f5934060c60 2021-10-21T00:12:41.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340ac5f0 con 0x7f5934065190 2021-10-21T00:12:41.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5939c7f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340656a0 con 0x7f5934142b80 2021-10-21T00:12:41.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f59337fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5934060c60 0x7f5934142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36786/0 (socket says 172.21.15.41:36786) 2021-10-21T00:12:41.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f59337fe700 1 -- 172.21.15.41:0/1247183372 learned_addr learned my addr 172.21.15.41:0/1247183372 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:41.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5933fff700 1 --2- 172.21.15.41:0/1247183372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 0x7f593413f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f592bfff700 1 --2- 172.21.15.41:0/1247183372 >> v2:172.21.15.62:3300/0 conn(0x7f5934065190 0x7f593405cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5932ffd700 1 -- 172.21.15.41:0/1247183372 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310536985 0 0) 0x7f5934061040 con 0x7f5934060c60 2021-10-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.328+0000 7f5932ffd700 1 -- 172.21.15.41:0/1247183372 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003260 con 0x7f5934060c60 2021-10-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5933fff700 1 -- 172.21.15.41:0/1247183372 >> v2:172.21.15.62:3300/0 conn(0x7f5934065190 msgr2=0x7f593405cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:41.343 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5933fff700 1 --2- 172.21.15.41:0/1247183372 >> v2:172.21.15.62:3300/0 conn(0x7f5934065190 0x7f593405cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5933fff700 1 -- 172.21.15.41:0/1247183372 >> v1:172.21.15.41:6789/0 conn(0x7f5934060c60 legacy=0x7f5934142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5933fff700 1 -- 172.21.15.41:0/1247183372 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934065940 con 0x7f5934142b80 2021-10-21T00:12:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5933fff700 1 --2- 172.21.15.41:0/1247183372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 0x7f593413f220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f592c0032f0 tx=0x7f592c0091d0).ready entity=mon.2 client_cookie=826847c40ee05bf7 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5932ffd700 1 -- 172.21.15.41:0/1247183372 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592c00b600 con 0x7f5934142b80 2021-10-21T00:12:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5932ffd700 1 -- 172.21.15.41:0/1247183372 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00b760 con 0x7f5934142b80 2021-10-21T00:12:41.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5932ffd700 1 -- 172.21.15.41:0/1247183372 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f592c00b8d0 con 0x7f5934142b80 2021-10-21T00:12:41.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 -- 172.21.15.41:0/1247183372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 msgr2=0x7f593413f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 --2- 172.21.15.41:0/1247183372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 0x7f593413f220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f592c0032f0 tx=0x7f592c0091d0).stop 2021-10-21T00:12:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 -- 172.21.15.41:0/1247183372 shutdown_connections 2021-10-21T00:12:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 --2- 172.21.15.41:0/1247183372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934142b80 0x7f593413f220 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.349 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 --2- 172.21.15.41:0/1247183372 >> v2:172.21.15.62:3300/0 conn(0x7f5934065190 0x7f593405cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 -- 172.21.15.41:0/1247183372 >> 172.21.15.41:0/1247183372 conn(0x7f5934063b70 msgr2=0x7f5934060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 -- 172.21.15.41:0/1247183372 shutdown_connections 2021-10-21T00:12:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 -- 172.21.15.41:0/1247183372 wait complete. 2021-10-21T00:12:41.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.332+0000 7f5939c7f700 1 Processor -- start 2021-10-21T00:12:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- start start 2021-10-21T00:12:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934065190 0x7f59340b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5934142b80 0x7f5934155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5934151b90 con 0x7f5934060c60 2021-10-21T00:12:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59340afab0 con 0x7f5934142b80 2021-10-21T00:12:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340aeca0 con 0x7f5934065190 2021-10-21T00:12:41.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39022/0 (socket says 172.21.15.41:39022) 2021-10-21T00:12:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 -- 172.21.15.41:0/2368064685 learned_addr learned my addr 172.21.15.41:0/2368064685 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5933fff700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5934142b80 0x7f5934155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f592bfff700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934065190 0x7f59340b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 -- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934065190 msgr2=0x7f59340b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934065190 0x7f59340b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 -- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5934142b80 msgr2=0x7f5934155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5934142b80 0x7f5934155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 -- 172.21.15.41:0/2368064685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c009470 con 0x7f5934060c60 2021-10-21T00:12:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59337fe700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f5924001110 tx=0x7f5924007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59240070d0 con 0x7f5934060c60 2021-10-21T00:12:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924007230 con 0x7f5934060c60 2021-10-21T00:12:41.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5934155270 con 0x7f5934060c60 2021-10-21T00:12:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924005610 con 0x7f5934060c60 2021-10-21T00:12:41.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.336+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593409e1e0 con 0x7f5934060c60 2021-10-21T00:12:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5934065be0 con 0x7f5934060c60 2021-10-21T00:12:41.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f592401a060 con 0x7f5934060c60 2021-10-21T00:12:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f59317fa700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 0x7f59180559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f592406adf0 con 0x7f5934060c60 2021-10-21T00:12:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f592bfff700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 0x7f59180559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.340+0000 7f592bfff700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 0x7f59180559b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f591c00b000 tx=0x7f591c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.344+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5924041e40 con 0x7f5934060c60 2021-10-21T00:12:41.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.472+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5934057350 con 0x7f5934060c60 2021-10-21T00:12:41.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.472+0000 7f59317fa700 1 -- 172.21.15.41:0/2368064685 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5924018020 con 0x7f5934060c60 2021-10-21T00:12:41.484 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:41.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 msgr2=0x7f59180559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 0x7f59180559b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f591c00b000 tx=0x7f591c006df0).stop 2021-10-21T00:12:41.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 msgr2=0x7f593409eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f5924001110 tx=0x7f5924007aa0).stop 2021-10-21T00:12:41.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 shutdown_connections 2021-10-21T00:12:41.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f59180534f0 0x7f59180559b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5934142b80 0x7f5934155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5934065190 0x7f59340b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 --2- 172.21.15.41:0/2368064685 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5934060c60 0x7f593409eef0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 >> 172.21.15.41:0/2368064685 conn(0x7f5934063b70 msgr2=0x7f5934142380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 shutdown_connections 2021-10-21T00:12:41.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.476+0000 7f5939c7f700 1 -- 172.21.15.41:0/2368064685 wait complete. 2021-10-21T00:12:41.496 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-10-21T00:12:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 Processor -- start 2021-10-21T00:12:41.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 -- start start 2021-10-21T00:12:41.609 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6738062f70 0x7f673805c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673805bd40 con 0x7f67380b3a20 2021-10-21T00:12:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673805bf70 con 0x7f6738062f70 2021-10-21T00:12:41.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d829700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738142cb0 con 0x7f6738062330 2021-10-21T00:12:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673c827700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f6737fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6738062f70 0x7f673805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673c827700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57528/0 (socket says 172.21.15.41:57528) 2021-10-21T00:12:41.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673d028700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f67380b3a20 0x7f673813c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:44860/0 (socket says 172.21.15.41:44860) 2021-10-21T00:12:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f673c827700 1 -- 172.21.15.41:0/3154915626 learned_addr learned my addr 172.21.15.41:0/3154915626 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.596+0000 7f67377fe700 1 -- 172.21.15.41:0/3154915626 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167937532 0 0) 0x7f673805bd40 con 0x7f67380b3a20 2021-10-21T00:12:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673c827700 1 -- 172.21.15.41:0/3154915626 >> v2:172.21.15.62:3300/0 conn(0x7f6738062f70 msgr2=0x7f673805c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673c827700 1 --2- 172.21.15.41:0/3154915626 >> v2:172.21.15.62:3300/0 conn(0x7f6738062f70 0x7f673805c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673c827700 1 -- 172.21.15.41:0/3154915626 >> v1:172.21.15.62:6789/0 conn(0x7f67380b3a20 legacy=0x7f673813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673c827700 1 -- 172.21.15.41:0/3154915626 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738142950 con 0x7f6738062330 2021-10-21T00:12:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673c827700 1 --2- 172.21.15.41:0/3154915626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f672c002f70 tx=0x7f672c006eb0).ready entity=mon.2 client_cookie=449ec6e215ac7050 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f67377fe700 1 -- 172.21.15.41:0/3154915626 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672c00d570 con 0x7f6738062330 2021-10-21T00:12:41.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f67377fe700 1 -- 172.21.15.41:0/3154915626 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c000e90 con 0x7f6738062330 2021-10-21T00:12:41.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f67377fe700 1 -- 172.21.15.41:0/3154915626 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f672c00d8c0 con 0x7f6738062330 2021-10-21T00:12:41.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- 172.21.15.41:0/3154915626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 msgr2=0x7f67380b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 --2- 172.21.15.41:0/3154915626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f672c002f70 tx=0x7f672c006eb0).stop 2021-10-21T00:12:41.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- 172.21.15.41:0/3154915626 shutdown_connections 2021-10-21T00:12:41.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 --2- 172.21.15.41:0/3154915626 >> v2:172.21.15.62:3300/0 conn(0x7f6738062f70 0x7f673805c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 --2- 172.21.15.41:0/3154915626 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062330 0x7f67380b3f30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- 172.21.15.41:0/3154915626 >> 172.21.15.41:0/3154915626 conn(0x7f67380b9080 msgr2=0x7f67380b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- 172.21.15.41:0/3154915626 shutdown_connections 2021-10-21T00:12:41.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- 172.21.15.41:0/3154915626 wait complete. 2021-10-21T00:12:41.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 Processor -- start 2021-10-21T00:12:41.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.600+0000 7f673d829700 1 -- start start 2021-10-21T00:12:41.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6738062330 0x7f67380b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062f70 0x7f6738151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738156220 con 0x7f67380b3a20 2021-10-21T00:12:41.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738149890 con 0x7f6738062330 2021-10-21T00:12:41.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738144be0 con 0x7f6738062f70 2021-10-21T00:12:41.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39040/0 (socket says 172.21.15.41:39040) 2021-10-21T00:12:41.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673c827700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6738062330 0x7f67380b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.623 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 -- 172.21.15.41:0/1142434572 learned_addr learned my addr 172.21.15.41:0/1142434572 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f6737fff700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062f70 0x7f6738151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 -- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062f70 msgr2=0x7f6738151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062f70 0x7f6738151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.624 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 -- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6738062330 msgr2=0x7f67380b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6738062330 0x7f67380b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 -- 172.21.15.41:0/1142434572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c00b1e0 con 0x7f67380b3a20 2021-10-21T00:12:41.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d028700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f6730000f40 tx=0x7f6730007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6730005ae0 con 0x7f67380b3a20 2021-10-21T00:12:41.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730005c40 con 0x7f67380b3a20 2021-10-21T00:12:41.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738144e70 con 0x7f67380b3a20 2021-10-21T00:12:41.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67300070d0 con 0x7f67380b3a20 2021-10-21T00:12:41.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.604+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738155250 con 0x7f67380b3a20 2021-10-21T00:12:41.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738057350 con 0x7f67380b3a20 2021-10-21T00:12:41.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6730010070 con 0x7f67380b3a20 2021-10-21T00:12:41.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f6735ffb700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 0x7f67180559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f673006b0f0 con 0x7f67380b3a20 2021-10-21T00:12:41.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f673c827700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 0x7f67180559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.608+0000 7f673c827700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 0x7f67180559b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f672c01c000 tx=0x7f672c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.612+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6730042250 con 0x7f67380b3a20 2021-10-21T00:12:41.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.740+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f673805d080 con 0x7f67380b3a20 2021-10-21T00:12:41.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.740+0000 7f6735ffb700 1 -- 172.21.15.41:0/1142434572 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6730045870 con 0x7f67380b3a20 2021-10-21T00:12:41.752 INFO:teuthology.orchestra.run.smithi041.stdout:pg_num: 8 2021-10-21T00:12:41.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 msgr2=0x7f67180559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 0x7f67180559b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f672c01c000 tx=0x7f672c015000).stop 2021-10-21T00:12:41.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 msgr2=0x7f6738152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f6730000f40 tx=0x7f6730007f90).stop 2021-10-21T00:12:41.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 shutdown_connections 2021-10-21T00:12:41.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f67180534f0 0x7f67180559b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f67380b3a20 0x7f6738152450 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6738062f70 0x7f6738151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 --2- 172.21.15.41:0/1142434572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6738062330 0x7f67380b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 >> 172.21.15.41:0/1142434572 conn(0x7f67380b9080 msgr2=0x7f673805c330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 shutdown_connections 2021-10-21T00:12:41.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.744+0000 7f673d829700 1 -- 172.21.15.41:0/1142434572 wait complete. 2021-10-21T00:12:41.770 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-10-21T00:12:41.770 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:41.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.860+0000 7fddc97f3700 1 Processor -- start 2021-10-21T00:12:41.872 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 -- start start 2021-10-21T00:12:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fddc40af720 0x7fddc4143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 0x7fddc40b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.874 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40afb00 con 0x7fddc40af720 2021-10-21T00:12:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40afdf0 con 0x7fddc40b2370 2021-10-21T00:12:41.875 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc97f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40b0090 con 0x7fddc405f6b0 2021-10-21T00:12:41.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fddc40af720 0x7fddc4143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fddc40af720 0x7fddc4143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39044/0 (socket says 172.21.15.41:39044) 2021-10-21T00:12:41.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 -- 172.21.15.41:0/75891998 learned_addr learned my addr 172.21.15.41:0/75891998 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc37fe700 1 --2- 172.21.15.41:0/75891998 >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 0x7fddc40b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc8ff2700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 -- 172.21.15.41:0/75891998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 msgr2=0x7fddc413d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:41.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc413d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 -- 172.21.15.41:0/75891998 >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 msgr2=0x7fddc40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:41.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 --2- 172.21.15.41:0/75891998 >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 0x7fddc40b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.883 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 -- 172.21.15.41:0/75891998 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40b2bc0 con 0x7fddc40af720 2021-10-21T00:12:41.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc37fe700 1 --2- 172.21.15.41:0/75891998 >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 0x7fddc40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:41.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc3fff700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4143cf0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7fddb4002f70 tx=0x7fddb4006e50).ready entity=mon.0 client_cookie=e46adbdc3568de07 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc2ffd700 1 -- 172.21.15.41:0/75891998 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb400d570 con 0x7fddc40af720 2021-10-21T00:12:41.884 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc2ffd700 1 -- 172.21.15.41:0/75891998 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4000e90 con 0x7fddc40af720 2021-10-21T00:12:41.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.864+0000 7fddc2ffd700 1 -- 172.21.15.41:0/75891998 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb400d900 con 0x7fddc40af720 2021-10-21T00:12:41.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- 172.21.15.41:0/75891998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 msgr2=0x7fddc4143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4143cf0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7fddb4002f70 tx=0x7fddb4006e50).stop 2021-10-21T00:12:41.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- 172.21.15.41:0/75891998 shutdown_connections 2021-10-21T00:12:41.885 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc413d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- 172.21.15.41:0/75891998 >> v2:172.21.15.62:3300/0 conn(0x7fddc40b2370 0x7fddc40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- 172.21.15.41:0/75891998 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4143cf0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- 172.21.15.41:0/75891998 >> 172.21.15.41:0/75891998 conn(0x7fddc40637b0 msgr2=0x7fddc4063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:41.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- 172.21.15.41:0/75891998 shutdown_connections 2021-10-21T00:12:41.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- 172.21.15.41:0/75891998 wait complete. 2021-10-21T00:12:41.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 Processor -- start 2021-10-21T00:12:41.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- start start 2021-10-21T00:12:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc4147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddc40b2370 0x7fddc4151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4147cc0 con 0x7fddc40af720 2021-10-21T00:12:41.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4147f60 con 0x7fddc40b2370 2021-10-21T00:12:41.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc97f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4148200 con 0x7fddc405f6b0 2021-10-21T00:12:41.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc37fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39052/0 (socket says 172.21.15.41:39052) 2021-10-21T00:12:41.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc37fe700 1 -- 172.21.15.41:0/1670625527 learned_addr learned my addr 172.21.15.41:0/1670625527 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:41.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc3fff700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc4147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.868+0000 7fddc8ff2700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddc40b2370 0x7fddc4151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 -- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 msgr2=0x7fddc4147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc4147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 -- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddc40b2370 msgr2=0x7fddc4151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:41.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddc40b2370 0x7fddc4151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:41.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 -- 172.21.15.41:0/1670625527 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb400b1e0 con 0x7fddc40af720 2021-10-21T00:12:41.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc37fe700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7fddb8006940 tx=0x7fddb8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb8011780 con 0x7fddc40af720 2021-10-21T00:12:41.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb80118e0 con 0x7fddc40af720 2021-10-21T00:12:41.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc4147120 con 0x7fddc40af720 2021-10-21T00:12:41.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb8011c40 con 0x7fddc40af720 2021-10-21T00:12:41.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc4149900 con 0x7fddc40af720 2021-10-21T00:12:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.872+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc41496a0 con 0x7fddc40af720 2021-10-21T00:12:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.876+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fddb8012420 con 0x7fddc40af720 2021-10-21T00:12:41.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.876+0000 7fddc17fa700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 0x7fdda40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.876+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fddb806b6f0 con 0x7fddc40af720 2021-10-21T00:12:41.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.876+0000 7fddc3fff700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 0x7fdda40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.876+0000 7fddc3fff700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 0x7fdda40559b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fddb401a000 tx=0x7fddb4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:41.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:41.880+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fddb80427f0 con 0x7fddc40af720 2021-10-21T00:12:42.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddc41441e0 con 0x7fddc40af720 2021-10-21T00:12:42.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc17fa700 1 -- 172.21.15.41:0/1670625527 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fddb8045e10 con 0x7fddc40af720 2021-10-21T00:12:42.058 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:42.058 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:34.610443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8781":{"gid":8781,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/680865420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":680865420},{"type":"v1","addr":"172.21.15.41:6833","nonce":680865420}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:42.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 msgr2=0x7fdda40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:42.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 0x7fdda40559b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fddb401a000 tx=0x7fddb4014000).stop 2021-10-21T00:12:42.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 msgr2=0x7fddc4066ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:42.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7fddb8006940 tx=0x7fddb8008040).stop 2021-10-21T00:12:42.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 shutdown_connections 2021-10-21T00:12:42.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdda40534f0 0x7fdda40559b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:42.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddc40b2370 0x7fddc4151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:42.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fddc40af720 0x7fddc4066ab0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:42.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 --2- 172.21.15.41:0/1670625527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fddc405f6b0 0x7fddc4147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:42.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 >> 172.21.15.41:0/1670625527 conn(0x7fddc40637b0 msgr2=0x7fddc40b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:42.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 shutdown_connections 2021-10-21T00:12:42.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:42.048+0000 7fddc97f3700 1 -- 172.21.15.41:0/1670625527 wait complete. 2021-10-21T00:12:42.062 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 77 2021-10-21T00:12:42.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-10-21T00:12:33.607687+0000', 'modified': '2021-10-21T00:12:34.610443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8781': {'gid': 8781, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.41:6833/680865420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.41:6832', 'nonce': 680865420}, {'type': 'v1', 'addr': '172.21.15.41:6833', 'nonce': 680865420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-10-21T00:12:42.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-10-21T00:12:42.274 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-10-21T00:12:42.394 INFO:teuthology.orchestra.run.smithi041.stdout:{"cluster_fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","whoami":0,"id":8781,"want_state":"up:active","state":"up:active","rank_uptime":8.7677126350000005,"mdsmap_epoch":77,"osdmap_epoch":145,"osdmap_epoch_barrier":144,"uptime":13.122962295000001} 2021-10-21T00:12:42.395 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", "id": 8781, "mdsmap_epoch": 77, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "rank_uptime": 8.767712635, "state": "up:active", "uptime": 13.122962295, "want_state": "up:active", "whoami": 0 } 2021-10-21T00:12:42.395 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-10-21T00:12:42.396 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-10-21T00:12:42.397 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi099.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-10-21T00:12:42.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:42.398 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:42.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:42.466 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:42.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:42.477 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:42.478 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:42.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:42.479 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:42.485 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-10-21T00:12:42.485 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:42.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:42.504 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:42.504 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:42.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2021-10-21T00:12:42.552+0000 7f200d472080 -1 init, newargv = 0x556335d089c0 newargc=9 2021-10-21T00:12:42.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14662]: starting ceph client 2021-10-21T00:12:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:42.564 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:42.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:42.565 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:42.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14662]: starting fuse 2021-10-21T00:12:43.672 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2021-10-21T00:12:43.690 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-10-21T00:12:43.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-10-21T00:12:43.747 INFO:teuthology.orchestra.run.smithi099.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-10-21T00:12:43.748 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-10-21T00:12:43.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.749 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2021-10-21T00:12:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:52 2021-10-21T00:12:43.755 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-10-21T00:12:43.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo python3 -c ' 2021-10-21T00:12:43.759 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2021-10-21T00:12:43.760 DEBUG:teuthology.orchestra.run.smithi099:> import re 2021-10-21T00:12:43.760 DEBUG:teuthology.orchestra.run.smithi099:> import os 2021-10-21T00:12:43.761 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2021-10-21T00:12:43.761 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:43.761 DEBUG:teuthology.orchestra.run.smithi099:> def find_socket(client_name): 2021-10-21T00:12:43.762 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-10-21T00:12:43.762 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2021-10-21T00:12:43.763 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:43.763 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2021-10-21T00:12:43.764 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2021-10-21T00:12:43.764 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2021-10-21T00:12:43.765 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2021-10-21T00:12:43.765 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:43.765 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2021-10-21T00:12:43.766 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-10-21T00:12:43.766 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2021-10-21T00:12:43.767 DEBUG:teuthology.orchestra.run.smithi099:> return f 2021-10-21T00:12:43.767 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-10-21T00:12:43.768 DEBUG:teuthology.orchestra.run.smithi099:> 2021-10-21T00:12:43.768 DEBUG:teuthology.orchestra.run.smithi099:> print(find_socket("client.1")) 2021-10-21T00:12:43.768 DEBUG:teuthology.orchestra.run.smithi099:> ' 2021-10-21T00:12:43.812 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.14662.asok 2021-10-21T00:12:43.817 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14662.asok 2021-10-21T00:12:43.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14662.asok status 2021-10-21T00:12:43.951 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-10-21T00:12:43.952 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2021-10-21T00:12:43.952 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3fb760aae831e6138791851b7921f8f0e05db414", 2021-10-21T00:12:43.952 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 15.2.14-138-g3fb760aa (3fb760aae831e6138791851b7921f8f0e05db414) octopus (stable)", 2021-10-21T00:12:43.953 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2021-10-21T00:12:43.953 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2021-10-21T00:12:43.953 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-10-21T00:12:43.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "14662", 2021-10-21T00:12:43.954 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2021-10-21T00:12:43.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:43.954 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2021-10-21T00:12:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2021-10-21T00:12:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 8979, 2021-10-21T00:12:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2021-10-21T00:12:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2021-10-21T00:12:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2021-10-21T00:12:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 8979 2021-10-21T00:12:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:12:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:12:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:12:43.959 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 921094614 2021-10-21T00:12:43.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-10-21T00:12:43.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:43.959 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2021-10-21T00:12:43.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2021-10-21T00:12:43.960 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2021-10-21T00:12:43.964 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 921094614 2021-10-21T00:12:43.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-10-21T00:12:43.964 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.8979 172.21.15.99:0/921094614", 2021-10-21T00:12:43.965 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/921094614", 2021-10-21T00:12:43.965 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2021-10-21T00:12:43.965 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 77, 2021-10-21T00:12:43.965 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 145, 2021-10-21T00:12:43.965 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2021-10-21T00:12:43.966 INFO:teuthology.orchestra.run.smithi099.stdout: "blacklisted": false, 2021-10-21T00:12:43.967 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2021-10-21T00:12:43.967 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-10-21T00:12:43.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.971 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:43.971 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:43.978 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:12:43.980 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:43.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.981 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:43.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:43.998 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:43.998 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:44.053 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:12:44.054 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:44.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:44.055 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:44.056 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:44.064 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2021-10-21T00:12:44.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-10-21T00:12:44.065 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2021-10-21T00:12:44.066 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-10-21T00:12:44.066 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:44.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[14662]: fuse finished with error 0 and tester_r 0 2021-10-21T00:12:44.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:12:44.124 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:12:44.124 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:44.130 INFO:teuthology.orchestra.run.smithi099.stdout:ext2/ext3 2021-10-21T00:12:44.131 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-10-21T00:12:44.131 INFO:teuthology.orchestra.run:waiting for 900 2021-10-21T00:12:44.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-10-21T00:12:44.153 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-10-21T00:12:44.161 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-10-21T00:12:44.162 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-10-21T00:12:44.183 INFO:teuthology.orchestra.run.smithi071.stdout: File: "." 2021-10-21T00:12:44.184 INFO:teuthology.orchestra.run.smithi071.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-10-21T00:12:44.184 INFO:teuthology.orchestra.run.smithi071.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-10-21T00:12:44.184 INFO:teuthology.orchestra.run.smithi071.stdout:Blocks: Total: 86148 Free: 86148 Available: 86148 2021-10-21T00:12:44.184 INFO:teuthology.orchestra.run.smithi071.stdout:Inodes: Total: 1 Free: 0 2021-10-21T00:12:44.186 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-10-21T00:12:44.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 Processor -- start 2021-10-21T00:12:44.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 -- start start 2021-10-21T00:12:44.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 0x7f64f013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f005bd40 con 0x7f64f0062330 2021-10-21T00:12:44.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f005bf70 con 0x7f64f0062f70 2021-10-21T00:12:44.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64f4997700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0142cb0 con 0x7f64f00b3a20 2021-10-21T00:12:44.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ef7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f64f0062330 0x7f64f00b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36828/0 (socket says 172.21.15.41:36828) 2021-10-21T00:12:44.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ef7fe700 1 -- 172.21.15.41:0/4105328363 learned_addr learned my addr 172.21.15.41:0/4105328363 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:44.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64effff700 1 --2- 172.21.15.41:0/4105328363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 0x7f64f013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210819666 0 0) 0x7f64f005bd40 con 0x7f64f0062330 2021-10-21T00:12:44.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64dc003260 con 0x7f64f0062330 2021-10-21T00:12:44.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398348291 0 0) 0x7f64f005bf70 con 0x7f64f0062f70 2021-10-21T00:12:44.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f005bd40 con 0x7f64f0062f70 2021-10-21T00:12:44.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3169845270 0 0) 0x7f64dc003260 con 0x7f64f0062330 2021-10-21T00:12:44.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64effff700 1 -- 172.21.15.41:0/4105328363 >> v1:172.21.15.62:6789/0 conn(0x7f64f0062f70 legacy=0x7f64f005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64effff700 1 -- 172.21.15.41:0/4105328363 >> v1:172.21.15.41:6789/0 conn(0x7f64f0062330 legacy=0x7f64f00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64effff700 1 -- 172.21.15.41:0/4105328363 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0142950 con 0x7f64f00b3a20 2021-10-21T00:12:44.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.288+0000 7f64effff700 1 --2- 172.21.15.41:0/4105328363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 0x7f64f013c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f64e0001110 tx=0x7f64e80091d0).ready entity=mon.2 client_cookie=3d8908bf69174846 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e0001660 con 0x7f64f00b3a20 2021-10-21T00:12:44.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800f510 con 0x7f64f00b3a20 2021-10-21T00:12:44.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64ee7fc700 1 -- 172.21.15.41:0/4105328363 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e800f680 con 0x7f64f00b3a20 2021-10-21T00:12:44.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- 172.21.15.41:0/4105328363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 msgr2=0x7f64f013c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 --2- 172.21.15.41:0/4105328363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 0x7f64f013c510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f64e0001110 tx=0x7f64e80091d0).stop 2021-10-21T00:12:44.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- 172.21.15.41:0/4105328363 shutdown_connections 2021-10-21T00:12:44.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 --2- 172.21.15.41:0/4105328363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f00b3a20 0x7f64f013c510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- 172.21.15.41:0/4105328363 >> 172.21.15.41:0/4105328363 conn(0x7f64f00b9080 msgr2=0x7f64f00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:44.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- 172.21.15.41:0/4105328363 shutdown_connections 2021-10-21T00:12:44.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- 172.21.15.41:0/4105328363 wait complete. 2021-10-21T00:12:44.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 Processor -- start 2021-10-21T00:12:44.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.292+0000 7f64f4997700 1 -- start start 2021-10-21T00:12:44.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f0062f70 0x7f64f00aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64f00b3a20 0x7f64f0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f013e7a0 con 0x7f64f0062330 2021-10-21T00:12:44.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0145a80 con 0x7f64f00b3a20 2021-10-21T00:12:44.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0145d20 con 0x7f64f0062f70 2021-10-21T00:12:44.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39064/0 (socket says 172.21.15.41:39064) 2021-10-21T00:12:44.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 -- 172.21.15.41:0/3046424686 learned_addr learned my addr 172.21.15.41:0/3046424686 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:44.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64eeffd700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f0062f70 0x7f64f00aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64effff700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64f00b3a20 0x7f64f0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 -- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f0062f70 msgr2=0x7f64f00aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f0062f70 0x7f64f00aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 -- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64f00b3a20 msgr2=0x7f64f0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64f00b3a20 0x7f64f0155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 -- 172.21.15.41:0/3046424686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8009470 con 0x7f64f0062330 2021-10-21T00:12:44.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ef7fe700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f64e0001840 tx=0x7f64e0001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e0007170 con 0x7f64f0062330 2021-10-21T00:12:44.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e00072d0 con 0x7f64f0062330 2021-10-21T00:12:44.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e0004920 con 0x7f64f0062330 2021-10-21T00:12:44.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0145fc0 con 0x7f64f0062330 2021-10-21T00:12:44.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0155800 con 0x7f64f0062330 2021-10-21T00:12:44.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.296+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f0112c20 con 0x7f64f0062330 2021-10-21T00:12:44.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.300+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64e001b070 con 0x7f64f0062330 2021-10-21T00:12:44.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.300+0000 7f64ecff9700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 0x7f64d0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.300+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64e006b140 con 0x7f64f0062330 2021-10-21T00:12:44.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.300+0000 7f64eeffd700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 0x7f64d0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.300+0000 7f64eeffd700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 0x7f64d0055ad0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f64e400d000 tx=0x7f64e4007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.304+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64f0112c20 con 0x7f64f0062330 2021-10-21T00:12:44.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.432+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f64f0112c20 con 0x7f64f0062330 2021-10-21T00:12:44.444 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.432+0000 7f64ecff9700 1 -- 172.21.15.41:0/3046424686 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f64f0112c20 con 0x7f64f0062330 2021-10-21T00:12:44.445 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:44.446 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:12:44.446 INFO:teuthology.orchestra.run.smithi041.stdout: "epoch": 145, 2021-10-21T00:12:44.447 INFO:teuthology.orchestra.run.smithi041.stdout: "fsid": "2ab49014-dc00-4ddf-b4a9-8b85c10c4d60", 2021-10-21T00:12:44.447 INFO:teuthology.orchestra.run.smithi041.stdout: "created": "2021-10-21T00:02:41.407605+0000", 2021-10-21T00:12:44.448 INFO:teuthology.orchestra.run.smithi041.stdout: "modified": "2021-10-21T00:12:34.611140+0000", 2021-10-21T00:12:44.448 INFO:teuthology.orchestra.run.smithi041.stdout: "last_up_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:44.449 INFO:teuthology.orchestra.run.smithi041.stdout: "last_in_change": "2021-10-21T00:02:47.809822+0000", 2021-10-21T00:12:44.449 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-10-21T00:12:44.449 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_num": 5799936, 2021-10-21T00:12:44.450 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_set": [ 2021-10-21T00:12:44.450 INFO:teuthology.orchestra.run.smithi041.stdout: "pglog_hardlimit", 2021-10-21T00:12:44.451 INFO:teuthology.orchestra.run.smithi041.stdout: "purged_snapdirs", 2021-10-21T00:12:44.451 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_deletes", 2021-10-21T00:12:44.452 INFO:teuthology.orchestra.run.smithi041.stdout: "sortbitwise" 2021-10-21T00:12:44.452 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:44.452 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_version": 4, 2021-10-21T00:12:44.453 INFO:teuthology.orchestra.run.smithi041.stdout: "full_ratio": 0.94999998807907104, 2021-10-21T00:12:44.453 INFO:teuthology.orchestra.run.smithi041.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-10-21T00:12:44.454 INFO:teuthology.orchestra.run.smithi041.stdout: "nearfull_ratio": 0.85000002384185791, 2021-10-21T00:12:44.454 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_snapshot": "", 2021-10-21T00:12:44.455 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_max": 30, 2021-10-21T00:12:44.455 INFO:teuthology.orchestra.run.smithi041.stdout: "max_osd": 8, 2021-10-21T00:12:44.456 INFO:teuthology.orchestra.run.smithi041.stdout: "require_min_compat_client": "jewel", 2021-10-21T00:12:44.456 INFO:teuthology.orchestra.run.smithi041.stdout: "min_compat_client": "jewel", 2021-10-21T00:12:44.457 INFO:teuthology.orchestra.run.smithi041.stdout: "require_osd_release": "octopus", 2021-10-21T00:12:44.457 INFO:teuthology.orchestra.run.smithi041.stdout: "pools": [ 2021-10-21T00:12:44.458 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.458 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 1, 2021-10-21T00:12:44.458 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "device_health_metrics", 2021-10-21T00:12:44.458 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:44.355251+0000", 2021-10-21T00:12:44.459 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:44.459 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:44.459 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:44.459 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:44.460 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:44.460 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:44.460 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:44.460 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:44.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 1, 2021-10-21T00:12:44.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 1, 2021-10-21T00:12:44.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 1, 2021-10-21T00:12:44.461 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 1, 2021-10-21T00:12:44.462 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 1, 2021-10-21T00:12:44.462 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:44.462 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:44.462 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:44.462 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:44.463 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:44.463 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:44.463 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:44.463 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "15", 2021-10-21T00:12:44.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:44.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:44.464 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:44.464 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:44.465 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:44.465 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:44.465 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:44.465 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:44.466 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:44.466 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:44.466 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:44.466 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:44.466 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:44.467 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:44.467 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:44.467 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:44.467 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:44.468 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:44.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:44.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:44.468 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:44.469 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:44.469 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:44.469 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:44.469 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:44.469 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:44.470 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.470 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:44.470 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:44.470 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:44.471 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:44.471 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:44.471 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:44.471 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:44.471 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:44.472 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:44.472 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:44.472 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:44.472 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:44.472 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 1 2021-10-21T00:12:44.473 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.473 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:44.473 INFO:teuthology.orchestra.run.smithi041.stdout: "mgr_devicehealth": {} 2021-10-21T00:12:44.473 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.474 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.474 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.474 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 2, 2021-10-21T00:12:44.474 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "rbd", 2021-10-21T00:12:44.474 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:02:53.369001+0000", 2021-10-21T00:12:44.475 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:44.475 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:44.475 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:44.475 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:44.475 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:44.476 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:44.476 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:44.476 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:44.476 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:44.477 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:44.477 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:44.477 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:44.477 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:44.477 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:44.478 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:44.478 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:44.478 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:44.478 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:44.478 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:44.479 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:44.479 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.479 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "18", 2021-10-21T00:12:44.479 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:44.479 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:44.480 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:44.480 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:44.480 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:44.480 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:44.480 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:44.481 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:44.481 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:44.481 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:44.481 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:44.482 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:44.482 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:44.482 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:44.482 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:44.482 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:44.483 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:44.483 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:44.483 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:44.483 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:44.483 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:44.484 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:44.484 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:44.484 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:44.484 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:44.485 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:44.485 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.485 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:44.485 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:44.485 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:44.486 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:44.486 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:44.486 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:44.486 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:44.486 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:44.487 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:44.487 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:44.487 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:44.487 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:44.488 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:44.488 INFO:teuthology.orchestra.run.smithi041.stdout: "rbd": {} 2021-10-21T00:12:44.488 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.488 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.489 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.489 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 29, 2021-10-21T00:12:44.489 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_metadata", 2021-10-21T00:12:44.489 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:12:32.085660+0000", 2021-10-21T00:12:44.489 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:44.490 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:44.490 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:44.490 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:44.490 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:44.490 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:44.491 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:44.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:44.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:44.491 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:44.492 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:44.492 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:44.492 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:44.492 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:44.492 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:44.493 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:44.493 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:44.493 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:44.493 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:44.494 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:44.494 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.494 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "144", 2021-10-21T00:12:44.494 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:44.495 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:44.495 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:44.495 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:44.495 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:44.495 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:44.496 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:44.496 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:44.496 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:44.496 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:44.496 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:44.497 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:44.497 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:44.497 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:44.497 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:44.498 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:44.498 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:44.498 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:44.498 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:44.499 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:44.499 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:44.499 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:44.499 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:44.500 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:44.500 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:44.500 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:44.500 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.501 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:44.501 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:44.501 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:44.501 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:44.501 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:44.502 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:44.502 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:44.502 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:44.502 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:44.503 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:44.503 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:44.503 INFO:teuthology.orchestra.run.smithi041.stdout: "options": { 2021-10-21T00:12:44.503 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_bias": 4, 2021-10-21T00:12:44.504 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_min": 16, 2021-10-21T00:12:44.504 INFO:teuthology.orchestra.run.smithi041.stdout: "recovery_priority": 5 2021-10-21T00:12:44.504 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.504 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:44.504 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:12:44.505 INFO:teuthology.orchestra.run.smithi041.stdout: "metadata": "cephfs" 2021-10-21T00:12:44.505 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.505 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.505 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.506 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.506 INFO:teuthology.orchestra.run.smithi041.stdout: "pool": 30, 2021-10-21T00:12:44.506 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_name": "cephfs_data", 2021-10-21T00:12:44.506 INFO:teuthology.orchestra.run.smithi041.stdout: "create_time": "2021-10-21T00:12:33.246025+0000", 2021-10-21T00:12:44.506 INFO:teuthology.orchestra.run.smithi041.stdout: "flags": 1, 2021-10-21T00:12:44.507 INFO:teuthology.orchestra.run.smithi041.stdout: "flags_names": "hashpspool", 2021-10-21T00:12:44.507 INFO:teuthology.orchestra.run.smithi041.stdout: "type": 1, 2021-10-21T00:12:44.507 INFO:teuthology.orchestra.run.smithi041.stdout: "size": 2, 2021-10-21T00:12:44.507 INFO:teuthology.orchestra.run.smithi041.stdout: "min_size": 1, 2021-10-21T00:12:44.507 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_rule": 0, 2021-10-21T00:12:44.508 INFO:teuthology.orchestra.run.smithi041.stdout: "object_hash": 2, 2021-10-21T00:12:44.508 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_autoscale_mode": "off", 2021-10-21T00:12:44.508 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num": 8, 2021-10-21T00:12:44.508 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num": 8, 2021-10-21T00:12:44.509 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_placement_num_target": 8, 2021-10-21T00:12:44.509 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_target": 8, 2021-10-21T00:12:44.509 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_num_pending": 8, 2021-10-21T00:12:44.509 INFO:teuthology.orchestra.run.smithi041.stdout: "last_pg_merge_meta": { 2021-10-21T00:12:44.509 INFO:teuthology.orchestra.run.smithi041.stdout: "source_pgid": "0.0", 2021-10-21T00:12:44.510 INFO:teuthology.orchestra.run.smithi041.stdout: "ready_epoch": 0, 2021-10-21T00:12:44.510 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_started": 0, 2021-10-21T00:12:44.510 INFO:teuthology.orchestra.run.smithi041.stdout: "last_epoch_clean": 0, 2021-10-21T00:12:44.510 INFO:teuthology.orchestra.run.smithi041.stdout: "source_version": "0'0", 2021-10-21T00:12:44.510 INFO:teuthology.orchestra.run.smithi041.stdout: "target_version": "0'0" 2021-10-21T00:12:44.511 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.511 INFO:teuthology.orchestra.run.smithi041.stdout: "last_change": "145", 2021-10-21T00:12:44.511 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend": "0", 2021-10-21T00:12:44.511 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_prenautilus": "0", 2021-10-21T00:12:44.512 INFO:teuthology.orchestra.run.smithi041.stdout: "last_force_op_resend_preluminous": "0", 2021-10-21T00:12:44.512 INFO:teuthology.orchestra.run.smithi041.stdout: "auid": 0, 2021-10-21T00:12:44.512 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_mode": "selfmanaged", 2021-10-21T00:12:44.512 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_seq": 0, 2021-10-21T00:12:44.512 INFO:teuthology.orchestra.run.smithi041.stdout: "snap_epoch": 0, 2021-10-21T00:12:44.513 INFO:teuthology.orchestra.run.smithi041.stdout: "pool_snaps": [], 2021-10-21T00:12:44.513 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps": "[]", 2021-10-21T00:12:44.513 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_bytes": 0, 2021-10-21T00:12:44.513 INFO:teuthology.orchestra.run.smithi041.stdout: "quota_max_objects": 0, 2021-10-21T00:12:44.513 INFO:teuthology.orchestra.run.smithi041.stdout: "tiers": [], 2021-10-21T00:12:44.514 INFO:teuthology.orchestra.run.smithi041.stdout: "tier_of": -1, 2021-10-21T00:12:44.514 INFO:teuthology.orchestra.run.smithi041.stdout: "read_tier": -1, 2021-10-21T00:12:44.514 INFO:teuthology.orchestra.run.smithi041.stdout: "write_tier": -1, 2021-10-21T00:12:44.514 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_mode": "none", 2021-10-21T00:12:44.514 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_bytes": 0, 2021-10-21T00:12:44.515 INFO:teuthology.orchestra.run.smithi041.stdout: "target_max_objects": 0, 2021-10-21T00:12:44.515 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-10-21T00:12:44.515 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-10-21T00:12:44.515 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_target_full_ratio_micro": 800000, 2021-10-21T00:12:44.516 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_flush_age": 0, 2021-10-21T00:12:44.516 INFO:teuthology.orchestra.run.smithi041.stdout: "cache_min_evict_age": 0, 2021-10-21T00:12:44.516 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profile": "", 2021-10-21T00:12:44.516 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_params": { 2021-10-21T00:12:44.516 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "none" 2021-10-21T00:12:44.517 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.517 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_period": 0, 2021-10-21T00:12:44.517 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_count": 0, 2021-10-21T00:12:44.517 INFO:teuthology.orchestra.run.smithi041.stdout: "use_gmt_hitset": true, 2021-10-21T00:12:44.517 INFO:teuthology.orchestra.run.smithi041.stdout: "min_read_recency_for_promote": 0, 2021-10-21T00:12:44.518 INFO:teuthology.orchestra.run.smithi041.stdout: "min_write_recency_for_promote": 0, 2021-10-21T00:12:44.518 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_grade_decay_rate": 0, 2021-10-21T00:12:44.518 INFO:teuthology.orchestra.run.smithi041.stdout: "hit_set_search_last_n": 0, 2021-10-21T00:12:44.518 INFO:teuthology.orchestra.run.smithi041.stdout: "grade_table": [], 2021-10-21T00:12:44.518 INFO:teuthology.orchestra.run.smithi041.stdout: "stripe_width": 0, 2021-10-21T00:12:44.519 INFO:teuthology.orchestra.run.smithi041.stdout: "expected_num_objects": 0, 2021-10-21T00:12:44.519 INFO:teuthology.orchestra.run.smithi041.stdout: "fast_read": false, 2021-10-21T00:12:44.519 INFO:teuthology.orchestra.run.smithi041.stdout: "options": {}, 2021-10-21T00:12:44.519 INFO:teuthology.orchestra.run.smithi041.stdout: "application_metadata": { 2021-10-21T00:12:44.520 INFO:teuthology.orchestra.run.smithi041.stdout: "cephfs": { 2021-10-21T00:12:44.520 INFO:teuthology.orchestra.run.smithi041.stdout: "data": "cephfs" 2021-10-21T00:12:44.520 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.520 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.520 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.521 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:44.521 INFO:teuthology.orchestra.run.smithi041.stdout: "osds": [ 2021-10-21T00:12:44.521 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.521 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:44.522 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "9d4121f8-718a-453c-8e46-22ccaa7c65d6", 2021-10-21T00:12:44.522 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.522 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.522 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.522 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.523 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.523 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.523 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.523 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.524 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.524 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.524 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.524 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.524 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.525 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.525 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6800", 2021-10-21T00:12:44.525 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.525 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.525 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.526 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.526 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6801", 2021-10-21T00:12:44.526 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.526 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.527 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.527 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.527 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.527 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.527 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.528 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.528 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6802", 2021-10-21T00:12:44.528 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.528 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.528 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.529 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.529 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6803", 2021-10-21T00:12:44.529 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.529 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.529 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.530 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.530 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.530 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.530 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.530 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.531 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6806", 2021-10-21T00:12:44.531 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.531 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.531 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.532 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.532 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6807", 2021-10-21T00:12:44.532 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.532 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.532 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.533 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.533 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.533 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.533 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.533 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.534 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6804", 2021-10-21T00:12:44.534 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.534 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.534 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.534 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.535 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6805", 2021-10-21T00:12:44.535 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14347 2021-10-21T00:12:44.535 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.535 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.535 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.536 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6801/14347", 2021-10-21T00:12:44.536 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6803/14347", 2021-10-21T00:12:44.536 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6807/14347", 2021-10-21T00:12:44.536 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6805/14347", 2021-10-21T00:12:44.537 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.537 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.537 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.537 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.537 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.538 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.538 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:44.538 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "74d69c01-63b5-4279-9378-9271a8ca55a6", 2021-10-21T00:12:44.538 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.538 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.539 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.539 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.539 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.539 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.539 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.540 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 142, 2021-10-21T00:12:44.540 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.540 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.540 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.540 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.541 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.541 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.541 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6808", 2021-10-21T00:12:44.541 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.542 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.542 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.542 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.542 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6809", 2021-10-21T00:12:44.542 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.543 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.543 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.543 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.543 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.543 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.544 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.544 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.544 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6810", 2021-10-21T00:12:44.544 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.545 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.545 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.545 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.545 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6811", 2021-10-21T00:12:44.545 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.546 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.546 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.546 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.546 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.546 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.547 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.547 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.547 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6814", 2021-10-21T00:12:44.547 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.548 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.548 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.548 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.548 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6815", 2021-10-21T00:12:44.549 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.549 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.549 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.549 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.550 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.550 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.550 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.550 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.551 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6812", 2021-10-21T00:12:44.551 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.551 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.551 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.551 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.552 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6813", 2021-10-21T00:12:44.552 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14348 2021-10-21T00:12:44.552 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.552 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.553 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.553 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6809/14348", 2021-10-21T00:12:44.553 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6811/14348", 2021-10-21T00:12:44.553 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6815/14348", 2021-10-21T00:12:44.553 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6813/14348", 2021-10-21T00:12:44.554 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.554 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.554 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.554 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.554 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.555 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.555 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:44.555 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "603c1558-e391-4cf5-92fb-2b53696e1c56", 2021-10-21T00:12:44.555 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.556 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.556 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.556 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.556 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.556 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.557 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.557 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.557 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.557 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.558 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.558 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.558 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.558 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.558 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6823", 2021-10-21T00:12:44.559 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.559 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.559 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.559 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.559 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6825", 2021-10-21T00:12:44.560 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.560 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.560 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.560 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.561 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.561 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.561 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.561 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.561 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6826", 2021-10-21T00:12:44.562 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.562 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.562 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.562 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.562 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6827", 2021-10-21T00:12:44.563 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.563 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.563 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.563 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.563 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.564 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.564 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.564 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.564 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6830", 2021-10-21T00:12:44.565 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.565 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.565 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.565 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.565 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6831", 2021-10-21T00:12:44.566 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.566 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.566 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.566 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.567 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.567 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.567 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.567 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.567 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6828", 2021-10-21T00:12:44.568 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.568 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.568 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.569 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.569 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6829", 2021-10-21T00:12:44.569 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14360 2021-10-21T00:12:44.569 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.570 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.570 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.570 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6825/14360", 2021-10-21T00:12:44.570 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6827/14360", 2021-10-21T00:12:44.571 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6831/14360", 2021-10-21T00:12:44.571 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6829/14360", 2021-10-21T00:12:44.571 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.571 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.571 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.572 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.572 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.572 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.572 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:44.572 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "42c9fc1d-cfc4-40ab-829c-269c80c181a2", 2021-10-21T00:12:44.573 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.573 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.573 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.573 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.573 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.574 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.574 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.574 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.574 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.575 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.575 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.575 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.575 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.575 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.576 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6816", 2021-10-21T00:12:44.576 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.576 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.576 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.576 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.577 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6817", 2021-10-21T00:12:44.577 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.577 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.577 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.577 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.578 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.578 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.578 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.578 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.578 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6818", 2021-10-21T00:12:44.579 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.579 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.579 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.579 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.579 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6819", 2021-10-21T00:12:44.580 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.580 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.580 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.580 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.581 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.581 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.581 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.581 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.581 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6822", 2021-10-21T00:12:44.582 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.582 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.582 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.582 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.582 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6824", 2021-10-21T00:12:44.583 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.583 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.583 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.583 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.584 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.584 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.584 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.584 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.584 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6820", 2021-10-21T00:12:44.585 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.585 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.585 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.585 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.585 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.41:6821", 2021-10-21T00:12:44.586 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14357 2021-10-21T00:12:44.586 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.586 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.586 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.586 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.41:6817/14357", 2021-10-21T00:12:44.587 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.41:6819/14357", 2021-10-21T00:12:44.587 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.41:6824/14357", 2021-10-21T00:12:44.587 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.41:6821/14357", 2021-10-21T00:12:44.587 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.588 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.588 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.588 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.588 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.588 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.589 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:44.589 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "f454248d-9887-41fb-8d6b-6ef9afcb0ce7", 2021-10-21T00:12:44.589 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.589 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.589 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.590 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.590 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.590 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.590 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.590 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 142, 2021-10-21T00:12:44.591 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.591 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.591 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.591 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6814", 2021-10-21T00:12:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.592 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.593 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.593 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.593 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6816", 2021-10-21T00:12:44.593 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.593 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.594 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.594 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.594 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.594 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.594 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.595 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.595 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6819", 2021-10-21T00:12:44.595 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.595 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.595 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.596 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.596 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6821", 2021-10-21T00:12:44.596 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.596 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.596 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.597 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.597 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.597 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.597 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.598 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.598 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6824", 2021-10-21T00:12:44.598 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.598 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.598 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.599 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.599 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6825", 2021-10-21T00:12:44.599 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.599 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.600 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.600 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.600 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.600 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.600 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.601 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.601 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6822", 2021-10-21T00:12:44.601 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.601 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.602 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.602 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.602 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6823", 2021-10-21T00:12:44.602 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14810 2021-10-21T00:12:44.603 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.603 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.603 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.603 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6816/14810", 2021-10-21T00:12:44.603 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6821/14810", 2021-10-21T00:12:44.604 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6825/14810", 2021-10-21T00:12:44.604 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6823/14810", 2021-10-21T00:12:44.604 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.604 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.604 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.605 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.605 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.605 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.605 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:44.606 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "acfe82dc-231b-49f2-a47f-99afb268f107", 2021-10-21T00:12:44.606 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.606 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.606 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.607 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.607 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.607 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.607 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.608 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.608 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.608 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.608 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.608 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.609 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.609 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.609 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6802", 2021-10-21T00:12:44.609 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.610 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.610 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.610 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.610 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6803", 2021-10-21T00:12:44.610 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.611 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.612 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.612 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.612 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6804", 2021-10-21T00:12:44.612 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.612 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.613 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.613 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.613 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6805", 2021-10-21T00:12:44.613 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.614 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.614 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.614 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.614 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.614 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.615 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.615 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.615 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6808", 2021-10-21T00:12:44.615 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.615 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.616 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.616 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.616 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6809", 2021-10-21T00:12:44.616 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.616 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.617 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.617 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.617 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.617 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.617 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.618 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.618 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6806", 2021-10-21T00:12:44.618 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.618 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.619 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.619 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.619 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6807", 2021-10-21T00:12:44.619 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14811 2021-10-21T00:12:44.619 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.620 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.620 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.620 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6803/14811", 2021-10-21T00:12:44.620 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6805/14811", 2021-10-21T00:12:44.620 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6809/14811", 2021-10-21T00:12:44.621 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6807/14811", 2021-10-21T00:12:44.621 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.621 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.621 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.621 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.622 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.622 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.622 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:44.622 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "7384bca7-9f97-4d81-a23f-bcbd810a7073", 2021-10-21T00:12:44.623 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.623 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.623 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.623 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.623 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.624 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.624 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.624 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.624 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.624 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.625 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.625 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.625 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.625 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.625 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6810", 2021-10-21T00:12:44.626 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.626 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.626 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.626 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.626 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6811", 2021-10-21T00:12:44.627 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.627 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.627 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.627 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.628 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.628 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.628 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.628 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.628 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6812", 2021-10-21T00:12:44.629 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.629 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.629 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.629 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.629 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6813", 2021-10-21T00:12:44.630 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.630 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.630 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.630 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.630 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.631 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.631 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.631 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.631 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6818", 2021-10-21T00:12:44.632 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.632 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.632 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.632 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.632 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6820", 2021-10-21T00:12:44.633 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.633 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.633 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.633 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.633 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.634 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.634 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.634 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.634 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6815", 2021-10-21T00:12:44.634 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.635 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.635 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.635 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.635 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6817", 2021-10-21T00:12:44.635 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14812 2021-10-21T00:12:44.636 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.636 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.636 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.636 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6811/14812", 2021-10-21T00:12:44.637 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6813/14812", 2021-10-21T00:12:44.637 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6820/14812", 2021-10-21T00:12:44.637 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6817/14812", 2021-10-21T00:12:44.637 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.637 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.638 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.638 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.638 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.639 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.639 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:44.639 INFO:teuthology.orchestra.run.smithi041.stdout: "uuid": "8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7", 2021-10-21T00:12:44.639 INFO:teuthology.orchestra.run.smithi041.stdout: "up": 1, 2021-10-21T00:12:44.640 INFO:teuthology.orchestra.run.smithi041.stdout: "in": 1, 2021-10-21T00:12:44.640 INFO:teuthology.orchestra.run.smithi041.stdout: "weight": 1, 2021-10-21T00:12:44.640 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_affinity": 1, 2021-10-21T00:12:44.640 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_begin": 0, 2021-10-21T00:12:44.641 INFO:teuthology.orchestra.run.smithi041.stdout: "last_clean_end": 0, 2021-10-21T00:12:44.641 INFO:teuthology.orchestra.run.smithi041.stdout: "up_from": 13, 2021-10-21T00:12:44.641 INFO:teuthology.orchestra.run.smithi041.stdout: "up_thru": 143, 2021-10-21T00:12:44.641 INFO:teuthology.orchestra.run.smithi041.stdout: "down_at": 0, 2021-10-21T00:12:44.641 INFO:teuthology.orchestra.run.smithi041.stdout: "lost_at": 0, 2021-10-21T00:12:44.642 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addrs": { 2021-10-21T00:12:44.642 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.642 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.642 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.643 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6826", 2021-10-21T00:12:44.643 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.643 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.643 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.643 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.644 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6827", 2021-10-21T00:12:44.644 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.644 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.644 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.644 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.645 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addrs": { 2021-10-21T00:12:44.645 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.645 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.645 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.645 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6828", 2021-10-21T00:12:44.646 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.646 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.646 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.646 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.647 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6829", 2021-10-21T00:12:44.647 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.647 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.647 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.648 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.648 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addrs": { 2021-10-21T00:12:44.648 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.649 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.649 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.649 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6832", 2021-10-21T00:12:44.649 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.650 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.650 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.650 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.650 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6833", 2021-10-21T00:12:44.651 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.651 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.651 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.651 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.652 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addrs": { 2021-10-21T00:12:44.652 INFO:teuthology.orchestra.run.smithi041.stdout: "addrvec": [ 2021-10-21T00:12:44.652 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.652 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v2", 2021-10-21T00:12:44.652 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6830", 2021-10-21T00:12:44.653 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.653 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.653 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.653 INFO:teuthology.orchestra.run.smithi041.stdout: "type": "v1", 2021-10-21T00:12:44.653 INFO:teuthology.orchestra.run.smithi041.stdout: "addr": "172.21.15.62:6831", 2021-10-21T00:12:44.654 INFO:teuthology.orchestra.run.smithi041.stdout: "nonce": 14821 2021-10-21T00:12:44.654 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.654 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.654 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.655 INFO:teuthology.orchestra.run.smithi041.stdout: "public_addr": "172.21.15.62:6827/14821", 2021-10-21T00:12:44.655 INFO:teuthology.orchestra.run.smithi041.stdout: "cluster_addr": "172.21.15.62:6829/14821", 2021-10-21T00:12:44.655 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_back_addr": "172.21.15.62:6833/14821", 2021-10-21T00:12:44.655 INFO:teuthology.orchestra.run.smithi041.stdout: "heartbeat_front_addr": "172.21.15.62:6831/14821", 2021-10-21T00:12:44.655 INFO:teuthology.orchestra.run.smithi041.stdout: "state": [ 2021-10-21T00:12:44.656 INFO:teuthology.orchestra.run.smithi041.stdout: "exists", 2021-10-21T00:12:44.656 INFO:teuthology.orchestra.run.smithi041.stdout: "up" 2021-10-21T00:12:44.656 INFO:teuthology.orchestra.run.smithi041.stdout: ] 2021-10-21T00:12:44.656 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.656 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:44.657 INFO:teuthology.orchestra.run.smithi041.stdout: "osd_xinfo": [ 2021-10-21T00:12:44.657 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.657 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 0, 2021-10-21T00:12:44.657 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.657 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.658 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.658 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.658 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.658 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.925611+0000", 2021-10-21T00:12:44.659 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.659 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.659 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.660 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 1, 2021-10-21T00:12:44.660 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.660 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.660 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.661 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.661 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.661 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.957500+0000", 2021-10-21T00:12:44.662 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.662 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.662 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.662 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 2, 2021-10-21T00:12:44.662 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.663 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.663 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.663 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.663 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.664 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.942424+0000", 2021-10-21T00:12:44.664 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.664 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.664 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.665 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 3, 2021-10-21T00:12:44.665 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.665 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.665 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.665 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.666 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.666 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.963085+0000", 2021-10-21T00:12:44.666 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.666 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.666 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.667 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 4, 2021-10-21T00:12:44.667 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.667 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.667 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.667 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.668 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.668 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.952259+0000", 2021-10-21T00:12:44.668 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.669 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.669 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.669 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 5, 2021-10-21T00:12:44.669 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.670 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.670 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.670 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.670 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.671 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.996711+0000", 2021-10-21T00:12:44.671 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.671 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.671 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.672 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 6, 2021-10-21T00:12:44.672 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.672 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.672 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.672 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.673 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.673 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.975479+0000", 2021-10-21T00:12:44.673 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.673 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.673 INFO:teuthology.orchestra.run.smithi041.stdout: { 2021-10-21T00:12:44.674 INFO:teuthology.orchestra.run.smithi041.stdout: "osd": 7, 2021-10-21T00:12:44.674 INFO:teuthology.orchestra.run.smithi041.stdout: "down_stamp": "0.000000", 2021-10-21T00:12:44.674 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_probability": 0, 2021-10-21T00:12:44.674 INFO:teuthology.orchestra.run.smithi041.stdout: "laggy_interval": 0, 2021-10-21T00:12:44.675 INFO:teuthology.orchestra.run.smithi041.stdout: "features": 4540138292840890367, 2021-10-21T00:12:44.675 INFO:teuthology.orchestra.run.smithi041.stdout: "old_weight": 0, 2021-10-21T00:12:44.675 INFO:teuthology.orchestra.run.smithi041.stdout: "last_purged_snaps_scrub": "2021-10-21T00:02:45.978415+0000", 2021-10-21T00:12:44.675 INFO:teuthology.orchestra.run.smithi041.stdout: "dead_epoch": 0 2021-10-21T00:12:44.675 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.676 INFO:teuthology.orchestra.run.smithi041.stdout: ], 2021-10-21T00:12:44.676 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap": [], 2021-10-21T00:12:44.676 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_upmap_items": [], 2021-10-21T00:12:44.676 INFO:teuthology.orchestra.run.smithi041.stdout: "pg_temp": [], 2021-10-21T00:12:44.676 INFO:teuthology.orchestra.run.smithi041.stdout: "primary_temp": [], 2021-10-21T00:12:44.677 INFO:teuthology.orchestra.run.smithi041.stdout: "blacklist": {}, 2021-10-21T00:12:44.677 INFO:teuthology.orchestra.run.smithi041.stdout: "erasure_code_profiles": { 2021-10-21T00:12:44.677 INFO:teuthology.orchestra.run.smithi041.stdout: "default": { 2021-10-21T00:12:44.677 INFO:teuthology.orchestra.run.smithi041.stdout: "crush-failure-domain": "osd", 2021-10-21T00:12:44.677 INFO:teuthology.orchestra.run.smithi041.stdout: "k": "2", 2021-10-21T00:12:44.678 INFO:teuthology.orchestra.run.smithi041.stdout: "m": "1", 2021-10-21T00:12:44.678 INFO:teuthology.orchestra.run.smithi041.stdout: "plugin": "jerasure", 2021-10-21T00:12:44.678 INFO:teuthology.orchestra.run.smithi041.stdout: "ruleset-failure-domain": "osd", 2021-10-21T00:12:44.678 INFO:teuthology.orchestra.run.smithi041.stdout: "technique": "reed_sol_van" 2021-10-21T00:12:44.678 INFO:teuthology.orchestra.run.smithi041.stdout: } 2021-10-21T00:12:44.679 INFO:teuthology.orchestra.run.smithi041.stdout: }, 2021-10-21T00:12:44.679 INFO:teuthology.orchestra.run.smithi041.stdout: "removed_snaps_queue": [], 2021-10-21T00:12:44.679 INFO:teuthology.orchestra.run.smithi041.stdout: "new_removed_snaps": [], 2021-10-21T00:12:44.680 INFO:teuthology.orchestra.run.smithi041.stdout: "new_purged_snaps": [], 2021-10-21T00:12:44.680 INFO:teuthology.orchestra.run.smithi041.stdout: "crush_node_flags": {}, 2021-10-21T00:12:44.680 INFO:teuthology.orchestra.run.smithi041.stdout: "device_class_flags": {} 2021-10-21T00:12:44.680 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:12:44.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 msgr2=0x7f64d0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 0x7f64d0055ad0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f64e400d000 tx=0x7f64e4007a20).stop 2021-10-21T00:12:44.683 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 msgr2=0x7f64f0145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f64e0001840 tx=0x7f64e0001ae0).stop 2021-10-21T00:12:44.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 shutdown_connections 2021-10-21T00:12:44.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f64d0053610 0x7f64d0055ad0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.684 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64f00b3a20 0x7f64f0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64f0062f70 0x7f64f00aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 --2- 172.21.15.41:0/3046424686 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f64f0062330 0x7f64f0145450 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.685 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 >> 172.21.15.41:0/3046424686 conn(0x7f64f00b9080 msgr2=0x7f64f00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:44.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 shutdown_connections 2021-10-21T00:12:44.686 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.436+0000 7f64f4997700 1 -- 172.21.15.41:0/3046424686 wait complete. 2021-10-21T00:12:44.687 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:44.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 Processor -- start 2021-10-21T00:12:44.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- start start 2021-10-21T00:12:44.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ad40609a0 0x7f3ad4142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad40abc50 con 0x7f3ad40af9d0 2021-10-21T00:12:44.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad40672a0 con 0x7f3ad4066ec0 2021-10-21T00:12:44.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad41431a0 con 0x7f3ad40609a0 2021-10-21T00:12:44.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad2d9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3ad40af9d0 0x7f3ad405fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36846/0 (socket says 172.21.15.41:36846) 2021-10-21T00:12:44.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad2d9d700 1 -- 172.21.15.41:0/3353786509 learned_addr learned my addr 172.21.15.41:0/3353786509 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:44.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ac9d9b700 1 --2- 172.21.15.41:0/3353786509 >> v2:172.21.15.62:3300/0 conn(0x7f3ad40609a0 0x7f3ad4142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad1d9b700 1 -- 172.21.15.41:0/3353786509 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245300890 0 0) 0x7f3ad40abc50 con 0x7f3ad40af9d0 2021-10-21T00:12:44.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad1d9b700 1 -- 172.21.15.41:0/3353786509 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ab4003260 con 0x7f3ad40af9d0 2021-10-21T00:12:44.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3353786509 >> v1:172.21.15.62:6789/0 conn(0x7f3ad4066ec0 legacy=0x7f3ad413fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3353786509 >> v1:172.21.15.41:6789/0 conn(0x7f3ad40af9d0 legacy=0x7f3ad405fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3353786509 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40b16c0 con 0x7f3ad40609a0 2021-10-21T00:12:44.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ac9d9b700 1 --2- 172.21.15.41:0/3353786509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40609a0 0x7f3ad4142cb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3abc002f70 tx=0x7f3abc006df0).ready entity=mon.1 client_cookie=b66b31c215757062 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad1d9b700 1 -- 172.21.15.41:0/3353786509 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc00d610 con 0x7f3ad40609a0 2021-10-21T00:12:44.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad1d9b700 1 -- 172.21.15.41:0/3353786509 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc000e90 con 0x7f3ad40609a0 2021-10-21T00:12:44.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad1d9b700 1 -- 172.21.15.41:0/3353786509 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc00d960 con 0x7f3ad40609a0 2021-10-21T00:12:44.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- 172.21.15.41:0/3353786509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40609a0 msgr2=0x7f3ad4142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3353786509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40609a0 0x7f3ad4142cb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3abc002f70 tx=0x7f3abc006df0).stop 2021-10-21T00:12:44.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- 172.21.15.41:0/3353786509 shutdown_connections 2021-10-21T00:12:44.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3353786509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40609a0 0x7f3ad4142cb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- 172.21.15.41:0/3353786509 >> 172.21.15.41:0/3353786509 conn(0x7f3ad405bca0 msgr2=0x7f3ad405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:44.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- 172.21.15.41:0/3353786509 shutdown_connections 2021-10-21T00:12:44.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.792+0000 7f3ad885b700 1 -- 172.21.15.41:0/3353786509 wait complete. 2021-10-21T00:12:44.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 Processor -- start 2021-10-21T00:12:44.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- start start 2021-10-21T00:12:44.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ad40609a0 0x7f3ad409a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40af9d0 0x7f3ad40ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad409a550 con 0x7f3ad4066ec0 2021-10-21T00:12:44.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4098d00 con 0x7f3ad40af9d0 2021-10-21T00:12:44.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad409ae70 con 0x7f3ad40609a0 2021-10-21T00:12:44.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39080/0 (socket says 172.21.15.41:39080) 2021-10-21T00:12:44.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3091269941 learned_addr learned my addr 172.21.15.41:0/3091269941 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:44.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad259c700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ad40609a0 0x7f3ad409a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad2d9d700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40af9d0 0x7f3ad40ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ad40609a0 msgr2=0x7f3ad409a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ad40609a0 0x7f3ad409a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40af9d0 msgr2=0x7f3ad40ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40af9d0 0x7f3ad40ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 -- 172.21.15.41:0/3091269941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc00b180 con 0x7f3ad4066ec0 2021-10-21T00:12:44.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ac9d9b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f3abc002f70 tx=0x7f3abc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.817 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc013de0 con 0x7f3ad4066ec0 2021-10-21T00:12:44.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00d290 con 0x7f3ad4066ec0 2021-10-21T00:12:44.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad4098fa0 con 0x7f3ad4066ec0 2021-10-21T00:12:44.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3abc01e5f0 con 0x7f3ad4066ec0 2021-10-21T00:12:44.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.796+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad4098980 con 0x7f3ad4066ec0 2021-10-21T00:12:44.818 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad40ab9b0 con 0x7f3ad4066ec0 2021-10-21T00:12:44.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3abc025030 con 0x7f3ad4066ec0 2021-10-21T00:12:44.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3acbfff700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 0x7f3ab8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:44.819 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3abc06c810 con 0x7f3ad4066ec0 2021-10-21T00:12:44.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3ad259c700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 0x7f3ab8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:44.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.800+0000 7f3ad259c700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 0x7f3ab8055ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3ac400d000 tx=0x7f3ac4007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:44.820 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.804+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3abc043860 con 0x7f3ad4066ec0 2021-10-21T00:12:44.978 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.968+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ad4057350 con 0x7f3ad4066ec0 2021-10-21T00:12:44.979 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.968+0000 7f3acbfff700 1 -- 172.21.15.41:0/3091269941 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f3abc023020 con 0x7f3ad4066ec0 2021-10-21T00:12:44.979 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:44.980 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":77,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:34.610443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8781":{"gid":8781,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.41:6833/680865420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6832","nonce":680865420},{"type":"v1","addr":"172.21.15.41:6833","nonce":680865420}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:44.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 msgr2=0x7f3ab8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 0x7f3ab8055ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3ac400d000 tx=0x7f3ac4007b90).stop 2021-10-21T00:12:44.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 msgr2=0x7f3ad40ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:44.982 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f3abc002f70 tx=0x7f3abc014000).stop 2021-10-21T00:12:44.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 shutdown_connections 2021-10-21T00:12:44.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3ab8053610 0x7f3ab8055ad0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ad40af9d0 0x7f3ad40ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.983 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3ad4066ec0 0x7f3ad40ad490 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 --2- 172.21.15.41:0/3091269941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3ad40609a0 0x7f3ad409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:44.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 >> 172.21.15.41:0/3091269941 conn(0x7f3ad405bca0 msgr2=0x7f3ad405fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:44.984 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 shutdown_connections 2021-10-21T00:12:44.985 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:44.972+0000 7f3ad885b700 1 -- 172.21.15.41:0/3091269941 wait complete. 2021-10-21T00:12:44.986 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 77 2021-10-21T00:12:44.993 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-10-21T00:12:45.098 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 Processor -- start 2021-10-21T00:12:45.099 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 -- start start 2021-10-21T00:12:45.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc0ab880 0x7fa1bc0609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.100 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0abd10 con 0x7fa1bc09a450 2021-10-21T00:12:45.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc09a830 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c2329700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0afed0 con 0x7fa1bc0ab880 2021-10-21T00:12:45.101 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c08c6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c08c6700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39090/0 (socket says 172.21.15.41:39090) 2021-10-21T00:12:45.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.088+0000 7fa1c08c6700 1 -- 172.21.15.41:0/1229382958 learned_addr learned my addr 172.21.15.41:0/1229382958 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:45.102 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1bb7fe700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc0ab880 0x7fa1bc0609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c08c6700 1 -- 172.21.15.41:0/1229382958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc0ab880 msgr2=0x7fa1bc0609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:45.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c08c6700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc0ab880 0x7fa1bc0609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.104 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c08c6700 1 -- 172.21.15.41:0/1229382958 >> v1:172.21.15.62:6789/0 conn(0x7fa1bc09a450 legacy=0x7fa1bc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c08c6700 1 -- 172.21.15.41:0/1229382958 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0b0170 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1baffd700 1 -- 172.21.15.41:0/1229382958 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130783894 0 0) 0x7fa1bc0abd10 con 0x7fa1bc09a450 2021-10-21T00:12:45.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c08c6700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa1b4002f70 tx=0x7fa1b4006eb0).ready entity=mon.0 client_cookie=9c2a3d08417369b0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.105 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1baffd700 1 -- 172.21.15.41:0/1229382958 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b400d570 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1baffd700 1 -- 172.21.15.41:0/1229382958 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4000e90 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1baffd700 1 -- 172.21.15.41:0/1229382958 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b400d8c0 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- 172.21.15.41:0/1229382958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc05fdc0 msgr2=0x7fa1bc0b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa1b4002f70 tx=0x7fa1b4006eb0).stop 2021-10-21T00:12:45.106 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- 172.21.15.41:0/1229382958 shutdown_connections 2021-10-21T00:12:45.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc05fdc0 0x7fa1bc0b08a0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.107 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 --2- 172.21.15.41:0/1229382958 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc0ab880 0x7fa1bc0609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- 172.21.15.41:0/1229382958 >> 172.21.15.41:0/1229382958 conn(0x7fa1bc05bca0 msgr2=0x7fa1bc05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:45.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- 172.21.15.41:0/1229382958 shutdown_connections 2021-10-21T00:12:45.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- 172.21.15.41:0/1229382958 wait complete. 2021-10-21T00:12:45.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 Processor -- start 2021-10-21T00:12:45.108 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.092+0000 7fa1c2329700 1 -- start start 2021-10-21T00:12:45.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 0x7fa1bc097f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.112 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1bc0996a0 0x7fa1bc152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc090510 con 0x7fa1bc09a450 2021-10-21T00:12:45.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0907b0 con 0x7fa1bc0996a0 2021-10-21T00:12:45.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc151fb0 con 0x7fa1bc05fdc0 2021-10-21T00:12:45.113 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39092/0 (socket says 172.21.15.41:39092) 2021-10-21T00:12:45.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 -- 172.21.15.41:0/3225946697 learned_addr learned my addr 172.21.15.41:0/3225946697 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:45.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c08c6700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1bc0996a0 0x7fa1bc152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.114 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bbfff700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 0x7fa1bc097f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 -- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 msgr2=0x7fa1bc097f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 0x7fa1bc097f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 -- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1bc0996a0 msgr2=0x7fa1bc152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.115 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1bc0996a0 0x7fa1bc152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 -- 172.21.15.41:0/3225946697 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b400b1e0 con 0x7fa1bc09a450 2021-10-21T00:12:45.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bbfff700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 0x7fa1bc097f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:45.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1bb7fe700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fa1ac00c000 tx=0x7fa1ac0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.116 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ac00c6a0 con 0x7fa1bc09a450 2021-10-21T00:12:45.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00c800 con 0x7fa1bc09a450 2021-10-21T00:12:45.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc066f10 con 0x7fa1bc09a450 2021-10-21T00:12:45.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ac00cb60 con 0x7fa1bc09a450 2021-10-21T00:12:45.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc152940 con 0x7fa1bc09a450 2021-10-21T00:12:45.117 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc152170 con 0x7fa1bc09a450 2021-10-21T00:12:45.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.096+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1ac022070 con 0x7fa1bc09a450 2021-10-21T00:12:45.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.100+0000 7fa1b97fa700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 0x7fa1a0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.118 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.100+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1ac06c030 con 0x7fa1bc09a450 2021-10-21T00:12:45.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.100+0000 7fa1bbfff700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 0x7fa1a0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.100+0000 7fa1bbfff700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 0x7fa1a0055b90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fa1a400b000 tx=0x7fa1a4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.119 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.108+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1ac043130 con 0x7fa1bc09a450 2021-10-21T00:12:45.279 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.268+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa1bc057350 con 0x7fa1bc09a450 2021-10-21T00:12:45.563 INFO:tasks.ceph.mon.a.smithi041.stderr:2021-10-21T00:12:45.552+0000 7f808d84f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-10-21T00:12:45.580 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.572+0000 7fa1b97fa700 1 -- 172.21.15.41:0/3225946697 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa1ac016070 con 0x7fa1bc09a450 2021-10-21T00:12:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.572+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 msgr2=0x7fa1a0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.585 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.572+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 0x7fa1a0055b90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fa1a400b000 tx=0x7fa1a4009040).stop 2021-10-21T00:12:45.586 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 msgr2=0x7fa1bc145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fa1ac00c000 tx=0x7fa1ac0091d0).stop 2021-10-21T00:12:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 shutdown_connections 2021-10-21T00:12:45.587 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fa1a00536d0 0x7fa1a0055b90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1bc0996a0 0x7fa1bc152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fa1bc09a450 0x7fa1bc145970 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 --2- 172.21.15.41:0/3225946697 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa1bc05fdc0 0x7fa1bc097f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 >> 172.21.15.41:0/3225946697 conn(0x7fa1bc05bca0 msgr2=0x7fa1bc0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:45.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 shutdown_connections 2021-10-21T00:12:45.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.576+0000 7fa1c2329700 1 -- 172.21.15.41:0/3225946697 wait complete. 2021-10-21T00:12:45.590 INFO:teuthology.orchestra.run.smithi041.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-10-21T00:12:45.601 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-10-21T00:12:45.614 INFO:tasks.ceph.mds.a.smithi041.stdout:starting mds.a at 2021-10-21T00:12:45.708 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.696+0000 7fdc5f59e700 1 Processor -- start 2021-10-21T00:12:45.709 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.696+0000 7fdc5f59e700 1 -- start start 2021-10-21T00:12:45.713 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 0x7fdc601461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6005c3c0 con 0x7fdc6005c6b0 2021-10-21T00:12:45.714 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600b27a0 con 0x7fdc60067a00 2021-10-21T00:12:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b1920 con 0x7fdc6005bfe0 2021-10-21T00:12:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5ed9d700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fdc6005c6b0 0x7fdc60141930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36882/0 (socket says 172.21.15.41:36882) 2021-10-21T00:12:45.715 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5ed9d700 1 -- 172.21.15.41:0/1864353181 learned_addr learned my addr 172.21.15.41:0/1864353181 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5e59c700 1 --2- 172.21.15.41:0/1864353181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 0x7fdc601461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.716 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148997848 0 0) 0x7fdc6005c3c0 con 0x7fdc6005c6b0 2021-10-21T00:12:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40003260 con 0x7fdc6005c6b0 2021-10-21T00:12:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339687376 0 0) 0x7fdc600b27a0 con 0x7fdc60067a00 2021-10-21T00:12:45.717 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6005c3c0 con 0x7fdc60067a00 2021-10-21T00:12:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1864353181 >> v1:172.21.15.62:6789/0 conn(0x7fdc60067a00 legacy=0x7fdc601466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.718 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1864353181 >> v1:172.21.15.41:6789/0 conn(0x7fdc6005c6b0 legacy=0x7fdc60141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.719 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1864353181 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600b2a40 con 0x7fdc6005bfe0 2021-10-21T00:12:45.721 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5e59c700 1 --2- 172.21.15.41:0/1864353181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 0x7fdc601461c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fdc50002f70 tx=0x7fdc50006d90).ready entity=mon.2 client_cookie=77f7a68767cf3cf8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc5000d4a0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50000e90 con 0x7fdc6005bfe0 2021-10-21T00:12:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5dd9b700 1 -- 172.21.15.41:0/1864353181 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc5000d7f0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1864353181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 msgr2=0x7fdc601461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1864353181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 0x7fdc601461c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fdc50002f70 tx=0x7fdc50006d90).stop 2021-10-21T00:12:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1864353181 shutdown_connections 2021-10-21T00:12:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1864353181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc6005bfe0 0x7fdc601461c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1864353181 >> 172.21.15.41:0/1864353181 conn(0x7fdc600637b0 msgr2=0x7fdc60063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1864353181 shutdown_connections 2021-10-21T00:12:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.700+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1864353181 wait complete. 2021-10-21T00:12:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 Processor -- start 2021-10-21T00:12:45.724 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 -- start start 2021-10-21T00:12:45.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 0x7fdc601519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 0x7fdc6013e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60066160 con 0x7fdc6005bfe0 2021-10-21T00:12:45.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60151ea0 con 0x7fdc6005c6b0 2021-10-21T00:12:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5f59e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601520a0 con 0x7fdc60067a00 2021-10-21T00:12:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39118/0 (socket says 172.21.15.41:39118) 2021-10-21T00:12:45.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1606369603 learned_addr learned my addr 172.21.15.41:0/1606369603 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc55d9b700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 0x7fdc601519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5ed9d700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 0x7fdc6013e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 msgr2=0x7fdc6013e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 0x7fdc6013e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 msgr2=0x7fdc601519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 0x7fdc601519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 -- 172.21.15.41:0/1606369603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5000b120 con 0x7fdc6005bfe0 2021-10-21T00:12:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5ed9d700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 0x7fdc6013e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:12:45.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc55d9b700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 0x7fdc601519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:12:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.704+0000 7fdc5e59c700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fdc60146b20 tx=0x7fdc50014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc50011c00 con 0x7fdc6005bfe0 2021-10-21T00:12:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000de90 con 0x7fdc6005bfe0 2021-10-21T00:12:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc60152340 con 0x7fdc6005bfe0 2021-10-21T00:12:45.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc5001c400 con 0x7fdc6005bfe0 2021-10-21T00:12:45.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc60147bc0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc600b11e0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc5000f070 con 0x7fdc6005bfe0 2021-10-21T00:12:45.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 0x7fdc44055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:45.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdc5006cec0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.708+0000 7fdc55d9b700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 0x7fdc44055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:45.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.712+0000 7fdc55d9b700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 0x7fdc44055a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fdc4800b000 tx=0x7fdc48009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:45.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.716+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc50043f70 con 0x7fdc6005bfe0 2021-10-21T00:12:45.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.880+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc601527b0 con 0x7fdc6005bfe0 2021-10-21T00:12:45.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.880+0000 7fdc57fff700 1 -- 172.21.15.41:0/1606369603 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fdc50047590 con 0x7fdc6005bfe0 2021-10-21T00:12:45.892 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:12:45.893 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":78,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2177468812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2177468812},{"type":"v1","addr":"172.21.15.62:6835","nonce":2177468812}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":78,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-10-21T00:12:33.607687+0000","modified":"2021-10-21T00:12:45.558402+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":146,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-10-21T00:12:45.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 msgr2=0x7fdc44055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 0x7fdc44055a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fdc4800b000 tx=0x7fdc48009040).stop 2021-10-21T00:12:45.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 msgr2=0x7fdc601465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:45.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7fdc60146b20 tx=0x7fdc50014000).stop 2021-10-21T00:12:45.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 shutdown_connections 2021-10-21T00:12:45.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fdc44053580 0x7fdc44055a40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc60067a00 0x7fdc6013e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc6005c6b0 0x7fdc601519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 --2- 172.21.15.41:0/1606369603 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fdc6005bfe0 0x7fdc601465b0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:45.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 >> 172.21.15.41:0/1606369603 conn(0x7fdc600637b0 msgr2=0x7fdc600b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:45.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 shutdown_connections 2021-10-21T00:12:45.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:45.884+0000 7fdc5f59e700 1 -- 172.21.15.41:0/1606369603 wait complete. 2021-10-21T00:12:45.899 INFO:teuthology.orchestra.run.smithi041.stderr:dumped fsmap epoch 78 2021-10-21T00:12:45.905 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-10-21T00:12:46.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 Processor -- start 2021-10-21T00:12:46.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 -- start start 2021-10-21T00:12:46.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2b00af620 0x7fe2b00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b00b0b50 con 0x7fe2b0067a80 2021-10-21T00:12:46.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b00b2550 con 0x7fe2b00b2170 2021-10-21T00:12:46.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b62a3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00b0d90 con 0x7fe2b00af620 2021-10-21T00:12:46.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b5aa2700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fe2b0067a80 0x7fe2b0149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36898/0 (socket says 172.21.15.41:36898) 2021-10-21T00:12:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b5aa2700 1 -- 172.21.15.41:0/79369888 learned_addr learned my addr 172.21.15.41:0/79369888 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b4aa0700 1 --2- 172.21.15.41:0/79369888 >> v2:172.21.15.62:3300/0 conn(0x7fe2b00af620 0x7fe2b00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937576884 0 0) 0x7fe2ac001110 con 0x7fe2b0067a80 2021-10-21T00:12:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe294003260 con 0x7fe2b0067a80 2021-10-21T00:12:46.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b4aa0700 1 -- 172.21.15.41:0/79369888 >> v1:172.21.15.62:6789/0 conn(0x7fe2b00b2170 legacy=0x7fe2b00ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3816869753 0 0) 0x7fe294003260 con 0x7fe2b0067a80 2021-10-21T00:12:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b4aa0700 1 -- 172.21.15.41:0/79369888 >> v1:172.21.15.41:6789/0 conn(0x7fe2b0067a80 legacy=0x7fe2b0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b4aa0700 1 -- 172.21.15.41:0/79369888 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00b1030 con 0x7fe2b00af620 2021-10-21T00:12:46.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2b4aa0700 1 --2- 172.21.15.41:0/79369888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b00ab880 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fe2b00aafa0 tx=0x7fe2a0006df0).ready entity=mon.1 client_cookie=263e2dae5f59e8d2 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac0017f0 con 0x7fe2b00af620 2021-10-21T00:12:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0000e90 con 0x7fe2b00af620 2021-10-21T00:12:46.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.048+0000 7fe2a7fff700 1 -- 172.21.15.41:0/79369888 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2a000d4f0 con 0x7fe2b00af620 2021-10-21T00:12:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- 172.21.15.41:0/79369888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 msgr2=0x7fe2b00ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/79369888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b00ab880 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fe2b00aafa0 tx=0x7fe2a0006df0).stop 2021-10-21T00:12:46.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- 172.21.15.41:0/79369888 shutdown_connections 2021-10-21T00:12:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/79369888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b00ab880 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- 172.21.15.41:0/79369888 >> 172.21.15.41:0/79369888 conn(0x7fe2b00b5700 msgr2=0x7fe2b00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- 172.21.15.41:0/79369888 shutdown_connections 2021-10-21T00:12:46.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- 172.21.15.41:0/79369888 wait complete. 2021-10-21T00:12:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 Processor -- start 2021-10-21T00:12:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- start start 2021-10-21T00:12:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b0067a80 0x7fe2b00ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b0144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0148700 con 0x7fe2b00b2170 2021-10-21T00:12:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00aec30 con 0x7fe2b00af620 2021-10-21T00:12:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b62a3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00ac730 con 0x7fe2b0067a80 2021-10-21T00:12:46.069 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39136/0 (socket says 172.21.15.41:39136) 2021-10-21T00:12:46.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 -- 172.21.15.41:0/609054416 learned_addr learned my addr 172.21.15.41:0/609054416 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:46.070 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b52a1700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b0067a80 0x7fe2b00ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b4aa0700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b0144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 -- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b0067a80 msgr2=0x7fe2b00ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b0067a80 0x7fe2b00ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 -- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 msgr2=0x7fe2b0144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b0144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 -- 172.21.15.41:0/609054416 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a000b180 con 0x7fe2b00b2170 2021-10-21T00:12:46.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2b5aa2700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fe2b0144630 tx=0x7fe2ac001260).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac007170 con 0x7fe2b00b2170 2021-10-21T00:12:46.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.052+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0072d0 con 0x7fe2b00b2170 2021-10-21T00:12:46.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00ae990 con 0x7fe2b00b2170 2021-10-21T00:12:46.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac004710 con 0x7fe2b00b2170 2021-10-21T00:12:46.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b0097650 con 0x7fe2b00b2170 2021-10-21T00:12:46.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2ac004870 con 0x7fe2b00b2170 2021-10-21T00:12:46.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b0097900 con 0x7fe2b00b2170 2021-10-21T00:12:46.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2a67fc700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 0x7fe298055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe2ac06b160 con 0x7fe2b00b2170 2021-10-21T00:12:46.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2b52a1700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 0x7fe298055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.056+0000 7fe2b52a1700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 0x7fe298055a40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe2a800d000 tx=0x7fe2a8007f10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.060+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2ac0421d0 con 0x7fe2b00b2170 2021-10-21T00:12:46.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.220+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe2b00acd20 con 0x7fe2b00b2170 2021-10-21T00:12:46.584 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.572+0000 7fe2a67fc700 1 -- 172.21.15.41:0/609054416 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe2b00acd20 con 0x7fe2b00b2170 2021-10-21T00:12:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 msgr2=0x7fe298055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 0x7fe298055a40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fe2a800d000 tx=0x7fe2a8007f10).stop 2021-10-21T00:12:46.588 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 msgr2=0x7fe2b0145230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fe2b0144630 tx=0x7fe2ac001260).stop 2021-10-21T00:12:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 shutdown_connections 2021-10-21T00:12:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fe298053580 0x7fe298055a40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fe2b00b2170 0x7fe2b0145230 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00af620 0x7fe2b0144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 --2- 172.21.15.41:0/609054416 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b0067a80 0x7fe2b00ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.590 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.576+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 >> 172.21.15.41:0/609054416 conn(0x7fe2b00b5700 msgr2=0x7fe2b00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.580+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 shutdown_connections 2021-10-21T00:12:46.591 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.580+0000 7fe2b62a3700 1 -- 172.21.15.41:0/609054416 wait complete. 2021-10-21T00:12:46.603 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-10-21T00:12:46.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.716+0000 7f800ec78700 1 Processor -- start 2021-10-21T00:12:46.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.716+0000 7f800ec78700 1 -- start start 2021-10-21T00:12:46.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f800805fed0 0x7f8008063070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80080b4760 con 0x7f80080b4380 2021-10-21T00:12:46.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8008062930 con 0x7f80080b1830 2021-10-21T00:12:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80080b24e0 con 0x7f800805fed0 2021-10-21T00:12:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800dc76700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f80080b4380 0x7f800805f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36912/0 (socket says 172.21.15.41:36912) 2021-10-21T00:12:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800dc76700 1 -- 172.21.15.41:0/536573283 learned_addr learned my addr 172.21.15.41:0/536573283 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:12:46.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800e477700 1 --2- 172.21.15.41:0/536573283 >> v2:172.21.15.62:3300/0 conn(0x7f800805fed0 0x7f8008063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515059260 0 0) 0x7f80080b4760 con 0x7f80080b4380 2021-10-21T00:12:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff0003260 con 0x7f80080b4380 2021-10-21T00:12:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511794229 0 0) 0x7f8008062930 con 0x7f80080b1830 2021-10-21T00:12:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080b4760 con 0x7f80080b1830 2021-10-21T00:12:46.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800e477700 1 -- 172.21.15.41:0/536573283 >> v1:172.21.15.62:6789/0 conn(0x7f80080b1830 legacy=0x7f8008141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800e477700 1 -- 172.21.15.41:0/536573283 >> v1:172.21.15.41:6789/0 conn(0x7f80080b4380 legacy=0x7f800805f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800e477700 1 -- 172.21.15.41:0/536573283 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008062bd0 con 0x7f800805fed0 2021-10-21T00:12:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800e477700 1 --2- 172.21.15.41:0/536573283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800805fed0 0x7f8008063070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f80000032f0 tx=0x7f80000091d0).ready entity=mon.1 client_cookie=e2133ac3b0a4c10b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800000b600 con 0x7f800805fed0 2021-10-21T00:12:46.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000b760 con 0x7f800805fed0 2021-10-21T00:12:46.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800cc74700 1 -- 172.21.15.41:0/536573283 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800000b8d0 con 0x7f800805fed0 2021-10-21T00:12:46.738 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- 172.21.15.41:0/536573283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800805fed0 msgr2=0x7f8008063070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 --2- 172.21.15.41:0/536573283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800805fed0 0x7f8008063070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f80000032f0 tx=0x7f80000091d0).stop 2021-10-21T00:12:46.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- 172.21.15.41:0/536573283 shutdown_connections 2021-10-21T00:12:46.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 --2- 172.21.15.41:0/536573283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f800805fed0 0x7f8008063070 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- 172.21.15.41:0/536573283 >> 172.21.15.41:0/536573283 conn(0x7f80080b7960 msgr2=0x7f80080b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:46.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.720+0000 7f800ec78700 1 -- 172.21.15.41:0/536573283 shutdown_connections 2021-10-21T00:12:46.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 -- 172.21.15.41:0/536573283 wait complete. 2021-10-21T00:12:46.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 Processor -- start 2021-10-21T00:12:46.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 -- start start 2021-10-21T00:12:46.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 0x7f80080b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b1830 0x7f8008152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800809af40 con 0x7f80080b4380 2021-10-21T00:12:46.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800809aca0 con 0x7f80080b1830 2021-10-21T00:12:46.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800ec78700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800809a430 con 0x7f800805fed0 2021-10-21T00:12:46.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800e477700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800dc76700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 0x7f80080b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800d475700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b1830 0x7f8008152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800e477700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39152/0 (socket says 172.21.15.41:39152) 2021-10-21T00:12:46.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.724+0000 7f800e477700 1 -- 172.21.15.41:0/1201715878 learned_addr learned my addr 172.21.15.41:0/1201715878 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:46.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 -- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b1830 msgr2=0x7f8008152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b1830 0x7f8008152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 -- 172.21.15.41:0/1201715878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 msgr2=0x7f80081528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:46.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:46.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 -- 172.21.15.41:0/1201715878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009470 con 0x7f800805fed0 2021-10-21T00:12:46.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800e477700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:46.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800dc76700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 0x7f80080b65f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f8004001110 tx=0x7f8004007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f800400cdb0 con 0x7f800805fed0 2021-10-21T00:12:46.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040070d0 con 0x7f800805fed0 2021-10-21T00:12:46.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8008152de0 con 0x7f800805fed0 2021-10-21T00:12:46.752 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8004007430 con 0x7f800805fed0 2021-10-21T00:12:46.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800809bcb0 con 0x7f800805fed0 2021-10-21T00:12:46.755 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008057350 con 0x7f800805fed0 2021-10-21T00:12:46.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8004010070 con 0x7f800805fed0 2021-10-21T00:12:46.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.728+0000 7f7ff6ffd700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 0x7f7fe80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:46.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.732+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f800406af40 con 0x7f800805fed0 2021-10-21T00:12:46.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.732+0000 7f800d475700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 0x7f7fe80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:46.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.732+0000 7f800d475700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 0x7f7fe80559b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7ff800d000 tx=0x7f7ff8007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:46.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.740+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8004041fb0 con 0x7f800805fed0 2021-10-21T00:12:46.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:46.872+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f800806a4c0 con 0x7f800805fed0 2021-10-21T00:12:47.589 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f7ff6ffd700 1 -- 172.21.15.41:0/1201715878 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v147) v1 ==== 185+0+0 (secure 0 0 0) 0x7f80040455d0 con 0x7f800805fed0 2021-10-21T00:12:47.592 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 msgr2=0x7f7fe80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 0x7f7fe80559b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f7ff800d000 tx=0x7f7ff8007a20).stop 2021-10-21T00:12:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 msgr2=0x7f80080b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 0x7f80080b65f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f8004001110 tx=0x7f8004007a40).stop 2021-10-21T00:12:47.593 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 shutdown_connections 2021-10-21T00:12:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7fe80534f0 0x7f7fe80559b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f80080b4380 0x7f80081528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80080b1830 0x7f8008152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.594 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 --2- 172.21.15.41:0/1201715878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f800805fed0 0x7f80080b65f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.580+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 >> 172.21.15.41:0/1201715878 conn(0x7f80080b7960 msgr2=0x7f80080abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.584+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 shutdown_connections 2021-10-21T00:12:47.595 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.584+0000 7f800ec78700 1 -- 172.21.15.41:0/1201715878 wait complete. 2021-10-21T00:12:47.596 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_metadata' removed 2021-10-21T00:12:47.607 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-10-21T00:12:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 Processor -- start 2021-10-21T00:12:47.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 -- start start 2021-10-21T00:12:47.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4ac0af620 0x7fc4ac143e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac144380 0x7fc4ac1410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0b2550 con 0x7fc4ac0b2170 2021-10-21T00:12:47.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac099ba0 con 0x7fc4ac0af620 2021-10-21T00:12:47.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.716+0000 7fc4b08f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac099e40 con 0x7fc4ac144380 2021-10-21T00:12:47.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39156/0 (socket says 172.21.15.41:39156) 2021-10-21T00:12:47.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/763869472 learned_addr learned my addr 172.21.15.41:0/763869472 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:47.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4aaffd700 1 --2- 172.21.15.41:0/763869472 >> v2:172.21.15.62:3300/0 conn(0x7fc4ac0af620 0x7fc4ac143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4abfff700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac144380 0x7fc4ac1410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/763869472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac144380 msgr2=0x7fc4ac1410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac144380 0x7fc4ac1410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/763869472 >> v2:172.21.15.62:3300/0 conn(0x7fc4ac0af620 msgr2=0x7fc4ac143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:12:47.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/763869472 >> v2:172.21.15.62:3300/0 conn(0x7fc4ac0af620 0x7fc4ac143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/763869472 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac09a0e0 con 0x7fc4ac0b2170 2021-10-21T00:12:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c009290).ready entity=mon.0 client_cookie=fb0db55595c54084 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4aa7fc700 1 -- 172.21.15.41:0/763869472 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00b680 con 0x7fc4ac0b2170 2021-10-21T00:12:47.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4aa7fc700 1 -- 172.21.15.41:0/763869472 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00b7e0 con 0x7fc4ac0b2170 2021-10-21T00:12:47.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4aa7fc700 1 -- 172.21.15.41:0/763869472 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00b950 con 0x7fc4ac0b2170 2021-10-21T00:12:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 -- 172.21.15.41:0/763869472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac0b2170 msgr2=0x7fc4ac09a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c009290).stop 2021-10-21T00:12:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 -- 172.21.15.41:0/763869472 shutdown_connections 2021-10-21T00:12:47.739 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac144380 0x7fc4ac1410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/763869472 >> v2:172.21.15.62:3300/0 conn(0x7fc4ac0af620 0x7fc4ac143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/763869472 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac0b2170 0x7fc4ac09a5a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 -- 172.21.15.41:0/763869472 >> 172.21.15.41:0/763869472 conn(0x7fc4ac0b5700 msgr2=0x7fc4ac0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 -- 172.21.15.41:0/763869472 shutdown_connections 2021-10-21T00:12:47.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.720+0000 7fc4b08f3700 1 -- 172.21.15.41:0/763869472 wait complete. 2021-10-21T00:12:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 Processor -- start 2021-10-21T00:12:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 -- start start 2021-10-21T00:12:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac0b2170 0x7fc4ac0635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1472d0 con 0x7fc4ac144380 2021-10-21T00:12:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0652f0 con 0x7fc4ac0af620 2021-10-21T00:12:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4b08f3700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac065590 con 0x7fc4ac0b2170 2021-10-21T00:12:47.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39166/0 (socket says 172.21.15.41:39166) 2021-10-21T00:12:47.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4abfff700 1 -- 172.21.15.41:0/1610407847 learned_addr learned my addr 172.21.15.41:0/1610407847 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:12:47.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:51080/0 (socket says 172.21.15.41:51080) 2021-10-21T00:12:47.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4aaffd700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac0b2170 0x7fc4ac0635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac0b2170 msgr2=0x7fc4ac0635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:47.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac0b2170 0x7fc4ac0635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/1610407847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 msgr2=0x7fc4ac13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:47.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:47.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 -- 172.21.15.41:0/1610407847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009530 con 0x7fc4ac0af620 2021-10-21T00:12:47.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4abfff700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:12:47.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4ab7fe700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:47.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.724+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00b680 con 0x7fc4ac0af620 2021-10-21T00:12:47.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c01b410 con 0x7fc4ac0af620 2021-10-21T00:12:47.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac1477d0 con 0x7fc4ac0af620 2021-10-21T00:12:47.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00bee0 con 0x7fc4ac0af620 2021-10-21T00:12:47.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac063ad0 con 0x7fc4ac0af620 2021-10-21T00:12:47.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac147140 con 0x7fc4ac0af620 2021-10-21T00:12:47.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc49c00f070 con 0x7fc4ac0af620 2021-10-21T00:12:47.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4a8ff9700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 0x7fc4900559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:12:47.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fc49c06cb60 con 0x7fc4ac0af620 2021-10-21T00:12:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.728+0000 7fc4aaffd700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 0x7fc4900559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:12:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.732+0000 7fc4aaffd700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 0x7fc4900559b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fc49400b000 tx=0x7fc494006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:12:47.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.740+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc49c043ea0 con 0x7fc4ac0af620 2021-10-21T00:12:47.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:47.872+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4ac065750 con 0x7fc4ac0af620 2021-10-21T00:12:48.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.588+0000 7fc4a8ff9700 1 -- 172.21.15.41:0/1610407847 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v148) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc49c01f030 con 0x7fc4ac0af620 2021-10-21T00:12:48.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 msgr2=0x7fc4900559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:48.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 0x7fc4900559b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fc49400b000 tx=0x7fc494006df0).stop 2021-10-21T00:12:48.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 msgr2=0x7fc4ac146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:12:48.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c017000).stop 2021-10-21T00:12:48.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 shutdown_connections 2021-10-21T00:12:48.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc4900534f0 0x7fc4900559b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:48.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc4ac144380 0x7fc4ac13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:48.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4ac0b2170 0x7fc4ac0635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:48.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 --2- 172.21.15.41:0/1610407847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4ac0af620 0x7fc4ac146a30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:12:48.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 >> 172.21.15.41:0/1610407847 conn(0x7fc4ac0b5700 msgr2=0x7fc4ac0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:12:48.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 shutdown_connections 2021-10-21T00:12:48.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:12:48.592+0000 7fc4b08f3700 1 -- 172.21.15.41:0/1610407847 wait complete. 2021-10-21T00:12:48.607 INFO:teuthology.orchestra.run.smithi041.stderr:pool 'cephfs_data' removed 2021-10-21T00:12:48.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-10-21T00:12:48.620 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-10-21T00:12:59.254 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:59.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:59.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:59.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:12:59.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:18.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:13:18.728 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:13:18.728 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:13:29.315 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:29.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:29.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:29.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:29.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:48.628 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:13:48.633 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:13:59.379 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:59.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:59.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:59.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:13:59.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:29.452 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:29.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:29.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:29.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:29.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:59.510 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:59.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:59.516 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:59.519 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:14:59.522 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:29.593 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:29.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:29.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:29.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:29.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:59.670 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:59.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:59.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:59.680 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:15:59.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:29.769 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:29.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:29.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:29.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:29.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:59.840 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:59.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:59.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:59.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:16:59.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:29.920 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:29.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:29.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:29.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:17:29.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:00.048 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:00.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:00.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:00.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:00.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:30.135 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:30.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:30.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:30.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:18:30.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:00.210 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:00.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:00.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:00.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:00.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:30.294 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:30.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:30.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:30.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:19:30.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:00.395 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:00.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:00.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:00.405 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:00.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:30.462 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:30.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:30.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:30.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:20:30.474 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:00.527 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:00.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:00.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:00.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:00.563 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:30.678 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:30.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:30.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:30.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:21:30.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:00.746 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:00.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:00.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:00.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:00.758 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:30.818 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:30.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:30.824 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:30.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:22:30.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:00.921 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:00.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:00.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:00.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:00.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:31.006 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:31.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:31.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:31.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:23:31.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:01.078 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:01.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:01.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:01.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:01.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:31.185 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:31.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:31.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:31.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:24:31.197 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:01.249 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:01.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:01.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:01.262 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:01.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:31.320 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:31.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:31.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:31.330 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:25:31.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:01.392 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:01.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:01.398 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:01.401 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:01.404 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:31.473 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:31.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:31.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:31.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:26:31.484 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:01.545 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:01.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:01.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:01.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:01.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:31.642 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:31.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:31.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:31.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:27:31.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:01.717 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:01.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:01.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:01.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:01.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:18.735 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:28:18.737 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:28:18.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:28:18.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-10-21T00:28:18.741 DEBUG:teuthology.orchestra.run.smithi041:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:28:18.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:28:18.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:28:18.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:28:18.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-10-21T00:28:18.848 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-10-21T00:28:18.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:28:18.850 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:28:18.850 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:28:31.784 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:31.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:31.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:31.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:28:31.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:01.852 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:01.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:01.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:01.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:01.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:31.967 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:31.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:31.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:31.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:29:31.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:02.108 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:02.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:02.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:02.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:02.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:32.207 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:32.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:32.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:32.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:30:32.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:02.533 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:02.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:02.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:02.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:02.544 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:32.616 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:32.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:32.622 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:32.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:31:32.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:02.678 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:02.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:02.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:02.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:02.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:32.793 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:32.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:32.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:32.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:32:32.805 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:02.962 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:02.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:02.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:02.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:02.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:33.036 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:33.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:33.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:33.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:33:33.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:03.100 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:03.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:03.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:03.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:03.111 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:33.228 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:33.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:33.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:33.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:34:33.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:03.572 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:03.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:03.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:03.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:03.584 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:33.693 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:33.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:33.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:33.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:35:33.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:03.790 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:03.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:03.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:03.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:03.801 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:34.064 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:34.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:34.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:34.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:36:34.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:04.233 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:04.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:04.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:04.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:04.245 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:34.314 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:34.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:34.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:34.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:37:34.325 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:04.607 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:04.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:04.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:04.617 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:04.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:34.727 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:34.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:34.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:34.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:38:34.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:04.863 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:04.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:04.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:04.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:04.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:35.007 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:35.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:35.014 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:35.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:39:35.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:05.143 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:05.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:05.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:05.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:05.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:35.295 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:35.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:35.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:35.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:40:35.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:05.607 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:05.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:05.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:05.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:05.618 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:35.813 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:35.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:35.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:35.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:41:35.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:05.953 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:05.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:05.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:05.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:05.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:36.044 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:36.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:36.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:36.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:42:36.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:06.195 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:06.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:06.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:06.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:06.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:18.854 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:43:18.856 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:43:18.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:43:18.862 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-10-21T00:43:18.862 INFO:tasks.cephfs_test_runner:ERROR 2021-10-21T00:43:18.863 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.863 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:43:18.864 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:18.864 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:43:18.864 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.865 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:43:18.865 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:43:18.865 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:43:18.865 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:43:18.866 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:43:18.866 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.866 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:43:18.867 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.867 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-10-21T00:43:18.868 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-10-21T00:43:18.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-10-21T00:43:18.868 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-10-21T00:43:18.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:43:18.869 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:43:18.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:43:18.869 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:43:18.869 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:43:18.870 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:43:18.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:43:18.870 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:43:18.871 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:43:18.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:43:18.871 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:43:18.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:43:18.872 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:43:18.872 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:43:18.872 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:43:18.872 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:43:18.873 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:43:18.873 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:43:18.873 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:43:18.874 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:43:18.874 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:43:18.874 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:43:18.874 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.875 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:43:18.875 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:18.875 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:43:18.876 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.876 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:43:18.876 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:43:18.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:43:18.877 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:43:18.877 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:43:18.877 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.878 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:43:18.878 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.878 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-10-21T00:43:18.879 INFO:tasks.cephfs_test_runner: m.teardown() 2021-10-21T00:43:18.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-10-21T00:43:18.879 INFO:tasks.cephfs_test_runner: self.umount() 2021-10-21T00:43:18.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-10-21T00:43:18.880 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-10-21T00:43:18.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:43:18.881 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:43:18.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:43:18.881 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:43:18.881 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:43:18.882 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:43:18.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:43:18.882 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:43:18.882 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:43:18.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:43:18.883 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:43:18.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:43:18.884 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:43:18.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:43:18.884 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:43:18.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:43:18.885 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:43:18.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:43:18.885 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:43:18.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:43:18.886 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:43:18.886 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:43:18.886 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.887 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:43:18.887 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2394.263s 2021-10-21T00:43:18.887 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.888 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-10-21T00:43:18.888 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.888 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:43:18.889 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:18.889 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:43:18.889 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.889 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:43:18.890 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:43:18.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:43:18.890 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:43:18.890 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:43:18.891 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.891 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:43:18.891 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.892 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.892 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-10-21T00:43:18.892 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-10-21T00:43:18.892 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-10-21T00:43:18.893 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-10-21T00:43:18.893 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:43:18.893 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:43:18.893 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:43:18.894 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:43:18.894 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:43:18.894 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:43:18.895 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:43:18.895 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:43:18.895 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:43:18.895 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:43:18.896 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:43:18.896 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:43:18.896 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:43:18.896 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:43:18.897 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:43:18.897 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:43:18.897 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:43:18.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:43:18.898 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:43:18.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:43:18.898 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:43:18.899 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:43:18.899 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.899 INFO:tasks.cephfs_test_runner:====================================================================== 2021-10-21T00:43:18.899 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:18.900 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-10-21T00:43:18.900 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.900 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-10-21T00:43:18.901 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-10-21T00:43:18.901 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-10-21T00:43:18.901 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-10-21T00:43:18.901 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-10-21T00:43:18.902 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.902 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-10-21T00:43:18.902 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.902 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-10-21T00:43:18.903 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-10-21T00:43:18.903 INFO:tasks.cephfs_test_runner: m.teardown() 2021-10-21T00:43:18.903 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-10-21T00:43:18.904 INFO:tasks.cephfs_test_runner: self.umount() 2021-10-21T00:43:18.904 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-10-21T00:43:18.904 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-10-21T00:43:18.904 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-10-21T00:43:18.905 INFO:tasks.cephfs_test_runner: proc.wait() 2021-10-21T00:43:18.905 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait 2021-10-21T00:43:18.905 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-10-21T00:43:18.905 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-10-21T00:43:18.906 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-10-21T00:43:18.906 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-10-21T00:43:18.906 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-10-21T00:43:18.906 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-10-21T00:43:18.907 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-10-21T00:43:18.907 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-10-21T00:43:18.907 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-10-21T00:43:18.908 INFO:tasks.cephfs_test_runner: for line in f: 2021-10-21T00:43:18.908 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-10-21T00:43:18.908 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-10-21T00:43:18.908 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-10-21T00:43:18.909 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-10-21T00:43:18.909 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-10-21T00:43:18.909 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-10-21T00:43:18.910 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-10-21T00:43:18.910 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-10-21T00:43:18.910 INFO:tasks.cephfs_test_runner:socket.timeout 2021-10-21T00:43:18.910 INFO:tasks.cephfs_test_runner: 2021-10-21T00:43:18.911 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:19.104 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0270c40625e44c78acaac5ab4d51187e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-10-21T00:43:19.107 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-10-21T00:43:19.114 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-10-21T00:43:19.188 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-10-21T00:43:19.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-10-21T00:43:19.190 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-10-21T00:43:19.190 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-10-21T00:43:36.442 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:36.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:36.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:36.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:43:36.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:06.614 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:06.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:06.622 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:06.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:06.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:36.856 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:36.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:36.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:36.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:44:36.868 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:06.998 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:07.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:07.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:07.007 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:07.010 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:37.131 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:37.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:37.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:37.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:45:37.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:07.203 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:07.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:07.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:07.213 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:07.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:37.290 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:37.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:37.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:37.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:46:37.304 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:07.459 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:07.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:07.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:07.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:07.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:37.666 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:37.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:37.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:37.676 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:47:37.679 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:07.797 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:07.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:07.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:07.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:07.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:37.933 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:37.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:37.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:37.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:48:37.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:08.060 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:08.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:08.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:08.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:08.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:38.185 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:38.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:38.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:38.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:49:38.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:08.414 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:08.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:08.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:08.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:08.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:38.599 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:38.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:38.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:38.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:50:38.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:08.743 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:08.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:08.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:08.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:08.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:39.013 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:39.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:39.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:39.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:51:39.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:09.141 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:09.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:09.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:09.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:09.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:39.283 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:39.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:39.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:39.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:52:39.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:09.423 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:09.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:09.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:09.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:09.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:39.577 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:39.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:39.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:39.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:53:39.590 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:09.717 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:09.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:09.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:09.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:09.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:39.845 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:39.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:39.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:39.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:54:39.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:09.983 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:09.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:09.989 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:09.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:09.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:40.048 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:40.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:40.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:40.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:55:40.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:10.197 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:10.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:10.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:10.208 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:10.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:40.529 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:40.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:40.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:40.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:56:40.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:10.703 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:10.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:10.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:10.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:10.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:40.841 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:40.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:40.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:40.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:57:40.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:10.992 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:10.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:10.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:11.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:11.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:19.221 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:58:19.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:58:19.362 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:58:19.366 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-10-21T00:58:19.376 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-10-21T00:58:19.388 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-10-21T00:58:19.390 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:58:19.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 Processor -- start 2021-10-21T00:58:19.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 -- start start 2021-10-21T00:58:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49900af620 0x7f49900ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.525 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 0x7f4990149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.526 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900b0b50 con 0x7f49900b2170 2021-10-21T00:58:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900b2550 con 0x7f49900af620 2021-10-21T00:58:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f4995040700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900b0d90 con 0x7f4990067a80 2021-10-21T00:58:19.528 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f498ffff700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f49900b2170 0x7f49900ab170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36976/0 (socket says 172.21.15.41:36976) 2021-10-21T00:58:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f498ffff700 1 -- 172.21.15.41:0/280976954 learned_addr learned my addr 172.21.15.41:0/280976954 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:19.529 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f498f7fe700 1 --2- 172.21.15.41:0/280976954 >> v2:172.21.15.62:3300/0 conn(0x7f49900af620 0x7f49900ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.514+0000 7f499483f700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 0x7f4990149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498effd700 1 -- 172.21.15.41:0/280976954 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557382358 0 0) 0x7f4984001110 con 0x7f49900b2170 2021-10-21T00:58:19.530 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498effd700 1 -- 172.21.15.41:0/280976954 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c003260 con 0x7f49900b2170 2021-10-21T00:58:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498f7fe700 1 -- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 msgr2=0x7f4990149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498f7fe700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 0x7f4990149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498f7fe700 1 -- 172.21.15.41:0/280976954 >> v1:172.21.15.41:6789/0 conn(0x7f49900b2170 legacy=0x7f49900ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498f7fe700 1 -- 172.21.15.41:0/280976954 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900b1030 con 0x7f49900af620 2021-10-21T00:58:19.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f499483f700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 0x7f4990149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498f7fe700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49900af620 0x7f49900ab880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f4980002f70 tx=0x7f4980006df0).ready entity=mon.1 client_cookie=63485b5739a99a3b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498effd700 1 -- 172.21.15.41:0/280976954 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498000d4a0 con 0x7f49900af620 2021-10-21T00:58:19.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498effd700 1 -- 172.21.15.41:0/280976954 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980000e90 con 0x7f49900af620 2021-10-21T00:58:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f498effd700 1 -- 172.21.15.41:0/280976954 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498000d7f0 con 0x7f49900af620 2021-10-21T00:58:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49900af620 msgr2=0x7f49900ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49900af620 0x7f49900ab880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f4980002f70 tx=0x7f4980006df0).stop 2021-10-21T00:58:19.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- 172.21.15.41:0/280976954 shutdown_connections 2021-10-21T00:58:19.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4990067a80 0x7f4990149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- 172.21.15.41:0/280976954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49900af620 0x7f49900ab880 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- 172.21.15.41:0/280976954 >> 172.21.15.41:0/280976954 conn(0x7f49900b5700 msgr2=0x7f49900b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- 172.21.15.41:0/280976954 shutdown_connections 2021-10-21T00:58:19.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- 172.21.15.41:0/280976954 wait complete. 2021-10-21T00:58:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 Processor -- start 2021-10-21T00:58:19.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- start start 2021-10-21T00:58:19.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4990067a80 0x7f49901470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49900af620 0x7f49901599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990145810 con 0x7f49900b2170 2021-10-21T00:58:19.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ad6d0 con 0x7f4990067a80 2021-10-21T00:58:19.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.518+0000 7f4995040700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ad970 con 0x7f49900af620 2021-10-21T00:58:19.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498f7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49900af620 0x7f49901599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39216/0 (socket says 172.21.15.41:39216) 2021-10-21T00:58:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 -- 172.21.15.41:0/741608547 learned_addr learned my addr 172.21.15.41:0/741608547 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498ffff700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4990067a80 0x7f49901470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 -- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49900af620 msgr2=0x7f49901599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49900af620 0x7f49901599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 -- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4990067a80 msgr2=0x7f49901470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4990067a80 0x7f49901470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 -- 172.21.15.41:0/741608547 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009470 con 0x7f49900b2170 2021-10-21T00:58:19.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f499483f700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f498800c000 tx=0x7f49880091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498800c6a0 con 0x7f49900b2170 2021-10-21T00:58:19.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800c800 con 0x7f49900b2170 2021-10-21T00:58:19.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498000b180 con 0x7f49900b2170 2021-10-21T00:58:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498800cb60 con 0x7f49900b2170 2021-10-21T00:58:19.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49900976c0 con 0x7f49900b2170 2021-10-21T00:58:19.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49900adb30 con 0x7f49900b2170 2021-10-21T00:58:19.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.522+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4988022070 con 0x7f49900b2170 2021-10-21T00:58:19.551 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.526+0000 7f498d7fa700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 0x7f4970055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.526+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f498806bcf0 con 0x7f49900b2170 2021-10-21T00:58:19.552 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.526+0000 7f498ffff700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 0x7f4970055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.526+0000 7f498ffff700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 0x7f4970055b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f498400d000 tx=0x7f49840078a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.553 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.530+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4988043130 con 0x7f49900b2170 2021-10-21T00:58:19.662 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.654+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49900b12d0 con 0x7f49900b2170 2021-10-21T00:58:19.663 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.658+0000 7f498d7fa700 1 -- 172.21.15.41:0/741608547 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+13318 (secure 0 0 0) 0x7f4988016020 con 0x7f49900b2170 2021-10-21T00:58:19.664 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:58:19.665 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":148,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:48.577200+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.41:6833/680865420":"2021-10-22T00:12:45.275070+0000","172.21.15.41:6832/680865420":"2021-10-22T00:12:45.275070+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:58:19.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 msgr2=0x7f4970055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.668 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 0x7f4970055b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f498400d000 tx=0x7f49840078a0).stop 2021-10-21T00:58:19.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 msgr2=0x7f4990159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.669 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f498800c000 tx=0x7f49880091d0).stop 2021-10-21T00:58:19.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 shutdown_connections 2021-10-21T00:58:19.670 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f49700536a0 0x7f4970055b60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f49900b2170 0x7f4990159ea0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.671 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49900af620 0x7f49901599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 --2- 172.21.15.41:0/741608547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4990067a80 0x7f49901470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.672 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 >> 172.21.15.41:0/741608547 conn(0x7f49900b5700 msgr2=0x7f499014c710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:19.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 shutdown_connections 2021-10-21T00:58:19.673 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.662+0000 7f4995040700 1 -- 172.21.15.41:0/741608547 wait complete. 2021-10-21T00:58:19.680 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:58:19.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 Processor -- start 2021-10-21T00:58:19.785 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 -- start start 2021-10-21T00:58:19.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd10005f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd10005fe30 0x7fd1000602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1000b4760 con 0x7fd1000b4380 2021-10-21T00:58:19.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000b1b40 con 0x7fd10005fe30 2021-10-21T00:58:19.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0fffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd100062e50 con 0x7fd100147950 2021-10-21T00:58:19.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd10005fe30 0x7fd1000602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0feffd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fd1000b4380 0x7fd1001464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:36992/0 (socket says 172.21.15.41:36992) 2021-10-21T00:58:19.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fd10005fe30 0x7fd1000602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39224/0 (socket says 172.21.15.41:39224) 2021-10-21T00:58:19.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0feffd700 1 -- 172.21.15.41:0/4278926074 learned_addr learned my addr 172.21.15.41:0/4278926074 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:19.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0f7fff700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd10005f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 -- 172.21.15.41:0/4278926074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 msgr2=0x7fd10005f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:19.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd10005f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 -- 172.21.15.41:0/4278926074 >> v1:172.21.15.41:6789/0 conn(0x7fd1000b4380 legacy=0x7fd1001464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.778+0000 7fd0ff7fe700 1 -- 172.21.15.41:0/4278926074 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000630f0 con 0x7fd10005fe30 2021-10-21T00:58:19.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0ff7fe700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd1000602c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fd0f80032f0 tx=0x7fd0f80091d0).ready entity=mon.0 client_cookie=fb7d88166ef0ae1b server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fe7fc700 1 -- 172.21.15.41:0/4278926074 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f800b6c0 con 0x7fd10005fe30 2021-10-21T00:58:19.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fe7fc700 1 -- 172.21.15.41:0/4278926074 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800b820 con 0x7fd10005fe30 2021-10-21T00:58:19.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fe7fc700 1 -- 172.21.15.41:0/4278926074 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f800b990 con 0x7fd10005fe30 2021-10-21T00:58:19.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- 172.21.15.41:0/4278926074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 msgr2=0x7fd1000602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd1000602c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fd0f80032f0 tx=0x7fd0f80091d0).stop 2021-10-21T00:58:19.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- 172.21.15.41:0/4278926074 shutdown_connections 2021-10-21T00:58:19.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd1000602c0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 --2- 172.21.15.41:0/4278926074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd10005f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- 172.21.15.41:0/4278926074 >> 172.21.15.41:0/4278926074 conn(0x7fd1000b7910 msgr2=0x7fd1000b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:19.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- 172.21.15.41:0/4278926074 shutdown_connections 2021-10-21T00:58:19.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- 172.21.15.41:0/4278926074 wait complete. 2021-10-21T00:58:19.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 Processor -- start 2021-10-21T00:58:19.804 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.782+0000 7fd0fffff700 1 -- start start 2021-10-21T00:58:19.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 0x7fd10014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.805 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd100159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10014b3f0 con 0x7fd10005fe30 2021-10-21T00:58:19.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10015a490 con 0x7fd1000b4380 2021-10-21T00:58:19.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10015a730 con 0x7fd100147950 2021-10-21T00:58:19.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd100159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 0x7fd10014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39230/0 (socket says 172.21.15.41:39230) 2021-10-21T00:58:19.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 -- 172.21.15.41:0/2735338548 learned_addr learned my addr 172.21.15.41:0/2735338548 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:19.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 -- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 msgr2=0x7fd100159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd100159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 -- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 msgr2=0x7fd10014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 0x7fd10014adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 -- 172.21.15.41:0/2735338548 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009470 con 0x7fd10005fe30 2021-10-21T00:58:19.810 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0f7fff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 0x7fd10014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:19.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0ff7fe700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd100159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:19.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0feffd700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fd100060c40 tx=0x7fd0f0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.811 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f00070d0 con 0x7fd10005fe30 2021-10-21T00:58:19.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0007230 con 0x7fd10005fe30 2021-10-21T00:58:19.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0f0005610 con 0x7fd10005fe30 2021-10-21T00:58:19.812 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10014a4a0 con 0x7fd10005fe30 2021-10-21T00:58:19.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.786+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1000af260 con 0x7fd10005fe30 2021-10-21T00:58:19.813 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd0f0010070 con 0x7fd10005fe30 2021-10-21T00:58:19.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10015a2c0 con 0x7fd10005fe30 2021-10-21T00:58:19.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0fcff9700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 0x7fd0e4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:19.814 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd0f006ab00 con 0x7fd10005fe30 2021-10-21T00:58:19.815 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0f7fff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 0x7fd0e4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:19.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.790+0000 7fd0f7fff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 0x7fd0e4055b90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fd0e800b000 tx=0x7fd0e8006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:19.816 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.794+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0f0041f40 con 0x7fd10005fe30 2021-10-21T00:58:19.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.914+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd100063390 con 0x7fd0e40536d0 2021-10-21T00:58:19.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.922+0000 7fd0fcff9700 1 -- 172.21.15.41:0/2735338548 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67984 (secure 0 0 0) 0x7fd100063390 con 0x7fd0e40536d0 2021-10-21T00:58:19.930 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:58:19.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 msgr2=0x7fd0e4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 0x7fd0e4055b90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fd0e800b000 tx=0x7fd0e8006df0).stop 2021-10-21T00:58:19.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 msgr2=0x7fd100148b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:19.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fd100060c40 tx=0x7fd0f0007c00).stop 2021-10-21T00:58:19.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 shutdown_connections 2021-10-21T00:58:19.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fd0e40536d0 0x7fd0e4055b90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd100147950 0x7fd100159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1000b4380 0x7fd10014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 --2- 172.21.15.41:0/2735338548 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fd10005fe30 0x7fd100148b70 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:19.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 >> 172.21.15.41:0/2735338548 conn(0x7fd1000b7910 msgr2=0x7fd1000b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:19.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 shutdown_connections 2021-10-21T00:58:19.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:19.926+0000 7fd0fffff700 1 -- 172.21.15.41:0/2735338548 wait complete. 2021-10-21T00:58:19.936 INFO:teuthology.orchestra.run.smithi041.stderr:dumped all 2021-10-21T00:58:19.943 INFO:teuthology.orchestra.run.smithi041.stdout:{"pg_ready":true,"pg_map":{"version":1809,"stamp":"2021-10-21T00:58:19.229706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6384832,"kb_used_data":743210208,"kb_used_omap":27883,"kb_used_meta":0,"kb_avail":743210208,"statfs":{"total":767585320960,"available":761047252992,"internally_reserved":0,"allocated":761047252992,"data_stored":761047252992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28552981,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003219"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":137,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.581595+0000","last_change":"2021-10-21T00:02:48.921294+0000","last_active":"2021-10-21T00:12:47.581595+0000","last_peered":"2021-10-21T00:12:47.581595+0000","last_clean":"2021-10-21T00:12:47.581595+0000","last_became_active":"2021-10-21T00:02:48.920214+0000","last_became_peered":"2021-10-21T00:02:48.920214+0000","last_unstale":"2021-10-21T00:12:47.581595+0000","last_undegraded":"2021-10-21T00:12:47.581595+0000","last_fullsized":"2021-10-21T00:12:47.581595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_clean_scrub_stamp":"2021-10-21T00:02:44.356620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":139,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582746+0000","last_change":"2021-10-21T00:02:54.442999+0000","last_active":"2021-10-21T00:12:47.582746+0000","last_peered":"2021-10-21T00:12:47.582746+0000","last_clean":"2021-10-21T00:12:47.582746+0000","last_became_active":"2021-10-21T00:02:54.442653+0000","last_became_peered":"2021-10-21T00:02:54.442653+0000","last_unstale":"2021-10-21T00:12:47.582746+0000","last_undegraded":"2021-10-21T00:12:47.582746+0000","last_fullsized":"2021-10-21T00:12:47.582746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.581855+0000","last_change":"2021-10-21T00:02:54.443329+0000","last_active":"2021-10-21T00:12:47.581855+0000","last_peered":"2021-10-21T00:12:47.581855+0000","last_clean":"2021-10-21T00:12:47.581855+0000","last_became_active":"2021-10-21T00:02:54.442888+0000","last_became_peered":"2021-10-21T00:02:54.442888+0000","last_unstale":"2021-10-21T00:12:47.581855+0000","last_undegraded":"2021-10-21T00:12:47.581855+0000","last_fullsized":"2021-10-21T00:12:47.581855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:48.080238+0000","last_change":"2021-10-21T00:02:55.009600+0000","last_active":"2021-10-21T00:12:48.080238+0000","last_peered":"2021-10-21T00:12:48.080238+0000","last_clean":"2021-10-21T00:12:48.080238+0000","last_became_active":"2021-10-21T00:02:55.009083+0000","last_became_peered":"2021-10-21T00:02:55.009083+0000","last_unstale":"2021-10-21T00:12:48.080238+0000","last_undegraded":"2021-10-21T00:12:48.080238+0000","last_fullsized":"2021-10-21T00:12:48.080238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":139,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582747+0000","last_change":"2021-10-21T00:02:54.443795+0000","last_active":"2021-10-21T00:12:47.582747+0000","last_peered":"2021-10-21T00:12:47.582747+0000","last_clean":"2021-10-21T00:12:47.582747+0000","last_became_active":"2021-10-21T00:02:54.443329+0000","last_became_peered":"2021-10-21T00:02:54.443329+0000","last_unstale":"2021-10-21T00:12:47.582747+0000","last_undegraded":"2021-10-21T00:12:47.582747+0000","last_fullsized":"2021-10-21T00:12:47.582747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.752243+0000","last_change":"2021-10-21T00:02:55.002147+0000","last_active":"2021-10-21T00:12:47.752243+0000","last_peered":"2021-10-21T00:12:47.752243+0000","last_clean":"2021-10-21T00:12:47.752243+0000","last_became_active":"2021-10-21T00:02:55.001733+0000","last_became_peered":"2021-10-21T00:02:55.001733+0000","last_unstale":"2021-10-21T00:12:47.752243+0000","last_undegraded":"2021-10-21T00:12:47.752243+0000","last_fullsized":"2021-10-21T00:12:47.752243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582354+0000","last_change":"2021-10-21T00:02:55.003763+0000","last_active":"2021-10-21T00:12:47.582354+0000","last_peered":"2021-10-21T00:12:47.582354+0000","last_clean":"2021-10-21T00:12:47.582354+0000","last_became_active":"2021-10-21T00:02:55.003018+0000","last_became_peered":"2021-10-21T00:02:55.003018+0000","last_unstale":"2021-10-21T00:12:47.582354+0000","last_undegraded":"2021-10-21T00:12:47.582354+0000","last_fullsized":"2021-10-21T00:12:47.582354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.752630+0000","last_change":"2021-10-21T00:02:54.444552+0000","last_active":"2021-10-21T00:12:47.752630+0000","last_peered":"2021-10-21T00:12:47.752630+0000","last_clean":"2021-10-21T00:12:47.752630+0000","last_became_active":"2021-10-21T00:02:54.443600+0000","last_became_peered":"2021-10-21T00:02:54.443600+0000","last_unstale":"2021-10-21T00:12:47.752630+0000","last_undegraded":"2021-10-21T00:12:47.752630+0000","last_fullsized":"2021-10-21T00:12:47.752630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:48.081266+0000","last_change":"2021-10-21T00:02:54.441675+0000","last_active":"2021-10-21T00:12:48.081266+0000","last_peered":"2021-10-21T00:12:48.081266+0000","last_clean":"2021-10-21T00:12:48.081266+0000","last_became_active":"2021-10-21T00:02:54.441301+0000","last_became_peered":"2021-10-21T00:02:54.441301+0000","last_unstale":"2021-10-21T00:12:48.081266+0000","last_undegraded":"2021-10-21T00:12:48.081266+0000","last_fullsized":"2021-10-21T00:12:48.081266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3650,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3737700,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0800000000000001,"5min":1.248,"15min":1.2929999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0940000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.198},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84999999999999998,"15min":0.83399999999999996},"min":{"1min":0.66700000000000004,"5min":0.60999999999999999,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84199999999999997,"15min":0.85199999999999998},"min":{"1min":0.68300000000000005,"5min":0.58499999999999996,"15min":0.57999999999999996},"max":{"1min":1.0269999999999999,"5min":1.1000000000000001,"15min":1.3300000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.874,"15min":0.88},"min":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.159,"5min":1.194,"15min":1.466},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.69099999999999995,"5min":0.621,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.242,"15min":1.5529999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91600000000000004,"15min":0.90300000000000002},"min":{"1min":0.76600000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.153,"5min":1.167,"15min":1.3089999999999999},"last":1.403}]},{"osd":4,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.2549999999999999,"5min":1.3660000000000001,"15min":1.6299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.64300000000000002,"5min":0.629,"15min":0.57499999999999996},"max":{"1min":1.097,"5min":1.2809999999999999,"15min":1.393},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.82799999999999996},"min":{"1min":0.60399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1950000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.71999999999999997,"5min":0.63100000000000001,"15min":0.59699999999999998},"max":{"1min":1.2,"5min":1.4590000000000001,"15min":1.7050000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68600000000000005,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":1.2330000000000001,"5min":1.605,"15min":1.605},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.82199999999999995,"5min":0.69899999999999995,"15min":0.56699999999999995},"max":{"1min":1.204,"5min":1.3839999999999999,"15min":1.78},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":4014,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4111129,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.434},"max":{"1min":1.02,"5min":1.1000000000000001,"15min":3.278},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.52000000000000002},"max":{"1min":1.0740000000000001,"5min":1.7709999999999999,"15min":3.069},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0229999999999999,"5min":1.1910000000000001,"15min":2.9380000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56000000000000005},"max":{"1min":1.089,"5min":2.8460000000000001,"15min":3.3519999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.64300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.137,"5min":2.7189999999999999,"15min":3.0299999999999998},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89200000000000002,"15min":0.86899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.1160000000000001,"5min":1.254,"15min":3.3199999999999998},"last":0.879}]},{"osd":3,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.89100000000000001},"min":{"1min":0.73899999999999999,"5min":0.63500000000000001,"15min":0.62},"max":{"1min":1.238,"5min":3.0019999999999998,"15min":3.008},"last":0.629},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92600000000000005,"15min":0.90900000000000003},"min":{"1min":0.65800000000000003,"5min":0.64500000000000002,"15min":0.63700000000000001},"max":{"1min":1.1020000000000001,"5min":2.8959999999999999,"15min":3.1150000000000002},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.1719999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.56100000000000005},"max":{"1min":1.21,"5min":1.365,"15min":1.365},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.66400000000000003,"5min":0.58699999999999997,"15min":0.46500000000000002},"max":{"1min":1.071,"5min":1.167,"15min":1.2589999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0149999999999999,"15min":0.999},"min":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.385,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.099}]}]},{"osd":5,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806057,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.44500000000000001},"max":{"1min":0.95299999999999996,"5min":1.087,"15min":1.2130000000000001},"last":1.218},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.57399999999999995},"max":{"1min":1.1100000000000001,"5min":1.2030000000000001,"15min":1.2050000000000001},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.86599999999999999},"min":{"1min":0.61299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.014,"5min":1.117,"15min":1.1910000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.63200000000000001,"5min":0.60999999999999999,"15min":0.47599999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.258},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.0369999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.1819999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61399999999999999},"max":{"1min":1.1279999999999999,"5min":1.194,"15min":1.194},"last":1.091},{"interface":"front","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71399999999999997,"5min":0.64600000000000002,"15min":0.59699999999999998},"max":{"1min":1.1040000000000001,"5min":1.139,"15min":1.2470000000000001},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79700000000000004,"15min":0.78800000000000003},"min":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1870000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.90000000000000002},"min":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.46800000000000003},"max":{"1min":1.2170000000000001,"5min":1.236,"15min":1.3},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.0669999999999999,"5min":1.2070000000000001,"15min":1.3169999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91200000000000003,"15min":0.91000000000000003},"min":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.56399999999999995},"max":{"1min":1.1579999999999999,"5min":1.27,"15min":1.274},"last":1.252}]},{"osd":7,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.99199999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.4730000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.0309999999999999,"15min":1.026},"min":{"1min":0.84499999999999997,"5min":0.67000000000000004,"15min":0.57599999999999996},"max":{"1min":1.1579999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.03}]}]},{"osd":4,"up_from":13,"seq":55834575517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797992,"kb_used_data":92901388,"kb_used_omap":3545,"kb_used_meta":0,"kb_avail":92901388,"statfs":{"total":95948165120,"available":95131021312,"internally_reserved":0,"allocated":95131021312,"data_stored":95131021312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3630274,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.46700000000000003},"max":{"1min":1.091,"5min":1.139,"15min":1.147},"last":0.996},{"interface":"front","average":{"1min":0.753,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.96699999999999997,"5min":1.2869999999999999,"15min":1.3540000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.60199999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93799999999999994,"5min":1.21,"15min":1.381},"last":0.622},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81799999999999995},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.53200000000000003},"max":{"1min":1.0469999999999999,"5min":1.0860000000000001,"15min":1.2789999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.70999999999999996,"5min":0.60399999999999998,"15min":0.59999999999999998},"max":{"1min":0.99099999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84899999999999998,"15min":0.86299999999999999},"min":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.56599999999999995},"max":{"1min":0.97399999999999998,"5min":1.351,"15min":1.351},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.61499999999999999,"15min":0.56599999999999995},"max":{"1min":1.056,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.95299999999999996},"min":{"1min":0.80300000000000005,"5min":0.74399999999999999,"15min":0.62},"max":{"1min":1.171,"5min":1.393,"15min":1.393},"last":1.0349999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.71499999999999997,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.127,"5min":1.1799999999999999,"15min":1.24},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.90400000000000003,"15min":0.874},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.51500000000000001},"max":{"1min":1.056,"5min":1.198,"15min":1.2350000000000001},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":0.85299999999999998},"min":{"1min":0.61399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1579999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.91200000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.202,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.88700000000000001},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3129999999999999,"5min":1.415,"15min":1.415},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0349999999999999},"min":{"1min":0.66700000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.339,"5min":1.454,"15min":1.5069999999999999},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3364,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3444746,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.442},"max":{"1min":1.0860000000000001,"5min":1.095,"15min":1.095},"last":1.355}]},{"osd":1,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.379},"max":{"1min":0.89700000000000002,"5min":0.91900000000000004,"15min":1.0609999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.496},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.028},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":0.97699999999999998,"5min":1.115,"15min":1.129},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.117},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":0.94499999999999995},"min":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.1419999999999999,"5min":1.222,"15min":1.2789999999999999},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1799999999999999,"5min":1.351,"15min":1.351},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.72099999999999997,"5min":0.69799999999999995,"15min":0.67500000000000004},"max":{"1min":1.1519999999999999,"5min":1.296,"15min":1.399},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.72699999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1040000000000001,"5min":1.421,"15min":1.421},"last":1.514}]},{"osd":7,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.78600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.226,"5min":1.518,"15min":1.518},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.82299999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.53},"last":1.115}]}]},{"osd":2,"up_from":13,"seq":55834575516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2833,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2901293,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.117},"last":0.496},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70499999999999996,"15min":0.67800000000000005},"min":{"1min":0.53600000000000003,"5min":0.47799999999999998,"15min":0.41599999999999998},"max":{"1min":1.0780000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.57399999999999995},"max":{"1min":0.94299999999999995,"5min":1.228,"15min":1.228},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":1.1519999999999999,"15min":1.1539999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.071,"15min":1.1399999999999999},"last":0.873}]},{"osd":4,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.81699999999999995,"5min":0.71299999999999997,"15min":0.63900000000000001},"max":{"1min":1.0109999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.74299999999999999,"5min":0.63300000000000001,"15min":0.624},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.67000000000000004},"max":{"1min":1.1830000000000001,"5min":1.2989999999999999,"15min":1.373},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.753,"5min":0.69299999999999995,"15min":0.67100000000000004},"max":{"1min":1.2390000000000001,"5min":1.3700000000000001,"15min":1.4299999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.85899999999999999,"5min":0.66800000000000004,"15min":0.66700000000000004},"max":{"1min":1.117,"5min":1.198,"15min":1.4179999999999999},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.98799999999999999,"15min":0.98899999999999999},"min":{"1min":0.86699999999999999,"5min":0.66500000000000004,"15min":0.65900000000000003},"max":{"1min":1.236,"5min":1.2549999999999999,"15min":1.5549999999999999},"last":1.107},{"interface":"front","average":{"1min":1.04,"5min":1.0309999999999999,"15min":1.028},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.69799999999999995},"max":{"1min":1.302,"5min":1.4279999999999999,"15min":1.595},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834575516,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3954,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4049883,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.026,"15min":1.0620000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.7230000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.436},"max":{"1min":1.133,"5min":1.133,"15min":1.181},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.72099999999999997,"15min":0.71199999999999997},"min":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.57499999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77300000000000002,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48099999999999998},"max":{"1min":0.99399999999999999,"5min":1.0589999999999999,"15min":1.0700000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89000000000000001,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.262},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.71199999999999997,"5min":0.67400000000000004,"15min":0.63500000000000001},"max":{"1min":1.2629999999999999,"5min":1.347,"15min":1.347},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98899999999999999,"15min":0.97199999999999998},"min":{"1min":0.747,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6200000000000001},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.96699999999999997},"min":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.67200000000000004},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.70599999999999996},"max":{"1min":1.3069999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.036,"15min":1.0289999999999999},"min":{"1min":0.83299999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6850000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.0649999999999999,"15min":1.04},"min":{"1min":0.81599999999999995,"5min":0.749,"15min":0.71199999999999997},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3781,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3871899,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":1.028,"5min":1.304,"15min":1.304},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":1.0409999999999999,"15min":1.272},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.49099999999999999},"max":{"1min":1.2230000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.755,"15min":0.748},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.089,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88200000000000001,"15min":0.877},"min":{"1min":0.72899999999999998,"5min":0.67500000000000004,"15min":0.65700000000000003},"max":{"1min":1.3759999999999999,"5min":1.5,"15min":1.5},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.79400000000000004,"5min":0.63300000000000001,"15min":0.58299999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88600000000000001,"15min":0.89000000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.61499999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96799999999999997,"15min":0.95799999999999996},"min":{"1min":0.79300000000000004,"5min":0.746,"15min":0.67600000000000005},"max":{"1min":1.4910000000000001,"5min":1.587,"15min":1.587},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0249999999999999,"15min":1.0069999999999999},"min":{"1min":0.81100000000000005,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.607,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.107},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.96599999999999997,"15min":0.96899999999999997},"min":{"1min":0.81299999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.81299999999999994,"5min":0.74299999999999999,"15min":0.69399999999999995},"max":{"1min":1.617,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.123,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.71799999999999997},"max":{"1min":1.661,"5min":1.722,"15min":1.722},"last":1.151}]}]}]}} 2021-10-21T00:58:19.946 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-10-21T00:58:20.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 Processor -- start 2021-10-21T00:58:20.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 -- start start 2021-10-21T00:58:20.059 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:20.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c05fdd0 con 0x7fad4c0b0730 2021-10-21T00:58:20.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c140400 con 0x7fad4c05f9f0 2021-10-21T00:58:20.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0b27c0 con 0x7fad4c0b3370 2021-10-21T00:58:20.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4b7fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fad4c0b0730 0x7fad4c138b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37008/0 (socket says 172.21.15.41:37008) 2021-10-21T00:58:20.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4b7fe700 1 -- 172.21.15.41:0/2268844216 learned_addr learned my addr 172.21.15.41:0/2268844216 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:20.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4a7fc700 1 --2- 172.21.15.41:0/2268844216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:20.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526936627 0 0) 0x7fad4c05fdd0 con 0x7fad4c0b0730 2021-10-21T00:58:20.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003260 con 0x7fad4c0b0730 2021-10-21T00:58:20.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453374310 0 0) 0x7fad4c140400 con 0x7fad4c05f9f0 2021-10-21T00:58:20.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c05fdd0 con 0x7fad4c05f9f0 2021-10-21T00:58:20.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4a7fc700 1 -- 172.21.15.41:0/2268844216 >> v1:172.21.15.62:6789/0 conn(0x7fad4c05f9f0 legacy=0x7fad4c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4a7fc700 1 -- 172.21.15.41:0/2268844216 >> v1:172.21.15.41:6789/0 conn(0x7fad4c0b0730 legacy=0x7fad4c138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4a7fc700 1 -- 172.21.15.41:0/2268844216 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c140080 con 0x7fad4c0b3370 2021-10-21T00:58:20.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.050+0000 7fad4a7fc700 1 --2- 172.21.15.41:0/2268844216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c0b0e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fad3c0032f0 tx=0x7fad3c0091d0).ready entity=mon.2 client_cookie=e9001772e60a6161 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:20.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3c00b640 con 0x7fad4c0b3370 2021-10-21T00:58:20.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00b7a0 con 0x7fad4c0b3370 2021-10-21T00:58:20.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad49ffb700 1 -- 172.21.15.41:0/2268844216 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3c00b910 con 0x7fad4c0b3370 2021-10-21T00:58:20.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- 172.21.15.41:0/2268844216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 msgr2=0x7fad4c0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 --2- 172.21.15.41:0/2268844216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c0b0e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fad3c0032f0 tx=0x7fad3c0091d0).stop 2021-10-21T00:58:20.066 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- 172.21.15.41:0/2268844216 shutdown_connections 2021-10-21T00:58:20.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 --2- 172.21.15.41:0/2268844216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c0b0e50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- 172.21.15.41:0/2268844216 >> 172.21.15.41:0/2268844216 conn(0x7fad4c0637b0 msgr2=0x7fad4c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:20.067 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- 172.21.15.41:0/2268844216 shutdown_connections 2021-10-21T00:58:20.068 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- 172.21.15.41:0/2268844216 wait complete. 2021-10-21T00:58:20.071 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 Processor -- start 2021-10-21T00:58:20.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.054+0000 7fad4bfff700 1 -- start start 2021-10-21T00:58:20.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad4c05f9f0 0x7fad4c145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:20.072 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:20.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:20.073 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c064d20 con 0x7fad4c0b0730 2021-10-21T00:58:20.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c064fc0 con 0x7fad4c05f9f0 2021-10-21T00:58:20.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c065260 con 0x7fad4c0b3370 2021-10-21T00:58:20.074 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:20.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39242/0 (socket says 172.21.15.41:39242) 2021-10-21T00:58:20.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 -- 172.21.15.41:0/1327483392 learned_addr learned my addr 172.21.15.41:0/1327483392 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:20.075 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4affd700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad4c05f9f0 0x7fad4c145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:20.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4b7fe700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:20.076 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 -- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 msgr2=0x7fad4c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 -- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad4c05f9f0 msgr2=0x7fad4c145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.077 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad4c05f9f0 0x7fad4c145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 -- 172.21.15.41:0/1327483392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009470 con 0x7fad4c0b0730 2021-10-21T00:58:20.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4a7fc700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fad3c0032f0 tx=0x7fad3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:20.078 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3c00b910 con 0x7fad4c0b0730 2021-10-21T00:58:20.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0205f0 con 0x7fad4c0b0730 2021-10-21T00:58:20.079 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c065ba0 con 0x7fad4c0b0730 2021-10-21T00:58:20.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3c00b640 con 0x7fad4c0b0730 2021-10-21T00:58:20.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c155af0 con 0x7fad4c0b0730 2021-10-21T00:58:20.080 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c057350 con 0x7fad4c0b0730 2021-10-21T00:58:20.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.058+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad3c027030 con 0x7fad4c0b0730 2021-10-21T00:58:20.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.062+0000 7fad43fff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 0x7fad30055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:20.081 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.062+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fad3c06c510 con 0x7fad4c0b0730 2021-10-21T00:58:20.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.062+0000 7fad4affd700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 0x7fad30055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:20.082 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.062+0000 7fad4affd700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 0x7fad30055a70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fad3400d000 tx=0x7fad340079f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:20.083 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.070+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad3c043840 con 0x7fad4c0b0730 2021-10-21T00:58:20.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.194+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad4c14cf90 con 0x7fad4c0b0730 2021-10-21T00:58:20.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad43fff700 1 -- 172.21.15.41:0/1327483392 <== mon.0 v2:172.21.15.41:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+13318 (secure 0 0 0) 0x7fad3c015090 con 0x7fad4c0b0730 2021-10-21T00:58:20.204 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:58:20.204 INFO:teuthology.orchestra.run.smithi041.stdout:{"epoch":148,"fsid":"2ab49014-dc00-4ddf-b4a9-8b85c10c4d60","created":"2021-10-21T00:02:41.407605+0000","modified":"2021-10-21T00:12:48.577200+0000","last_up_change":"2021-10-21T00:02:47.809822+0000","last_in_change":"2021-10-21T00:02:47.809822+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-10-21T00:02:44.355251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-10-21T00:02:53.369001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9d4121f8-718a-453c-8e46-22ccaa7c65d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6800","nonce":14347},{"type":"v1","addr":"172.21.15.41:6801","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6802","nonce":14347},{"type":"v1","addr":"172.21.15.41:6803","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6806","nonce":14347},{"type":"v1","addr":"172.21.15.41:6807","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6804","nonce":14347},{"type":"v1","addr":"172.21.15.41:6805","nonce":14347}]},"public_addr":"172.21.15.41:6801/14347","cluster_addr":"172.21.15.41:6803/14347","heartbeat_back_addr":"172.21.15.41:6807/14347","heartbeat_front_addr":"172.21.15.41:6805/14347","state":["exists","up"]},{"osd":1,"uuid":"74d69c01-63b5-4279-9378-9271a8ca55a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6808","nonce":14348},{"type":"v1","addr":"172.21.15.41:6809","nonce":14348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6810","nonce":14348},{"type":"v1","addr":"172.21.15.41:6811","nonce":14348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6814","nonce":14348},{"type":"v1","addr":"172.21.15.41:6815","nonce":14348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6812","nonce":14348},{"type":"v1","addr":"172.21.15.41:6813","nonce":14348}]},"public_addr":"172.21.15.41:6809/14348","cluster_addr":"172.21.15.41:6811/14348","heartbeat_back_addr":"172.21.15.41:6815/14348","heartbeat_front_addr":"172.21.15.41:6813/14348","state":["exists","up"]},{"osd":2,"uuid":"603c1558-e391-4cf5-92fb-2b53696e1c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6823","nonce":14360},{"type":"v1","addr":"172.21.15.41:6825","nonce":14360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6826","nonce":14360},{"type":"v1","addr":"172.21.15.41:6827","nonce":14360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6830","nonce":14360},{"type":"v1","addr":"172.21.15.41:6831","nonce":14360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6828","nonce":14360},{"type":"v1","addr":"172.21.15.41:6829","nonce":14360}]},"public_addr":"172.21.15.41:6825/14360","cluster_addr":"172.21.15.41:6827/14360","heartbeat_back_addr":"172.21.15.41:6831/14360","heartbeat_front_addr":"172.21.15.41:6829/14360","state":["exists","up"]},{"osd":3,"uuid":"42c9fc1d-cfc4-40ab-829c-269c80c181a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6816","nonce":14357},{"type":"v1","addr":"172.21.15.41:6817","nonce":14357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6818","nonce":14357},{"type":"v1","addr":"172.21.15.41:6819","nonce":14357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6822","nonce":14357},{"type":"v1","addr":"172.21.15.41:6824","nonce":14357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.41:6820","nonce":14357},{"type":"v1","addr":"172.21.15.41:6821","nonce":14357}]},"public_addr":"172.21.15.41:6817/14357","cluster_addr":"172.21.15.41:6819/14357","heartbeat_back_addr":"172.21.15.41:6824/14357","heartbeat_front_addr":"172.21.15.41:6821/14357","state":["exists","up"]},{"osd":4,"uuid":"f454248d-9887-41fb-8d6b-6ef9afcb0ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":14810},{"type":"v1","addr":"172.21.15.62:6816","nonce":14810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6819","nonce":14810},{"type":"v1","addr":"172.21.15.62:6821","nonce":14810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":14810},{"type":"v1","addr":"172.21.15.62:6825","nonce":14810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":14810},{"type":"v1","addr":"172.21.15.62:6823","nonce":14810}]},"public_addr":"172.21.15.62:6816/14810","cluster_addr":"172.21.15.62:6821/14810","heartbeat_back_addr":"172.21.15.62:6825/14810","heartbeat_front_addr":"172.21.15.62:6823/14810","state":["exists","up"]},{"osd":5,"uuid":"acfe82dc-231b-49f2-a47f-99afb268f107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":14811},{"type":"v1","addr":"172.21.15.62:6803","nonce":14811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":14811},{"type":"v1","addr":"172.21.15.62:6805","nonce":14811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":14811},{"type":"v1","addr":"172.21.15.62:6809","nonce":14811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":14811},{"type":"v1","addr":"172.21.15.62:6807","nonce":14811}]},"public_addr":"172.21.15.62:6803/14811","cluster_addr":"172.21.15.62:6805/14811","heartbeat_back_addr":"172.21.15.62:6809/14811","heartbeat_front_addr":"172.21.15.62:6807/14811","state":["exists","up"]},{"osd":6,"uuid":"7384bca7-9f97-4d81-a23f-bcbd810a7073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":14812},{"type":"v1","addr":"172.21.15.62:6811","nonce":14812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":14812},{"type":"v1","addr":"172.21.15.62:6813","nonce":14812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":14812},{"type":"v1","addr":"172.21.15.62:6820","nonce":14812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":14812},{"type":"v1","addr":"172.21.15.62:6817","nonce":14812}]},"public_addr":"172.21.15.62:6811/14812","cluster_addr":"172.21.15.62:6813/14812","heartbeat_back_addr":"172.21.15.62:6820/14812","heartbeat_front_addr":"172.21.15.62:6817/14812","state":["exists","up"]},{"osd":7,"uuid":"8ac9bf19-cf7f-4e6c-ace4-e6b84c316ba7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":14821},{"type":"v1","addr":"172.21.15.62:6827","nonce":14821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":14821},{"type":"v1","addr":"172.21.15.62:6829","nonce":14821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":14821},{"type":"v1","addr":"172.21.15.62:6833","nonce":14821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":14821},{"type":"v1","addr":"172.21.15.62:6831","nonce":14821}]},"public_addr":"172.21.15.62:6827/14821","cluster_addr":"172.21.15.62:6829/14821","heartbeat_back_addr":"172.21.15.62:6833/14821","heartbeat_front_addr":"172.21.15.62:6831/14821","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.925611+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.957500+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.942424+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.963085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.952259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.996711+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.975479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-10-21T00:02:45.978415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.41:6833/680865420":"2021-10-22T00:12:45.275070+0000","172.21.15.41:6832/680865420":"2021-10-22T00:12:45.275070+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-10-21T00:58:20.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 msgr2=0x7fad30055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 0x7fad30055a70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fad3400d000 tx=0x7fad340079f0).stop 2021-10-21T00:58:20.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 msgr2=0x7fad4c0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:20.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fad3c0032f0 tx=0x7fad3c016000).stop 2021-10-21T00:58:20.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 shutdown_connections 2021-10-21T00:58:20.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fad300535b0 0x7fad30055a70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fad4c0b3370 0x7fad4c1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fad4c0b0730 0x7fad4c0af1e0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 --2- 172.21.15.41:0/1327483392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad4c05f9f0 0x7fad4c145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:20.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 >> 172.21.15.41:0/1327483392 conn(0x7fad4c0637b0 msgr2=0x7fad4c12c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:20.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 shutdown_connections 2021-10-21T00:58:20.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:20.198+0000 7fad4bfff700 1 -- 172.21.15.41:0/1327483392 wait complete. 2021-10-21T00:58:21.218 INFO:tasks.ceph:Scrubbing osd.0 2021-10-21T00:58:21.219 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:21.341 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.334+0000 7fbe0359e700 1 Processor -- start 2021-10-21T00:58:21.342 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.334+0000 7fbe0359e700 1 -- start start 2021-10-21T00:58:21.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbe040b0a70 0x7fbe0405bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.344 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe0405c190 0x7fbe04142a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0405cad0 con 0x7fbe040b26f0 2021-10-21T00:58:21.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe040b0e50 con 0x7fbe040b0a70 2021-10-21T00:58:21.345 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0405c830 con 0x7fbe0405c190 2021-10-21T00:58:21.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbe040b0a70 0x7fbe0405bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbe040b0a70 0x7fbe0405bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39250/0 (socket says 172.21.15.41:39250) 2021-10-21T00:58:21.346 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 -- 172.21.15.41:0/207415564 learned_addr learned my addr 172.21.15.41:0/207415564 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe02d9d700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe0405c190 0x7fbe04142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 -- 172.21.15.41:0/207415564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe0405c190 msgr2=0x7fbe04142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe0405c190 0x7fbe04142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.348 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 -- 172.21.15.41:0/207415564 >> v1:172.21.15.62:6789/0 conn(0x7fbe040b26f0 legacy=0x7fbe0405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 -- 172.21.15.41:0/207415564 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04067c30 con 0x7fbe040b0a70 2021-10-21T00:58:21.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0259c700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b0a70 0x7fbe0405bca0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fbdf4002f70 tx=0x7fbdf4006eb0).ready entity=mon.0 client_cookie=197d401a7605038 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0159a700 1 -- 172.21.15.41:0/207415564 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf400d570 con 0x7fbe040b0a70 2021-10-21T00:58:21.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0159a700 1 -- 172.21.15.41:0/207415564 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4000e90 con 0x7fbe040b0a70 2021-10-21T00:58:21.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0159a700 1 -- 172.21.15.41:0/207415564 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf400d900 con 0x7fbe040b0a70 2021-10-21T00:58:21.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- 172.21.15.41:0/207415564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b0a70 msgr2=0x7fbe0405bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b0a70 0x7fbe0405bca0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fbdf4002f70 tx=0x7fbdf4006eb0).stop 2021-10-21T00:58:21.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- 172.21.15.41:0/207415564 shutdown_connections 2021-10-21T00:58:21.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe0405c190 0x7fbe04142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 --2- 172.21.15.41:0/207415564 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b0a70 0x7fbe0405bca0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.338+0000 7fbe0359e700 1 -- 172.21.15.41:0/207415564 >> 172.21.15.41:0/207415564 conn(0x7fbe040637b0 msgr2=0x7fbe04063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- 172.21.15.41:0/207415564 shutdown_connections 2021-10-21T00:58:21.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- 172.21.15.41:0/207415564 wait complete. 2021-10-21T00:58:21.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 Processor -- start 2021-10-21T00:58:21.359 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- start start 2021-10-21T00:58:21.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe0405c190 0x7fbe040ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.360 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe040b0a70 0x7fbe041400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 0x7fbe04065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040ae150 con 0x7fbe040b26f0 2021-10-21T00:58:21.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040ae370 con 0x7fbe0405c190 2021-10-21T00:58:21.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe0359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04067340 con 0x7fbe040b0a70 2021-10-21T00:58:21.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe02d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 0x7fbe04065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe02d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 0x7fbe04065ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39258/0 (socket says 172.21.15.41:39258) 2021-10-21T00:58:21.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe02d9d700 1 -- 172.21.15.41:0/615163708 learned_addr learned my addr 172.21.15.41:0/615163708 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.342+0000 7fbe01d9b700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe040b0a70 0x7fbe041400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe0259c700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe0405c190 0x7fbe040ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 -- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe040b0a70 msgr2=0x7fbe041400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe040b0a70 0x7fbe041400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 -- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe0405c190 msgr2=0x7fbe040ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe0405c190 0x7fbe040ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf400b1e0 con 0x7fbe040b26f0 2021-10-21T00:58:21.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe0259c700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe0405c190 0x7fbe040ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:21.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe01d9b700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe040b0a70 0x7fbe041400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:21.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe02d9d700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 0x7fbe04065ca0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fbdfc00c000 tx=0x7fbdfc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc012600 con 0x7fbe040b26f0 2021-10-21T00:58:21.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc012760 con 0x7fbe040b26f0 2021-10-21T00:58:21.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe040ad920 con 0x7fbe040b26f0 2021-10-21T00:58:21.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc012ac0 con 0x7fbe040b26f0 2021-10-21T00:58:21.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe040adea0 con 0x7fbe040b26f0 2021-10-21T00:58:21.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe040675c0 con 0x7fbe040b26f0 2021-10-21T00:58:21.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.346+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdfc022070 con 0x7fbe040b26f0 2021-10-21T00:58:21.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbde00536a0 0x7fbde0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbdfc06bb60 con 0x7fbe040b26f0 2021-10-21T00:58:21.372 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7fbde0059e20 0x7fbde005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbde005c800 con 0x7fbde0059e20 2021-10-21T00:58:21.373 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdfc070220 con 0x7fbe040b26f0 2021-10-21T00:58:21.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbe0259c700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbde00536a0 0x7fbde0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbe01d9b700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7fbde0059e20 0x7fbde005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.374 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbe01d9b700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7fbde0059e20 0x7fbde005c240 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbe0259c700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbde00536a0 0x7fbde0055b60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fbdf401c000 tx=0x7fbdf4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.375 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.350+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== osd.0 v2:172.21.15.41:6800/14347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fbde005c800 con 0x7fbde0059e20 2021-10-21T00:58:21.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.366+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 --> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe04146cc0 con 0x7fbde0059e20 2021-10-21T00:58:21.376 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.366+0000 7fbdf37fe700 1 -- 172.21.15.41:0/615163708 <== osd.0 v2:172.21.15.41:6800/14347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe04146cc0 con 0x7fbde0059e20 2021-10-21T00:58:21.377 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:21.377 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:21.378 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:21.379 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7fbde0059e20 msgr2=0x7fbde005c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:6800/14347,v1:172.21.15.41:6801/14347] conn(0x7fbde0059e20 0x7fbde005c240 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbde00536a0 msgr2=0x7fbde0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.380 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbde00536a0 0x7fbde0055b60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fbdf401c000 tx=0x7fbdf4015000).stop 2021-10-21T00:58:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 msgr2=0x7fbe04065ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 --2- 172.21.15.41:0/615163708 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbe040b26f0 0x7fbe04065ca0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fbdfc00c000 tx=0x7fbdfc0091d0).stop 2021-10-21T00:58:21.381 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe02d9d700 1 -- 172.21.15.41:0/615163708 reap_dead start 2021-10-21T00:58:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 shutdown_connections 2021-10-21T00:58:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 >> 172.21.15.41:0/615163708 conn(0x7fbe040637b0 msgr2=0x7fbe04142690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.382 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 shutdown_connections 2021-10-21T00:58:21.383 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.370+0000 7fbe0359e700 1 -- 172.21.15.41:0/615163708 wait complete. 2021-10-21T00:58:21.390 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-10-21T00:58:21.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 Processor -- start 2021-10-21T00:58:21.496 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 -- start start 2021-10-21T00:58:21.501 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65e414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40609d0 con 0x7f65e414b350 2021-10-21T00:58:21.502 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e405fdd0 con 0x7f65e40aa750 2021-10-21T00:58:21.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e9541700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40b1620 con 0x7f65e405f9f0 2021-10-21T00:58:21.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e37fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f65e414b350 0x7f65e40af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37036/0 (socket says 172.21.15.41:37036) 2021-10-21T00:58:21.503 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e37fe700 1 -- 172.21.15.41:0/3420505286 learned_addr learned my addr 172.21.15.41:0/3420505286 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:21.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65e414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755443481 0 0) 0x7f65e40609d0 con 0x7f65e414b350 2021-10-21T00:58:21.504 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c8003260 con 0x7f65e414b350 2021-10-21T00:58:21.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451475100 0 0) 0x7f65e405fdd0 con 0x7f65e40aa750 2021-10-21T00:58:21.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e40609d0 con 0x7f65e40aa750 2021-10-21T00:58:21.505 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v1:172.21.15.41:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651795236 0 0) 0x7f65c8003260 con 0x7f65e414b350 2021-10-21T00:58:21.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 msgr2=0x7f65e414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65e414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.506 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 >> v1:172.21.15.62:6789/0 conn(0x7f65e40aa750 legacy=0x7f65e414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> v1:172.21.15.41:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40b1380 con 0x7f65e414b350 2021-10-21T00:58:21.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v1:172.21.15.41:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3626318863 0 0) 0x7f65dc001680 con 0x7f65e414b350 2021-10-21T00:58:21.507 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.490+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 >> v1:172.21.15.41:6789/0 conn(0x7f65e414b350 legacy=0x7f65e40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c8003910 0x7f65c8003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.508 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65c8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65c80049f0 0x7f65c8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.509 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40b1620 con 0x7f65c80049f0 2021-10-21T00:58:21.510 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c800b800 con 0x7f65c8003910 2021-10-21T00:58:21.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c800b970 con 0x7f65e405f9f0 2021-10-21T00:58:21.511 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65c80049f0 0x7f65c8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c8003910 0x7f65c8003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.512 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e27fc700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65c8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.513 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 -- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 msgr2=0x7f65c8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e405f9f0 0x7f65c8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.514 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 -- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c8003910 msgr2=0x7f65c8003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.515 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c8003910 0x7f65c8003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 -- 172.21.15.41:0/3420505286 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c8003260 con 0x7f65c80049f0 2021-10-21T00:58:21.516 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65c80049f0 0x7f65c8004e70 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f65dc001450 tx=0x7f65e40aab90).ready entity=mon.0 client_cookie=3a2cdde9468760f8 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65dc007170 con 0x7f65c80049f0 2021-10-21T00:58:21.517 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc0072d0 con 0x7f65c80049f0 2021-10-21T00:58:21.518 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e1ffb700 1 -- 172.21.15.41:0/3420505286 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65dc00c8c0 con 0x7f65c80049f0 2021-10-21T00:58:21.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- 172.21.15.41:0/3420505286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65c80049f0 msgr2=0x7f65c8004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.519 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 --2- 172.21.15.41:0/3420505286 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65c80049f0 0x7f65c8004e70 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f65dc001450 tx=0x7f65e40aab90).stop 2021-10-21T00:58:21.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e37fe700 1 -- 172.21.15.41:0/3420505286 reap_dead start 2021-10-21T00:58:21.520 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- 172.21.15.41:0/3420505286 shutdown_connections 2021-10-21T00:58:21.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- 172.21.15.41:0/3420505286 >> 172.21.15.41:0/3420505286 conn(0x7f65e405bca0 msgr2=0x7f65e405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.521 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- 172.21.15.41:0/3420505286 shutdown_connections 2021-10-21T00:58:21.522 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- 172.21.15.41:0/3420505286 wait complete. 2021-10-21T00:58:21.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 Processor -- start 2021-10-21T00:58:21.523 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.494+0000 7f65e9541700 1 -- start start 2021-10-21T00:58:21.531 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 0x7f65e4062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.532 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 0x7f65e40671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.533 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4064a40 con 0x7f65e40ae0e0 2021-10-21T00:58:21.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4062690 con 0x7f65c80049f0 2021-10-21T00:58:21.534 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4062930 con 0x7f65e4066d50 2021-10-21T00:58:21.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.535 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39278/0 (socket says 172.21.15.41:39278) 2021-10-21T00:58:21.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 -- 172.21.15.41:0/3073109902 learned_addr learned my addr 172.21.15.41:0/3073109902 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.536 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 0x7f65e4062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 0x7f65e40671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.537 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 -- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 msgr2=0x7f65e40671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.538 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 0x7f65e40671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 -- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 msgr2=0x7f65e4062dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.539 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 0x7f65e4062dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.540 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 -- 172.21.15.41:0/3073109902 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40676c0 con 0x7f65e40ae0e0 2021-10-21T00:58:21.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 0x7f65e4062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:21.541 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e37fe700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 0x7f65e40671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:58:21.542 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e27fc700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f65d400d000 tx=0x7f65d4007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d400c7f0 con 0x7f65e40ae0e0 2021-10-21T00:58:21.543 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d400c950 con 0x7f65e40ae0e0 2021-10-21T00:58:21.544 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e4064610 con 0x7f65e40ae0e0 2021-10-21T00:58:21.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65d400ccb0 con 0x7f65e40ae0e0 2021-10-21T00:58:21.545 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.498+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e40ae870 con 0x7f65e40ae0e0 2021-10-21T00:58:21.546 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4062af0 con 0x7f65e40ae0e0 2021-10-21T00:58:21.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f65d401d460 con 0x7f65e40ae0e0 2021-10-21T00:58:21.547 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65d3fff700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 0x7f65c0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f65d406bf30 con 0x7f65e40ae0e0 2021-10-21T00:58:21.548 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 0x7f65c0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.549 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.502+0000 7f65e2ffd700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 0x7f65c0055a40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f65d800b000 tx=0x7f65d8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.550 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.506+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65d4043270 con 0x7f65e40ae0e0 2021-10-21T00:58:21.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.634+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f65e4057350 con 0x7f65c0053580 2021-10-21T00:58:21.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.634+0000 7f65d3fff700 1 -- 172.21.15.41:0/3073109902 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f65e4057350 con 0x7f65c0053580 2021-10-21T00:58:21.644 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 msgr2=0x7f65c0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 0x7f65c0055a40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f65d800b000 tx=0x7f65d8008040).stop 2021-10-21T00:58:21.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 msgr2=0x7f65e40ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f65d400d000 tx=0x7f65d4007d80).stop 2021-10-21T00:58:21.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 shutdown_connections 2021-10-21T00:58:21.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f65c0053580 0x7f65c0055a40 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e4066d50 0x7f65e40671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f65e40ae0e0 0x7f65e40ad300 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 --2- 172.21.15.41:0/3073109902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c80049f0 0x7f65e4062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 >> 172.21.15.41:0/3073109902 conn(0x7f65e405bca0 msgr2=0x7f65e40b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 shutdown_connections 2021-10-21T00:58:21.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.638+0000 7f65e9541700 1 -- 172.21.15.41:0/3073109902 wait complete. 2021-10-21T00:58:21.649 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 0 to deep-scrub 2021-10-21T00:58:21.660 INFO:tasks.ceph:Scrubbing osd.1 2021-10-21T00:58:21.661 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:21.770 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 Processor -- start 2021-10-21T00:58:21.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- start start 2021-10-21T00:58:21.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 0x7f87441391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8744060850 0x7f87441396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f874405fa30 0x7f874405fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874413f620 con 0x7f8744060850 2021-10-21T00:58:21.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440b0810 con 0x7f87440b2aa0 2021-10-21T00:58:21.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744139b90 con 0x7f874405fa30 2021-10-21T00:58:21.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8744060850 0x7f87441396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f8744060850 0x7f87441396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39288/0 (socket says 172.21.15.41:39288) 2021-10-21T00:58:21.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 -- 172.21.15.41:0/302598021 learned_addr learned my addr 172.21.15.41:0/302598021 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f8742ffd700 1 --2- 172.21.15.41:0/302598021 >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 0x7f87441391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87437fe700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f874405fa30 0x7f874405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 -- 172.21.15.41:0/302598021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f874405fa30 msgr2=0x7f874405fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f874405fa30 0x7f874405fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 -- 172.21.15.41:0/302598021 >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 msgr2=0x7f87441391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 --2- 172.21.15.41:0/302598021 >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 0x7f87441391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 -- 172.21.15.41:0/302598021 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874413f810 con 0x7f8744060850 2021-10-21T00:58:21.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f8742ffd700 1 --2- 172.21.15.41:0/302598021 >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 0x7f87441391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:21.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f87427fc700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8744060850 0x7f87441396a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f87440b0950 tx=0x7f8738006eb0).ready entity=mon.0 client_cookie=76fcdb8dc972a1c server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f8741ffb700 1 -- 172.21.15.41:0/302598021 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873800d570 con 0x7f8744060850 2021-10-21T00:58:21.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f8741ffb700 1 -- 172.21.15.41:0/302598021 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738000e90 con 0x7f8744060850 2021-10-21T00:58:21.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f8741ffb700 1 -- 172.21.15.41:0/302598021 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873800d900 con 0x7f8744060850 2021-10-21T00:58:21.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- 172.21.15.41:0/302598021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8744060850 msgr2=0x7f87441396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8744060850 0x7f87441396a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f87440b0950 tx=0x7f8738006eb0).stop 2021-10-21T00:58:21.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- 172.21.15.41:0/302598021 shutdown_connections 2021-10-21T00:58:21.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f8744060850 0x7f87441396a0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- 172.21.15.41:0/302598021 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f874405fa30 0x7f874405fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.783 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 --2- 172.21.15.41:0/302598021 >> v2:172.21.15.62:3300/0 conn(0x7f87440b2aa0 0x7f87441391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.766+0000 7f874933a700 1 -- 172.21.15.41:0/302598021 >> 172.21.15.41:0/302598021 conn(0x7f8744061ed0 msgr2=0x7f8744063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- 172.21.15.41:0/302598021 shutdown_connections 2021-10-21T00:58:21.784 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- 172.21.15.41:0/302598021 wait complete. 2021-10-21T00:58:21.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 Processor -- start 2021-10-21T00:58:21.789 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- start start 2021-10-21T00:58:21.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f874405fa30 0x7f874413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87440b2aa0 0x7f874413c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.790 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 0x7f874413c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874413bae0 con 0x7f87440ae780 2021-10-21T00:58:21.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440aeeb0 con 0x7f874405fa30 2021-10-21T00:58:21.791 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f874933a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874413b840 con 0x7f87440b2aa0 2021-10-21T00:58:21.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f87437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 0x7f874413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f87437fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 0x7f874413c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39294/0 (socket says 172.21.15.41:39294) 2021-10-21T00:58:21.792 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f87437fe700 1 -- 172.21.15.41:0/65977963 learned_addr learned my addr 172.21.15.41:0/65977963 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f87427fc700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87440b2aa0 0x7f874413c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.770+0000 7f8742ffd700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f874405fa30 0x7f874413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.793 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 -- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87440b2aa0 msgr2=0x7f874413c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87440b2aa0 0x7f874413c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.794 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 -- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f874405fa30 msgr2=0x7f874413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f874405fa30 0x7f874413ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873800b1e0 con 0x7f87440ae780 2021-10-21T00:58:21.795 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87427fc700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87440b2aa0 0x7f874413c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:21.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f87437fe700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 0x7f874413c760 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f873c006e00 tx=0x7f873c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c00c670 con 0x7f87440ae780 2021-10-21T00:58:21.796 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00c7d0 con 0x7f87440ae780 2021-10-21T00:58:21.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874413bdd0 con 0x7f87440ae780 2021-10-21T00:58:21.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c00cb30 con 0x7f87440ae780 2021-10-21T00:58:21.797 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874413cc50 con 0x7f87440ae780 2021-10-21T00:58:21.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f874413b690 con 0x7f87440ae780 2021-10-21T00:58:21.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f873c00cc90 con 0x7f87440ae780 2021-10-21T00:58:21.798 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8720053610 0x7f8720055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.774+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f873c06c1b0 con 0x7f87440ae780 2021-10-21T00:58:21.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8733fff700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f8720059d90 0x7f872005c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.799 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f872005c770 con 0x7f8720059d90 2021-10-21T00:58:21.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f873c06c480 con 0x7f87440ae780 2021-10-21T00:58:21.800 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8742ffd700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8720053610 0x7f8720055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f87427fc700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f8720059d90 0x7f872005c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f87427fc700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f8720059d90 0x7f872005c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.801 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8742ffd700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8720053610 0x7f8720055ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f873400c000 tx=0x7f8734008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.802 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.778+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== osd.1 v2:172.21.15.41:6808/14348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f872005c770 con 0x7f8720059d90 2021-10-21T00:58:21.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 --> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8744136550 con 0x7f8720059d90 2021-10-21T00:58:21.803 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f8733fff700 1 -- 172.21.15.41:0/65977963 <== osd.1 v2:172.21.15.41:6808/14348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8744136550 con 0x7f8720059d90 2021-10-21T00:58:21.804 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:21.804 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:21.805 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:21.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f8720059d90 msgr2=0x7f872005c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.806 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:6808/14348,v1:172.21.15.41:6809/14348] conn(0x7f8720059d90 0x7f872005c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8720053610 msgr2=0x7f8720055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f8720053610 0x7f8720055ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f873400c000 tx=0x7f8734008040).stop 2021-10-21T00:58:21.807 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 msgr2=0x7f874413c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 --2- 172.21.15.41:0/65977963 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f87440ae780 0x7f874413c760 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f873c006e00 tx=0x7f873c0091d0).stop 2021-10-21T00:58:21.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f87437fe700 1 -- 172.21.15.41:0/65977963 reap_dead start 2021-10-21T00:58:21.808 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 shutdown_connections 2021-10-21T00:58:21.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 >> 172.21.15.41:0/65977963 conn(0x7f8744061ed0 msgr2=0x7f874413dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 shutdown_connections 2021-10-21T00:58:21.809 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.794+0000 7f874933a700 1 -- 172.21.15.41:0/65977963 wait complete. 2021-10-21T00:58:21.811 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-10-21T00:58:21.917 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 Processor -- start 2021-10-21T00:58:21.918 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 -- start start 2021-10-21T00:58:21.920 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f85cc05f9f0 0x7f85cc0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b3370 0x7f85cc138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc05fdd0 con 0x7f85cc0b0730 2021-10-21T00:58:21.921 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc140400 con 0x7f85cc05f9f0 2021-10-21T00:58:21.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.910+0000 7f85d238a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0b27c0 con 0x7f85cc0b3370 2021-10-21T00:58:21.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f85cc05f9f0 0x7f85cc0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.922 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f85cc05f9f0 0x7f85cc0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39300/0 (socket says 172.21.15.41:39300) 2021-10-21T00:58:21.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 -- 172.21.15.41:0/1128441806 learned_addr learned my addr 172.21.15.41:0/1128441806 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d0b87700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f85cc0b0730 0x7f85cc0b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37072/0 (socket says 172.21.15.41:37072) 2021-10-21T00:58:21.923 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1b89700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b3370 0x7f85cc138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 -- 172.21.15.41:0/1128441806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b3370 msgr2=0x7f85cc138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:21.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b3370 0x7f85cc138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.924 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 -- 172.21.15.41:0/1128441806 >> v1:172.21.15.41:6789/0 conn(0x7f85cc0b0730 legacy=0x7f85cc0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 -- 172.21.15.41:0/1128441806 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc140080 con 0x7f85cc05f9f0 2021-10-21T00:58:21.925 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d1388700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0b0e50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f85cc13f630 tx=0x7f85c4006eb0).ready entity=mon.0 client_cookie=ca5f147d26fb4334 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85cbfff700 1 -- 172.21.15.41:0/1128441806 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400d5c0 con 0x7f85cc05f9f0 2021-10-21T00:58:21.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85cbfff700 1 -- 172.21.15.41:0/1128441806 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4000e90 con 0x7f85cc05f9f0 2021-10-21T00:58:21.926 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85cbfff700 1 -- 172.21.15.41:0/1128441806 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400d950 con 0x7f85cc05f9f0 2021-10-21T00:58:21.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- 172.21.15.41:0/1128441806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc05f9f0 msgr2=0x7f85cc0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0b0e50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f85cc13f630 tx=0x7f85c4006eb0).stop 2021-10-21T00:58:21.927 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- 172.21.15.41:0/1128441806 shutdown_connections 2021-10-21T00:58:21.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b3370 0x7f85cc138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- 172.21.15.41:0/1128441806 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0b0e50 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.928 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- 172.21.15.41:0/1128441806 >> 172.21.15.41:0/1128441806 conn(0x7f85cc0637b0 msgr2=0x7f85cc063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:21.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- 172.21.15.41:0/1128441806 shutdown_connections 2021-10-21T00:58:21.929 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- 172.21.15.41:0/1128441806 wait complete. 2021-10-21T00:58:21.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 Processor -- start 2021-10-21T00:58:21.932 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- start start 2021-10-21T00:58:21.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b0730 0x7f85cc065670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.933 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc141100 con 0x7f85cc0b3370 2021-10-21T00:58:21.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0654d0 con 0x7f85cc05f9f0 2021-10-21T00:58:21.934 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.914+0000 7f85d238a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc1413c0 con 0x7f85cc0b0730 2021-10-21T00:58:21.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39310/0 (socket says 172.21.15.41:39310) 2021-10-21T00:58:21.935 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 -- 172.21.15.41:0/2339289674 learned_addr learned my addr 172.21.15.41:0/2339289674 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:21.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d0b87700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b0730 0x7f85cc065670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1388700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.936 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 -- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b0730 msgr2=0x7f85cc065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b0730 0x7f85cc065670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 -- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc05f9f0 msgr2=0x7f85cc0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:21.937 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:21.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 -- 172.21.15.41:0/2339289674 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c400b1e0 con 0x7f85cc0b3370 2021-10-21T00:58:21.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d1b89700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f85cc065610 tx=0x7f85bc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.938 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc011750 con 0x7f85cc0b3370 2021-10-21T00:58:21.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0118b0 con 0x7f85cc0b3370 2021-10-21T00:58:21.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc065b60 con 0x7f85cc0b3370 2021-10-21T00:58:21.939 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85bc011c10 con 0x7f85cc0b3370 2021-10-21T00:58:21.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc0650a0 con 0x7f85cc0b3370 2021-10-21T00:58:21.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc13f3a0 con 0x7f85cc0b3370 2021-10-21T00:58:21.940 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.918+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85bc011d70 con 0x7f85cc0b3370 2021-10-21T00:58:21.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.922+0000 7f85ca7fc700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 0x7f85b0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:21.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.922+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f85bc06b910 con 0x7f85cc0b3370 2021-10-21T00:58:21.941 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.922+0000 7f85d1388700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 0x7f85b0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:21.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.922+0000 7f85d1388700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 0x7f85b0055b90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f85c401a000 tx=0x7f85c4012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:21.942 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:21.926+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85cc13f3a0 con 0x7f85cc0b3370 2021-10-21T00:58:22.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.050+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f85cc065230 con 0x7f85b00536d0 2021-10-21T00:58:22.056 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.050+0000 7f85ca7fc700 1 -- 172.21.15.41:0/2339289674 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f85c4017070 con 0x7f85b00536d0 2021-10-21T00:58:22.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 msgr2=0x7f85b0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.060 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 0x7f85b0055b90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f85c401a000 tx=0x7f85c4012000).stop 2021-10-21T00:58:22.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 msgr2=0x7f85cc141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f85cc065610 tx=0x7f85bc006df0).stop 2021-10-21T00:58:22.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 shutdown_connections 2021-10-21T00:58:22.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f85b00536d0 0x7f85b0055b90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f85cc0b3370 0x7f85cc141be0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85cc0b0730 0x7f85cc065670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 --2- 172.21.15.41:0/2339289674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc05f9f0 0x7f85cc0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 >> 172.21.15.41:0/2339289674 conn(0x7f85cc0637b0 msgr2=0x7f85cc0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 shutdown_connections 2021-10-21T00:58:22.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.054+0000 7f85d238a700 1 -- 172.21.15.41:0/2339289674 wait complete. 2021-10-21T00:58:22.064 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 1 to deep-scrub 2021-10-21T00:58:22.075 INFO:tasks.ceph:Scrubbing osd.2 2021-10-21T00:58:22.076 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:22.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 Processor -- start 2021-10-21T00:58:22.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 -- start start 2021-10-21T00:58:22.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 0x7f37c80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c8142ad0 con 0x7f37c8142f00 2021-10-21T00:58:22.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c8145f90 con 0x7f37c8062330 2021-10-21T00:58:22.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.186+0000 7f37cf2c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80b3520 con 0x7f37c813cc20 2021-10-21T00:58:22.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37ceac1700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f37c8142f00 0x7f37c81433b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37086/0 (socket says 172.21.15.41:37086) 2021-10-21T00:58:22.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37ceac1700 1 -- 172.21.15.41:0/527979629 learned_addr learned my addr 172.21.15.41:0/527979629 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:22.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cdabf700 1 --2- 172.21.15.41:0/527979629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 0x7f37c80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447631603 0 0) 0x7f37c8142ad0 con 0x7f37c8142f00 2021-10-21T00:58:22.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b0003260 con 0x7f37c8142f00 2021-10-21T00:58:22.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162250654 0 0) 0x7f37c8145f90 con 0x7f37c8062330 2021-10-21T00:58:22.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c8142ad0 con 0x7f37c8062330 2021-10-21T00:58:22.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cdabf700 1 -- 172.21.15.41:0/527979629 >> v1:172.21.15.62:6789/0 conn(0x7f37c8062330 legacy=0x7f37c813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cdabf700 1 -- 172.21.15.41:0/527979629 >> v1:172.21.15.41:6789/0 conn(0x7f37c8142f00 legacy=0x7f37c81433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cdabf700 1 -- 172.21.15.41:0/527979629 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8146230 con 0x7f37c813cc20 2021-10-21T00:58:22.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cdabf700 1 --2- 172.21.15.41:0/527979629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 0x7f37c80b4140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f37b8002f70 tx=0x7f37b8006df0).ready entity=mon.2 client_cookie=72d36b35e0fb5da3 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b800d5c0 con 0x7f37c813cc20 2021-10-21T00:58:22.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8000e90 con 0x7f37c813cc20 2021-10-21T00:58:22.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cd2be700 1 -- 172.21.15.41:0/527979629 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b800d910 con 0x7f37c813cc20 2021-10-21T00:58:22.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 -- 172.21.15.41:0/527979629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 msgr2=0x7f37c80b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 --2- 172.21.15.41:0/527979629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 0x7f37c80b4140 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f37b8002f70 tx=0x7f37b8006df0).stop 2021-10-21T00:58:22.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 -- 172.21.15.41:0/527979629 shutdown_connections 2021-10-21T00:58:22.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 --2- 172.21.15.41:0/527979629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c813cc20 0x7f37c80b4140 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 -- 172.21.15.41:0/527979629 >> 172.21.15.41:0/527979629 conn(0x7f37c80b9080 msgr2=0x7f37c80b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 -- 172.21.15.41:0/527979629 shutdown_connections 2021-10-21T00:58:22.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.190+0000 7f37cf2c2700 1 -- 172.21.15.41:0/527979629 wait complete. 2021-10-21T00:58:22.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 Processor -- start 2021-10-21T00:58:22.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- start start 2021-10-21T00:58:22.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c8062330 0x7f37c8141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c8142f00 0x7f37c80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 0x7f37c8146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c81482e0 con 0x7f37c80ad220 2021-10-21T00:58:22.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8148510 con 0x7f37c8062330 2021-10-21T00:58:22.213 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80ac890 con 0x7f37c8142f00 2021-10-21T00:58:22.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 0x7f37c8146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 0x7f37c8146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39324/0 (socket says 172.21.15.41:39324) 2021-10-21T00:58:22.214 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 -- 172.21.15.41:0/2516310669 learned_addr learned my addr 172.21.15.41:0/2516310669 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:22.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ce2c0700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c8062330 0x7f37c8141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cdabf700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c8142f00 0x7f37c80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.215 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 -- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c8142f00 msgr2=0x7f37c80acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37c8142f00 0x7f37c80acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 -- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c8062330 msgr2=0x7f37c8141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.216 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37c8062330 0x7f37c8141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b800b180 con 0x7f37c80ad220 2021-10-21T00:58:22.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37ceac1700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 0x7f37c8146480 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f37c0001490 tx=0x7f37c0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.217 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c0005ba0 con 0x7f37c80ad220 2021-10-21T00:58:22.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0005d00 con 0x7f37c80ad220 2021-10-21T00:58:22.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c8147500 con 0x7f37c80ad220 2021-10-21T00:58:22.218 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37c00072c0 con 0x7f37c80ad220 2021-10-21T00:58:22.219 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.194+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c8147f70 con 0x7f37c80ad220 2021-10-21T00:58:22.220 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37c80aca50 con 0x7f37c80ad220 2021-10-21T00:58:22.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f37c001a060 con 0x7f37c80ad220 2021-10-21T00:58:22.221 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a8053610 0x7f37a8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f37c006acb0 con 0x7f37c80ad220 2021-10-21T00:58:22.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7f37a8059d90 0x7f37a805c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.222 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37a805c770 con 0x7f37a8059d90 2021-10-21T00:58:22.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37c006d340 con 0x7f37c80ad220 2021-10-21T00:58:22.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37ce2c0700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a8053610 0x7f37a8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.223 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37cdabf700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7f37a8059d90 0x7f37a805c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37cdabf700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7f37a8059d90 0x7f37a805c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.198+0000 7f37ce2c0700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a8053610 0x7f37a8055ad0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f37c400d000 tx=0x7f37c4007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.224 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.202+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== osd.2 v2:172.21.15.41:6823/14360 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f37a805c770 con 0x7f37a8059d90 2021-10-21T00:58:22.225 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 --> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37c8063020 con 0x7f37a8059d90 2021-10-21T00:58:22.226 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37b77fe700 1 -- 172.21.15.41:0/2516310669 <== osd.2 v2:172.21.15.41:6823/14360 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f37c8063020 con 0x7f37a8059d90 2021-10-21T00:58:22.226 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:22.227 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:22.227 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:22.228 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7f37a8059d90 msgr2=0x7f37a805c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:6823/14360,v1:172.21.15.41:6825/14360] conn(0x7f37a8059d90 0x7f37a805c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a8053610 msgr2=0x7f37a8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.229 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f37a8053610 0x7f37a8055ad0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f37c400d000 tx=0x7f37c4007a20).stop 2021-10-21T00:58:22.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 msgr2=0x7f37c8146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 --2- 172.21.15.41:0/2516310669 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f37c80ad220 0x7f37c8146480 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f37c0001490 tx=0x7f37c0007e00).stop 2021-10-21T00:58:22.230 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37ceac1700 1 -- 172.21.15.41:0/2516310669 reap_dead start 2021-10-21T00:58:22.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 shutdown_connections 2021-10-21T00:58:22.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 >> 172.21.15.41:0/2516310669 conn(0x7f37c80b9080 msgr2=0x7f37c80b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.231 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 shutdown_connections 2021-10-21T00:58:22.232 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.218+0000 7f37cf2c2700 1 -- 172.21.15.41:0/2516310669 wait complete. 2021-10-21T00:58:22.235 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-10-21T00:58:22.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 Processor -- start 2021-10-21T00:58:22.347 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 -- start start 2021-10-21T00:58:22.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 0x7f5c9405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.350 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940b4760 con 0x7f5c940b1830 2021-10-21T00:58:22.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940ad4c0 con 0x7f5c94140890 2021-10-21T00:58:22.351 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940ad760 con 0x7f5c940b4380 2021-10-21T00:58:22.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c91d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f5c940b1830 0x7f5c9405fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37102/0 (socket says 172.21.15.41:37102) 2021-10-21T00:58:22.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c91d9b700 1 -- 172.21.15.41:0/1638034900 learned_addr learned my addr 172.21.15.41:0/1638034900 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:22.352 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9259c700 1 --2- 172.21.15.41:0/1638034900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 0x7f5c9405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089812203 0 0) 0x7f5c940b4760 con 0x7f5c940b1830 2021-10-21T00:58:22.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c78003260 con 0x7f5c940b1830 2021-10-21T00:58:22.353 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9259c700 1 -- 172.21.15.41:0/1638034900 >> v1:172.21.15.62:6789/0 conn(0x7f5c94140890 legacy=0x7f5c94140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079206402 0 0) 0x7f5c940ad4c0 con 0x7f5c94140890 2021-10-21T00:58:22.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9259c700 1 -- 172.21.15.41:0/1638034900 >> v1:172.21.15.41:6789/0 conn(0x7f5c940b1830 legacy=0x7f5c9405fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.354 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9259c700 1 -- 172.21.15.41:0/1638034900 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940ada00 con 0x7f5c940b4380 2021-10-21T00:58:22.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9259c700 1 --2- 172.21.15.41:0/1638034900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 0x7f5c9405f7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5c8c0032f0 tx=0x7f5c8c0091d0).ready entity=mon.2 client_cookie=8937ef9a49c968cf server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00b6c0 con 0x7f5c940b4380 2021-10-21T00:58:22.355 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b820 con 0x7f5c940b4380 2021-10-21T00:58:22.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.342+0000 7f5c9159a700 1 -- 172.21.15.41:0/1638034900 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00b990 con 0x7f5c940b4380 2021-10-21T00:58:22.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- 172.21.15.41:0/1638034900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 msgr2=0x7f5c9405f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.356 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 --2- 172.21.15.41:0/1638034900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 0x7f5c9405f7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5c8c0032f0 tx=0x7f5c8c0091d0).stop 2021-10-21T00:58:22.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- 172.21.15.41:0/1638034900 shutdown_connections 2021-10-21T00:58:22.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 --2- 172.21.15.41:0/1638034900 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b4380 0x7f5c9405f7c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.357 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- 172.21.15.41:0/1638034900 >> 172.21.15.41:0/1638034900 conn(0x7f5c940b7910 msgr2=0x7f5c940b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- 172.21.15.41:0/1638034900 shutdown_connections 2021-10-21T00:58:22.358 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- 172.21.15.41:0/1638034900 wait complete. 2021-10-21T00:58:22.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 Processor -- start 2021-10-21T00:58:22.361 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- start start 2021-10-21T00:58:22.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 0x7f5c94067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.362 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94140890 0x7f5c94099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941523d0 con 0x7f5c940b4380 2021-10-21T00:58:22.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941447c0 con 0x7f5c94140890 2021-10-21T00:58:22.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9359e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94144a60 con 0x7f5c940b1830 2021-10-21T00:58:22.363 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39338/0 (socket says 172.21.15.41:39338) 2021-10-21T00:58:22.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 -- 172.21.15.41:0/197507898 learned_addr learned my addr 172.21.15.41:0/197507898 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:22.364 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c9259c700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 0x7f5c94067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c92d9d700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94140890 0x7f5c94099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 -- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 msgr2=0x7f5c94067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.365 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 0x7f5c94067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.346+0000 7f5c91d9b700 1 -- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94140890 msgr2=0x7f5c94099f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c91d9b700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94140890 0x7f5c94099f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.366 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c91d9b700 1 -- 172.21.15.41:0/197507898 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009470 con 0x7f5c940b4380 2021-10-21T00:58:22.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c9259c700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 0x7f5c94067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:22.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c91d9b700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f5c7c001110 tx=0x7f5c7c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.367 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c00ce00 con 0x7f5c940b4380 2021-10-21T00:58:22.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0072e0 con 0x7f5c940b4380 2021-10-21T00:58:22.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c941564f0 con 0x7f5c940b4380 2021-10-21T00:58:22.368 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c005800 con 0x7f5c940b4380 2021-10-21T00:58:22.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9409a410 con 0x7f5c940b4380 2021-10-21T00:58:22.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94156350 con 0x7f5c940b4380 2021-10-21T00:58:22.369 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c7c01a060 con 0x7f5c940b4380 2021-10-21T00:58:22.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 0x7f5c6c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.370 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5c7c06aea0 con 0x7f5c940b4380 2021-10-21T00:58:22.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.350+0000 7f5c9259c700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 0x7f5c6c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.354+0000 7f5c9259c700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 0x7f5c6c0559b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5c8c019000 tx=0x7f5c8c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.371 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.354+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c94156350 con 0x7f5c940b4380 2021-10-21T00:58:22.488 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.482+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c94156350 con 0x7f5c6c0534f0 2021-10-21T00:58:22.489 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.482+0000 7f5c8b7fe700 1 -- 172.21.15.41:0/197507898 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c94156350 con 0x7f5c6c0534f0 2021-10-21T00:58:22.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 msgr2=0x7f5c6c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 0x7f5c6c0559b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5c8c019000 tx=0x7f5c8c016000).stop 2021-10-21T00:58:22.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 msgr2=0x7f5c940b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f5c7c001110 tx=0x7f5c7c007aa0).stop 2021-10-21T00:58:22.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 shutdown_connections 2021-10-21T00:58:22.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f5c6c0534f0 0x7f5c6c0559b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c94140890 0x7f5c94099f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f5c940b4380 0x7f5c940b0bc0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 --2- 172.21.15.41:0/197507898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5c940b1830 0x7f5c94067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 >> 172.21.15.41:0/197507898 conn(0x7f5c940b7910 msgr2=0x7f5c940b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 shutdown_connections 2021-10-21T00:58:22.494 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.486+0000 7f5c9359e700 1 -- 172.21.15.41:0/197507898 wait complete. 2021-10-21T00:58:22.495 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 2 to deep-scrub 2021-10-21T00:58:22.502 INFO:tasks.ceph:Scrubbing osd.3 2021-10-21T00:58:22.503 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:22.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 Processor -- start 2021-10-21T00:58:22.610 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 -- start start 2021-10-21T00:58:22.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faefc062330 0x7faefc0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc13c510 0x7faefc13c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc142ad0 con 0x7faefc142f00 2021-10-21T00:58:22.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc0b3520 con 0x7faefc062330 2021-10-21T00:58:22.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01a34700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc143c40 con 0x7faefc13c510 2021-10-21T00:58:22.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7faefc062330 0x7faefc0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01233700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faefc142f00 0x7faefc143340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:45172/0 (socket says 172.21.15.41:45172) 2021-10-21T00:58:22.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf01233700 1 -- 172.21.15.41:0/4069349356 learned_addr learned my addr 172.21.15.41:0/4069349356 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:22.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faefbfff700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc13c510 0x7faefc13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 -- 172.21.15.41:0/4069349356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc13c510 msgr2=0x7faefc13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:22.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc13c510 0x7faefc13c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faefb7fe700 1 -- 172.21.15.41:0/4069349356 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434948499 0 0) 0x7faefc142ad0 con 0x7faefc142f00 2021-10-21T00:58:22.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 -- 172.21.15.41:0/4069349356 >> v1:172.21.15.62:6789/0 conn(0x7faefc142f00 legacy=0x7faefc143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 -- 172.21.15.41:0/4069349356 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc13ce60 con 0x7faefc062330 2021-10-21T00:58:22.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faf00a32700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc062330 0x7faefc0b4140 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).ready entity=mon.0 client_cookie=8b60818e2c33778e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faefb7fe700 1 -- 172.21.15.41:0/4069349356 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d570 con 0x7faefc062330 2021-10-21T00:58:22.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faefb7fe700 1 -- 172.21.15.41:0/4069349356 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0000e90 con 0x7faefc062330 2021-10-21T00:58:22.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.606+0000 7faefb7fe700 1 -- 172.21.15.41:0/4069349356 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d8c0 con 0x7faefc062330 2021-10-21T00:58:22.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- 172.21.15.41:0/4069349356 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc062330 msgr2=0x7faefc0b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc062330 0x7faefc0b4140 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).stop 2021-10-21T00:58:22.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- 172.21.15.41:0/4069349356 shutdown_connections 2021-10-21T00:58:22.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc13c510 0x7faefc13c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 --2- 172.21.15.41:0/4069349356 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc062330 0x7faefc0b4140 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- 172.21.15.41:0/4069349356 >> 172.21.15.41:0/4069349356 conn(0x7faefc0b9080 msgr2=0x7faefc0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- 172.21.15.41:0/4069349356 shutdown_connections 2021-10-21T00:58:22.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- 172.21.15.41:0/4069349356 wait complete. 2021-10-21T00:58:22.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 Processor -- start 2021-10-21T00:58:22.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.610+0000 7faf01a34700 1 -- start start 2021-10-21T00:58:22.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc062330 0x7faefc13f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc13c510 0x7faefc13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 0x7faefc13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc152980 con 0x7faefc142f00 2021-10-21T00:58:22.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1526e0 con 0x7faefc13c510 2021-10-21T00:58:22.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc13e0f0 con 0x7faefc062330 2021-10-21T00:58:22.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 0x7faefc13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 0x7faefc13e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39354/0 (socket says 172.21.15.41:39354) 2021-10-21T00:58:22.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 -- 172.21.15.41:0/423627884 learned_addr learned my addr 172.21.15.41:0/423627884 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:22.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf00a32700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc062330 0x7faefc13f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faefbfff700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc13c510 0x7faefc13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 -- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc062330 msgr2=0x7faefc13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faefc062330 0x7faefc13f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 -- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc13c510 msgr2=0x7faefc13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faefc13c510 0x7faefc13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef000b180 con 0x7faefc142f00 2021-10-21T00:58:22.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01233700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 0x7faefc13e590 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7faef4001250 tx=0x7faef4001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef4005c70 con 0x7faefc142f00 2021-10-21T00:58:22.635 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4005dd0 con 0x7faefc142f00 2021-10-21T00:58:22.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc152410 con 0x7faefc142f00 2021-10-21T00:58:22.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef4004a90 con 0x7faefc142f00 2021-10-21T00:58:22.636 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc148e10 con 0x7faefc142f00 2021-10-21T00:58:22.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faefc13e2b0 con 0x7faefc142f00 2021-10-21T00:58:22.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.614+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faef4004bf0 con 0x7faefc142f00 2021-10-21T00:58:22.637 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faedc0536a0 0x7faedc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7faef406b2b0 con 0x7faefc142f00 2021-10-21T00:58:22.638 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7faedc059e20 0x7faedc05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faedc05c800 con 0x7faedc059e20 2021-10-21T00:58:22.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7faef406d940 con 0x7faefc142f00 2021-10-21T00:58:22.639 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faf00a32700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faedc0536a0 0x7faedc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faefbfff700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7faedc059e20 0x7faedc05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faefbfff700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7faedc059e20 0x7faedc05c240 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.640 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faf00a32700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faedc0536a0 0x7faedc055b60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7faef001a000 tx=0x7faef0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.641 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.618+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== osd.3 v2:172.21.15.41:6816/14357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7faedc05c800 con 0x7faedc059e20 2021-10-21T00:58:22.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 --> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faefc13f080 con 0x7faedc059e20 2021-10-21T00:58:22.642 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faef9ffb700 1 -- 172.21.15.41:0/423627884 <== osd.3 v2:172.21.15.41:6816/14357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faefc13f080 con 0x7faedc059e20 2021-10-21T00:58:22.642 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:22.643 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:22.643 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:22.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7faedc059e20 msgr2=0x7faedc05c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:6816/14357,v1:172.21.15.41:6817/14357] conn(0x7faedc059e20 0x7faedc05c240 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.645 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faedc0536a0 msgr2=0x7faedc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7faedc0536a0 0x7faedc055b60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7faef001a000 tx=0x7faef0014000).stop 2021-10-21T00:58:22.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 msgr2=0x7faefc13e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.646 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 --2- 172.21.15.41:0/423627884 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7faefc142f00 0x7faefc13e590 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7faef4001250 tx=0x7faef4001360).stop 2021-10-21T00:58:22.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01233700 1 -- 172.21.15.41:0/423627884 reap_dead start 2021-10-21T00:58:22.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 shutdown_connections 2021-10-21T00:58:22.647 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.634+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 >> 172.21.15.41:0/423627884 conn(0x7faefc0b9080 msgr2=0x7faefc0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.638+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 shutdown_connections 2021-10-21T00:58:22.648 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.638+0000 7faf01a34700 1 -- 172.21.15.41:0/423627884 wait complete. 2021-10-21T00:58:22.653 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-10-21T00:58:22.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 Processor -- start 2021-10-21T00:58:22.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- start start 2021-10-21T00:58:22.761 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbf780b2170 0x7fbf780ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780b0b50 con 0x7fbf78067a80 2021-10-21T00:58:22.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780b2550 con 0x7fbf780af620 2021-10-21T00:58:22.762 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780b0d90 con 0x7fbf780b2170 2021-10-21T00:58:22.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7d56e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbf780b2170 0x7fbf780ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7dd6f700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fbf78067a80 0x7fbf78149320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37134/0 (socket says 172.21.15.41:37134) 2021-10-21T00:58:22.763 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7dd6f700 1 -- 172.21.15.41:0/983223577 learned_addr learned my addr 172.21.15.41:0/983223577 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:22.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7d56e700 1 -- 172.21.15.41:0/983223577 >> v1:172.21.15.62:6789/0 conn(0x7fbf780af620 legacy=0x7fbf780ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7d56e700 1 -- 172.21.15.41:0/983223577 >> v1:172.21.15.41:6789/0 conn(0x7fbf78067a80 legacy=0x7fbf78149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.764 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7d56e700 1 -- 172.21.15.41:0/983223577 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780b1030 con 0x7fbf780b2170 2021-10-21T00:58:22.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf77fff700 1 -- 172.21.15.41:0/983223577 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923835750 0 0) 0x7fbf68001110 con 0x7fbf78067a80 2021-10-21T00:58:22.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7d56e700 1 --2- 172.21.15.41:0/983223577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf780ab170 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fbf780aafa0 tx=0x7fbf700091d0).ready entity=mon.0 client_cookie=cfab19ec15bca7b9 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.765 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf77fff700 1 -- 172.21.15.41:0/983223577 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7000b860 con 0x7fbf780b2170 2021-10-21T00:58:22.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf77fff700 1 -- 172.21.15.41:0/983223577 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000b9c0 con 0x7fbf780b2170 2021-10-21T00:58:22.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf77fff700 1 -- 172.21.15.41:0/983223577 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7000bb30 con 0x7fbf780b2170 2021-10-21T00:58:22.766 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- 172.21.15.41:0/983223577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 msgr2=0x7fbf780ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 --2- 172.21.15.41:0/983223577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf780ab170 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fbf780aafa0 tx=0x7fbf700091d0).stop 2021-10-21T00:58:22.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- 172.21.15.41:0/983223577 shutdown_connections 2021-10-21T00:58:22.767 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 --2- 172.21.15.41:0/983223577 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf780ab170 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- 172.21.15.41:0/983223577 >> 172.21.15.41:0/983223577 conn(0x7fbf780b5700 msgr2=0x7fbf780b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- 172.21.15.41:0/983223577 shutdown_connections 2021-10-21T00:58:22.768 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.754+0000 7fbf7e570700 1 -- 172.21.15.41:0/983223577 wait complete. 2021-10-21T00:58:22.771 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 Processor -- start 2021-10-21T00:58:22.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- start start 2021-10-21T00:58:22.772 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf78067a80 0x7fbf781495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf780af620 0x7fbf780645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.773 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780adad0 con 0x7fbf780b2170 2021-10-21T00:58:22.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780ae9f0 con 0x7fbf780af620 2021-10-21T00:58:22.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78066f80 con 0x7fbf78067a80 2021-10-21T00:58:22.774 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39368/0 (socket says 172.21.15.41:39368) 2021-10-21T00:58:22.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 -- 172.21.15.41:0/906285549 learned_addr learned my addr 172.21.15.41:0/906285549 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:22.775 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7d56e700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf78067a80 0x7fbf781495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7cd6d700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf780af620 0x7fbf780645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 -- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf78067a80 msgr2=0x7fbf781495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.776 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf78067a80 0x7fbf781495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 -- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf780af620 msgr2=0x7fbf780645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf780af620 0x7fbf780645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.777 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 -- 172.21.15.41:0/906285549 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009470 con 0x7fbf780b2170 2021-10-21T00:58:22.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7dd6f700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fbf68000bc0 tx=0x7fbf68007820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6800cde0 con 0x7fbf780b2170 2021-10-21T00:58:22.778 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680070d0 con 0x7fbf780b2170 2021-10-21T00:58:22.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf780aee90 con 0x7fbf780b2170 2021-10-21T00:58:22.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf68007430 con 0x7fbf780b2170 2021-10-21T00:58:22.779 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.758+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78149c30 con 0x7fbf780b2170 2021-10-21T00:58:22.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf780ae840 con 0x7fbf780b2170 2021-10-21T00:58:22.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf6801a060 con 0x7fbf780b2170 2021-10-21T00:58:22.780 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf767fc700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 0x7fbf58055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:22.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbf6806aaf0 con 0x7fbf780b2170 2021-10-21T00:58:22.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf7d56e700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 0x7fbf58055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:22.781 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.762+0000 7fbf7d56e700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 0x7fbf58055a40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fbf7001b000 tx=0x7fbf70016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:22.782 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.766+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf68041f30 con 0x7fbf780b2170 2021-10-21T00:58:22.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf780ad080 con 0x7fbf58053580 2021-10-21T00:58:22.900 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf767fc700 1 -- 172.21.15.41:0/906285549 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf700032b0 con 0x7fbf58053580 2021-10-21T00:58:22.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 msgr2=0x7fbf58055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 0x7fbf58055a40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fbf7001b000 tx=0x7fbf70016000).stop 2021-10-21T00:58:22.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 msgr2=0x7fbf78064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:22.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7fbf68000bc0 tx=0x7fbf68007820).stop 2021-10-21T00:58:22.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 shutdown_connections 2021-10-21T00:58:22.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbf58053580 0x7fbf58055a40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbf780b2170 0x7fbf78064a90 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf780af620 0x7fbf780645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 --2- 172.21.15.41:0/906285549 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbf78067a80 0x7fbf781495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:22.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 >> 172.21.15.41:0/906285549 conn(0x7fbf780b5700 msgr2=0x7fbf780b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:22.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 shutdown_connections 2021-10-21T00:58:22.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:22.894+0000 7fbf7e570700 1 -- 172.21.15.41:0/906285549 wait complete. 2021-10-21T00:58:22.906 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 3 to deep-scrub 2021-10-21T00:58:22.913 INFO:tasks.ceph:Scrubbing osd.4 2021-10-21T00:58:22.913 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:23.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.018+0000 7f3865c3a700 1 Processor -- start 2021-10-21T00:58:23.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.018+0000 7f3865c3a700 1 -- start start 2021-10-21T00:58:23.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f386009aca0 0x7f386005fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386009b4a0 con 0x7f3860144d10 2021-10-21T00:58:23.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38601419f0 con 0x7f386005f6b0 2021-10-21T00:58:23.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3860141c90 con 0x7f386009aca0 2021-10-21T00:58:23.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f386009aca0 0x7f386005fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385effd700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f3860144d10 0x7f386009a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37146/0 (socket says 172.21.15.41:37146) 2021-10-21T00:58:23.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385effd700 1 -- 172.21.15.41:0/3229763945 learned_addr learned my addr 172.21.15.41:0/3229763945 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:23.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385ffff700 1 -- 172.21.15.41:0/3229763945 >> v1:172.21.15.62:6789/0 conn(0x7f386005f6b0 legacy=0x7f3860144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385ffff700 1 -- 172.21.15.41:0/3229763945 >> v1:172.21.15.41:6789/0 conn(0x7f3860144d10 legacy=0x7f386009a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385ffff700 1 -- 172.21.15.41:0/3229763945 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386009b200 con 0x7f386009aca0 2021-10-21T00:58:23.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385e7fc700 1 -- 172.21.15.41:0/3229763945 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722871880 0 0) 0x7f386009b4a0 con 0x7f3860144d10 2021-10-21T00:58:23.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385ffff700 1 --2- 172.21.15.41:0/3229763945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f386009aca0 0x7f386005fa90 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f38580032f0 tx=0x7f38580091d0).ready entity=mon.0 client_cookie=5dfec8508c28c16e server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385e7fc700 1 -- 172.21.15.41:0/3229763945 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3858009ea0 con 0x7f386009aca0 2021-10-21T00:58:23.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385e7fc700 1 -- 172.21.15.41:0/3229763945 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385800b8a0 con 0x7f386009aca0 2021-10-21T00:58:23.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f385e7fc700 1 -- 172.21.15.41:0/3229763945 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385800ba10 con 0x7f386009aca0 2021-10-21T00:58:23.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- 172.21.15.41:0/3229763945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f386009aca0 msgr2=0x7f386005fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 --2- 172.21.15.41:0/3229763945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f386009aca0 0x7f386005fa90 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f38580032f0 tx=0x7f38580091d0).stop 2021-10-21T00:58:23.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- 172.21.15.41:0/3229763945 shutdown_connections 2021-10-21T00:58:23.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 --2- 172.21.15.41:0/3229763945 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f386009aca0 0x7f386005fa90 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- 172.21.15.41:0/3229763945 >> 172.21.15.41:0/3229763945 conn(0x7f38600b7030 msgr2=0x7f38600b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- 172.21.15.41:0/3229763945 shutdown_connections 2021-10-21T00:58:23.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.022+0000 7f3865c3a700 1 -- 172.21.15.41:0/3229763945 wait complete. 2021-10-21T00:58:23.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 Processor -- start 2021-10-21T00:58:23.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- start start 2021-10-21T00:58:23.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f386005f6b0 0x7f38601468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f386009aca0 0x7f3860062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 0x7f38600af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600aed30 con 0x7f3860144d10 2021-10-21T00:58:23.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600b1750 con 0x7f386005f6b0 2021-10-21T00:58:23.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600629b0 con 0x7f386009aca0 2021-10-21T00:58:23.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 0x7f38600af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 0x7f38600af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39384/0 (socket says 172.21.15.41:39384) 2021-10-21T00:58:23.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 -- 172.21.15.41:0/3692755659 learned_addr learned my addr 172.21.15.41:0/3692755659 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385f7fe700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f386005f6b0 0x7f38601468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385effd700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f386009aca0 0x7f3860062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 -- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f386009aca0 msgr2=0x7f3860062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f386009aca0 0x7f3860062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 -- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f386005f6b0 msgr2=0x7f38601468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f386005f6b0 0x7f38601468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009470 con 0x7f3860144d10 2021-10-21T00:58:23.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385ffff700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 0x7f38600af7f0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f38600aeb30 tx=0x7f3858016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3858009ea0 con 0x7f3860144d10 2021-10-21T00:58:23.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858011e20 con 0x7f3860144d10 2021-10-21T00:58:23.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38600b07b0 con 0x7f3860144d10 2021-10-21T00:58:23.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385801f5e0 con 0x7f3860144d10 2021-10-21T00:58:23.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.026+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600632d0 con 0x7f3860144d10 2021-10-21T00:58:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38600b0b90 con 0x7f3860144d10 2021-10-21T00:58:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3858026030 con 0x7f3860144d10 2021-10-21T00:58:23.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3844053610 0x7f3844055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f385806c330 con 0x7f3860144d10 2021-10-21T00:58:23.052 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f3844059d90 0x7f384405c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f384405c770 con 0x7f3844059d90 2021-10-21T00:58:23.053 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f385806e9c0 con 0x7f3860144d10 2021-10-21T00:58:23.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385f7fe700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3844053610 0x7f3844055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385effd700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f3844059d90 0x7f384405c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.054 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385f7fe700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3844053610 0x7f3844055ad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f384800d000 tx=0x7f3848009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.030+0000 7f385effd700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f3844059d90 0x7f384405c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.055 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.034+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== osd.4 v2:172.21.15.62:6814/14810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f384405c770 con 0x7f3844059d90 2021-10-21T00:58:23.057 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.050+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 --> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3860062af0 con 0x7f3844059d90 2021-10-21T00:58:23.058 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f385cff9700 1 -- 172.21.15.41:0/3692755659 <== osd.4 v2:172.21.15.62:6814/14810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3860062af0 con 0x7f3844059d90 2021-10-21T00:58:23.059 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:23.060 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:23.060 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:23.061 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f3844059d90 msgr2=0x7f384405c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6814/14810,v1:172.21.15.62:6816/14810] conn(0x7f3844059d90 0x7f384405c1b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.062 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3844053610 msgr2=0x7f3844055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f3844053610 0x7f3844055ad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f384800d000 tx=0x7f3848009040).stop 2021-10-21T00:58:23.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 msgr2=0x7f38600af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.063 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 --2- 172.21.15.41:0/3692755659 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3860144d10 0x7f38600af7f0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f38600aeb30 tx=0x7f3858016000).stop 2021-10-21T00:58:23.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f385ffff700 1 -- 172.21.15.41:0/3692755659 reap_dead start 2021-10-21T00:58:23.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 shutdown_connections 2021-10-21T00:58:23.064 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 >> 172.21.15.41:0/3692755659 conn(0x7f38600b7030 msgr2=0x7f38600b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 shutdown_connections 2021-10-21T00:58:23.065 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.054+0000 7f3865c3a700 1 -- 172.21.15.41:0/3692755659 wait complete. 2021-10-21T00:58:23.071 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-10-21T00:58:23.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.178+0000 7fc0e4740700 1 Processor -- start 2021-10-21T00:58:23.185 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.178+0000 7fc0e4740700 1 -- start start 2021-10-21T00:58:23.189 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc0dc142b80 0x7fc0dc0ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.190 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc143dc0 con 0x7fc0dc13cb80 2021-10-21T00:58:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc05c3b0 con 0x7fc0dc0ad930 2021-10-21T00:58:23.191 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc064190 con 0x7fc0dc142b80 2021-10-21T00:58:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39394/0 (socket says 172.21.15.41:39394) 2021-10-21T00:58:23.192 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/3378410072 learned_addr learned my addr 172.21.15.41:0/3378410072 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e1cdb700 1 --2- 172.21.15.41:0/3378410072 >> v2:172.21.15.62:3300/0 conn(0x7fc0dc142b80 0x7fc0dc0ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/3378410072 >> v2:172.21.15.62:3300/0 conn(0x7fc0dc142b80 msgr2=0x7fc0dc0ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:23.193 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 --2- 172.21.15.41:0/3378410072 >> v2:172.21.15.62:3300/0 conn(0x7fc0dc142b80 0x7fc0dc0ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/3378410072 >> v1:172.21.15.62:6789/0 conn(0x7fc0dc13cb80 legacy=0x7fc0dc05bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.194 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/3378410072 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc064430 con 0x7fc0dc0ad930 2021-10-21T00:58:23.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e2cdd700 1 --2- 172.21.15.41:0/3378410072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fc0d40032f0 tx=0x7fc0d4009290).ready entity=mon.0 client_cookie=3516eb6213167aa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e14da700 1 -- 172.21.15.41:0/3378410072 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d400b870 con 0x7fc0dc0ad930 2021-10-21T00:58:23.195 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e14da700 1 -- 172.21.15.41:0/3378410072 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d400b9d0 con 0x7fc0dc0ad930 2021-10-21T00:58:23.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e14da700 1 -- 172.21.15.41:0/3378410072 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d400bb40 con 0x7fc0dc0ad930 2021-10-21T00:58:23.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- 172.21.15.41:0/3378410072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc0ad930 msgr2=0x7fc0dc14d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.196 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 --2- 172.21.15.41:0/3378410072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fc0d40032f0 tx=0x7fc0d4009290).stop 2021-10-21T00:58:23.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- 172.21.15.41:0/3378410072 shutdown_connections 2021-10-21T00:58:23.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 --2- 172.21.15.41:0/3378410072 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc0ad930 0x7fc0dc14d4f0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.197 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 --2- 172.21.15.41:0/3378410072 >> v2:172.21.15.62:3300/0 conn(0x7fc0dc142b80 0x7fc0dc0ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- 172.21.15.41:0/3378410072 >> 172.21.15.41:0/3378410072 conn(0x7fc0dc061d80 msgr2=0x7fc0dc063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- 172.21.15.41:0/3378410072 shutdown_connections 2021-10-21T00:58:23.198 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.182+0000 7fc0e4740700 1 -- 172.21.15.41:0/3378410072 wait complete. 2021-10-21T00:58:23.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 Processor -- start 2021-10-21T00:58:23.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 -- start start 2021-10-21T00:58:23.202 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0ad930 0x7fc0dc067130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 0x7fc0dc13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.203 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc146010 con 0x7fc0dc142b80 2021-10-21T00:58:23.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc145570 con 0x7fc0dc13cb80 2021-10-21T00:58:23.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e4740700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc145810 con 0x7fc0dc0ad930 2021-10-21T00:58:23.204 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e2cdd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e2cdd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39400/0 (socket says 172.21.15.41:39400) 2021-10-21T00:58:23.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/4065705247 learned_addr learned my addr 172.21.15.41:0/4065705247 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.205 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e24dc700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0ad930 0x7fc0dc067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.186+0000 7fc0e1cdb700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 0x7fc0dc13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0ad930 msgr2=0x7fc0dc067130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.206 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0ad930 0x7fc0dc067130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 msgr2=0x7fc0dc13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 0x7fc0dc13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.207 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 -- 172.21.15.41:0/4065705247 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4009530 con 0x7fc0dc142b80 2021-10-21T00:58:23.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e1cdb700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 0x7fc0dc13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:23.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e2cdd700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fc0d40032f0 tx=0x7fc0d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.208 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d400b870 con 0x7fc0dc142b80 2021-10-21T00:58:23.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4021440 con 0x7fc0dc142b80 2021-10-21T00:58:23.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc145ab0 con 0x7fc0dc142b80 2021-10-21T00:58:23.209 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d40217a0 con 0x7fc0dc142b80 2021-10-21T00:58:23.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc064830 con 0x7fc0dc142b80 2021-10-21T00:58:23.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc0d4027020 con 0x7fc0dc142b80 2021-10-21T00:58:23.210 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc05f6b0 con 0x7fc0dc142b80 2021-10-21T00:58:23.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 0x7fc0bc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc0d406cbc0 con 0x7fc0dc142b80 2021-10-21T00:58:23.211 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.190+0000 7fc0e24dc700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 0x7fc0bc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.194+0000 7fc0e24dc700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 0x7fc0bc055b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fc0cc00d000 tx=0x7fc0cc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.212 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.198+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0d4044000 con 0x7fc0dc142b80 2021-10-21T00:58:23.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.322+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0dc05daf0 con 0x7fc0bc0536a0 2021-10-21T00:58:23.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.322+0000 7fc0db7fe700 1 -- 172.21.15.41:0/4065705247 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc0dc05daf0 con 0x7fc0bc0536a0 2021-10-21T00:58:23.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 msgr2=0x7fc0bc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 0x7fc0bc055b60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fc0cc00d000 tx=0x7fc0cc009040).stop 2021-10-21T00:58:23.331 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 msgr2=0x7fc0dc13f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fc0d40032f0 tx=0x7fc0d4016000).stop 2021-10-21T00:58:23.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 shutdown_connections 2021-10-21T00:58:23.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fc0bc0536a0 0x7fc0bc055b60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fc0dc142b80 0x7fc0dc13f9d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0dc13cb80 0x7fc0dc13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 --2- 172.21.15.41:0/4065705247 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc0dc0ad930 0x7fc0dc067130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 >> 172.21.15.41:0/4065705247 conn(0x7fc0dc061d80 msgr2=0x7fc0dc05fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 shutdown_connections 2021-10-21T00:58:23.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.326+0000 7fc0e4740700 1 -- 172.21.15.41:0/4065705247 wait complete. 2021-10-21T00:58:23.335 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 4 to deep-scrub 2021-10-21T00:58:23.342 INFO:tasks.ceph:Scrubbing osd.5 2021-10-21T00:58:23.342 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:23.451 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 Processor -- start 2021-10-21T00:58:23.452 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 -- start start 2021-10-21T00:58:23.455 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3104143a40 0x7f31040b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31040b0660 0x7f31041419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040ba050 con 0x7f31040b9c70 2021-10-21T00:58:23.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3104146360 con 0x7f31040b0660 2021-10-21T00:58:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f310a002700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3104142bf0 con 0x7f3104143a40 2021-10-21T00:58:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31040b0660 0x7f31041419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f31040b0660 0x7f31041419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39408/0 (socket says 172.21.15.41:39408) 2021-10-21T00:58:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 -- 172.21.15.41:0/2889791186 learned_addr learned my addr 172.21.15.41:0/2889791186 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f31037fe700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f31040b9c70 0x7f3104143330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37174/0 (socket says 172.21.15.41:37174) 2021-10-21T00:58:23.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3102ffd700 1 --2- 172.21.15.41:0/2889791186 >> v2:172.21.15.62:3300/0 conn(0x7f3104143a40 0x7f31040b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 -- 172.21.15.41:0/2889791186 >> v2:172.21.15.62:3300/0 conn(0x7f3104143a40 msgr2=0x7f31040b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 --2- 172.21.15.41:0/2889791186 >> v2:172.21.15.62:3300/0 conn(0x7f3104143a40 0x7f31040b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 -- 172.21.15.41:0/2889791186 >> v1:172.21.15.41:6789/0 conn(0x7f31040b9c70 legacy=0x7f3104143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 -- 172.21.15.41:0/2889791186 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104142e90 con 0x7f31040b0660 2021-10-21T00:58:23.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.446+0000 7f3103fff700 1 --2- 172.21.15.41:0/2889791186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b0660 0x7f31041419c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f31040b5640 tx=0x7f30fc009290).ready entity=mon.0 client_cookie=3fe1b47bf69a64ab server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f31027fc700 1 -- 172.21.15.41:0/2889791186 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30fc00b860 con 0x7f31040b0660 2021-10-21T00:58:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f31027fc700 1 -- 172.21.15.41:0/2889791186 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00b9c0 con 0x7f31040b0660 2021-10-21T00:58:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f31027fc700 1 -- 172.21.15.41:0/2889791186 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30fc00bb30 con 0x7f31040b0660 2021-10-21T00:58:23.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- 172.21.15.41:0/2889791186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b0660 msgr2=0x7f31041419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 --2- 172.21.15.41:0/2889791186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b0660 0x7f31041419c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f31040b5640 tx=0x7f30fc009290).stop 2021-10-21T00:58:23.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- 172.21.15.41:0/2889791186 shutdown_connections 2021-10-21T00:58:23.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 --2- 172.21.15.41:0/2889791186 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b0660 0x7f31041419c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 --2- 172.21.15.41:0/2889791186 >> v2:172.21.15.62:3300/0 conn(0x7f3104143a40 0x7f31040b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- 172.21.15.41:0/2889791186 >> 172.21.15.41:0/2889791186 conn(0x7f3104062f00 msgr2=0x7f31040b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- 172.21.15.41:0/2889791186 shutdown_connections 2021-10-21T00:58:23.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- 172.21.15.41:0/2889791186 wait complete. 2021-10-21T00:58:23.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 Processor -- start 2021-10-21T00:58:23.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.450+0000 7f310a002700 1 -- start start 2021-10-21T00:58:23.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040b0660 0x7f3104142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 0x7f3104140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3104143a40 0x7f3104140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040af150 con 0x7f31040b9c70 2021-10-21T00:58:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040af3f0 con 0x7f31040b0660 2021-10-21T00:58:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31041414c0 con 0x7f3104143a40 2021-10-21T00:58:23.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 0x7f3104140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 0x7f3104140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39410/0 (socket says 172.21.15.41:39410) 2021-10-21T00:58:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 -- 172.21.15.41:0/2424626326 learned_addr learned my addr 172.21.15.41:0/2424626326 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f31037fe700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040b0660 0x7f3104142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3103fff700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3104143a40 0x7f3104140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 -- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3104143a40 msgr2=0x7f3104140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3104143a40 0x7f3104140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 -- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040b0660 msgr2=0x7f3104142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040b0660 0x7f3104142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc009530 con 0x7f31040b9c70 2021-10-21T00:58:23.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f31037fe700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31040b0660 0x7f3104142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:58:23.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3103fff700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3104143a40 0x7f3104140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-10-21T00:58:23.480 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3102ffd700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 0x7f3104140ae0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f30f400c000 tx=0x7f30f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4010780 con 0x7f31040b9c70 2021-10-21T00:58:23.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40108e0 con 0x7f31040b9c70 2021-10-21T00:58:23.481 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31040ad340 con 0x7f31040b9c70 2021-10-21T00:58:23.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4010c40 con 0x7f31040b9c70 2021-10-21T00:58:23.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31040ad070 con 0x7f31040b9c70 2021-10-21T00:58:23.482 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.454+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31041134b0 con 0x7f31040b9c70 2021-10-21T00:58:23.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30f401c460 con 0x7f31040b9c70 2021-10-21T00:58:23.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30e4053580 0x7f30e4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f30f406bba0 con 0x7f31040b9c70 2021-10-21T00:58:23.483 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f30e4059d00 0x7f30e405c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30e405c780 con 0x7f30e4059d00 2021-10-21T00:58:23.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f31037fe700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30e4053580 0x7f30e4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.484 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30f406e230 con 0x7f31040b9c70 2021-10-21T00:58:23.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3103fff700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f30e4059d00 0x7f30e405c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f31037fe700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30e4053580 0x7f30e4055a40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f30f8008000 tx=0x7f30f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.485 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3103fff700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f30e4059d00 0x7f30e405c120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.486 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.458+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== osd.5 v2:172.21.15.62:6802/14811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f30e405c780 con 0x7f30e4059d00 2021-10-21T00:58:23.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.474+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 --> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3104155c30 con 0x7f30e4059d00 2021-10-21T00:58:23.487 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f3100ff9700 1 -- 172.21.15.41:0/2424626326 <== osd.5 v2:172.21.15.62:6802/14811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f30fc006ce0 con 0x7f30e4059d00 2021-10-21T00:58:23.488 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:23.488 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:23.489 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:23.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f30e4059d00 msgr2=0x7f30e405c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.490 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6802/14811,v1:172.21.15.62:6803/14811] conn(0x7f30e4059d00 0x7f30e405c120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30e4053580 msgr2=0x7f30e4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f30e4053580 0x7f30e4055a40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f30f8008000 tx=0x7f30f8009040).stop 2021-10-21T00:58:23.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 msgr2=0x7f3104140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.491 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 --2- 172.21.15.41:0/2424626326 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f31040b9c70 0x7f3104140ae0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f30f400c000 tx=0x7f30f4006df0).stop 2021-10-21T00:58:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f3103fff700 1 -- 172.21.15.41:0/2424626326 reap_dead start 2021-10-21T00:58:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 shutdown_connections 2021-10-21T00:58:23.492 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 >> 172.21.15.41:0/2424626326 conn(0x7f3104062f00 msgr2=0x7f31040b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 shutdown_connections 2021-10-21T00:58:23.493 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.478+0000 7f310a002700 1 -- 172.21.15.41:0/2424626326 wait complete. 2021-10-21T00:58:23.495 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-10-21T00:58:23.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 Processor -- start 2021-10-21T00:58:23.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 -- start start 2021-10-21T00:58:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f213405f9f0 0x7f213414a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.611 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21340aa750 0x7f213414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f213414b130 0x7f21341495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340b1620 con 0x7f213405f9f0 2021-10-21T00:58:23.612 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340609d0 con 0x7f21340aa750 2021-10-21T00:58:23.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213405fdd0 con 0x7f213414b130 2021-10-21T00:58:23.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f213405f9f0 0x7f213414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.613 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f213405f9f0 0x7f213414a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39420/0 (socket says 172.21.15.41:39420) 2021-10-21T00:58:23.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 -- 172.21.15.41:0/1675571077 learned_addr learned my addr 172.21.15.41:0/1675571077 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f212bfff700 1 --2- 172.21.15.41:0/1675571077 >> v2:172.21.15.62:3300/0 conn(0x7f21340aa750 0x7f213414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.614 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f213359e700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f213414b130 0x7f21341495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 -- 172.21.15.41:0/1675571077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f213414b130 msgr2=0x7f21341495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:23.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f213414b130 0x7f21341495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.615 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 -- 172.21.15.41:0/1675571077 >> v2:172.21.15.62:3300/0 conn(0x7f21340aa750 msgr2=0x7f213414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:23.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 --2- 172.21.15.41:0/1675571077 >> v2:172.21.15.62:3300/0 conn(0x7f21340aa750 0x7f213414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.616 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 -- 172.21.15.41:0/1675571077 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340b1380 con 0x7f213405f9f0 2021-10-21T00:58:23.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f2132d9d700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f213414a750 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f2124002f70 tx=0x7f2124006eb0).ready entity=mon.0 client_cookie=521d5125bd0141d0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f213259c700 1 -- 172.21.15.41:0/1675571077 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f212400d570 con 0x7f213405f9f0 2021-10-21T00:58:23.617 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f213259c700 1 -- 172.21.15.41:0/1675571077 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124000e90 con 0x7f213405f9f0 2021-10-21T00:58:23.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f213259c700 1 -- 172.21.15.41:0/1675571077 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f212400d900 con 0x7f213405f9f0 2021-10-21T00:58:23.618 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 -- 172.21.15.41:0/1675571077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 msgr2=0x7f213414a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.602+0000 7f21391e7700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f213414a750 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f2124002f70 tx=0x7f2124006eb0).stop 2021-10-21T00:58:23.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/1675571077 shutdown_connections 2021-10-21T00:58:23.619 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f213414b130 0x7f21341495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- 172.21.15.41:0/1675571077 >> v2:172.21.15.62:3300/0 conn(0x7f21340aa750 0x7f213414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- 172.21.15.41:0/1675571077 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f213414a750 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.620 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/1675571077 >> 172.21.15.41:0/1675571077 conn(0x7f213405bca0 msgr2=0x7f213405c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/1675571077 shutdown_connections 2021-10-21T00:58:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/1675571077 wait complete. 2021-10-21T00:58:23.621 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 Processor -- start 2021-10-21T00:58:23.622 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- start start 2021-10-21T00:58:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340aa750 0x7f21340ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.625 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f213414b130 0x7f2134146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340aca20 con 0x7f213405f9f0 2021-10-21T00:58:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134156f10 con 0x7f213414b130 2021-10-21T00:58:23.626 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21341571b0 con 0x7f21340aa750 2021-10-21T00:58:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.627 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39426/0 (socket says 172.21.15.41:39426) 2021-10-21T00:58:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 -- 172.21.15.41:0/4265016743 learned_addr learned my addr 172.21.15.41:0/4265016743 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f212bfff700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340aa750 0x7f21340ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.628 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f213359e700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f213414b130 0x7f2134146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 -- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340aa750 msgr2=0x7f21340ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340aa750 0x7f21340ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.629 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 -- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f213414b130 msgr2=0x7f2134146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f213414b130 0x7f2134146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 -- 172.21.15.41:0/4265016743 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212400b1e0 con 0x7f213405f9f0 2021-10-21T00:58:23.630 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2132d9d700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2124002f70 tx=0x7f2124015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21240117e0 con 0x7f213405f9f0 2021-10-21T00:58:23.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21340ad660 con 0x7f213405f9f0 2021-10-21T00:58:23.631 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124011940 con 0x7f213405f9f0 2021-10-21T00:58:23.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2124011ca0 con 0x7f213405f9f0 2021-10-21T00:58:23.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.606+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2134146980 con 0x7f213405f9f0 2021-10-21T00:58:23.632 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21340ac870 con 0x7f213405f9f0 2021-10-21T00:58:23.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f212401a040 con 0x7f213405f9f0 2021-10-21T00:58:23.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f2130d99700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 0x7f2118055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.633 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f212406c5e0 con 0x7f213405f9f0 2021-10-21T00:58:23.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f212bfff700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 0x7f2118055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.610+0000 7f212bfff700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 0x7f2118055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f211c00b000 tx=0x7f211c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.634 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.618+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2124043980 con 0x7f213405f9f0 2021-10-21T00:58:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.746+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f213414b550 con 0x7f2118053610 2021-10-21T00:58:23.753 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.746+0000 7f2130d99700 1 -- 172.21.15.41:0/4265016743 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f213414b550 con 0x7f2118053610 2021-10-21T00:58:23.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 msgr2=0x7f2118055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.756 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 0x7f2118055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f211c00b000 tx=0x7f211c006df0).stop 2021-10-21T00:58:23.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 msgr2=0x7f21340ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2124002f70 tx=0x7f2124015000).stop 2021-10-21T00:58:23.757 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 shutdown_connections 2021-10-21T00:58:23.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f2118053610 0x7f2118055ad0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f213414b130 0x7f2134146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.758 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21340aa750 0x7f21340ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 --2- 172.21.15.41:0/4265016743 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f213405f9f0 0x7f21340ae140 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 >> 172.21.15.41:0/4265016743 conn(0x7f213405bca0 msgr2=0x7f21340b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.759 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 shutdown_connections 2021-10-21T00:58:23.760 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.750+0000 7f21391e7700 1 -- 172.21.15.41:0/4265016743 wait complete. 2021-10-21T00:58:23.760 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 5 to deep-scrub 2021-10-21T00:58:23.767 INFO:tasks.ceph:Scrubbing osd.6 2021-10-21T00:58:23.768 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:23.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.870+0000 7f77be733700 1 Processor -- start 2021-10-21T00:58:23.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.870+0000 7f77be733700 1 -- start start 2021-10-21T00:58:23.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b80aa7a0 0x7f77b8140350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80609a0 0x7f77b8060090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b80b0ff0 con 0x7f77b80b0c10 2021-10-21T00:58:23.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b805f6b0 con 0x7f77b80aa7a0 2021-10-21T00:58:23.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b805f950 con 0x7f77b80609a0 2021-10-21T00:58:23.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77bccd0700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80609a0 0x7f77b8060090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b80aa7a0 0x7f77b8140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b80aa7a0 0x7f77b8140350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.41:51354/0 (socket says 172.21.15.41:51354) 2021-10-21T00:58:23.881 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b7fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f77b80b0c10 0x7f77b80aa090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:45260/0 (socket says 172.21.15.41:45260) 2021-10-21T00:58:23.882 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 -- 172.21.15.41:0/2966718907 learned_addr learned my addr 172.21.15.41:0/2966718907 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 -- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80609a0 msgr2=0x7f77b8060090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:23.886 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 --2- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80609a0 0x7f77b8060090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 -- 172.21.15.41:0/2966718907 >> v1:172.21.15.62:6789/0 conn(0x7f77b80b0c10 legacy=0x7f77b80aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 -- 172.21.15.41:0/2966718907 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b805fbf0 con 0x7f77b80aa7a0 2021-10-21T00:58:23.887 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b77fe700 1 --2- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80aa7a0 0x7f77b8140350 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f77ac002f70 tx=0x7f77ac006f40).ready entity=mon.1 client_cookie=535569f24be913ad server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b6ffd700 1 -- 172.21.15.41:0/2966718907 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00da80 con 0x7f77b80aa7a0 2021-10-21T00:58:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b6ffd700 1 -- 172.21.15.41:0/2966718907 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac000e90 con 0x7f77b80aa7a0 2021-10-21T00:58:23.888 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77b6ffd700 1 -- 172.21.15.41:0/2966718907 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00de10 con 0x7f77b80aa7a0 2021-10-21T00:58:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80aa7a0 msgr2=0x7f77b8140350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 --2- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80aa7a0 0x7f77b8140350 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f77ac002f70 tx=0x7f77ac006f40).stop 2021-10-21T00:58:23.889 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- 172.21.15.41:0/2966718907 shutdown_connections 2021-10-21T00:58:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 --2- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80609a0 0x7f77b8060090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 --2- 172.21.15.41:0/2966718907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80aa7a0 0x7f77b8140350 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.890 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- 172.21.15.41:0/2966718907 >> 172.21.15.41:0/2966718907 conn(0x7f77b805bca0 msgr2=0x7f77b805c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- 172.21.15.41:0/2966718907 shutdown_connections 2021-10-21T00:58:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.874+0000 7f77be733700 1 -- 172.21.15.41:0/2966718907 wait complete. 2021-10-21T00:58:23.891 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 Processor -- start 2021-10-21T00:58:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- start start 2021-10-21T00:58:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 0x7f77b8139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.892 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80aa7a0 0x7f77b814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80b0c10 0x7f77b8141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b813a3d0 con 0x7f77b80609a0 2021-10-21T00:58:23.893 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b813ab40 con 0x7f77b80b0c10 2021-10-21T00:58:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b813ade0 con 0x7f77b80aa7a0 2021-10-21T00:58:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 0x7f77b8139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.894 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 0x7f77b8139ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39440/0 (socket says 172.21.15.41:39440) 2021-10-21T00:58:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 -- 172.21.15.41:0/3309249194 learned_addr learned my addr 172.21.15.41:0/3309249194 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b77fe700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80aa7a0 0x7f77b814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.895 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77bccd0700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80b0c10 0x7f77b8141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 -- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80aa7a0 msgr2=0x7f77b814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77b80aa7a0 0x7f77b814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.896 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 -- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80b0c10 msgr2=0x7f77b8141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b80b0c10 0x7f77b8141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.897 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac00b460 con 0x7f77b80609a0 2021-10-21T00:58:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b7fff700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 0x7f77b8139ab0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f77b805ce40 tx=0x7f77a80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a8005ae0 con 0x7f77b80609a0 2021-10-21T00:58:23.898 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8005c40 con 0x7f77b80609a0 2021-10-21T00:58:23.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b813a5c0 con 0x7f77b80609a0 2021-10-21T00:58:23.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a80070d0 con 0x7f77b80609a0 2021-10-21T00:58:23.899 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.878+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b814e430 con 0x7f77b80609a0 2021-10-21T00:58:23.901 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77b813afa0 con 0x7f77b80609a0 2021-10-21T00:58:23.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f77a8010070 con 0x7f77b80609a0 2021-10-21T00:58:23.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7798053610 0x7f7798055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.902 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f77a806b570 con 0x7f77b80609a0 2021-10-21T00:58:23.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f7798059d90 0x7f779805c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:23.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f779805c770 con 0x7f7798059d90 2021-10-21T00:58:23.903 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77a806b950 con 0x7f77b80609a0 2021-10-21T00:58:23.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b77fe700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7798053610 0x7f7798055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77bccd0700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f7798059d90 0x7f779805c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:23.904 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77b77fe700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7798053610 0x7f7798055ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f77ac01b000 tx=0x7f77b805d130).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.882+0000 7f77bccd0700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f7798059d90 0x7f779805c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:23.905 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.886+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== osd.6 v2:172.21.15.62:6810/14812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f779805c770 con 0x7f7798059d90 2021-10-21T00:58:23.906 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 --> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77b8060580 con 0x7f7798059d90 2021-10-21T00:58:23.907 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77b57fa700 1 -- 172.21.15.41:0/3309249194 <== osd.6 v2:172.21.15.62:6810/14812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f77b8060580 con 0x7f7798059d90 2021-10-21T00:58:23.908 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:23.908 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:23.908 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:23.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f7798059d90 msgr2=0x7f779805c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6810/14812,v1:172.21.15.62:6811/14812] conn(0x7f7798059d90 0x7f779805c1b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:23.910 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7798053610 msgr2=0x7f7798055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f7798053610 0x7f7798055ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f77ac01b000 tx=0x7f77b805d130).stop 2021-10-21T00:58:23.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 msgr2=0x7f77b8139ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:23.911 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77be733700 1 --2- 172.21.15.41:0/3309249194 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f77b80609a0 0x7f77b8139ab0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f77b805ce40 tx=0x7f77a80013a0).stop 2021-10-21T00:58:23.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.898+0000 7f77bccd0700 1 -- 172.21.15.41:0/3309249194 reap_dead start 2021-10-21T00:58:23.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.902+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 shutdown_connections 2021-10-21T00:58:23.912 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.902+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 >> 172.21.15.41:0/3309249194 conn(0x7f77b805bca0 msgr2=0x7f77b80aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:23.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.902+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 shutdown_connections 2021-10-21T00:58:23.913 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:23.902+0000 7f77be733700 1 -- 172.21.15.41:0/3309249194 wait complete. 2021-10-21T00:58:23.918 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-10-21T00:58:24.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.018+0000 7fce644a2700 1 Processor -- start 2021-10-21T00:58:24.025 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.018+0000 7fce644a2700 1 -- start start 2021-10-21T00:58:24.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fce5c0aa750 0x7fce5c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fce5c14b350 0x7fce5c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5c0609d0 con 0x7fce5c05f9f0 2021-10-21T00:58:24.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5c0b1620 con 0x7fce5c14b350 2021-10-21T00:58:24.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5c05fdd0 con 0x7fce5c0aa750 2021-10-21T00:58:24.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fce5c14b350 0x7fce5c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fce5c14b350 0x7fce5c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39454/0 (socket says 172.21.15.41:39454) 2021-10-21T00:58:24.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 -- 172.21.15.41:0/2782720051 learned_addr learned my addr 172.21.15.41:0/2782720051 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce61a3d700 1 --2- 172.21.15.41:0/2782720051 >> v2:172.21.15.62:3300/0 conn(0x7fce5c0aa750 0x7fce5c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 -- 172.21.15.41:0/2782720051 >> v2:172.21.15.62:3300/0 conn(0x7fce5c0aa750 msgr2=0x7fce5c14ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:24.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 --2- 172.21.15.41:0/2782720051 >> v2:172.21.15.62:3300/0 conn(0x7fce5c0aa750 0x7fce5c14ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 -- 172.21.15.41:0/2782720051 >> v1:172.21.15.62:6789/0 conn(0x7fce5c05f9f0 legacy=0x7fce5c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 -- 172.21.15.41:0/2782720051 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0b1380 con 0x7fce5c14b350 2021-10-21T00:58:24.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce62a3f700 1 --2- 172.21.15.41:0/2782720051 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c0af7c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fce54002f70 tx=0x7fce54006eb0).ready entity=mon.0 client_cookie=fd169de03b575a23 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce6123c700 1 -- 172.21.15.41:0/2782720051 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5400d5c0 con 0x7fce5c14b350 2021-10-21T00:58:24.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce6123c700 1 -- 172.21.15.41:0/2782720051 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54000e90 con 0x7fce5c14b350 2021-10-21T00:58:24.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce6123c700 1 -- 172.21.15.41:0/2782720051 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5400d950 con 0x7fce5c14b350 2021-10-21T00:58:24.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- 172.21.15.41:0/2782720051 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 msgr2=0x7fce5c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 --2- 172.21.15.41:0/2782720051 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c0af7c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fce54002f70 tx=0x7fce54006eb0).stop 2021-10-21T00:58:24.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- 172.21.15.41:0/2782720051 shutdown_connections 2021-10-21T00:58:24.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 --2- 172.21.15.41:0/2782720051 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c0af7c0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 --2- 172.21.15.41:0/2782720051 >> v2:172.21.15.62:3300/0 conn(0x7fce5c0aa750 0x7fce5c14ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- 172.21.15.41:0/2782720051 >> 172.21.15.41:0/2782720051 conn(0x7fce5c05bca0 msgr2=0x7fce5c05c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- 172.21.15.41:0/2782720051 shutdown_connections 2021-10-21T00:58:24.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.022+0000 7fce644a2700 1 -- 172.21.15.41:0/2782720051 wait complete. 2021-10-21T00:58:24.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 Processor -- start 2021-10-21T00:58:24.040 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- start start 2021-10-21T00:58:24.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 0x7fce5c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 0x7fce5c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.041 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0aeae0 con 0x7fce5c14b350 2021-10-21T00:58:24.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0aed80 con 0x7fce5c0aa750 2021-10-21T00:58:24.042 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0af020 con 0x7fce5c05f9f0 2021-10-21T00:58:24.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce61a3d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 0x7fce5c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.043 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce6223e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 0x7fce5c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39458/0 (socket says 172.21.15.41:39458) 2021-10-21T00:58:24.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce6223e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 0x7fce5c0b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.41:57954/0 (socket says 172.21.15.41:57954) 2021-10-21T00:58:24.044 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 -- 172.21.15.41:0/997332066 learned_addr learned my addr 172.21.15.41:0/997332066 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 -- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 msgr2=0x7fce5c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 0x7fce5c0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.045 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 -- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 msgr2=0x7fce5c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 0x7fce5c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.046 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 -- 172.21.15.41:0/997332066 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5400b1e0 con 0x7fce5c14b350 2021-10-21T00:58:24.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce61a3d700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 0x7fce5c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:24.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce62a3f700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fce54002f70 tx=0x7fce54015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.047 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce540116e0 con 0x7fce5c14b350 2021-10-21T00:58:24.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54011840 con 0x7fce5c14b350 2021-10-21T00:58:24.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce54011ba0 con 0x7fce5c14b350 2021-10-21T00:58:24.048 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c1562c0 con 0x7fce5c14b350 2021-10-21T00:58:24.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.026+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c0630a0 con 0x7fce5c14b350 2021-10-21T00:58:24.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c0af1e0 con 0x7fce5c14b350 2021-10-21T00:58:24.049 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce5401a040 con 0x7fce5c14b350 2021-10-21T00:58:24.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce4b7fe700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 0x7fce3c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fce5406c4c0 con 0x7fce5c14b350 2021-10-21T00:58:24.050 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce6223e700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 0x7fce3c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.030+0000 7fce6223e700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 0x7fce3c055ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fce4c00d000 tx=0x7fce4c007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.051 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.038+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce54043930 con 0x7fce5c14b350 2021-10-21T00:58:24.172 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.166+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fce5c057350 con 0x7fce3c053610 2021-10-21T00:58:24.173 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.166+0000 7fce4b7fe700 1 -- 172.21.15.41:0/997332066 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce5c057350 con 0x7fce3c053610 2021-10-21T00:58:24.175 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 msgr2=0x7fce3c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 0x7fce3c055ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fce4c00d000 tx=0x7fce4c007b90).stop 2021-10-21T00:58:24.176 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 msgr2=0x7fce5c146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fce54002f70 tx=0x7fce54015000).stop 2021-10-21T00:58:24.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 shutdown_connections 2021-10-21T00:58:24.177 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fce3c053610 0x7fce3c055ad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fce5c14b350 0x7fce5c146980 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce5c0aa750 0x7fce5c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.178 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 --2- 172.21.15.41:0/997332066 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fce5c05f9f0 0x7fce5c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 >> 172.21.15.41:0/997332066 conn(0x7fce5c05bca0 msgr2=0x7fce5c146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.179 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 shutdown_connections 2021-10-21T00:58:24.180 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.170+0000 7fce644a2700 1 -- 172.21.15.41:0/997332066 wait complete. 2021-10-21T00:58:24.180 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 6 to deep-scrub 2021-10-21T00:58:24.186 INFO:tasks.ceph:Scrubbing osd.7 2021-10-21T00:58:24.187 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-10-21T00:58:24.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 Processor -- start 2021-10-21T00:58:24.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 -- start start 2021-10-21T00:58:24.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 0x7f33080b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3308143610 0x7f330813c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3308142ad0 con 0x7f330813c510 2021-10-21T00:58:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33080b3520 con 0x7f3308143610 2021-10-21T00:58:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308143c40 con 0x7f3308062330 2021-10-21T00:58:24.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f3306d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3308143610 0x7f330813c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f3305d9b700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7f330813c510 0x7f3308142f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37234/0 (socket says 172.21.15.41:37234) 2021-10-21T00:58:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f3306d9d700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f3308143610 0x7f330813c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39468/0 (socket says 172.21.15.41:39468) 2021-10-21T00:58:24.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f3305d9b700 1 -- 172.21.15.41:0/1399963933 learned_addr learned my addr 172.21.15.41:0/1399963933 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:24.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.290+0000 7f330659c700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 0x7f33080b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f3306d9d700 1 -- 172.21.15.41:0/1399963933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 msgr2=0x7f33080b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:24.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f3306d9d700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 0x7f33080b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f3306d9d700 1 -- 172.21.15.41:0/1399963933 >> v1:172.21.15.41:6789/0 conn(0x7f330813c510 legacy=0x7f3308142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f3306d9d700 1 -- 172.21.15.41:0/1399963933 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330813ce60 con 0x7f3308143610 2021-10-21T00:58:24.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330659c700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 0x7f33080b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-10-21T00:58:24.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330559a700 1 -- 172.21.15.41:0/1399963933 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876106202 0 0) 0x7f3308142ad0 con 0x7f330813c510 2021-10-21T00:58:24.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f3306d9d700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3308143610 0x7f330813c970 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f33000032f0 tx=0x7f33000091d0).ready entity=mon.0 client_cookie=b45739a343b819f0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330559a700 1 -- 172.21.15.41:0/1399963933 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3300009ea0 con 0x7f3308143610 2021-10-21T00:58:24.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330559a700 1 -- 172.21.15.41:0/1399963933 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000b8a0 con 0x7f3308143610 2021-10-21T00:58:24.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330559a700 1 -- 172.21.15.41:0/1399963933 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f330000ba10 con 0x7f3308143610 2021-10-21T00:58:24.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- 172.21.15.41:0/1399963933 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3308143610 msgr2=0x7f330813c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3308143610 0x7f330813c970 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7f33000032f0 tx=0x7f33000091d0).stop 2021-10-21T00:58:24.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- 172.21.15.41:0/1399963933 shutdown_connections 2021-10-21T00:58:24.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f3308143610 0x7f330813c970 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 --2- 172.21.15.41:0/1399963933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308062330 0x7f33080b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- 172.21.15.41:0/1399963933 >> 172.21.15.41:0/1399963933 conn(0x7f33080b9080 msgr2=0x7f33080b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- 172.21.15.41:0/1399963933 shutdown_connections 2021-10-21T00:58:24.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- 172.21.15.41:0/1399963933 wait complete. 2021-10-21T00:58:24.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 Processor -- start 2021-10-21T00:58:24.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.294+0000 7f330759e700 1 -- start start 2021-10-21T00:58:24.315 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3308062330 0x7f33080acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 0x7f330813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308143610 0x7f330813add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080b84f0 con 0x7f330813c510 2021-10-21T00:58:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080b8760 con 0x7f3308062330 2021-10-21T00:58:24.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33080b7030 con 0x7f3308143610 2021-10-21T00:58:24.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 0x7f330813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 0x7f330813a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39472/0 (socket says 172.21.15.41:39472) 2021-10-21T00:58:24.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 -- 172.21.15.41:0/2313734113 learned_addr learned my addr 172.21.15.41:0/2313734113 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.319 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3306d9d700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308143610 0x7f330813add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330659c700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3308062330 0x7f33080acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 -- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308143610 msgr2=0x7f330813add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.320 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3308143610 0x7f330813add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 -- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3308062330 msgr2=0x7f33080acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3308062330 0x7f33080acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.321 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009470 con 0x7f330813c510 2021-10-21T00:58:24.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f3305d9b700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 0x7f330813a8e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f32f0000ed0 tx=0x7f32f0007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.322 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32f00070d0 con 0x7f330813c510 2021-10-21T00:58:24.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0007230 con 0x7f330813c510 2021-10-21T00:58:24.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32f0005610 con 0x7f330813c510 2021-10-21T00:58:24.323 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3308141eb0 con 0x7f330813c510 2021-10-21T00:58:24.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33080af650 con 0x7f330813c510 2021-10-21T00:58:24.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33080b8960 con 0x7f330813c510 2021-10-21T00:58:24.324 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.298+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f32f0010070 con 0x7f330813c510 2021-10-21T00:58:24.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f32ff7fe700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32ec0536a0 0x7f32ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f32f006ac90 con 0x7f330813c510 2021-10-21T00:58:24.325 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f330659c700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32ec0536a0 0x7f32ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f32ff7fe700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f32ec059e20 0x7f32ec05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32ec05c800 con 0x7f32ec059e20 2021-10-21T00:58:24.326 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f006d320 con 0x7f330813c510 2021-10-21T00:58:24.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f3306d9d700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f32ec059e20 0x7f32ec05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.327 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f330659c700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32ec0536a0 0x7f32ec055b60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f32f800c000 tx=0x7f32f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.302+0000 7f3306d9d700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f32ec059e20 0x7f32ec05c240 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.328 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.306+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== osd.7 v2:172.21.15.62:6826/14821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f32ec05c800 con 0x7f32ec059e20 2021-10-21T00:58:24.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.318+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 --> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33080b6eb0 con 0x7f32ec059e20 2021-10-21T00:58:24.329 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f32ff7fe700 1 -- 172.21.15.41:0/2313734113 <== osd.7 v2:172.21.15.62:6826/14821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f330000bc40 con 0x7f32ec059e20 2021-10-21T00:58:24.330 INFO:teuthology.orchestra.run.smithi041.stdout:{ 2021-10-21T00:58:24.331 INFO:teuthology.orchestra.run.smithi041.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-10-21T00:58:24.331 INFO:teuthology.orchestra.run.smithi041.stdout:} 2021-10-21T00:58:24.332 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f32ec059e20 msgr2=0x7f32ec05c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6826/14821,v1:172.21.15.62:6827/14821] conn(0x7f32ec059e20 0x7f32ec05c240 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.333 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32ec0536a0 msgr2=0x7f32ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f32ec0536a0 0x7f32ec055b60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f32f800c000 tx=0x7f32f8008040).stop 2021-10-21T00:58:24.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 msgr2=0x7f330813a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.334 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 --2- 172.21.15.41:0/2313734113 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f330813c510 0x7f330813a8e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f32f0000ed0 tx=0x7f32f0007ac0).stop 2021-10-21T00:58:24.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f3306d9d700 1 -- 172.21.15.41:0/2313734113 reap_dead start 2021-10-21T00:58:24.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 shutdown_connections 2021-10-21T00:58:24.335 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 >> 172.21.15.41:0/2313734113 conn(0x7f33080b9080 msgr2=0x7f33080b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 shutdown_connections 2021-10-21T00:58:24.336 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.322+0000 7f330759e700 1 -- 172.21.15.41:0/2313734113 wait complete. 2021-10-21T00:58:24.343 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-10-21T00:58:24.453 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.446+0000 7fac6ff9b700 1 Processor -- start 2021-10-21T00:58:24.454 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.446+0000 7fac6ff9b700 1 -- start start 2021-10-21T00:58:24.456 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.446+0000 7fac6ff9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac6814e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- --> v1:172.21.15.41:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac68143dc0 con 0x7fac6813cb80 2021-10-21T00:58:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6805c3b0 con 0x7fac68142b80 2021-10-21T00:58:24.457 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac680adfe0 con 0x7fac680adb50 2021-10-21T00:58:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6dd37700 1 --1- >> v1:172.21.15.41:6789/0 conn(0x7fac6813cb80 0x7fac6805bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.41:6789/0 says I am v1:172.21.15.41:37252/0 (socket says 172.21.15.41:37252) 2021-10-21T00:58:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6dd37700 1 -- 172.21.15.41:0/3386146051 learned_addr learned my addr 172.21.15.41:0/3386146051 (peer_addr_for_me v1:172.21.15.41:0/0) 2021-10-21T00:58:24.458 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6e538700 1 --2- 172.21.15.41:0/3386146051 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac6814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 <== mon.0 v1:172.21.15.41:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505233734 0 0) 0x7fac68143dc0 con 0x7fac6813cb80 2021-10-21T00:58:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 --> v1:172.21.15.41:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003260 con 0x7fac6813cb80 2021-10-21T00:58:24.459 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24690561 0 0) 0x7fac6805c3b0 con 0x7fac68142b80 2021-10-21T00:58:24.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac68143dc0 con 0x7fac68142b80 2021-10-21T00:58:24.460 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6e538700 1 -- 172.21.15.41:0/3386146051 >> v1:172.21.15.62:6789/0 conn(0x7fac68142b80 legacy=0x7fac680ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6e538700 1 -- 172.21.15.41:0/3386146051 >> v1:172.21.15.41:6789/0 conn(0x7fac6813cb80 legacy=0x7fac6805bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6e538700 1 -- 172.21.15.41:0/3386146051 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68064190 con 0x7fac680adb50 2021-10-21T00:58:24.461 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6e538700 1 --2- 172.21.15.41:0/3386146051 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac6814e500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fac600032f0 tx=0x7fac600091d0).ready entity=mon.2 client_cookie=cf11ebff86f55b3f server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6000b640 con 0x7fac680adb50 2021-10-21T00:58:24.462 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6000b7a0 con 0x7fac680adb50 2021-10-21T00:58:24.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6cd35700 1 -- 172.21.15.41:0/3386146051 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac6000b910 con 0x7fac680adb50 2021-10-21T00:58:24.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- 172.21.15.41:0/3386146051 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 msgr2=0x7fac6814e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.463 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/3386146051 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac6814e500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fac600032f0 tx=0x7fac600091d0).stop 2021-10-21T00:58:24.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- 172.21.15.41:0/3386146051 shutdown_connections 2021-10-21T00:58:24.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/3386146051 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac6814e500 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.464 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- 172.21.15.41:0/3386146051 >> 172.21.15.41:0/3386146051 conn(0x7fac68061d80 msgr2=0x7fac68063900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- 172.21.15.41:0/3386146051 shutdown_connections 2021-10-21T00:58:24.465 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.450+0000 7fac6ff9b700 1 -- 172.21.15.41:0/3386146051 wait complete. 2021-10-21T00:58:24.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 Processor -- start 2021-10-21T00:58:24.468 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- start start 2021-10-21T00:58:24.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac68064b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.469 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68142b80 0x7fac68155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6813a9c0 con 0x7fac6813cb80 2021-10-21T00:58:24.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac681554e0 con 0x7fac68142b80 2021-10-21T00:58:24.470 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6813df40 con 0x7fac680adb50 2021-10-21T00:58:24.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.471 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39488/0 (socket says 172.21.15.41:39488) 2021-10-21T00:58:24.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 -- 172.21.15.41:0/2907872756 learned_addr learned my addr 172.21.15.41:0/2907872756 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6e538700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68142b80 0x7fac68155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.472 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6dd37700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac68064b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 -- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 msgr2=0x7fac68064b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac68064b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.473 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 -- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68142b80 msgr2=0x7fac68155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68142b80 0x7fac68155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 -- 172.21.15.41:0/2907872756 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac60009470 con 0x7fac6813cb80 2021-10-21T00:58:24.474 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6d536700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fac58001110 tx=0x7fac58007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac58012400 con 0x7fac6813cb80 2021-10-21T00:58:24.475 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac58012560 con 0x7fac6813cb80 2021-10-21T00:58:24.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac68155710 con 0x7fac6813cb80 2021-10-21T00:58:24.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac580128c0 con 0x7fac6813cb80 2021-10-21T00:58:24.476 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.454+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac68152560 con 0x7fac6813cb80 2021-10-21T00:58:24.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.458+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac681558a0 con 0x7fac6813cb80 2021-10-21T00:58:24.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.458+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac58019030 con 0x7fac6813cb80 2021-10-21T00:58:24.477 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.458+0000 7fac56ffd700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 0x7fac48055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.458+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fac5806aa70 con 0x7fac6813cb80 2021-10-21T00:58:24.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.458+0000 7fac6dd37700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 0x7fac48055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.478 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.462+0000 7fac6dd37700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 0x7fac48055a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fac6400d000 tx=0x7fac64009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.479 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.466+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac58041da0 con 0x7fac6813cb80 2021-10-21T00:58:24.599 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.594+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fac68057350 con 0x7fac48053580 2021-10-21T00:58:24.600 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.594+0000 7fac56ffd700 1 -- 172.21.15.41:0/2907872756 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac68057350 con 0x7fac48053580 2021-10-21T00:58:24.603 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 msgr2=0x7fac48055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 0x7fac48055a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fac6400d000 tx=0x7fac64009040).stop 2021-10-21T00:58:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 msgr2=0x7fac68151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.604 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fac58001110 tx=0x7fac58007a90).stop 2021-10-21T00:58:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 shutdown_connections 2021-10-21T00:58:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fac48053580 0x7fac48055a40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.605 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac68142b80 0x7fac68155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fac6813cb80 0x7fac68151ed0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 --2- 172.21.15.41:0/2907872756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fac680adb50 0x7fac68064b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.606 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 >> 172.21.15.41:0/2907872756 conn(0x7fac68061d80 msgr2=0x7fac680638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 shutdown_connections 2021-10-21T00:58:24.607 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.598+0000 7fac6ff9b700 1 -- 172.21.15.41:0/2907872756 wait complete. 2021-10-21T00:58:24.608 INFO:teuthology.orchestra.run.smithi041.stderr:instructed osd(s) 7 to deep-scrub 2021-10-21T00:58:24.619 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:58:24.722 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 Processor -- start 2021-10-21T00:58:24.723 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- start start 2021-10-21T00:58:24.726 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b20062330 0x7f4b200b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4b200b3a20 0x7f4b2013c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2005bd40 con 0x7f4b20062f70 2021-10-21T00:58:24.727 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2005bf70 con 0x7f4b20062330 2021-10-21T00:58:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b20142cb0 con 0x7f4b200b3a20 2021-10-21T00:58:24.728 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b20062330 0x7f4b200b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f4b20062330 0x7f4b200b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39494/0 (socket says 172.21.15.41:39494) 2021-10-21T00:58:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 -- 172.21.15.41:0/1564522061 learned_addr learned my addr 172.21.15.41:0/1564522061 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.729 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1f7fe700 1 --2- 172.21.15.41:0/1564522061 >> v2:172.21.15.62:3300/0 conn(0x7f4b200b3a20 0x7f4b2013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 -- 172.21.15.41:0/1564522061 >> v2:172.21.15.62:3300/0 conn(0x7f4b200b3a20 msgr2=0x7f4b2013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:24.730 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 --2- 172.21.15.41:0/1564522061 >> v2:172.21.15.62:3300/0 conn(0x7f4b200b3a20 0x7f4b2013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 -- 172.21.15.41:0/1564522061 >> v1:172.21.15.62:6789/0 conn(0x7f4b20062f70 legacy=0x7f4b2005c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 -- 172.21.15.41:0/1564522061 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20142950 con 0x7f4b20062330 2021-10-21T00:58:24.731 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1effd700 1 --2- 172.21.15.41:0/1564522061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b200b3f30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10006eb0).ready entity=mon.0 client_cookie=e9572e8b100856aa server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1dffb700 1 -- 172.21.15.41:0/1564522061 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1000d610 con 0x7f4b20062330 2021-10-21T00:58:24.732 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1dffb700 1 -- 172.21.15.41:0/1564522061 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10000e90 con 0x7f4b20062330 2021-10-21T00:58:24.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1dffb700 1 -- 172.21.15.41:0/1564522061 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1000d9a0 con 0x7f4b20062330 2021-10-21T00:58:24.733 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- 172.21.15.41:0/1564522061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 msgr2=0x7f4b200b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/1564522061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b200b3f30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10006eb0).stop 2021-10-21T00:58:24.734 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- 172.21.15.41:0/1564522061 shutdown_connections 2021-10-21T00:58:24.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/1564522061 >> v2:172.21.15.62:3300/0 conn(0x7f4b200b3a20 0x7f4b2013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.735 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/1564522061 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b200b3f30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- 172.21.15.41:0/1564522061 >> 172.21.15.41:0/1564522061 conn(0x7f4b200b9080 msgr2=0x7f4b200b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.736 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- 172.21.15.41:0/1564522061 shutdown_connections 2021-10-21T00:58:24.737 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.718+0000 7f4b1ffff700 1 -- 172.21.15.41:0/1564522061 wait complete. 2021-10-21T00:58:24.740 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 Processor -- start 2021-10-21T00:58:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 -- start start 2021-10-21T00:58:24.741 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b20062f70 0x7f4b201459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b200b3a20 0x7f4b20112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.742 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20153170 con 0x7f4b20062330 2021-10-21T00:58:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2013d420 con 0x7f4b200b3a20 2021-10-21T00:58:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20113730 con 0x7f4b20062f70 2021-10-21T00:58:24.743 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39500/0 (socket says 172.21.15.41:39500) 2021-10-21T00:58:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 -- 172.21.15.41:0/488632216 learned_addr learned my addr 172.21.15.41:0/488632216 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:24.744 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1f7fe700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b200b3a20 0x7f4b20112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1e7fc700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b20062f70 0x7f4b201459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 -- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b20062f70 msgr2=0x7f4b201459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.745 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b20062f70 0x7f4b201459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 -- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b200b3a20 msgr2=0x7f4b20112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b200b3a20 0x7f4b20112ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.746 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.722+0000 7f4b1effd700 1 -- 172.21.15.41:0/488632216 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1000b1e0 con 0x7f4b20062330 2021-10-21T00:58:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b1effd700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b10011760 con 0x7f4b20062330 2021-10-21T00:58:24.747 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b100118c0 con 0x7f4b20062330 2021-10-21T00:58:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b20113960 con 0x7f4b20062330 2021-10-21T00:58:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b10011c20 con 0x7f4b20062330 2021-10-21T00:58:24.748 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b20143f90 con 0x7f4b20062330 2021-10-21T00:58:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b20146200 con 0x7f4b20062330 2021-10-21T00:58:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b10025030 con 0x7f4b20062330 2021-10-21T00:58:24.749 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 0x7f4afc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4b1006c790 con 0x7f4b20062330 2021-10-21T00:58:24.750 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.726+0000 7f4b1e7fc700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 0x7f4afc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:24.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.730+0000 7f4b1e7fc700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 0x7f4afc055b90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f4b1400d000 tx=0x7f4b14007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:24.751 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.734+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b10043bd0 con 0x7f4b20062330 2021-10-21T00:58:24.866 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.862+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b20113af0 con 0x7f4afc0536d0 2021-10-21T00:58:24.873 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.866+0000 7f4b0ffff700 1 -- 172.21.15.41:0/488632216 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67969 (secure 0 0 0) 0x7f4b14015410 con 0x7f4afc0536d0 2021-10-21T00:58:24.874 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:58:24.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 msgr2=0x7f4afc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.876 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 0x7f4afc055b90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f4b1400d000 tx=0x7f4b14007b90).stop 2021-10-21T00:58:24.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 msgr2=0x7f4b20144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:24.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f4b10002f70 tx=0x7f4b10015000).stop 2021-10-21T00:58:24.877 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 shutdown_connections 2021-10-21T00:58:24.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f4afc0536d0 0x7f4afc055b90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.878 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b200b3a20 0x7f4b20112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4b20062f70 0x7f4b201459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 --2- 172.21.15.41:0/488632216 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f4b20062330 0x7f4b20144520 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:24.879 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 >> 172.21.15.41:0/488632216 conn(0x7f4b200b9080 msgr2=0x7f4b2013de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 shutdown_connections 2021-10-21T00:58:24.880 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:24.870+0000 7f4b1ffff700 1 -- 172.21.15.41:0/488632216 wait complete. 2021-10-21T00:58:24.881 INFO:teuthology.orchestra.run.smithi041.stderr:dumped all 2021-10-21T00:58:24.888 INFO:teuthology.orchestra.run.smithi041.stdout:{"pg_ready":true,"pg_map":{"version":1811,"stamp":"2021-10-21T00:58:23.230803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6384832,"kb_used_data":743210208,"kb_used_omap":27883,"kb_used_meta":0,"kb_avail":743210208,"statfs":{"total":767585320960,"available":761047252992,"internally_reserved":0,"allocated":761047252992,"data_stored":761047252992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28552981,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003268"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":137,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.581595+0000","last_change":"2021-10-21T00:02:48.921294+0000","last_active":"2021-10-21T00:12:47.581595+0000","last_peered":"2021-10-21T00:12:47.581595+0000","last_clean":"2021-10-21T00:12:47.581595+0000","last_became_active":"2021-10-21T00:02:48.920214+0000","last_became_peered":"2021-10-21T00:02:48.920214+0000","last_unstale":"2021-10-21T00:12:47.581595+0000","last_undegraded":"2021-10-21T00:12:47.581595+0000","last_fullsized":"2021-10-21T00:12:47.581595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:44.356620+0000","last_clean_scrub_stamp":"2021-10-21T00:02:44.356620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":139,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582746+0000","last_change":"2021-10-21T00:02:54.442999+0000","last_active":"2021-10-21T00:12:47.582746+0000","last_peered":"2021-10-21T00:12:47.582746+0000","last_clean":"2021-10-21T00:12:47.582746+0000","last_became_active":"2021-10-21T00:02:54.442653+0000","last_became_peered":"2021-10-21T00:02:54.442653+0000","last_unstale":"2021-10-21T00:12:47.582746+0000","last_undegraded":"2021-10-21T00:12:47.582746+0000","last_fullsized":"2021-10-21T00:12:47.582746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.581855+0000","last_change":"2021-10-21T00:02:54.443329+0000","last_active":"2021-10-21T00:12:47.581855+0000","last_peered":"2021-10-21T00:12:47.581855+0000","last_clean":"2021-10-21T00:12:47.581855+0000","last_became_active":"2021-10-21T00:02:54.442888+0000","last_became_peered":"2021-10-21T00:02:54.442888+0000","last_unstale":"2021-10-21T00:12:47.581855+0000","last_undegraded":"2021-10-21T00:12:47.581855+0000","last_fullsized":"2021-10-21T00:12:47.581855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:48.080238+0000","last_change":"2021-10-21T00:02:55.009600+0000","last_active":"2021-10-21T00:12:48.080238+0000","last_peered":"2021-10-21T00:12:48.080238+0000","last_clean":"2021-10-21T00:12:48.080238+0000","last_became_active":"2021-10-21T00:02:55.009083+0000","last_became_peered":"2021-10-21T00:02:55.009083+0000","last_unstale":"2021-10-21T00:12:48.080238+0000","last_undegraded":"2021-10-21T00:12:48.080238+0000","last_fullsized":"2021-10-21T00:12:48.080238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":139,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582747+0000","last_change":"2021-10-21T00:02:54.443795+0000","last_active":"2021-10-21T00:12:47.582747+0000","last_peered":"2021-10-21T00:12:47.582747+0000","last_clean":"2021-10-21T00:12:47.582747+0000","last_became_active":"2021-10-21T00:02:54.443329+0000","last_became_peered":"2021-10-21T00:02:54.443329+0000","last_unstale":"2021-10-21T00:12:47.582747+0000","last_undegraded":"2021-10-21T00:12:47.582747+0000","last_fullsized":"2021-10-21T00:12:47.582747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.752243+0000","last_change":"2021-10-21T00:02:55.002147+0000","last_active":"2021-10-21T00:12:47.752243+0000","last_peered":"2021-10-21T00:12:47.752243+0000","last_clean":"2021-10-21T00:12:47.752243+0000","last_became_active":"2021-10-21T00:02:55.001733+0000","last_became_peered":"2021-10-21T00:02:55.001733+0000","last_unstale":"2021-10-21T00:12:47.752243+0000","last_undegraded":"2021-10-21T00:12:47.752243+0000","last_fullsized":"2021-10-21T00:12:47.752243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.582354+0000","last_change":"2021-10-21T00:02:55.003763+0000","last_active":"2021-10-21T00:12:47.582354+0000","last_peered":"2021-10-21T00:12:47.582354+0000","last_clean":"2021-10-21T00:12:47.582354+0000","last_became_active":"2021-10-21T00:02:55.003018+0000","last_became_peered":"2021-10-21T00:02:55.003018+0000","last_unstale":"2021-10-21T00:12:47.582354+0000","last_undegraded":"2021-10-21T00:12:47.582354+0000","last_fullsized":"2021-10-21T00:12:47.582354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:47.752630+0000","last_change":"2021-10-21T00:02:54.444552+0000","last_active":"2021-10-21T00:12:47.752630+0000","last_peered":"2021-10-21T00:12:47.752630+0000","last_clean":"2021-10-21T00:12:47.752630+0000","last_became_active":"2021-10-21T00:02:54.443600+0000","last_became_peered":"2021-10-21T00:02:54.443600+0000","last_unstale":"2021-10-21T00:12:47.752630+0000","last_undegraded":"2021-10-21T00:12:47.752630+0000","last_fullsized":"2021-10-21T00:12:47.752630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":147,"state":"active+clean","last_fresh":"2021-10-21T00:12:48.081266+0000","last_change":"2021-10-21T00:02:54.441675+0000","last_active":"2021-10-21T00:12:48.081266+0000","last_peered":"2021-10-21T00:12:48.081266+0000","last_clean":"2021-10-21T00:12:48.081266+0000","last_became_active":"2021-10-21T00:02:54.441301+0000","last_became_peered":"2021-10-21T00:02:54.441301+0000","last_unstale":"2021-10-21T00:12:48.081266+0000","last_undegraded":"2021-10-21T00:12:48.081266+0000","last_fullsized":"2021-10-21T00:12:48.081266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:02:53.419217+0000","last_clean_scrub_stamp":"2021-10-21T00:02:53.419217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3650,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3737700,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.82099999999999995,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0800000000000001,"5min":1.248,"15min":1.2929999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0940000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.54800000000000004},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.198},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84999999999999998,"15min":0.83399999999999996},"min":{"1min":0.66700000000000004,"5min":0.60999999999999999,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84199999999999997,"15min":0.85199999999999998},"min":{"1min":0.68300000000000005,"5min":0.58499999999999996,"15min":0.57999999999999996},"max":{"1min":1.0269999999999999,"5min":1.1000000000000001,"15min":1.3300000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.874,"15min":0.88},"min":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.159,"5min":1.194,"15min":1.466},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.69099999999999995,"5min":0.621,"15min":0.58199999999999996},"max":{"1min":1.099,"5min":1.242,"15min":1.5529999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91600000000000004,"15min":0.90300000000000002},"min":{"1min":0.76600000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.153,"5min":1.167,"15min":1.3089999999999999},"last":1.403}]},{"osd":4,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.2549999999999999,"5min":1.3660000000000001,"15min":1.6299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.64300000000000002,"5min":0.629,"15min":0.57499999999999996},"max":{"1min":1.097,"5min":1.2809999999999999,"15min":1.393},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.82799999999999996},"min":{"1min":0.60399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1950000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.71999999999999997,"5min":0.63100000000000001,"15min":0.59699999999999998},"max":{"1min":1.2,"5min":1.4590000000000001,"15min":1.7050000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:57:23 2021","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68600000000000005,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":1.2330000000000001,"5min":1.605,"15min":1.605},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.82199999999999995,"5min":0.69899999999999995,"15min":0.56699999999999995},"max":{"1min":1.204,"5min":1.3839999999999999,"15min":1.78},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":4014,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4111129,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.434},"max":{"1min":1.02,"5min":1.1000000000000001,"15min":3.278},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.52000000000000002},"max":{"1min":1.0740000000000001,"5min":1.7709999999999999,"15min":3.069},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0229999999999999,"5min":1.1910000000000001,"15min":2.9380000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56000000000000005},"max":{"1min":1.089,"5min":2.8460000000000001,"15min":3.3519999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.64300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.137,"5min":2.7189999999999999,"15min":3.0299999999999998},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89200000000000002,"15min":0.86899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.1160000000000001,"5min":1.254,"15min":3.3199999999999998},"last":0.879}]},{"osd":3,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.89100000000000001},"min":{"1min":0.73899999999999999,"5min":0.63500000000000001,"15min":0.62},"max":{"1min":1.238,"5min":3.0019999999999998,"15min":3.008},"last":0.629},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92600000000000005,"15min":0.90900000000000003},"min":{"1min":0.65800000000000003,"5min":0.64500000000000002,"15min":0.63700000000000001},"max":{"1min":1.1020000000000001,"5min":2.8959999999999999,"15min":3.1150000000000002},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.1719999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.56100000000000005},"max":{"1min":1.21,"5min":1.365,"15min":1.365},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.66400000000000003,"5min":0.58699999999999997,"15min":0.46500000000000002},"max":{"1min":1.071,"5min":1.167,"15min":1.2589999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0149999999999999,"15min":0.999},"min":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.385,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.099}]}]},{"osd":5,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806057,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.44500000000000001},"max":{"1min":0.95299999999999996,"5min":1.087,"15min":1.2130000000000001},"last":1.218},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.57399999999999995},"max":{"1min":1.1100000000000001,"5min":1.2030000000000001,"15min":1.2050000000000001},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.86599999999999999},"min":{"1min":0.61299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.014,"5min":1.117,"15min":1.1910000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.63200000000000001,"5min":0.60999999999999999,"15min":0.47599999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.258},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.0369999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.1819999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61399999999999999},"max":{"1min":1.1279999999999999,"5min":1.194,"15min":1.194},"last":1.091},{"interface":"front","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71399999999999997,"5min":0.64600000000000002,"15min":0.59699999999999998},"max":{"1min":1.1040000000000001,"5min":1.139,"15min":1.2470000000000001},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79700000000000004,"15min":0.78800000000000003},"min":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1870000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.90000000000000002},"min":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.46800000000000003},"max":{"1min":1.2170000000000001,"5min":1.236,"15min":1.3},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.0669999999999999,"5min":1.2070000000000001,"15min":1.3169999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91200000000000003,"15min":0.91000000000000003},"min":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.56399999999999995},"max":{"1min":1.1579999999999999,"5min":1.27,"15min":1.274},"last":1.252}]},{"osd":7,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.99199999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.4730000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.0309999999999999,"15min":1.026},"min":{"1min":0.84499999999999997,"5min":0.67000000000000004,"15min":0.57599999999999996},"max":{"1min":1.1579999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.03}]}]},{"osd":4,"up_from":13,"seq":55834575518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797992,"kb_used_data":92901388,"kb_used_omap":3545,"kb_used_meta":0,"kb_avail":92901388,"statfs":{"total":95948165120,"available":95131021312,"internally_reserved":0,"allocated":95131021312,"data_stored":95131021312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3630274,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.80000000000000004,"15min":0.78800000000000003},"min":{"1min":0.61499999999999999,"5min":0.53200000000000003,"15min":0.46700000000000003},"max":{"1min":1.091,"5min":1.139,"15min":1.147},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.96699999999999997,"5min":1.2869999999999999,"15min":1.3540000000000001},"last":1.052}]},{"osd":1,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.60199999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93799999999999994,"5min":1.21,"15min":1.381},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81799999999999995},"min":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.53200000000000003},"max":{"1min":1.0469999999999999,"5min":1.0860000000000001,"15min":1.2789999999999999},"last":0.98399999999999999}]},{"osd":2,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.70999999999999996,"5min":0.60399999999999998,"15min":0.59999999999999998},"max":{"1min":0.99099999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84899999999999998,"15min":0.86299999999999999},"min":{"1min":0.65200000000000002,"5min":0.61599999999999999,"15min":0.56599999999999995},"max":{"1min":0.97399999999999998,"5min":1.351,"15min":1.351},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.63500000000000001,"5min":0.61499999999999999,"15min":0.56599999999999995},"max":{"1min":1.056,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.95299999999999996},"min":{"1min":0.80300000000000005,"5min":0.74399999999999999,"15min":0.62},"max":{"1min":1.171,"5min":1.393,"15min":1.393},"last":1.022}]},{"osd":5,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.71499999999999997,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.127,"5min":1.1799999999999999,"15min":1.24},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.90400000000000003,"15min":0.874},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.51500000000000001},"max":{"1min":1.056,"5min":1.198,"15min":1.2350000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":0.85299999999999998},"min":{"1min":0.61399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1579999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.92900000000000005,"15min":0.91200000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.202,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Oct 21 00:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91700000000000004,"15min":0.88700000000000001},"min":{"1min":0.63600000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3129999999999999,"5min":1.415,"15min":1.415},"last":0.871},{"interface":"front","average":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0349999999999999},"min":{"1min":0.66700000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.339,"5min":1.454,"15min":1.5069999999999999},"last":1.0920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3364,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3444746,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.442},"max":{"1min":1.0860000000000001,"5min":1.095,"15min":1.095},"last":1.355}]},{"osd":1,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.379},"max":{"1min":0.89700000000000002,"5min":0.91900000000000004,"15min":1.0609999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.496},"max":{"1min":0.89500000000000002,"5min":1.0129999999999999,"15min":1.028},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":0.97699999999999998,"5min":1.115,"15min":1.129},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.117},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.82999999999999996},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89400000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":0.94499999999999995},"min":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.1419999999999999,"5min":1.222,"15min":1.2789999999999999},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1799999999999999,"5min":1.351,"15min":1.351},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.72099999999999997,"5min":0.69799999999999995,"15min":0.67500000000000004},"max":{"1min":1.1519999999999999,"5min":1.296,"15min":1.399},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":0.95899999999999996},"min":{"1min":0.72699999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1040000000000001,"5min":1.421,"15min":1.421},"last":1.514}]},{"osd":7,"last update":"Thu Oct 21 00:57:28 2021","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.78600000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.226,"5min":1.518,"15min":1.518},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.82299999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.53},"last":1.115}]}]},{"osd":2,"up_from":13,"seq":55834575516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2833,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2901293,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.117},"last":0.496},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70499999999999996,"15min":0.67800000000000005},"min":{"1min":0.53600000000000003,"5min":0.47799999999999998,"15min":0.41599999999999998},"max":{"1min":1.0780000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.57399999999999995},"max":{"1min":0.94299999999999995,"5min":1.228,"15min":1.228},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":1.1519999999999999,"15min":1.1539999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.071,"15min":1.1399999999999999},"last":0.873}]},{"osd":4,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.81699999999999995,"5min":0.71299999999999997,"15min":0.63900000000000001},"max":{"1min":1.0109999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.74299999999999999,"5min":0.63300000000000001,"15min":0.624},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.67000000000000004},"max":{"1min":1.1830000000000001,"5min":1.2989999999999999,"15min":1.373},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.753,"5min":0.69299999999999995,"15min":0.67100000000000004},"max":{"1min":1.2390000000000001,"5min":1.3700000000000001,"15min":1.4299999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.85899999999999999,"5min":0.66800000000000004,"15min":0.66700000000000004},"max":{"1min":1.117,"5min":1.198,"15min":1.4179999999999999},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.98799999999999999,"15min":0.98899999999999999},"min":{"1min":0.86699999999999999,"5min":0.66500000000000004,"15min":0.65900000000000003},"max":{"1min":1.236,"5min":1.2549999999999999,"15min":1.5549999999999999},"last":1.107},{"interface":"front","average":{"1min":1.04,"5min":1.0309999999999999,"15min":1.028},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.69799999999999995},"max":{"1min":1.302,"5min":1.4279999999999999,"15min":1.595},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834575516,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3954,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4049883,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.026,"15min":1.0620000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.7230000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.436},"max":{"1min":1.133,"5min":1.133,"15min":1.181},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.72099999999999997,"15min":0.71199999999999997},"min":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.57499999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77300000000000002,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48099999999999998},"max":{"1min":0.99399999999999999,"5min":1.0589999999999999,"15min":1.0700000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89000000000000001,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.262},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.71199999999999997,"5min":0.67400000000000004,"15min":0.63500000000000001},"max":{"1min":1.2629999999999999,"5min":1.347,"15min":1.347},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98899999999999999,"15min":0.97199999999999998},"min":{"1min":0.747,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6200000000000001},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.96699999999999997},"min":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.67200000000000004},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.70599999999999996},"max":{"1min":1.3069999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.036,"15min":1.0289999999999999},"min":{"1min":0.83299999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6850000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.0649999999999999,"15min":1.04},"min":{"1min":0.81599999999999995,"5min":0.749,"15min":0.71199999999999997},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3781,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3871899,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":1.028,"5min":1.304,"15min":1.304},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":1.0409999999999999,"15min":1.272},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.49099999999999999},"max":{"1min":1.2230000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.755,"15min":0.748},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.089,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88200000000000001,"15min":0.877},"min":{"1min":0.72899999999999998,"5min":0.67500000000000004,"15min":0.65700000000000003},"max":{"1min":1.3759999999999999,"5min":1.5,"15min":1.5},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.79400000000000004,"5min":0.63300000000000001,"15min":0.58299999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88600000000000001,"15min":0.89000000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.61499999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96799999999999997,"15min":0.95799999999999996},"min":{"1min":0.79300000000000004,"5min":0.746,"15min":0.67600000000000005},"max":{"1min":1.4910000000000001,"5min":1.587,"15min":1.587},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0249999999999999,"15min":1.0069999999999999},"min":{"1min":0.81100000000000005,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.607,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.107},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.96599999999999997,"15min":0.96899999999999997},"min":{"1min":0.81299999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.81299999999999994,"5min":0.74299999999999999,"15min":0.69399999999999995},"max":{"1min":1.617,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.123,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.71799999999999997},"max":{"1min":1.661,"5min":1.722,"15min":1.722},"last":1.151}]}]}]}} 2021-10-21T00:58:24.894 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-10-21T00:02:44.356620+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=44, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.894 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.895 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.896 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.896 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.897 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.898 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.899 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.899 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-10-21T00:02:53.419217+0000 time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=294, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=10, tm_mday=21, tm_hour=0, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=294, tm_isdst=0) 2021-10-21T00:58:24.900 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-10-21T00:58:41.138 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:41.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:41.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:41.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:41.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:44.901 DEBUG:teuthology.orchestra.run.smithi041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-10-21T00:58:45.012 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.006+0000 7f4860dcf700 1 Processor -- start 2021-10-21T00:58:45.013 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.006+0000 7f4860dcf700 1 -- start start 2021-10-21T00:58:45.015 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.006+0000 7f4860dcf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c05bfe0 0x7f485c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f485c05c6b0 0x7f485c141930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c05c3c0 con 0x7f485c067a00 2021-10-21T00:58:45.016 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0b1920 con 0x7f485c05c6b0 2021-10-21T00:58:45.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0b27a0 con 0x7f485c05bfe0 2021-10-21T00:58:45.017 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f485c05c6b0 0x7f485c141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7f485c05c6b0 0x7f485c141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39512/0 (socket says 172.21.15.41:39512) 2021-10-21T00:58:45.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 -- 172.21.15.41:0/58811770 learned_addr learned my addr 172.21.15.41:0/58811770 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:45.018 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485b7fe700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c05bfe0 0x7f485c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485affd700 1 --1- 172.21.15.41:0/58811770 >> v1:172.21.15.62:6789/0 conn(0x7f485c067a00 0x7f485c1466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.41:45336/0 (socket says 172.21.15.41:45336) 2021-10-21T00:58:45.019 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 -- 172.21.15.41:0/58811770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c05bfe0 msgr2=0x7f485c1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:45.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c05bfe0 0x7f485c1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 -- 172.21.15.41:0/58811770 >> v1:172.21.15.62:6789/0 conn(0x7f485c067a00 legacy=0x7f485c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.020 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 -- 172.21.15.41:0/58811770 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0b2a40 con 0x7f485c05c6b0 2021-10-21T00:58:45.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485bfff700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05c6b0 0x7f485c141930 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f484c002f70 tx=0x7f484c006eb0).ready entity=mon.0 client_cookie=dc55463f539e0af server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485a7fc700 1 -- 172.21.15.41:0/58811770 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f484c00d5c0 con 0x7f485c05c6b0 2021-10-21T00:58:45.021 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485a7fc700 1 -- 172.21.15.41:0/58811770 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c000e90 con 0x7f485c05c6b0 2021-10-21T00:58:45.022 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f485a7fc700 1 -- 172.21.15.41:0/58811770 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f484c00d950 con 0x7f485c05c6b0 2021-10-21T00:58:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- 172.21.15.41:0/58811770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05c6b0 msgr2=0x7f485c141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05c6b0 0x7f485c141930 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f484c002f70 tx=0x7f484c006eb0).stop 2021-10-21T00:58:45.026 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- 172.21.15.41:0/58811770 shutdown_connections 2021-10-21T00:58:45.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05c6b0 0x7f485c141930 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 --2- 172.21.15.41:0/58811770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c05bfe0 0x7f485c1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.027 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- 172.21.15.41:0/58811770 >> 172.21.15.41:0/58811770 conn(0x7f485c0637b0 msgr2=0x7f485c063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:45.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- 172.21.15.41:0/58811770 shutdown_connections 2021-10-21T00:58:45.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.010+0000 7f4860dcf700 1 -- 172.21.15.41:0/58811770 wait complete. 2021-10-21T00:58:45.028 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 Processor -- start 2021-10-21T00:58:45.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- start start 2021-10-21T00:58:45.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.029 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 0x7f485c144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c067a00 0x7f485c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c13f5e0 con 0x7f485c05bfe0 2021-10-21T00:58:45.030 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c151c40 con 0x7f485c05c6b0 2021-10-21T00:58:45.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c156160 con 0x7f485c067a00 2021-10-21T00:58:45.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.031 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39514/0 (socket says 172.21.15.41:39514) 2021-10-21T00:58:45.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 -- 172.21.15.41:0/4098471575 learned_addr learned my addr 172.21.15.41:0/4098471575 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:45.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485affd700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 0x7f485c144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.032 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485bfff700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c067a00 0x7f485c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 -- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c067a00 msgr2=0x7f485c0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c067a00 0x7f485c0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.033 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 -- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 msgr2=0x7f485c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 0x7f485c144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 -- 172.21.15.41:0/4098471575 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c00b1e0 con 0x7f485c05bfe0 2021-10-21T00:58:45.034 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485affd700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 0x7f485c144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:45.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f485b7fe700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f48540032b0 tx=0x7f4854008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4854013620 con 0x7f485c05bfe0 2021-10-21T00:58:45.035 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854013780 con 0x7f485c05bfe0 2021-10-21T00:58:45.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c155c20 con 0x7f485c05bfe0 2021-10-21T00:58:45.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4854013ae0 con 0x7f485c05bfe0 2021-10-21T00:58:45.036 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.014+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c0af0a0 con 0x7f485c05bfe0 2021-10-21T00:58:45.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0b11e0 con 0x7f485c05bfe0 2021-10-21T00:58:45.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4854013c40 con 0x7f485c05bfe0 2021-10-21T00:58:45.037 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f4858ff9700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 0x7f483c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f485406ba50 con 0x7f485c05bfe0 2021-10-21T00:58:45.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f485affd700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 0x7f483c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.038 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.018+0000 7f485affd700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 0x7f483c055a70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f485000d000 tx=0x7f4850007b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.039 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.026+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4854042e90 con 0x7f485c05bfe0 2021-10-21T00:58:45.149 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.142+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 --> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f485c057350 con 0x7f483c0535b0 2021-10-21T00:58:45.157 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.150+0000 7f4858ff9700 1 -- 172.21.15.41:0/4098471575 <== mgr.4107 v2:172.21.15.62:6800/14449 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67989 (secure 0 0 0) 0x7f485c057350 con 0x7f483c0535b0 2021-10-21T00:58:45.158 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-10-21T00:58:45.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 msgr2=0x7f483c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 0x7f483c055a70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f485000d000 tx=0x7f4850007b80).stop 2021-10-21T00:58:45.160 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 msgr2=0x7f485c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f48540032b0 tx=0x7f4854008040).stop 2021-10-21T00:58:45.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 shutdown_connections 2021-10-21T00:58:45.161 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7f483c0535b0 0x7f483c055a70 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c067a00 0x7f485c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.162 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c05c6b0 0x7f485c144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 --2- 172.21.15.41:0/4098471575 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7f485c05bfe0 0x7f485c0ae7f0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.163 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 >> 172.21.15.41:0/4098471575 conn(0x7f485c0637b0 msgr2=0x7f485c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:45.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 shutdown_connections 2021-10-21T00:58:45.164 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.154+0000 7f4860dcf700 1 -- 172.21.15.41:0/4098471575 wait complete. 2021-10-21T00:58:45.165 INFO:teuthology.orchestra.run.smithi041.stderr:dumped all 2021-10-21T00:58:45.171 INFO:teuthology.orchestra.run.smithi041.stdout:{"pg_ready":true,"pg_map":{"version":1821,"stamp":"2021-10-21T00:58:43.236536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9688,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6384832,"kb_used_data":743210208,"kb_used_omap":27908,"kb_used_meta":0,"kb_avail":743210208,"statfs":{"total":767585320960,"available":761047252992,"internally_reserved":0,"allocated":761047252992,"data_stored":761047252992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28577828,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003375"},"pg_stats":[{"pgid":"1.0","version":"148'4","reported_seq":142,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:24.788826+0000","last_change":"2021-10-21T00:58:24.788912+0000","last_active":"2021-10-21T00:58:24.788826+0000","last_peered":"2021-10-21T00:58:24.788826+0000","last_clean":"2021-10-21T00:58:24.788826+0000","last_became_active":"2021-10-21T00:02:48.920214+0000","last_became_peered":"2021-10-21T00:02:48.920214+0000","last_unstale":"2021-10-21T00:58:24.788826+0000","last_undegraded":"2021-10-21T00:58:24.788826+0000","last_fullsized":"2021-10-21T00:58:24.788826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'4","last_scrub_stamp":"2021-10-21T00:58:24.788825+0000","last_deep_scrub":"148'4","last_deep_scrub_stamp":"2021-10-21T00:58:24.788825+0000","last_clean_scrub_stamp":"2021-10-21T00:58:24.788825+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9688,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:25.149603+0000","last_change":"2021-10-21T00:58:25.149682+0000","last_active":"2021-10-21T00:58:25.149603+0000","last_peered":"2021-10-21T00:58:25.149603+0000","last_clean":"2021-10-21T00:58:25.149603+0000","last_became_active":"2021-10-21T00:02:54.442653+0000","last_became_peered":"2021-10-21T00:02:54.442653+0000","last_unstale":"2021-10-21T00:58:25.149603+0000","last_undegraded":"2021-10-21T00:58:25.149603+0000","last_fullsized":"2021-10-21T00:58:25.149603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:25.149603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:25.149603+0000","last_clean_scrub_stamp":"2021-10-21T00:58:25.149603+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:29.834701+0000","last_change":"2021-10-21T00:58:29.834808+0000","last_active":"2021-10-21T00:58:29.834701+0000","last_peered":"2021-10-21T00:58:29.834701+0000","last_clean":"2021-10-21T00:58:29.834701+0000","last_became_active":"2021-10-21T00:02:54.442888+0000","last_became_peered":"2021-10-21T00:02:54.442888+0000","last_unstale":"2021-10-21T00:58:29.834701+0000","last_undegraded":"2021-10-21T00:58:29.834701+0000","last_fullsized":"2021-10-21T00:58:29.834701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:29.834700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:29.834700+0000","last_clean_scrub_stamp":"2021-10-21T00:58:29.834700+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:24.181460+0000","last_change":"2021-10-21T00:58:24.181549+0000","last_active":"2021-10-21T00:58:24.181460+0000","last_peered":"2021-10-21T00:58:24.181460+0000","last_clean":"2021-10-21T00:58:24.181460+0000","last_became_active":"2021-10-21T00:02:55.009083+0000","last_became_peered":"2021-10-21T00:02:55.009083+0000","last_unstale":"2021-10-21T00:58:24.181460+0000","last_undegraded":"2021-10-21T00:58:24.181460+0000","last_fullsized":"2021-10-21T00:58:24.181460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:24.181460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:24.181460+0000","last_clean_scrub_stamp":"2021-10-21T00:58:24.181460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:24.188678+0000","last_change":"2021-10-21T00:58:24.188782+0000","last_active":"2021-10-21T00:58:24.188678+0000","last_peered":"2021-10-21T00:58:24.188678+0000","last_clean":"2021-10-21T00:58:24.188678+0000","last_became_active":"2021-10-21T00:02:54.443329+0000","last_became_peered":"2021-10-21T00:02:54.443329+0000","last_unstale":"2021-10-21T00:58:24.188678+0000","last_undegraded":"2021-10-21T00:58:24.188678+0000","last_fullsized":"2021-10-21T00:58:24.188678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:24.188677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:24.188677+0000","last_clean_scrub_stamp":"2021-10-21T00:58:24.188677+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:24.950970+0000","last_change":"2021-10-21T00:58:24.951069+0000","last_active":"2021-10-21T00:58:24.950970+0000","last_peered":"2021-10-21T00:58:24.950970+0000","last_clean":"2021-10-21T00:58:24.950970+0000","last_became_active":"2021-10-21T00:02:55.001733+0000","last_became_peered":"2021-10-21T00:02:55.001733+0000","last_unstale":"2021-10-21T00:58:24.950970+0000","last_undegraded":"2021-10-21T00:58:24.950970+0000","last_fullsized":"2021-10-21T00:58:24.950970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:24.950969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:24.950969+0000","last_clean_scrub_stamp":"2021-10-21T00:58:24.950969+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:34.875231+0000","last_change":"2021-10-21T00:58:34.875329+0000","last_active":"2021-10-21T00:58:34.875231+0000","last_peered":"2021-10-21T00:58:34.875231+0000","last_clean":"2021-10-21T00:58:34.875231+0000","last_became_active":"2021-10-21T00:02:55.003018+0000","last_became_peered":"2021-10-21T00:02:55.003018+0000","last_unstale":"2021-10-21T00:58:34.875231+0000","last_undegraded":"2021-10-21T00:58:34.875231+0000","last_fullsized":"2021-10-21T00:58:34.875231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:34.875231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:34.875231+0000","last_clean_scrub_stamp":"2021-10-21T00:58:34.875231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:25.949811+0000","last_change":"2021-10-21T00:58:25.949909+0000","last_active":"2021-10-21T00:58:25.949811+0000","last_peered":"2021-10-21T00:58:25.949811+0000","last_clean":"2021-10-21T00:58:25.949811+0000","last_became_active":"2021-10-21T00:02:54.443600+0000","last_became_peered":"2021-10-21T00:02:54.443600+0000","last_unstale":"2021-10-21T00:58:25.949811+0000","last_undegraded":"2021-10-21T00:58:25.949811+0000","last_fullsized":"2021-10-21T00:58:25.949811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:25.949810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:25.949810+0000","last_clean_scrub_stamp":"2021-10-21T00:58:25.949810+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":148,"state":"active+clean","last_fresh":"2021-10-21T00:58:25.064865+0000","last_change":"2021-10-21T00:58:25.064956+0000","last_active":"2021-10-21T00:58:25.064865+0000","last_peered":"2021-10-21T00:58:25.064865+0000","last_clean":"2021-10-21T00:58:25.064865+0000","last_became_active":"2021-10-21T00:02:54.441301+0000","last_became_peered":"2021-10-21T00:02:54.441301+0000","last_unstale":"2021-10-21T00:58:25.064865+0000","last_undegraded":"2021-10-21T00:58:25.064865+0000","last_fullsized":"2021-10-21T00:58:25.064865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-10-21T00:58:25.064864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-10-21T00:58:25.064864+0000","last_clean_scrub_stamp":"2021-10-21T00:58:25.064864+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9688,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3656,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3744163,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83099999999999996,"15min":0.81899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.173,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.1459999999999999,"15min":1.198},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.56299999999999994},"max":{"1min":1.153,"5min":1.1699999999999999,"15min":1.2310000000000001},"last":0.85399999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.57999999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.3300000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.86699999999999999,"15min":0.88},"min":{"1min":0.623,"5min":0.60699999999999998,"15min":0.58999999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.466},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.90500000000000003},"min":{"1min":0.64800000000000002,"5min":0.621,"15min":0.58199999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92000000000000004,"15min":0.90200000000000002},"min":{"1min":0.70599999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.268,"5min":1.3660000000000001,"15min":1.6299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57499999999999996},"max":{"1min":1.2430000000000001,"5min":1.2809999999999999,"15min":1.393},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85199999999999998,"15min":0.83199999999999996},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.51900000000000002},"max":{"1min":1.165,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.59699999999999998},"max":{"1min":1.2729999999999999,"5min":1.4590000000000001,"15min":1.7050000000000001},"last":0.99399999999999999}]},{"osd":6,"last update":"Thu Oct 21 00:58:24 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.93200000000000005,"15min":0.91400000000000003},"min":{"1min":0.70999999999999996,"5min":0.59099999999999997,"15min":0.57099999999999995},"max":{"1min":1.1579999999999999,"5min":1.605,"15min":1.605},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.0469999999999999,"15min":1.0409999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.78},"last":0.95499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575521,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":4017,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4113514,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.434},"max":{"1min":1.02,"5min":1.1000000000000001,"15min":3.278},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.52000000000000002},"max":{"1min":1.0740000000000001,"5min":1.7709999999999999,"15min":3.069},"last":0.82599999999999996}]},{"osd":1,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0229999999999999,"5min":1.1910000000000001,"15min":2.9380000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56000000000000005},"max":{"1min":1.089,"5min":2.8460000000000001,"15min":3.3519999999999999},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.64300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.137,"5min":2.7189999999999999,"15min":3.0299999999999998},"last":1.002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89200000000000002,"15min":0.86899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.1160000000000001,"5min":1.254,"15min":3.3199999999999998},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.89100000000000001},"min":{"1min":0.73899999999999999,"5min":0.63500000000000001,"15min":0.62},"max":{"1min":1.238,"5min":3.0019999999999998,"15min":3.008},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92600000000000005,"15min":0.90900000000000003},"min":{"1min":0.65800000000000003,"5min":0.64500000000000002,"15min":0.63700000000000001},"max":{"1min":1.1020000000000001,"5min":2.8959999999999999,"15min":3.1150000000000002},"last":0.875}]},{"osd":4,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.1719999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.024}]},{"osd":5,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.621,"5min":0.58299999999999996,"15min":0.56100000000000005},"max":{"1min":1.21,"5min":1.365,"15min":1.365},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.66400000000000003,"5min":0.58699999999999997,"15min":0.46500000000000002},"max":{"1min":1.071,"5min":1.167,"15min":1.2589999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:57:39 2021","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":0.96099999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.0149999999999999,"15min":0.999},"min":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.62},"max":{"1min":1.385,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.92000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575521,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2742,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2808319,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.60899999999999999,"5min":0.54800000000000004,"15min":0.44500000000000001},"max":{"1min":0.95299999999999996,"5min":1.087,"15min":1.2130000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.57399999999999995},"max":{"1min":1.1100000000000001,"5min":1.2030000000000001,"15min":1.2050000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.86599999999999999},"min":{"1min":0.61299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.82499999999999996},"min":{"1min":0.63,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.014,"5min":1.117,"15min":1.1910000000000001},"last":0.624}]},{"osd":2,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.63200000000000001,"5min":0.60999999999999999,"15min":0.47599999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.629,"5min":0.57799999999999996,"15min":0.54500000000000004},"max":{"1min":1.0369999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.87},"min":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61399999999999999},"max":{"1min":1.1279999999999999,"5min":1.194,"15min":1.194},"last":1.155},{"interface":"front","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71399999999999997,"5min":0.64600000000000002,"15min":0.59699999999999998},"max":{"1min":1.1040000000000001,"5min":1.139,"15min":1.2470000000000001},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79700000000000004,"15min":0.78800000000000003},"min":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1799999999999999,"15min":1.1870000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.90000000000000002},"min":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.46800000000000003},"max":{"1min":1.2170000000000001,"5min":1.236,"15min":1.3},"last":1.1990000000000001}]},{"osd":6,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.0669999999999999,"5min":1.2070000000000001,"15min":1.3169999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91200000000000003,"15min":0.91000000000000003},"min":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.56399999999999995},"max":{"1min":1.1579999999999999,"5min":1.27,"15min":1.274},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Oct 21 00:57:45 2021","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.99199999999999999,"15min":0.98599999999999999},"min":{"1min":0.68700000000000006,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.4730000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.24},{"interface":"front","average":{"1min":1.038,"5min":1.0309999999999999,"15min":1.026},"min":{"1min":0.84499999999999997,"5min":0.67000000000000004,"15min":0.57599999999999996},"max":{"1min":1.1579999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.099}]}]},{"osd":4,"up_from":13,"seq":55834575522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797992,"kb_used_data":92901388,"kb_used_omap":3545,"kb_used_meta":0,"kb_avail":92901388,"statfs":{"total":95948165120,"available":95131021312,"internally_reserved":0,"allocated":95131021312,"data_stored":95131021312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3630274,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.091,"15min":1.147},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0840000000000001,"5min":1.2869999999999999,"15min":1.3540000000000001},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0660000000000001,"5min":1.21,"15min":1.381},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.53200000000000003},"max":{"1min":1.0469999999999999,"5min":1.0860000000000001,"15min":1.2789999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.85499999999999998,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2070000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"max":{"1min":1.0469999999999999,"5min":1.351,"15min":1.351},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82599999999999996,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56599999999999995},"max":{"1min":1.1259999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.748},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.97599999999999998,"15min":0.95299999999999996},"min":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.62},"max":{"1min":1.141,"5min":1.393,"15min":1.393},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.86399999999999999},"min":{"1min":0.72299999999999998,"5min":0.52600000000000002,"15min":0.51600000000000001},"max":{"1min":1.1180000000000001,"5min":1.1799999999999999,"15min":1.24},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.90400000000000003,"15min":0.874},"min":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.51500000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2350000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88800000000000001,"15min":0.85599999999999998},"min":{"1min":0.60599999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.266,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":0.91300000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1160000000000001,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.62}]},{"osd":7,"last update":"Thu Oct 21 00:58:38 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.91600000000000004,"15min":0.88900000000000001},"min":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.58199999999999996},"max":{"1min":1.1759999999999999,"5min":1.415,"15min":1.415},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0580000000000001,"15min":1.034},"min":{"1min":0.63600000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.321,"5min":1.454,"15min":1.5069999999999999},"last":1.0269999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3365,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3445975,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.028},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.442},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.49199999999999999,"5min":0.44800000000000001,"15min":0.379},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.95799999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.028},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.60199999999999998,"5min":0.53300000000000003,"15min":0.53200000000000003},"max":{"1min":0.95799999999999996,"5min":1.115,"15min":1.129},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.51400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0580000000000001,"15min":1.117},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.54800000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89400000000000002,"15min":0.90100000000000002},"min":{"1min":0.69299999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.169,"5min":1.218,"15min":1.218},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.80400000000000005,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.0880000000000001,"5min":1.222,"15min":1.2789999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96099999999999997,"15min":0.97699999999999998},"min":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.105,"5min":1.351,"15min":1.351},"last":1.004}]},{"osd":6,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95799999999999996,"15min":0.97499999999999998},"min":{"1min":0.86699999999999999,"5min":0.69799999999999995,"15min":0.67500000000000004},"max":{"1min":1.1759999999999999,"5min":1.296,"15min":1.399},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96299999999999997,"15min":0.95999999999999996},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:58:28 2021","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.78000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.0189999999999999,"15min":1.02},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"max":{"1min":1.24,"5min":1.4399999999999999,"15min":1.53},"last":0.90400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575520,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":2835,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2903678,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.40500000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.117},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70499999999999996,"15min":0.67800000000000005},"min":{"1min":0.53600000000000003,"5min":0.47799999999999998,"15min":0.41599999999999998},"max":{"1min":1.0780000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86899999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.57399999999999995},"max":{"1min":0.94299999999999995,"5min":1.228,"15min":1.228},"last":0.621}]},{"osd":3,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":1.1519999999999999,"15min":1.1539999999999999},"last":0.995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.53300000000000003},"max":{"1min":0.98699999999999999,"5min":1.071,"15min":1.1399999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.81699999999999995,"5min":0.71299999999999997,"15min":0.63900000000000001},"max":{"1min":1.0109999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.64600000000000002,"5min":0.60199999999999998,"15min":0.58899999999999997},"max":{"1min":1.133,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.74299999999999999,"5min":0.63300000000000001,"15min":0.624},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.67000000000000004},"max":{"1min":1.1830000000000001,"5min":1.2989999999999999,"15min":1.373},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.753,"5min":0.69299999999999995,"15min":0.67100000000000004},"max":{"1min":1.2390000000000001,"5min":1.3700000000000001,"15min":1.4299999999999999},"last":0.879},{"interface":"front","average":{"1min":1.002,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.85899999999999999,"5min":0.66800000000000004,"15min":0.66700000000000004},"max":{"1min":1.117,"5min":1.198,"15min":1.4179999999999999},"last":1.127}]},{"osd":7,"last update":"Thu Oct 21 00:57:40 2021","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.98799999999999999,"15min":0.98899999999999999},"min":{"1min":0.86699999999999999,"5min":0.66500000000000004,"15min":0.65900000000000003},"max":{"1min":1.236,"5min":1.2549999999999999,"15min":1.5549999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.0309999999999999,"15min":1.028},"min":{"1min":0.82499999999999996,"5min":0.71699999999999997,"15min":0.69799999999999995},"max":{"1min":1.302,"5min":1.4279999999999999,"15min":1.595},"last":1.091}]}]},{"osd":1,"up_from":13,"seq":55834575520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3959,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4054553,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.026,"15min":1.0620000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.47699999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.7230000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.436},"max":{"1min":1.133,"5min":1.133,"15min":1.181},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.72099999999999997,"15min":0.71199999999999997},"min":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.57499999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.381},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77300000000000002,"15min":0.76100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.48099999999999998},"max":{"1min":0.99399999999999999,"5min":1.0589999999999999,"15min":1.0700000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89000000000000001,"15min":0.871},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86699999999999999,"15min":0.871},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.256,"5min":1.256,"15min":1.262},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.71199999999999997,"5min":0.67400000000000004,"15min":0.63500000000000001},"max":{"1min":1.2629999999999999,"5min":1.347,"15min":1.347},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98899999999999999,"15min":0.97199999999999998},"min":{"1min":0.747,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6200000000000001},"last":0.879}]},{"osd":6,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.96699999999999997},"min":{"1min":0.71599999999999997,"5min":0.70299999999999996,"15min":0.67200000000000004},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.022},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.76600000000000001,"5min":0.70799999999999996,"15min":0.70599999999999996},"max":{"1min":1.3069999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:58:13 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.036,"15min":1.0289999999999999},"min":{"1min":0.83299999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6850000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.0649999999999999,"15min":1.04},"min":{"1min":0.81599999999999995,"5min":0.749,"15min":0.71199999999999997},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1659999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575520,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92901260,"kb_used_omap":3786,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":0,"allocated":95130890240,"data_stored":95130890240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3877352,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":1.028,"5min":1.304,"15min":1.304},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65800000000000003,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":1.0409999999999999,"15min":1.272},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.49099999999999999},"max":{"1min":1.2230000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.755,"15min":0.748},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.089,"5min":1.2,"15min":1.2},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88200000000000001,"15min":0.877},"min":{"1min":0.72899999999999998,"5min":0.67500000000000004,"15min":0.65700000000000003},"max":{"1min":1.3759999999999999,"5min":1.5,"15min":1.5},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.014,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.79400000000000004,"5min":0.63300000000000001,"15min":0.58299999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88600000000000001,"15min":0.89000000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.61499999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96799999999999997,"15min":0.95799999999999996},"min":{"1min":0.79300000000000004,"5min":0.746,"15min":0.67600000000000005},"max":{"1min":1.4910000000000001,"5min":1.587,"15min":1.587},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0249999999999999,"15min":1.0069999999999999},"min":{"1min":0.81100000000000005,"5min":0.70499999999999996,"15min":0.69399999999999995},"max":{"1min":1.607,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.96599999999999997,"15min":0.96899999999999997},"min":{"1min":0.81299999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 21 00:57:42 2021","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.81299999999999994,"5min":0.74299999999999999,"15min":0.69399999999999995},"max":{"1min":1.617,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.81000000000000005,"5min":0.73199999999999998,"15min":0.71799999999999997},"max":{"1min":1.661,"5min":1.722,"15min":1.722},"last":0.76700000000000002}]}]}]}} 2021-10-21T00:58:45.175 DEBUG:teuthology.orchestra.run.smithi041:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-10-21T00:58:45.285 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 Processor -- start 2021-10-21T00:58:45.286 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 -- start start 2021-10-21T00:58:45.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc140b17e0 0x7fbc140b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.295 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc14128450 0x7fbc14128890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 0x7fbc1413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.296 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 -- --> v2:172.21.15.41:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc140ae0e0 con 0x7fbc14128450 2021-10-21T00:58:45.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc140ad850 con 0x7fbc14128d80 2021-10-21T00:58:45.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.278+0000 7fbc1af69700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140ad5b0 con 0x7fbc140b17e0 2021-10-21T00:58:45.297 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc14128450 0x7fbc14128890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1a768700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 0x7fbc1413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 --2- >> v2:172.21.15.41:3300/0 conn(0x7fbc14128450 0x7fbc14128890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39522/0 (socket says 172.21.15.41:39522) 2021-10-21T00:58:45.298 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 -- 172.21.15.41:0/1947483130 learned_addr learned my addr 172.21.15.41:0/1947483130 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:45.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19f67700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc140b17e0 0x7fbc140b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 -- 172.21.15.41:0/1947483130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc140b17e0 msgr2=0x7fbc140b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:45.299 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc140b17e0 0x7fbc140b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 -- 172.21.15.41:0/1947483130 >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 msgr2=0x7fbc1413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-10-21T00:58:45.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 --2- 172.21.15.41:0/1947483130 >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 0x7fbc1413fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.300 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 -- 172.21.15.41:0/1947483130 --> v2:172.21.15.41:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1413f7d0 con 0x7fbc14128450 2021-10-21T00:58:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1a768700 1 --2- 172.21.15.41:0/1947483130 >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 0x7fbc1413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc19766700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc14128450 0x7fbc14128890 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fbc04002f70 tx=0x7fbc04006eb0).ready entity=mon.0 client_cookie=a17c76695e96322 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.301 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc18f65700 1 -- 172.21.15.41:0/1947483130 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0400d570 con 0x7fbc14128450 2021-10-21T00:58:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc18f65700 1 -- 172.21.15.41:0/1947483130 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04000e90 con 0x7fbc14128450 2021-10-21T00:58:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc18f65700 1 -- 172.21.15.41:0/1947483130 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc0400d900 con 0x7fbc14128450 2021-10-21T00:58:45.302 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 -- 172.21.15.41:0/1947483130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc14128450 msgr2=0x7fbc14128890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc14128450 0x7fbc14128890 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fbc04002f70 tx=0x7fbc04006eb0).stop 2021-10-21T00:58:45.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 -- 172.21.15.41:0/1947483130 shutdown_connections 2021-10-21T00:58:45.303 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc14128450 0x7fbc14128890 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 --2- 172.21.15.41:0/1947483130 >> v2:172.21.15.62:3300/0 conn(0x7fbc14128d80 0x7fbc1413fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 --2- 172.21.15.41:0/1947483130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc140b17e0 0x7fbc140b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.304 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 -- 172.21.15.41:0/1947483130 >> 172.21.15.41:0/1947483130 conn(0x7fbc140627b0 msgr2=0x7fbc14062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:45.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 -- 172.21.15.41:0/1947483130 shutdown_connections 2021-10-21T00:58:45.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.282+0000 7fbc1af69700 1 -- 172.21.15.41:0/1947483130 wait complete. 2021-10-21T00:58:45.305 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 Processor -- start 2021-10-21T00:58:45.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- start start 2021-10-21T00:58:45.306 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc14128450 0x7fbc1414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 0x7fbc14150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.307 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1411f540 con 0x7fbc140b17e0 2021-10-21T00:58:45.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14064660 con 0x7fbc1414e100 2021-10-21T00:58:45.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1411f770 con 0x7fbc14128450 2021-10-21T00:58:45.308 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1a768700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 0x7fbc14150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19766700 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc14128450 0x7fbc1414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.309 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 --2- >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.41:3300/0 says I am v2:172.21.15.41:39526/0 (socket says 172.21.15.41:39526) 2021-10-21T00:58:45.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 -- 172.21.15.41:0/2865961389 learned_addr learned my addr 172.21.15.41:0/2865961389 (peer_addr_for_me v2:172.21.15.41:0/0) 2021-10-21T00:58:45.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 -- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc14128450 msgr2=0x7fbc1414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.310 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc14128450 0x7fbc1414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 -- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 msgr2=0x7fbc14150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 0x7fbc14150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.311 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 -- 172.21.15.41:0/2865961389 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c00b710 con 0x7fbc140b17e0 2021-10-21T00:58:45.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1a768700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 0x7fbc14150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-10-21T00:58:45.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc19f67700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fbc1000c000 tx=0x7fbc10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.312 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc10010780 con 0x7fbc140b17e0 2021-10-21T00:58:45.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000b3b0 con 0x7fbc140b17e0 2021-10-21T00:58:45.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0400b1e0 con 0x7fbc140b17e0 2021-10-21T00:58:45.313 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc10010ad0 con 0x7fbc140b17e0 2021-10-21T00:58:45.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.286+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1414e590 con 0x7fbc140b17e0 2021-10-21T00:58:45.314 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 4 ==== mgrmap(e 4) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc10010c30 con 0x7fbc140b17e0 2021-10-21T00:58:45.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc02ffd700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 0x7fbbf4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-10-21T00:58:45.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc140b20b0 con 0x7fbc140b17e0 2021-10-21T00:58:45.316 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fbc1006ba60 con 0x7fbc140b17e0 2021-10-21T00:58:45.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc19766700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 0x7fbbf4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-10-21T00:58:45.317 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.290+0000 7fbc19766700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 0x7fbbf4055b00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fbc0401c000 tx=0x7fbc04015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-10-21T00:58:45.318 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.294+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc10042e00 con 0x7fbc140b17e0 2021-10-21T00:58:45.428 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.422+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 --> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbc14057350 con 0x7fbc140b17e0 2021-10-21T00:58:45.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.426+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbc10042e00 con 0x7fbc140b17e0 2021-10-21T00:58:45.434 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.426+0000 7fbc02ffd700 1 -- 172.21.15.41:0/2865961389 <== mon.0 v2:172.21.15.41:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbc10046420 con 0x7fbc140b17e0 2021-10-21T00:58:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 msgr2=0x7fbbf4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 0x7fbbf4055b00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fbc0401c000 tx=0x7fbc04015000).stop 2021-10-21T00:58:45.438 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 msgr2=0x7fbc14143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-10-21T00:58:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fbc1000c000 tx=0x7fbc10006df0).stop 2021-10-21T00:58:45.439 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 shutdown_connections 2021-10-21T00:58:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:6800/14449,v1:172.21.15.62:6801/14449] conn(0x7fbbf4053640 0x7fbbf4055b00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc1414e100 0x7fbc14150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.440 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc14128450 0x7fbc1414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 --2- 172.21.15.41:0/2865961389 >> [v2:172.21.15.41:3300/0,v1:172.21.15.41:6789/0] conn(0x7fbc140b17e0 0x7fbc14143360 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-10-21T00:58:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 >> 172.21.15.41:0/2865961389 conn(0x7fbc140627b0 msgr2=0x7fbc1413b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-10-21T00:58:45.441 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 shutdown_connections 2021-10-21T00:58:45.442 INFO:teuthology.orchestra.run.smithi041.stderr:2021-10-21T00:58:45.430+0000 7fbc1af69700 1 -- 172.21.15.41:0/2865961389 wait complete. 2021-10-21T00:58:45.450 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:58:45.454 INFO:teuthology.misc:Shutting down mds daemons... 2021-10-21T00:58:45.455 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-10-21T00:58:45.455 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.470 INFO:tasks.ceph.mds.a:Stopped 2021-10-21T00:58:45.471 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-10-21T00:58:45.472 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.486 INFO:tasks.ceph.mds.b:Stopped 2021-10-21T00:58:45.487 INFO:teuthology.misc:Shutting down osd daemons... 2021-10-21T00:58:45.487 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-10-21T00:58:45.488 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.533 INFO:tasks.ceph.osd.0:Stopped 2021-10-21T00:58:45.534 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-10-21T00:58:45.535 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.548 INFO:tasks.ceph.osd.1:Stopped 2021-10-21T00:58:45.549 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-10-21T00:58:45.550 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.567 INFO:tasks.ceph.osd.2:Stopped 2021-10-21T00:58:45.568 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-10-21T00:58:45.569 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.629 INFO:tasks.ceph.osd.3:Stopped 2021-10-21T00:58:45.630 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-10-21T00:58:45.632 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.653 INFO:tasks.ceph.osd.4:Stopped 2021-10-21T00:58:45.654 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-10-21T00:58:45.655 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.676 INFO:tasks.ceph.osd.5:Stopped 2021-10-21T00:58:45.677 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-10-21T00:58:45.678 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.696 INFO:tasks.ceph.osd.6:Stopped 2021-10-21T00:58:45.697 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-10-21T00:58:45.697 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.714 INFO:tasks.ceph.osd.7:Stopped 2021-10-21T00:58:45.717 INFO:teuthology.misc:Shutting down mgr daemons... 2021-10-21T00:58:45.718 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-10-21T00:58:45.719 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.742 INFO:tasks.ceph.mgr.y:Stopped 2021-10-21T00:58:45.743 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-10-21T00:58:45.744 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.779 INFO:tasks.ceph.mgr.x:Stopped 2021-10-21T00:58:45.780 INFO:teuthology.misc:Shutting down mon daemons... 2021-10-21T00:58:45.781 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-10-21T00:58:45.782 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.808 INFO:tasks.ceph.mon.a:Stopped 2021-10-21T00:58:45.809 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-10-21T00:58:45.811 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.832 INFO:tasks.ceph.mon.b:Stopped 2021-10-21T00:58:45.833 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-10-21T00:58:45.834 INFO:teuthology.orchestra.run:waiting for 300 2021-10-21T00:58:45.853 INFO:tasks.ceph.mon.c:Stopped 2021-10-21T00:58:45.855 INFO:tasks.ceph:Checking cluster log for badness... 2021-10-21T00:58:45.856 DEBUG:teuthology.orchestra.run.smithi041:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-10-21T00:58:45.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:58:45.881 DEBUG:teuthology.orchestra.run.smithi041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-10-21T00:58:46.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:58:46.191 DEBUG:teuthology.orchestra.run.smithi041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-10-21T00:58:46.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:58:46.514 DEBUG:teuthology.orchestra.run.smithi041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-10-21T00:58:46.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:58:46.736 DEBUG:teuthology.orchestra.run.smithi041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-10-21T00:58:47.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:58:47.081 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-10-21T00:58:47.332 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:58:47.333 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-10-21T00:58:47.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:58:47.613 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-10-21T00:58:47.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:58:47.860 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-10-21T00:58:48.078 INFO:tasks.ceph:Archiving mon data... 2021-10-21T00:58:48.080 DEBUG:teuthology.misc:Transferring archived files from smithi041:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/data/mon.a.tgz 2021-10-21T00:58:48.081 DEBUG:teuthology.orchestra.run.smithi041:> mktemp 2021-10-21T00:58:48.089 INFO:teuthology.orchestra.run.smithi041.stdout:/tmp/tmp.O691viDvZN 2021-10-21T00:58:48.090 DEBUG:teuthology.orchestra.run.smithi041:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.O691viDvZN 2021-10-21T00:58:48.296 DEBUG:teuthology.orchestra.run.smithi041:> sudo chmod 0666 /tmp/tmp.O691viDvZN 2021-10-21T00:58:48.320 DEBUG:teuthology.orchestra.remote:smithi041:/tmp/tmp.O691viDvZN is 445KB 2021-10-21T00:58:48.384 DEBUG:teuthology.orchestra.run.smithi041:> rm -fr /tmp/tmp.O691viDvZN 2021-10-21T00:58:48.392 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/data/mon.b.tgz 2021-10-21T00:58:48.392 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:58:48.400 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.YgkzevVzdS 2021-10-21T00:58:48.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YgkzevVzdS 2021-10-21T00:58:48.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.YgkzevVzdS 2021-10-21T00:58:48.633 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.YgkzevVzdS is 470KB 2021-10-21T00:58:48.698 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.YgkzevVzdS 2021-10-21T00:58:48.706 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/data/mon.c.tgz 2021-10-21T00:58:48.708 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2021-10-21T00:58:48.757 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.KqTQMjaqTI 2021-10-21T00:58:48.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.KqTQMjaqTI 2021-10-21T00:58:48.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.KqTQMjaqTI 2021-10-21T00:58:49.034 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.KqTQMjaqTI is 470KB 2021-10-21T00:58:49.106 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.KqTQMjaqTI 2021-10-21T00:58:49.115 INFO:tasks.ceph:Cleaning ceph cluster... 2021-10-21T00:58:49.116 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:58:49.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:58:49.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:58:49.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:58:49.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-10-21T00:58:49.188 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-10-21T00:58:49.189 DEBUG:teuthology.orchestra.run.smithi041:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:58:49.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:58:49.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:58:49.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:58:49.214 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:58:49.218 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:58:49.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-10-21T00:58:49.260 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:58:49.302 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:58:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-10-21T00:58:49.319 INFO:tasks.ceph:Archiving crash dumps... 2021-10-21T00:58:49.323 DEBUG:teuthology.misc:Transferring archived files from smithi041:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi041/crash 2021-10-21T00:58:49.325 DEBUG:teuthology.orchestra.run.smithi041:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:58:49.345 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi062/crash 2021-10-21T00:58:49.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:58:49.368 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi071/crash 2021-10-21T00:58:49.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:58:49.391 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi099/crash 2021-10-21T00:58:49.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:58:49.413 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi102/crash 2021-10-21T00:58:49.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-10-21T00:58:49.437 INFO:tasks.ceph:Shutting down logrotate 2021-10-21T00:58:49.438 DEBUG:teuthology.orchestra.run.smithi041:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.443 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.445 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.458 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.523 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-10-21T00:58:49.605 INFO:tasks.ceph:Compressing logs... 2021-10-21T00:58:49.606 DEBUG:teuthology.orchestra.run.smithi041:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:58:49.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:58:49.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:58:49.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:58:49.634 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:58:59.181 INFO:tasks.ceph:Archiving logs... 2021-10-21T00:58:59.182 DEBUG:teuthology.misc:Transferring archived files from smithi041:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi041/log 2021-10-21T00:58:59.183 DEBUG:teuthology.orchestra.run.smithi041:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:59:01.469 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi062/log 2021-10-21T00:59:01.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:59:02.799 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi071/log 2021-10-21T00:59:02.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:59:03.223 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi099/log 2021-10-21T00:59:03.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:59:03.258 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi102/log 2021-10-21T00:59:03.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/log/ceph -- . 2021-10-21T00:59:03.281 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-10-21T00:59:03.293 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_3fb760aae831e6138791851b7921f8f0e05db414/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-10-21T00:59:03.297 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-10-21T00:59:03.297 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:59:03.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:59:03.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:59:03.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:59:03.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-10-21T00:59:03.427 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-10-21T00:59:03.441 INFO:teuthology.task.clock:Checking final clock skew... 2021-10-21T00:59:03.442 DEBUG:teuthology.orchestra.run.smithi041:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:59:03.466 INFO:teuthology.orchestra.run.smithi041.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:59:03.467 INFO:teuthology.orchestra.run.smithi041.stdout:============================================================================== 2021-10-21T00:59:03.467 INFO:teuthology.orchestra.run.smithi041.stdout:-hv01.front.sepi 216.240.36.24 3 u 75 128 377 0.110 12.791 0.482 2021-10-21T00:59:03.467 INFO:teuthology.orchestra.run.smithi041.stdout:*hv02.front.sepi 163.237.218.18 2 u 11 128 377 0.113 1.536 0.817 2021-10-21T00:59:03.468 INFO:teuthology.orchestra.run.smithi041.stdout:+hv03.front.sepi 74.6.168.72 3 u 101 128 377 0.108 4.752 0.360 2021-10-21T00:59:03.468 INFO:teuthology.orchestra.run.smithi041.stdout:+hv04.front.sepi 96.245.170.99 3 u 88 128 377 0.102 1.761 0.697 2021-10-21T00:59:03.469 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:59:03.495 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:59:03.495 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2021-10-21T00:59:03.495 INFO:teuthology.orchestra.run.smithi062.stdout:-hv01.front.sepi 216.240.36.24 3 u 24 64 377 0.089 12.242 0.165 2021-10-21T00:59:03.496 INFO:teuthology.orchestra.run.smithi062.stdout:*hv02.front.sepi 163.237.218.18 2 u 22 64 377 0.094 0.580 0.124 2021-10-21T00:59:03.496 INFO:teuthology.orchestra.run.smithi062.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.100 4.691 0.412 2021-10-21T00:59:03.496 INFO:teuthology.orchestra.run.smithi062.stdout:+hv04.front.sepi 96.245.170.99 3 u 20 64 377 0.069 1.027 0.164 2021-10-21T00:59:03.498 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:59:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:59:03.522 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2021-10-21T00:59:03.522 INFO:teuthology.orchestra.run.smithi071.stdout:-hv01.front.sepi 216.240.36.24 3 u - 64 377 0.073 12.588 0.976 2021-10-21T00:59:03.522 INFO:teuthology.orchestra.run.smithi071.stdout:*hv02.front.sepi 163.237.218.18 2 u 9 64 377 0.108 -0.002 0.593 2021-10-21T00:59:03.523 INFO:teuthology.orchestra.run.smithi071.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.105 3.428 0.666 2021-10-21T00:59:03.523 INFO:teuthology.orchestra.run.smithi071.stdout:+hv04.front.sepi 96.245.170.99 3 u 4 64 377 0.097 0.059 0.683 2021-10-21T00:59:03.524 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:59:03.549 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:59:03.550 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2021-10-21T00:59:03.550 INFO:teuthology.orchestra.run.smithi099.stdout:-hv01.front.sepi 216.240.36.24 3 u 4 64 377 0.072 11.048 0.231 2021-10-21T00:59:03.551 INFO:teuthology.orchestra.run.smithi099.stdout:*hv02.front.sepi 163.237.218.18 2 u 58 64 377 0.077 -0.243 0.346 2021-10-21T00:59:03.551 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.080 3.247 0.102 2021-10-21T00:59:03.552 INFO:teuthology.orchestra.run.smithi099.stdout:+hv04.front.sepi 96.245.170.99 3 u 8 64 377 0.090 -0.101 0.214 2021-10-21T00:59:03.552 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-10-21T00:59:03.575 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2021-10-21T00:59:03.575 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2021-10-21T00:59:03.576 INFO:teuthology.orchestra.run.smithi102.stdout:-hv01.front.sepi 216.240.36.24 3 u 121 128 377 0.194 13.708 0.304 2021-10-21T00:59:03.576 INFO:teuthology.orchestra.run.smithi102.stdout:*hv02.front.sepi 163.237.218.18 2 u 59 128 377 0.174 2.429 0.368 2021-10-21T00:59:03.576 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 128 377 0.193 5.942 0.323 2021-10-21T00:59:03.577 INFO:teuthology.orchestra.run.smithi102.stdout:+hv04.front.sepi 96.245.170.99 3 u 16 128 377 0.189 2.299 0.237 2021-10-21T00:59:03.578 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-10-21T00:59:03.589 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-10-21T00:59:03.590 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-10-21T00:59:03.610 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-10-21T00:59:03.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-10-21T00:59:03.700 INFO:teuthology.task.internal:Duration was 3795.463291 seconds 2021-10-21T00:59:03.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-10-21T00:59:03.735 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-10-21T00:59:03.736 DEBUG:teuthology.orchestra.run.smithi041:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:59:03.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:59:03.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:59:03.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:59:03.748 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-10-21T00:59:03.798 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-10-21T00:59:03.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi041.front.sepia.ceph.com 2021-10-21T00:59:03.800 DEBUG:teuthology.orchestra.run.smithi041:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:59:03.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2021-10-21T00:59:03.814 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:59:03.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2021-10-21T00:59:03.831 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:59:03.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2021-10-21T00:59:03.845 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:59:03.861 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2021-10-21T00:59:03.861 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-10-21T00:59:03.879 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-10-21T00:59:03.880 DEBUG:teuthology.orchestra.run.smithi041:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:59:03.883 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:59:03.886 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:59:03.889 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:59:03.906 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-10-21T00:59:03.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-10-21T00:59:03.975 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-10-21T00:59:03.976 DEBUG:teuthology.orchestra.run.smithi041:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:59:03.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:59:04.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:59:04.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:59:04.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-10-21T00:59:04.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-10-21T00:59:04.080 DEBUG:teuthology.orchestra.run.smithi041:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.088 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.096 INFO:teuthology.orchestra.run.smithi041.stdout:kernel.core_pattern = core 2021-10-21T00:59:04.097 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2021-10-21T00:59:04.101 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2021-10-21T00:59:04.103 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2021-10-21T00:59:04.106 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2021-10-21T00:59:04.128 DEBUG:teuthology.orchestra.run.smithi041:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:59:04.136 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:59:04.165 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:59:04.172 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:59:04.179 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2021-10-21T00:59:04.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-10-21T00:59:04.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-10-21T00:59:04.197 INFO:teuthology.task.internal:Transferring archived files... 2021-10-21T00:59:04.198 DEBUG:teuthology.misc:Transferring archived files from smithi041:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi041 2021-10-21T00:59:04.199 DEBUG:teuthology.orchestra.run.smithi041:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:59:04.228 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi062 2021-10-21T00:59:04.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:59:04.257 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi071 2021-10-21T00:59:04.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:59:04.287 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi099 2021-10-21T00:59:04.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:59:04.316 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-10-20_18:49:58-fs-wip-yuri5-testing-2021-10-20-0922-octopus-distro-basic-smithi/6453076/remote/smithi102 2021-10-21T00:59:04.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-10-21T00:59:04.344 INFO:teuthology.task.internal:Removing archive directory... 2021-10-21T00:59:04.345 DEBUG:teuthology.orchestra.run.smithi041:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:59:04.348 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:59:04.350 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:59:04.353 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:59:04.356 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2021-10-21T00:59:04.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-10-21T00:59:04.377 INFO:teuthology.task.internal:Not uploading archives. 2021-10-21T00:59:04.378 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-10-21T00:59:04.409 INFO:teuthology.task.internal:Tidying up after the test... 2021-10-21T00:59:04.410 DEBUG:teuthology.orchestra.run.smithi041:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:59:04.413 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:59:04.416 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:59:04.419 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:59:04.420 INFO:teuthology.orchestra.run.smithi041.stdout: 655376 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:59 /home/ubuntu/cephtest 2021-10-21T00:59:04.422 INFO:teuthology.orchestra.run.smithi062.stdout: 655395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:59 /home/ubuntu/cephtest 2021-10-21T00:59:04.423 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-10-21T00:59:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: 655396 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:59 /home/ubuntu/cephtest 2021-10-21T00:59:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: 655400 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 21 00:59 /home/ubuntu/cephtest 2021-10-21T11:48:34.118 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-10-21T11:48:34.153 DEBUG:teuthology.task.console_log:Killing console logger for smithi041 2021-10-21T11:48:34.155 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2021-10-21T11:48:34.155 DEBUG:teuthology.task.console_log:Killing console logger for smithi071 2021-10-21T11:48:34.156 DEBUG:teuthology.task.console_log:Killing console logger for smithi099 2021-10-21T11:48:34.156 DEBUG:teuthology.task.console_log:Killing console logger for smithi102 2021-10-21T11:48:34.157 DEBUG:teuthology.exit:Finished running handlers